JP5548643B2 - Operation device for in-vehicle equipment in automobile - Google Patents

Description

  The present invention relates to an imaging device for determining the illuminance of a surrounding environment using a camera capable of capturing both visible light and infrared images, and an operation device for an in-vehicle device in an automobile using the imaging device.

  Conventionally, an image pickup means for reading the shape and movement of an occupant's hand on a steering handle and an operation command means for outputting an operation command for an in-vehicle device based on the shape and movement of the hand read by the image pickup means are provided. A gesture remote control type operation device is known.

In such Zesu char remote-control operation device, separately example Bei the camera for camera and infrared for visible light as image pickup means, using the image captured by the camera for visible light in the daytime of high illumination, etc., low illuminance Patent Document 1 listed below discloses that the shape and movement of an occupant's hand can be read regardless of the illuminance in the passenger compartment by irradiating infrared rays at night and using an image captured by an infrared camera. More known. According to this, since the visible light camera does not sense infrared light, it is possible to determine the illuminance in the passenger compartment from the image captured by the visible light camera, and based on the determined illuminance, Irradiation and irradiation stop can be switched.

JP 2004-170873 A

  By the way, when a camera capable of capturing both visible and infrared images that has been put into practical use in recent years is adopted, it is possible to determine that the illuminance in the passenger compartment has decreased from the image and start the infrared irradiation. However, while performing infrared irradiation, the illuminance in the vehicle interior determined from the image becomes high regardless of the actual illuminance in the vehicle interior due to visible light, so know when to stop infrared irradiation. The problem of not being able to occur.

  The present invention has been made in view of the above-described circumstances, and it is intended to be able to accurately determine the illuminance of the surrounding environment even during infrared irradiation using a camera capable of capturing both visible and infrared images. Objective.

In order to achieve the above object, according to the first aspect of the present invention, an imaging device capable of imaging a steering handle provided with a plurality of marks, and imaging data output from the imaging device. On-vehicle in a vehicle, comprising: a determination unit capable of individually determining whether or not the mark is hidden; and an operation command unit that outputs an operation command to the on-vehicle device based on a determination result by the determination unit. An apparatus operating device, wherein the imaging device includes a camera capable of capturing both visible light and infrared images, an illuminance determination device that determines illuminance of the surrounding environment from the image, and the illuminance determination device includes the ambient environment When the illuminance of is determined to be less than the predetermined value includes an infrared irradiation unit for irradiating infrared rays, the infrared ray irradiation means is intermittently irradiating infrared rays, the illuminance Constant device vehicle equipment operation apparatus in a motor vehicle, characterized by determining the illuminance of the surrounding environment from the image when the infrared irradiation unit is not irradiated with infrared rays is proposed.

According to the invention described in claim 2, in addition to the configuration of claim 1, the illuminance determination device creates a brightness histogram of the image, and also calculates a high brightness area and a low brightness area from the brightness histogram. There is proposed an operating device for an in-vehicle device in an automobile , characterized in that the illuminance of the surrounding environment is determined based on an average value of data in an intermediate brightness area excluding data.

According to the invention described in claim 3, in addition to the configuration of claim 1 or claim 2, the illuminance at which the infrared irradiation means starts the infrared irradiation and the illuminance at which the infrared irradiation stops stops have hysteresis. An operating device for an in-vehicle device in an automobile characterized by having the above is proposed .

Note that the audio AU, the video DVD, and the car navigation CN of the embodiment correspond to the in-vehicle device of the present invention, and the recognition means C4 of the embodiment corresponds to the illuminance determination device of the present invention.

According to the configuration of the first aspect, the determination unit individually determines, for each mark, whether or not any of the plurality of marks is hidden based on the imaging data output from the imaging device. Since the means outputs an operation command for the in-vehicle device based on the determination result, not only can the operation command for the in-vehicle device be accurately output based on whether or not each mark is hidden from the imaging device, but also the operator's The operation procedure is easy to understand, and an erroneous operation due to an operator's recognition difference can be effectively prevented. Moreover, the determination logic in the operation command means is relatively simple and can contribute to cost savings, and can also perform arithmetic processing quickly.

In addition, the imaging device includes a camera that can capture both visible light and infrared images, an illuminance determination device that determines the illuminance of the surrounding environment from the image, and the illuminance determination device has an illuminance of the ambient environment that is less than a predetermined value. Since the infrared irradiation means for irradiating infrared light is provided when it is determined, even when the illuminance of the surrounding environment is low, imaging can be performed without any problem by irradiating the infrared light. Still further, the infrared irradiation means irradiates the infrared light intermittently, and the illuminance determination device determines the illuminance of the surrounding environment from the image when the infrared irradiation means is not irradiating the infrared light. It is possible to prevent the illuminance from being determined to be higher than the actual illuminance, and to improve the illuminance determination accuracy.

  According to the configuration of claim 2, the illuminance determination device creates a lightness histogram of an image, and based on the average value of the data of the intermediate lightness region excluding the data of the high lightness region and the low lightness region from the lightness histogram. Since the illuminance of the surrounding environment is determined, even if an extremely bright part or an extremely dark part exists in the image, the illuminance of the surrounding environment can be accurately determined without being affected by those parts.

According to the third aspect of the present invention, since the illuminance at which the infrared irradiation means starts the infrared irradiation and the illuminance at which the infrared irradiation is stopped have hysteresis, the infrared irradiation means performs the infrared irradiation and the irradiation stop at short time intervals. It is possible to prevent chattering from occurring repeatedly .

Schematic which shows the vehicle interior of a motor vehicle. The front view which looked at the instrument panel vicinity from the driver | operator side. FIG. 3 is an enlarged sectional view taken along line 3-3 in FIG. 2. The block diagram of a control system. Explanatory drawing which shows simply the switching operation process from the standby mode of an operation command means to the 1st operation mode. Explanatory drawing which shows simply the switching operation process from the 1st operation mode of the operation command means to the 2nd operation mode. Explanatory drawing which simplifies the operation process for canceling | releasing control of operation in vehicle with respect to vehicle equipment, and enabling manual operation to vehicle equipment by the passengers other than a driver | operator, even if it is drive | working. The block diagram which shows the logic which determines illumination intensity. The figure which shows an example of a brightness histogram. The step schematic diagram which shows the operation procedure for performing volume adjustment operation. The step schematic diagram which shows the operation procedure for performing source selection operation. The step schematic diagram which shows the operation procedure for performing selection operation of an album name and a song name. The step schematic diagram which shows the operation procedure for performing transfer operation to voice search mode.

  Hereinafter, embodiments of the present invention will be described with reference to FIGS.

  First, in FIG. 1 to FIG. 3, the instrument panel I in the passenger compartment includes various instruments such as a speedometer, a display unit L for in-vehicle devices such as an audio AU, a video DVD, and a car navigation CN, An operation unit 1 and the like for manually operating the devices AU, DVD, and CN are provided, and a steering handle S that is steered by the driver is disposed on the front side of the various instruments.

  The steering handle S includes a central hub portion Sa connected to a steering shaft (not shown), a rim portion Sm that surrounds the central hub portion Sa in an annular shape, and a connection between the rim portion Sm and the central hub portion Sa. Three spoke portions Sb1 to Sb3. A horn cover 2 is detachably attached to the outer surface of the central hub portion Sa, and a design-processed first H-shaped mark M1 is attached to the central outer surface of the horn cover 2.

  The spoke portions Sb1 to Sb3 are detachably mounted with a spoke cover 3 that covers the outer surfaces of the spoke portions Sb1 to Sb3. In the illustrated example, the spoke cover 3 is formed by forming a flexible sheet-like metal plate into a developed shape corresponding to the spoke portions Sb1 to Sb3, and an adhesive or adhesive for pasting is provided on the back surface thereof. A sheet is provided. When the spoke cover 3 is attached to the spoke portions Sb1 to Sb3, the cover 3 is wound and pasted so as to follow the outer surfaces of the spoke portions Sb1 to Sb3, and the free edge 3e of the cover 3 is attached to the spoke portion Sb1 to Sb3. As shown in FIG. 4, the spoke portions Sb1 to Sb3 are fixed to be bent inward.

  In the spoke cover 3, the second to fourth marks M2 to M4 (in the example shown, M2 corresponds to the volume mark, M3 corresponds to the source mark, and M4 corresponds to the select mark) on the portion corresponding to the left spoke portion Sb1. It is attached in a row by bonding or printing, and the spoke cover 3 corresponding to the right spoke portion Sb3 has fifth to seventh marks M5 to M7 (in the example shown, M5 is a voice mark and M6 is up). A mark, M7 corresponds to a down mark) is attached in a zigzag arrangement with the fifth mark M5 inward by adhesion or printing.

A monochrome camera CA, which is a component of the imaging device that can capture the marks M1 to M7, is installed at a suitable position in the passenger compartment, in the illustrated example, at a slightly obliquely rear ceiling portion of the driver. When the driver hides any of the marks M <b> 1 to M <b> 7, the camera CA outputs imaging data that makes it possible to clearly recognize that the mark is hidden to the electronic control unit ECU (see FIG. 4). In addition, when the vehicle interior becomes dark and imaging data of visible light cannot be obtained, the infrared irradiation means UR composed of LEDs that irradiate infrared light intermittently around the steering handle S at predetermined time intervals is provided by the camera CA. It is arrange | positioned at the ceiling part of near.

  In order that the first to seventh marks M1 to M7 and the driver's hand H can be easily recognized from the imaging data of the camera CA, the color of the steering wheel S is preferably a dark color system close to black. The 7 marks M1 to M7 are preferably black with white borders.

  As shown in FIG. 4, the electronic control unit ECU is installed in a suitable position in the vehicle interior, for example, inside the instrument panel I, which analyzes the imaging data output from the camera CA and analyzes the analysis data. Based on the determination means C1 that can individually determine whether the marks M1 to M7 are hidden for each of the marks M1 to M7, and on-vehicle equipment (that is, audio AU, video DVD, Operation command means C2 for outputting an operation command signal as an operation command for the car navigation CN), and a signal to be output to the in-vehicle equipment AU, DVD, CN by converting the output signal of the operation instruction means C2 into a drive signal for the in-vehicle equipment An output unit C3 and a recognition unit C4 capable of recognizing the occupant's hand H based on the imaging data output from the camera CA are provided.

  The camera CA is connected to each input side of the determination unit C1 and the recognition unit C4. Further, the output side of the determination means C1 and the recognition means C4, and the external operation section 1, the steering angle sensor SE1, and the vehicle speed sensor SE2 are connected to the input side of the operation command means C2. Furthermore, the output side of the operation command means C2 is connected to the input side of the signal output unit C3, and the in-vehicle devices AU, DVD, CN are connected to the output side of the signal output unit C3.

  The operation command means C2 selects either a standby mode in which the operation input of the in-vehicle equipment AU, DVD, CN can be performed by the external operation unit 1 or the first and second operation modes in which the operation input is prohibited. In the standby mode, marks other than the first mark M1 and the fifth mark M5 (that is, the second to fourth marks M2 to M4, the sixth mark M6, and the seventh mark M7) are hidden. However, the operation command means C2 does not respond, that is, no operation command is issued.

  The operation command means C2 is a state in which the vehicle is in a preset state (specifically, a steering angle operation of a predetermined angle or more when the operation command means C2 is in the first or second operation mode, or An operation of concealing any of the second to seventh marks M2 to M7 in a state where there is a sudden change in vehicle speed within a predetermined time, or for a certain period of time after switching to one of the first and second operation modes. The standby mode is automatically switched to the standby mode in response to a state in which the first mark M1 is hidden again despite being in the first or second operation mode. Change.

As shown in FIG. 8, the portion of the recognition means C4 that determines the illuminance of the passenger compartment is the visible light image selection means P1, the histogram creation means P2, the low / high brightness area deletion means P3, and the average value calculation means. P4 and illuminance determination means P5 are provided. The camera CA is connected to the visible light image selection means P1, the visible light image selection means P1 is connected to the histogram creation means P2, and the histogram creation means P2 is connected to the low / high brightness area deletion means P3, and the low / high brightness area The deletion means P3 is connected to the average value calculation means P4, the average value calculation means P4 is connected to the illuminance determination means P5, and the illuminance determination means P5 is connected to the infrared irradiation means UR. And an imaging device is provided with the recognition means C4 and infrared irradiation means UR as these cameras CA, and an illumination intensity determination apparatus.

  When the vehicle interior is dark and a clear image cannot be obtained with only visible light, the infrared irradiation means UR operates to irradiate infrared rays intermittently. Therefore, when the intermittent infrared irradiation by the infrared irradiation means UR is interrupted, the camera CA captures an image by visible light, and when the intermittent infrared irradiation by the infrared irradiation means UR is not interrupted, the camera CA Captures both visible and infrared images.

  The visible light image selection means P1 selects an image based on visible light when the intermittent infrared irradiation by the infrared irradiation means UR is interrupted, and outputs it to the histogram creation means P2 to determine the illuminance of the passenger compartment. In addition, the image by both visible rays and infrared rays when the intermittent infrared irradiation by the infrared irradiation means UR is not interrupted is used for recognizing the first to seventh marks M1 to M7. And the histogram creation means P2 extracts all the pixels of the image selected by the visible light image selection means P1 and arranges them for each brightness, thereby creating the brightness histogram shown in FIG.

The low / high brightness area deleting means P3 includes, for example, pixels of extremely low brightness, such as the lower part of the dashboard, and pixels of extremely high brightness, such as the monitor screen, among the pixels of the brightness histogram. delete. Subsequently, the average value calculation means P4 calculates the average value of the brightness of the pixels remaining without being deleted by the low / high brightness area deletion means P3, and compares the average value with a predetermined threshold value. Subsequently, if the average value is less than the threshold value, the illuminance determination means P5 determines that irradiation with infrared rays is necessary because the illuminance in the passenger compartment is low, and activates the infrared irradiation means UR. If it is equal to or greater than the threshold value, it is determined that infrared irradiation is unnecessary because the illuminance in the passenger compartment is high, and the operation of the infrared irradiation means UR is stopped.

For example, when the vehicle is once starts infrared irradiation to become dark cabin enters the interior of the tunnel, detected from the image to the vehicle even when bright inner casing exits the tunnel, infrared is irradiated However, according to the present embodiment, the infrared irradiation is intermittently performed and the infrared irradiation is interrupted. Since the illuminance in the vehicle interior is determined based on the image at that time, that is, the visible light image, it is possible to reliably determine the timing at which the interior of the vehicle is brightened and the infrared irradiation is stopped.

  In addition, a brightness histogram is created from the visible light image at that time, and the illuminance is determined based on the remaining pixels from which extremely low brightness pixels and extremely high brightness pixels are deleted. Accuracy can be increased.

  In addition, when the passenger compartment is dark and the infrared irradiation is started, the illuminance of the passenger compartment is determined from an arbitrary image because the image obtained before the start of the infrared irradiation is a visible light image. Can do.

  The threshold value of the illuminance for operating the infrared irradiation means UR is set lower than the threshold value of the illuminance for stopping the operation of the infrared irradiation means UR. It is possible to prevent chattering from occurring repeatedly.

  Thus, when the operation command means C2 is in the standby mode, the determination means C1 recognizes the contour (circle) of the steering body Sm as shown in FIG. 5 (A) based on the imaging data of the camera CA. Since the center first mark M1 is recognized as shown in FIG. 5B, the first mark M1 is recognized during the recognition as shown in FIG. 5C. When it is hidden by the driver's hand H, it can be recognized quickly and reliably, and the recognition result is output to the operation command means C2, whereby the means C2 is switched to the first operation mode.

  In addition, when the operation command means C2 is in the first or second operation mode, the determination means C1 displays the second to seventh marks M2 to M7 of the spoke portions Sb1 and Sb2, as shown in FIG. During the recognition, for example, a plurality of second marks (that is, the second to fifth marks M2 to M5) are hidden by the driver's hand H as shown in FIG. If this happens, this can be recognized quickly and reliably, and the operation command means C2 switches to the second operation mode based on the recognition result. Further, in the second operation mode, a plurality of third marks (namely, sixth and seventh marks M6 and M7) are hidden by the driver's hand H as shown in FIG. This can be quickly and reliably recognized, and the recognition result is output to the operation command means C2.

  Further, the recognizing unit C4 recognizes the contour of the steering body Sm as a monitoring target range as shown in FIG. 7A based on the imaging data of the camera CA, regardless of the mode of the operation command unit C2. Yes. The operation command means C2 does not recognize that the recognition means C4 has two hands H on the rim portion Sm when it determines that the vehicle is running based on the detection signal of the vehicle speed sensor SE2. In this case, at least a part of the operation signal from the operation unit 1 is invalidated, but the recognition means C4 recognizes that there are two hands H on the rim portion Sm as shown in FIG. In some cases, the operation signal is not invalidated.

  Therefore, during traveling, at least a part of manual operation to the operation unit 1 of the in-vehicle devices AU, DVD, CN can be invalidated from the viewpoint of safe driving as in the past. However, if the recognition means C4 recognizes that there are two hands H on the rim portion Sm even when the vehicle is traveling, even if an operation signal is output from the operation unit 1, it is determined by an occupant other than the driver. Since it can be considered that the vehicle has been operated, the operation command means C2 does not invalidate the operation signal, and enables operations by passengers other than the driver. As a result, even when the vehicle is running, if the driver holds the steering wheel S with both hands H, passengers other than the driver can operate the in-vehicle devices AU, DVD, CN, which is convenient and convenient. Improves.

  The operation command means C2 switches to the first operation mode based on the determination by the determination means C1 that the first mark M1 is hidden when the operation command means C2 is in the standby mode. By obscuring one of the fifth marks M2 to M5, an operation target in the in-vehicle device (in the illustrated example, “volume”, “source” for selecting video / audio, “select” for selecting album name / song name, “Voice” for selecting the voice search mode of the car navigation system can be arbitrarily selected.

  Further, the operation command means C2 switches to the second operation mode when the determination means C1 determines that any of the second to fifth marks M2 to M5 is hidden when it is in the first operation mode. Instead, in the second operation mode, one of the plurality of operation parameters related to the operation object can be selected by hiding one of the sixth and seventh marks M6 and M7. The operation parameter means an operation content to be selected and operated more specifically by the operator in relation to the operation target. In the illustrated example, “volume” is selected because the second mark M2 is hidden. In such a case, hiding the sixth mark M6 corresponds to “volume up” and hiding the seventh mark M7 corresponds to “volume down”.

  Further, when the “source” is selected because the third mark M3 is hidden, hiding the sixth mark M6 is “one-way forward” of OFF / video / audio, and the seventh mark M7 is hidden. Corresponds to “forward feed in other directions”.

  Further, when “Select” is selected because the fourth mark M4 is hidden, the sixth mark M6 is hidden for a long time (for example, 2 seconds) by “one-way forward” in the album name, and the sixth mark Concealing M6 shortly means “one-way forward” of the song name, hiding the seventh mark M7 long (for example, 2 seconds), concealing the album name “forward-forwarding”, and concealing the seventh mark M7 shortly Corresponds to the song title “forward in the other direction”.

Next, the operation procedure of the operating device will be described more specifically with reference to FIGS.
[1] Volume adjustment operation When the operation command means C2 is in the standby mode, the display portion L is a normal car navigation screen as shown in step S10 of FIG. When M1 is concealed (step S11), the display of the marks M2 to M5 to be selected next is highlighted in the lower half of the screen together with the announcement “please operate” (step S12). If the second mark M2 is hidden (step S13), the display of the marks M6 and M7 to be selected next is highlighted in the lower half of the screen together with the announcement of “volume” (step S14), and then for a predetermined time (for example, After 3 seconds, the current volume display appears (step S15). Therefore, when either the sixth mark M6 or the seventh mark M7 is hidden (step S16), the volume adjustment is executed corresponding to the hidden mark, and the volume display after the adjustment appears (step S17).
[2] Source Selection Operation As shown in FIG. 11, steps S20 to S22 are the same as steps S10 to S12. When the third mark M3 is hidden from the state of step S22 (step S23), “source” The display of the marks M6 and M7 to be selected next is highlighted in the lower half of the screen together with the “selection” announcement (step S24), and when a predetermined time (for example, 3 seconds) elapses, the current source display (in the figure, “OFF” selection display) appears (step S25). Therefore, when either the sixth mark M6 or the seventh mark M7 is hidden (step S26), OFF video / audio is forwarded in one direction or the other direction corresponding to the hidden mark, and “source selection 〇〇 A source display after the selection appears together with the announcement “OO” (step S27).
[3] Album Name / Song Title Selection Operation As shown in FIG. 12, steps S30 to S32 are the same as steps S10 to S12. If the fourth mark M4 is hidden from the state of step S32 (step S33). ), Along with the announcement of “album name / song name selection”, the display of the marks M6 and M7 to be selected next is highlighted in the lower half of the screen (step S34), and then when a predetermined time (for example, 3 seconds) has passed, The album name / song title source display appears at (Step S35). Therefore, if one of the sixth mark M6 and the seventh mark M7 is hidden for a long time (for example, 2 seconds), the album name is forwarded in one direction or forward in the other direction (step S36), and the sixth mark M6 or If any of the seventh marks M7 is briefly hidden, one-way forward or other-direction forward of the song title is executed (step S36), and the newly selected album name / song title display appears along with the execution (step S36). Step S37). If the display is left for a predetermined time (for example, 5 seconds), the newly selected album name / song title is confirmed.
[4] Operation for Shifting to Voice Search Mode As shown in FIG. 13, steps S40 to S42 are the same as steps S10 to S12. When the operator hides the fifth mark M5 from the state of step S42. (Step S43) Along with the announcement of “voice search”, the car navigation CN can be shifted to a conventionally known voice search mode.

  According to the present embodiment described above, the determination unit C1 that can individually determine for each mark whether or not the plurality of marks M1 to M7 are hidden based on the imaging data output from the camera CA, and the determination Since the operation command means C2 for outputting an operation command (operation command signal) for the in-vehicle devices AU, DVD, CN based on the determination result by the means C1, each mark M1 to M7 is set by the operator's hand H with the camera CA. In addition to accurately outputting operation commands for in-vehicle devices AU, DVD, and CN based on whether or not they are hidden from the user, the operator's operation procedure is easy to understand, and erroneous operation due to a difference in operator's recognition can be effectively prevented. Become.

  In addition, the determination logic in the operation command means C2 is relatively simple, so that cost savings can be achieved and calculation processing can be performed quickly. The plurality of marks M1 to M7 are provided on a to-be-attached member (a horn cover 2 and a spoke cover 3 that can be attached to and detached from the steering wheel S in the illustrated example) and is read by the covers 2 and 3 and the steering wheel S. It is not necessary to make a special through-hole, so that it is relatively easy to respond to the option of retrofitting, and the degree of freedom of the installation positions of the marks M1 to M7 and the camera CA is also relatively high, and further the steering. The driver with S can easily and quickly perform the operation of hiding the marks M1 to M7 at hand.

  In addition, the operator can quickly and surely switch the operation command means C2 from the standby mode to the first operation mode by simply hiding the first mark M, and in the first operation mode, a plurality of By simply hiding one of the marks M2 to M5, it is possible to quickly and reliably select an operation target in the in-vehicle device AU, DVD, CN. Further, when the operation command means C2 is in the second operation mode, the operator simply hides one of the sixth and seventh marks M6 and M7, and specifies a plurality of operation parameters to be specified in relation to the operation target. That is, one of the operation contents can be selected quickly and reliably.

  By the way, the operation command means C2 is a state in which the vehicle is set in advance when the means is in one of the operation modes (specifically, a state in which a steering angle operation of a predetermined angle or more has been performed, or a rapid vehicle speed within a predetermined time). A state in which there has been a change, or a state in which the second to seventh marks M2 to M7 have not been hidden for a certain period of time after switching to one of the first and second operation modes, or the first or second The state is automatically switched to the standby mode in response to the operation of the first mark M1 being hidden again despite being in the operation mode. As a result, in special driving conditions that should be devoted to driving, such as when driving on a curve or sudden acceleration, or when the driver wants to return to standby mode immediately after leaving it for a certain period of time. In addition, since the operation command means C2 can be automatically returned to the standby mode, it is possible to reliably prevent the operation command means C2 from outputting a command due to an erroneous operation by the operator in those cases.

  Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and various design changes can be made without departing from the present invention described in the claims. Is possible.

  For example, in the embodiment, the recognition unit C4 has the function of an illuminance determination device, but an illuminance determination device independent of the recognition unit C4 may be provided.

  In the present invention, an audio device such as an audio AU, a video DVD, a car navigation system CN, etc. are shown. However, in the present invention, the operation object is set to other in-vehicle devices such as an air conditioner such as an air conditioner, a television, Also good.

  In the embodiment, the operation command means C2 outputs an operation command (operation command signal) for the in-vehicle devices AU, DVD, CN based on the determination result of the determination means C1 that the marks M1 to M7 are hidden. In the present invention, based on the determination logic that combines the determination result of the determination unit C1 that the marks M1 to M7 are hidden and the result of the recognition unit C4 recognizing the hand H. You may make it output the operation command (operation command signal) with respect to vehicle equipment AU, DVD, CN. Even in this case, since the recognition unit C4 only identifies the hand H from a body part (head, arm, etc.) other than the hand H, the determination logic is not complicated as in the prior art.

AU audio (vehicle equipment)
C1 determination means C2 operation command means C4 recognition means (illuminance determination device)
CA camera (imaging means)
CN car navigation (in-vehicle equipment)
DVD video (on-vehicle equipment)
M1 to M7 Multiple marks S Steering handle UR Infrared irradiation means

Claims (3)

An imaging device capable of imaging the steering handle (S) provided with a plurality of marks (M1 to M7), and whether or not the marks (M1 to M7) are hidden based on imaging data output from the imaging device A determination means (C1) capable of individually determining whether or not each mark (M1 to M7), and an operation command for the in-vehicle device (AU, DVD, CN) are output based on the determination result by the determination means (C1). An operation device for an in-vehicle device in an automobile, comprising an operation command means (C2),
The imaging device includes a camera (CA) that can capture both visible and infrared images, an illuminance determination device (C4) that determines the illuminance of the surrounding environment from the image, and the illuminance determination device (C4). Infrared irradiation means (UR) for irradiating infrared rays when it is determined that the illuminance of the environment is less than a predetermined value ,
The infrared irradiation means (UR) irradiates infrared rays intermittently, and the illuminance determination device (C4) determines the illuminance of the surrounding environment from the image when the infrared irradiation means (UR) is not irradiating infrared rays. An operating device for an in-vehicle device in an automobile . The illuminance determination device (C4) creates a brightness histogram of the image and illuminates the surrounding environment based on an average value of intermediate brightness area data obtained by excluding data of a high brightness area and a low brightness area from the brightness histogram. The apparatus for operating an in-vehicle device in an automobile according to claim 1, wherein: The illuminance at which the infrared irradiation means (UR) starts the infrared irradiation and the illuminance at which the infrared irradiation stops stops have hysteresis, and the operation of the in-vehicle device in the automobile according to claim 1 or 2, apparatus.

Images