JP5342587B2 - Operation device for in-vehicle equipment in automobile - Google Patents

Description

The present invention relates to an operation device of the in-vehicle equipment in automobiles.

  Conventionally, an image pickup means such as a CCD camera for reading the position and movement of an occupant's hand on the steering handle, and an operation command that can output an operation command for on-vehicle equipment based on the position and movement of the hand read by the image pickup means There is known a gesture remote control type operating device provided with means.

  For example, Patent Literature 1 below describes an operator's gesture, that is, an operation command that outputs an operation command for an in-vehicle device based on a hand position or a hand movement.

  Further, in Patent Document 2 below, the operation of the gesture remote controller is prevented from being erroneously started by starting the operation of the gesture remote controller in response to the through hole provided in the steering wheel being blocked by the driver's hand. Is described.

Japanese Patent No. 3914786 JP 2006-31347 A

  However, the technique described in Patent Document 1 not only complicates the judgment logic for the gesture, but also makes it difficult to accurately read the position and movement of the operator's hand. Since the difference cannot be clearly identified, there are inconveniences such as the gesture remote control being erroneously started due to a reading error or an erroneous operation command being output to the in-vehicle device.

  In addition, it is necessary to provide a through hole in the steering from the manufacturing stage for the one described in Patent Document 2, and it is difficult to deal with the option of retrofitting, and the installation of an imaging means for reading the installation position of the through hole and the blocking state of the hole There are inconveniences such as large positional restrictions. In addition, after the operation of the gesture remote controller is started, the operator's gesture is read and an operation command is output in the same manner as described in Patent Document 1, so that the determination logic becomes complicated and reading errors easily occur. In some cases, an incorrect operation command was output to the device.

  Therefore, a plurality of marks are provided on the steering handle, and when it is determined from the image data of the imaging means that these marks are hidden by the operator's hand, a predetermined operation command can be output to the in-vehicle device. Conceivable.

  However, when configured in this way, if the driver accidentally hides two or more marks while trying to hide one mark, both the operation command intended by the driver and the unintended operation command are output, Only an operation command that is not intended by the driver may be output, which may cause the driver to feel uncomfortable.

  The present invention has been made in view of the above circumstances, and an operation command unintended by the driver is output when two or more of a plurality of marks provided in the passenger compartment are simultaneously hidden. The purpose is to prevent.

To achieve the above object, according to the first aspect of the present invention, the imaging means capable of imaging the spoke portions on the left and right sides of the steering handle, and the imaging data output from the imaging means , Determining means capable of individually determining for each mark whether or not a plurality of marks provided on the left and right spoke portions are hidden by the driver's hand, and an operation command for the in-vehicle device based on the determination result by the determining means have an operation command means for outputting a, when the above prior Symbol judging means one second of said plurality of marks is determined to have been hidden at the same time, as the operation command unit does not output the operation command An on-vehicle device operating device in an automobile, wherein the left reference mark is placed around the plurality of marks provided on the left spoke portion on the left spoke portion. The right-side spoke part is provided with right-side reference marks around a plurality of marks provided on the right-side spoke part, and the left and right side reference marks are arranged at the center when the steering handle is in the neutral position. Is disposed symmetrically with respect to a vertical plane passing through the vehicle, and is disposed at a position where a finger cannot reach when the driver places his / her hand on the rim portion of the steering handle. By recognizing the reference marks on the left and right sides based on the data, the center position of the steering wheel and the rotation angle from the neutral position of the steering wheel are detected, and the plurality of the spoke portions on the left and right side spoke parts are detected from the detection result. An on- vehicle equipment operating device in an automobile is proposed, characterized in that each mark position can be estimated .

  The audio AU, the video DVD, and the car navigation CN of the embodiment correspond to the in-vehicle device of the present invention, and the camera CA of the embodiment corresponds to the imaging unit of the present invention.

According to the first aspect, the operation command means when the determine constant means more twofold of the plurality of marks is determined to have been hidden at the same time does not output the operation command, the two operation command is output at the same time It is possible to prevent the driver from feeling uncomfortable by outputting an operation command that is not intended by the driver.

In particular, the left spoke portion is provided with a left reference mark around the plurality of marks provided therein, and the right spoke portion is provided with a right reference mark around the plurality of marks provided there, The reference marks on both the left and right sides are arranged symmetrically with respect to the vertical plane passing through the center of the steering handle when it is in the neutral position, and are indicated when the driver places his hand on the rim of the steering handle. The determination means recognizes the left and right reference marks respectively provided on the left and right spoke portions of the steering handle based on the imaging data of the imaging means, and thereby determines the center position of the steering handle and the same handle. The left and right rotation angles from the neutral position can be detected, and the detection results indicate the positions of multiple marks on the left and right spokes. Since it is possible to estimate, while saving calculation time and calculation load of the computer, it becomes possible to accurately estimate the positions of the left and right spoke portions of the plurality of marks in a short time. That is, in order to directly identify the positions of a plurality of marks from the imaged data, it is necessary to analyze the imaged data by complex image processing, which increases the computation time and computation load of the computer. Then, such a problem is solved and each position of the left and right spoke portions of a plurality of marks can be estimated accurately in a short time.

Schematic which shows the vehicle interior of a motor vehicle. The front view which looked at the instrument panel vicinity from the driver | operator side. FIG. 3 is an enlarged sectional view taken along line 3-3 in FIG. 2. The block diagram of a control system. Explanatory drawing which shows simply the switching operation process from the standby mode of an operation command means to the 1st operation mode. Explanatory drawing which shows simply the switching operation process from the 1st operation mode of the operation command means to the 2nd operation mode. Explanatory drawing which simplifies the operation process for canceling | releasing control of operation in vehicle with respect to vehicle equipment, and enabling manual operation to vehicle equipment by the passengers other than a driver | operator, even if it is drive | working. Explanatory drawing which shows the method of the image processing of a reference mark. The figure explaining the effect | action of the 1st-7th mark. Explanatory drawing of operation when one mark is simultaneously hidden by the left and right hands.

  Hereinafter, embodiments of the present invention will be described with reference to FIGS.

  First, in FIG. 1 to FIG. 3, the instrument panel I in the passenger compartment includes various instruments such as a speedometer, a display unit L for in-vehicle devices such as an audio AU, a video DVD, and a car navigation CN, An operation unit 1 and the like for manually operating the devices AU, DVD, and CN are provided, and a steering handle S that is steered by the driver is disposed on the front side of the various instruments.

  The steering handle S includes a central hub portion Sa connected to a steering shaft (not shown), a rim portion Sm that surrounds the central hub portion Sa in an annular shape, and a connection between the rim portion Sm and the central hub portion Sa. Three spoke portions Sb1 to Sb3. A horn cover 2 is detachably attached to the outer surface of the central hub portion Sa, and a design-processed first H-shaped mark M1 is attached to the central outer surface of the horn cover 2.

  The spoke portions Sb1 to Sb3 are detachably mounted with a spoke cover 3 that covers the outer surfaces of the spoke portions Sb1 to Sb3. In the illustrated example, the spoke cover 3 is formed by forming a flexible sheet-like metal plate into a developed shape corresponding to the spoke portions Sb1 to Sb3, and an adhesive or adhesive for pasting is provided on the back surface thereof. A sheet is provided. When the spoke cover 3 is attached to the spoke portions Sb1 to Sb3, the cover 3 is wound and pasted so as to follow the outer surfaces of the spoke portions Sb1 to Sb3, and the free edge 3e of the cover 3 is attached to the spoke portion 3 as shown in FIG. As shown in FIG. 4, the spoke portions Sb1 to Sb3 are fixed to be bent inward.

  In the spoke cover 3, the second to fourth marks M2 to M4 (in the example shown, M2 corresponds to the volume mark, M3 corresponds to the source mark, and M4 corresponds to the select mark) on the portion corresponding to the left spoke portion Sb1. The portion of the spoke cover 3 corresponding to the spoke portion Sb3 on the right side is provided with fifth to seventh marks M5 to M7 (M5 is a mute mark, M6 is an up mark, M7 corresponds to a down mark) is attached by adhesion or printing.

  Of the second to fourth marks M2 to M4, the second mark M2 (volume mark) and the fourth mark M4 (select mark) are arranged on the radially outer side of the steering handle S, and the third mark M3 (source mark) is Of the second mark M2 (volume mark) and the fourth mark M4 (select mark) that are arranged on the inner side in the radial direction and are on the same circumference, the second mark M2 (volume mark) is arranged on the upper side and the fourth mark M4 (select mark) is arranged on the lower side. Among the fifth to seventh marks M5 to M7, the sixth mark M6 (up mark) and the seventh mark M7 (down mark) are arranged on the outer side in the radial direction of the steering wheel S, and the fifth mark M5 (mute mark). Of the sixth mark M6 (up mark) and the seventh mark M7 (down mark) on the same circumference, the sixth mark M6 (up mark) is arranged on the upper side and the seventh mark A mark M7 (down mark) is arranged on the lower side.

  An infrared reflective material (recursive) that strongly reflects infrared rays at a position corresponding to the left spoke portion Sb1 of the spoke cover 3 and radially inward of the steering wheel S relative to the second to fourth marks M2 to M4. An L-shaped reference mark Ms made of a reflective material is provided. Similarly, the portion corresponding to the spoke portion Sb3 on the right side of the spoke cover 3 and at the radially inner position of the fifth to seventh marks M5 to M7 is made of an infrared reflecting material that strongly reflects infrared rays. A character-shaped reference mark Ms is provided. When the steering handle S is in the neutral position, the left and right reference marks Ms and Ms are arranged symmetrically with respect to the vertical plane passing through the center thereof. The reference marks Ms and Ms are not only arranged on the inner side in the radial direction of the steering handle S than the second to seventh marks M2 to M7, but also when the driver puts his hand on the rim portion Sm of the steering handle S. It is arranged at a position sufficiently away from the rim portion Sm so that the finger does not reach.

  The color of the spoke cover 3 is a dark color (for example, black) and the color of the reference marks Ms and Ms is a light color (for example, black) so that the positions and shapes of the reference marks Ms and Ms can be easily identified from imaging data of a camera CA described later. White). On the other hand, since it is not necessary to identify the positions and shapes of the first to seventh marks M1 to M7 from the imaging data of the camera CA, those colors are arbitrary as long as they are dark colors. Since it is necessary to recognize the positions of the marks M1 to M7 and hide them by hand, it is desirable that the color be easily recognizable by the driver.

  A monochrome camera CA serving as an imaging unit capable of imaging each of the marks M1 to M7 is installed at a suitable position in the passenger compartment, in the illustrated example, at a ceiling slightly behind the driver. The camera CA can clearly recognize the image data that can recognize the positions and shapes of the reference marks Ms and Ms, and when any one of the marks M1 to M7 is hidden by the driver. The imaging data is output to the electronic control unit ECU (see FIG. 4).

  As shown in FIG. 4, the electronic control unit ECU is installed in a suitable position in the vehicle interior, for example, inside the instrument panel I, which analyzes the imaging data output from the camera CA and analyzes the analysis data. Based on the determination means C1 that can individually determine whether the marks M1 to M7 are hidden for each of the marks M1 to M7, and on-vehicle equipment (that is, audio AU, video DVD, Operation command means C2 for outputting an operation command signal as an operation command for the car navigation CN), and a signal to be output to the in-vehicle equipment AU, DVD, CN by converting the output signal of the operation instruction means C2 into a drive signal for the in-vehicle equipment An output unit C3 and a recognition unit C4 capable of recognizing the occupant's hand H based on the imaging data output from the camera CA are provided.

  The camera CA is connected to each input side of the determination unit C1 and the recognition unit C4. Further, the output side of the determination means C1 and the recognition means C4, and the external operation section 1, the steering angle sensor SE1, and the vehicle speed sensor SE2 are connected to the input side of the operation command means C2. Furthermore, the output side of the operation command means C2 is connected to the input side of the signal output unit C3, and the in-vehicle devices AU, DVD, CN are connected to the output side of the signal output unit C3.

  The operation command means C2 selects either a standby mode in which the operation input of the in-vehicle equipment AU, DVD, CN can be performed by the external operation unit 1 or the first and second operation modes in which the operation input is prohibited. In the standby mode, marks other than the first mark M1 and the fifth mark M5 (that is, the second to fourth marks M2 to M4, the sixth mark M6, and the seventh mark M7) are hidden. However, the operation command means C2 does not respond, that is, no operation command is issued.

  Further, the operation command means C2 is a state set in advance in the vehicle when the operation command means C2 is in the first or second operation mode, that is, a state in which the steering angle operation is greater than a predetermined angle, or within a predetermined time. An operation of hiding any of the second to seventh marks M2 to M7 for a certain time (for example, 8 seconds) or more after a state in which the vehicle speed has changed suddenly or after switching to one of the first and second operation modes. In the state where the first mark M1 is hidden again despite being left or in the first or second operation mode, the mode is automatically switched to the standby mode.

  Thus, in the state where the operation command means C2 is in the standby mode, the determination means C1 is based on the imaging data of the camera CA, as shown in FIG. 5A, the pair of reference marks Ms, Ms of the steering wheel S. Is detected, the center position of the steering wheel S and the left and right rotation angles from the neutral position are detected. As will be described later, the determination unit C1 estimates the positions of the first to seventh marks M1 to M7 from the center position and the rotation angle of the steering wheel S. Since the positional relationship between the reference marks Ms and Ms and the first to seventh marks M1 to M7 with respect to the steering handle S is known, if the positions of the reference marks Ms and Ms are known, the center position of the steering handle S can be known. If the rotation angle of S is known, the positions of the first to seventh marks M1 to M7 can be estimated.

  Next, the recognition of the reference mark Ms and the detection of the angle of the reference mark Ms (the rotation angle of the steering wheel S) will be described based on FIG.

  The L-shaped reference mark Ms includes five convex portions a and one concave portion b. First, the convex portions a and the concave portions b are extracted from the imaging data of the camera CA. Then, the pixel corresponding to the edge of the reference mark Ms is checked clockwise as indicated by an arrow, for example. The white pixels in the figure correspond to the reference mark Ms, and the black pixels correspond to the background spoke cover 3. Each pixel is in contact with the surrounding eight pixels. If five of the pixels are white, the pixel is present in the straight line portion of the reference mark Ms. For example, in the pixels P1 and P2, five of the surrounding eight pixels are white and exist in the straight line portion of the reference mark Ms. In addition, in the pixels P3 and P4, seven of the surrounding eight pixels are white, and are present in the recess b of the reference mark Ms. In P5 to P7, 3 to 4 pixels out of the surrounding 8 pixels are white, and are present on the convex portion a of the reference mark Ms.

  Therefore, the pixels corresponding to the edge of the reference mark Ms can be determined to be the pixels corresponding to the recess b if 6 or more of the 8 surrounding pixels are white. If four or less of the pixels are white, it can be determined that the pixel corresponds to the convex portion a, and therefore the positions of the convex portion a and the concave portion b of the reference mark Ms can be specified.

  Thus, if a high-brightness object recognized from the imaging data includes five convex portions a and one concave portion b, it can be determined that the object is the reference mark Ms. For example, the rotation angle of the steering wheel S can be detected from the position of the recess b of the right reference mark Ms and the position of the recess b of the left reference mark Ms. Further, even when only one of the left and right reference marks Ms and Ms can be recognized, the steering is determined based on the positional relationship between any two of the total six convex portions a and concave portions b of the recognized reference mark Ms. The rotation angle of the handle S can be detected. However, in this case, since the distance between the two convex portions a or the concave portion b to be employed is smaller than the distance between the left and right reference marks Ms and Ms, the detection accuracy of the rotation angle of the steering wheel S is slightly lowered.

  In addition, although the reference marks Ms and Ms of the present embodiment are formed in an L shape, the shape is not limited to the L shape, and other shapes such as a T shape and an E shape may be used. Also good. That is, the reference marks Ms and Ms need not be rotationally symmetric figures. A rotationally symmetric figure is a figure that overlaps itself when rotated by (360 / n) ° around its center when n is a natural number of 2 or more. The reference marks Ms and Ms are recognized at predetermined time intervals. However, if for some reason both the left and right reference marks Ms and Ms cannot be recognized, recognition is attempted again in the next cycle.

  The position of the steering wheel S can be adjusted according to the physique and preference of the driver, but the center position of the steering wheel S can be specified by specifying the positions of the left and right reference marks Ms and Ms as described above. can do. Since the positions of the first to seventh marks M1 to M7 in the steering handle S are known, if the center position of the steering handle S and the rotation angle of the steering handle S are determined, the first to seventh marks M1 to M7 are determined. Can be estimated.

  In order to directly identify the positions of the first to seventh marks M1 to M7 from the imaged data, it is necessary to analyze the imaged data by complicated image processing, which causes a problem that the computation time and computation load of the computer increase. . However, as in the present embodiment, the positions of the first to seventh marks M1 to M7 are estimated based on the reference marks Ms and Ms, so that the calculation time and calculation load of the computer are reduced and the first to seventh marks are reduced. It becomes possible to accurately estimate the positions of the marks M1 to M7 in a short time.

  Next, functions of the first to seventh marks M1 to M7 will be described with reference to FIGS.

  Since the determination means C1 recognizes the center first mark M1 as shown in FIG. 5B, during this recognition, the first mark M1 is displayed as shown in FIG. Can be recognized quickly and reliably, and the result of the recognition is output to the operation command means C2, whereby the means C2 switches from the standby mode to the first operation mode.

  Further, the determination means C1 can determine that the fifth mark M5 (mute mark) is hidden by the driver's hand in any of the standby mode, the first operation mode, and the second operation mode. It is. Therefore, in any of the above states, when the fifth mark M5 is hidden by the driver's hand, the volume of the in-vehicle device AU, DVD, CN becomes zero, and the fifth mark M5 is hidden again by the driver's hand. The volume returns to its original state. The reason that the fifth mark M5 is always recognized by the driver's hand is that the volume of the in-vehicle devices AU, DVD, CN can be quickly reduced to zero when an in-vehicle hands-free call is made. This is to make it possible to answer the phone.

  Only the first mark M1 and the fifth mark M5 (mute mark) are set to so-called “long press”, which is recognized when the mark is hidden for 1 to 1.5 seconds, for example. The 2nd to 4th marks M2 to M4, the 6th mark M6, and the 7th mark M7 are set to a so-called “chon push” that is recognized when they are hidden for 0.5 seconds to 0.8 seconds, for example. Yes.

  In addition, when the operation command means C2 is in the first or second operation mode, the determination means C1 displays the second to seventh marks M2 to M7 of the spoke portions Sb1 and Sb2, as shown in FIG. Therefore, during this recognition, if any of the second to fifth marks M2 to M5 is hidden by the driver's hand H as shown in FIG. Recognition can be performed quickly and reliably, and the operation command means C2 switches to the second operation mode based on the recognition result. Furthermore, in the state of the second operation mode, it is possible to quickly and surely recognize that any of the sixth and seventh marks M6 and M7 is hidden by the driver's hand H as shown in FIG. The recognition result is output to the operation command means C2.

  Further, the operation command means C2 does not recognize that the recognition means C4 has two hands H on the rim portion Sm when it determines that the vehicle is running based on the detection signal of the vehicle speed sensor SE2. In this case, at least a part of the operation signal from the operation unit 1 is invalidated. However, when the recognition unit C4 recognizes that there are two hands H on the rim portion Sm as shown in FIG. It is configured not to invalidate the operation signal.

  Therefore, during traveling, at least a part of manual operation to the operation unit 1 of the in-vehicle devices AU, DVD, CN can be invalidated from the viewpoint of safe driving as in the past. However, if the recognition means C4 recognizes that there are two hands H on the rim portion Sm even when the vehicle is traveling, even if an operation signal is output from the operation unit 1, it is determined by an occupant other than the driver. Since it can be considered that the vehicle has been operated, the operation command means C2 does not invalidate the operation signal, and enables operations by passengers other than the driver. As a result, even when the vehicle is running, if the driver holds the steering wheel S with both hands H, passengers other than the driver can operate the in-vehicle devices AU, DVD, CN, which is convenient and convenient. Improves.

  The operation command unit C2 switches to the first operation mode based on the determination unit C1 determining that the first mark M1 is hidden when it is in the standby mode. In the first operation mode, one of the second to fourth marks M2 to M4 is hidden so that an operation target in the in-vehicle device (in the illustrated example, “volume”, “source” for selecting video / audio, album) "Select" to select the name / song name can be arbitrarily selected. Incidentally, at the beginning of switching to the first operation mode, “volume” is automatically selected from the “volume”, “source”, and “select”.

  Further, the operation command means C2 switches to the second operation mode when the determination means C1 determines that any one of the second to fourth marks M2 to M4 is hidden when it is in the first operation mode. Instead, in the second operation mode, one of the plurality of operation parameters related to the operation object can be selected by hiding one of the sixth and seventh marks M6 and M7.

  The operation parameter means an operation content to be selected and operated more specifically by the operator in relation to the operation target. In the illustrated example, “volume” is selected because the second mark M2 is hidden. In such a case, hiding the sixth mark M6 corresponds to “volume up” and hiding the seventh mark M7 corresponds to “volume down”.

  Further, when the “source” is selected because the third mark M3 is hidden, hiding the sixth mark M6 is “one-way forward” of OFF / video / audio, and the seventh mark M7 is hidden. Corresponds to “forward feed in other directions”.

  Further, when “Select” is selected because the fourth mark M4 is hidden, the sixth mark M6 can be hidden in the “one-way forward” of the music or video, and the seventh mark M7 can be hidden. Corresponds to “forward in other directions” of music and videos.

  In the second operation mode, when the first mark M1 is hidden or the sixth mark M6 or the seventh mark M7 is not hidden for a predetermined time (for example, 8 seconds), the second operation mode To standby mode. In the first operation mode, when the first mark M1 is hidden or the state in which any one of the second to fourth marks M2 to M4 is not hidden continues for a predetermined time (for example, 8 seconds), Switch from the operation mode to standby mode.

  Incidentally, as shown in FIG. 10, any one of the second mark M2 (volume), the third mark M3 (source) and the fourth mark M4 (select) arranged on the left side of the steering handle S, and the steering wheel When any one of the fifth mark M5 (mute), the sixth mark M6 (up), and the seventh mark M7 (down) arranged on the right side of the handle S is simultaneously hidden, the determination unit C1 Determines that none of the marks are hidden. At this time, the hidden mark is not limited to that shown in FIG.

  As described above, according to the present embodiment, when the driver accidentally hides one mark with the left and right hands, the determination unit C1 determines that none of the marks are hidden. Since the operation command means C2 does not output an operation command, it can be prevented that two operation commands are output at the same time or an operation command unintended by the driver is output to give a sense of incongruity.

  Further, based on the imaging data output from the camera CA, determination means C1 capable of individually determining whether or not the plurality of marks M1 to M7 are hidden for each mark, and on-vehicle equipment based on the determination result by the determination means C1 The operation command means C2 for outputting an operation command (operation command signal) for AU, DVD, CN is provided. Not only can the operation commands for the devices AU, DVD, and CN be output accurately, the operator's operation procedure is easy to understand, and erroneous operation due to the operator's misrecognition can be effectively prevented.

  In addition, the determination logic in the operation command means C2 is relatively simple, so that cost savings can be achieved and calculation processing can be performed quickly. The plurality of marks M1 to M7 are provided on a to-be-attached member (a horn cover 2 and a spoke cover 3 that can be attached to and detached from the steering wheel S in the illustrated example) and is read by the covers 2 and 3 and the steering wheel S. It is not necessary to make a special through-hole, so that it is relatively easy to respond to the option of retrofitting, and the degree of freedom of the installation positions of the marks M1 to M7 and the camera CA is also relatively high, and further the steering. The driver with S can easily and quickly perform the operation of hiding the marks M1 to M7 at hand.

  In addition, the operator can quickly and surely switch the operation command means C2 from the standby mode to the first operation mode by simply hiding the first mark M, and in the first operation mode, a plurality of By simply hiding one of the marks M2 to M4, it is possible to quickly and reliably select an operation target in the in-vehicle device AU, DVD, or CN. Further, when the operation command means C2 is in the second operation mode, the operator simply hides one of the sixth and seventh marks M6 and M7, and specifies a plurality of operation parameters to be specified in relation to the operation target. That is, one of the operation contents can be selected quickly and reliably.

  Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and various design changes can be made without departing from the present invention described in the claims. Is possible.

  For example, although the first to seventh marks M1 to M7 are provided on the steering handle S in the embodiment, they may be provided at any position in the vehicle compartment such as an instrument panel.

  In the embodiments, the audio AU, the video DVD, the car navigation CN, etc. are operated by the operation device of the present invention. However, in the present invention, the operation object is an air conditioner such as an air conditioner such as an air conditioner. It may be a device, a television or the like.

  In the embodiment, the operation command means C2 outputs an operation command (operation command signal) for the in-vehicle devices AU, DVD, CN based on the determination result of the determination means C1 that the marks M1 to M7 are hidden. In the present invention, based on the determination logic that combines the determination result of the determination unit C1 that the marks M1 to M7 are hidden and the result of the recognition unit C4 recognizing the hand H. You may make it output the operation command (operation command signal) with respect to vehicle equipment AU, DVD, CN. Even in this case, since the recognition unit C4 only identifies the hand H from a body part (head, arm, etc.) other than the hand H, the determination logic is not complicated as in the prior art.

AU audio (vehicle equipment)
C1 determination means C2 operation command means CA camera (imaging means)
CN car navigation (in-vehicle equipment)
DVD video (on-vehicle equipment)
M2-M7 mark
Ms reference mark
S steering wheel
Sm rim
Sb1 left spoke part
Sb3 right spoke part

Claims (1)

Left and right side of the spoke portion of the steering wheel (S) (Sb1, Sb3) and the imaging means capable of capturing the (CA), on the basis of the imaging data outputted from the imaging means (CA), the right and left sides of the spokes ( Determination means (C1) capable of individually determining for each mark (M2 to M7) whether or not a plurality of marks (M2 to M7) provided in Sb1, Sb3) are hidden by the driver's hand; means vehicle equipment based on the by the determination result (C1) (AU, DVD, CN) have an operation and command means (C2) for outputting an operation command for the mark before Symbol judging means (C1) is of the plurality (M2 to M7) when two or more is determined to have been hidden at the same time of one of said operation command means (C2) is not to output the operation command, the vehicle-mounted device of the operating device in a motor vehicle There,
The left spoke portion (Sb1) has a left reference mark (Ms) around a plurality of marks (M2 to M4) provided on the left spoke portion (Sb1), and the right spoke portion (Sb3). The right reference mark (Ms) is provided around the plurality of marks (M5 to M7) provided on the right spoke portion (Sb3),
These left and right reference marks (Ms) are arranged symmetrically with respect to a vertical plane passing through the center of the steering handle (S) when the steering handle (S) is in a neutral position. Placed in a position where your fingers cannot reach when you put your hand on the rim (Sm)
The determination means (C1) recognizes the reference marks (Ms) on both the left and right sides based on the imaging data of the imaging means (CA), so that the center position of the steering handle (S) and the position of the steering wheel (S) are the same. It is possible to detect the rotation angle from the neutral position and to estimate the positions of the plurality of marks (M2 to M4, M5 to M7) in the spoke portions (Sb1, Sb3) on both the left and right sides from the detection result. A device for operating an in-vehicle device in an automobile.

Images