JP5484384B2 - Operation device for in-vehicle equipment in automobile - Google Patents

Description

The present invention relates to an operation device of the in-vehicle equipment in automobiles.

  Conventionally, an image pickup means such as a CCD camera for reading the position and movement of an occupant's hand on the steering handle, and an operation command that can output an operation command for on-vehicle equipment based on the position and movement of the hand read by the image pickup means There is known a gesture remote control type operating device provided with means.

  For example, Patent Literature 1 below describes an operator's gesture, that is, an operation command that outputs an operation command for an in-vehicle device based on a hand position or a hand movement.

  Further, in Patent Document 2 below, the operation of the gesture remote controller is prevented from being erroneously started by starting the operation of the gesture remote controller in response to the through hole provided in the steering wheel being blocked by the driver's hand. Is described.

Japanese Patent No. 3914786 JP 2006-31347 A

  However, the technique described in Patent Document 1 not only complicates the judgment logic for the gesture, but also makes it difficult to accurately read the position and movement of the operator's hand. Since the difference cannot be clearly identified, there are inconveniences such as the gesture remote control being erroneously started due to a reading error or an erroneous operation command being output to the in-vehicle device.

  In addition, it is necessary to provide a through hole in the steering from the manufacturing stage for the one described in Patent Document 2, and it is difficult to deal with the option of retrofitting, and the installation of an imaging means for reading the installation position of the through hole and the blocking state of the hole There are inconveniences such as large positional restrictions. In addition, after the operation of the gesture remote controller is started, the operator's gesture is read and an operation command is output in the same manner as described in Patent Document 1, so that the determination logic becomes complicated and reading errors easily occur. In some cases, an incorrect operation command was output to the device.

  Therefore, it is conceivable that a plurality of marks are provided on the steering wheel and a predetermined operation command is output to the in-vehicle device when it is determined from the imaging data of the imaging means that these marks are hidden by the operator's hand. It is done.

  However, with this configuration, if the driver accidentally hides two or more marks while trying to hide one mark, both the operation command intended by the driver and the unintended operation command are output, Only an operation command that is not intended by the driver may be output, which may cause the driver to feel uncomfortable.

  The present invention has been made in view of the above circumstances, and an operation command unintended by the driver is output when two or more marks out of a plurality of marks provided in the passenger compartment are hidden. The purpose is to prevent this.

To achieve the above object, according to the first aspect of the present invention, the imaging means capable of imaging the spoke portions on the left and right sides of the steering handle, and the imaging data output from the imaging means , Determining means capable of individually determining for each mark whether or not a plurality of marks provided on the left and right spoke portions are hidden by the driver's hand, and an operation command for the in-vehicle device based on the determination result by the determining means have an operation command means for outputting a, as before Symbol judging means when two or more marks is determined to have been hidden at the same time, for outputting an operation command the operation command means corresponding to any one of the marks The left-side reference mark is provided around the plurality of marks provided on the left-side spoke portion on the left-side spoke portion. The right spoke portion is provided with right reference marks around the plurality of marks provided on the right spoke portion, and the reference marks on both the left and right sides of the right and left reference marks, when the steering handle is in the neutral position, It is arranged symmetrically with respect to a vertical plane passing through the center, and is arranged at a position where a finger cannot reach when the driver puts his hand on the rim portion of the steering handle. By recognizing the reference marks on both the left and right sides based on the imaging data, the center position of the steering handle and the rotation angle from the neutral position of the handle are detected, and the detection results in the spoke portions on the left and right sides are detected. An operation device for an in-vehicle device in an automobile is proposed, which is capable of estimating the positions of a plurality of marks .

According to the invention described in claim 2, in addition to the configuration of claim 1, the reference mark is a figure that does not overlap with itself unless the reference mark is rotated 360 degrees around its center. An operating device for an in-vehicle device in an automobile is proposed.

According to the invention described in claim 3 , in addition to the configuration of claim 1 or claim 2 , the determination means includes two marks arranged on the radially outer side and the radially inner side of the steering handle at the same time. When it is determined that the operation command is hidden, the operation command means outputs an operation command corresponding to the mark arranged on the radially inner side.

According to the invention described in claim 4 , in addition to the configuration of claim 1 or claim 2 , the determination means is configured to simultaneously hide two marks arranged on the same circumference of the steering handle. When the determination is made, the operation command means outputs an operation command corresponding to the mark placed on the upper side, and the apparatus for operating an in-vehicle device in an automobile according to claim 1 is proposed.

  The audio AU, the video DVD, and the car navigation CN of the embodiment correspond to the in-vehicle device of the present invention, and the camera CA of the embodiment corresponds to the imaging unit of the present invention.

According to the first aspect, when the determine constant means more twofold of the plurality of marks is determined to have been hidden at the same time, since the operation command means for outputting an operation command corresponding to one of the marks, It can be prevented that a plurality of operation commands are output at the same time, or an operation command unintended by the driver is output to give an uncomfortable feeling.

In particular, the left spoke portion is provided with a left reference mark around the plurality of marks provided therein, and the right spoke portion is provided with a right reference mark around the plurality of marks provided there, The reference marks on both the left and right sides are arranged symmetrically with respect to the vertical plane passing through the center of the steering handle when it is in the neutral position, and are indicated when the driver places his hand on the rim of the steering handle. The determination means recognizes the left and right reference marks respectively provided on the left and right spoke portions of the steering handle based on the imaging data of the imaging means, and thereby determines the center position of the steering handle and the same handle. The left and right rotation angles from the neutral position can be detected, and the detection results indicate the positions of multiple marks on the left and right spokes. Since it is possible to estimate, while saving calculation time and calculation load of the computer, it becomes possible to accurately estimate the positions of the left and right spoke portions of the plurality of marks in a short time. That is, in order to directly identify the positions of a plurality of marks from the imaged data, it is necessary to analyze the imaged data by complex image processing, which increases the computation time and computation load of the computer. Then, such a problem is solved and each position of the left and right spoke portions of a plurality of marks can be estimated accurately in a short time.

According to the third aspect of the present invention, when the determination means determines that the two marks arranged on the radially outer side and the radially inner side of the steering handle are simultaneously hidden, the operation command means is arranged on the radially inner side. Since the operation command corresponding to the mark is output, it is possible to output an operation command that is highly likely to be intended by the driver. This is because the driver's finger extends from the radially outer side to the radially inner side, so there is a possibility of hiding the radially outer mark while trying to hide the radially inner mark, but hiding the radially outer mark. This is because the possibility of hiding the radially inner mark is low.

According to the fourth aspect of the present invention, when the determination means determines that the two marks arranged on the same circumference of the steering wheel are simultaneously hidden, the operation command means operates the operation corresponding to the mark arranged on the upper side. than you output a command, it is possible to output a high possibility that the driver intends operation command. Because the driver's finger extends from the lower side to the upper side, there is a possibility of hiding the mark placed on the lower side while trying to hide the mark placed on the upper side, but the mark placed on the lower side This is because it is unlikely that the mark placed on the upper side will be hidden in an attempt to hide it.

Schematic which shows the vehicle interior of a motor vehicle. The front view which looked at the instrument panel vicinity from the driver | operator side. FIG. 3 is an enlarged sectional view taken along line 3-3 in FIG. 2. The block diagram of a control system. Explanatory drawing which shows simply the switching operation process from the standby mode of an operation command means to the 1st operation mode. Explanatory drawing which shows simply the switching operation process from the 1st operation mode of the operation command means to the 2nd operation mode. Explanatory drawing which simplifies the operation process for canceling | releasing control of operation in vehicle with respect to vehicle equipment, and enabling manual operation to vehicle equipment by the passengers other than a driver | operator, even if it is drive | working. Explanatory drawing which shows the method of the image processing of a reference mark. The figure explaining the effect | action of the 1st-7th mark. Explanatory drawing of operation when two marks inside and outside in the radial direction are simultaneously hidden. Operation explanatory diagram when two mark Ru vertically near the hidden simultaneously.

  Hereinafter, embodiments of the present invention will be described with reference to FIGS.

  First, in FIG. 1 to FIG. 3, the instrument panel I in the passenger compartment includes various instruments such as a speedometer, a display unit L for in-vehicle devices such as an audio AU, a video DVD, and a car navigation CN, An operation unit 1 and the like for manually operating the devices AU, DVD, and CN are provided, and a steering handle S that is steered by the driver is disposed on the front side of the various instruments.

  The steering handle S includes a central hub portion Sa connected to a steering shaft (not shown), a rim portion Sm that surrounds the central hub portion Sa in an annular shape, and a connection between the rim portion Sm and the central hub portion Sa. Three spoke portions Sb1 to Sb3. A horn cover 2 is detachably attached to the outer surface of the central hub portion Sa, and a design-processed first H-shaped mark M1 is attached to the central outer surface of the horn cover 2.

  The spoke portions Sb1 to Sb3 are detachably mounted with a spoke cover 3 that covers the outer surfaces of the spoke portions Sb1 to Sb3. In the illustrated example, the spoke cover 3 is formed by forming a flexible sheet-like metal plate into a developed shape corresponding to the spoke portions Sb1 to Sb3, and an adhesive or adhesive for pasting is provided on the back surface thereof. A sheet is provided. When the spoke cover 3 is attached to the spoke portions Sb1 to Sb3, the cover 3 is wound and pasted so as to follow the outer surfaces of the spoke portions Sb1 to Sb3, and the free edge 3e of the cover 3 is attached to the spoke portion Sb1 to Sb3. As shown in FIG. 4, the spoke portions Sb1 to Sb3 are fixed to be bent inward.

  In the spoke cover 3, the second to fourth marks M2 to M4 (in the example shown, M2 corresponds to the volume mark, M3 corresponds to the source mark, and M4 corresponds to the select mark) on the portion corresponding to the left spoke portion Sb1. The portion of the spoke cover 3 corresponding to the spoke portion Sb3 on the right side is provided with fifth to seventh marks M5 to M7 (M5 is a mute mark, M6 is an up mark, M7 corresponds to a down mark) is attached by adhesion or printing.

  Of the second to fourth marks M2 to M4, the second mark M2 (volume mark) and the fourth mark M4 (select mark) are arranged on the radially outer side of the steering handle S, and the third mark M3 (source mark) is Of the second mark M2 (volume mark) and the fourth mark M4 (select mark) that are arranged on the inner side in the radial direction and are on the same circumference, the second mark M2 (volume mark) is arranged on the upper side and the fourth mark M4 (select mark) is arranged on the lower side. Among the fifth to seventh marks M5 to M7, the sixth mark M6 (up mark) and the seventh mark M7 (down mark) are arranged on the outer side in the radial direction of the steering wheel S, and the fifth mark M5 (mute mark). Of the sixth mark M6 (up mark) and the seventh mark M7 (down mark) on the same circumference, the sixth mark M6 (up mark) is arranged on the upper side and the seventh mark A mark M7 (down mark) is arranged on the lower side.

  An infrared reflective material (recursive) that strongly reflects infrared rays at a position corresponding to the left spoke portion Sb1 of the spoke cover 3 and radially inward of the steering wheel S relative to the second to fourth marks M2 to M4. An L-shaped reference mark Ms made of a reflective material is provided. Similarly, the portion corresponding to the spoke portion Sb3 on the right side of the spoke cover 3 and at the radially inner position of the fifth to seventh marks M5 to M7 is made of an infrared reflecting material that strongly reflects infrared rays. A character-shaped reference mark Ms is provided. When the steering handle S is in the neutral position, the left and right reference marks Ms and Ms are arranged symmetrically with respect to the vertical plane passing through the center thereof. The reference marks Ms and Ms are not only arranged on the inner side in the radial direction of the steering handle S than the second to seventh marks M2 to M7, but also when the driver puts his hand on the rim portion Sm of the steering handle S. It is arranged at a position sufficiently away from the rim portion Sm so that the finger does not reach.

The color of the spoke cover 3 is a dark color (for example, black) and the color of the reference marks Ms and Ms is a light color (for example, black) so that the positions and shapes of the reference marks Ms and Ms can be easily identified from imaging data of a camera CA described later. White). On the other hand, since it is not necessary to identify the positions and shapes of the first to seventh marks M1 to M7 from the imaging data of the camera CA, those colors are arbitrary as long as they are dark colors. Since it is necessary to recognize the positions of the marks M1 to M7 and hide them by hand, it is desirable that the color be easily recognized by the driver.

  A monochrome camera CA serving as an imaging unit capable of imaging each of the marks M1 to M7 is installed at a suitable position in the passenger compartment, in the illustrated example, at a ceiling slightly behind the driver. The camera CA can clearly recognize the image data that can recognize the positions and shapes of the reference marks Ms and Ms, and when any one of the marks M1 to M7 is hidden by the driver. The imaging data is output to the electronic control unit ECU (see FIG. 4).

  As shown in FIG. 4, the electronic control unit ECU is installed in a suitable position in the vehicle interior, for example, inside the instrument panel I, which analyzes the imaging data output from the camera CA and analyzes the analysis data. Based on the determination means C1 that can individually determine whether the marks M1 to M7 are hidden for each of the marks M1 to M7, and on-vehicle equipment (that is, audio AU, video DVD, Operation command means C2 for outputting an operation command signal as an operation command for the car navigation CN), and a signal to be output to the in-vehicle equipment AU, DVD, CN by converting the output signal of the operation instruction means C2 into a drive signal for the in-vehicle equipment An output unit C3 and a recognition unit C4 capable of recognizing the occupant's hand H based on the imaging data output from the camera CA are provided.

  The camera CA is connected to each input side of the determination unit C1 and the recognition unit C4. Further, the output side of the determination means C1 and the recognition means C4, and the external operation section 1, the steering angle sensor SE1, and the vehicle speed sensor SE2 are connected to the input side of the operation command means C2. Furthermore, the output side of the operation command means C2 is connected to the input side of the signal output unit C3, and the in-vehicle devices AU, DVD, CN are connected to the output side of the signal output unit C3.

  The operation command means C2 selects either a standby mode in which the operation input of the in-vehicle equipment AU, DVD, CN can be performed by the external operation unit 1 or the first and second operation modes in which the operation input is prohibited. In the standby mode, marks other than the first mark M1 and the fifth mark M7 (that is, the second to fourth marks M2 to M4, the sixth mark M6, and the seventh mark M7) are hidden. However, the operation command means C2 does not respond, that is, no operation command is issued.

  Further, the operation command means C2 is a state set in advance in the vehicle when the operation command means C2 is in the first or second operation mode, that is, a state in which the steering angle operation is greater than a predetermined angle, or within a predetermined time. An operation of hiding any of the second to seventh marks M2 to M7 for a certain time (for example, 8 seconds) or more after a state in which the vehicle speed has changed suddenly or after switching to one of the first and second operation modes. In the state where the first mark M1 is hidden again despite being left or in the first or second operation mode, the mode is automatically switched to the standby mode.

  Thus, in the state where the operation command means C2 is in the standby mode, the determination means C1 is based on the imaging data of the camera CA, as shown in FIG. 5A, the pair of reference marks Ms, Ms of the steering wheel S. Is detected, the center position of the steering wheel S and the left and right rotation angles from the neutral position are detected. As will be described later, the determination unit C1 estimates the positions of the first to seventh marks M1 to M7 from the center position and the rotation angle of the steering wheel S. Since the positional relationship between the reference marks Ms and Ms and the first to seventh marks M1 to M7 with respect to the steering handle S is known, if the positions of the reference marks Ms and Ms are known, the center position of the steering handle S can be known. If the rotation angle of S is known, the positions of the first to seventh marks M1 to M7 can be estimated.

  Next, the recognition of the reference mark Ms and the detection of the angle of the reference mark Ms (the rotation angle of the steering wheel S) will be described based on FIG.

  The L-shaped reference mark Ms includes five convex portions a and one concave portion b. First, the convex portions a and the concave portions b are extracted from the imaging data of the camera CA. Then, the pixel corresponding to the edge of the reference mark Ms is checked clockwise as indicated by an arrow, for example. The white pixels in the figure correspond to the reference mark Ms, and the black pixels correspond to the background spoke cover 3. Each pixel is in contact with the surrounding eight pixels. If five of the pixels are white, the pixel is present in the straight line portion of the reference mark Ms. For example, in the pixels P1 and P2, five of the surrounding eight pixels are white and exist in the straight line portion of the reference mark Ms. In addition, in the pixels P3 and P4, seven of the surrounding eight pixels are white, and are present in the recess b of the reference mark Ms. In P5 to P7, 3 to 4 pixels out of the surrounding 8 pixels are white, and are present on the convex portion a of the reference mark Ms.

  Therefore, the pixels corresponding to the edge of the reference mark Ms can be determined to be the pixels corresponding to the recess b if 6 or more of the 8 surrounding pixels are white. If four or less of the pixels are white, it can be determined that the pixel corresponds to the convex portion a, and therefore the positions of the convex portion a and the concave portion b of the reference mark Ms can be specified.

  Thus, if a high-brightness object recognized from the imaging data includes five convex portions a and one concave portion b, it can be determined that the object is the reference mark Ms. For example, the rotation angle of the steering wheel S can be detected from the position of the recess b of the right reference mark Ms and the position of the recess b of the left reference mark Ms. Further, even when only one of the left and right reference marks Ms and Ms can be recognized, the steering is determined based on the positional relationship between any two of the total six convex portions a and concave portions b of the recognized reference mark Ms. The rotation angle of the handle S can be detected. However, in this case, since the distance between the two convex portions a or the concave portion b to be employed is smaller than the distance between the left and right reference marks Ms and Ms, the detection accuracy of the rotation angle of the steering wheel S is slightly lowered.

  In addition, although the reference marks Ms and Ms of the present embodiment are formed in an L shape, the shape is not limited to the L shape, and other shapes such as a T shape and an E shape may be used. Also good. That is, the reference marks Ms and Ms need not be rotationally symmetric figures. A rotationally symmetric figure is a figure that overlaps itself when rotated by (360 / n) ° around its center when n is a natural number of 2 or more. The reference marks Ms and Ms are recognized at predetermined time intervals. However, if for some reason both the left and right reference marks Ms and Ms cannot be recognized, recognition is attempted again in the next cycle.

  The position of the steering wheel S can be adjusted according to the physique and preference of the driver, but the center position of the steering wheel S can be specified by specifying the positions of the left and right reference marks Ms and Ms as described above. can do. Since the positions of the first to seventh marks M1 to M7 in the steering handle S are known, if the center position of the steering handle S and the rotation angle of the steering handle S are determined, the first to seventh marks M1 to M7 are determined. Can be estimated.

  In order to directly identify the positions of the first to seventh marks M1 to M7 from the imaged data, it is necessary to analyze the imaged data by complicated image processing, which causes a problem that the computation time and computation load of the computer increase. . However, as in the present embodiment, the positions of the first to seventh marks M1 to M7 are estimated based on the reference marks Ms and Ms, so that the calculation time and calculation load of the computer are reduced and the first to seventh marks are reduced. It becomes possible to accurately estimate the positions of the marks M1 to M7 in a short time.

  Next, functions of the first to seventh marks M1 to M7 will be described with reference to FIGS.

  Since the determination means C1 recognizes the center first mark M1 as shown in FIG. 5B, during this recognition, the first mark M1 is displayed as shown in FIG. Can be recognized quickly and reliably, and the result of the recognition is output to the operation command means C2, whereby the means C2 switches from the standby mode to the first operation mode.

  Further, the determination means C1 can determine that the fifth mark M5 (mute mark) is hidden by the driver's hand in any of the standby mode, the first operation mode, and the second operation mode. It is. Therefore, in any of the above states, when the fifth mark M5 is hidden by the driver's hand, the volume of the in-vehicle device AU, DVD, CN becomes zero, and the fifth mark M5 is hidden again by the driver's hand. The volume returns to its original state. The reason that the fifth mark M5 is always recognized by the driver's hand is that the volume of the in-vehicle devices AU, DVD, CN can be quickly reduced to zero when an in-vehicle hands-free call is made. This is to make it possible to answer the phone.

  Only the first mark M1 and the fifth mark M5 (mute mark) are set to so-called “long press”, which is recognized when the mark is hidden for 1 to 1.5 seconds, for example. The 2nd to 4th marks M2 to M4, the 6th mark M6, and the 7th mark M7 are set to a so-called “chon push” that is recognized when they are hidden for 0.5 seconds to 0.8 seconds, for example. Yes.

  In addition, when the operation command means C2 is in the first or second operation mode, the determination means C1 displays the second to seventh marks M2 to M7 of the spoke portions Sb1 and Sb2, as shown in FIG. Therefore, during this recognition, if any of the second to fifth marks M2 to M5 is hidden by the driver's hand H as shown in FIG. Recognition can be performed quickly and reliably, and the operation command means C2 switches to the second operation mode based on the recognition result. Furthermore, in the state of the second operation mode, it is possible to quickly and surely recognize that any of the sixth and seventh marks M6 and M7 is hidden by the driver's hand H as shown in FIG. The recognition result is output to the operation command means C2.

  Further, the operation command means C2 does not recognize that the recognition means C4 has two hands H on the rim portion Sm when it determines that the vehicle is running based on the detection signal of the vehicle speed sensor SE2. In this case, at least a part of the operation signal from the operation unit 1 is invalidated. However, when the recognition unit C4 recognizes that there are two hands H on the rim portion Sm as shown in FIG. It is configured not to invalidate the operation signal.

  Therefore, during traveling, at least a part of manual operation to the operation unit 1 of the in-vehicle devices AU, DVD, CN can be invalidated from the viewpoint of safe driving as in the past. However, if the recognition means C4 recognizes that there are two hands H on the rim portion Sm even when the vehicle is traveling, even if an operation signal is output from the operation unit 1, it is determined by an occupant other than the driver. Since it can be considered that the vehicle has been operated, the operation command means C2 does not invalidate the operation signal, and enables operations by passengers other than the driver. As a result, even when the vehicle is running, if the driver holds the steering wheel S with both hands H, passengers other than the driver can operate the in-vehicle devices AU, DVD, CN, which is convenient and convenient. Improves.

  The operation command unit C2 switches to the first operation mode based on the determination unit C1 determining that the first mark M1 is hidden when it is in the standby mode. In the first operation mode, one of the second to fourth marks M2 to M4 is hidden so that an operation target in the in-vehicle device (in the illustrated example, “volume”, “source” for selecting video / audio, album) "Select" to select the name / song name can be arbitrarily selected. Incidentally, at the beginning of switching to the first operation mode, “volume” is automatically selected from the “volume”, “source”, and “select”.

  Further, the operation command means C2 switches to the second operation mode when the determination means C1 determines that any one of the second to fourth marks M2 to M4 is hidden when it is in the first operation mode. Instead, in the second operation mode, one of the plurality of operation parameters related to the operation object can be selected by hiding one of the sixth and seventh marks M6 and M7.

  The operation parameter means an operation content to be selected and operated more specifically by the operator in relation to the operation target. In the illustrated example, “volume” is selected because the second mark M2 is hidden. In such a case, hiding the sixth mark M6 corresponds to “volume up” and hiding the seventh mark M7 corresponds to “volume down”.

  Further, when the “source” is selected because the third mark M3 is hidden, hiding the sixth mark M6 is “one-way forward” of OFF / video / audio, and the seventh mark M7 is hidden. Corresponds to “forward feed in other directions”.

  Further, when “Select” is selected because the fourth mark M4 is hidden, the sixth mark M6 can be hidden in the “one-way forward” of the music or video, and the seventh mark M7 can be hidden. Corresponds to “forward in other directions” of music and videos.

In the second operating mode, the first mark M1 is hidden, and if a state of the sixth mark M6 or the seventh mark M7 is not hidden becomes timeout continuously for a predetermined time (e.g. 8 seconds), the second mode of operation To standby mode. In a first operating mode, the first mark M1 is hidden, and if a state of either is not hidden in the second to fourth mark M2~M4 becomes timeout continuously for a predetermined time (e.g. 8 seconds), the first Switch from the operation mode to standby mode.

  By the way, as shown in FIG. 10A, in the first operation mode, when the second mark M4 (select) on the radially outer side and the third mark M3 (source) on the radially inner side are simultaneously hidden. The determination means C1 assumes that only the third mark M3 (source) on the radially inner side is hidden, and the operation command means (C2) outputs an operation command for the third mark M3 (source). The reason is that when the driver hides the mark, the index finger generally extends inwardly from the radially outer side of the steering wheel S, so that the fourth mark M4 (select) on the radially outer side is hidden in the radial direction. Although it is unlikely that the inner third mark M3 (source) is hidden, a situation in which the radially outer fourth mark M4 (select) is hidden in an attempt to hide the radially inner third mark M3 (source). Because it is easy to happen.

  As shown in FIG. 10B, in the second operation mode, when the radially outer seventh mark M7 (down) and the radially inner fifth mark M5 (mute) are simultaneously hidden. The determination means C1 assumes that only the fifth mark M5 (mute) on the radially inner side is hidden, and the operation command means (C2) outputs an operation command for the fifth mark M5 (mute). The reason is that when the driver hides the mark, the index finger generally extends inwardly from the radially outer side of the steering wheel S, so that the seventh mark M7 (down) on the radially outer side is radially hidden. Although it is unlikely that the inner fifth mark M5 (mute) will be hidden, a situation in which the radially outer seventh mark M7 (down) is hidden in an attempt to hide the radially inner fifth mark M5 (mute). Because it is easy to happen.

  Furthermore, as shown in FIG. 11 (A), if the lower fourth mark M4 (select) and the upper second mark M2 (volume) are hidden simultaneously in the first operation mode, the determination is made. The means C1 assumes that only the upper second mark M2 (volume) is hidden, and the operation command means (C2) outputs an operation command for the second mark M2 (volume). The reason is that when the driver hides the mark, the index finger generally extends from the lower side to the upper side. Therefore, the driver tries to hide the lower fourth mark M4 (select) and presses the upper second mark M2 (volume). ) Is difficult to occur, but it is easy to happen that the lower fourth mark M4 (select) is hidden in an attempt to hide the upper second mark M2 (volume).

  In addition, as shown in FIG. 11B, in the second operation mode, when the lower seventh mark M7 (down) and the upper sixth mark M6 (up) are hidden simultaneously by the driver, The determination means C1 assumes that only the upper sixth mark M6 (up) is hidden, and the operation command means (C2) outputs an operation command for the sixth mark M6 (up). The reason is that when the driver hides the mark, his / her index finger generally extends from the lower side to the upper side, so the upper sixth mark M6 (up) tries to hide the lower seventh mark M7 (down). ) Is difficult to occur, but it is easy to happen that the lower seventh mark M7 (down) is hidden in an attempt to hide the upper sixth mark M6 (up).

  As described above, according to the present embodiment, when two or more of the second to seventh marks M2 to M7 are simultaneously hidden, the determination means C1 hides only the radially inner mark or the upper mark. Since the operation command means C2 outputs the operation command for the radially inner mark or the upper mark, the operation command intended by the driver is output to the maximum and a plurality of operation commands are output simultaneously. It is possible to prevent the driver from feeling uncomfortable due to an operation command not intended by the driver being output.

  Further, based on the imaging data output from the camera CA, determination means C1 capable of individually determining whether or not the plurality of marks M1 to M7 are hidden for each mark, and on-vehicle equipment based on the determination result by the determination means C1 The operation command means C2 for outputting an operation command (operation command signal) for AU, DVD, CN is provided. Not only can the operation commands for the devices AU, DVD, and CN be output accurately, the operator's operation procedure is easy to understand, and erroneous operation due to the operator's misrecognition can be effectively prevented.

  In addition, the determination logic in the operation command means C2 is relatively simple, so that cost savings can be achieved and calculation processing can be performed quickly. The plurality of marks M1 to M7 are provided on a to-be-attached member (a horn cover 2 and a spoke cover 3 that can be attached to and detached from the steering wheel S in the illustrated example) and is read by the covers 2 and 3 and the steering wheel S. It is not necessary to make a special through-hole, so that it is relatively easy to respond to the option of retrofitting, and the degree of freedom of the installation positions of the marks M1 to M7 and the camera CA is also relatively high, and further the steering. The driver with S can easily and quickly perform the operation of hiding the marks M1 to M7 at hand.

  In addition, the operator can quickly and surely switch the operation command means C2 from the standby mode to the first operation mode by simply hiding the first mark M, and in the first operation mode, a plurality of By simply hiding one of the marks M2 to M4, it is possible to quickly and reliably select an operation target in the in-vehicle device AU, DVD, or CN. Further, when the operation command means C2 is in the second operation mode, the operator simply hides one of the sixth and seventh marks M6 and M7, and specifies a plurality of operation parameters to be specified in relation to the operation target. That is, one of the operation contents can be selected quickly and reliably.

  Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and various design changes can be made without departing from the present invention described in the claims. Is possible.

For example, in the form of implementation, audio AU the present invention the operating device, a video DVD, showed that to be able to operate the car navigation CN, etc., in the present invention, the operation target vehicle other devices, for example, air conditioner It may be an air conditioner, a television or the like.

  In the embodiment, the operation command means C2 outputs an operation command (operation command signal) for the in-vehicle devices AU, DVD, CN based on the determination result of the determination means C1 that the marks M1 to M7 are hidden. In the present invention, based on the determination logic that combines the determination result of the determination unit C1 that the marks M1 to M7 are hidden and the result of the recognition unit C4 recognizing the hand H. You may make it output the operation command (operation command signal) with respect to vehicle equipment AU, DVD, CN. Even in this case, since the recognition unit C4 only identifies the hand H from a body part (head, arm, etc.) other than the hand H, the determination logic is not complicated as in the prior art.

AU audio (vehicle equipment)
C1 determination means C2 operation command means CA camera (imaging means)
CN car navigation (in-vehicle equipment)
DVD video (on-vehicle equipment)
M2-M7 mark
Ms reference mark S Steering handle
Sm rim
Sb1 left spoke part
Sb3 right spoke part

Claims (4)

Left and right side of the spoke portion of the steering wheel (S) (Sb1, Sb3) and the imaging means capable of capturing the (CA), on the basis of the imaging data outputted from the imaging means (CA), the right and left sides of the spokes ( Determination means (C1) capable of individually determining for each mark (M2 to M7) whether or not a plurality of marks (M2 to M7) provided in Sb1, Sb3) are hidden by the driver's hand; vehicle equipment based on a determination result by the means (C1) (AU, DVD, CN) have an operation and command means (C2) for outputting an operation command for the previous SL determining means (C1) is more than one mark when (M2 to M7) is determined to have been hidden at the same time, the operation command means (C2) is to output an operation command corresponding to one of the mark (M2 to M7), in motor vehicles The operation apparatus mounting device,
The left spoke portion (Sb1) has a left reference mark (Ms) around a plurality of marks (M2 to M4) provided on the left spoke portion (Sb1), and the right spoke portion (Sb3). The right reference mark (Ms) is provided around the plurality of marks (M5 to M7) provided on the right spoke portion (Sb3),
These left and right reference marks (Ms) are arranged symmetrically with respect to a vertical plane passing through the center of the steering handle (S) when the steering handle (S) is in a neutral position. Placed in a position where your fingers cannot reach when you put your hand on the rim (Sm)
The determination means (C1) recognizes the reference marks (Ms) on both the left and right sides based on the imaging data of the imaging means (CA), so that the center position of the steering handle (S) and the position of the steering wheel (S) are the same. It is possible to detect the rotation angle from the neutral position and to estimate the positions of the plurality of marks (M2 to M4, M5 to M7) in the spoke portions (Sb1, Sb3) on both the left and right sides from the detection result. A device for operating an in-vehicle device in an automobile. The vehicle-mounted device according to claim 1, wherein the reference mark (Ms) is a figure that does not overlap with the reference mark (Ms) unless the reference mark (Ms) is rotated 360 degrees around its center. Operating device. When the front Symbol judging means (C1) is the steering wheel (S) radially outwardly and radially inwardly arranged two marks (M2 to M7) is determined to have been hidden at the same time, the operation command means (C2) The operation device corresponding to the marks (M2 to M7) arranged on the radially inner side outputs an operation command for in-vehicle equipment in an automobile according to claim 1 or 2 . When the front Symbol judging means (C1) is the two marks arranged on the same circumference of the steering wheel (S) (M2~M7) is determined to have been hidden at the same time, the operation command means (C2) on the upper side The operation device for on-vehicle equipment in an automobile according to claim 1 or 2 , wherein an operation command corresponding to the arranged mark (M2 to M7) is output.

Images