JP5450491B2 - Operation device for in-vehicle equipment in automobile - Google Patents

Description

  The present invention individually determines for each mark whether or not the mark is hidden based on imaging means capable of imaging a steering handle provided with a plurality of marks, and imaging data output from the imaging means. The present invention relates to an in-vehicle device operation device in an automobile, comprising: a possible determination unit; and an operation command unit that outputs an operation command for the in-vehicle device based on a determination result by the determination unit.

  Conventionally, an image pickup means such as a CCD camera for reading the position and movement of an occupant's hand on the steering handle, and an operation command that can output an operation command for on-vehicle equipment based on the position and movement of the hand read by the image pickup means There is known a gesture remote control type operating device provided with means.

  For example, Patent Literature 1 below describes an operator's gesture, that is, an operation command that outputs an operation command for an in-vehicle device based on a hand position or a hand movement.

  Further, in Patent Document 2 below, the operation of the gesture remote controller is prevented from being erroneously started by starting the operation of the gesture remote controller in response to the through hole provided in the steering wheel being blocked by the driver's hand. Is described.

Japanese Patent No. 3914786 JP 2006-31347 A

  However, the technique described in Patent Document 1 not only complicates the judgment logic for the gesture, but also makes it difficult to accurately read the position and movement of the operator's hand. Since the difference cannot be clearly identified, there are inconveniences such as the gesture remote control being erroneously started due to a reading error or an erroneous operation command being output to the in-vehicle device.

  In addition, it is necessary to provide a through hole in the steering from the manufacturing stage for the one described in Patent Document 2, and it is difficult to deal with the option of retrofitting, and the installation of an imaging means for reading the installation position of the through hole and the blocking state of the hole There are inconveniences such as large positional restrictions. In addition, after the operation of the gesture remote controller is started, the operator's gesture is read and an operation command is output in the same manner as described in Patent Document 1, so that the determination logic becomes complicated and reading errors easily occur. In some cases, an incorrect operation command was output to the device.

  Therefore, it is conceivable that a plurality of marks are provided on the steering wheel and a predetermined operation command is output to the in-vehicle device when it is determined from the imaging data of the imaging means that these marks are hidden by the operator's hand. It is done. In this case, since it is difficult to directly identify a plurality of marks from the imaging data, first, the circular rim portion of the steering handle is identified, and each mark is identified from the positional relationship to the rim portion and the arrangement relationship of the plurality of marks. However, if such a procedure is taken, not only will it take a long time to identify the mark, but there will be a problem that the computation load of the computer will increase.

  In addition, when an inexpensive monochrome imaging means is used, it is generally difficult to distinguish between a whitish hand and a mark if a dark-colored steering handle such as black is provided with a light-colored mark such as white. In contrast, if the mark is darkened in order to produce a lightness difference from the hand, the lightness difference from the steering handle is reduced and the mark cannot be identified.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to make it possible to easily and accurately specify the position of a mark provided on a steering wheel from image data obtained by an imaging unit.

  In order to achieve the above object, according to the first aspect of the present invention, based on imaging means capable of imaging a steering wheel provided with a plurality of marks, and imaging data output from the imaging means. An in-vehicle device in an automobile comprising: a determination unit capable of individually determining whether or not the mark is hidden; and an operation command unit that outputs an operation command for the on-vehicle device based on a determination result by the determination unit. In the operation device, a reference mark is provided on the steering handle, and the determination unit recognizes the reference mark based on the imaging data of the reference mark by the imaging unit, and the plurality of marks are determined from the position of the reference mark. An operation device for an in-vehicle device in an automobile characterized by specifying a position is proposed.

  According to a second aspect of the present invention, in addition to the configuration of the first aspect, the reference mark includes both a convex portion and a concave portion. .

  According to the invention described in claim 3, in addition to the structure of claim 1 or claim 2, the reference mark is made of an infrared reflecting material, and the reference mark is irradiated with infrared rays intermittently. Means for comparing the imaging data at the time of infrared irradiation and the imaging data at the time of non-infrared irradiation, and recognizing a portion having a large change in brightness as the reference mark. An operating device is proposed.

  The audio AU, the video DVD, and the car navigation CN of the embodiment correspond to the in-vehicle device of the present invention, and the camera CA of the embodiment corresponds to the imaging unit of the present invention.

  According to the configuration of the first aspect, the imaging unit images the steering handle provided with a plurality of marks, and the determination unit determines whether the mark is hidden based on the imaging data output from the imaging unit. The operation command means outputs an operation command for the in-vehicle device based on the determination result by the determination means. Based on the image data of the reference mark provided on the steering handle, the determination means recognizes the reference mark and identifies the position of the plurality of marks from the position of the reference mark. It is possible to indirectly specify the positions of a plurality of marks from the position of the reference mark without directly specifying them. As a result, even when it is difficult to identify the steering wheel, the mark, and the operator's hand due to the use of an inexpensive monochrome imaging means, the positions of the plurality of marks can be specified with high accuracy. Since the logic for specifying the position of the mark is simplified, the computational load on the computer can be reduced.

  According to the configuration of the second aspect, since the reference mark includes both the convex portion and the concave portion, the position and angle of the steering wheel can be detected with high accuracy according to the positional relationship between the convex portion and the concave portion.

  According to the third aspect of the present invention, since the reference mark is made of an infrared reflecting material and the reference mark is intermittently irradiated with infrared rays by the infrared irradiation means, the imaging data at the time of infrared irradiation and the imaging data at the time of non-infrared irradiation are used. , The determination means can recognize a portion having a large change in brightness as a reference mark. As a result, the reference mark can be reliably recognized without being affected by the brightness of the passenger compartment or the attached matter such as a sticker attached to the steering handle.

Schematic which shows the vehicle interior of a motor vehicle. (First embodiment) The front view which looked at the instrument panel vicinity from the driver | operator side. (First embodiment) FIG. 3 is an enlarged sectional view taken along line 3-3 in FIG. 2. (First embodiment) The block diagram of a control system. (First embodiment) Explanatory drawing which shows simply the switching operation process from the standby mode of an operation command means to the 1st operation mode. (First embodiment) Explanatory drawing which shows simply the switching operation process from the 1st operation mode of the operation command means to the 2nd operation mode. (First embodiment) Explanatory drawing which simplifies the operation process for canceling | releasing control of operation in vehicle with respect to vehicle equipment, and enabling manual operation to vehicle equipment by the passengers other than a driver | operator, even if it is drive | working. (First embodiment) Explanatory drawing which shows the method of the image processing of a reference mark. (First embodiment) The step schematic diagram which shows the operation procedure for performing volume adjustment operation. (First embodiment) The step schematic diagram which shows the operation procedure for performing source selection operation. (First embodiment) The step schematic diagram which shows the operation procedure for performing selection operation of an album name and a song name. (First embodiment) The step schematic diagram which shows the operation procedure for performing transfer operation to voice search mode. (First embodiment) The flowchart explaining estimation of the position of a mark. (First embodiment) The figure which shows the shape of the reference mark by other embodiment. (Second Embodiment)

  Hereinafter, a first embodiment of the present invention will be described with reference to FIGS.

  First, in FIG. 1 to FIG. 3, the instrument panel I in the passenger compartment includes various instruments such as a speedometer, a display unit L for in-vehicle devices such as an audio AU, a video DVD, and a car navigation CN, An operation unit 1 and the like for manually operating the devices AU, DVD, and CN are provided, and a steering handle S that is steered by the driver is disposed on the front side of the various instruments.

  The steering handle S includes a central hub portion Sa connected to a steering shaft (not shown), a rim portion Sm that surrounds the central hub portion Sa in an annular shape, and a connection between the rim portion Sm and the central hub portion Sa. Three spoke portions Sb1 to Sb3. A horn cover 2 is detachably attached to the outer surface of the central hub portion Sa, and a design-processed first H-shaped mark M1 is attached to the central outer surface of the horn cover 2.

  The spoke portions Sb1 to Sb3 are detachably mounted with a spoke cover 3 that covers the outer surfaces of the spoke portions Sb1 to Sb3. In the illustrated example, the spoke cover 3 is formed by forming a flexible sheet-like metal plate into a developed shape corresponding to the spoke portions Sb1 to Sb3, and an adhesive or adhesive for pasting is provided on the back surface thereof. A sheet is provided. When the spoke cover 3 is attached to the spoke portions Sb1 to Sb3, the cover 3 is wound and pasted so as to follow the outer surfaces of the spoke portions Sb1 to Sb3, and the free edge 3e of the cover 3 is attached to the spoke portion Sb1 to Sb3. As shown in FIG. 4, the spoke portions Sb1 to Sb3 are fixed to be bent inward.

  In the spoke cover 3, the second to fourth marks M2 to M4 (in the example shown, M2 corresponds to the volume mark, M3 corresponds to the source mark, and M4 corresponds to the select mark) on the portion corresponding to the left spoke portion Sb1. It is attached in a row by bonding or printing, and the spoke cover 3 corresponding to the right spoke portion Sb3 has fifth to seventh marks M5 to M7 (in the example shown, M5 is a voice mark and M6 is up). A mark, M7 corresponds to a down mark) is attached in a zigzag arrangement with the fifth mark M5 inward by adhesion or printing.

  An infrared reflective material (recursive) that strongly reflects infrared rays at a position corresponding to the left spoke portion Sb1 of the spoke cover 3 and radially inward of the steering wheel S relative to the second to fourth marks M2 to M4. An L-shaped reference mark Ms made of a reflective material is provided. Similarly, the portion corresponding to the spoke portion Sb3 on the right side of the spoke cover 3 and at the radially inner position of the fifth to seventh marks M5 to M7 is made of an infrared reflecting material that strongly reflects infrared rays. A character-shaped reference mark Ms is provided. When the steering handle S is in the neutral position, the left and right reference marks Ms and Ms are arranged symmetrically with respect to the vertical plane passing through the center thereof. The reference marks Ms and Ms are not only arranged on the radially inner side of the steering handle S with respect to the first to seventh marks M1 to M7, but also when the driver puts his hand on the rim portion Sm of the steering handle S. It is arranged at a position sufficiently away from the rim portion Sm so that the finger does not reach.

  The color of the spoke cover 3 is a dark color (for example, black) and the color of the reference marks Ms and Ms is a light color (for example, black) so that the positions and shapes of the reference marks Ms and Ms can be easily identified from imaging data of a camera CA described later. White). On the other hand, since it is not necessary to identify the positions and shapes of the first to seventh marks M1 to M7 from the imaging data of the camera CA, those colors are arbitrary as long as they are dark colors. Since it is necessary to recognize the positions of the marks M1 to M7 and hide them by hand, it is desirable that the color be easily recognizable by the driver.

  A monochrome camera CA serving as an imaging unit capable of imaging each of the marks M1 to M7 is installed at a suitable position in the passenger compartment, in the illustrated example, at a ceiling slightly behind the driver. This camera CA is capable of capturing both visible light images and infrared images. The camera CA can capture image data that can recognize the positions and shapes of the reference marks Ms and Ms, and the driver can hide any of the marks M1 to M7. When it is detected, the imaging data that makes it possible to clearly recognize the hidden state is output to the electronic control unit ECU (see FIG. 4).

  In addition, when the vehicle interior becomes dark and imaging data of visible light cannot be obtained, the infrared irradiation means UR composed of LEDs that irradiate infrared light intermittently around the steering handle S at predetermined time intervals is provided by the camera CA. It is arrange | positioned at the ceiling part of the vicinity. ON / OFF of the infrared irradiation means UR is linked to, for example, a headlight or small light switch, and the infrared irradiation means UR is turned ON when the outside light becomes dark and the headlight or small light is turned on. Yes.

  As shown in FIG. 4, the electronic control unit ECU is installed in a suitable position in the vehicle interior, for example, inside the instrument panel I, which analyzes the imaging data output from the camera CA and analyzes the analysis data. Based on the determination means C1 that can individually determine whether the marks M1 to M7 are hidden for each of the marks M1 to M7, and on-vehicle equipment (that is, audio AU, video DVD, Operation command means C2 for outputting an operation command signal as an operation command for the car navigation CN), and a signal to be output to the in-vehicle equipment AU, DVD, CN by converting the output signal of the operation instruction means C2 into a drive signal for the in-vehicle equipment An output unit C3 and a recognition unit C4 capable of recognizing the occupant's hand H based on the imaging data output from the camera CA are provided.

  The camera CA is connected to each input side of the determination unit C1 and the recognition unit C4. Further, the output side of the determination means C1 and the recognition means C4, and the external operation section 1, the steering angle sensor SE1, and the vehicle speed sensor SE2 are connected to the input side of the operation command means C2. Furthermore, the output side of the operation command means C2 is connected to the input side of the signal output unit C3, and the in-vehicle devices AU, DVD, CN are connected to the output side of the signal output unit C3.

  The operation command means C2 selects either a standby mode in which the operation input of the in-vehicle equipment AU, DVD, CN can be performed by the external operation unit 1 or the first and second operation modes in which the operation input is prohibited. In the standby mode, even if a mark other than the first mark M1 (that is, the second to seventh marks M2 to M7) is hidden, the operation command means C2 does not respond, that is, an operation command is issued. It will never be done.

  The operation command means C2 is a state in which the vehicle is in a preset state (specifically, a steering angle operation of a predetermined angle or more when the operation command means C2 is in the first or second operation mode, or An operation of concealing any of the second to seventh marks M2 to M7 in a state where there is a sudden change in vehicle speed within a predetermined time, or for a certain period of time after switching to one of the first and second operation modes. The standby mode is automatically switched to the standby mode in response to a state in which the first mark M1 is hidden again despite being in the first or second operation mode. Change.

  Thus, in the state where the operation command means C2 is in the standby mode, the determination means C1 is based on the imaging data of the camera CA, as shown in FIG. 5A, the pair of reference marks Ms, Ms of the steering wheel S. Is detected, the center position of the steering wheel S and the left and right rotation angles from the neutral position are detected. As will be described later, the determination unit C1 estimates the positions of the first to seventh marks M1 to M7 from the center position and the rotation angle of the steering wheel S. Since the positional relationship between the reference marks Ms and Ms and the first to seventh marks M1 to M7 with respect to the steering handle S is known, if the positions of the reference marks Ms and Ms are known, the center position of the steering handle S can be known. If the rotation angle of S is known, the positions of the first to seventh marks M1 to M7 can be estimated.

  Next, the recognition of the reference mark Ms and the detection of the angle of the reference mark Ms (the rotation angle of the steering wheel S) will be described based on FIG.

  The L-shaped reference mark Ms includes five convex portions a and one concave portion b. First, the convex portions a and the concave portions b are extracted from the imaging data of the camera CA. Then, the pixel corresponding to the edge of the reference mark Ms is checked clockwise as indicated by an arrow, for example. The white pixels in the figure correspond to the reference mark Ms, and the black pixels correspond to the background spoke cover 3. Each pixel is in contact with the surrounding eight pixels. If five of the pixels are white, the pixel is present in the straight line portion of the reference mark Ms. For example, in the pixels P1 and P2, five of the surrounding eight pixels are white and exist in the straight line portion of the reference mark Ms. In addition, in the pixels P3 and P4, seven of the surrounding eight pixels are white, and are present in the recess b of the reference mark Ms. In P5 to P7, 3 to 4 pixels out of the surrounding 8 pixels are white, and are present on the convex portion a of the reference mark Ms.

  Therefore, the pixels corresponding to the edge of the reference mark Ms can be determined to be the pixels corresponding to the recess b if 6 or more of the 8 surrounding pixels are white. If four or less of the pixels are white, it can be determined that the pixel corresponds to the convex portion a, and therefore the positions of the convex portion a and the concave portion b of the reference mark Ms can be specified.

  Thus, if a high-brightness object recognized from the imaging data includes five convex portions a and one concave portion b, it can be determined that the object is the reference mark Ms. For example, the rotation angle of the steering wheel S can be detected from the position of the recess b of the right reference mark Ms and the position of the recess b of the left reference mark Ms. Further, even when only one of the left and right reference marks Ms and Ms can be recognized, the steering is determined based on the positional relationship between any two of the total six convex portions a and concave portions b of the recognized reference mark Ms. The rotation angle of the handle S can be detected. However, in this case, since the distance between the two convex portions a or the concave portion b to be employed is smaller than the distance between the left and right reference marks Ms and Ms, the detection accuracy of the rotation angle of the steering wheel S is slightly lowered.

  The reference marks Ms and Ms are recognized at predetermined time intervals. However, if for some reason both the left and right reference marks Ms and Ms cannot be recognized, recognition is attempted again in the next cycle.

  The position of the steering wheel S can be adjusted according to the physique and preference of the driver, but the center position of the steering wheel S can be specified by specifying the positions of the left and right reference marks Ms and Ms as described above. can do. Since the positions of the first to seventh marks M1 to M7 in the steering handle S are known, if the center position of the steering handle S and the rotation angle of the steering handle S are determined, the first to seventh marks M1 to M7 are determined. Can be estimated.

  In order to directly identify the positions of the first to seventh marks M1 to M7 from the imaged data, it is necessary to analyze the imaged data by complicated image processing, which causes a problem that the computation time and computation load of the computer increase. . However, as in the present embodiment, the positions of the first to seventh marks M1 to M7 are estimated based on the reference marks Ms and Ms, so that the calculation time and calculation load of the computer are reduced and the first to seventh marks are reduced. It becomes possible to accurately estimate the positions of the marks M1 to M7 in a short time.

  As described above, the determination means C1 recognizes the center first mark M1 as shown in FIG. 5B. During this recognition, as shown in FIG. When the 1 mark M1 is hidden by the driver's hand H, this can be quickly and reliably recognized, and the recognition result is output to the operation command means C2, so that the means C2 is switched to the first operation mode. Change.

  In addition, when the operation command means C2 is in the first or second operation mode, the determination means C1 displays the second to seventh marks M2 to M7 of the spoke portions Sb1 and Sb2, as shown in FIG. During the recognition, for example, a plurality of second marks (that is, the second to fifth marks M2 to M5) are hidden by the driver's hand H as shown in FIG. If this happens, this can be recognized quickly and reliably, and the operation command means C2 switches to the second operation mode based on the recognition result. Further, in the second operation mode, a plurality of third marks (namely, sixth and seventh marks M6 and M7) are hidden by the driver's hand H as shown in FIG. This can be quickly and reliably recognized, and the recognition result is output to the operation command means C2.

  Further, the operation command means C2 does not recognize that the recognition means C4 has two hands H on the rim portion Sm when it determines that the vehicle is running based on the detection signal of the vehicle speed sensor SE2. In this case, at least a part of the operation signal from the operation unit 1 is invalidated. However, when the recognition unit C4 recognizes that there are two hands H on the rim portion Sm as shown in FIG. It is configured not to invalidate the operation signal.

  Therefore, during traveling, at least a part of manual operation to the operation unit 1 of the in-vehicle devices AU, DVD, CN can be invalidated from the viewpoint of safe driving as in the past. However, if the recognition means C4 recognizes that there are two hands H on the rim portion Sm even when the vehicle is traveling, even if an operation signal is output from the operation unit 1, it is determined by an occupant other than the driver. Since it can be considered that the vehicle has been operated, the operation command means C2 does not invalidate the operation signal, and enables operations by passengers other than the driver. As a result, even when the vehicle is running, if the driver holds the steering wheel S with both hands H, passengers other than the driver can operate the in-vehicle devices AU, DVD, CN, which is convenient and convenient. Improves.

  The operation command means C2 switches to the first operation mode based on the determination by the determination means C1 that the first mark M1 is hidden when the operation command means C2 is in the standby mode. By obscuring one of the fifth marks M2 to M5, an operation target in the in-vehicle device (in the illustrated example, “volume”, “source” for selecting video / audio, “select” for selecting album name / song name, “Voice” for selecting the voice search mode of the car navigation system can be arbitrarily selected.

  Further, the operation command means C2 switches to the second operation mode when the determination means C1 determines that any of the second to fifth marks M2 to M5 is hidden when it is in the first operation mode. Instead, in the second operation mode, one of the plurality of operation parameters related to the operation object can be selected by hiding one of the sixth and seventh marks M6 and M7. The operation parameter means an operation content to be selected and operated more specifically by the operator in relation to the operation target. In the illustrated example, “volume” is selected because the second mark M2 is hidden. In such a case, hiding the sixth mark M6 corresponds to “volume up” and hiding the seventh mark M7 corresponds to “volume down”.

  Further, when the “source” is selected because the third mark M3 is hidden, hiding the sixth mark M6 is “one-way forward” of OFF / video / audio, and the seventh mark M7 is hidden. Corresponds to “forward feed in other directions”.

  Further, when “Select” is selected because the fourth mark M4 is hidden, the sixth mark M6 is hidden for a long time (for example, 2 seconds) by “one-way forward” in the album name, and the sixth mark Concealing M6 shortly means “one-way forward” of the song name, hiding the seventh mark M7 long (for example, 2 seconds), concealing the album name “forward-forwarding”, and concealing the seventh mark M7 shortly Corresponds to the song title “forward in the other direction”.

Next, the operation procedure of the operating device will be described more specifically with reference to FIGS.
[1] Volume adjustment operation When the operation command means C2 is in the standby mode, the display portion L is a normal car navigation screen as shown in step S10 in FIG. When M1 is concealed (step S11), the display of the marks M2 to M5 to be selected next is highlighted in the lower half of the screen together with the announcement “please operate” (step S12). If the second mark M2 is hidden (step S13), the display of the marks M6 and M7 to be selected next is highlighted in the lower half of the screen together with the announcement of “volume” (step S14), and then for a predetermined time (for example, After 3 seconds, the current volume display appears (step S15). Therefore, when either the sixth mark M6 or the seventh mark M7 is hidden (step S16), the volume adjustment is executed corresponding to the hidden mark, and the volume display after the adjustment appears (step S17).
[2] Source Selection Operation As shown in FIG. 10, steps S20 to S22 are the same as steps S10 to S12. When the third mark M3 is hidden from the state of step S22 (step S23), “source” The display of the marks M6 and M7 to be selected next is highlighted in the lower half of the screen together with the “selection” announcement (step S24), and when a predetermined time (for example, 3 seconds) elapses, the current source display (in the figure, “OFF” selection display) appears (step S25). Therefore, when either the sixth mark M6 or the seventh mark M7 is hidden (step S26), OFF video / audio is forwarded in one direction or the other direction corresponding to the hidden mark, and “source selection 〇〇 A source display after the selection appears together with the announcement “OO” (step S27).
[3] Album Name / Song Title Selection Operation As shown in FIG. 11, steps S30 to S32 are the same as steps S10 to S12. If the fourth mark M4 is hidden from the state of step S32 (step S33). ), Along with the announcement of “album name / song name selection”, the display of the marks M6 and M7 to be selected next is highlighted in the lower half of the screen (step S34), and then when a predetermined time (for example, 3 seconds) has passed, The album name / song title source display appears at (Step S35). Therefore, if one of the sixth mark M6 and the seventh mark M7 is hidden for a long time (for example, 2 seconds), the album name is forwarded in one direction or forward in the other direction (step S36), and the sixth mark M6 or If any of the seventh marks M7 is briefly hidden, one-way forward or other-direction forward of the song title is executed (step S36), and the newly selected album name / song title display appears along with the execution (step S36). Step S37). If the display is left for a predetermined time (for example, 5 seconds), the newly selected album name / song title is confirmed.
[4] Operation for Shifting to Voice Search Mode As shown in FIG. 12, steps S40 to S42 are the same as steps S10 to S12. When the operator hides the fifth mark M5 from the state of step S42. (Step S43) Along with the announcement of “voice search”, the car navigation CN can be shifted to a conventionally known voice search mode.

  According to the present embodiment described above, the determination unit C1 that can individually determine for each mark whether or not the plurality of marks M1 to M7 are hidden based on the imaging data output from the camera CA, and the determination Since the operation command means C2 for outputting an operation command (operation command signal) for the in-vehicle devices AU, DVD, CN based on the determination result by the means C1, each mark M1 to M7 is set by the operator's hand H with the camera CA. In addition to accurately outputting operation commands for in-vehicle devices AU, DVD, and CN based on whether or not they are hidden from the user, the operator's operation procedure is easy to understand, and erroneous operation due to a difference in operator's recognition can be effectively prevented. Become.

  In addition, the determination logic in the operation command means C2 is relatively simple, so that cost savings can be achieved and calculation processing can be performed quickly. The plurality of marks M1 to M7 are provided on a to-be-attached member (a horn cover 2 and a spoke cover 3 that can be attached to and detached from the steering wheel S in the illustrated example) and is read by the covers 2 and 3 and the steering wheel S. It is not necessary to make a special through-hole, so that it is relatively easy to respond to the option of retrofitting, and the degree of freedom of the installation positions of the marks M1 to M7 and the camera CA is also relatively high, and further the steering. The driver with S can easily and quickly perform the operation of hiding the marks M1 to M7 at hand.

  In addition, the operator can quickly and surely switch the operation command means C2 from the standby mode to the first operation mode by simply hiding the first mark M, and in the first operation mode, a plurality of By simply hiding one of the marks M2 to M5, it is possible to quickly and reliably select an operation target in the in-vehicle device AU, DVD, CN. Further, when the operation command means C2 is in the first operation mode, the operator simply hides one of the sixth and seventh marks M6 and M7, and specifies a plurality of operation parameters to be specified in relation to the operation target. That is, one of the operation contents can be selected quickly and reliably.

  Further, since the reference marks Ms and Ms are provided at a position far from the rim portion Sm of the steering handle S, that is, at a radially inner position of the steering handle S with respect to the first to seventh marks M1 to M7, the driver can It is possible to effectively prevent the reference marks Ms and Ms from being hidden unintentionally when trying to hide the first to seventh marks M1 to M7 with the hand H. Further, since it is difficult for the finger to reach the reference marks Ms and Ms while the driver holds the rim portion Sm of the steering handle S, the reference marks Ms and Ms are unintentionally hidden during normal driving, and the position Can be prevented in advance.

  By the way, the operation command means C2 is a state in which the vehicle is set in advance when the means is in one of the operation modes (in the illustrated example, the steering angle is operated more than a predetermined angle, or the vehicle speed changes rapidly within a predetermined time). Or a state in which the second to seventh marks M2 to M7 are left undisturbed for a certain period of time after switching to the first or second operation mode, or the first or second The operation automatically switches to the standby mode in accordance with the operation in which the first mark M1 is hidden again despite the operation mode. As a result, in special driving conditions that should be devoted to driving, such as when driving on a curve or sudden acceleration, or when the driver wants to return to standby mode immediately after leaving it for a certain period of time. In addition, since the operation command means C2 can be automatically returned to the standby mode, it is possible to reliably prevent the operation command means C2 from outputting a command due to an erroneous operation by the operator in those cases.

  In addition, when the vehicle interior becomes dark at night or the like, and the camera CA cannot acquire visible light imaging data, the infrared irradiation means UR irradiates the area including the steering wheel S with infrared rays, Imaging data can be acquired in the same way as during the daytime. At this time, since the reference marks Ms and Ms are made of an infrared reflecting material, when the imaging data at the time of infrared irradiation and the imaging data at the time of non-infrared irradiation are compared, the brightness of the reference marks Ms and Ms is significantly different. Therefore, the positions of the reference marks Ms and Ms can be provisionally determined from the imaging data. This facilitates the work of finally determining the reference marks Ms and Ms by confirming the arrangement of the convex portions a and the concave portions b of the temporarily determined reference marks Ms and Ms, further reducing the calculation time and calculation load of the computer. be able to.

  The above operation will be described with reference to the flowchart of FIG. 13. First, imaging data is input in step S1, and if infrared rays are irradiated in step S2, a difference image between infrared irradiation and non-irradiation is created in step S3. In step S4, the high brightness portion of the difference image is provisionally determined as the reference marks Ms and Ms. In step S5, the characteristic points (convex part a and concave part b) of the reference marks Ms and Ms temporarily determined are detected. In step S6, the reference marks Ms and Ms are determined from the number and arrangement of the characteristic points. In step S7, the reference points are determined. The positions of the first to seventh marks M1 to M7 are estimated from the positions of the marks Ms and Ms. If the infrared ray is not irradiated in step S2, the process skips to step S5 and detects the feature points (convex portion a and concave portion b) for all candidates of the reference marks Ms and Ms. The computation time and computation load of the computer will increase slightly.

  Next, a second embodiment of the present invention will be described with reference to FIG.

  Although the reference marks Ms and Ms of the first embodiment are formed in an L shape, in the second embodiment, the reference marks Ms and Ms are formed in a T shape and have six convex portions. a and two recesses b are provided. Even if these reference marks Ms and Ms are used, the same operational effects as those of the first embodiment can be achieved. The reference marks Ms and Ms need to have at least one convex part a and at least one concave part b, but need not be a rotationally symmetric figure.

  A rotationally symmetric figure is a figure that overlaps itself when rotated by (360 / n) ° around its center when n is a natural number of 2 or more, and is symmetric twice when n = 2. When n = 3, it is called 3-fold symmetry, and when n = 4, it is called 4-fold symmetry. For example, “x” has eight convex portions a and four concave portions b, but is a four-fold symmetrical figure that overlaps when rotated by 90 °, so that the steering handle S is in the neutral position. Therefore, it cannot be distinguished from the state rotated 90 degrees to the left and right from there, and is therefore inappropriate as the reference marks Ms and Ms.

  Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and various design changes can be made without departing from the present invention described in the claims. Is possible.

  For example, in the embodiment, L-shaped and T-shaped marks are exemplified as the reference mark Ms, but the shape of the reference mark Ms is not limited thereto.

  In the embodiments, the audio AU, the video DVD, the car navigation CN, etc. are operated by the operation device of the present invention. However, in the present invention, the operation object is an air conditioner such as an air conditioner such as an air conditioner. It may be a device, a television or the like.

  In the embodiment, the operation command means C2 outputs an operation command (operation command signal) for the in-vehicle devices AU, DVD, CN based on the determination result of the determination means C1 that the marks M1 to M7 are hidden. In the present invention, based on the determination logic that combines the determination result of the determination unit C1 that the marks M1 to M7 are hidden and the result of the recognition unit C4 recognizing the hand H. You may make it output the operation command (operation command signal) with respect to vehicle equipment AU, DVD, CN. Even in this case, since the recognition unit C4 only identifies the hand H from a body part (head, arm, etc.) other than the hand H, the determination logic is not complicated as in the prior art.

AU audio (vehicle equipment)
C1 determination means C2 operation command means CA camera (imaging means)
CN car navigation (in-vehicle equipment)
DVD video (on-vehicle equipment)
M1 to M7 Mark Ms Reference mark S Steering handle UR Infrared irradiation means a convex part b concave part

Claims (3)

An imaging means (CA) that can image the steering handle (S) provided with a plurality of marks (M1 to M7), and the marks (M1 to M7) based on imaging data output from the imaging means (CA). ) Can be individually determined for each of the marks (M1 to M7), and on-vehicle equipment (AU, DVD, CN) based on the determination result by the determination means (C1) In an in-vehicle device operating device in an automobile comprising operation command means (C2) for outputting an operation command for
A reference mark (Ms) is provided on the steering handle (S), and the determination means (C1) recognizes the reference mark (Ms) based on image data of the reference mark (Ms) by the imaging means (CA). And the operation apparatus of the vehicle equipment in a motor vehicle which pinpoints the position of these marks (M1-M7) from the position of the said reference | standard mark (Ms).   The operating device for on-vehicle equipment in an automobile according to claim 1, wherein the reference mark (Ms) includes both a convex portion (a) and a concave portion (b). The reference mark (Ms) is made of an infrared reflecting material, and provided with infrared irradiation means (UR) for irradiating the reference mark (Ms) with infrared rays intermittently,
The determination means (C1) compares imaging data at the time of infrared irradiation and imaging data at the time of non-infrared irradiation, and recognizes a portion having a large brightness change as the reference mark (Ms). The operation apparatus of the vehicle equipment in the motor vehicle of Claim 1 or Claim 2.

Images