JP4754294B2 - Method and apparatus for adjusting mirror surface angle of vehicle mirror - Google Patents

Method and apparatus for adjusting mirror surface angle of vehicle mirror Download PDF

Info

Publication number
JP4754294B2
JP4754294B2 JP2005224170A JP2005224170A JP4754294B2 JP 4754294 B2 JP4754294 B2 JP 4754294B2 JP 2005224170 A JP2005224170 A JP 2005224170A JP 2005224170 A JP2005224170 A JP 2005224170A JP 4754294 B2 JP4754294 B2 JP 4754294B2
Authority
JP
Japan
Prior art keywords
mirror
driver
voice
angle adjustment
vehicle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2005224170A
Other languages
Japanese (ja)
Other versions
JP2007038790A (en
Inventor
英法 佐藤
敬士 嶋田
政彦 村松
祥宏 野口
光芳 長尾
Original Assignee
旭化成株式会社
株式会社村上開明堂
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 旭化成株式会社, 株式会社村上開明堂 filed Critical 旭化成株式会社
Priority to JP2005224170A priority Critical patent/JP4754294B2/en
Publication of JP2007038790A publication Critical patent/JP2007038790A/en
Application granted granted Critical
Publication of JP4754294B2 publication Critical patent/JP4754294B2/en
Application status is Active legal-status Critical
Anticipated expiration legal-status Critical

Links

Images

Description

  The present invention relates to a method and an apparatus for adjusting a mirror angle of a vehicle mirror (that is, a tilt angle in the vertical and horizontal directions of the mirror surface), and facilitates remote adjustment operation of the mirror angle.

  Electric remote-control type outer mirrors (door mirrors, fender mirrors, etc.) that can perform mirror surface angle adjustment by remote control from the passenger compartment have been widely put into practical use. Conventional electric remote-control type outer mirrors perform mirror surface angle adjustment by manually operating a switch disposed near a driver's seat and tilting the mirror surface up, down, left, and right.

Further, as a technique for automating the mirror surface angle adjustment, a technique described in Patent Document 1 has been proposed. This is so that the driver's face position is obtained by photographing the driver with a camera, the optimum angle of the mirror is obtained based on the obtained face position, and the mirror is automatically tilted to the optimum angle. It is a thing.
JP 2002-274265 A

  In the conventional mirror surface angle adjustment by the switch operation, first of all the left and right outer mirrors, the mirror whose mirror surface angle is to be adjusted is selected by the switch, and then the mirror surface is tilted in the vertical and horizontal directions by the switch operation for the selected mirror. An operation to adjust the angle is necessary, and the switch operation is troublesome. In addition, the conventional automatic mirror surface angle adjustment has a uniform mirror surface angle depending on the position of the driver's face, and cannot be adjusted to a preferred mirror surface angle that is different for each driver.

  SUMMARY OF THE INVENTION The present invention has been made in view of the above-described points. The mirror surface angle adjusting method for a vehicle mirror, which facilitates the mirror surface angle adjustment operation and can be adjusted to a different preferred mirror surface angle for each driver, and its The device is to be provided.

  The present invention pays attention to the fact that when the driver adjusts the mirror angle, he / she always takes the action of adjusting the mirror angle while looking at the mirror to be adjusted. The direction is determined by image recognition, the mirror in the corresponding direction is automatically selected, and the mirror angle adjustment is performed on the selected mirror by the voice of the driver.

  In other words, the mirror angle adjustment method for a vehicle mirror according to the present invention is a method of adjusting the mirror angle of a plurality of mirrors mounted on a vehicle by electrically controlling the mirror angle of each mirror individually by remote control operation. Based on the image of the driver, it is determined by image recognition whether the driver's face or line of sight is facing the mirror, and based on the driver's voice collected by the microphone, The instruction content for mirror angle adjustment by voice is analyzed by voice recognition, and the mirror angle of the mirror determined by the image recognition is automatically adjusted to the instruction content analyzed by the voice recognition.

  In addition, the mirror angle adjustment device for a vehicle mirror according to the present invention is a mirror angle adjustment device for a mirror for a vehicle that electrically adjusts the mirror angle of a plurality of mirrors mounted on the vehicle individually by remote control operation. Based on the image of the driver, the image recognition means for determining which direction of the plurality of mirrors the driver's face or line of sight is directed to based on the driver's voice collected by the microphone , Voice recognition means for analyzing the instruction content of the mirror angle adjustment by the voice of the driver by voice recognition, and control for adjusting the mirror angle of the mirror determined by the image recognition to the instruction content analyzed by the voice recognition Means.

  According to the present invention, a special operation for selecting a mirror to be subjected to mirror surface angle adjustment is not required, and the driver can instruct the contents of the mirror surface angle adjustment by voice, thereby facilitating the mirror surface angle adjustment operation. In addition, it is possible to adjust the mirror angle to a different preference for each driver.

  A camera that reflects an image of the driver's face and a microphone that picks up the driver's voice can be mounted on, for example, an inner mirror. In this case, the camera is composed of an infrared camera built in the inner mirror, and at least a region of the mirror surface of the inner mirror where the driver's face is desired is composed of a cold mirror that transmits infrared light. can do. In this way, since the driver cannot see the infrared camera, the driver's face can be photographed without making the driver aware of the presence of the infrared camera.

  According to the present invention, the presence or absence of movement (opening / closing operation) of the driver's lips can be determined by image recognition, and specular angle adjustment can be permitted or prohibited based on the determination result. That is, the mirror angle adjustment is permitted for the instruction content analyzed by voice recognition during the period when it is determined that the driver's lip opening / closing operation is performed, and the voice recognition is performed during the period when it is determined that the driver's lip opening / closing operation is not performed. The mirror angle adjustment can be prohibited for the instruction content analyzed by the above. In this way, it is possible to prevent the mirror angle adjustment from being erroneously performed due to a voice or other noise from a passenger other than the driver.

  For example, when the mirror surface angle adjustment instruction by the driver's voice is fixed, for example, when the mirror surface tilt amount per instruction is fixed, only the tilt direction instruction may be given. Further, when the amount of tilting of the mirror surface per instruction is made variable, it is only necessary to instruct the tilting direction and the amount of tilting. For example, in the case where the degree of tilting is instructed in two levels, as in the embodiments described later, there is no explicit instruction indicating the degree of tilting by the driver's voice and the explicit degree indicating the degree of tilting. It is possible to identify an instruction of the amount of tilting when there is an instruction. That is, when there is no explicit instruction indicating the degree of tilting amount, the tilting amount per instruction is set as a predetermined normal tilting amount, and for example, “little” (or its synonym) is specified as an explicit instruction for the degree of tilting amount. When there is an instruction such as a word (for example, “small”), the amount of tilt per instruction can be made smaller than that when there is no explicit instruction. Alternatively, when there is no explicit instruction indicating the degree of tilting amount, the tilting amount per instruction is set as a predetermined normal tilting amount, and for example, “many” (or its synonyms) When there is an instruction such as a word (for example, “large”), the amount of tilt per instruction can be set larger than that when there is no explicit instruction. In any of these cases, the amount of tilt can be instructed in two steps with a simple voice instruction. In addition, when there is no explicit instruction indicating the degree of tilting amount, the tilting amount per instruction is set as a predetermined normal tilting amount, and for example, “a little” (or its synonym) is specified as an explicit instruction for the degree of tilting amount. When there is an instruction such as “word (for example,“ small ”)”, the tilt amount per instruction is set to a small tilt amount compared to the case where there is no explicit instruction, and for example, “ When there is an instruction of “many” (or its synonyms (for example, “large”)), the amount of tilt per instruction can be set to a larger amount of tilt than when there is no explicit instruction. In this way, the amount of tilting can be instructed in three stages with a simple voice instruction.

  An embodiment in which the present invention is applied to mirror surface angle adjustment of left and right door mirrors will be described below. In this embodiment, a camera and a microphone are mounted on the inner mirror. The driver's face is photographed with a camera, and the driver's face or line of sight is directed to the left door mirror direction, the right door mirror direction, or otherwise by image recognition from the photographed video. It is judged whether it is in the state. In addition, an instruction of adjustment contents by a driver's voice (words) is collected by a microphone, and the instruction contents of a tilt direction and a tilt amount are analyzed by voice recognition from the collected voice, and determined by the image recognition. For the other door mirror, the mirror surface angle is adjusted by the tilt direction and tilt amount analyzed by the voice recognition.

  First, the configuration of the inner mirror is shown in FIG. The stay 12 of the inner mirror 10 is in the vehicle interior, and the upper end (not shown) of the stay 12 is located at the center in the left-right direction of the front edge of the ceiling of the vehicle interior or the center of the front window in the left-right direction. It is attached. A mirror housing 14 is connected to the lower end of the stay 12. A mirror plate 16 is fitted and attached to an opening 14a of the mirror housing 14 that opens toward the rear of the vehicle. The end plate 16 is formed of a so-called cold mirror having a spectral characteristic that reflects visible light and transmits infrared light.

  A substrate 18 is fixedly mounted on the inner peripheral surface of the mirror housing 14 in a space 14 b in the mirror housing 14 behind the end plate 16. An infrared camera 20, an infrared LED (light emitting diode) 22, various circuit elements 24, and the like are fixedly disposed on the substrate 18. The camera optical axis (objective lens optical axis) L of the infrared camera 20 is directed to the rear of the vehicle or the direction of the driver's face so that the driver's face enters the field of view of the infrared camera 20 in any case. Is set. The infrared LED 22 is disposed around the infrared camera 20, and the optical axis of the infrared LED 22 is set parallel to the camera optical axis L. A microphone 26 is attached to the outer part of the mirror housing 14 toward the rear of the vehicle, the direction of the driver's face, or another direction that can properly collect the driver's voice.

  According to the configuration of the inner mirror 10 described above, since the end plate 16 formed of a cold mirror reflects visible light, the driver can use the inner mirror 10 in the same manner as a normal inner mirror, It is possible to visually recognize the image behind the reflected vehicle. Further, the infrared light continuously emitted from the infrared LED 22 passes through the end plate 16 and is irradiated to the driver's face. The infrared camera 20 continuously captures the driver's face irradiated with infrared light. Since the driver cannot see the infrared camera 20 and the infrared LED 22, the driver's face can be continuously photographed without making the driver aware of the presence of the infrared camera 20 and the infrared LED 22.

  FIG. 1 shows a system configuration of a mirror surface angle adjustment device for left and right door mirrors using the inner mirror 10 of FIG. The inner mirror arrangement part 10A is a part arranged in the inner mirror 10, and the door mirror controller 28 is a part arranged in the dashboard of the vehicle. An ACC cable (electric cable supplied with power when the engine key position is “ACC”) 30 and a GND cable (electric cable connected to the ground potential of the vehicle) 32 are connected to a stabilized power supply 34 of the door mirror controller 28. Are connected to the stabilized power supply 36 of the inner mirror arrangement portion 10A, respectively, and supply power to both circuits 34 and 36. The stabilized power circuit 34 supplies a stabilized power supply of a predetermined voltage to each part of the door mirror controller 28. The stabilized power supply circuit 36 supplies a stabilized power supply of a predetermined voltage to each part of the inner mirror arrangement unit 10A.

  In the inner mirror arrangement unit 10A, the image recognition circuit 38 is a known image recognition method (for example, as described in Japanese Patent Laid-Open Nos. 3-255793 and 6-262959) from continuous video captured by the infrared camera 20. The direction of the driver's face or line of sight is continuously detected using the method), and the driver's face or line of sight faces the left door mirror 42, the right door mirror 44, or It is determined continuously and individually whether the determination is impossible (a state in which neither the right side nor the left side can be determined due to facing the front direction or the like). The image recognition circuit 38 also opens and closes the driver's lips using a known image recognition method (for example, the method described in Japanese Patent Application Laid-Open No. 2000-338987) from continuous video captured by the infrared camera 20. It is continuously detected, and the presence / absence of the lip opening / closing operation (that is, the presence / absence of speech) is continuously determined.

  In the memory 48, instruction voices based on the driver's voice to be recognized by the voice recognition circuit 46 are registered in advance. The voice recognition circuit 46 compares the voice picked up by the microphone and the voice registered in the memory 48 and analyzes the instruction content by the driver's voice. The light emitting circuit 50 continuously drives the infrared LED 22 to emit light.

  The door mirror control circuit 52 constituting the control means outputs a signal (mirror surface angle adjustment signal) for adjusting the mirror surface angle of the left and right door mirrors 42 and 44 according to the determination result of the image recognition circuit 38 and the analysis result of the voice recognition circuit 46. To do. That is, the door mirror control circuit 52 realizes the specular angle adjustment instruction content analyzed by the voice recognition circuit 46 for the door mirror determined by the image recognition circuit 38 that the driver's face direction or line of sight is facing. A mirror angle adjustment signal is output. In this case, in order to prevent the mirror surface angle of the left and right door mirrors 42 and 44 from malfunctioning due to a voice or other noise from a passenger other than the driver, the door mirror control circuit 52 opens and closes the driver's lips with the image recognition circuit 38. Only the specular angle adjustment instruction content analyzed by the voice recognition circuit 46 is valid during the period in which it is determined that there is an action, and the specular angle adjustment signal corresponding to the instruction content is output. The specular angle adjustment instruction content analyzed by the voice recognition circuit 46 during a period when it is determined that there is no lip opening / closing operation is invalidated so that the specular angle adjustment signal corresponding to the instruction content is not output.

  The mirror angle adjustment signal output from the door mirror control circuit 52 is transmitted from the door mirror communication output circuit 54 and received by the door mirror communication input circuit 56 of the door mirror controller 28 via the communication cable 55. Note that the ACC cable 30, the GND cable 32, and the communication cable 55 are guided into the inner mirror 10 through the stay 12. In the door mirror controller 28, the door mirror drive circuit 58 analyzes the mirror angle adjustment signal received by the door mirror communication input circuit 56 and adjusts the mirror angle in the left and right door mirrors 42 and 44 that realizes the instruction content of the mirror angle adjustment signal. A drive signal for a motor (not shown) is generated, and the drive signal is supplied to the left and right door mirrors 42 and 44 via electric cables 60 and 62. Thereby, the mirror surface angle adjusting motors in the left and right door mirrors 42 and 44 are driven, and the mirror surface angles of the left and right door mirrors 42 and 44 are respectively adjusted to the contents instructed by the door mirror control circuit 52.

  The left and right door mirrors 42 by the door mirror control circuit 52 according to the combination of the driver's utterance analyzed by the voice recognition circuit 46 and the driver's face orientation and lip opening / closing operation determined by the image recognition circuit 38. An example of the control content of 44 is shown in Table 1. In Table 1, “speech recognition result data” is an example of code data of a speech recognition result output from the speech recognition circuit 46, and “face image recognition result data” is an image recognition result output from the image recognition circuit 38. It is an example of code data. In Table 1, for the left and right door mirrors 42 and 44, in addition to the mirror surface angle adjustment for normal operation, the mirror surface angle adjustment for reverse (reverse) operation (mirror surfaces for easy garage entry in reverse) Adjustment operation that tilts greatly downward), electric retracting operation of electric retractable door mirror (storage / returning operation), and heater on / off operation to evaporate water droplets adhering to the mirror surface by voice instructions Shows about.

In Table 1, among the 8-bit data “xxxxAAAB” (x is a Don't care bit) constituting “face image recognition result data”, 2 bits of “AA” are determination results of the face direction,

Right direction: “AA” = “10”
Left direction: “AA” = “11”
Judgment impossible: “AA” = “00”

It is. In addition, 2 bits of “BB” is a determination result of the presence / absence of opening / closing operation of the lips,

No lip opening / closing action: “BB” = “00”
Lip opening / closing operation: “BB” = “11”

It is. Table 1 shows a case where the opening / closing operation of the lips is present (“BB” = “11”) except for “driver utterance” other than “non-utterance”. The mirror operation when there is no lip opening / closing operation (“BB” = “00”) not shown in Table 1 is “no operation”. When the “driver's utterance” is “non-utterance”, the mirror operation is “not activated” even if the lip opening / closing operation is present (“BB” = “11”).

  The door mirror control circuit 52 outputs, for example, data obtained by combining the voice recognition result data and the face image recognition result data in Table 1 as a door mirror control signal (a mirror angle adjustment signal and other control signals for executing each operation in Table 1). can do. In this case, the door mirror communication output circuit 54 can convert the combined data into a serial signal and transmit it to the door mirror controller 28 via the communication cable 55. A data configuration example of this serial signal is shown in FIG. The serial signal in FIG. 3 is composed of 24-bit data obtained by connecting 8-bit code data of “voice recognition result”, “face image recognition result”, and “delimiter code” to each other. As the “delimiter code”, for example, CR (Carriage Return) is used, and the code is “00001101”.

Each control content of Table 1 is demonstrated. Here, in any case, it is assumed that the determination result of the presence / absence of the opening / closing operation of the lips is “the opening / closing operation of the lips”.
(1) Mirror surface angle adjustment for normal operation As is well known, mirror surface angle adjustment is built in the left and right door mirrors 42 and 44, respectively, and a vertical mirror surface adjustment motor for tilting the mirror surface in the vertical direction and tilting in the horizontal direction. This can be realized by rotating the right and left mirror surface adjusting motors forward and backward. The mirror surface angle adjustment is performed so that the driver's voice is adjusted for the door mirror in the direction in which the driver's face or line of sight determined by the image recognition circuit 38 among the left and right door mirrors 42 and 44 is adjusted. This is realized by driving two mirror surface adjustment motors. The driver gives a voice instruction for tilting the mirror surfaces of the left and right door mirrors 42 and 44 in two large and small tilt amounts in each of the vertical and horizontal directions. That is, the voices “up”, “down”, “right”, and “left” uttered by the driver are instructions for driving the corresponding mirror surface adjustment motor in the corresponding rotation direction for 1 second. In addition, the voices “slightly above”, “slightly below”, “slightly right”, and “slightly left” uttered by the driver are instructions to drive the corresponding mirror surface adjustment motor for 0.5 seconds in the corresponding rotation direction. . When the voice recognition circuit 46 recognizes these instructions, the door mirror control circuit 52 executes this motor drive for the door mirror in the direction in which the driver's face or line of sight determined by the image recognition circuit 38 is facing. If the same voice instruction is repeatedly issued, the mirror surface is sequentially tilted in the corresponding direction.

(2) Reverse / Return Operation The voice “reverse” uttered by the driver is an instruction to drive the vertical mirror surface adjustment motor downward for 2 seconds. The door mirror control circuit 52 executes this motor drive for the door mirror in the direction in which the driver's face or line of sight determined by the image recognition circuit 38 is facing. As a result, the driver can visually recognize the vicinity of the rear wheel through the door mirror, and it is easy to enter the garage in the reverse direction. The voice “drive” uttered by the driver with the mirror surface facing down in this manner is an instruction to drive the vertical mirror adjustment motor upward for 2 seconds. When the voice recognition circuit 46 recognizes these instructions, the door mirror control circuit 52 executes this motor drive for the door mirror in the direction in which the driver's face or line of sight determined by the image recognition circuit 38 is facing. As a result, the mirror surface returns to the position before being lowered, that is, the position during normal operation.

(3) Electric storing / returning operation The voice “storage” uttered by the driver is an instruction to put the electric collapsible left and right door mirrors 42 and 44 into the retracted state (the collapsed state). The voice “return” uttered by the driver in this retracted state is an instruction to bring the left and right door mirrors 42, 44 into the return state (the standing state). When the voice recognition circuit 46 recognizes these instructions, the door mirror control circuit 52 drives an electric storage motor (not shown) built in the left and right door mirrors 42 and 44 in the corresponding direction. In the electric retracting / returning operation, the left and right door mirrors 42 and 44 are simultaneously operated, so that the determination result of the driver's face (or line of sight) among the determination results of the image recognition circuit 38 is not used (driver) The determination result on the presence / absence of the opening / closing operation of the lips is used).

(4) Heater On / Off Operation The driver's voice “heater operation” is an instruction to turn on the heaters provided on the end plates of the left and right door mirrors 42 and 44. When the voice recognition circuit 46 recognizes these instructions, the door mirror control circuit 52 turns on the heaters of the left and right door mirrors 42 and 44. The voice “heater stop” uttered by the driver is an instruction to turn off the heaters provided on the end plates of the left and right door mirrors 42 and 44. When the voice recognition circuit 46 recognizes these instructions, the door mirror control circuit 52 turns off the heaters of the left and right door mirrors 42 and 44. In the heater on / off operation, the heaters of the left and right door mirrors 42 and 44 are simultaneously operated, so that the determination result on the driver's face (or line of sight) among the determination results of the image recognition circuit 38 is not used (driving). The determination result on the presence / absence of opening / closing operation of the person's lips is used).

  Next, a processing flow of control of the left and right door mirrors 42 and 44 by the mirror surface angle adjusting device of FIG. 1 will be described with reference to FIG. The processing flow of FIG. 4 includes an image recognition process F1, a voice recognition process F2, and a door mirror control signal (a mirror angle adjustment signal and other control signals for executing the operations in Table 1) based on both processes F1 and F2. Consists of.

  The image recognition process F1 is a control executed by the image recognition circuit 38. That is, an image of the driver is acquired from the video signal output from the infrared camera 20 (S1), and further, detection of an image of the entire face of the driver is tried (S2). When an image of the entire face is detected (S3), an area for searching for the driver's lips is set in the image (S4), and detection of the lips in the area is tried (S5). If the detection of the lips is successful (S6), a lip image is acquired (S7), and the presence / absence of the driver's speech is determined from the presence / absence of the opening / closing operation of the lips (S8). That is, if there is a lip opening / closing operation, it is determined that “speech is present”, and if there is no lip opening / closing operation, it is determined that “no utterance”. Further, the orientation of the driver's face is determined from the position of the lip detected by the lip detection (S6) in the entire face image detected by the image detection (S3) of the entire face (S9).

  On the other hand, the voice recognition process F <b> 2 is a control executed by the voice recognition circuit 46. That is, the voice of a person is extracted from the voice signal output from the microphone 26 (S10), and the voice is compared with the instruction content registered in the memory 48 and to be recognized by the voice recognition circuit 46 based on the driver's voice. It recognizes and detects "driver's utterance" of Table 1 (S11).

  The door mirror control signal creation processing F3 is control executed by the door mirror control circuit 52. That is, when a driver utterance is detected in the voice recognition process F2, the effectiveness of the driver utterance is determined from a combination with the result of the determination of the presence or absence of utterance based on the lip opening / closing operation (S8) in the image recognition process F1 (S12). That is, the driver utterance detected during the period determined as “speech” is determined to be valid, and the driver utterance detected during the period “no utterance” is determined to be invalid. And the door mirror control signal which performs the mirror operation | movement corresponded to the content of the driver | operator utterance determined to be effective is produced (S13). At this time, the determination result of the face orientation is used for the “(1) mirror angle adjustment for normal operation” and “(2) reverse / return operation”. That is, a door mirror control signal for executing the corresponding mirror operation is created for the door mirror in the direction in which the driver's face is facing. On the other hand, the determination result of the face orientation is not used for the “(3) Electric storage / return operation” and “(4) Heater on / off operation”. That is, a door mirror control signal for executing the corresponding mirror operation is created for both the left and right door mirrors 42 and 44 regardless of the direction of the driver's face. As described above, the left and right door mirrors 42 and 44 perform the corresponding operations shown in “Mirror operation” in Table 1.

  In the above embodiment, the case where the mirror angle adjustment of the left and right outer mirrors is described, but the mirror angle adjustment of the inner mirror can also be performed. In that case, an electric remote control type inner mirror that can adjust the angle of the mirror surface with respect to the mirror housing in the vertical and horizontal directions by electric drive is used as the inner mirror. Then, the driver's face or line of sight is detected by image recognition from the image of the driver's face taken with a camera equipped with an inner mirror, and the driver's face or line of sight is detected by the left outer mirror, right outer mirror, and inner mirror. Which direction is pointed to is determined. In parallel with this, mirror angle adjustment instructions ("Up", "Down", "Left", "Right", "Slightly above", "Slightly below") from the driver's voice collected by the microphone equipped with the inner mirror , “Slightly left”, “slightly right”, etc.) are detected by voice recognition, and the mirror surface adjustment corresponding to the instruction is executed for the mirror that is determined that the face or line of sight is facing.

It is a block diagram which shows the system configuration | structure of the mirror surface angle adjustment apparatus in embodiment of this invention. It is a figure which shows the structure of the inner mirror in embodiment of this invention, and is the front view and sectional drawing which saw through the inside. It is a figure which shows the structural example of the serial signal transmitted from the door mirror communication output circuit 54 of FIG. It is a flowchart which shows the processing content of control of the left-right both door mirrors 42 and 44 by the mirror surface angle adjustment apparatus of FIG.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Inner mirror, 16 ... End plate (cold mirror), 20 ... Camera (infrared camera), 26 ... Microphone, 38 ... Image recognition circuit (image recognition means), 42 ... Left door mirror, 44 ... Right door mirror, 46 ... Audio Recognition circuit (voice recognition means), 52... Door mirror control circuit (control means).

Claims (11)

  1. In the mirror angle adjustment method for a mirror for a vehicle that electrically adjusts the mirror angle of a plurality of mirrors mounted on the vehicle individually by remote control operation,
    Based on the image of the driver photographed by the camera, it is determined by image recognition which direction of the plurality of mirrors the driver's face or line of sight is facing,
    Based on the voice of the driver picked up by the microphone, the instruction content of mirror angle adjustment by the voice of the driver is analyzed by voice recognition,
    A mirror angle adjusting method for a mirror for a vehicle, wherein the mirror angle determined by the image recognition is automatically adjusted to the instruction content analyzed by the voice recognition.
  2. In the mirror angle adjustment device for a mirror for a vehicle that electrically adjusts the mirror angle of a plurality of mirrors mounted on the vehicle individually by remote control operation,
    Image recognition means for determining by image recognition which direction of the plurality of mirrors the driver's face or line of sight is facing based on the driver's image captured by the camera;
    Based on the voice of the driver picked up by the microphone, voice recognition means for analyzing the instruction content of the mirror surface angle adjustment by the voice of the driver by voice recognition;
    A mirror angle adjustment device for a vehicle mirror, comprising: a control unit that adjusts the mirror angle of the mirror determined by the image recognition to an instruction content analyzed by the voice recognition.
  3.   The mirror surface angle adjusting device for a vehicle mirror according to claim 2, wherein the camera is mounted on an inner mirror.
  4. The camera is composed of an infrared camera built in the inner mirror,
    The mirror angle adjustment device for a vehicle mirror according to claim 3, wherein at least a region of the mirror surface of the inner mirror where the driver's face is desired from the camera is constituted by a cold mirror that transmits infrared light.
  5.   The mirror angle adjustment device for a vehicle mirror according to any one of claims 2 to 4, wherein the microphone is mounted on an inner mirror.
  6. The image recognition means further determines the presence / absence of an opening / closing operation of the driver's lips by image recognition;
    The control means permits mirror angle adjustment for the instruction content analyzed by the voice recognition means during a period when the image recognition means determines that the driver's lip opening / closing operation is performed, and the image recognition means The mirror angle adjustment device for a vehicle mirror according to any one of claims 2 to 5, wherein the mirror angle adjustment is prohibited for the instruction content analyzed by the voice recognition means during a period when it is determined that there is no lip opening / closing operation.
  7. The instruction content of the mirror surface angle adjustment by the voice is an instruction of the tilt direction,
    The control means tilts the mirror surface of the mirror determined by the image recognition with a predetermined tilt amount in the tilt direction instructed for one instruction by the voice. A mirror surface angle adjusting device for a vehicle mirror according to claim 1.
  8. The instruction content of the mirror surface angle adjustment by the voice is an instruction of the tilt direction and the amount of tilt,
    The control means, with respect to one instruction by the voice, the mirror surface of the mirror determined by the image recognition is tilted in a predetermined amount as the degree of the instructed inclination in the instructed inclination direction. The mirror surface angle adjusting device for a vehicle mirror according to any one of claims 2 to 6, wherein the mirror surface angle is adjusted.
  9. The instruction content of the mirror surface angle adjustment by the voice is an instruction of only the tilt direction or an instruction of the tilt direction and the amount of tilt,
    In the case where only the tilt direction is instructed for one instruction by the voice, the control means tilts the mirror surface of the mirror determined by the image recognition in a predetermined tilt direction in the instructed tilt direction. When the direction of tilting and the amount of tilting are instructed, the mirror surface of the mirror determined by the image recognition is instructed only in the inclining direction in the instructed tilting direction. The mirror surface angle adjusting device for a vehicle mirror according to any one of claims 2 to 6, wherein the mirror surface is tilted by a predetermined amount as a degree of the tilting amount, or by a small amount.
  10.   The mirror angle adjustment device for a mirror for a vehicle according to any one of claims 7 to 9, wherein the directions of the tilt direction are four types of instructions corresponding to up, down, left and right directions.
  11.   The mirror angle adjustment device for a vehicle mirror according to any one of claims 2 to 10, wherein the plurality of mirrors include at least left and right outer mirrors.
JP2005224170A 2005-08-02 2005-08-02 Method and apparatus for adjusting mirror surface angle of vehicle mirror Active JP4754294B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2005224170A JP4754294B2 (en) 2005-08-02 2005-08-02 Method and apparatus for adjusting mirror surface angle of vehicle mirror

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2005224170A JP4754294B2 (en) 2005-08-02 2005-08-02 Method and apparatus for adjusting mirror surface angle of vehicle mirror

Publications (2)

Publication Number Publication Date
JP2007038790A JP2007038790A (en) 2007-02-15
JP4754294B2 true JP4754294B2 (en) 2011-08-24

Family

ID=37797174

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2005224170A Active JP4754294B2 (en) 2005-08-02 2005-08-02 Method and apparatus for adjusting mirror surface angle of vehicle mirror

Country Status (1)

Country Link
JP (1) JP4754294B2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9704484B2 (en) 2012-08-10 2017-07-11 Honda Access Corp. Speech recognition method and speech recognition device

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5316050B2 (en) * 2008-04-21 2013-10-16 株式会社デンソー Visibility providing device
JP5368771B2 (en) * 2008-11-10 2013-12-18 パナソニック株式会社 Crew monitoring device
JP5400458B2 (en) * 2009-04-21 2014-01-29 矢崎エナジーシステム株式会社 In-vehicle shooting unit
FR2945630B1 (en) * 2009-05-14 2011-12-30 Airbus France Method and system for remotely inspecting a structure
JP4837762B2 (en) 2009-06-18 2011-12-14 本田技研工業株式会社 In-vehicle device operation device
US8467551B2 (en) * 2010-07-30 2013-06-18 Gentex Corporation Vehicular directional microphone assembly for preventing airflow encounter
JP2013047019A (en) * 2011-08-27 2013-03-07 Denso Corp Vehicle mirror control device
US9296338B2 (en) * 2014-02-24 2016-03-29 Intel Corporation Vehicle mirror adjustment

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09216530A (en) * 1996-02-09 1997-08-19 Soshio Enterp Kk Autopositioning interlocking mirror
JP2002274265A (en) * 2001-03-22 2002-09-25 Honda Motor Co Ltd Mirror adjustment device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09216530A (en) * 1996-02-09 1997-08-19 Soshio Enterp Kk Autopositioning interlocking mirror
JP2002274265A (en) * 2001-03-22 2002-09-25 Honda Motor Co Ltd Mirror adjustment device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9704484B2 (en) 2012-08-10 2017-07-11 Honda Access Corp. Speech recognition method and speech recognition device

Also Published As

Publication number Publication date
JP2007038790A (en) 2007-02-15

Similar Documents

Publication Publication Date Title
DE10237988B4 (en) Vehicle imaging device and vehicle monitoring device
US8814401B2 (en) Vehicular vision system
US9656608B2 (en) Driver assist system for vehicle
EP1658191B1 (en) Method for controlling the display of different information in a vehicle and optoacoustic information unit
US7248151B2 (en) Virtual keypad for vehicle entry control
EP1510423B1 (en) Driver certifying system
US9656691B2 (en) Method for performing an at least semi-autonomous parking process of a motor vehicle in a garage, parking assistance system and motor vehicle
US8938337B2 (en) Vehicle door control apparatus and method for controlling vehicle door
EP1120313B1 (en) Monitoring device for a vehicle, preferably a motor vehicle
US20080154613A1 (en) Voice command processing system in a vehicle environment
US7343234B2 (en) Vehicle control unit and vehicle control system having the same
DE19700665C5 (en) Sensor for detecting foreign material and windshield wiper system with sensor for detecting foreign material, especially raindrops
DE202014102291U1 (en) Rearview mirror position using rearview camera system
US20030152251A1 (en) Method and apparartus for picking up object being authenticated
US20060202843A1 (en) Image capturing apparatus and monitoring apparatus for vehicle driver
EP1379411B1 (en) Imaging rain sensor illumination positioning system
DE102012102564A1 (en) Driving assistance device for a vehicle
JP2013152700A (en) Driver monitor device
KR101498976B1 (en) Parking asistance system and parking asistance method for vehicle
US20120217764A1 (en) Multi-function camera system
DE10227221A1 (en) Method for monitoring the interior or exterior of a vehicle and a vehicle with at least one panoramic camera
JP2009040270A (en) In-vehicle camera
CN101730635A (en) In-vehicle information display device and illumination device used for the same
JP2002240629A (en) On-vehicle video camera
EP1185436B1 (en) Holding device and method for detecting a vehicle environment with at least one camera

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20080321

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20100916

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20110301

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20110517

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20110525

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20140603

Year of fee payment: 3

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

S531 Written request for registration of change of domicile

Free format text: JAPANESE INTERMEDIATE CODE: R313531

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250