US9041809B2 - Periphery monitoring apparatus - Google Patents

Periphery monitoring apparatus Download PDF

Info

Publication number
US9041809B2
US9041809B2 US14/122,006 US201214122006A US9041809B2 US 9041809 B2 US9041809 B2 US 9041809B2 US 201214122006 A US201214122006 A US 201214122006A US 9041809 B2 US9041809 B2 US 9041809B2
Authority
US
United States
Prior art keywords
vehicle
mirror
camera
light source
monitoring apparatus
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
US14/122,006
Other versions
US20140078306A1 (en
Inventor
Hidehiko Miyoshi
Kazuya Watanabe
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Aisin Corp
Original Assignee
Aisin Seiki Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Aisin Seiki Co Ltd filed Critical Aisin Seiki Co Ltd
Assigned to AISIN SEIKIN KABUSHIKI KAISHA reassignment AISIN SEIKIN KABUSHIKI KAISHA ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MIYOSHI, HIDEHIKO, WATANABE, KAZUYA
Publication of US20140078306A1 publication Critical patent/US20140078306A1/en
Application granted granted Critical
Publication of US9041809B2 publication Critical patent/US9041809B2/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
    • B60R11/04—Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
    • B60Q1/0017—Devices integrating an element dedicated to another function
    • B60Q1/0023—Devices integrating an element dedicated to another function the element being a sensor, e.g. distance sensor, camera
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
    • B60Q1/02—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments
    • B60Q1/24—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments for lighting other areas than only the way ahead
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
    • B60Q1/02—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments
    • B60Q1/24—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments for lighting other areas than only the way ahead
    • B60Q1/249—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments for lighting other areas than only the way ahead for illuminating the field of view of a sensor or camera
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
    • B60Q1/26—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
    • B60Q1/48—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for parking purposes
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/103—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using camera systems provided with artificial illumination device, e.g. IR light source
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/301—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/806—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for aiding parking

Definitions

  • the present invention relates to a periphery monitoring apparatus for monitoring the periphery of a vehicle.
  • a vehicle drive assisting apparatus disclosed in Patent Document 1 is configured such that an in-vehicle camera capable of photographing the peripheral area of a vehicle, a light guiding means for guiding light from a photographic subject present at a position deviated from the optical axis of the in-vehicle camera to a photo detector of the in-vehicle camera, are housed in a light-transparent cover of a vehicle lamp unit. With this configuration, it is possible to photograph each of the left and right sides of the vehicle reflected in the light guiding means provided inside the transparent covers by the single in-vehicle camera.
  • a vehicle periphery monitoring apparatus disclosed in Patent Document 2 includes a reflector mirror disposed in front of a lamp unit for illuminating the outside of the vehicle and having a non-planar face, a photographing device having a lens face receiving light through the reflector mirror for photographing the periphery condition of the vehicle, and an incidence preventing means for preventing the irradiated light from the lamp unit from entering the photographing device when the lamp unit is lit.
  • the incidence preventing means is provided in an optical path along which the irradiated light from the lamp unit travels through the reflector mirror to reach the photographing device.
  • Patent Document 1 is capable of photographing a wide area in the width direction of the self vehicle.
  • the technique disclosed in Patent Document 2 involves an arrangement wherein the unit per se constantly projects, so there is the possibility of impairing the outer appearance of the vehicle. Further, as the unit is disposed in front of the lamp unit, the arrangement can interfere with irradiation by the lamp unit also.
  • the object of the present invention is to provide a periphery monitoring apparatus capable of photographing a vicinity of a vehicle.
  • the apparatus comprises: a light source configured to be provided in a vehicle for illuminating the periphery of the vehicle; and a camera photographing a condition of the periphery of the vehicle with an optical axis changed by a mirror toward the underside of a circumferential edge of the vehicle illuminated by at least a portion of light irradiated from the light source reflected by the mirror configured to be disposed on the outer side of the circumferential edge of the vehicle.
  • the apparatus can be realized at low costs, since there is no need for providing a new light source.
  • the blind spot of the vehicle as the target of photography by the camera is illuminated, the vicinity of the vehicle can be clearly photographed even in the case of dim situation such as nighttime, twilight, etc.
  • the camera can be formed compact. Hence, it becomes possible to employ an inexpensive camera.
  • the blind spot of the vehicle is photographed by the camera with illumination of this blind spot. Hence, it is possible to have the driver recognize an object present in the periphery of the vehicle.
  • the optical axis changed by the mirror is configured to pass the light irradiated from the light source and reflected by the mirror.
  • the photographic range covered by the camera can be illuminated by the light source. Hence, the vicinity of the vehicle can be photographed clearly even in a dim condition.
  • a mirror reflecting the light from the light source and the mirror changing the optical axis are constituted of a same mirror.
  • the camera is disposed on the inner side of the circumferential edge portion of the vehicle.
  • the camera will not come into contact with an object present in the periphery of the vehicle. Therefore, damage to the camera can be prevented.
  • the camera is provided within a headlight unit of the vehicle having the light source.
  • the apparatus further comprises a drive mechanism for causing the mirror reflecting the light from the light source to project along the circumferential direction beyond the circumferential edge of the vehicle.
  • the mirror can be projected automatically.
  • the mirror reflecting the light from the light source is projected/retracted according to the speed of the vehicle.
  • the mirror does not project from the circumferential edge of the vehicle when not needed. Hence, the outer appearance of the vehicle is not impaired.
  • the mirror comprises a non-planar mirror.
  • FIG. 1 is a plane view of a vehicle having a periphery monitoring apparatus
  • FIG. 2 is a block diagram schematically showing the configuration of the periphery monitoring apparatus
  • FIG. 3 is a view showing an exemplary case when the left front portion of the vehicle is photographed by the periphery monitoring apparatus relating to a first embodiment
  • FIG. 4 is a view showing an exemplary case when the left front portion of the vehicle is photographed by the periphery monitoring apparatus relating to the first embodiment
  • FIG. 5 is a view showing with enlargement the left front portion of the vehicle having a periphery monitoring apparatus relating to a second embodiment
  • FIG. 6 is a view showing with enlargement the left front portion of the vehicle having a periphery monitoring apparatus relating to a third embodiment
  • FIG. 7 is a view showing with enlargement the left front portion of the vehicle having a periphery monitoring apparatus relating to a fourth embodiment
  • FIG. 8 is a view showing a periphery monitoring image displayed on a display device relating to a further embodiment.
  • a periphery monitoring apparatus 100 relating to the present invention is provided in a vehicle 1 and has a function of photographing the circumferential edge portion of the vehicle 1 and a region including the perpendicularly downside of the circumferential edge portion.
  • a plane view of the vehicle 1 having such periphery monitoring apparatus 100 .
  • perspective views which schematically show the four corners of the vehicle 1 (a left front portion, a right front portion, a left rear portion and a right rear portion of the vehicle 1 ).
  • the periphery monitoring apparatus 100 is comprised of a camera 20 and a mirror 30 disposed at each of the four corners.
  • FIG. 2 is a block diagram schematically showing the configuration of the periphery monitoring apparatus 100 .
  • the periphery monitoring apparatus 100 includes respective functional units of a light source 10 , the camera 20 , the mirror 30 , a drive section 40 , a control section 50 , a vehicle state detection section 60 , and a display device 70 .
  • the above-described respective functional units are constituted of software and/or hardware comprising a CPU as a core component for effecting various operations for the periphery monitoring of the vehicle 1 for the sake of ease of driver's driving.
  • the light source 10 illuminates the periphery of the vehicle 1 . More particularly, the light source 10 irradiates light toward the periphery of the vehicle 1 .
  • Such light source 10 corresponds to e.g. a light bulb 11 of a headlight or a light bulb 12 of a rear lamp of the vehicle 1 .
  • these light bulbs can be a light bulb 13 of a fog lamp though not shown.
  • Each of the bulbs 11 and 12 has its light-on/light-out (illumination/dis-illumination) controlled by an illumination control section 54 to be described later.
  • the camera 20 photographs a situation or condition of the periphery of the vehicle 1 .
  • the camera 20 is provided at each of the left front portion, the right front portion, the left rear portion and the right rear portion of the of the vehicle 1 as described above and is comprised of a left front camera 21 , a right front camera 22 , a left rear camera 23 and a right rear camera 24 .
  • Each of these cameras 21 - 24 is constituted of e.g. a CCD camera or CIS (CMOS image sensor) or the like and effects a photographic operation in real time.
  • An image obtained by photography is transmitted to an image generation section 51 which will be described later.
  • the mirror 30 too is provided, as described above, at each of the left front portion, the right front portion, the left rear portion and the right rear portion of the vehicle 1 and is comprised of a left front mirror 31 , a right front mirror 32 , a left rear mirror 33 and a right rear mirror 34 .
  • the drive section 40 causes each of these mirrors 31 - 34 to project.
  • the drive section 40 is provided in correspondence with the respective mirrors 31 - 34 . That is, the section 40 is comprised of a left front drive mechanism 41 for causing the left front mirror 31 to project, a right front drive mechanism 42 for causing the right front mirror 32 to project, a left rear drive mechanism 43 for causing the left rear mirror 33 to project and a right rear drive mechanism 44 for causing the right rear mirror 34 to project.
  • Each of these drive mechanisms 41 - 44 is controlled by a drive control section 52 to be described later.
  • the vehicle condition detection section 60 detects at least one of a behavior and a condition of a driving operation of the vehicle 1 .
  • the vehicle condition detection section 60 is comprised of a steering angle sensor 61 , a shift position sensor 62 and a vehicle speed sensor 63 .
  • the vehicle condition detection section 60 in the instant embodiment will be described as one for detecting both a behavior and a condition of a driving operation of the vehicle 1 .
  • the section detects vehicle information indicative of condition of the vehicle 1 .
  • the steering angle sensor 61 detects a steering angle of a steering wheel (not shown) provided in the vehicle 1 .
  • the language “steering angle” corresponds to a rotational angle formed when the steering wheel has been rotated clockwise or counter clockwise from its neutral condition.
  • neutral condition refers to a condition where the direction of steerable wheels (not shown) provided in the vehicle 1 is parallel with the vehicle width, that is, a condition where the vehicle 1 can travel straight.
  • the steering angle sensor 61 for detecting such rotational angle of the steering wheel can be comprised by using a hall effect sensor.
  • a hall effect sensor is a device configured to detect a magnetic flux with utilization of the hall effect which produces an electromotive force according to a force received for moving an electric charge inside a conductor in the lateral direction when a magnetic field is applied to the conductor through which an electric current is flowing.
  • the steering angle sensor 61 calculates the steering angle of the steering wheel based on this detection result. And, a steering angle calculated by the steering angle sensor 61 is transmitted as steering information to a position determination section 53 which will be described later.
  • the shift position sensor 62 effects detection of a shift position of a shift lever (not shown) provided in the vehicle 1 .
  • the shift lever in this embodiment, is a lever for effecting switchover of gears provided in an AT (Automatic Transmission) mechanism.
  • AT mechanism includes a [P] range for use mainly at the time of parking wherein the drive line is locked in a speed changer, an [R] range for use in reversing, an [N] range where the inside of the speed changer is rendered to a free state and power of the engine is not transmitted to the drive line, a [D] range for use in normal traveling, a [2] range for use when the engine brake is used on a downslope, etc.
  • the AT mechanism is configured such that output voltages corresponding to these shift ranges can be outputted for the respective shift positions.
  • the shift position sensor 62 is capable of detecting a current shift position through detection of this output voltage. The detection result of the shift position detected by the shift position sensor 62 is transmitted to the position determination section 53 to be described later.
  • the vehicle speed sensor 63 effects detection of a rotational speed of the traveling wheels (not shown) provided in the vehicle 1 .
  • the vehicle speed sensor 63 too is capable of detecting a rotational speed of the wheels by employing a hall effect sensor like the steering angle sensor 61 described above.
  • the vehicle speed sensor 63 is provided to e.g. the rotational shaft of the left front wheel and the rotational shaft of the right front wheel. With provision of the vehicle speed sensors 63 to the rotational shafts of both of the left and right wheels, it becomes possible to detect difference between a straight traveling and a turning. That is, if it is found that the rotational speeds of the left and right wheels are same, this can be determined as a straight traveling.
  • the vehicle speed sensor 63 is provided to at least one of the rotational shafts of the front wheels and the rear wheels provided in the vehicle 1 .
  • the detection result of the wheel speeds detected by the vehicle speed sensor 63 is transmitted to the position determination section 53 to be described later.
  • the control section 50 includes the image generation section 51 , the drive control section 52 , the position determination section 53 , and the illumination control section 54 .
  • the position determination section 53 determines a position as the monitoring target based on the detection results of the steering angle sensor 61 , the shift position sensor 62 and the vehicle speed sensor 63 .
  • the position determination section 53 determines a front position as the monitoring target position. If the detection result indicates that the shift lever is currently located at a shift position for use in reversing, the position determination section 53 determines a rear position as the monitoring target position.
  • the position determination section 53 determines a right position as the monitoring target position. Whereas, if the detection result indicates that the steering wheel has been rotated to the right, the position determination section 53 determines a left position as the monitoring target position.
  • the position determination section 53 determines that no monitoring is to be effected. Whereas, if the detection result indicates a value below the preset value, the position determination section 53 determines that monitoring is to be effected.
  • the position determination section 53 determines whether to effect monitoring or not and determines also a monitoring target position when monitoring is to be effected. Then, the position determination section 53 transmits the determined monitoring target position to the image generation section 51 , the drive control section 52 and the illumination control section 54 .
  • the drive control section 52 controls a corresponding drive mechanism so as to cause the mirror corresponding to the monitoring target position determined by the position determination section 53 to project. With this, the mirror located the monitoring target position will be projected.
  • the illumination control section 54 causes the light bulb 11 of the headlight and the light bulb 12 of the rear lamp to illuminate.
  • the light bulb to be illuminated can be at the position determined by the position determination section 53 , that is, the bulb can be at only one of the front portion and the rear portion.
  • the image generation section 51 generates display image data based on an image obtained by the camera corresponding to the monitoring target position determined by the position determination section 53 .
  • the generated display image data is transmitted to the display device 70 to be displayed.
  • FIG. 3 is a view showing the left front portion of the vehicle 1 with an enlargement.
  • the light source 10 corresponds to the light bulb 11 of the headlight of the vehicle 1 .
  • the left front camera 21 (camera 20 ) is provided on the inner side of the circumferential edge portion of the vehicle 1 .
  • the language “circumferential edge portion of the vehicle 1 ” refers to the outer edge portion of the vehicle 1 as seen in a plane view thereof like the FIG. 1 illustration. Therefore, the left front camera 21 (camera 20 ) is disposed so as not to project beyond the outer edge portion of the vehicle 1 in the plane view of the vehicle 1 .
  • the left front camera 21 (camera 20 ) is disposed inside a headlight unit 15 of the vehicle 1 having the light source 10 .
  • the left front camera 21 (camera 20 ) can be provided within a sealed space, there is no need to provide the left front camera 21 (camera 20 ) with any water proof treatment or dust proof treatment. Therefore, cost reduction can be realized with the possibility of prevention of deterioration of the camera.
  • the left front mirror 31 (mirror 30 ) is comprised of a first mirror 31 A and a second mirror 31 B.
  • the first mirror 31 A reflects at least a portion of the light irradiated from the light source 10 to illuminate the circumferential edge portion of the vehicle 1 .
  • the light source 10 comprises the light bulb 11 of the headlight. Therefore, the light irradiated from the light source 10 becomes a portion of the light irradiated from the light source 10 .
  • the circumferential edge portion of the vehicle 1 is the outer edge portion as shown in the plane view, which is denoted with a mark S in FIG. 3 . With the illumination of the circumferential edge portion S, the underside (region R) of this circumferential edge portion S is also illuminated.
  • FIG. 4 shows these circumferential edge portion S and the region R as seen from the perpendicular upper side.
  • the first mirror 31 A is disposed on the outer side of the circumferential edge portion S of the vehicle 1 .
  • the first mirror 31 A is caused by the left front drive mechanism 41 (drive section 40 ) to project in the circumferential direction beyond the circumferential edge portion S of the vehicle 1 .
  • the left front drive mechanism 41 includes an unillustrated actuator and the first mirror 31 A is caused to project beyond the circumferential edge portion S by the actuator acting as the power source.
  • the light from the headlight unit 15 has a certain degree of horizontal extension of a predetermined angle. Then, the light having such horizontal extension is reflected by the first mirror 31 A projecting in the circumferential direction beyond the circumferential edge portion S and extended to the perpendicularly underside of the circumferential edge portion S, so that the circumferential edge portion S and the region R can be illuminated brightly.
  • the second mirror 31 B changes the optical axis of the left front camera 21 toward the underside of the circumferential edge portion S of the vehicle 1 .
  • the left front camera 21 is disposed inside the headlight unit 15 as described hereinbefore. Therefore, the optical axis of the left front camera 21 is oriented forwardly of the vehicle 1 , and the second mirror 31 B changes this optical axis to the direction of the circumferential edge portion S. With this, the left front camera 21 photographs the situations of the circumferential edge portion S and the region R reflected in the second mirror 31 B.
  • the first mirror 31 A and the second mirror 31 B are comprised of a same mirror. With this, cost reduction can be realized.
  • these mirrors will be explained collectively as the left front mirror 31 .
  • the left front mirror 31 can employ a planar mirror, but in case there exists significant misalignment between the left front camera 21 and the light source 10 , the left front mirror 31 can be comprised of a non-planar face (e.g. a convex face). In the case of the mirror comprised of a non-planar mirror, it will be preferred for the above-described image generation section 51 to effect a known image processing on the image photographed by the left front camera 21 for eliminating distortion therefrom.
  • the left front mirror 31 (mirror 30 ) is configured to be projected/retracted according to the speed of the vehicle 1 .
  • the term “projected/retracted” refers to projection and retraction.
  • the left front mirror 31 is caused to project by the left front drive mechanism 41 as described hereinbefore. And, its retraction too is effected by the left front drive mechanism 41 . More particularly, the left front mirror 31 is projected when the speed of the vehicle 1 becomes below a preset value and is retracted when the speed of the vehicle 1 becomes greater than the preset value.
  • This control can be effected by the left front drive mechanism 41 based on detection result of the vehicle speed sensor 63 . Incidentally, with using a known technique, the control will be effected so as not to project the left front mirror 31 (mirror 30 ) during a low speed traveling due to simple traffic congestion or the like.
  • FIG. 4 shows one example of such image displayed by the display device 70 .
  • the inventive periphery monitoring apparatus 100 obtains an image of the vehicle 1 as seen from the outer side in the circumferential direction of the vehicle 1 because the camera 20 effects photography with orientation toward the circumferential edge portion S side of the vehicle 1 via the mirror 30 . Therefore, the image will contain a portion of the vehicle 1 as shown by the exemplary image to be displayed on the monitor device 70 in FIG. 4 .
  • Such image as above showing the vehicle 1 as seen from the outside will be displayed on the display device 70 . Based on this image, the driver of the vehicle 1 will visually confirm the immediate vicinity of the vehicle 1 and can readily grasp the distance between the vehicle 1 and an object present in the periphery of this vehicle 1 .
  • the inventive periphery monitoring apparatus 100 by reflecting a portion of the light source 10 for illuminating the periphery of the vehicle 1 by the mirror 30 , it is possible to illuminate a blind spot of the vehicle 1 . Therefore, there is no need to provide any additional light source 10 , so that the apparatus can be realized at low costs. Further, as the blind spot of the vehicle 1 as the photographic object of the camera 20 is illuminated, it is possible to photograph the vicinity of the vehicle 1 clearly even when it is dim such as in a nighttime or twilight. Further, through adjustment of the shape and size of the mirror 30 for changing the optical axis of the camera 20 , the camera 20 can be formed compact. Accordingly, it is possible to employ an inexpensive camera 20 . As described above, according to the present invention, since a blind spot of the vehicle 1 is photographed by the camera 20 with illumination of this blind spot, it becomes possible to cause the driver to recognize an object present in the periphery of the vehicle 1 .
  • FIG. 5 is a view showing with enlargement the left front portion of the vehicle 1 having a periphery monitoring apparatus 100 relating to this embodiment.
  • the left front camera 21 is provided outside the headlight unit 15 .
  • the left front camera 21 by using a convex mirror as the left front mirror 31 , it is possible for the left front camera 21 to photograph the circumferential edge portion S of the vehicle 1 and the region R including the perpendicularly downside of this circumferential edge portion S.
  • FIG. 6 is a view showing with enlargement the left front portion of the vehicle 1 having a periphery monitoring apparatus 100 relating to this embodiment.
  • FIG. 7 is a view showing with enlargement the left front portion of the vehicle 1 having a periphery monitoring apparatus 100 relating to this embodiment.
  • the first mirror 31 A and the second mirror 31 B are provided separately.
  • the first mirror 31 A bends the light from the light source 10 and the second mirror 31 B changes the optical axis of the left front camera 21 .
  • Projection and retraction of each of these mirrors 31 A, 31 B are effected by the left front drive mechanism 41 .
  • the left front drive mechanism 41 can be an integrated mechanism for both projection/retraction of the first mirror 31 A and projection/retraction of the second mirror 31 B, or can be provided as separate mechanisms, one for the projection/retraction of the first mirror 31 A and the other for the projection/retraction of the second mirror 31 B.
  • the left front camera 21 is provided outside the headlight unit 15 . With this arrangement too, it is possible for the left front camera 21 to photograph the circumferential edge portion S of the vehicle 1 and the region R including the perpendicularly downside of this circumferential edge portion S.
  • the camera 20 is provided inside the headlight unit 15 .
  • the range of application of the present invention is not limited thereto.
  • the camera 20 can be provided inside the fog lamp unit as a matter of course.
  • the light source 10 comprises the light bulb 12 of the rear lamp
  • the camera 20 can be provided inside the rear lamp unit as a matter of course.
  • the first mirror 31 A and the second mirror 31 B project or retract according to the speed of the vehicle 1 .
  • the range of application of the present invention is not limited thereto. It is also possible as a matter of course to employ an arrangement in which the mirrors project or retract in response to e.g. an operation on a touch panel by the driver of the vehicle 1 , rather than according to the speed of the vehicle 1 .
  • the camera 20 and the mirror 30 are provided at the left front portion, the right front portion, the left rear portion and the right rear portion of the vehicle 1 , respectively.
  • the range of application of the present invention is not limited thereto.
  • the camera 20 and the mirror 30 can be provided at the front portion or rear portion of the vehicle 1 . Or, they can be provided at the left portion or right portion of the vehicle 1 . Or, they can be provided only at a predetermined position of the vehicle 1 as a matter of course.
  • the range of application of the present invention is not limited thereto.
  • the invention can be applied also to a large vehicle such as a bus, a truck, etc. or can be applied to a heavy machinery or the like as a matter of course.
  • the display device 70 displays an image of a portion of the vehicle 1 photographed by the camera 20 .
  • the range of application of the present invention is not limited thereto.
  • an image obtained by synthesizing an image obtained by the camera 20 with an image picture of the vehicle 1 can be displayed also.
  • the term “image picture” of the vehicle 1 means a pre-stored image picture, not an image actually obtained by the camera 20 .
  • the image picture can be a portion of a bird's eye view image of the vehicle 1 for instance.
  • the periphery monitoring apparatus 100 includes the light source 10 provided in the vehicle 1 for illuminating the periphery of this vehicle 1 , the camera 20 for photographing a situation of the periphery of the vehicle 1 , the first mirror 31 A for bending the light irradiated from the light source 10 toward the circumferential edge portion S side of the vehicle 1 , and the second mirror 31 B for changing the optical axis of the camera 20 toward the circumferential edge portion S side.
  • the first mirror 31 A and the second mirror 31 B can be comprised of a same mirror like the first embodiment and the second embodiment. Or, like the third embodiment and the fourth embodiment, the first mirror 31 A and the second mirror 31 B can be provided as separate mirrors.
  • the position determination section 53 determines the front portion as the monitoring target position; whereas, if the shift position sensor 62 detects that the shift lever is located at a shift position used at the time of reversing, the position determination section 53 determines the rear portion as the monitoring target position.
  • the range of application of the present invention is not limited thereto. For instance, in the case of parallel parking, even in the case of reversing of the vehicle 1 , a blind spot present on the front side can be displayed as a matter of course.
  • the light bulb 12 of the rear lamp can be used as one light source of the vehicle 1 .
  • the range of application of the present invention is not limited thereto.
  • the present invention may be applied to a periphery monitoring apparatus for monitoring the periphery of a vehicle.

Abstract

A periphery monitoring apparatus capable of photographing a vicinity of a vehicle without impairing the outer appearance of the vehicle includes a light source configured to be provided in the vehicle for illuminating the periphery of the vehicle, and a camera photographing a condition of the periphery of the vehicle with an optical axis changed by a mirror toward the underside of the circumferential edge of the vehicle illuminated by at least a portion of light irradiated from the light source reflected by the mirror configured to be disposed on the outer side of the circumferential edge of the vehicle.

Description

CROSS REFERENCE TO RELATED APPLICATIONS
This application is a National Stage of International Application No. PCT/JP2012/064174, filed on May 31, 2012, which claims priority from Japanese Patent Application No. 2011-141910, filed on Jun. 27, 2011, the contents of all of which are incorporated herein by reference in their entirety.
TECHNICAL FIELD
The present invention relates to a periphery monitoring apparatus for monitoring the periphery of a vehicle.
BACKGROUND ART
Conventionally, there is an apparatus including a camera mounted in a vehicle in order to monitor the blind spot of the vehicle. As examples of techniques of this type, there are those disclosed in Patent Documents 1 and 2 identified below.
A vehicle drive assisting apparatus disclosed in Patent Document 1 is configured such that an in-vehicle camera capable of photographing the peripheral area of a vehicle, a light guiding means for guiding light from a photographic subject present at a position deviated from the optical axis of the in-vehicle camera to a photo detector of the in-vehicle camera, are housed in a light-transparent cover of a vehicle lamp unit. With this configuration, it is possible to photograph each of the left and right sides of the vehicle reflected in the light guiding means provided inside the transparent covers by the single in-vehicle camera.
A vehicle periphery monitoring apparatus disclosed in Patent Document 2 includes a reflector mirror disposed in front of a lamp unit for illuminating the outside of the vehicle and having a non-planar face, a photographing device having a lens face receiving light through the reflector mirror for photographing the periphery condition of the vehicle, and an incidence preventing means for preventing the irradiated light from the lamp unit from entering the photographing device when the lamp unit is lit. The incidence preventing means is provided in an optical path along which the irradiated light from the lamp unit travels through the reflector mirror to reach the photographing device. With this arrangement, it is made possible to photograph the blind spot portion of the vehicle, with preventing the irradiated light from passing toward the photographing device.
PRIOR ART DOCUMENTS Patent Documents
  • Patent Document 1: Japanese Unexamined Patent Application Publication No. 2007-131162
  • Patent Document 2: Japanese Patent Publication No. 4231962
SUMMARY OF THE INVENTION Object to be Achieved by Invention
The technique disclosed in Patent Document 1 is capable of photographing a wide area in the width direction of the self vehicle. However, as its photographing range is small in the length direction of the self vehicle, it is difficult to utilize this technique for checking the blind spots present on the lateral sides of the self vehicle. Also, the technique disclosed in Patent Document 2 involves an arrangement wherein the unit per se constantly projects, so there is the possibility of impairing the outer appearance of the vehicle. Further, as the unit is disposed in front of the lamp unit, the arrangement can interfere with irradiation by the lamp unit also.
In view of the above-described state of the art, the object of the present invention is to provide a periphery monitoring apparatus capable of photographing a vicinity of a vehicle.
Means for Achieving the Object
For achieving the above-noted object, according to the characterizing feature of a periphery monitoring apparatus relating to the present invention, the apparatus comprises: a light source configured to be provided in a vehicle for illuminating the periphery of the vehicle; and a camera photographing a condition of the periphery of the vehicle with an optical axis changed by a mirror toward the underside of a circumferential edge of the vehicle illuminated by at least a portion of light irradiated from the light source reflected by the mirror configured to be disposed on the outer side of the circumferential edge of the vehicle.
With the above-described characterizing feature, as a portion of light irradiated from the light source for illuminating the periphery of the vehicle is reflected by the mirror, the blind spots of the vehicle can be illuminated. Therefore, the apparatus can be realized at low costs, since there is no need for providing a new light source. Further, as the blind spot of the vehicle as the target of photography by the camera is illuminated, the vicinity of the vehicle can be clearly photographed even in the case of dim situation such as nighttime, twilight, etc. Further, through adjustment of the shape or size of the mirror for changing the optical axis of the camera, the camera can be formed compact. Hence, it becomes possible to employ an inexpensive camera. As described above, according to the present invention, the blind spot of the vehicle is photographed by the camera with illumination of this blind spot. Hence, it is possible to have the driver recognize an object present in the periphery of the vehicle.
Further, preferably, the optical axis changed by the mirror is configured to pass the light irradiated from the light source and reflected by the mirror.
With this arrangement, the photographic range covered by the camera can be illuminated by the light source. Hence, the vicinity of the vehicle can be photographed clearly even in a dim condition.
Further, preferably, a mirror reflecting the light from the light source and the mirror changing the optical axis are constituted of a same mirror.
With the above-described arrangement, as two mirrors are constituted of a same mirror, cost reduction can be realized.
Further, preferably, the camera is disposed on the inner side of the circumferential edge portion of the vehicle.
With the above-described arrangement, the camera will not come into contact with an object present in the periphery of the vehicle. Therefore, damage to the camera can be prevented.
Further, preferably, the camera is provided within a headlight unit of the vehicle having the light source.
With the above-described arrangement, there is no need for providing water proof treatment or dust proof treatment to the camera. Accordingly, cost reduction can be realized with possibility of prevention of deterioration of the camera.
Further, preferably, the apparatus further comprises a drive mechanism for causing the mirror reflecting the light from the light source to project along the circumferential direction beyond the circumferential edge of the vehicle.
With the above-described arrangement, the mirror can be projected automatically.
Further, preferably, the mirror reflecting the light from the light source is projected/retracted according to the speed of the vehicle.
With the above-described arrangement, the mirror does not project from the circumferential edge of the vehicle when not needed. Hence, the outer appearance of the vehicle is not impaired.
Further, preferably, the mirror comprises a non-planar mirror.
With the above-described arrangement, with use of the non-planar mirror, it becomes possible to adjust a misalignment if any between the camera and the optical axis. Therefore, even when there exists significant misalignment between the camera and the optical axis, with adjustment of this misalignment, the vicinity of the vehicle can be photographed clearly.
BRIEF DESCRIPTION THE DRAWINGS
FIG. 1 is a plane view of a vehicle having a periphery monitoring apparatus,
FIG. 2 is a block diagram schematically showing the configuration of the periphery monitoring apparatus,
FIG. 3 is a view showing an exemplary case when the left front portion of the vehicle is photographed by the periphery monitoring apparatus relating to a first embodiment,
FIG. 4 is a view showing an exemplary case when the left front portion of the vehicle is photographed by the periphery monitoring apparatus relating to the first embodiment,
FIG. 5 is a view showing with enlargement the left front portion of the vehicle having a periphery monitoring apparatus relating to a second embodiment,
FIG. 6 is a view showing with enlargement the left front portion of the vehicle having a periphery monitoring apparatus relating to a third embodiment,
FIG. 7 is a view showing with enlargement the left front portion of the vehicle having a periphery monitoring apparatus relating to a fourth embodiment, and
FIG. 8 is a view showing a periphery monitoring image displayed on a display device relating to a further embodiment.
 MODES OF EMBODYING THE INVENTION First Embodiment
Next, an embodiment of the present invention will be explained with reference to the drawings. A periphery monitoring apparatus 100 relating to the present invention is provided in a vehicle 1 and has a function of photographing the circumferential edge portion of the vehicle 1 and a region including the perpendicularly downside of the circumferential edge portion. At the center of FIG. 1, there is shown a plane view of the vehicle 1 having such periphery monitoring apparatus 100. Further, around this plane view, there are shown perspective views which schematically show the four corners of the vehicle 1 (a left front portion, a right front portion, a left rear portion and a right rear portion of the vehicle 1). As shown in these drawings, in the instant embodiment, the periphery monitoring apparatus 100 is comprised of a camera 20 and a mirror 30 disposed at each of the four corners.
FIG. 2 is a block diagram schematically showing the configuration of the periphery monitoring apparatus 100. The periphery monitoring apparatus 100 includes respective functional units of a light source 10, the camera 20, the mirror 30, a drive section 40, a control section 50, a vehicle state detection section 60, and a display device 70. The above-described respective functional units are constituted of software and/or hardware comprising a CPU as a core component for effecting various operations for the periphery monitoring of the vehicle 1 for the sake of ease of driver's driving.
The light source 10 illuminates the periphery of the vehicle 1. More particularly, the light source 10 irradiates light toward the periphery of the vehicle 1. Such light source 10 corresponds to e.g. a light bulb 11 of a headlight or a light bulb 12 of a rear lamp of the vehicle 1. For instance, these light bulbs, as a matter of course, can be a light bulb 13 of a fog lamp though not shown. Each of the bulbs 11 and 12 has its light-on/light-out (illumination/dis-illumination) controlled by an illumination control section 54 to be described later.
The camera 20 photographs a situation or condition of the periphery of the vehicle 1. The camera 20 is provided at each of the left front portion, the right front portion, the left rear portion and the right rear portion of the of the vehicle 1 as described above and is comprised of a left front camera 21, a right front camera 22, a left rear camera 23 and a right rear camera 24. Each of these cameras 21-24 is constituted of e.g. a CCD camera or CIS (CMOS image sensor) or the like and effects a photographic operation in real time. An image obtained by photography is transmitted to an image generation section 51 which will be described later.
The mirror 30 too is provided, as described above, at each of the left front portion, the right front portion, the left rear portion and the right rear portion of the vehicle 1 and is comprised of a left front mirror 31, a right front mirror 32, a left rear mirror 33 and a right rear mirror 34.
Though will be detailed later, the drive section 40 causes each of these mirrors 31-34 to project. The drive section 40 is provided in correspondence with the respective mirrors 31-34. That is, the section 40 is comprised of a left front drive mechanism 41 for causing the left front mirror 31 to project, a right front drive mechanism 42 for causing the right front mirror 32 to project, a left rear drive mechanism 43 for causing the left rear mirror 33 to project and a right rear drive mechanism 44 for causing the right rear mirror 34 to project. Each of these drive mechanisms 41-44 is controlled by a drive control section 52 to be described later.
The vehicle condition detection section 60 detects at least one of a behavior and a condition of a driving operation of the vehicle 1. The vehicle condition detection section 60 is comprised of a steering angle sensor 61, a shift position sensor 62 and a vehicle speed sensor 63. The vehicle condition detection section 60 in the instant embodiment will be described as one for detecting both a behavior and a condition of a driving operation of the vehicle 1. The section detects vehicle information indicative of condition of the vehicle 1.
The steering angle sensor 61 detects a steering angle of a steering wheel (not shown) provided in the vehicle 1. Here, the language “steering angle” corresponds to a rotational angle formed when the steering wheel has been rotated clockwise or counter clockwise from its neutral condition. The term “neutral condition” refers to a condition where the direction of steerable wheels (not shown) provided in the vehicle 1 is parallel with the vehicle width, that is, a condition where the vehicle 1 can travel straight. The steering angle sensor 61 for detecting such rotational angle of the steering wheel can be comprised by using a hall effect sensor. A hall effect sensor is a device configured to detect a magnetic flux with utilization of the hall effect which produces an electromotive force according to a force received for moving an electric charge inside a conductor in the lateral direction when a magnetic field is applied to the conductor through which an electric current is flowing.
In the case of such hall effect sensor described above, preferably, permanent magnets are arranged around the rotational shaft of the steering wheel, so that the magnetic field that varies according to steering wheel rotation is detected by the hall effect sensor. Also, as the detection result outputted from the hall effect sensor is an electric signal, the steering angle sensor 61 calculates the steering angle of the steering wheel based on this detection result. And, a steering angle calculated by the steering angle sensor 61 is transmitted as steering information to a position determination section 53 which will be described later.
The shift position sensor 62 effects detection of a shift position of a shift lever (not shown) provided in the vehicle 1. The shift lever, in this embodiment, is a lever for effecting switchover of gears provided in an AT (Automatic Transmission) mechanism. Such AT mechanism includes a [P] range for use mainly at the time of parking wherein the drive line is locked in a speed changer, an [R] range for use in reversing, an [N] range where the inside of the speed changer is rendered to a free state and power of the engine is not transmitted to the drive line, a [D] range for use in normal traveling, a [2] range for use when the engine brake is used on a downslope, etc. and the upper limit of shift-up operation is fixed to the second speed, and a [1] range for use when strong engine brake is used on a steep downslope, etc. and the gear is fixed to the first speed. The AT mechanism is configured such that output voltages corresponding to these shift ranges can be outputted for the respective shift positions. And, the shift position sensor 62 is capable of detecting a current shift position through detection of this output voltage. The detection result of the shift position detected by the shift position sensor 62 is transmitted to the position determination section 53 to be described later.
The vehicle speed sensor 63 effects detection of a rotational speed of the traveling wheels (not shown) provided in the vehicle 1. The vehicle speed sensor 63 too is capable of detecting a rotational speed of the wheels by employing a hall effect sensor like the steering angle sensor 61 described above. Preferably, the vehicle speed sensor 63 is provided to e.g. the rotational shaft of the left front wheel and the rotational shaft of the right front wheel. With provision of the vehicle speed sensors 63 to the rotational shafts of both of the left and right wheels, it becomes possible to detect difference between a straight traveling and a turning. That is, if it is found that the rotational speeds of the left and right wheels are same, this can be determined as a straight traveling. If it is found that the rotational speeds of the left and right wheels differ from each other, this can be determined as a turning to the side of the lower rotational speed. Incidentally, it will suffice for the vehicle speed sensor 63 to be provided to at least one of the rotational shafts of the front wheels and the rear wheels provided in the vehicle 1. The detection result of the wheel speeds detected by the vehicle speed sensor 63 is transmitted to the position determination section 53 to be described later.
The control section 50 includes the image generation section 51, the drive control section 52, the position determination section 53, and the illumination control section 54. The position determination section 53 determines a position as the monitoring target based on the detection results of the steering angle sensor 61, the shift position sensor 62 and the vehicle speed sensor 63.
For instance, if the detection result by the shift position sensor 62 indicates that the shift lever is currently located at a shift position for use in forward traveling, the position determination section 53 determines a front position as the monitoring target position. If the detection result indicates that the shift lever is currently located at a shift position for use in reversing, the position determination section 53 determines a rear position as the monitoring target position.
Further, if the detection result by the steering angle sensor 61 indicates that the steering wheel has been rotated to the left, the position determination section 53 determines a right position as the monitoring target position. Whereas, if the detection result indicates that the steering wheel has been rotated to the right, the position determination section 53 determines a left position as the monitoring target position.
Moreover, if the detection result by the vehicle speed sensor 63 indicates a value over a preset value, the position determination section 53 determines that no monitoring is to be effected. Whereas, if the detection result indicates a value below the preset value, the position determination section 53 determines that monitoring is to be effected.
Based on these results, the position determination section 53 determines whether to effect monitoring or not and determines also a monitoring target position when monitoring is to be effected. Then, the position determination section 53 transmits the determined monitoring target position to the image generation section 51, the drive control section 52 and the illumination control section 54.
The drive control section 52 controls a corresponding drive mechanism so as to cause the mirror corresponding to the monitoring target position determined by the position determination section 53 to project. With this, the mirror located the monitoring target position will be projected.
If the position determination section 53 has determined that monitoring is to be effected, the illumination control section 54 causes the light bulb 11 of the headlight and the light bulb 12 of the rear lamp to illuminate. In the course of this, the light bulb to be illuminated can be at the position determined by the position determination section 53, that is, the bulb can be at only one of the front portion and the rear portion.
The image generation section 51 generates display image data based on an image obtained by the camera corresponding to the monitoring target position determined by the position determination section 53. The generated display image data is transmitted to the display device 70 to be displayed.
Next, the specific movements of the mirror 30 will be explained. The movements of the mirror 30 are same for the left front portion, the right front portion, the left rear portion and the right rear portion. Therefore, in the following, the left front mirror 31 will be explained as an example. FIG. 3 is a view showing the left front portion of the vehicle 1 with an enlargement. As shown in FIG. 3, the light source 10 corresponds to the light bulb 11 of the headlight of the vehicle 1.
The left front camera 21 (camera 20) is provided on the inner side of the circumferential edge portion of the vehicle 1. Here, the language “circumferential edge portion of the vehicle 1” refers to the outer edge portion of the vehicle 1 as seen in a plane view thereof like the FIG. 1 illustration. Therefore, the left front camera 21 (camera 20) is disposed so as not to project beyond the outer edge portion of the vehicle 1 in the plane view of the vehicle 1. In particular, in the example illustrated in FIG. 3, the left front camera 21 (camera 20) is disposed inside a headlight unit 15 of the vehicle 1 having the light source 10. Therefore, as the left front camera 21 (camera 20) can be provided within a sealed space, there is no need to provide the left front camera 21 (camera 20) with any water proof treatment or dust proof treatment. Therefore, cost reduction can be realized with the possibility of prevention of deterioration of the camera.
The left front mirror 31 (mirror 30) is comprised of a first mirror 31A and a second mirror 31B. The first mirror 31A reflects at least a portion of the light irradiated from the light source 10 to illuminate the circumferential edge portion of the vehicle 1. As described above, the light source 10 comprises the light bulb 11 of the headlight. Therefore, the light irradiated from the light source 10 becomes a portion of the light irradiated from the light source 10. The circumferential edge portion of the vehicle 1 is the outer edge portion as shown in the plane view, which is denoted with a mark S in FIG. 3. With the illumination of the circumferential edge portion S, the underside (region R) of this circumferential edge portion S is also illuminated. FIG. 4 shows these circumferential edge portion S and the region R as seen from the perpendicular upper side. As shown in FIG. 3 and FIG. 4, the first mirror 31A is disposed on the outer side of the circumferential edge portion S of the vehicle 1.
The first mirror 31A is caused by the left front drive mechanism 41 (drive section 40) to project in the circumferential direction beyond the circumferential edge portion S of the vehicle 1. The left front drive mechanism 41 includes an unillustrated actuator and the first mirror 31A is caused to project beyond the circumferential edge portion S by the actuator acting as the power source.
Inside the headlight unit 15, there is provided a reflector for reflecting the light from the light source 10. Therefore, the light from the headlight unit 15 has a certain degree of horizontal extension of a predetermined angle. Then, the light having such horizontal extension is reflected by the first mirror 31A projecting in the circumferential direction beyond the circumferential edge portion S and extended to the perpendicularly underside of the circumferential edge portion S, so that the circumferential edge portion S and the region R can be illuminated brightly.
The second mirror 31B changes the optical axis of the left front camera 21 toward the underside of the circumferential edge portion S of the vehicle 1. Here, the left front camera 21 is disposed inside the headlight unit 15 as described hereinbefore. Therefore, the optical axis of the left front camera 21 is oriented forwardly of the vehicle 1, and the second mirror 31B changes this optical axis to the direction of the circumferential edge portion S. With this, the left front camera 21 photographs the situations of the circumferential edge portion S and the region R reflected in the second mirror 31B.
In the instant embodiment, the first mirror 31A and the second mirror 31B are comprised of a same mirror. With this, cost reduction can be realized. In the following discussion, except for a case where some special distinction is needed, these mirrors will be explained collectively as the left front mirror 31. The left front mirror 31 can employ a planar mirror, but in case there exists significant misalignment between the left front camera 21 and the light source 10, the left front mirror 31 can be comprised of a non-planar face (e.g. a convex face). In the case of the mirror comprised of a non-planar mirror, it will be preferred for the above-described image generation section 51 to effect a known image processing on the image photographed by the left front camera 21 for eliminating distortion therefrom.
The left front mirror 31 (mirror 30) is configured to be projected/retracted according to the speed of the vehicle 1. The term “projected/retracted” refers to projection and retraction. Here, the left front mirror 31 is caused to project by the left front drive mechanism 41 as described hereinbefore. And, its retraction too is effected by the left front drive mechanism 41. More particularly, the left front mirror 31 is projected when the speed of the vehicle 1 becomes below a preset value and is retracted when the speed of the vehicle 1 becomes greater than the preset value. This control can be effected by the left front drive mechanism 41 based on detection result of the vehicle speed sensor 63. Incidentally, with using a known technique, the control will be effected so as not to project the left front mirror 31 (mirror 30) during a low speed traveling due to simple traffic congestion or the like.
Next, the image to be displayed by the display device 70 will be explained. FIG. 4 shows one example of such image displayed by the display device 70. As shown by this image, with the periphery monitoring apparatus 100, it is possible to appropriately photograph a blind spot of the vehicle 1. As described above, the inventive periphery monitoring apparatus 100 obtains an image of the vehicle 1 as seen from the outer side in the circumferential direction of the vehicle 1 because the camera 20 effects photography with orientation toward the circumferential edge portion S side of the vehicle 1 via the mirror 30. Therefore, the image will contain a portion of the vehicle 1 as shown by the exemplary image to be displayed on the monitor device 70 in FIG. 4. Such image as above showing the vehicle 1 as seen from the outside will be displayed on the display device 70. Based on this image, the driver of the vehicle 1 will visually confirm the immediate vicinity of the vehicle 1 and can readily grasp the distance between the vehicle 1 and an object present in the periphery of this vehicle 1.
As described above, with the inventive periphery monitoring apparatus 100, by reflecting a portion of the light source 10 for illuminating the periphery of the vehicle 1 by the mirror 30, it is possible to illuminate a blind spot of the vehicle 1. Therefore, there is no need to provide any additional light source 10, so that the apparatus can be realized at low costs. Further, as the blind spot of the vehicle 1 as the photographic object of the camera 20 is illuminated, it is possible to photograph the vicinity of the vehicle 1 clearly even when it is dim such as in a nighttime or twilight. Further, through adjustment of the shape and size of the mirror 30 for changing the optical axis of the camera 20, the camera 20 can be formed compact. Accordingly, it is possible to employ an inexpensive camera 20. As described above, according to the present invention, since a blind spot of the vehicle 1 is photographed by the camera 20 with illumination of this blind spot, it becomes possible to cause the driver to recognize an object present in the periphery of the vehicle 1.
Second Embodiment
Next, a second embodiment of the inventive periphery monitoring apparatus 100 will be explained. In the first embodiment, it was explained that the left front camera 21 is provided inside the headlight unit 15. The left front camera 21 relating to the instant embodiment differs from the first embodiment in that this camera 21 is not provided inside the headlight unit 15. FIG. 5 is a view showing with enlargement the left front portion of the vehicle 1 having a periphery monitoring apparatus 100 relating to this embodiment.
As shown in FIG. 5, the left front camera 21 is provided outside the headlight unit 15. With this arrangement too, by using a convex mirror as the left front mirror 31, it is possible for the left front camera 21 to photograph the circumferential edge portion S of the vehicle 1 and the region R including the perpendicularly downside of this circumferential edge portion S.
Third Embodiment
Next, a third embodiment of the inventive periphery monitoring apparatus 100 will be explained. In the first embodiment, it was explained that the first mirror 31A and the second mirror 31B were co-used. This embodiment differs from the first embodiment in that the first mirror 31A and the second mirror 31B are not co-used. FIG. 6 is a view showing with enlargement the left front portion of the vehicle 1 having a periphery monitoring apparatus 100 relating to this embodiment.
As shown in FIG. 6, the first mirror 31A and the second mirror 31B are provided separately. The first mirror 31A bends the light from the light source 10 and the second mirror 31B changes a portion of the light from a light bulb 13 of a fog lamp as the optical axis of the left front camera 21. Projection and retraction of each of these mirrors 31A, 31B are effected by the left front drive mechanism 41. The left front drive mechanism 41 can be an integrated mechanism for both projection/retraction of the first mirror 31A and projection/retraction of the second mirror 31B, or can be provided as separate mechanisms, one for the projection/retraction of the first mirror 31A and the other for the projection/retraction of the second mirror 31B. With this arrangement too, it is possible for the left front camera 21 to photograph the circumferential edge portion S of the vehicle 1 and the region R including the perpendicularly downside of this circumferential edge portion S.
Fourth Embodiment
Next, a fourth embodiment of the inventive periphery monitoring apparatus 100 will be explained. In the first embodiment, it was explained that the first mirror 31A and the second mirror 31B were co-used and the left front camera 21 is provided inside the headlight unit 15. This embodiment differs from the first embodiment in that the first mirror 31A and the second mirror 31B are not co-used and also in that the left front camera 21 is not disposed inside the headlight unit 15. FIG. 7 is a view showing with enlargement the left front portion of the vehicle 1 having a periphery monitoring apparatus 100 relating to this embodiment.
As shown in FIG. 7, the first mirror 31A and the second mirror 31B are provided separately. The first mirror 31A bends the light from the light source 10 and the second mirror 31B changes the optical axis of the left front camera 21. Projection and retraction of each of these mirrors 31A, 31B are effected by the left front drive mechanism 41. The left front drive mechanism 41 can be an integrated mechanism for both projection/retraction of the first mirror 31A and projection/retraction of the second mirror 31B, or can be provided as separate mechanisms, one for the projection/retraction of the first mirror 31A and the other for the projection/retraction of the second mirror 31B. Further, the left front camera 21 is provided outside the headlight unit 15. With this arrangement too, it is possible for the left front camera 21 to photograph the circumferential edge portion S of the vehicle 1 and the region R including the perpendicularly downside of this circumferential edge portion S.
Other Embodiments
In the first embodiment, it was explained that in case the light source 10 comprises the light bulb 11 of the headlight, the camera 20 is provided inside the headlight unit 15. However, the range of application of the present invention is not limited thereto. In case the light source 10 comprises the light bulb 13 of the fog lamp, the camera 20 can be provided inside the fog lamp unit as a matter of course. Further, in case the light source 10 comprises the light bulb 12 of the rear lamp, the camera 20 can be provided inside the rear lamp unit as a matter of course.
In the foregoing embodiment, it was explained that the camera 20 is provided on the inner side of the circumferential edge portion S of the vehicle 1. However, the range of application of the present invention is not limited thereto. The camera 20 can also be provided on the outer side of the circumferential edge portion S of the vehicle 1 as a matter of course. In such case, it is also possible as a matter of course to eliminate the drive section 40 for causing the first mirror 31A and the second mirror 31B to project in the circumferential direction beyond the circumferential edge portion S of the vehicle 1.
In the foregoing embodiment, it was explained that the first mirror 31A and the second mirror 31B project or retract according to the speed of the vehicle 1. However, the range of application of the present invention is not limited thereto. It is also possible as a matter of course to employ an arrangement in which the mirrors project or retract in response to e.g. an operation on a touch panel by the driver of the vehicle 1, rather than according to the speed of the vehicle 1.
In the foregoing embodiment, it was explained that the camera 20 and the mirror 30 are provided at the left front portion, the right front portion, the left rear portion and the right rear portion of the vehicle 1, respectively. However, the range of application of the present invention is not limited thereto. The camera 20 and the mirror 30 can be provided at the front portion or rear portion of the vehicle 1. Or, they can be provided at the left portion or right portion of the vehicle 1. Or, they can be provided only at a predetermined position of the vehicle 1 as a matter of course.
In the foregoing embodiment, an explanation was made with using a passenger automobile as the vehicle 1. However, the range of application of the present invention is not limited thereto. For instance, the invention can be applied also to a large vehicle such as a bus, a truck, etc. or can be applied to a heavy machinery or the like as a matter of course.
In the foregoing embodiment, it was explained that the display device 70 displays an image of a portion of the vehicle 1 photographed by the camera 20. However, the range of application of the present invention is not limited thereto. For instance, an image obtained by synthesizing an image obtained by the camera 20 with an image picture of the vehicle 1 can be displayed also. Here, the term “image picture” of the vehicle 1 means a pre-stored image picture, not an image actually obtained by the camera 20. Further, the image picture can be a portion of a bird's eye view image of the vehicle 1 for instance. In the case of synthesis of a portion of an image picture of a portion of the vehicle 1 also, it is possible as a matter of course to allow the driver of the vehicle 1 to readily grasp the distance between the vehicle 1 and an object present in the periphery of the vehicle 1 included in the image.
Further, it is also possible as a matter of course to effect a viewpoint conversion on the image actually obtained by the camera 20 to a viewpoint from the perpendicularly upward and to display this converted image on the display device 70.
In the foregoing embodiment, it was explained that the periphery monitoring apparatus 100 includes the light source 10 provided in the vehicle 1 for illuminating the periphery of this vehicle 1 and the camera 20 for photographing situation of the periphery of the vehicle 1 with an optical axis changed by the mirror 30 provided on the outer side of the circumferential edge portion S of the vehicle 1, toward the downward of the circumferential edge portion S of the vehicle 1 illuminated by illumination of at least a portion of the light source 10 reflected by the mirror 30. That is, the periphery monitoring apparatus 100 includes the light source 10 provided in the vehicle 1 for illuminating the periphery of this vehicle 1, the camera 20 for photographing a situation of the periphery of the vehicle 1, the first mirror 31A for bending the light irradiated from the light source 10 toward the circumferential edge portion S side of the vehicle 1, and the second mirror 31B for changing the optical axis of the camera 20 toward the circumferential edge portion S side. Here, the first mirror 31A and the second mirror 31B can be comprised of a same mirror like the first embodiment and the second embodiment. Or, like the third embodiment and the fourth embodiment, the first mirror 31A and the second mirror 31B can be provided as separate mirrors.
According to the explanation given in the foregoing embodiment, if the shift position sensor 62 detects that the shift lever is located at a shift portion used at the time of forward traveling, the position determination section 53 determines the front portion as the monitoring target position; whereas, if the shift position sensor 62 detects that the shift lever is located at a shift position used at the time of reversing, the position determination section 53 determines the rear portion as the monitoring target position. However, the range of application of the present invention is not limited thereto. For instance, in the case of parallel parking, even in the case of reversing of the vehicle 1, a blind spot present on the front side can be displayed as a matter of course. In such case, it is possible to arrange such that the displaying is realized in response to an operation by the driver of the vehicle 1 on a predetermined switch (e.g. a switch displayed on the monitor screen in case the display device 70 is a touch panel). With this arrangement, as shown in FIG. 8, when the vehicle 1 is reversed with rotating the steering wheel to the right, with displaying of the left front portion on the display device 70, contact with another vehicle 2 can be prevented.
In the foregoing embodiment, it was explained that the light bulb 12 of the rear lamp can be used as one light source of the vehicle 1. However, the range of application of the present invention is not limited thereto. For instance, it is possible also as a matter of course to provide a lamp dedicated to illumination of the rear side of the vehicle 1 for instance. In such case, brighter illumination than that provided by a rear lamp can be provided.
INDUSTRIAL APPLICABILITY
The present invention may be applied to a periphery monitoring apparatus for monitoring the periphery of a vehicle.
DESCRIPTION OF REFERENCE MARKS/NUMERALS
    • 1: vehicle
    • 10: light source
    • 15: headlight unit
    • 20: camera
    • 30: mirror
    • 40: drive section
    • 100: periphery monitoring apparatus
    • S: circumferential edge portion

Claims (7)

The invention claimed is:
1. A periphery monitoring apparatus comprising:
a light source configured to be provided in a vehicle for illuminating the periphery of the vehicle; and
a camera provided within a headlight unit of the vehicle having the light source photographing a condition of the periphery of the vehicle with an optical axis of the camera changed by a mirror toward the underside of the circumferential edge of the vehicle illuminated by at least a portion of light irradiated from the light source reflected by the mirror configured to be disposed on the outer side of the circumferential edge of the vehicle.
2. The periphery monitoring apparatus according to claim 1, wherein the optical axis changed by the mirror is configured to pass the light irradiated from the light source and reflected by the mirror.
3. The periphery monitoring apparatus according to claim 1, wherein the mirror comprises a first mirror reflecting the light from the light source and a second mirror changing the optical axis of the camera.
4. The periphery monitoring apparatus according to claim 1, wherein the camera is disposed on the inner side of the circumferential edge portion of the vehicle.
5. The periphery monitoring apparatus according to claim 1, further comprising a drive mechanism causing the mirror for reflecting the light from the light source to project along the circumferential direction beyond the circumferential edge of the vehicle.
6. The periphery monitoring apparatus according to claim 5, wherein the mirror reflecting the light from the light source is projected/retracted according to the speed of the vehicle.
7. The periphery monitoring apparatus according to claim 1, wherein the mirror comprises a non-planar mirror.
US14/122,006 2011-06-27 2012-05-31 Periphery monitoring apparatus Expired - Fee Related US9041809B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2011-141910 2011-06-27
JP2011141910A JP5459560B2 (en) 2011-06-27 2011-06-27 Perimeter monitoring device
PCT/JP2012/064174 WO2013001978A1 (en) 2011-06-27 2012-05-31 Surrounding monitoring device

Publications (2)

Publication Number Publication Date
US20140078306A1 US20140078306A1 (en) 2014-03-20
US9041809B2 true US9041809B2 (en) 2015-05-26

Family

ID=47423878

Family Applications (1)

Application Number Title Priority Date Filing Date
US14/122,006 Expired - Fee Related US9041809B2 (en) 2011-06-27 2012-05-31 Periphery monitoring apparatus

Country Status (5)

Country Link
US (1) US9041809B2 (en)
EP (1) EP2724890B1 (en)
JP (1) JP5459560B2 (en)
CN (1) CN203713697U (en)
WO (1) WO2013001978A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150258935A1 (en) * 2014-03-11 2015-09-17 Toyota Motor Engineering & Manufacturing North America, Inc. Surroundings monitoring system for a vehicle
USD758390S1 (en) * 2014-12-30 2016-06-07 Toyota Jidosha Kabushiki Kaisha Display screen with graphical user interface
USD760247S1 (en) * 2014-12-30 2016-06-28 Toyota Jidosha Kabushiki Kaisha Display screen with graphical user interface
US20230087119A1 (en) * 2021-09-22 2023-03-23 Motional Ad Llc Switchable wheel view mirrors

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9041552B2 (en) * 2012-01-10 2015-05-26 Xiao Lin Yu Automobile blind spot detection system and method
US11086481B2 (en) * 2013-07-29 2021-08-10 Landmark Graphics Corporation Displaying data for a preferred well
CN104309531B (en) * 2014-09-30 2016-08-17 东风商用车有限公司 Viewing system and using method thereof before a kind of vehicle
US9855886B2 (en) * 2015-07-16 2018-01-02 Honda Motor Co., Ltd. Physical tire tracks coupled to headlights
CN105216710A (en) * 2015-09-17 2016-01-06 山东鲁得贝车灯股份有限公司 A kind of light fixture possessing drive recorder function
US10486600B1 (en) * 2015-09-28 2019-11-26 Apple Inc. Systems for improving side-mirror functionality of a vehicle
JP7172309B2 (en) * 2018-09-06 2022-11-16 株式会社アイシン Perimeter monitoring device
FR3087721B1 (en) * 2018-10-24 2021-07-30 Valeo Vision SYSTEM AND METHOD FOR LIGHTING A SIDE REGION OF A VEHICLE
CN111845540A (en) * 2019-04-24 2020-10-30 奥迪股份公司 Vehicle auxiliary lighting device and method
JP7264749B2 (en) * 2019-07-05 2023-04-25 日立Astemo株式会社 Stereo camera and stereo camera integrated light unit
US11807391B2 (en) * 2021-05-31 2023-11-07 Honeywell International Inc. Retractable lighting systems and autoretraction methods
US20230087169A1 (en) * 2021-09-22 2023-03-23 Motional Ad Llc Switchable wheel view mirrors
US20230256985A1 (en) * 2022-02-14 2023-08-17 Continental Advanced Lidar Solutions Us, Llc Method and system for avoiding vehicle undercarriage collisions

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003023623A (en) 2001-07-06 2003-01-24 Sharp Corp Device for monitoring surroundings of vehicle
JP2004255903A (en) 2003-02-24 2004-09-16 Auto Network Gijutsu Kenkyusho:Kk Method and device for monitoring surrounding area of vehicle
US20040201674A1 (en) 2003-04-10 2004-10-14 Mitsubishi Denki Kabushiki Kaisha Obstacle detection device
JP2004299557A (en) 2003-03-31 2004-10-28 Mazda Motor Corp Monitoring device for vehicle
EP1724153A1 (en) 2005-05-20 2006-11-22 Valeo Vision Vorrichtung zur Detektion von Hindernissen mit einem Abbildungssystem für Kraftfahrzeug
JP2007131162A (en) 2005-11-10 2007-05-31 Aisin Seiki Co Ltd Vehicle driving support device

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003023623A (en) 2001-07-06 2003-01-24 Sharp Corp Device for monitoring surroundings of vehicle
JP2004255903A (en) 2003-02-24 2004-09-16 Auto Network Gijutsu Kenkyusho:Kk Method and device for monitoring surrounding area of vehicle
JP2004299557A (en) 2003-03-31 2004-10-28 Mazda Motor Corp Monitoring device for vehicle
JP4231962B2 (en) 2003-03-31 2009-03-04 マツダ株式会社 Vehicle monitoring device
US20040201674A1 (en) 2003-04-10 2004-10-14 Mitsubishi Denki Kabushiki Kaisha Obstacle detection device
JP2004312638A (en) 2003-04-10 2004-11-04 Mitsubishi Electric Corp Obstacle detection apparatus
EP1724153A1 (en) 2005-05-20 2006-11-22 Valeo Vision Vorrichtung zur Detektion von Hindernissen mit einem Abbildungssystem für Kraftfahrzeug
US20070025596A1 (en) 2005-05-20 2007-02-01 Valeo Vision Device for detecting obstacles comprising an imaging system for motor vehicles
JP2007131162A (en) 2005-11-10 2007-05-31 Aisin Seiki Co Ltd Vehicle driving support device

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Extended European Search Report issued in European Application No. 12804475.7 dated Apr. 10, 2014.
International Preliminary Report on Patentability for PCT/JP2012/064174 dated Jan. 7, 2014.
International Search Report for PCT/JP2012/064174 dated Sep. 4, 2012.

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150258935A1 (en) * 2014-03-11 2015-09-17 Toyota Motor Engineering & Manufacturing North America, Inc. Surroundings monitoring system for a vehicle
US9598012B2 (en) * 2014-03-11 2017-03-21 Toyota Motor Engineering & Manufacturing North America, Inc. Surroundings monitoring system for a vehicle
USD758390S1 (en) * 2014-12-30 2016-06-07 Toyota Jidosha Kabushiki Kaisha Display screen with graphical user interface
USD760247S1 (en) * 2014-12-30 2016-06-28 Toyota Jidosha Kabushiki Kaisha Display screen with graphical user interface
USD791824S1 (en) 2014-12-30 2017-07-11 Toyota Jidosha Kabushiki Kaisha Display screen with graphical user interface
US20230087119A1 (en) * 2021-09-22 2023-03-23 Motional Ad Llc Switchable wheel view mirrors

Also Published As

Publication number Publication date
US20140078306A1 (en) 2014-03-20
EP2724890B1 (en) 2015-10-14
CN203713697U (en) 2014-07-16
JP5459560B2 (en) 2014-04-02
EP2724890A1 (en) 2014-04-30
WO2013001978A1 (en) 2013-01-03
JP2013006564A (en) 2013-01-10
EP2724890A4 (en) 2014-05-14

Similar Documents

Publication Publication Date Title
US9041809B2 (en) Periphery monitoring apparatus
CN110450705B (en) Vehicle with a steering wheel
US9156402B2 (en) Wide view vehicle periphery image generation apparatus
KR101014105B1 (en) Headlamp control device for the use of vehicle
JP4268974B2 (en) Monitoring device and method
JP2016055674A (en) Vehicle display
JP2005184225A (en) Vehicular display
JP2011205375A (en) Image generating apparatus, image display system, and image generating method
JP2007191116A (en) Vehicular display device
JP5592138B2 (en) Image generation apparatus, image display system, and image generation method
WO2017195684A1 (en) Visual recognition device for vehicle
JP2016053622A (en) Display device
JP4731177B2 (en) Infrared imaging display device and infrared imaging display method for vehicle
JP2004182121A (en) Drive assist system
JP5045974B2 (en) Vehicle driving support device
JP4730589B2 (en) Vehicle perimeter monitoring system
KR101496322B1 (en) Device To Notify The Dangerous Factor Of Vehicle Blind Spot
JP4849298B2 (en) Vehicle perimeter monitoring system
US20220091415A1 (en) Head-up display apparatus
JP5686042B2 (en) Vehicle periphery display device
WO2019194218A1 (en) Device for displaying traveling direction
JP2017193277A (en) Visually recognizing device for vehicle
JP3201688U (en) Door mirror device
JP2010155593A (en) Vehicular view assisting device
JPH067979Y2 (en) Vehicle headlight device

Legal Events

Date Code Title Description
AS Assignment

Owner name: AISIN SEIKIN KABUSHIKI KAISHA, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MIYOSHI, HIDEHIKO;WATANABE, KAZUYA;SIGNING DATES FROM 20131016 TO 20131025;REEL/FRAME:031672/0118

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20230526