US20180370427A1 - System for detecting surrounding conditions of moving body - Google Patents

System for detecting surrounding conditions of moving body Download PDF

Info

Publication number
US20180370427A1
US20180370427A1 US16/119,876 US201816119876A US2018370427A1 US 20180370427 A1 US20180370427 A1 US 20180370427A1 US 201816119876 A US201816119876 A US 201816119876A US 2018370427 A1 US2018370427 A1 US 2018370427A1
Authority
US
United States
Prior art keywords
light
controller
panel
illumination
state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US16/119,876
Inventor
Masahiro Kato
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Pioneer Corp
Original Assignee
Pioneer Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Pioneer Corp filed Critical Pioneer Corp
Priority to US16/119,876 priority Critical patent/US20180370427A1/en
Assigned to PIONEER CORPORATION reassignment PIONEER CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KATO, MASAHIRO
Priority to US16/177,182 priority patent/US11577643B2/en
Priority to US16/177,212 priority patent/US20190061610A1/en
Priority to US16/177,122 priority patent/US20190071004A1/en
Priority to US16/177,079 priority patent/US10988077B2/en
Priority to US16/176,967 priority patent/US20190071003A1/en
Publication of US20180370427A1 publication Critical patent/US20180370427A1/en
Priority to US18/099,091 priority patent/US20230150424A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q1/00Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
    • B60Q1/26Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
    • B60Q1/46Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for giving flashing caution signals during drive, other than signalling change of direction, e.g. flashing the headlights or hazard lights
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q1/00Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q1/00Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
    • B60Q1/26Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q1/00Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
    • B60Q1/26Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
    • B60Q1/34Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating change of drive direction
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q1/00Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
    • B60Q1/26Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
    • B60Q1/44Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating braking action or preparation for braking, e.g. by detection of the foot approaching the brake pedal
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q3/00Arrangement of lighting devices for vehicle interiors; Lighting devices specially adapted for vehicle interiors
    • B60Q3/10Arrangement of lighting devices for vehicle interiors; Lighting devices specially adapted for vehicle interiors for dashboards
    • B60Q3/16Circuits; Control arrangements
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q3/00Arrangement of lighting devices for vehicle interiors; Lighting devices specially adapted for vehicle interiors
    • B60Q3/20Arrangement of lighting devices for vehicle interiors; Lighting devices specially adapted for vehicle interiors for lighting specific fittings of passenger or driving compartments; mounted on specific fittings of passenger or driving compartments
    • B60Q3/283Steering wheels; Gear levers
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q3/00Arrangement of lighting devices for vehicle interiors; Lighting devices specially adapted for vehicle interiors
    • B60Q3/80Circuits; Control arrangements
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q3/00Arrangement of lighting devices for vehicle interiors; Lighting devices specially adapted for vehicle interiors
    • B60Q3/80Circuits; Control arrangements
    • B60Q3/82Switches specially adapted for vehicle interior lighting, e.g. switching by tilting the lens
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q9/00Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
    • B60Q9/008Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for anti-collision purposes
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q1/00Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
    • B60Q1/02Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q2500/00Special features or arrangements of vehicle interior lamps
    • B60Q2500/30Arrangements for illuminating different zones in the vehicle, e.g. front/rear, different seats
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q3/00Arrangement of lighting devices for vehicle interiors; Lighting devices specially adapted for vehicle interiors
    • B60Q3/70Arrangement of lighting devices for vehicle interiors; Lighting devices specially adapted for vehicle interiors characterised by the purpose
    • B60Q3/74Arrangement of lighting devices for vehicle interiors; Lighting devices specially adapted for vehicle interiors characterised by the purpose for overall compartment lighting; for overall compartment lighting in combination with specific lighting, e.g. room lamps with reading lamps
    • B60Q3/745Arrangement of lighting devices for vehicle interiors; Lighting devices specially adapted for vehicle interiors characterised by the purpose for overall compartment lighting; for overall compartment lighting in combination with specific lighting, e.g. room lamps with reading lamps using lighting panels or mats, e.g. electro-luminescent panels, LED mats

Abstract

This system for detecting the surrounding conditions of a moving body forcibly changes the state of at least one of a plurality of lighting devices (change from an unlit state to a lighting state or a blinking state, change in the emission color, or change in the luminance) installed inside the moving body, if an object to which attention must be paid during traveling of the moving body is detected in the surroundings of the moving body.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application claims benefit under 35 USC § 120 as a Continuation of U.S. patent application Ser. No. 16/034,257, filed Jul. 12, 2018, and U.S. patent application Ser. No. 16/034,283, filed Jul. 12, 2018, which are Continuations of U.S. patent application Ser. No. 15/711,988, filed Sep. 21, 2017, which is a Continuation of U.S. patent application Ser. No. 15/489,174, filed on Apr. 17, 2017 (U.S. Pat. No. 9,802,532, issued Oct. 31, 2017), which is a Continuation of U.S. patent application Ser. No. 14/110,118, filed on Dec. 17, 2013 (U.S. Pat. No. 9,649,972, issued May 16, 2017), which is a National Stage entry under 35 USC § 371 of PCT/JP2011/058803, filed Apr. 7, 2011, the contents of which are incorporated by reference in their entirety for all purposes.
  • TECHNICAL FIELD
  • The present invention relates to a system for detecting surrounding conditions of a moving body that notifies a moving body driver of conditions around the moving body, in particular, surrounding conditions that can be used to facilitate driving of the moving body.
  • BACKGROUND ART
  • To assist driving of a vehicle (i.e., moving body), a device that notifies a vehicle driver of surrounding conditions regarding traveling of the vehicle is known (see, for example, Patent Document 1). The device notifies the surrounding conditions by displaying on an on-vehicle display unit a video obtained by video-recording surroundings of the vehicle with an on-vehicle camera.
  • However, there is a problem; to check contents displayed on the on-vehicle display unit, the driver needs to move his visual line from a travelling direction of the moving body to the display unit.
  • Patent Document 1: Japanese Patent Application Kokai No. 2000-285394
  • SUMMARY OF THE INVENTION Problems to be Solved by the Invention
  • The present invention has been developed in order to solve the above-described problem, and its object is to provide a system for detecting surrounding conditions of a moving body (e.g., a vehicle, a ship, and an aircraft) that can notify a driver of surrounding conditions of the moving body without causing the driver to move his visual line.
  • Solutions to the Problems
  • A system for detecting surrounding conditions of a moving body according to claim 1 is a system for detecting surrounding conditions of a moving body that includes a plurality of lighting devices (illumination devices), a detector, and a controller. The illumination devices are disposed in a room (cabin) of the moving body. Each of the illumination devices has a switch for switching between a lighting state (or a turn on state) and an unlit state (or a turn off state). The detector is configured to detect an object to which attention must be paid around the moving body. The controller is configured to change a state of at least one of the lighting devices upon detecting the attention-required object.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a block diagram of a system for detecting surrounding conditions of a moving body according to the present invention.
  • FIGS. 2A and 2B show exemplary installation of illumination panels 2 mounted in a cabin of a vehicle or the moving body.
  • FIG. 3 is a perspective view of a schematic structure of a contact-sensor-integrated EL panel 23.
  • FIG. 4 is a flowchart illustrating a main flow of a surrounding condition notification control.
  • FIG. 5 is a flowchart illustrating a forward vehicle's rear lamp notification subroutine.
  • FIG. 6 is a flowchart illustrating a traffic light notification subroutine.
  • FIG. 7 is a flowchart illustrating a pedestrian/bicycle notification subroutine.
  • FIG. 8 is a flowchart illustrating an attention-required zone (cautionary zone) notification subroutine.
  • FIG. 9 is a flowchart illustrating an emergency vehicle notification subroutine.
  • FIG. 10 is a flowchart illustrating an obstacle notification subroutine.
  • FIG. 11A to FIG. 11E illustrate lighting states of illumination panels 2 1 to 2 4 according to a lighting state of a rear lamp assembly of a vehicle traveling forward, respectively.
  • FIG. 12A to FIG. 12F illustrate lighting states of illumination panels 2 5 to 2 8 according to a lighting state of a traffic light ahead, respectively.
  • FIG. 13A to FIG. 13C illustrate lighting states of illumination panels 2 9 to 2 14 when an obstacle-to-avoid is present around the vehicle equipped with the surrounding condition detecting system, respectively.
  • FIG. 14A and FIG. 14B illustrate exemplary lighting states of illumination panels 2 15 and 2 16 when the vehicle equipped with the surrounding condition detecting system enters an intersection with poor visibility.
  • MODE FOR CARRYING OUT THE INVENTION
  • When a system for detecting surrounding conditions of a moving body according to the present invention detects a “pay attention” object to which attention must be paid during traveling, in the surroundings of the moving body, then the system forcibly changes a state of at least one illumination device among a plurality of illumination devices installed in a cabin of the moving body (change from a unlit state to a lighting or blinking state, change in emission color, or change in luminance). Accordingly, even if a driver of the moving body does not visually observe an attention-required object present near the moving body, a change in the state of the lighting device (illumination device) enters the driver's field of vision. This enables the driver to recognize that the attention-required object approaches the moving body or the moving body approaches the attention-required object. To this end, changed is the state of the illumination device (s) installed at a position corresponding to a direction where the attention-required object is present. This allows the moving body driver to recognize the direction where the attention-required object is present without moving the driver's visual line. In the case where the attention-required object is lighting of a rear lamp of a forward vehicle (the rear lamp may be a lamp assembly that includes at least one of a stop lamp, a backup lamp, a turn signal lamp, and a hazard warning lamp), an illumination panel (light-emitting panel) installed in front of a driver's seat is caused to light or blink (flash) in a color corresponding to a lighting color of the rear lamp assembly. Accordingly, even if the driver does not look straight the rear lamp assembly of the forward vehicle, the driver can recognize whether the lighting rear lamp assembly of the forward vehicle is the backup lamp, the stop lamp, the turn signal lamp, or the hazard warning lamp without moving the direction of his visual line. In the case where the attention-required object is a traffic light, the illumination panel installed above the driver's seat in the moving body is caused to light in a color corresponding to a lighting color of the traffic light. Accordingly, even if the driver does not look at the traffic light ahead, the driver can recognize the lighting color of the traffic light without moving the direction of his visual line. In the case where the attention-required object is an avoidance-required obstacle which the vehicle equipped with the surrounding condition detecting system must avoid, such as pedestrian, a bicycle, a wall, an edge stone, an obstruction, or an emergency vehicle, then an illumination panel installed in a direction that the avoidance-required obstacle is present is forced to light or blink. An emission color, luminance, and/or a blinking speed of the illumination panel are also altered according to a distance and a relative speed between the moving body and the avoidance-required obstacle. When the avoidance-required obstacle is an obstruction that hinders the traveling of the vehicle equipped with the surrounding condition detecting system, then the emission color and the luminance of the lighting panel (illumination panel) are changed according to a size of the obstruction. This allows the driver to intuitively recognize a hazard of the approaching avoidance-required obstacle.
  • Embodiments
  • FIG. 1 is a block diagram of a system configuration when a system for detecting surrounding conditions of a moving body according to the present invention is provided in a vehicle.
  • In FIG. 1, illumination panels 2 1 to 2 n (n represents an integer equal to or more than two), each of which serves as a lighting device or an illumination device, are installed, for example, at a front panel in front of a driver's seat, a steering wheel SW, a console box, doors DL and DR in the vehicle as illustrated by the dashed lines shown in FIG. 2A and on the ceiling in the vehicle illustrated by the dashed lines shown in FIG. 2B, respectively. The illumination panels 2 1 to 2 n are coupled to a controller 1 via a control bus BUS, respectively. A front camera 3, a rear camera 5, and a side camera 6 are also coupled to the controller 1 via the control bus BUS.
  • The illumination panels 2 1 to 2 n have the same internal configuration.
  • When the controller 1 sends a lighting or a blinking command signal of a certain color (red, white, yellow, green, blue, purple, indigo or orange) to a lighting on/off switch 21 of an illumination panel 2 via the control bus BUS, the lighting on/off switch 21 turns on and allows a power supply voltage V1 to be supplied to an electroluminescence (EL) panel drive r 22. When the controller 1 supplies an turn off command signal to the on/off switch 21 via the control bus BUS, the switch 21 turns off, and stops the supply of the power supply voltage V1 to the EL panel driver 22. The EL panel driver 22 generates various light emission drive voltages based on the lighting or blinking command signal of a desired color (red, white, yellow, green, blue, purple, indigo or orange) received from the controller 1 via the control bus BUS while the power supply voltage V1 is being supplied through the switch 21, and supplies the resulting light emission drive voltages to a touch-sensor-integrated EL panel 23. When, for example, the EL panel driver 22 receives a red lighting command signal from the controller 1, the EL panel driver 22 supplies a light emission drive voltage to the EL panel 23 to cause the EL panel to light in red. When the EL panel driver 22 receives a yellow blinking command signal from the controller 1, the EL panel driver 22 supplies a light emission drive voltage to the EL panel 23 to cause the EL pane 23 to blink in yellow.
  • FIG. 3 is a perspective view illustrating a rough structure of the touch-sensor-integrated EL panel 23.
  • As shown in FIG. 3, the EL panel 23 includes a transparent touch sensor panel TP bonded on a light emitting face of an organic electroluminescence (EL) light emitting panel ELP.
  • The organic EL light emitting panel ELP as a plane EL light emitting element lights or blinks in an emission color corresponding to the light emission drive voltage supplied from the EL panel driver 22. The light is emitted to outside via the touch sensor panel TP. The organic EL light emitting panel ELP is in the off state (unlit state) when the light emission drive voltage is not supplied. The touch sensor panel TP is a switch that switches between lighting and extinction (no lighting) of the organic EL light emitting panel ELP. When a person touches a touch sensor face of the touch sensor panel TP, the touch sensor panel TP generates a contact detection signal TC to turn on or off the organic EL light emitting panel ELP while the contact is being made. The contact detection signal TC is supplied to the controller 1 via the control bus BUS.
  • With the above-described configuration, each of the illumination panels 2 1 to 2 n lights or blinks in the emission color indicated by the lighting or blinking command signal that represents a desired color (red, white, yellow, green, blue, purple, indigo, or orange) received from the controller 1. When, for example, the controller 1 sends a white lighting command to the lighting panel 2 1, the illumination panel 2 1 emits a white light. When the controller 1 sends a white blinking command, the lighting panel 2 1 blinks in white. When the controller 1 sends a red lighting command to the illumination panel 2 1, the illumination panel 2 1 emits a red light. When the controller 1 sends a red blinking command, the illumination panel 2 1 blinks in red. Supply of a turn off command signal from the controller 1 can turn off each of the light-emitting panels 2 1 to 2 n. Each of the light-emitting panels 2 1 to 2 n generates the contact detection signal TC each time the touch sensor panel TP is made contact. The contact detection signal TC is sent to the controller 1.
  • The front camera 3 is installed at a front portion of a vehicle exterior. The front camera 3 supplies an image signal V1, which is obtained by video-recording the scene forward of the vehicle, to an image recognition processor 4.
  • The rear camera 5 is installed at a rear portion of the vehicle exterior. The rear camera 5 supplies an image signal V2, which is obtained by video-recording the scene backward of the vehicle, to the image recognition processor 4.
  • The side cameras 6 are installed at lateral parts of the vehicle exterior, such as right and left side-view mirrors of the vehicle, respectively. The side cameras 6 supply image signals V3, which are obtained by video-recording the scene on both sides of the vehicle, to the image recognition processor 4.
  • The image recognition processor 4 performs an image recognition process on the image signals V1 to V3 to detect in these images an attention-required object that the driver needs to care during driving. The attention-required object is, for example, a lighting state of a rear lamp assembly of a forward vehicle, a traffic light, and an avoidance-required obstacle which the vehicle equipped with the surrounding condition detecting system must avoid. The avoidance-required obstacle is, for example, a pedestrian, a bicycle, an emergency vehicle, an obstruction that becomes an obstacle in traveling, a wall at a road with poor visibility, and an edge stone.
  • When light emission of the rear lamp assembly of a preceding vehicle is detected in an image obtained from the image signal V1, the image recognition processor 4 generates rear lamp detection data RD. The rear lamp detection data RD indicates whether the emission color of the rear lamp assembly is red, white, or yellow. The image recognition processor 4 supplies the rear lamp detection data RD to the controller 1 via the control bus BUS. When the emission color of the rear lamp assembly is yellow, that is, when a turn signal lamp or a hazard warning lamp is activated, direction indication information is included in the rear lamp detect ion data RD. The direction indication information indicates whether the rear lamp assembly is blinking only on the right side, blinking only on the left side, or blinking on both right and left sides.
  • When the traffic light is detected in the image obtained from on the image signal V1, the image recognition processor 4 generates traffic-light detection data SD. The traffic-light detection data SD indicates a lighting color of the traffic light. The image recognition processor 4 supplies the traffic-light detection data SD to the controller 1 via the control bus BUS. In the case where a traffic light shows (indicates, displays) a direction with an arrow, the image recognition processor 4 incorporates, in the traffic-light detection data SD, information representing a fact that this is an arrow indication and also representing the pointing direction of the arrow.
  • When a pedestrian or a bicycle is found in an image or images obtained from the image signals V1 to V3, the image recognition processor 4 generates pedestrian/bicycle detection data HD. The pedestrian/bicycle detection data HD indicates the direction of, distance to, and relative speed of the pedestrian or bicycle, and the data is supplied to the controller 1 via the control bus BUS.
  • When the image recognition processor 4 detects an attention-required road zone such as a road zone with poor visibility or a route in a parking area (parking lot) in the images derived from the image signals V1 to V3 and also detects an attention-required object, such as a wall, an edge stone, and another vehicle on the attention-required road, then the image recognition processor 4 generates attention-required zone detection data ED. The attention-required zone detection data ED includes information representing the direction of, distance to, and relative speed of the attention-required object. The image recognition processor 4 supplies the attention-required zone detection data ED to the controller 1 via the control bus BUS. The road zone with poor visibility is a zone where the vehicle equipped with the surrounding condition detecting system enters a wider road from a narrower road without effective right/left visibility due to, for example, a blockade, such as a house wall.
  • When the image recognition processor 4 detects an emergency vehicle such as a patrol car, a police car, an ambulance, and a fire engine in the images obtained from the image signals V1 to V3, the image recognition processor 4 generates emergency vehicle detection data QD. The emergency vehicle detection data QD indicates the direction of, distance to, and relative speed of the emergency vehicle. The image recognition processor 4 supplies the emergency vehicle detection data QD to the controller 1 via the control bus BUS.
  • When the image recognition processor 4 detects an obstruction on the road in the images obtained from the image signals V1 to V3, the image recognition processor 4 generates obstruction detection data GD. The obstruction detection data GD indicates the direction of, distance to, and a size of the obstruction. The image recognition processor 4 supplies the obstruction detection data GD to the controller 1 via the control bus BUS.
  • The controller 1 sends the turn on command (i.e., lighting command signal) or the turn off command to the illumination panel 2, which is a delivery source of the contact detection signal TC, in response to the contact detection signal TC received from the illumination panel 2 1 to 2 n. This allows the illumination panel 2 to be lighted by simply touching the light emitting face of the illumination panel 2 with a fingertip in the case where a person in the vehicle equipped with the surrounding condition detecting system needs interior lighting. Touching the light emitting face of the illumination panel 2 with the fingertip again turns off the illumination panel 2.
  • The controller 1 forces the light-emitting panel 2 to light or blink in order to notify the person in the vehicle of the surrounding conditions by performing the following surrounding condition notification control.
  • FIG. 4 is a flowchart illustrating a main flow of the surrounding condition notification control.
  • In FIG. 4, first, the controller 1 executes a forward vehicle rear lamp notification subroutine to notify the occupant in the vehicle equipped with the surrounding condition detecting system of a state of a rear lamp assembly of a vehicle traveling forward (Step S1). Next, the controller 1 executes a traffic light notification subroutine to notify the occupant in the vehicle equipped with the surrounding condition detecting system of a color emitted by a traffic light ahead (Step S2). Next, the controller 1 executes a pedestrian/bicycle notification subroutine to notify the occupant in the vehicle equipped with the surrounding condition detecting system of presence of a pedestrian and/or a bicycle around the vehicle equipped with the surrounding condition detecting system (Step S3). Next, the controller 1 executes an attention-required zone notification subroutine to notify the vehicle occupant of presence of an attention-required object, such as a wall, an edge stone, and another vehicle around the vehicle equipped with the surrounding condition detecting system (Step S4). Next, the controller 1 executes an emergency vehicle notification subroutine to notify the vehicle occupant of a fact that an emergency vehicle is approaching (Step S5). Next, the controller 1 executes an obstruction notification subroutine to notify the vehicle occupant of presence of an obstruction on the road (Step S6).
  • After the execution of Step S6, the controller 1 returns to Step S1 and repeats the processing of Steps S1 to S6.
  • FIG. 5 is a flowchart showing the detail of the forward vehicle rear lamp notification subroutine executed in Step S1.
  • In FIG. 5, first, the controller 1 determines whether or not the rear lamp detection data RD has been received from the image recognition processor 4 (Step S11). When Step S11 determines that the rear lamp detection data RD is received, that is, when the rear lamp assembly of the vehicle traveling forward is lighting, then the controller 1 determines whether an emission color represented by the rear lamp detection data RD is red or not (Step S12). When Step S12 determines that the emission color of the rear lamp assembly is red, that is, when the stop lamp is lighting, then the controller 1 supplies a red lighting command signal to the illumination panel 2 1 (Step S13). The red lighting command signal causes the illumination panel 2 1, which is installed at the center of a steering wheel SW as shown in FIG. 2A, to light in red. On the other hand, when Step S12 determines that the emission color of the rear lamp assembly is not red, then the controller 1 supplies the turn off command signal to the illumination panel 2 1 in order to turn off the illumination panel 2 1 (Step S14). After the execution of Step S13 or S14, the controller 1 determines whether the emission color represented by the rear lamp detection data RD is white or not (Step S15). When it is determined in Step S15 that the emission color of the rear lamp assembly is white, i.e., it is determined that the backup lamp is lighting, then the controller 1 supplies a white lighting command signal to the illumination panel 2 2 (Step S16). The white lighting command signal causes the illumination panel 2 2, which is installed under the illumination panel 2 1 at the center of the steering wheel SW as shown in FIG. 2A, to light in white. On the other hand, when Step S15 determines that the emission color of the rear lamp assembly is not white, then the controller 1 supplies the turn off command to the illumination panel 2 2 in order to turn off the illumination panel 2 2 (Step S17). After the execution of Step S16 or S17, the controller 1 determines whether the emission color represented by the rear lamp detection data RD is yellow or not (Step S18). When Step S18 determines that the emission color of the rear lamp assembly is yellow, i.e., when the turn signal lamp or the hazard warning lamp is activated, then the controller 1 supplies a yellow blinking command signal to the illumination panel 2 (Step S19). The yellow blinking command signal causes one of or both the illumination panels 2 3 and 2 4, which are installed at right and left of the illumination panel 2 1 at the center of the steering wheel SW as shown in FIG. 2A, to blink. That is, in Step S19, when the direction indication information included in the rear lamp detection data RD indicates right, the controller 1 supplies the yellow blinking command signal to the illumination panel 2 4. When the direction indication information indicates left, the controller 1 supplies the yellow blinking command signal to the illumination panel 2 3. When the direction indication information indicates both right and left, the controller 1 supplies the yellow blinking command signal to the illumination panels 2 3 and 2 4. When Step S18 determines that the emission color of the rear lamp assembly is not yellow, then the controller 1 supplies the turn off command to the illumination panels 2 3 and 2 4 in order to turn off the illumination panels 2 3 and 2 4, respectively (Step S20). When Step S11 determines that the rear lamp detection data RD is not received, then the controller 1 supplies the turn off command signal to all the illumination panels 2 1 and 2 4 in order to turn off the illumination panels 2 1 and 2 4 (Step S21).
  • After the execution of Step S19, S20, or S21, the controller 1 exits the forward vehicle rear lamp notification subroutine shown in FIG. 5 and returns to the main routine shown in FIG. 4. That is, the controller 1 proceeds to execution of the traffic light notification subroutine in Step S2.
  • FIG. 6 is a flowchart showing the detail of the traffic light notification subroutine.
  • In FIG. 6, first, the controller 1 determines whether or not the traffic-light detection data SD is received from the image recognition processor 4 (Step S31). When Step S31 determines that the traffic-light detection data SD is received, that is, when the traffic light exists ahead, then the controller 1 determines whether a lighting color of the traffic light represented by the traffic light detection data SD is red or not (Step S32). When Step S31 determines that the lighting color is red, the controller 1 sends the red lighting command signal to the illumination panel 2 5 (Step S33). The red lighting command signal causes the illumination panel 2 5, which is installed at the ceiling above a windshield FG of the vehicle as shown in FIG. 2B, to light in red. On the other hand, when Step S32 determines that the lighting color represented by the traffic-light detection data SD is not red, the controller 1 supplies the turn off command signal to the illumination panel 2 5 in order to turn off the illumination panel 2 5 (Step S34). After the execution of Step S33 or S34, the controller 1 determines whether the lighting color of the traffic light represented by the traffic-light detection data SD is yellow or not (Step S35). When Step S35 determines that the lighting color is yellow, the controller 1 supplies a yellow lighting command signal to an illumination panel 2 6 (Step S36). The yellow lighting command signal causes the illumination panel 2 6, which is installed on the left of the illumination panel 2 5 above the windshield of the vehicle as shown in FIG. 2B, to light in yellow. On the other hand, when Step S35 determines that the lighting color represented by the traffic-light detection data SD is not yellow, the controller 1 supplies the turn off command signal to the illumination panel 2 6 in order to turn off the illumination panel 2 6 (Step S37). After the execution of Step S36 or S37, the controller 1 determines whether the lighting color of the traffic light represented by the traffic-light detection data SD is blue or not (Step S38). When Step S38 determines that the lighting color is blue, then the controller 1 determines, based on the traffic-light detection data SD, whether the blue lighting indicates a direction with an arrow or not (Step S39). When it is determined in Step S39 that the blue lighting is not an arrow indication, the controller 1 supplies a blue lighting command signal to an illumination panel 2 7 (Step S40). The blue lighting command signal causes the illumination panel 2 7, which is installed above the windshield of the vehicle as shown in FIG. 28, to light in blue. On the other hand, when it is determined in Step S39 that the traffic light is an arrow indication, the controller 1 detects (identifies) a pointing direction of the arrow based on the traffic-light detection data SD (Step S41). Next, the controller 1 supplies the blue lighting command signal to that illumination panel, among the illumination panels 2 7, 2 8, and 2 23 shown in FIG. 2B, which is located at a position corresponding to the direction pointed by the arrow (Step S42). The blue lighting command signal causes that illumination panel to light in blue. That is, in Step S42, when the direction pointed by the arrow is right, the controller 1 supplies the blue lighting command signal to the illumination panel 2 8. In Step S42, when the direction pointed by the arrow is left, the controller 1 supplies the blue lighting command signal to the illumination panel 2 7. In Step S42, when the direction pointed by the arrow is the straight direction, the controller 1 supplies the blue lighting command signal to the illumination panel 2 23. Next, the controller 1 supplies the red lighting command signal to the illumination panel 2 8 (Step S43). The red lighting command signal causes the illumination panel 2 8 to light in red. When Step S38 determines that the lighting color of the traffic light represented by the traffic-light detection data SD is not blue, the controller 1 supplies the turn off command signal to the illumination panel 21 in order to turn off the illumination panel 2 7 (Step S44). When Step S31 determines that the traffic-light detection data SD is not received, the controller 1 supplies the turn off command signal to all the illumination panels 2 5 to 2 8 and 2 23 in order to turn off the illumination panels 2 5 to 2 8 and 2 23 (Step S45).
  • After the execution of Step S40, S43, S44, or S45, the controller 1 exits the traffic light notification subroutine shown in FIG. 6 and returns to the main routine shown in FIG. 4. That is, the controller 1 proceeds to execution of the pedestrian/bicycle detection subroutine in Step S3.
  • FIG. 7 is a flowchart showing the detail of the pedestrian/bicycle detection subroutine.
  • In FIG. 7, first, the controller 1 determines whether or not the pedestrian/bicycle detection data HD is received from the image recognition processor 4 (Step S51). When Step S51 determines that the pedestrian/bicycle detection data HD is received, that is, when a pedestrian or a bicycle is present around the vehicle equipped with the surrounding condition detecting system, then the controller 1 selects that illumination panel 2 which is installed at a position corresponding to the direction that the pedestrian or the bicycle is present, as an attention-required direction indication panel (Step S52). The direction of the pedestrian or bicycle is represented by the pedestrian/bicycle detection data HD. The controller 1, for example, selects one illumination panel installed at a position corresponding to the direction of the pedestrian or the bicycle as the attention-required direction indication panel among the illumination panels 2 9 to 2 11 installed at the door DL on a front passenger seat side and the lighting panels 2 12 to 2 14 installed at the door DR on the driver's seat side of the vehicle as shown in FIG. 2A. That is, in Step S52, the controller 1 selects an illumination panel 2 12 as the attention-required direction indication panel when the direction of the pedestrian or the bicycle is right-front, selects an illumination panel 2 13 when the direction of the pedestrian/bicycle is right-lateral, selects an illumination panel 2 14 when the direction of the pedestrian/bicycle is right-rear, selects an illumination panel 2 9 when the direction of the pedestrian/bicycle is left-front, selects an illumination panel 2 10 when the direction of the pedestrian/bicycle is left-lateral, and selects an illumination panel 2 11 when the direction of the pedestrian/bicycle is left-rear.
  • Next, the controller 1 sets emission conditions (luminance, a color, and a blinking speed) corresponding to a distance to and a speed relative to the pedestrian or the bicycle represented by the pedestrian/bicycle detection data HD (Step S53). The emission condition is set, for example, as follows. The smaller the distance to the pedestrian/bicycle, the higher the luminance is. The smaller the distance, the more the emission color transitions from a cool color to a warm color (e.g., purple→indigo→blue→green→yellow→orange→red). The smaller the distance, the higher the blinking speed is. The higher the relative speed, the higher the luminance is. The higher the relative speed, the more the emission color transitions from a cool color to a warm color. The higher the relative speed, the higher the blinking speed is. It should be noted that the above-mentioned emission conditions based on the distance and relative speed may be combined.
  • Next, the controller 1 supplies the lighting or blinking command signal to the attention-required direction indication panel (Step S54). The lighting or blinking command signal causes the attention-required direction indication panel selected among the illumination panels 2 9 to 2 11 and 2 12 to 2 14 (FIG. 2A) in Step S52 to light or blink under the emission conditions set in Step S53.
  • When Step S51 determines that the pedestrian/bicycle detection data HD is not received, the controller 1 supplies the turn off command signal to the attention-required direction indication panel in order to turn off the attention-required direction indication panel (Step S55).
  • After the execution of Step S54 or S55, the controller 1 exits the pedestrian/bicycle detection subroutine shown in FIG. 7 and returns to the main routine shown in FIG. 4. That is, the controller 1 proceeds to execution of the attention-required zone notification subroutine in Step S4.
  • FIG. 8 is a flowchart illustrating the detail of the attention-required zone notification subroutine.
  • In FIG. 8, first, the controller 1 determines whether or not the attention-required zone detection data ED is received from the image recognition processor 4 (Step S61). When Step S61 determines that the attention-required zone detection data ED is received, that is, when a road zone with poor visibility is detected and an attention-required object, such as a wall, an edge stone, and a vehicle, is present on the road, then the controller 1 selects that illumination panel 2 which is installed at a position corresponding to the direction that the attention-required object is p resent, which is represented by the attention-required zone detect ion data ED (Step S62). The selected illumination panel 2 is used as an attention-required direction indication panel. The controller 1, for example, selects one illumination panel installed at a position corresponding to the direction that the attention-required object, such as a wall, an edge stone, and a vehicle, is present as the attention-required direction indication panel among the illumination panels 2 9 to 2 11 installed at the door DL on the front passenger seat side of the vehicle and the illumination panels 2 12 to 2 14 installed at the door DR on the driver's seat side of the vehicle as shown in FIG. 2A. That is, in Step S62, the controller 1 selects the illumination panel 2 12 as the attention-required direction indication panel when the direction of the above-described attention-required object is right front, selects the illumination panel 2 13 when the direction of the attention-required object is right-lateral, selects the illumination panel 2 14 when the direction of the attention-required object is right-rear, selects the illumination panel 2 9 when the direction of the attention-required object is left-front, selects the illumination panel 2 10 when the direction of the attention-required object is left lateral, and selects the illumination panel 2 11 when the direction of the attention-required object is left-rear.
  • Next, the controller 1 sets light emission conditions (luminance, a color, and a blinking speed) corresponding to a distance to and a speed relative to the attention-required object represented by the attention-required zone detection data ED (Step S63). The light emission condition is set, for example, as follows. The smaller the distance, the higher the luminance is. The smaller the distance, the more the emission color transitions from a cool color to a warm color (purple→indigo→blue→green→yellow→orange→red). The smaller the distance, the higher the blinking speed is. The higher the relative speed, the higher the luminance is. The higher the relative speed, the more the emission color transitions from a cool color to a warm color. The higher the relative speed, the higher the blinking speed is. It should be noted that the above-described light emission conditions based on the distance and relative speed may be combined.
  • Next, the controller 1 supplies the lighting or blinking command signal to the attention-required direction (cautionary direction) indication panel (Step S64). The lighting or blinking command signal causes the attention-required direction indication panel, selected among the illumination panels 2 9 to 2 11 and 2 12 to 2 14 (FIG. 2A) in Step S62, to light or blink under the light emission conditions set in Step S63.
  • When Step S61 determines that the attention-required zone detection data ED is not received, the controller 1 supplies the turn off command signal to the attention-required direction indication panel in order to turn off the attention-required direction indication panel (Step S65).
  • After the execution of Step S64 or S65, the controller 1 exits the attention-required zone notification subroutine shown in FIG. 8 and returns to the main routine shown in FIG. 4. Thus, the controller 1 proceeds to execution of the emergency vehicle notification subroutine in Step S5.
  • FIG. 9 is a flowchart illustrating the detail of the emergency vehicle notification subroutine.
  • In FIG. 9, first, the controller 1 determines whether or not the emergency vehicle detection data QD is received from the image recognition processor 4 (Step S71). When Step S71 determines that the emergency vehicle detection data QD is received, that is, when an emergency vehicle is present near the vehicle equipped with the surrounding condition detecting system, then the controller 1 selects that illumination panel 2 which is disposed at a position corresponding to the direction that the emergency vehicle is present, as the attention-required direction indication panel (Step S72). The presence of the emergency vehicle is represented by the emergency vehicle detection data QD. The controller 1, for example, selects one illumination panel disposed at a position corresponding to the direction that the emergency vehicle is present as the attention-required direction indication panel among the illumination panels 2 9 to 2 11 disposed at the door DL on the front passenger seat side and the illumination panels 2 12 to 2 14 disposed at the door DR on the driver's seat side of the vehicle as shown in Fi g. 2A. That is, in Step S72, the controller 1 selects the illumination panel 2 12 as the attention-required direction indication panel when the direction of the emergency vehicle is right-front, selects the illumination panel 2 13 when the direction of the emergency vehicle is right-lateral, selects the illumination panel 2 14 when the direction of the emergency vehicle is right-rear, selects the illumination panel 2 9 when the direction of the emergency vehicle is left-front, selects the illumination panel 2 10 when the direction of the emergency vehicle is left-lateral, and selects the illumination panel 2 11 when the direction of the emergency vehicle is left-rear.
  • Next, the controller 1 sets light emission conditions (luminance, a color, and a blinking speed) corresponding to a distance to and a speed relative to the emergency vehicle represented by the emergency vehicle detection data QD (Step S73). The light emission condition is set, for example, as follows. The smaller the distance, the higher the luminance is. The smaller the distance, the more the emission color transitions from a cool color to a warm color (purple→indigo→blue→green→yellow→orange→red). The smaller the distance, the higher the blinking speed is. The higher the relative speed, the higher the luminance is. The higher the relative speed, the more the emission color transitions from a cool color to a warm color. The higher the relative speed, the higher the blinking speed is. It should be noted that the light emission conditions based on the distance and relative speed may be combined.
  • Next, the controller 1 supplies the lighting or blinking command signal to the attention-required direction indication panel (Step S74). The lighting or blinking command signal causes the attention-required direction indication panel, selected among the light emission panels 2 9 to 2 11 and 2 12 to 2 14 (FIG. 2A) in Step S72, to light or blink under the light emission conditions set in Step S73.
  • When Step S71 determines that the emergency vehicle detection data QD is not received, the controller 1 supplies the turn off command signal to the attention-required direction indication panel in order to turn off the attention-required direction indication panel (Step S75).
  • After the execution of Step S74 or S75, the controller 1 exits the emergency vehicle notification subroutine shown in FIG. 9 and returns to the main routine shown in FIG. 4. That is, the controller 1 proceeds to execution of the obstruction notification subroutine in Step S6.
  • FIG. 10 is a flowchart illustrating the detail of the obstruction notification subroutine.
  • In FIG. 10, first, the controller 1 determines whether or not the obstruction detection data GD is received from the image recognition processor 4 (Step S81). When Step S81 determines that the obstruction detection data GD is received, i.e., when an obstruction is present around the vehicle equipped with the surrounding condition detecting system, the controller 1 selects that illumination panel 2 which is disposed at a position corresponding to the direction that the obstruction is present, as the attention-required direction indication panel (Step S82). The presence of the obstruction is represented by the obstruction detection data GD. The controller 1, for example, selects one illumination panel disposed at a position corresponding to the direction that the obstruction is present as the attention-required direction indication panel among the illumination panels 2 9 to 2 11 disposed at the door DL on the front passenger seat side and the illumination panels 2 12 to 2 14 disposed at the door DR on the driver's seat side of the vehicle as shown in FIG. 2A. That is, in Step S82, the controller 1 selects, as the attention-required direction indication panel, the illumination panel 2 12 when the direction of the obstruction is right-front, selects the illumination panel 2 13 when the direction of the obstruction is right-lateral, selects the illumination panel 2 14 when the direction of the obstruction is right-rear, selects the illumination panel 2 9 when the direction of the obstruction is left-front, selects the illumination panel 2 10 when the direction of the obstruction is left-lateral, and selects the illumination panel 2 11 when the direction of the obstruction is left-rear.
  • Next, the controller 1 sets light emission conditions (luminance, a color, and a blinking speed) corresponding to a distance to and a size of the obstruction represented by the obstruction detection data GD (Step S83). The light emission condition is set, for example, as follows. The smaller the distance, the higher the luminance is. The smaller the distance, the more the emission color transitions from a cool color to a warm color (purple→indigo→blue→green→yellow→orange→red). The smaller the distance, the higher the blinking speed is. The larger the obstruction size, the higher the luminance is. The larger the obstruction size, the more the emission color is inclined toward a warm color. The larger the obstruction size, the higher the blinking speed is. It should be noted that the light emission conditions based on the distance and size may be combined.
  • Next, the controller 1 supplies the lighting or blinking command signal to the attention-required direction indication panel (Step S84). The lighting or blinking command signal causes the attention-required direction indication panel, selected among the illumination panels 2 9 to 2 11 and 2 12 to 2 14 (FIG. 2A) in Step 82, to light or blink under the light emission conditions set in Step S83.
  • When it is determined in Step S81 that the obstruction detection data GD is not received, then the controller 1 supplies the turn off command signal to the attention-required direction indication panel in order to turn off the attention-required direction indication panel (Step S85).
  • After the execution of Step S84 or S85, the controller 1 exits the obstruction notification subroutine shown in FIG. 10 and returns to the main routine shown in FIG. 4. That is, the controller 1 proceeds to execution of the forward vehicle rear lamp notification subroutine in Step S1 and repeatedly executes the above-described processing.
  • Operations and advantages obtained upon execution of the processing shown in FIG. 4 to FIG. 10 will be described.
  • When a stop lamp of a vehicle traveling forward of the vehicle equipped with the surrounding condition detecting system emits a red light, the illumination panel 2 1 emits a red light in accordance with the lighting stop lamp. The illumination panel 2 1 is installed at the center of the steering wheel SW, which is a shaded portion in FIG. 11A. When a backup lamp of a vehicle in front of the vehicle equipped with the surrounding condition detecting system emits a white light, the illumination panel 2 2 emits a white light in accordance with the lighting backup lamp. The illumination panel 2 2 is installed under the illumination panel 2 1 of the steering wheel SW, which is a shaded portion in FIG. 11B. When a right turn signal lamp of a vehicle traveling ahead is blinking in yellow, the illumination panel 2 4 blinks in yellow in accordance with the blinking turn signal lamp. The illumination panel 2 4 is installed at right lateral to the illumination panel 2 1 of the steering wheel SW, which is a shaded portion in FIG. 11C. When a left turn signal lamp of the vehicle traveling forward is blinking in yellow, the illumination panel 2 3 blinks in yellow in accordance with the blinking turn signal lamp. The light-emitting panel 2 3 is installed at left-lateral to the light-emitting panel 2 1 of the steering wheel SW, which is a shaded portion in FIG. 11D. When a hazard warning lamp of the vehicle traveling forward is blinking in yellow, the illumination panels 2 3 and 2 4 blink in yellow in accordance with the flashing hazard warning lamp. The illumination panels 2 3 and 2 4 are installed at left-lateral and right-lateral of the illumination panel 2 1 of the steering wheel SW, which are shaded portions in FIG. 11E, respectively. Each emission color of the illumination panels 2 1 to 2 4 (when the illumination panels 2 1 to 2 4 lights or blinks) only needs to be a color similar to the emission color of the lighting rear lamp of the forward vehicle. In other words, the colors of the light emitted from the illumination panels 2 1 to 2 4 need not to be completely the same color as the rear lamp assembly of the forward vehicle.
  • That is, when an image captured by the front camera 3 includes a lighting rear lamp of the forward vehicle, the illumination panels 2 1 to 2 4, which are installed at the steering wheel SW, reproduce the lighting or blinking state with a color corresponding to the emission color of the rear lamp assembly of the forward vehicle. Accordingly, even if the driver's visual line is out of the forward vehicle, the lighting/blinking state of the illumination panels 2 1 to 2 4 installed at the steering wheel SW enters the driver's field of vision. Thus, even if the driver does not look at the forward vehicle, the driver can recognize a state of the rear lamp assembly of the forward vehicle (the backup lamp, the stop lamp, the turn signal lamp, or the hazard warning lamp) without moving the direction of his visual line. Accordingly, in the case where heavy braking is applied to the forward vehicle while the driver of the vehicle equipped with the surrounding condition detecting system is checking, for example, a traffic sign, the driver of the vehicle equipped with the surrounding condition detecting system can immediately take avoidance behavior.
  • When a traffic light appears forward while the vehicle equipped with the surrounding condition detecting system is traveling, and the emission color of the traffic light is red, then the illumination panel 2 5 lights in red. The illumination panel 2 5 is installed above the windshield FG, which is a shaded portion in FIG. 12A. When the emission color of the traffic light is yellow, the illumination panel 2 6 lights in yellow. The illumination panel 2 6 is installed above the windshield FG, which is a shaded portion in FIG. 12B. When the emission color of the traffic light is blue (green), the illumination panel 2 7 lights in blue (green). The illumination panel 2 7 is installed above the windshield FG, which is a shaded portion in FIG. 12C. When the traffic light displays an arrow pointing leftward, the illumination panel 2 7 lights in blue and the illumination panel 2 5 lights in red. The illumination panel 2 7 is installed above the windshield FG, which is one of shaded portions in FIG. 12D. The illumination panel 2 5 is installed next to next to the illumination panel 2 7. The illumination panel 2 5 is also installed above the windshield FG, which is the other of the shaded portions in FIG. 12D. When the traffic light displays an arrow pointing rightward, the illumination panel 2 8 lights in blue and the illumination panel 2 5 lights in red. The illumination panel 2 7 is installed above the windshield FG, and the illumination panel 2 5 is laterally next to the illumination panel 2 8. Both the illumination panels 2 5 and 2 8 are shaded portions in FIG. 12E. When the traffic light displays an arrow pointing a straight direction, the illumination panel 2 23 lights in blue and the illumination panel 2 5 lights in red. The illumination panel 2 23 is installed above the windshield FG, and the illumination panel 2 5 is disposed below the illumination panel 2 23. The illumination panels 2 5 and 2 23 are shaded portions in FIG. 12F. That is, combination of blue light from one illumination panel 2 and red light from another illumination panel 2 indicates that a turn arrow display is made by the traffic light. An installation position of the illumination panel 2 that lights in blue indicates a direction to which the vehicle is allowed to move. It should be noted that each emission color of the illumination panels 2 5 to 2 8 and 2 23 only needs to be a color corresponding (similar) to the emission color of the traffic light. The emission colors of the illumination panels 2 5 to 2 8 and 2 23 need not to be completely the same color as the traffic light.
  • Thus, when an image captured by the front camera 3 includes the traffic light, the illumination panels 2 5 to 2 8 and 2 23, which are installed above the windshield FG in front of the driver's seat, reproduce the lighting state of the traffic light with a color corresponding to the lighting color of the traffic light. Accordingly, even if the driver cannot visually observe a color of the traffic light due to sunlight, the lighting color of the traffic light can be checked. Even if the driver's visual line is out of the traffic light, lighting states of the illumination panels 2 5 to 2 8 and 2 23 installed above the windshield FG enters the driver's field of vision. This allows the driver to recognize the color of the traffic light without moving an eye direction of the driver. When the traffic light displays a turn-arrow, the direction of the turn arrow displayed can be recognized by the relationship between a position of one illumination panel 2 that emits a red light and a position of another illumination panel 2 that emits a blue light.
  • When the avoidance-required obstacle such as a pedestrian, a bicycle, a wall, an edge stone, an obstruction, and an emergency vehicle is present around the vehicle equipped with the surrounding condition detecting system, that illumination panel 2 which is installed at a position corresponding to a direction of the avoidance-required obstacle lights or blinks. For example, when the avoidance-required obstacle is present right front of the vehicle equipped with the surrounding condition detecting system, then the illumination panel 2 12, which is a shaded portion in FIG. 13A, installed on the vehicle front side among the illumination panels 2 12 to 2 14 lights or blinks. The illumination panels 2 12 to 2 14 are situated at the door DR on the driver's seat side. When the avoidance-required obstacle is present right-lateral to the vehicle equipped with the surrounding condition detecting system, then the illumination panel 2 13, which is a shaded portion in FIG. 13B, installed at the center among the illumination panels 2 12 to 2 14 lights or blinks. The illumination panels 2 12 to 2 14 are mounted on the door DR on the driver's seat side. When the avoidance-required obstacle is present left-rear of the vehicle equipped with the surrounding condition detecting system, the illumination panel 2 11, which is a shaded portion in FIG. 13C, installed on the vehicle rear side among the illumination panels 2 9 to 2 11 lights or blinks. The illumination panels 2 9 to 2 11 are installed at the door DL on the front passenger seat side. The illumination panel lights or blinks in the following manner. The smaller the distance from the vehicle to the avoidance required obstacle, the higher luminance of the lighting or blinking illumination panel 2 is. The larger the relative speed between the avoidance-required obstacle and the vehicle, the higher luminance of the lighting or blinking illumination panel 2 is. The smaller the distance from the vehicle to the avoidance-required obstacle, the more the emission color transitions from a cool color to a warm color (for example, purple→indigo→blue→green→yellow→orange→red). The larger the relative speed between the avoidance-required obstacle and the vehicle, the more the emission color transitions from a cool color to a warm color. The smaller the distance from the vehicle to the avoidance-required obstacle, the higher the blinking speed of the blinking illumination panel 2 is. The greater the relative speed between the avoidance-required obstacle and the vehicle, the higher the blinking speed of the blinking illumination panel 2 is. When an obstruction is present on the road, the larger the obstruction size, the higher the luminance of the lighting or blinking illumination panel 2 is. The larger the obstruction size, the emission color of the lighting or blinking illumination panel 2 is inclined toward a warm color. The larger the obstruction size, the higher the blinking speed is.
  • That is, when an image captured by the front camera 3, the rear camera 5, or the side camera 6 includes the avoidance-required obstacle, i.e., when the avoidance-required obstacle is present near the vehicle equipped with the surrounding condition detecting system, then a state of at least one of the light emitting panels 2 provided in the vehicle cabin is forcibly changed (change from unlit state to lighting or blinking state, changes in emission color or change in luminance). Accordingly, even if the driver of the vehicle equipped with the surrounding condition detecting system does not visually observe the attention-required object around the vehicle equipped with the surrounding condition detecting system, the change in the state of the light emitting panel(s) 2 enters the driver's field of vision. This allows the driver to recognize that the attention required object approaches his vehicle or his vehicle approaches the attention-required object. The light emitting panel 2 installed at a position corresponding to a direction that the attention-required object is present is caused to light or blink (flash). This allows the driver to recognize the direction where the attention-required object (cautionary object) is present without moving the driver's visual line.
  • Accordingly, even if the avoidance-required obstacle present near the vehicle is out of the driver's field of vision during backward driving, entering a road zone with poor visibility, or exiting a parking area or lot, light (blinking or no blinking) of the luminescence panel 2 located at a position corresponding to a direction of the avoidance-required obstacle enters the driver's field of vision. This enables the driver to recognize the direction where the avoidance-required obstacle is present without moving the driver's visual line. Because the emission color, the luminance, and the blinking speed of the luminescence panel 2 change in accordance with the distance and the relative speed between the vehicle and the avoidance-required obstacle, the driver is able to intuitively recognize danger or hazard associated with the approaching avoidance-required obstacle.
  • Steps S73 and S74 in the emergency vehicle notification subroutine shown in FIG. 9 are executed with an emergency vehicle as the obstacle. It should be noted, however, that processing similar to Steps S73 and S74 may be carried out with a preceding vehicle as the avoidance-required object. For example, if a distance to the preceding vehicle becomes smaller than a predetermined distance, all of the luminescence lamps 2 1 to 2 4 mounted on the steering wheel SW (FIG. 2A) may be used as the attention-required direction indication panels. Then, the processing similar to Steps S73 and S74 are carried out. Accordingly, the smaller the distance to the preceding vehicle, the higher the luminance of each of the luminescence panels 2 1 to 2 4 is. The higher the relative speed to the preceding vehicle, the higher the luminance of each of the luminescence panels 2 1 to 2 4 is. The smaller the distance to the preceding vehicle, the more the emission color transitions from a cool color to a warm color (for example, purple→indigo→blue→green→yellow→orange→red). The higher the relative speed to the preceding vehicle, the more the emission color transitions from a cool color to a warm color. The smaller the distance to the preceding vehicle, the higher the blinking speed of each of the luminescence panels 2 1 to 2 4 is. The higher the relative speed to the preceding vehicle, the higher the blinking speed of each of the luminescence panels 2 1 to 2 4 is.
  • Although in the above-described embodiment, as shown in FIG. 13A to FIG. 13C, the direction of the avoidance-required object is indicated by lighting or blinking of the luminescence panels 2 9 to 2 14 mounted on the door DR on the d river's seat side and the door DL on the front passenger seat side, the direction of the avoidance required object may be indicated by another luminescence panel(s) 2.
  • In the case where, for example, an avoidance-required object approaches from rightward of the vehicle equipped with the surrounding condition detecting system at an intersection with poor visibility where entry is from a narrow road without effective right/left visibility into a wide road, a luminescence panel 2 15 mounted on a dashboard on the driver's seat side shown in FIG. 14A is caused to light or blink. When the avoidance-required object approaches from leftward of the vehicle equipped with the surrounding condition detecting system, the luminescence panel 2 16 mounted on the dashboard on the front passenger seat side shown in FIG. 14B may be caused to light or blink. When the avoidance-required object is present right-lateral to the vehicle equipped with the surrounding condition detecting system, the luminescence panel 2 12 mounted on the door DR on the driver's seat side (FIG. 2A) may be caused to light or blink. When the avoidance-required object is present left-lateral to the vehicle, the luminescence panel 2 9 mounted on the door DL on the front passenger seat side (FIG. 2A) may be caused to light or blink. Similarly, the luminescence panels 2 17 to 2 22 mounted on the ceiling in the vehicle cabin (FIG. 2B) may be caused to light or blink corresponding to a direction of the avoidance-required object. For example, when the avoidance-required object is present at right front of the vehicle equipped with the surrounding condition detecting system, the luminescence panel 2 17 mounted on the ceiling may be caused to light or blink. When the avoidance-required object is present at left-rear of the vehicle, the luminescence panel 2 22 mounted on the ceiling may be caused to light or blink.
  • DESCRIPTION OF REFERENCE SIGNS
    • 1 controller
    • 2 1 to 2 n light emitting panels
    • 3 front camera
    • 4 image recognition processor
    • 5 rear camera
    • 6 side cameras

Claims (20)

What is claimed is:
1. A system for detecting a surrounding condition relative to a body, the system comprising:
a plurality of light-emitters,
a sensor configured to detect the surrounding condition; and
a controller configured to change a state of at least one of the plurality of the light-emitters when the sensor detects an object at an intersection.
2. The system according to claim 1, wherein the controller changes the state of the at least one of the plurality of light emitters positioned corresponding to a direction of the object.
3. The system according to claim 1, wherein,
when the object is present at a right side of the body, the controller changes the state of ones of the plurality of light-emitters positioned on the right side to light or blink; and,
when the object is present at a left side of the body, the controller changes the state of other ones of the plurality of light-emitters positioned on the left side to light or blink.
4. The system according to claim 3, wherein the controller changes the state of the at least one of the plurality of light-emitters to an off state when the body moves from the intersection.
5. The system according to claim 1, wherein the at least one of the plurality of the light-emitter is mounted on a dashboard of the body.
6. The system according to claim 1, wherein the at least one of the plurality of the light-emitter is mounted on a ceiling of the body.
7. The system according to claim 1, wherein the intersection comprises an entry from a first road to a second road that is wider than the first road.
8. The system according to claim 1,
wherein the controller changes the state of a first one of the plurality of light emitters positioned at a first direction to light or blink when the object is positioned at the first direction,
wherein, when the object moves to a second direction from the first direction, the controller changes the state of the first one of the plurality of light-emitters to an off sate and changes a state of second light emitter positioned at second direction to light or blink.
9. An illumination device that indicates a surrounding condition relative to a body, the illumination device comprising:
a plurality of light-emitters, each of which is configured to receive a voltage and, based on the voltage, to change a state; and
a driver configured to generate the voltage based on a detected object to which attention must be paid in a vicinity of the body,
wherein at least one of the plurality of light-emitters changes the state based on the voltage when an object is detected at an intersection.
10. The illumination device according to claim 9, wherein the driver generates the voltage according to a signal received from a controller.
11. The illumination device according to claim 9, wherein the driver changes the voltage to the at least one of the plurality of light-emitters when the body moves from the intersection.
12. The illumination device according to claim 9, wherein the at least one of the plurality of light-emitters is mounted on a dashboard of the body.
13. The illumination device according to claim 9, wherein the at least one of the plurality of light-emitters is mounted on a ceiling of the body.
14. The illumination device according to claim 9, wherein the intersection comprises an entry from a first road to a second road that is wider than the first road.
15. A detector attachable to a vehicle, the detector comprising:
a sensor configured to detect the surrounding condition; and
a controller configured to change a state of at least one of a plurality of light-emitters when the sensor detects an object at an intersection.
16. The detector according to claim 15, wherein the controller changes the state of the at least one of the plurality of light emitters that is positioned corresponding to a direction of the object.
17. The detector according to claim 15,
wherein the controller changes the state of at least one of the plurality of light-emitters to light or blink; and,
wherein the controller changes the state of at least one of the plurality of light-emitters to an off state when the body moves from the intersection.
18. The detector according to claim 15, wherein the intersection comprises an entry from a first road to a second road that is wider than the first road.
19. The detector according to claim 15, wherein the sensor comprises a camera positioned on a front portion of the body.
20. The detector according to claim 19, wherein the sensor comprises an image recognition processor which performs image recognition to image signals from the camera, so as to detect the object.
US16/119,876 2011-04-07 2018-08-31 System for detecting surrounding conditions of moving body Abandoned US20180370427A1 (en)

Priority Applications (7)

Application Number Priority Date Filing Date Title
US16/119,876 US20180370427A1 (en) 2011-04-07 2018-08-31 System for detecting surrounding conditions of moving body
US16/177,182 US11577643B2 (en) 2011-04-07 2018-10-31 System for detecting surrounding conditions of moving body
US16/177,212 US20190061610A1 (en) 2011-04-07 2018-10-31 System for detecting surrounding conditions of moving body
US16/177,122 US20190071004A1 (en) 2011-04-07 2018-10-31 System for detecting surrounding conditions of moving body
US16/177,079 US10988077B2 (en) 2011-04-07 2018-10-31 System for detecting surrounding conditions of moving body
US16/176,967 US20190071003A1 (en) 2011-04-07 2018-10-31 System for detecting surrounding conditions of moving body
US18/099,091 US20230150424A1 (en) 2011-04-07 2023-01-19 System for detecting surrounding conditions of moving body

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
PCT/JP2011/058803 WO2012137332A1 (en) 2011-04-07 2011-04-07 System for detecting surrounding conditions of moving body
US201314110118A 2013-12-17 2013-12-17
US15/489,174 US9802532B2 (en) 2011-04-07 2017-04-17 System for detecting surrounding conditions of moving body
US15/711,988 US20180009373A1 (en) 2011-04-07 2017-09-21 System for detecting surrounding conditions of moving body
US16/034,257 US10384596B2 (en) 2011-04-07 2018-07-12 System for detecting surrounding conditions of moving body
US16/034,283 US10625666B2 (en) 2011-04-07 2018-07-12 System for detecting surrounding conditions of moving body
US16/119,876 US20180370427A1 (en) 2011-04-07 2018-08-31 System for detecting surrounding conditions of moving body

Related Parent Applications (2)

Application Number Title Priority Date Filing Date
US16/034,283 Continuation US10625666B2 (en) 2011-04-07 2018-07-12 System for detecting surrounding conditions of moving body
US16/119,840 Continuation US10632904B2 (en) 2011-04-07 2018-08-31 System for detecting surrounding conditions of moving body

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/119,905 Continuation US10946795B2 (en) 2011-04-07 2018-08-31 System for detecting surrounding conditions of moving body

Publications (1)

Publication Number Publication Date
US20180370427A1 true US20180370427A1 (en) 2018-12-27

Family

ID=46968767

Family Applications (17)

Application Number Title Priority Date Filing Date
US14/110,118 Active 2032-09-12 US9649972B2 (en) 2011-04-07 2011-04-07 System for detecting surrounding conditions of moving body
US15/489,174 Active US9802532B2 (en) 2011-04-07 2017-04-17 System for detecting surrounding conditions of moving body
US15/711,988 Abandoned US20180009373A1 (en) 2011-04-07 2017-09-21 System for detecting surrounding conditions of moving body
US16/034,283 Active US10625666B2 (en) 2011-04-07 2018-07-12 System for detecting surrounding conditions of moving body
US16/034,257 Active US10384596B2 (en) 2011-04-07 2018-07-12 System for detecting surrounding conditions of moving body
US16/119,569 Abandoned US20180370425A1 (en) 2011-04-07 2018-08-31 System for detecting surrounding conditions of moving body
US16/119,905 Active US10946795B2 (en) 2011-04-07 2018-08-31 System for detecting surrounding conditions of moving body
US16/119,876 Abandoned US20180370427A1 (en) 2011-04-07 2018-08-31 System for detecting surrounding conditions of moving body
US16/119,749 Active US10632903B2 (en) 2011-04-07 2018-08-31 System for detecting surrounding conditions of moving body
US16/119,840 Active US10632904B2 (en) 2011-04-07 2018-08-31 System for detecting surrounding conditions of moving body
US16/177,212 Abandoned US20190061610A1 (en) 2011-04-07 2018-10-31 System for detecting surrounding conditions of moving body
US16/177,079 Active US10988077B2 (en) 2011-04-07 2018-10-31 System for detecting surrounding conditions of moving body
US16/176,967 Abandoned US20190071003A1 (en) 2011-04-07 2018-10-31 System for detecting surrounding conditions of moving body
US16/177,122 Abandoned US20190071004A1 (en) 2011-04-07 2018-10-31 System for detecting surrounding conditions of moving body
US16/177,182 Active US11577643B2 (en) 2011-04-07 2018-10-31 System for detecting surrounding conditions of moving body
US17/127,783 Active 2031-05-08 US11479165B2 (en) 2011-04-07 2020-12-18 System for detecting surrounding conditions of moving body
US18/099,091 Pending US20230150424A1 (en) 2011-04-07 2023-01-19 System for detecting surrounding conditions of moving body

Family Applications Before (7)

Application Number Title Priority Date Filing Date
US14/110,118 Active 2032-09-12 US9649972B2 (en) 2011-04-07 2011-04-07 System for detecting surrounding conditions of moving body
US15/489,174 Active US9802532B2 (en) 2011-04-07 2017-04-17 System for detecting surrounding conditions of moving body
US15/711,988 Abandoned US20180009373A1 (en) 2011-04-07 2017-09-21 System for detecting surrounding conditions of moving body
US16/034,283 Active US10625666B2 (en) 2011-04-07 2018-07-12 System for detecting surrounding conditions of moving body
US16/034,257 Active US10384596B2 (en) 2011-04-07 2018-07-12 System for detecting surrounding conditions of moving body
US16/119,569 Abandoned US20180370425A1 (en) 2011-04-07 2018-08-31 System for detecting surrounding conditions of moving body
US16/119,905 Active US10946795B2 (en) 2011-04-07 2018-08-31 System for detecting surrounding conditions of moving body

Family Applications After (9)

Application Number Title Priority Date Filing Date
US16/119,749 Active US10632903B2 (en) 2011-04-07 2018-08-31 System for detecting surrounding conditions of moving body
US16/119,840 Active US10632904B2 (en) 2011-04-07 2018-08-31 System for detecting surrounding conditions of moving body
US16/177,212 Abandoned US20190061610A1 (en) 2011-04-07 2018-10-31 System for detecting surrounding conditions of moving body
US16/177,079 Active US10988077B2 (en) 2011-04-07 2018-10-31 System for detecting surrounding conditions of moving body
US16/176,967 Abandoned US20190071003A1 (en) 2011-04-07 2018-10-31 System for detecting surrounding conditions of moving body
US16/177,122 Abandoned US20190071004A1 (en) 2011-04-07 2018-10-31 System for detecting surrounding conditions of moving body
US16/177,182 Active US11577643B2 (en) 2011-04-07 2018-10-31 System for detecting surrounding conditions of moving body
US17/127,783 Active 2031-05-08 US11479165B2 (en) 2011-04-07 2020-12-18 System for detecting surrounding conditions of moving body
US18/099,091 Pending US20230150424A1 (en) 2011-04-07 2023-01-19 System for detecting surrounding conditions of moving body

Country Status (3)

Country Link
US (17) US9649972B2 (en)
JP (1) JP5031126B1 (en)
WO (1) WO2012137332A1 (en)

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012137332A1 (en) 2011-04-07 2012-10-11 パイオニア株式会社 System for detecting surrounding conditions of moving body
US9043133B2 (en) * 2011-12-29 2015-05-26 Intel Corporation Navigation systems and associated methods
DE102013001086A1 (en) * 2013-01-23 2014-07-24 Audi Ag A motor vehicle comprising a plurality of illumination means for illuminating the lateral or rearward vehicle surroundings
JP5714618B2 (en) * 2013-01-29 2015-05-07 本田技研工業株式会社 Vehicle start notification control device
US9884586B2 (en) 2014-03-28 2018-02-06 Pioneer Corporation Vehicle lighting device
JP6281483B2 (en) * 2014-04-17 2018-02-21 株式会社デンソー Failure detection system, information processing apparatus, and vehicle mounting apparatus
FR3040938A1 (en) * 2015-09-14 2017-03-17 Valeo Vision MOTOR VEHICLE COMPRISING A DOOR PROVIDED WITH A LIGHT MODULE
JP6814153B2 (en) * 2015-10-27 2021-01-13 株式会社小糸製作所 Vehicle lighting, vehicle systems and vehicles
EP3395614A4 (en) * 2015-12-22 2019-10-09 Koito Manufacturing Co., Ltd. Vehicle illumination device, vehicle and illumination control system
JP6327719B2 (en) * 2016-02-04 2018-05-23 株式会社Subaru Vehicle travel control device
KR20170119515A (en) * 2016-04-19 2017-10-27 주식회사 만도 System and method for verification of lamp operation
CN109562726B (en) * 2016-07-29 2022-05-10 提爱思科技股份有限公司 Light emitting unit for vehicle
CN107767680B (en) * 2016-08-22 2021-11-05 福特环球技术公司 Intersection traffic signal reminding method and multifunctional vehicle atmosphere lamp system
US11145199B1 (en) * 2016-11-14 2021-10-12 Sensysnetworks, Inc. Apparatus and method for two-way signaling with traffic controllers over a wireless link
US10366286B2 (en) * 2016-12-13 2019-07-30 Google Llc Detection of traffic light signal changes
KR102279333B1 (en) 2017-03-07 2021-07-20 주식회사 만도 Display System Of Vehicle And Method of Driving Thereof
US10647332B2 (en) * 2017-09-12 2020-05-12 Harman International Industries, Incorporated System and method for natural-language vehicle control
KR101977716B1 (en) * 2017-11-03 2019-05-14 주식회사 만도 Safety apparatus of vehicle and method using thereof
US11206375B2 (en) 2018-03-28 2021-12-21 Gal Zuckerman Analyzing past events by utilizing imagery data captured by a plurality of on-road vehicles
CN110406467A (en) * 2018-04-28 2019-11-05 北京凌云智能科技有限公司 Information cuing method and device
US11138418B2 (en) 2018-08-06 2021-10-05 Gal Zuckerman Systems and methods for tracking persons by utilizing imagery data captured by on-road vehicles
JP7277205B2 (en) * 2019-03-28 2023-05-18 日産自動車株式会社 Traffic light detection method and traffic light detection device
US11328519B2 (en) 2020-07-23 2022-05-10 Waymo Llc Detecting traffic signaling states with neural networks
CN112455327A (en) * 2020-12-03 2021-03-09 上海汽车集团股份有限公司 Vehicle lamp control method and device and computer readable storage medium
US11554716B1 (en) 2022-04-06 2023-01-17 Toyota Research Institute, Inc. Systems and methods for recommending a steering angle using visual feedback on a wheel

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070268118A1 (en) * 2006-05-17 2007-11-22 Hisayuki Watanabe Surrounding image generating apparatus and method of adjusting metering for image pickup device
US7589883B2 (en) * 1994-05-05 2009-09-15 Donnelly Corporation Vehicular exterior mirror

Family Cites Families (147)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3393344A (en) * 1966-10-07 1968-07-16 Page Hayden J Photosensitive vane actuated circuitry for dimming headlamps
US4626850A (en) 1983-05-16 1986-12-02 David Chey Vehicle detection and collision avoidance apparatus
US4692798A (en) * 1984-01-09 1987-09-08 Nissan Motor Company, Limited Apparatus and process for improving visibility of object within visual field
JPS6259880A (en) 1985-09-11 1987-03-16 Stanley Electric Co Ltd Obstacle detection device
US4694295A (en) 1986-05-15 1987-09-15 Miller Brett A Vehicle blind spot detector
JPS63195045A (en) 1987-02-09 1988-08-12 Alpine Electron Inc On-board announciator for alarming approach of obstacle
JPH01278848A (en) * 1988-05-02 1989-11-09 Nissan Motor Co Ltd Headlight device for vehicle
AU705003B2 (en) * 1995-06-12 1999-05-13 Toyoda Gosei Co. Ltd. Information indicator for vehicle
US5786772A (en) * 1996-03-22 1998-07-28 Donnelly Corporation Vehicle blind spot detection display system
US6774988B2 (en) * 2002-07-30 2004-08-10 Gentex Corporation Light source detection and categorization system for automatic vehicle exterior light control and method of manufacturing
US5823666A (en) 1997-10-16 1998-10-20 Kingsolver; George L. Steering wheel mounted turn signal controls and indicators
US6420975B1 (en) * 1999-08-25 2002-07-16 Donnelly Corporation Interior rearview mirror sound processing system
US7265494B2 (en) 1998-10-09 2007-09-04 Azoteq Pty Ltd. Intelligent user interface with touch sensor technology
JP3864406B2 (en) 1999-01-26 2006-12-27 マツダ株式会社 Vehicle display device
US6894608B1 (en) 1999-07-22 2005-05-17 Altra Technologies Incorporated System and method for warning of potential collisions
EP1083076A3 (en) * 1999-09-07 2005-01-12 Mazda Motor Corporation Display apparatus for vehicle
ATE330818T1 (en) * 1999-11-24 2006-07-15 Donnelly Corp REARVIEW MIRROR WITH USEFUL FUNCTION
US20080122799A1 (en) 2001-02-22 2008-05-29 Pryor Timothy R Human interfaces for vehicles, homes, and other applications
AU2001243285A1 (en) * 2000-03-02 2001-09-12 Donnelly Corporation Video mirror systems incorporating an accessory module
US7370983B2 (en) 2000-03-02 2008-05-13 Donnelly Corporation Interior mirror assembly with display
US7167796B2 (en) * 2000-03-09 2007-01-23 Donnelly Corporation Vehicle navigation system for use with a telematics system
US6536928B1 (en) * 2000-03-03 2003-03-25 Lear Corporation Multi-colored vehicle interior lighting
US6470273B2 (en) 2000-11-08 2002-10-22 Milton Halsted Collision warning system
US7581859B2 (en) 2005-09-14 2009-09-01 Donnelly Corp. Display device for exterior rearview mirror
ES2287266T3 (en) * 2001-01-23 2007-12-16 Donnelly Corporation IMPROVED VEHICLE LIGHTING SYSTEM.
US8768286B2 (en) * 2001-10-24 2014-07-01 Mouhamad Ahmad Naboulsi Hands on steering wheel vehicle safety control system
US7019791B2 (en) 2001-11-09 2006-03-28 Hitachi, Ltd. Video processing device
JP2003291689A (en) 2002-04-05 2003-10-15 Sogo Jidosha Anzen Kogai Gijutsu Kenkyu Kumiai Information display device for vehicle
EP1504276B1 (en) 2002-05-03 2012-08-08 Donnelly Corporation Object detection system for vehicle
US7139411B2 (en) * 2002-06-14 2006-11-21 Honda Giken Kogyo Kabushiki Kaisha Pedestrian detection and tracking with night vision
US7156542B2 (en) * 2002-12-13 2007-01-02 Ford Global Technologies, Llc Vehicle headlight system having digital beam-forming optics
US7541743B2 (en) * 2002-12-13 2009-06-02 Ford Global Technologies, Llc Adaptive vehicle communication controlled lighting system
US8045760B2 (en) * 2003-02-21 2011-10-25 Gentex Corporation Automatic vehicle exterior light control systems
JP4066892B2 (en) 2003-06-24 2008-03-26 アイシン精機株式会社 Vehicle alarm device
US7477976B2 (en) * 2003-07-28 2009-01-13 Denso Corporation Automatic optical axis direction adjusting apparatus for vehicles
JP2005047383A (en) * 2003-07-29 2005-02-24 Daihatsu Motor Co Ltd Drive assisting device
JP4253271B2 (en) 2003-08-11 2009-04-08 株式会社日立製作所 Image processing system and vehicle control system
JP4424102B2 (en) * 2003-09-26 2010-03-03 株式会社デンソー Automatic headlamp optical axis adjustment device for vehicles
US7526103B2 (en) 2004-04-15 2009-04-28 Donnelly Corporation Imaging system for vehicle
US20060012595A1 (en) 2004-07-19 2006-01-19 Chien-Chih Chen Driving circuit and driving process of display system
US7123165B2 (en) * 2004-07-26 2006-10-17 General Electric Company Apparatus and method for monitoring the output of a warning or indicator light
JP2006064968A (en) 2004-08-26 2006-03-09 Advanced Lcd Technologies Development Center Co Ltd Phase shift mask and exposure method using the same
US7299892B2 (en) * 2004-09-20 2007-11-27 International Automotive Components Group North America, Inc. Door trim speaker grille with electroluminescent lamp and injection molding method of making same
US7881496B2 (en) * 2004-09-30 2011-02-01 Donnelly Corporation Vision system for vehicle
US7239953B2 (en) 2004-10-05 2007-07-03 Vision Works, Llc Absolute acceleration sensor for use within moving vehicles
JP4773080B2 (en) * 2004-12-17 2011-09-14 株式会社デンソー Visibility improvement support device
US6985073B1 (en) * 2004-12-20 2006-01-10 Duc Doan Apparatus for monitoring traffic signals and alerting drivers
JP2006192972A (en) * 2005-01-11 2006-07-27 Denso Corp Displaying device for vehicle rear seat
US7489236B2 (en) * 2005-04-29 2009-02-10 Chavarria Faustino V Pedestrian alert system for vehicles
US7492281B2 (en) * 2005-07-06 2009-02-17 Donnelly Corporation Vehicle exterior mirror assembly with blind spot indicator
US7344277B2 (en) * 2005-08-29 2008-03-18 Federal-Mogul Worldwide, Inc. Ambiance lighting system with temperature responsive variable color output
KR100696392B1 (en) 2005-12-07 2007-03-19 주식회사단해 System and method for monitoring outside of automobile
JP4791262B2 (en) 2006-06-14 2011-10-12 本田技研工業株式会社 Driving assistance device
US7972045B2 (en) * 2006-08-11 2011-07-05 Donnelly Corporation Automatic headlamp control system
JP2008087832A (en) 2006-10-03 2008-04-17 Sharp Corp Cylindrical packaging container
JP4240110B2 (en) * 2006-10-31 2009-03-18 トヨタ自動車株式会社 VEHICLE LIGHTING DEVICE, VEHICLE LIGHTING CONTROL METHOD, AND VEHICLE LIGHTING CONTROL PROGRAM
US7800483B2 (en) * 2006-11-10 2010-09-21 Federal-Mogul World Wide, Inc. Transitional lighting system for vehicle interior
JP2008158963A (en) 2006-12-26 2008-07-10 Calsonic Kansei Corp Vehicle surrounding detecting system
JP4930315B2 (en) * 2007-01-19 2012-05-16 株式会社デンソー In-vehicle information display device and light irradiation device used therefor
JP4946661B2 (en) 2007-06-27 2012-06-06 トヨタ自動車株式会社 Warning display device for vehicles
US8645001B2 (en) 2007-09-04 2014-02-04 International Business Machines Corporation Method and system for blind spot identification and warning utilizing visual indicators
US20090058621A1 (en) 2007-09-05 2009-03-05 San-Lin Yen Multifunction crash-protecting alerting system
EP2107503A1 (en) * 2008-03-31 2009-10-07 Harman Becker Automotive Systems GmbH Method and device for generating a real time environment model for vehicles
US8751154B2 (en) 2008-04-24 2014-06-10 GM Global Technology Operations LLC Enhanced clear path detection in the presence of traffic infrastructure indicator
JP5383142B2 (en) 2008-10-06 2014-01-08 アルパイン株式会社 Vehicle position warning method and vehicle position warning device
US20100188343A1 (en) 2009-01-29 2010-07-29 Edward William Bach Vehicular control system comprising touch pad and vehicles and methods
US8964032B2 (en) 2009-01-30 2015-02-24 Magna Electronics Inc. Rear illumination system
DE102009001122B8 (en) 2009-02-24 2020-11-26 Robert Bosch Gmbh Camera arrangement and method for determining image signals with color values
US9126525B2 (en) * 2009-02-27 2015-09-08 Magna Electronics Inc. Alert system for vehicle
JP5670426B2 (en) * 2009-04-07 2015-02-18 ボルボ テクノロジー コーポレイション Method and system for improving traffic safety and efficiency for vehicles
FR2944558B1 (en) * 2009-04-17 2014-05-02 Snecma DOUBLE BODY GAS TURBINE ENGINE PROVIDED WITH SUPPLEMENTARY BP TURBINE BEARING.
WO2010137174A1 (en) 2009-05-29 2010-12-02 トヨタ自動車 株式会社 Spectrum measuring apparatus for mover
JP5397321B2 (en) 2009-06-09 2014-01-22 株式会社デンソー Parking assistance system
US8536994B2 (en) 2009-06-10 2013-09-17 Toyota Motor Engineering & Manufacturing North America, Inc. Vehicle warning systems and methods
WO2011038100A1 (en) * 2009-09-23 2011-03-31 3M Innovative Properties Company Lighting assembly
US8482430B2 (en) * 2009-10-13 2013-07-09 GM Global Technology Operations LLC Method and apparatus for communicatively changing interior illumination color in a vehicle
JP5613398B2 (en) * 2009-10-29 2014-10-22 富士重工業株式会社 Intersection driving support device
DE102009054227A1 (en) * 2009-11-21 2011-05-26 Volkswagen Ag A method of controlling a headlamp assembly for a vehicle and headlamp assembly
JP5278292B2 (en) 2009-11-27 2013-09-04 株式会社デンソー Information presentation device
US8433473B2 (en) * 2010-01-18 2013-04-30 Ford Global Technologies, Llc System and method for indicating an efficiency level of energy usage by an automotive vehicle
US20110187518A1 (en) 2010-02-02 2011-08-04 Ford Global Technologies, Llc Steering wheel human/machine interface system and method
US20110298605A1 (en) * 2010-06-03 2011-12-08 Tung-Lin Lu Alarm light structure
US8522719B2 (en) * 2010-07-06 2013-09-03 Andrew Craghan Feld Portable and disposable living-grass pet toilet
US8827514B2 (en) * 2010-08-06 2014-09-09 Toyota Jidosha Kabushiki Kaisha Vehicle light distribution control apparatus and method
KR101231510B1 (en) * 2010-10-11 2013-02-07 현대자동차주식회사 System for alarming a danger coupled with driver-viewing direction, thereof method and vehicle for using the same
US8770810B2 (en) * 2010-12-10 2014-07-08 Smr Patents S.A.R.L. Rear view mirror assembly with optical indicator
DE102011078127B4 (en) 2011-02-01 2018-06-14 Johnson Controls Gmbh Interactive display unit
US8698639B2 (en) * 2011-02-18 2014-04-15 Honda Motor Co., Ltd. System and method for responding to driver behavior
US9292471B2 (en) * 2011-02-18 2016-03-22 Honda Motor Co., Ltd. Coordinated vehicle response system and method for driver behavior
DE102011004937A1 (en) * 2011-03-02 2012-09-06 Robert Bosch Gmbh Method and control device for influencing a lighting scene in front of a vehicle
JP5618887B2 (en) * 2011-04-01 2014-11-05 オムロンオートモーティブエレクトロニクス株式会社 Vehicle control device
WO2012137332A1 (en) * 2011-04-07 2012-10-11 パイオニア株式会社 System for detecting surrounding conditions of moving body
JP6091757B2 (en) * 2011-05-31 2017-03-08 株式会社小糸製作所 Vehicle lamp control device
US9415718B2 (en) * 2011-06-08 2016-08-16 Denso Corporation Vehicular headlight apparatus
KR101344423B1 (en) * 2011-06-08 2013-12-23 에스엘 주식회사 Apparatus for controllimg automotive headlamp
DE102011105983A1 (en) * 2011-06-29 2013-01-03 SMR Patents S.à.r.l. Close range cornering light in the exterior mirror
JP2013028274A (en) * 2011-07-28 2013-02-07 Denso Corp Headlight light control device
JP5833861B2 (en) * 2011-08-11 2015-12-16 株式会社小糸製作所 Vehicle headlamp device and light distribution control method
DE102011081367A1 (en) * 2011-08-23 2013-02-28 Robert Bosch Gmbh Method for controlling a light emission of a headlamp of a vehicle
US20130057397A1 (en) * 2011-09-01 2013-03-07 GM Global Technology Operations LLC Method of operating a vehicle safety system
KR101344424B1 (en) * 2011-11-18 2013-12-23 에스엘 주식회사 Apparatus and method for controlling head lamp of vehicle
CN103958272A (en) * 2011-12-01 2014-07-30 丰田自动车株式会社 Light distribution control system for vehicle
US9321329B2 (en) * 2012-05-10 2016-04-26 Chris Beckman Glare elimination and image enhancement system improving lenses, windows and displays
US9533615B2 (en) * 2011-12-15 2017-01-03 Toyota Motor Engineering & Manufacturing North America, Inc. Door trim pull cup ambient light
DE102012200040A1 (en) * 2012-01-03 2013-07-04 Robert Bosch Gmbh Method and control unit for adjusting an upper headlight beam boundary of a headlight cone
JP6048199B2 (en) * 2012-03-22 2016-12-21 株式会社デンソー Vehicle lighting device
JP5768756B2 (en) * 2012-04-17 2015-08-26 株式会社デンソー Light distribution control device for vehicle headlamp
US9707892B2 (en) * 2012-04-25 2017-07-18 Gentex Corporation Multi-focus optical system
US9161419B2 (en) * 2012-07-02 2015-10-13 International Business Machines Corporation Intelligent and coordinated lighting of a lighting device
RU2619059C2 (en) * 2012-07-27 2017-05-11 Ниссан Мотор Ко., Лтд. Device for detecting three-dimensional objects and method for detecting three-dimensional objects
JP6059910B2 (en) * 2012-08-21 2017-01-11 株式会社小糸製作所 Lamp control system and control device
JP5941800B2 (en) * 2012-09-07 2016-06-29 株式会社デンソー Vehicle headlamp device
JP5947682B2 (en) * 2012-09-07 2016-07-06 株式会社デンソー Vehicle headlamp device
US8922340B2 (en) * 2012-09-11 2014-12-30 Ford Global Technologies, Llc Proximity switch based door latch release
DE102012109423A1 (en) * 2012-10-04 2014-06-12 Hella Kgaa Hueck & Co. Method and device for adjusting a swivel angle of a headlamp when cornering
US20140098230A1 (en) * 2012-10-08 2014-04-10 Magna Mirrors Of America, Inc. Blind zone detection and alert system for vehicle
TW201416268A (en) * 2012-10-25 2014-05-01 Wistron Neweb Corp Automobile warning method and automobile warning system utilizing the same
US10796510B2 (en) * 2012-12-20 2020-10-06 Brett I. Walker Apparatus, systems and methods for monitoring vehicular activity
US9110169B2 (en) * 2013-03-08 2015-08-18 Advanced Scientific Concepts, Inc. LADAR enabled impact mitigation system
US9751534B2 (en) * 2013-03-15 2017-09-05 Honda Motor Co., Ltd. System and method for responding to driver state
US9069080B2 (en) * 2013-05-24 2015-06-30 Advanced Scientific Concepts, Inc. Automotive auxiliary ladar sensor
JP2015033944A (en) * 2013-08-09 2015-02-19 スタンレー電気株式会社 Lighting control device for headlight of vehicle, and headlight system of vehicle
US10023103B2 (en) * 2013-09-13 2018-07-17 J.W. Speaker, Corporation Systems and methods for illumination control and distribution during a vehicle bank
US9760698B2 (en) * 2013-09-17 2017-09-12 Toyota Motor Sales, U.S.A., Inc. Integrated wearable article for interactive vehicle control system
US10272920B2 (en) * 2013-10-11 2019-04-30 Panasonic Intellectual Property Corporation Of America Processing method, program, processing apparatus, and detection system
US20150206439A1 (en) * 2014-01-20 2015-07-23 Gulfstream Aerospace Corporation Ground vehicle warning to indicate presence of an obstacle near an aircraft
JP6284781B2 (en) * 2014-02-21 2018-02-28 株式会社小糸製作所 Light distribution control system
US10380693B2 (en) * 2014-02-25 2019-08-13 State Farm Mutual Automobile Insurance Company Systems and methods for generating data that is representative of an insurance policy for an autonomous vehicle
DE102014209771A1 (en) * 2014-05-22 2015-11-26 Hella Kgaa Hueck & Co. Method for controlling a cornering light and lighting device
US9714037B2 (en) * 2014-08-18 2017-07-25 Trimble Navigation Limited Detection of driver behaviors using in-vehicle systems and methods
US9718405B1 (en) * 2015-03-23 2017-08-01 Rosco, Inc. Collision avoidance and/or pedestrian detection system
US9550495B2 (en) * 2015-03-27 2017-01-24 Intel Corporation Technologies for assisting vehicles with changing road conditions
US20160297356A1 (en) * 2015-04-13 2016-10-13 Ford Global Technologies, Llc Printed led warning indicator signal
US9505346B1 (en) * 2015-05-08 2016-11-29 Honda Motor Co., Ltd. System and method for warning a driver of pedestrians and other obstacles
WO2016186255A1 (en) * 2015-05-18 2016-11-24 엘지전자 주식회사 Notification system and control method of vehicle
US10086699B2 (en) * 2015-06-24 2018-10-02 Nissan North America, Inc. Vehicle operation assistance information management for autonomous vehicle control operation
US20170162047A1 (en) * 2015-12-04 2017-06-08 Ford Global Technoligies, Llc Collision protection system for a parked motor vehicle
TWI570674B (en) * 2015-12-17 2017-02-11 合盈光電科技股份有限公司 Image detection system of vehicle
KR20170099188A (en) * 2016-02-23 2017-08-31 엘지전자 주식회사 Driver Assistance Apparatus and Vehicle Having The Same
US9903733B2 (en) * 2016-03-17 2018-02-27 Honda Motor Co., Ltd. Vehicular communications network and methods of use and manufacture thereof
US20170327035A1 (en) * 2016-05-10 2017-11-16 Ford Global Technologies, Llc Methods and systems for beyond-the-horizon threat indication for vehicles
KR101850392B1 (en) * 2016-05-12 2018-04-19 엘지전자 주식회사 Control device mounted on vehicle and method for controlling the same
KR20180032109A (en) * 2016-09-21 2018-03-29 엘지전자 주식회사 Dashboard display and vehicle comprising the same
US20180201184A1 (en) * 2017-01-16 2018-07-19 Siriustek Incorporated Light emitting device for car belt molding
US10600321B2 (en) * 2017-04-11 2020-03-24 International Business Machines Corporation Directional traffic notifications of approaching priority vehicles
KR101908309B1 (en) 2017-04-12 2018-10-16 엘지전자 주식회사 Lamp for Vehicle
US10668853B2 (en) * 2017-06-30 2020-06-02 Honda Motor Co., Ltd. Interior A-pillar electroluminescent assembly of a vehicle

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7589883B2 (en) * 1994-05-05 2009-09-15 Donnelly Corporation Vehicular exterior mirror
US20070268118A1 (en) * 2006-05-17 2007-11-22 Hisayuki Watanabe Surrounding image generating apparatus and method of adjusting metering for image pickup device

Also Published As

Publication number Publication date
US10632904B2 (en) 2020-04-28
US10946795B2 (en) 2021-03-16
US20180334093A1 (en) 2018-11-22
US9649972B2 (en) 2017-05-16
US11577643B2 (en) 2023-02-14
US20190071003A1 (en) 2019-03-07
US11479165B2 (en) 2022-10-25
US10384596B2 (en) 2019-08-20
US20180370426A1 (en) 2018-12-27
US20170217363A1 (en) 2017-08-03
US20230150424A1 (en) 2023-05-18
US20190039511A1 (en) 2019-02-07
WO2012137332A1 (en) 2012-10-11
JP5031126B1 (en) 2012-09-19
US20210146829A1 (en) 2021-05-20
JPWO2012137332A1 (en) 2014-07-28
US10632903B2 (en) 2020-04-28
US20180370425A1 (en) 2018-12-27
US10625666B2 (en) 2020-04-21
US20190061610A1 (en) 2019-02-28
US10988077B2 (en) 2021-04-27
US20140097748A1 (en) 2014-04-10
US20190071004A1 (en) 2019-03-07
US9802532B2 (en) 2017-10-31
US20190061609A1 (en) 2019-02-28
US20190071005A1 (en) 2019-03-07
US20180334092A1 (en) 2018-11-22
US20190009712A1 (en) 2019-01-10
US20180009373A1 (en) 2018-01-11

Similar Documents

Publication Publication Date Title
US11479165B2 (en) System for detecting surrounding conditions of moving body
US11914381B1 (en) Methods for communicating state, intent, and context of an autonomous vehicle
US7710243B2 (en) Driver-assistance vehicle
JP2012221487A (en) Ambient condition detection system of mobile body
WO2017073636A1 (en) Vehicular illumination device, vehicle system, and vehicle
US8599259B2 (en) Exterior mirror for vehicle
CN109204305B (en) Method for enriching the field of view, device for use in an observer vehicle and object, and motor vehicle
KR20200057865A (en) Apparatus and method for transmitting driving information of vehicle
JP2003291689A (en) Information display device for vehicle
CN112119398A (en) Method and device for operating a camera-monitor system of a motor vehicle
KR20190052741A (en) Sign device for safety line of crosswalk
JP2008195330A (en) Side mirror and warning device
CN111546980A (en) Automatic door alert and notification system
US20240109478A1 (en) Vehicle state-based light projection communication system
KR20240023896A (en) Electric two wheeled vehicle with driving information notification unction and driving information notification method thereof
KR20230008936A (en) Apparatus and method for commnicaion drivng codition of vehcle
WO2009099353A1 (en) Method for providing transportation means safety and a system for carrying out said method

Legal Events

Date Code Title Description
AS Assignment

Owner name: PIONEER CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KATO, MASAHIRO;REEL/FRAME:046771/0815

Effective date: 20131127

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: ADVISORY ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: ADVISORY ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION