US10864921B2 - Onboard apparatus - Google Patents

Onboard apparatus Download PDF

Info

Publication number
US10864921B2
US10864921B2 US16/675,580 US201916675580A US10864921B2 US 10864921 B2 US10864921 B2 US 10864921B2 US 201916675580 A US201916675580 A US 201916675580A US 10864921 B2 US10864921 B2 US 10864921B2
Authority
US
United States
Prior art keywords
display
vehicle
notification
time
ecu
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US16/675,580
Other languages
English (en)
Other versions
US20200164898A1 (en
Inventor
Naoyuki URUSHIZAKI
Kenta TAKENAKA
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honda Motor Co Ltd
Original Assignee
Honda Motor Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honda Motor Co Ltd filed Critical Honda Motor Co Ltd
Assigned to HONDA MOTOR CO., LTD. reassignment HONDA MOTOR CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: TAKENAKA, KENTA, URUSHIZAKI, Naoyuki
Publication of US20200164898A1 publication Critical patent/US20200164898A1/en
Application granted granted Critical
Publication of US10864921B2 publication Critical patent/US10864921B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/26—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view to the rear of the vehicle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/22—Display screens
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16—Type of output information
    • B60K2360/167—Vehicle dynamics information
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16—Type of output information
    • B60K2360/171—Vehicle or relevant part thereof displayed
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16—Type of output information
    • B60K2360/172—Driving mode indication
    • B60K2370/152—
    • B60K2370/167—
    • B60K2370/171—
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/60—Instruments characterised by their location or relative disposition in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/105—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using multiple cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/70—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by an event-triggered choice to display a specific image among a selection of captured images
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/802—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring and displaying vehicle exterior blind spot views
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8046—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for replacing a rear-view mirror system
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8066—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring rearward traffic
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/146—Display means

Definitions

  • the present invention relates to an onboard apparatus.
  • driving of the driver can be supported by the captured image.
  • the start of display of the captured image may be delayed as compared to the start of the engine because of the time needed for activation processing of an electronic device such as a camera. If the occupant is notified before the start of display of the captured image that the vehicle is in a startable state, support of the driver at the time of vehicle start is difficult.
  • an onboard apparatus comprising: an image capturing unit configured to capture a periphery of a vehicle; a display unit configured to display an image captured by the image capturing unit; and a notification unit configured to notify an occupant of information, wherein the notification unit is configured to notify the occupant that the vehicle is in a startable state on the condition that, at least, display of the captured image unit has been started by the display unit.
  • FIGS. 1A and 1B are a plan view and a side view of a vehicle including an onboard apparatus according to an embodiment of the present invention
  • FIG. 2 is a view showing the interior of the vehicle shown in FIGS. 1A and 1B ;
  • FIG. 3 is a block diagram of the onboard apparatus according to an embodiment of the present invention.
  • FIG. 4 is a flowchart showing an example of processing executed by the onboard apparatus shown in FIG. 3 ;
  • FIG. 5 is a flowchart showing an example of processing executed by the onboard apparatus shown in FIG. 3 ;
  • FIG. 6 is a timing chart showing an example of a notification to an occupant
  • FIG. 7 is a timing chart showing an example of a notification to an occupant
  • FIGS. 8A and 8B are views showing examples of setting of a threshold time
  • FIG. 9A is a timing chart showing an example of a notification to an occupant in a case of a fault of a display device.
  • FIG. 9B is a view showing an example of a notification.
  • FIGS. 1A and 1B are a plan view and a side view of a vehicle 1 as an application example of the present invention. Note that in the drawings, an arrow X indicates the longitudinal direction of the vehicle 1 , and an arrow Y indicates the vehicle width direction of the vehicle 1 . An arrow Z indicates the vertical direction.
  • the vehicle 1 is, for example, a sedan-type four-wheeled vehicle.
  • the vehicle 1 includes two seats in the front row adjacent to a windshield 5 , and two seats in the rear row.
  • the right seat in the front row is the driver's seat, and the left seat is the passenger seat.
  • the vehicle 1 includes a total of four doors adjacent to the seats.
  • a door 2 R is the door adjacent to the driver's seat, and is the right door on the front side.
  • a door 2 L is the door adjacent to the passenger seat, and is the left door on the front side.
  • a driving unit 6 is provided in the front part of the vehicle 1 .
  • the driving unit 6 includes a driving source that generates the driving force of the vehicle 1 .
  • the driving source is an engine (internal combustion engine).
  • the driving unit 6 includes an automatic transmission in addition to the engine.
  • the vehicle 1 includes image capturing devices 3 , 4 R, and 4 L configured to capture the periphery of the vehicle 1 .
  • Each of the image capturing devices 3 , 4 R, and 4 L is, for example, a camera including an image capturing element such as an image sensor and an optical system such as a lens.
  • the image capturing device 3 captures an image in an image capturing range F in front of the vehicle 1 .
  • An image captured by the image capturing device 3 is used to, for example, detect an obstacle in front of the vehicle 1 or recognize a road dividing line (for example, a white line).
  • the image capturing device 4 R is arranged in front of the door 2 R, and has an image capturing range RR in the rear on the right side of the vehicle 1 .
  • the image capturing device 4 L is arranged in front of the door 2 L, and has an image capturing range LR in the rear on the left side of the vehicle 1 .
  • the image capturing devices 4 R and 4 L are generically called image capturing devices 4 .
  • FIG. 2 is a view schematically showing the inside of the vehicle 1 , and is a view particularly showing the periphery of a dashboard DB.
  • a steering wheel W is provided in front of the driver's seat.
  • an instrument panel 8 is provided on the dashboard DB.
  • An ignition switch 10 is provided at the right end of the dashboard DB. The driver can instruct the engine start of the driving unit 6 by operating the ignition switch 10 .
  • a display device 11 configured to display map information or the like is provided at the center of the dashboard DB in the vehicle width direction, and a shift lever SL that accepts a shift operation for the automatic transmission is arranged near the display device 11 .
  • the instrument panel 8 includes a notification device 9 .
  • the notification device 9 is a device that notifies the occupant of various kinds of information, and is an image display device in this embodiment.
  • the notification device 9 may be a voice output device, or may be the combination of an image display device and a voice output device. In this embodiment, if the vehicle 1 is in a startable state, the notification device 9 notifies the occupant of it.
  • a display device 7 R is arranged at the right end of the dashboard DB, and a display device 7 L is arranged at the left end.
  • Each of the display devices 7 R and 7 L is an image display device, and is, for example, a liquid crystal display device.
  • An image captured by the image capturing device 4 R is displayed on the display device 7 R, and an image captured by the image capturing device 4 L is displayed on the display device 7 L.
  • the display devices 7 R and 7 L are generically called display devices 7 .
  • the vehicle 1 is a side-mirrorless vehicle.
  • the image capturing devices 4 and the display devices 7 are camera monitoring systems (CMS) provided to cause the occupant (in particular, the driver) to confirm the sides and the rear of the vehicle 1 in place of side mirrors (door mirrors).
  • CMS camera monitoring systems
  • the display devices 7 always display images captured by the image capturing devices 4 .
  • FIG. 3 is a block diagram showing an example of the arrangement of an onboard apparatus 20 of the vehicle 1 .
  • the onboard apparatus 20 is a unit configured to control each device in the vehicle 1 .
  • FIG. 3 shows only components needed in association with the feature of this embodiment to be described later.
  • the onboard apparatus 20 includes a control unit 21 .
  • the control unit 21 includes a plurality of ECUs (Electric Control Units) 22 to 26 .
  • the ECUs are connected to be communicable with each other via an in-vehicle network NT.
  • Each ECU includes a processor represented by a CPU, a storage device such as a semiconductor memory, an interface to an external device, and the like.
  • the storage device stores a program to be executed by the processor, data to be used by the processor for processing, and the like.
  • Each ECU may include a plurality of processors, storage devices, and interfaces. Note that the number of ECUs and the provided functions can appropriately be designed, and they can be subdivided or integrated as compared to this embodiment.
  • the ECU 22 controls the notification device 9 .
  • the ECU 23 controls the driving unit 6 .
  • the ECU 24 controls the image capturing devices 4 and the display devices 7 , thereby forming a camera monitoring system.
  • the ECU 25 accepts an occupant operation for an input device 12 .
  • the input device 12 includes, for example, the above-described ignition switch 10 and a remote controller or a door switch used for an unlock/lock operation of the doors.
  • the ECU 26 controls a sensor 13 and acquires a detection result. In relation to a description to be made later, the sensor 13 includes a temperature sensor configured to detect a temperature. Note that in FIG. 3 , the names of the representative functions of the ECUs 22 to 26 are given. For example, the ECU 22 is denoted by “notification ECU”.
  • FIG. 4 is a flowchart showing an example of notification processing executed by the ECU 22 .
  • the occupant is notified by the notification device 9 that the vehicle 1 is in a startable state.
  • this notification is executed based on an engine starting operation, that is, the operation of the ignition switch 10 .
  • step S 1 it is determined whether an operation (switch ON) on the ignition switch 10 is performed.
  • the operation on the ignition switch 10 is, for example, recognized by the ECU 25 and notified to each ECU. If an operation on the ignition switch 10 is performed, the process advances to step S 2 . If an operation is not performed, the process advances to step S 4 .
  • step S 2 it is determined whether notification conditions are satisfied. If the notification conditions are satisfied, the process advances to step S 3 . If the notification conditions are not satisfied, the process waits for satisfaction. If the notification conditions are not satisfied for a predetermined time, it may be determined that an abnormality has occurred, and a notification concerning the occurrence of the abnormality may be made.
  • step S 3 the notification device 9 notifies the occupant that the vehicle 1 is in a startable state.
  • FIG. 4 as an example of the notification, characters “READY!” are displayed on the notification device 9 . By this display, the occupant can recognize that the vehicle 1 can start. This display ends when, for example, the vehicle 1 starts.
  • step S 4 other processes are performed, and processing of one cycle ends.
  • the notification conditions in step S 2 will be described next.
  • One of the notification conditions is that the engine that forms the driving unit 6 is in an operable state and, more particularly, start completion.
  • the start of the vehicle 1 is premised on the start of the engine.
  • the ECU 23 notifies the ECU 22 of it (transmits a completion notification).
  • Another notification condition is that display of images captured has been started on the display devices 7 by the image capturing devices 4 .
  • the vehicle 1 according to this embodiment is a side-mirrorless vehicle, and the driver who is facing the front of the vehicle 1 can confirm the sides and the rear of the vehicle 1 on the display devices 7 . Even if the display on the display devices 7 is not started, the start of the vehicle 1 itself is possible. However, in a state in which the captured images of the sides and the rear of the vehicle 1 are not displayed on the display devices 7 , driving support for the driver is not sufficient. Hence, in this embodiment, the start of display on the display devices 7 is set as one of the notification conditions.
  • the other notification conditions are, for example, wearing of the seatbelt by the driver, and operation preparation completion of another component (for example, the automatic transmission) of the driving unit 6 .
  • FIG. 5 is a flowchart showing an example of processing of the ECU 24 in association with this notification.
  • the processing shown in FIG. 5 is started based on the start of use of the vehicle 1 and repetitively executed until the end of use of the vehicle 1 .
  • the start of use is door unlock from the outside of the vehicle by the occupant
  • the end of use is door lock from the outside of the vehicle by the occupant.
  • the lock operation and the unlock operation of the door by the occupant are recognized by the ECU 25 and notified to each ECU.
  • step S 11 initial processing is executed.
  • the initial processing is activation processing of the CMS system, and predetermined processes such as various kinds of initial settings concerning the image capturing devices 4 and the display devices 7 are executed.
  • step S 12 images captured by the image capturing devices 4 are displayed on the display devices 7 .
  • step S 16 images captured by the image capturing devices 4 are displayed on the display devices 7 .
  • steps S 13 to S 15 are executed in parallel to the processes of steps S 11 and S 12 .
  • the processes of steps S 13 to S 15 are processes for notifying the ECU 22 of the start of display.
  • a predetermined time is necessary after the ECU 24 performs the process of step S 11 until display on the display devices 7 is started.
  • a sensor configured to detect the start of display on the display devices 7 may be provided to specify the start of display on the display devices 7 . However, when the sensor is provided, the cost increases.
  • the elapse of a time (to be referred to as a threshold time hereinafter) needed for the display devices 7 to change from a non-display state to a display state is counted, and it is determined that the display devices 7 have started display based on the elapse of the threshold time.
  • a time in which display is reliably started is set based on the activation time (mainly a time needed for the initial processing (step S 11 )) of the ECU 24 , the activation time of the image capturing devices 4 , and the activation time of the display devices 7 (mainly a time needed for the operation of hardware until display stabilizes).
  • the activation time of the ECU 24 is the execution time of the program and can therefore be specified relatively easily.
  • the activation time of the display devices 7 sometimes depends on the temperature. For example, if a liquid crystal display device is employed, a time tends to be needed to stabilize display at a low temperature than at a high temperature.
  • FIGS. 8A and 8B schematically show examples of the relationship between the temperature and the threshold time.
  • a solid line represents an example of the activation time of the ECU 24 and that of the display devices 7 until the start of the display, and a broken line represents an example of the threshold time.
  • FIG. 8A shows an example of a fixed threshold time uniformly determined independently of the temperature.
  • a time longer than the activation time at a low temperature, which is the longest activation time is set to the threshold time, thereby notifying the ECU 22 of the start of display after the display devices 7 have reliably started display.
  • the threshold time can be obtained by, for example, experiments.
  • FIG. 8B shows an example of the threshold time that is changed in accordance with the temperature.
  • a time longer than the activation time that varies in accordance with the temperature is set to the threshold time, thereby notifying the ECU 22 of the start of display after the display devices 7 have reliably started display.
  • the relationship between the temperature and the threshold time can be obtained by, for example, experiments and stored in a storage device provided in the ECU 24 .
  • the threshold time can be set by acquiring the information of the current temperature.
  • the information of the current temperature can be obtained from the temperature sensor included in the sensor 13 .
  • the information of the temperature can be obtained by communication from a server that provides weather information.
  • threshold time setting processing is unnecessary, and the processing can be simplified. However, if the temperature is higher, the threshold time is unnecessarily long. In an example in which the threshold time is changed in accordance with the temperature, like the example shown in FIG. 8B , although the processing is more complex than in the example of FIG. 8A , a shorter threshold time can be set in accordance with the temperature.
  • step S 13 counting is started.
  • step S 14 it is determined whether the time from the start of counting in step S 13 exceeds the threshold time. If the time exceeds the threshold time, the process advances to step S 15 . If the time does not exceed the threshold time, the process waits for the elapse.
  • step S 15 the ECU 22 is notified of the start of display. This notification is a determination factor of notification condition satisfaction of step S 2 in FIG. 4 by the ECU 22 . After that, the process advances to step S 16 .
  • images captured by the image capturing devices 4 are always displayed on the display devices 7 .
  • the necessity of displaying the images of the sides and the rear on the display devices 7 is low although the vehicle 1 is used, like a case in which the vehicle 1 with the occupant on board stops the engine and stops for a long time.
  • the CMS system is stopped in such a case to suppress power consumption.
  • step S 16 it is determined whether a display end condition is satisfied.
  • the display end condition is, for example, that a state in which the vehicle 1 with the occupant on board stops the engine and stops continues for a predetermined time (for example, 5 to 10 min) or more. If the display end condition is satisfied, the process advances to step S 17 . If the display end condition is not satisfied, the display state is maintained.
  • step S 17 the ECU 22 is notified that the display of images captured by the image capturing devices 4 on the display devices 7 is to be ended. In addition, the image capturing devices 4 and the display devices 7 are shut down.
  • the ECU 24 changes to substantially the same state as that in starting the processing in FIG. 5 . In this state, if a resumption instruction (step S 18 ) is received, the processes of steps S 11 and S 13 that are the process at the start of processing are executed.
  • the resumption instruction indicates a case in which an operation (switch ON) on the ignition switch 10 is performed, and the ECU 25 makes a notification of it. As the situation, after the vehicle 1 with the occupant on board stops the engine and stops for a long time, the engine starting operation is performed.
  • FIGS. 6 and 7 are timing charts showing examples of an notification condition satisfaction pattern until the notification device 9 displays “READY!” in step S 3 in different situations of the vehicle 1 .
  • FIG. 6 shows a case in which the notification device 9 displays “READY!” based on the start of use of the vehicle 1 (door unlock from the outside of the vehicle), and shows the satisfaction timings of notification conditions including the start of the engine and the start of display on the display devices 7 .
  • “Start” indicates the use start timing of the vehicle 1 .
  • the ECU 23 does not start the engine.
  • the ECU 24 starts the processing shown in FIG. 5 , and after the elapse of a time T 2 corresponding to the threshold time, notifies the ECU 22 of the start of display.
  • the time T 2 is, for example, several sec.
  • “IG ON” indicates a timing at which the operation (switch ON) on the ignition switch 10 is performed.
  • the ECU 23 starts the engine, and after the elapse of a time T 1 corresponding to the actual time until start completion, notifies the ECU 22 of the start completion.
  • the time T 1 is, for example, several sec.
  • two conditions that is, the engine start completion and the start of display on the display devices 7 are the notification conditions.
  • the notification conditions are satisfied by the engine start notification, and the ECU 22 causes the notification device 9 to display “READY!” in step S 3 .
  • FIG. 7 shows a case in which the vehicle 1 with the occupant on board stops the engine and stops for a long time, and after that, the notification device 9 displays “READY!” based on an engine start instruction. This case corresponds to the situation of step S 18 in FIG. 5 .
  • IG ON indicates a timing at which the operation (switch ON) on the ignition switch 10 is performed.
  • the ECU 23 starts the engine, and after the elapse of the time T 1 corresponding to the actual time until start completion, notifies the ECU 22 of the start completion. Additionally, at this stage, the ECU 24 also starts processing, and after the elapse of the time T 2 corresponding to the threshold time, notifies the ECU 22 of the start of display.
  • time T 2 >time T 1 .
  • two conditions that is, the engine start completion and the start of display on the display devices 7 are the notification conditions.
  • the notification conditions are satisfied by the display start notification of the display devices 7 , and the ECU 22 causes the notification device 9 to display “READY!” in step S 3 .
  • the start of the vehicle 1 itself is enabled by starting the engine, “READY!” is not displayed at this point of time. “READY!” is displayed after the start of display on the display devices 7 .
  • FIGS. 9A and 9B show examples.
  • FIG. 9A is a timing chart showing an example of an notification condition satisfaction pattern until the notification device 9 displays “READY!” in step S 3 .
  • FIG. 7 the example of FIG.
  • FIG. 9A shows a case in which the vehicle 1 with the occupant on board stops the engine and stops for a long time, and after that, the notification device 9 displays “READY!” based on an engine start instruction. This also applies to a case in which “READY!” is displayed based on the start of use of the vehicle 1 , like FIG. 6 .
  • FIG. 9B shows an example of a notification by the notification device 9 .
  • IG ON indicates a timing at which the operation (switch ON) on the ignition switch 10 is performed.
  • the ECU 23 starts the engine, and after the elapse of the time T 1 corresponding to the actual time until start completion, notifies the ECU 22 of the start completion.
  • the ECU 24 also starts processing, and determines a fault in the constituent elements of the CMS system such as the image capturing devices 4 and the display devices 7 in the initial processing (step S 11 ). The fault determination can be performed based on, for example, the presence/absence of a response to a response request signal. If it is determined a fault exists, the ECU 24 transmits a fault notification to the ECU 22 .
  • the notification conditions are satisfied by the engine start notification by the fault notification from the ECU 24 , and the ECU 22 causes the notification device 9 to display “READY!” in step S 3 . Additionally, in this case, it is also notified that a fault has occurred in the CMS system.
  • the notification device 9 displays “a side monitor has a fault” and notifies the occupant that the captured images of the sides and the rear are not displayed on the display devices 7 because of the fault. This can urge the occupant to repair the CMS system.
  • An image captured by the image capturing device 3 can also be displayed on, for example, the display device 11 .
  • the notification conditions to cause the notification device 9 to notify that the vehicle 1 is in the startable state do not include a condition concerning the activation of the image capturing device 3 . This is because the image captured by the image capturing device 3 is not assumed to be an image to be always displayed in this embodiment, and because the image capturing range F of the image capturing device 3 can visually be recognized by the driver through the windshield 5 .
  • the notification conditions need not include activation of all of the image capturing devices and the display devices for captured images, and may include only activation of predetermined image capturing devices and display devices such as a component that always displays a captured image during traveling, as in the above-described embodiment.
  • predetermined image capturing devices and display devices such as a component that always displays a captured image during traveling, as in the above-described embodiment.
  • a form in which activation of all of the image capturing devices and the display devices for captured images is included can also be employed.
  • the driving source provided in the driving unit 6 an internal combustion engine has been exemplified.
  • another driving source such as an electric motor may be employed.
  • the driving source may be formed by a combination of a plurality of devices like a combination of an internal combustion engine and an electric motor. If the driving source includes an electric motor, a notification condition representing that the electric motor is in an operable state can be, for example, a state in which the driving circuit of the electric motor is activated.
  • the above-described embodiment discloses at least the following onboard apparatus.
  • an onboard apparatus comprising:
  • an image capturing unit (for example, 4) configured to capture a periphery of a vehicle (for example, 1);
  • a display unit (for example, 7) configured to display an image captured by the image capturing unit
  • a notification unit (for example, 9) configured to notify an occupant of information
  • the notification unit notifies the occupant that the vehicle is in a startable state on the condition that, at least, display of the captured image has been started by the display unit (for example, FIGS. 6 and 7 ).
  • the notification unit notifies the occupant that the vehicle is in the startable state on the condition that, at least: a driving source that generates a driving force of the vehicle is in an operable state; and display of the captured image has been started by the display unit (for example, FIGS. 6 and 7 ).
  • the start of display of the captured image by the display unit is determined based on an elapse of a time (for example, a threshold time) needed for the display unit to change from a non-display state to a display state.
  • a time for example, a threshold time
  • a sensor configured to detect the start of display need not be provided, and the start of display can be determined at a lower cost.
  • the time is a time uniformly determined independently of a temperature (for example, FIG. 8A ).
  • the time is a time that is changed in accordance with a temperature (for example, FIG. 8B ).
  • the notification unit notifies the occupant that the vehicle is in the startable state even if display of the captured image has not been started by the display unit (for example, FIG. 9A ).
  • the image capturing unit captures a side and a rear of the vehicle (for example, RR, LR), and
  • the vehicle is a side-mirrorless vehicle.

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Transportation (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Multimedia (AREA)
  • Automation & Control Theory (AREA)
  • Human Computer Interaction (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
  • Instrument Panels (AREA)
  • Closed-Circuit Television Systems (AREA)
US16/675,580 2018-11-26 2019-11-06 Onboard apparatus Active US10864921B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018220581A JP7011568B2 (ja) 2018-11-26 2018-11-26 車載装置
JP2018-220581 2018-11-26

Publications (2)

Publication Number Publication Date
US20200164898A1 US20200164898A1 (en) 2020-05-28
US10864921B2 true US10864921B2 (en) 2020-12-15

Family

ID=70770503

Family Applications (1)

Application Number Title Priority Date Filing Date
US16/675,580 Active US10864921B2 (en) 2018-11-26 2019-11-06 Onboard apparatus

Country Status (3)

Country Link
US (1) US10864921B2 (zh)
JP (1) JP7011568B2 (zh)
CN (1) CN111216634B (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7022044B2 (ja) * 2018-10-12 2022-02-17 本田技研工業株式会社 後方視認装置
KR20220055541A (ko) * 2020-10-26 2022-05-04 현대자동차주식회사 차량 및 그 제어방법

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5646612A (en) * 1995-02-09 1997-07-08 Daewoo Electronics Co., Ltd. Method for avoiding collision of vehicle and apparatus for performing the same
US20020135469A1 (en) * 2001-02-23 2002-09-26 Toru Nakamura Apparatus for controlling vehicle transmission
US7468933B2 (en) * 2006-04-11 2008-12-23 Denso Corproation Collision detection device
US7586400B2 (en) * 2006-01-16 2009-09-08 Honda Motor Co., Ltd. Vehicle surroundings monitoring apparatus
US7667581B2 (en) * 2006-05-24 2010-02-23 Nissan Motor Co., Ltd. Pedestrian detector and detecting method using change of velocity of object in image
US20100097202A1 (en) * 2008-07-30 2010-04-22 Fujitsu Ten Limited Eco-drive assist apparatus and method
US8082101B2 (en) * 2004-04-08 2011-12-20 Mobileye Technologies Ltd. Collision warning system
US20120113261A1 (en) * 2009-07-13 2012-05-10 Noriyuki Satoh Blind-spot image display system for vehicle, and blind-spot image display method for vehicle
US8199046B2 (en) * 2006-06-30 2012-06-12 Toyota Jidosha Kabushiki Kaisha Radar system to determine whether an object is subject of detection based on intensity of a radio wave emission of the object
US20120162427A1 (en) * 2010-12-22 2012-06-28 Magna Mirrors Of America, Inc. Vision display system for vehicle
WO2012127677A1 (ja) 2011-03-24 2012-09-27 トヨタ自動車株式会社 車両および車両用制御方法
US20160188004A1 (en) * 2013-08-09 2016-06-30 Daimler Ag Method and Device for the Compressed Transfer of Signals of an Operating Element Having Movement Coordinates in a Vehicle
US20170096102A1 (en) * 2015-10-01 2017-04-06 Ford Global Technologies, Llc Parking Obstruction Locator and Height Estimator
US20170343799A1 (en) * 2016-05-30 2017-11-30 Mazda Motor Corporation Display apparatus for vehicle
US20180093567A1 (en) * 2015-04-01 2018-04-05 Denso Corporation Head-up display device

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4100026B2 (ja) * 2002-04-11 2008-06-11 三菱自動車工業株式会社 発進支援装置
JP4211562B2 (ja) * 2003-10-10 2009-01-21 株式会社デンソー 車両用周辺監視装置
JP2010074260A (ja) * 2008-09-16 2010-04-02 Honda Motor Co Ltd 車両周囲監視装置
US9131123B2 (en) * 2010-03-19 2015-09-08 Panasonic Intellectual Property Management Co., Ltd. Device for monitoring surroundings of vehicle and method for monitoring surroundings of vehicle
CN106794800A (zh) * 2015-02-02 2017-05-31 松下知识产权经营株式会社 电子镜装置和使用其的电子镜系统
JP6197814B2 (ja) * 2015-03-18 2017-09-20 マツダ株式会社 車両用表示装置
JP2018047833A (ja) * 2016-09-23 2018-03-29 トヨタ自動車株式会社 車両周辺撮影表示装置及び車両周辺撮影表示プログラム
JP2018099944A (ja) * 2016-12-19 2018-06-28 株式会社東海理化電機製作所 車両用表示装置

Patent Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5646612A (en) * 1995-02-09 1997-07-08 Daewoo Electronics Co., Ltd. Method for avoiding collision of vehicle and apparatus for performing the same
US20020135469A1 (en) * 2001-02-23 2002-09-26 Toru Nakamura Apparatus for controlling vehicle transmission
US8082101B2 (en) * 2004-04-08 2011-12-20 Mobileye Technologies Ltd. Collision warning system
US7586400B2 (en) * 2006-01-16 2009-09-08 Honda Motor Co., Ltd. Vehicle surroundings monitoring apparatus
US7468933B2 (en) * 2006-04-11 2008-12-23 Denso Corproation Collision detection device
US7667581B2 (en) * 2006-05-24 2010-02-23 Nissan Motor Co., Ltd. Pedestrian detector and detecting method using change of velocity of object in image
US8199046B2 (en) * 2006-06-30 2012-06-12 Toyota Jidosha Kabushiki Kaisha Radar system to determine whether an object is subject of detection based on intensity of a radio wave emission of the object
US20100097202A1 (en) * 2008-07-30 2010-04-22 Fujitsu Ten Limited Eco-drive assist apparatus and method
US20120113261A1 (en) * 2009-07-13 2012-05-10 Noriyuki Satoh Blind-spot image display system for vehicle, and blind-spot image display method for vehicle
US20120162427A1 (en) * 2010-12-22 2012-06-28 Magna Mirrors Of America, Inc. Vision display system for vehicle
WO2012127677A1 (ja) 2011-03-24 2012-09-27 トヨタ自動車株式会社 車両および車両用制御方法
US20140002256A1 (en) 2011-03-24 2014-01-02 Toyota Jidosha Kabushki Kaisha Vehicle and control method for vehicle
US20160188004A1 (en) * 2013-08-09 2016-06-30 Daimler Ag Method and Device for the Compressed Transfer of Signals of an Operating Element Having Movement Coordinates in a Vehicle
US20180093567A1 (en) * 2015-04-01 2018-04-05 Denso Corporation Head-up display device
US20170096102A1 (en) * 2015-10-01 2017-04-06 Ford Global Technologies, Llc Parking Obstruction Locator and Height Estimator
US20170343799A1 (en) * 2016-05-30 2017-11-30 Mazda Motor Corporation Display apparatus for vehicle

Also Published As

Publication number Publication date
CN111216634A (zh) 2020-06-02
JP2020083067A (ja) 2020-06-04
CN111216634B (zh) 2023-04-18
JP7011568B2 (ja) 2022-01-26
US20200164898A1 (en) 2020-05-28

Similar Documents

Publication Publication Date Title
US10346715B2 (en) Camera misalignment determination methods and systems
US20200231104A1 (en) In-vehicle device
US10864921B2 (en) Onboard apparatus
WO2020250525A1 (ja) 車両用情報表示装置
JP4244684B2 (ja) 車両用監視装置
US20170050569A1 (en) In-vehicle display apparatus, control method for controlling same, and non-transitory computer readable medium recording program
EP3547021A1 (en) Image pickup device, display system, and display method
KR20190046579A (ko) 다중 카메라 제어 시스템 및 다중 카메라 영상 출력 제어 방법
CN113071503A (zh) 警告车辆乘员重新开始车辆操作的系统和方法
US20180077330A1 (en) Vehicular visual recognition device
US20200290514A1 (en) Driving assistance device, vehicle, and vehicle control device
CN111347998B (zh) 移动体用拍摄系统
CN111263944A (zh) 包括使用至少一个车辆摄像机以在起步之前检查车辆的某些元件是否处于安全状况中的方法
CN113386666B (zh) 车辆控制装置、车辆以及它们的控制方法
JP2016164010A (ja) 車載カメラシステム
EP4113973A1 (en) Vehicular recording control device and recording control method
JP2021111152A (ja) 車両制御システム
US10023121B1 (en) Rear vision camera switching
US20230382414A1 (en) Cleaning notification device, cleaning notification method, and non-transitory recording medium in which cleaning notification program is recorded
WO2023047704A1 (ja) 情報提示装置、および方法
JP2024094708A (ja) 運転者監視システム
JP2010208590A (ja) 表示装置及び車載表示システム
JP2022099157A (ja) 脇見判定装置および脇見判定方法
JP2022135889A (ja) 車両用記録制御装置および記録制御方法
CN112622797A (zh) 一种倒车影像控制系统及方法

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

AS Assignment

Owner name: HONDA MOTOR CO., LTD., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:URUSHIZAKI, NAOYUKI;TAKENAKA, KENTA;REEL/FRAME:051163/0546

Effective date: 20191007

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4