EP4100927A1 - Véhicule à caméra(s) d'analyse stockant des groupes d'images en présence d'évènements détectés - Google Patents

Véhicule à caméra(s) d'analyse stockant des groupes d'images en présence d'évènements détectés

Info

Publication number
EP4100927A1
EP4100927A1 EP21704600.2A EP21704600A EP4100927A1 EP 4100927 A1 EP4100927 A1 EP 4100927A1 EP 21704600 A EP21704600 A EP 21704600A EP 4100927 A1 EP4100927 A1 EP 4100927A1
Authority
EP
European Patent Office
Prior art keywords
images
event
memory
microcontroller
type
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP21704600.2A
Other languages
German (de)
English (en)
French (fr)
Inventor
Julien LAMPERIERE
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Stellantis Auto SAS
Original Assignee
PSA Automobiles SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by PSA Automobiles SA filed Critical PSA Automobiles SA
Publication of EP4100927A1 publication Critical patent/EP4100927A1/fr
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C5/00Registering or indicating the working of vehicles
    • G07C5/08Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
    • G07C5/0841Registering performance data
    • G07C5/085Registering performance data using electronic data carriers
    • G07C5/0866Registering performance data using electronic data carriers the electronic data carrier being a digital video recorder in combination with video camera
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C2205/00Indexing scheme relating to group G07C5/00
    • G07C2205/02Indexing scheme relating to group G07C5/00 using a vehicle scan tool

Definitions

  • TITLE ANALYSIS CAMERA (S) VEHICLE STORING GROUPS OF IMAGES IN THE PRESENCE OF DETECTED EVENTS
  • the invention relates to vehicles comprising at least one analysis camera acquiring and analyzing images in their environment, and more precisely the recording of image (s) associated with an event.
  • Some vehicles include at least one electronic device generating an alert message upon detection of an event and at least one scanning camera acquiring and analyzing images in their surroundings.
  • the analysis camera includes a microcontroller having a memory in which it stores the last image acquired when it detects an abnormal and potentially dangerous event for the vehicle and / or its passengers.
  • This event detection is carried out by analyzing the image (s) acquired generally as a function of values taken by parameters or operating variables of the vehicle. For example, an analysis camera can detect events such as a risk of collision or the need for emergency braking.
  • the image stored for an event detected by the analysis camera can then be retrieved by external electronic equipment (temporarily connected to the vehicle's diagnostic socket) so that a person analyzes the situation they represent in order to try to understand the reason why the corresponding event occurred.
  • This understanding can be particularly useful in the event of an accident or when testing a vehicle with at least partially automated (or autonomous) driving in a real situation.
  • the mode of operation described above has several drawbacks. Indeed, it only allows the analysis of a single image acquired by a camera on-board analysis, and again on condition that the event at the origin of its storage has been detected by this analysis camera, which only constitutes a snapshot of the situation in the part of the environment observed and therefore does not make it possible to form an opinion on the evolution of this situation. In addition, it only makes it possible to know the situation at the time of detection of the event by the analysis camera, which very often proves insufficient to understand the reason why this event occurred. In addition, a recording can only be made on a single internal event detected by the camera and not an event external to the latter (information coming from a vehicle computer via an internal (or on-board) communication network).
  • One aim of the invention is therefore to improve the situation.
  • a vehicle comprising at least one electronic device coupled to an internal communication network and generating an alert message in the event of detection of a first event associated with a type, and at least one analysis camera.
  • the first microcontroller systematically stores in the first memory the last N images acquired, with N> 2, and in the presence of a first or second event transfers into the second memory the last N images stored and M images acquired after the latter , with M> 1, so that they are stored with their respective associated types.
  • the vehicle according to the invention may have other characteristics which can be taken separately or in combination, and in particular:
  • - N can be between three and ten
  • - M can be between two and five;
  • the first microcontroller can be arranged to transfer the images associated with a type of event to a location dedicated to this type of event in the second memory;
  • the first microcontroller can be arranged, when a location dedicated to a type of event in the second memory is full and new images must be transferred to this location, to delete in the latter images having the oldest date of storage, then to transfer these new images to this location in the second memory;
  • the second microcontroller can be arranged, in the event of receipt of a request requesting images stored in the second memory, to retrieve these required images in order to transfer them to the internal communication network;
  • the second microcontroller can be arranged to retrieve in the second memory stored images associated with a type of event designated in the received request;
  • the first microcontroller can be arranged to store in the second memory images associated with a type of event and with an identifier representative of their temporal classification with respect to events of the same type.
  • the second microcontroller can be arranged to retrieve in the second memory stored images associated with an identifier designated in the request received for a type of event also designated in the request received;
  • the second microcontroller can comprise a third memory in which it stores data defining first events and second events, and sets of values taken by parameters or operating variables of the vehicle respectively during the first and second events, in correspondence of 'at least one type of event;
  • the second microcontroller can be arranged, when it receives a request requesting images stored in the second memory, to associate these requested images with the corresponding data and / or sets of values stored in the third memory;
  • FIG. 1 illustrates schematically and functionally a vehicle according to the invention, comprising two electronic devices and an analysis camera coupled to an internal communication network.
  • the object of the invention is in particular to provide a vehicle V comprising at least one electronic device Ej coupled to an internal communication network RC and generating an alert message in the event of detection of an event, and at least one camera.
  • CA analysis acquiring and analyzing images in its environment and being able to store several of these images in the presence of an event.
  • the vehicle V is of the automobile type. This is for example a car, as illustrated without limitation in Figure 1. But the invention is not limited to this type of vehicle. It concerns any type of vehicle that can transport at least one person and that can be the subject of maintenance operations in after-sales services. Thus, it concerns at least all land vehicles (and in particular motor vehicles, utility vehicles, camper vans, motorcycles, minibuses, coaches, trucks, road vehicles, construction machinery and machinery. agricultural), boats and aircraft (especially flying taxis).
  • the vehicle V is at least partially automated (or autonomous). It can therefore be driven at least partially automatically during an automated driving phase, as well as possibly manually during a manual driving phase.
  • automated (or autonomous) driving phase is understood here to mean a phase during which the driver of the vehicle V does not intervene, the driving being entirely controlled by an on-board driving assistance (or aid) device, and by “manual driving phase” a phase during which the driver of the vehicle V intervenes at least on the steering wheel and / or the pedals (or levers). But vehicle V could be purely manual (with possible driving assistance).
  • FIG. 1 An embodiment of a vehicle V comprising two electronic equipment Ej and an analysis camera CA coupled to an internal communication network RC.
  • the invention can be implemented as soon as the vehicle V comprises at least one electronic device Ej and at least one camera AC analysis coupled to the RC internal communication network.
  • This internal communication network RC can, for example, be multiplexed. In this case, it may be, for example, a CAN ("Controller Area Network"), or LIN ("Local Interconnect Network”) type network, or FLEXRAY, or even Ethernet.
  • CAN Controller Area Network
  • LIN Local Interconnect Network
  • Each electronic device Ej is arranged so as to generate an alert message in the event of detection of a first event associated with a type (event).
  • an electronic device Ej can provide at least one driving assistance function such as speed regulation, or speed adaptation to cross a bend, or braking control, or trajectory control, or inter-vehicle distance control, or seat belt control (s), or collision detection, or even centering control in a traffic lane.
  • the events can be, for example, automatic braking (possibly emergency), or pre-tensioning of at least one seat belt strap, or pre-loading of the braking system, or refocusing. in a traffic lane, or an automatic course correction, or an automatic speed reduction, or a significant speed reduction in a short period of time, or even the triggering of an air bag protection device (or "airbag ").
  • the first electronic equipment item E1 can be a trajectory control device
  • the second electronic equipment item E2 can be a device for monitoring the safety of the vehicle V
  • the third electronic equipment item E3 can be a radar before (analyzing the environment in front of the vehicle V).
  • the (each) analysis camera CA is arranged to acquire and analyze images in at least part of the external environment of the vehicle V (for example a front or rear or side part).
  • the (each) CA analysis camera includes first C1 and second C2 microcontrollers coupled together, and first M1 and second M2 memories.
  • Each of the first C1 and second C2 microcontrollers comprises at least one processor and at least one random access memory.
  • the processor can be a digital signal processor (or DSP (“Digital Signal Processor”)).
  • DSP Digital Signal Processor
  • This processor can include integrated circuits (or printed), or several integrated circuits (or printed) connected by wired or wireless connections.
  • integrated circuit or printed circuit is meant any type of device capable of performing at least one electrical or electronic operation.
  • RAM is responsible for storing instructions for the processor to perform operations.
  • Each of the first C1 and second C2 microcontrollers can also include, according to its functional needs, a mass memory, in particular for the storage of intermediate data involved in all its calculations and processing, and / or an input interface for the reception of messages.
  • the second microcontroller C2 is coupled to the internal communication network RC and is arranged so as to transmit to the first microcontroller C1 each alert message generated by electronic equipment Ej following the detection of a first event, containing data defining this first event, and circulating on the internal communication network RC.
  • the first microcontroller C1 is arranged so as to detect a second event associated with a type (of event) by analysis of each image acquired by its analysis camera CA as a function of values taken by parameters or operating variables of the vehicle V .
  • the CA analysis camera can detect second events such as a risk of collision, a need to refill the braking system for preparation for braking (refill), or a need for automatic emergency braking.
  • the first microcontroller C1 comprises a first memory M1 in which it systematically stores the last N images acquired by its analysis camera CA, with N> 2.
  • the first microcontroller C1 is arranged so as to transfer into the second memory M2, in the presence of a first or second event (as well as possibly when the vehicle V is switched off), the N last images stored in the first memory M1 and M images acquired after these N last images, with M > 1, so that they are stored with their respective associated types.
  • the first microcontroller C1 knows that a first or second event has been detected (or possibly when the internal (or onboard) communication networks of the vehicle V have fallen asleep), it immediately transfers to the second memory M2 the last N images stored in the first memory M1, then waits for having stored M new subsequent images in the latter (M1), in place of at least part of these N last images, in order to transfer them to the second memory M2.
  • the second memory M2 therefore stores at least one group of N + M images associated with the same type of event.
  • At least a group of N + M images representative of the evolution of the situation in a part of the external environment of the vehicle V before, during and after the occurrence of an event are available for a subsequent analysis. This makes it much easier to analyze the situation and understand why the event happened.
  • the number N can be between three and ten, especially when the CA scan camera acquires one image per second. Thus, it can, for example, be equal to three. But a number N greater than ten is possible.
  • the number M can be between two and five, especially when the analysis camera CA acquires one image per second. Thus, it can, for example, be equal to two. But a number M greater than five is possible.
  • the first memory M1 can be a random access memory RAM type (“Random Access Memory”).
  • the second memory M2 can be a flash memory.
  • the vehicle V can include a diagnostic socket PD coupled to the internal communication network RC and to which an external electronic device EC can be coupled responsible for recovering images stored in the second memory M2 of a CA analysis camera with a view to their analysis intended to understand the corresponding event.
  • the coupling between the external electronic equipment EC and the internal communication network RC could be done by means of waves (not wired), and for example by WiFi.
  • the first microcontroller C1 can be arranged to transfer the images associated with a type of event to a location which is dedicated to this type of event in the second memory M2. This option is intended to facilitate the retrieval of images stored in the second memory M2 by the external electronic equipment EC.
  • the first microcontroller C1 can be arranged, when a location dedicated to a type of event in the second memory M2 is full and new images must be transferred to this location, in order to delete in the latter. images with the oldest storage date, then to transfer these new images to this location of the second memory M2.
  • This sub-option is intended to favor the most recent images of an event type. It also makes it possible to increase the probability, when a user comes to an after-sales service a little after the occurrence of an abnormal event, that images relating to this event are still stored in the second memory M2 and therefore can be stored. analyzed.
  • the first microcontroller C1 can be arranged to store images associated with this type of event and with an identifier which is representative of the temporal classification of these images in relation to events of the same type.
  • the first microcontroller C1 can associate with the images corresponding to an event of a certain type an identifier equal to 1 for the first detection of this type of event, then the first microcontroller C1 can associate with the images corresponding to the next event of the same type an identifier equal to 2 for the second detection of this type of event, then the first microcontroller C1 can associate with the images corresponding to the next event of the same type an identifier equal to 3 for the third detection of this type of event, and so on up to a maximum identifier value.
  • the number of identifiers associated with the same type of event can take any value. For example, it can be between five and fifteen. Thus, it can, for example, be equal to ten. The number of identifiers may possibly vary from one type of event to another type of event.
  • the second microcontroller C2 can be arranged, in the event of receipt of a request requesting images stored in the second memory M2, to recover these images required in order to transfer them to the internal communication network RC.
  • the second microcontroller C2 transmits a request intended to obtain designated images stored in the second memory M2, then once these images have been obtained, it transmits them to the sender of the request (for example the external electronic equipment EC ) via the internal RC communication network.
  • the request can request all the images stored in the second memory M2 of an analysis camera CA.
  • the second microcontroller C2 can be arranged to recover in the second memory M2 specifically stored images associated with a type of event designated in the received request.
  • the first microcontroller C1 associates identifiers respectively with successive groups of N + M images of the same type of event that it stores in a possible dedicated location of the second memory M2
  • the second microcontroller C2 can be arranged to recover in the second memory M2 images which are stored by being associated with an identifier designated in the request received for a type of event also designated in this request received.
  • the second microcontroller C2 can comprise a third memory M3 in which it stores data defining first events (detected by electronic equipment Ej) and second events (detected by the first microcontroller C1), and sets of values taken by parameters or operating variables of the vehicle V respectively during the first and second events. It will be understood that the second microcontroller C2 recovers from the internal communication network RC these data (of the first events) and these sets of values when a first or second event occurs. It will also be understood that the second microcontroller C2 stores these data and these sets of values corresponding to at least one type of event as well as possibly an identifier representative of the temporal classification of the event with respect to events of the same type. .
  • the second microcontroller C2 can, when it receives a request requesting images, associate with these requested images the corresponding data and / or sets of values (and therefore associated with the same type of event and possibly the same identifier), before transmitting them to the sender of the request (for example the external electronic equipment EC) via the internal communication network RC.
  • the third memory M3 can be a rewritable read-only memory of the EEPROM type (“Electrically-Erasable Programmable Read-Only Memory” - electrically erasable and programmable read-only memory).
  • EEPROM Electrically-Erasable Programmable Read-Only Memory

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Traffic Control Systems (AREA)
  • Closed-Circuit Television Systems (AREA)
EP21704600.2A 2020-02-03 2021-01-06 Véhicule à caméra(s) d'analyse stockant des groupes d'images en présence d'évènements détectés Pending EP4100927A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR2001043A FR3106919B1 (fr) 2020-02-03 2020-02-03 Véhicule à caméra(s) d’analyse stockant des groupes d’images en présence d’évènements détectés
PCT/FR2021/050011 WO2021156552A1 (fr) 2020-02-03 2021-01-06 Véhicule à caméra(s) d'analyse stockant des groupes d'images en présence d'évènements détectés

Publications (1)

Publication Number Publication Date
EP4100927A1 true EP4100927A1 (fr) 2022-12-14

Family

ID=70978074

Family Applications (1)

Application Number Title Priority Date Filing Date
EP21704600.2A Pending EP4100927A1 (fr) 2020-02-03 2021-01-06 Véhicule à caméra(s) d'analyse stockant des groupes d'images en présence d'évènements détectés

Country Status (4)

Country Link
EP (1) EP4100927A1 (zh)
CN (1) CN115053271B (zh)
FR (1) FR3106919B1 (zh)
WO (1) WO2021156552A1 (zh)

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2823048B1 (fr) * 2001-03-30 2003-07-04 Claude Bendavid Dispositif pour la memorisation d'une sequence visuelle a la suite de l'emission d'un signal d'alarme a bord d'un vehicule
US9019377B2 (en) * 2007-02-13 2015-04-28 Fujitsu Ten Limited Drive recorder, drive recorder system, vehicle-mounted video recording apparatus, and vehicle-mounted video recording method
KR101035488B1 (ko) * 2009-10-05 2011-05-20 숭실대학교산학협력단 자동차 블랙박스 영상물 수집 방법
US8836784B2 (en) * 2010-10-27 2014-09-16 Intellectual Ventures Fund 83 Llc Automotive imaging system for recording exception events
GB2514151A (en) * 2013-05-15 2014-11-19 Nissan Motor Mfg Uk Ltd Event detection and recording methods and systems
AU2015249884B2 (en) * 2014-04-21 2019-07-18 Blast Motion Inc. Motion event recognition and video synchronization system and method
US9639995B2 (en) * 2015-02-25 2017-05-02 Snap-On Incorporated Methods and systems for generating and outputting test drive scripts for vehicles
FR3033150B1 (fr) * 2015-02-26 2017-02-17 Peugeot Citroen Automobiles Sa Dispositif d'aide a la conduite d'un vehicule en fonction d'une estimation d'au moins un niveau de vigilance globale du conducteur
EP3159853B1 (en) * 2015-10-23 2019-03-27 Harman International Industries, Incorporated Systems and methods for advanced driver assistance analytics
US10032318B1 (en) * 2016-04-15 2018-07-24 Allstate Insurance Company Crowd-sourced driver grading
CN110356344A (zh) * 2019-07-24 2019-10-22 重庆长安汽车股份有限公司 一种应用于全景系统的车载事件记录方法、系统及汽车

Also Published As

Publication number Publication date
WO2021156552A1 (fr) 2021-08-12
CN115053271A (zh) 2022-09-13
FR3106919A1 (fr) 2021-08-06
CN115053271B (zh) 2024-10-15
FR3106919B1 (fr) 2022-03-04

Similar Documents

Publication Publication Date Title
FR3062944A1 (fr) Procede de detection de faux-positifs relatifs a un feu de signalisation
WO2016066953A1 (fr) Procédé, équipement et système d'aide au diagnostic
WO2016128648A1 (fr) Procédé et système de réalisation de télédiagnostics sécurisés d'équipements électroniques communicants de véhicules
EP3627467B1 (fr) Procédé et dispositif de détection de l état d'un capot avant d'un véhicule automobile par comparaison de champs de vision
EP4100927A1 (fr) Véhicule à caméra(s) d'analyse stockant des groupes d'images en présence d'évènements détectés
US10843645B1 (en) Independent power control and output access for vehicle devices
EP2988981B1 (fr) Procédé de fourniture automatique d'informations de supervision d'un véhicule à l'équipement de communication du conducteur
FR3046770B1 (fr) Dispositif et procede de fourniture d'informations relatives a des vehicules circulant incapables d'echanger des messages
FR3065690A1 (fr) Dispositif et procede d’analyse de donnees d’un vehicule de location pour la determination de choc
FR3055986A1 (fr) Dispositif de controle de la reinitialisation d'un calculateur embarque automobile
FR2927707A1 (fr) Dispositif de fourniture d'images materialisant la position d'un vehicule automobile dans une zone situee en amont, et procede associe.
FR3146862A1 (fr) Procédé et système de surveillance d’un véhicule automobile
FR3086250A1 (fr) Procede d’assistance de l’utilisation d’un vehicule automobile a hayon arriere venant d’etre gare
FR3099897A1 (fr) Alerte d’un usager d’un véhicule en cas de détection d’une surélévation anormale
FR3044144B1 (fr) Procede de tenue d’une base de donnees de defauts d’un vehicule automobile
FR3139512A1 (fr) Procédé et dispositif de détection fiabilisée d’ouverture d’un capot d’un véhicule
FR3100774A1 (fr) Procédé et dispositif de contrôle à distance d’un véhicule en stationnement et sans passager
EP2153416B1 (fr) Dispositif de diagnostic pour une analyse a posteriori du comportement d'un vehicule automobile et procede correspondant
WO2016142603A1 (fr) Procédé et dispositif d'aide au dépassement d'un véhicule en présence d'un autre véhicule invisible et circulant à contresens
FR3125608A1 (fr) Procédé de génération d’une base de données pour l’entrainement d’un réseau de neurones artificiels destiné à être implémenté à bord d’un véhicule automobile afin de détecter des chocs de faible intensité
FR3100077A1 (fr) Alerte d’un conducteur d’un détournement prolongé d’attention pendant une phase de conduite manuelle d’un véhicule
FR3100516A1 (fr) Procédé et dispositif d’alerte d’un problème rencontré par un conducteur d’un véhicule
FR3144379A1 (fr) Procédé de détresse par satellite pour véhicule automobile, programme d’ordinateur et véhicule automobile associés
FR3085335A1 (fr) Procede d’assistance de l’utilisation d’un vehicule automobile a hayon arriere lors d’un stationnement
FR3098325A1 (fr) Procédé de détection d’une anomalie affectant une partie extérieure d’un véhicule automobile

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20220719

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
RAP3 Party data changed (applicant data changed or rights of an application transferred)

Owner name: STELLANTIS AUTO SAS