EP4100927A1 - Véhicule à caméra(s) d'analyse stockant des groupes d'images en présence d'évènements détectés - Google Patents
Véhicule à caméra(s) d'analyse stockant des groupes d'images en présence d'évènements détectésInfo
- Publication number
- EP4100927A1 EP4100927A1 EP21704600.2A EP21704600A EP4100927A1 EP 4100927 A1 EP4100927 A1 EP 4100927A1 EP 21704600 A EP21704600 A EP 21704600A EP 4100927 A1 EP4100927 A1 EP 4100927A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- images
- event
- memory
- microcontroller
- type
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000015654 memory Effects 0.000 claims abstract description 66
- 238000004891 communication Methods 0.000 claims abstract description 25
- 238000012546 transfer Methods 0.000 claims abstract description 15
- 238000001514 detection method Methods 0.000 claims description 14
- 230000002123 temporal effect Effects 0.000 claims description 4
- 230000006870 function Effects 0.000 description 3
- 230000002159 abnormal effect Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000029305 taxis Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C5/00—Registering or indicating the working of vehicles
- G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
- G07C5/0841—Registering performance data
- G07C5/085—Registering performance data using electronic data carriers
- G07C5/0866—Registering performance data using electronic data carriers the electronic data carrier being a digital video recorder in combination with video camera
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C2205/00—Indexing scheme relating to group G07C5/00
- G07C2205/02—Indexing scheme relating to group G07C5/00 using a vehicle scan tool
Definitions
- TITLE ANALYSIS CAMERA (S) VEHICLE STORING GROUPS OF IMAGES IN THE PRESENCE OF DETECTED EVENTS
- the invention relates to vehicles comprising at least one analysis camera acquiring and analyzing images in their environment, and more precisely the recording of image (s) associated with an event.
- Some vehicles include at least one electronic device generating an alert message upon detection of an event and at least one scanning camera acquiring and analyzing images in their surroundings.
- the analysis camera includes a microcontroller having a memory in which it stores the last image acquired when it detects an abnormal and potentially dangerous event for the vehicle and / or its passengers.
- This event detection is carried out by analyzing the image (s) acquired generally as a function of values taken by parameters or operating variables of the vehicle. For example, an analysis camera can detect events such as a risk of collision or the need for emergency braking.
- the image stored for an event detected by the analysis camera can then be retrieved by external electronic equipment (temporarily connected to the vehicle's diagnostic socket) so that a person analyzes the situation they represent in order to try to understand the reason why the corresponding event occurred.
- This understanding can be particularly useful in the event of an accident or when testing a vehicle with at least partially automated (or autonomous) driving in a real situation.
- the mode of operation described above has several drawbacks. Indeed, it only allows the analysis of a single image acquired by a camera on-board analysis, and again on condition that the event at the origin of its storage has been detected by this analysis camera, which only constitutes a snapshot of the situation in the part of the environment observed and therefore does not make it possible to form an opinion on the evolution of this situation. In addition, it only makes it possible to know the situation at the time of detection of the event by the analysis camera, which very often proves insufficient to understand the reason why this event occurred. In addition, a recording can only be made on a single internal event detected by the camera and not an event external to the latter (information coming from a vehicle computer via an internal (or on-board) communication network).
- One aim of the invention is therefore to improve the situation.
- a vehicle comprising at least one electronic device coupled to an internal communication network and generating an alert message in the event of detection of a first event associated with a type, and at least one analysis camera.
- the first microcontroller systematically stores in the first memory the last N images acquired, with N> 2, and in the presence of a first or second event transfers into the second memory the last N images stored and M images acquired after the latter , with M> 1, so that they are stored with their respective associated types.
- the vehicle according to the invention may have other characteristics which can be taken separately or in combination, and in particular:
- - N can be between three and ten
- - M can be between two and five;
- the first microcontroller can be arranged to transfer the images associated with a type of event to a location dedicated to this type of event in the second memory;
- the first microcontroller can be arranged, when a location dedicated to a type of event in the second memory is full and new images must be transferred to this location, to delete in the latter images having the oldest date of storage, then to transfer these new images to this location in the second memory;
- the second microcontroller can be arranged, in the event of receipt of a request requesting images stored in the second memory, to retrieve these required images in order to transfer them to the internal communication network;
- the second microcontroller can be arranged to retrieve in the second memory stored images associated with a type of event designated in the received request;
- the first microcontroller can be arranged to store in the second memory images associated with a type of event and with an identifier representative of their temporal classification with respect to events of the same type.
- the second microcontroller can be arranged to retrieve in the second memory stored images associated with an identifier designated in the request received for a type of event also designated in the request received;
- the second microcontroller can comprise a third memory in which it stores data defining first events and second events, and sets of values taken by parameters or operating variables of the vehicle respectively during the first and second events, in correspondence of 'at least one type of event;
- the second microcontroller can be arranged, when it receives a request requesting images stored in the second memory, to associate these requested images with the corresponding data and / or sets of values stored in the third memory;
- FIG. 1 illustrates schematically and functionally a vehicle according to the invention, comprising two electronic devices and an analysis camera coupled to an internal communication network.
- the object of the invention is in particular to provide a vehicle V comprising at least one electronic device Ej coupled to an internal communication network RC and generating an alert message in the event of detection of an event, and at least one camera.
- CA analysis acquiring and analyzing images in its environment and being able to store several of these images in the presence of an event.
- the vehicle V is of the automobile type. This is for example a car, as illustrated without limitation in Figure 1. But the invention is not limited to this type of vehicle. It concerns any type of vehicle that can transport at least one person and that can be the subject of maintenance operations in after-sales services. Thus, it concerns at least all land vehicles (and in particular motor vehicles, utility vehicles, camper vans, motorcycles, minibuses, coaches, trucks, road vehicles, construction machinery and machinery. agricultural), boats and aircraft (especially flying taxis).
- the vehicle V is at least partially automated (or autonomous). It can therefore be driven at least partially automatically during an automated driving phase, as well as possibly manually during a manual driving phase.
- automated (or autonomous) driving phase is understood here to mean a phase during which the driver of the vehicle V does not intervene, the driving being entirely controlled by an on-board driving assistance (or aid) device, and by “manual driving phase” a phase during which the driver of the vehicle V intervenes at least on the steering wheel and / or the pedals (or levers). But vehicle V could be purely manual (with possible driving assistance).
- FIG. 1 An embodiment of a vehicle V comprising two electronic equipment Ej and an analysis camera CA coupled to an internal communication network RC.
- the invention can be implemented as soon as the vehicle V comprises at least one electronic device Ej and at least one camera AC analysis coupled to the RC internal communication network.
- This internal communication network RC can, for example, be multiplexed. In this case, it may be, for example, a CAN ("Controller Area Network"), or LIN ("Local Interconnect Network”) type network, or FLEXRAY, or even Ethernet.
- CAN Controller Area Network
- LIN Local Interconnect Network
- Each electronic device Ej is arranged so as to generate an alert message in the event of detection of a first event associated with a type (event).
- an electronic device Ej can provide at least one driving assistance function such as speed regulation, or speed adaptation to cross a bend, or braking control, or trajectory control, or inter-vehicle distance control, or seat belt control (s), or collision detection, or even centering control in a traffic lane.
- the events can be, for example, automatic braking (possibly emergency), or pre-tensioning of at least one seat belt strap, or pre-loading of the braking system, or refocusing. in a traffic lane, or an automatic course correction, or an automatic speed reduction, or a significant speed reduction in a short period of time, or even the triggering of an air bag protection device (or "airbag ").
- the first electronic equipment item E1 can be a trajectory control device
- the second electronic equipment item E2 can be a device for monitoring the safety of the vehicle V
- the third electronic equipment item E3 can be a radar before (analyzing the environment in front of the vehicle V).
- the (each) analysis camera CA is arranged to acquire and analyze images in at least part of the external environment of the vehicle V (for example a front or rear or side part).
- the (each) CA analysis camera includes first C1 and second C2 microcontrollers coupled together, and first M1 and second M2 memories.
- Each of the first C1 and second C2 microcontrollers comprises at least one processor and at least one random access memory.
- the processor can be a digital signal processor (or DSP (“Digital Signal Processor”)).
- DSP Digital Signal Processor
- This processor can include integrated circuits (or printed), or several integrated circuits (or printed) connected by wired or wireless connections.
- integrated circuit or printed circuit is meant any type of device capable of performing at least one electrical or electronic operation.
- RAM is responsible for storing instructions for the processor to perform operations.
- Each of the first C1 and second C2 microcontrollers can also include, according to its functional needs, a mass memory, in particular for the storage of intermediate data involved in all its calculations and processing, and / or an input interface for the reception of messages.
- the second microcontroller C2 is coupled to the internal communication network RC and is arranged so as to transmit to the first microcontroller C1 each alert message generated by electronic equipment Ej following the detection of a first event, containing data defining this first event, and circulating on the internal communication network RC.
- the first microcontroller C1 is arranged so as to detect a second event associated with a type (of event) by analysis of each image acquired by its analysis camera CA as a function of values taken by parameters or operating variables of the vehicle V .
- the CA analysis camera can detect second events such as a risk of collision, a need to refill the braking system for preparation for braking (refill), or a need for automatic emergency braking.
- the first microcontroller C1 comprises a first memory M1 in which it systematically stores the last N images acquired by its analysis camera CA, with N> 2.
- the first microcontroller C1 is arranged so as to transfer into the second memory M2, in the presence of a first or second event (as well as possibly when the vehicle V is switched off), the N last images stored in the first memory M1 and M images acquired after these N last images, with M > 1, so that they are stored with their respective associated types.
- the first microcontroller C1 knows that a first or second event has been detected (or possibly when the internal (or onboard) communication networks of the vehicle V have fallen asleep), it immediately transfers to the second memory M2 the last N images stored in the first memory M1, then waits for having stored M new subsequent images in the latter (M1), in place of at least part of these N last images, in order to transfer them to the second memory M2.
- the second memory M2 therefore stores at least one group of N + M images associated with the same type of event.
- At least a group of N + M images representative of the evolution of the situation in a part of the external environment of the vehicle V before, during and after the occurrence of an event are available for a subsequent analysis. This makes it much easier to analyze the situation and understand why the event happened.
- the number N can be between three and ten, especially when the CA scan camera acquires one image per second. Thus, it can, for example, be equal to three. But a number N greater than ten is possible.
- the number M can be between two and five, especially when the analysis camera CA acquires one image per second. Thus, it can, for example, be equal to two. But a number M greater than five is possible.
- the first memory M1 can be a random access memory RAM type (“Random Access Memory”).
- the second memory M2 can be a flash memory.
- the vehicle V can include a diagnostic socket PD coupled to the internal communication network RC and to which an external electronic device EC can be coupled responsible for recovering images stored in the second memory M2 of a CA analysis camera with a view to their analysis intended to understand the corresponding event.
- the coupling between the external electronic equipment EC and the internal communication network RC could be done by means of waves (not wired), and for example by WiFi.
- the first microcontroller C1 can be arranged to transfer the images associated with a type of event to a location which is dedicated to this type of event in the second memory M2. This option is intended to facilitate the retrieval of images stored in the second memory M2 by the external electronic equipment EC.
- the first microcontroller C1 can be arranged, when a location dedicated to a type of event in the second memory M2 is full and new images must be transferred to this location, in order to delete in the latter. images with the oldest storage date, then to transfer these new images to this location of the second memory M2.
- This sub-option is intended to favor the most recent images of an event type. It also makes it possible to increase the probability, when a user comes to an after-sales service a little after the occurrence of an abnormal event, that images relating to this event are still stored in the second memory M2 and therefore can be stored. analyzed.
- the first microcontroller C1 can be arranged to store images associated with this type of event and with an identifier which is representative of the temporal classification of these images in relation to events of the same type.
- the first microcontroller C1 can associate with the images corresponding to an event of a certain type an identifier equal to 1 for the first detection of this type of event, then the first microcontroller C1 can associate with the images corresponding to the next event of the same type an identifier equal to 2 for the second detection of this type of event, then the first microcontroller C1 can associate with the images corresponding to the next event of the same type an identifier equal to 3 for the third detection of this type of event, and so on up to a maximum identifier value.
- the number of identifiers associated with the same type of event can take any value. For example, it can be between five and fifteen. Thus, it can, for example, be equal to ten. The number of identifiers may possibly vary from one type of event to another type of event.
- the second microcontroller C2 can be arranged, in the event of receipt of a request requesting images stored in the second memory M2, to recover these images required in order to transfer them to the internal communication network RC.
- the second microcontroller C2 transmits a request intended to obtain designated images stored in the second memory M2, then once these images have been obtained, it transmits them to the sender of the request (for example the external electronic equipment EC ) via the internal RC communication network.
- the request can request all the images stored in the second memory M2 of an analysis camera CA.
- the second microcontroller C2 can be arranged to recover in the second memory M2 specifically stored images associated with a type of event designated in the received request.
- the first microcontroller C1 associates identifiers respectively with successive groups of N + M images of the same type of event that it stores in a possible dedicated location of the second memory M2
- the second microcontroller C2 can be arranged to recover in the second memory M2 images which are stored by being associated with an identifier designated in the request received for a type of event also designated in this request received.
- the second microcontroller C2 can comprise a third memory M3 in which it stores data defining first events (detected by electronic equipment Ej) and second events (detected by the first microcontroller C1), and sets of values taken by parameters or operating variables of the vehicle V respectively during the first and second events. It will be understood that the second microcontroller C2 recovers from the internal communication network RC these data (of the first events) and these sets of values when a first or second event occurs. It will also be understood that the second microcontroller C2 stores these data and these sets of values corresponding to at least one type of event as well as possibly an identifier representative of the temporal classification of the event with respect to events of the same type. .
- the second microcontroller C2 can, when it receives a request requesting images, associate with these requested images the corresponding data and / or sets of values (and therefore associated with the same type of event and possibly the same identifier), before transmitting them to the sender of the request (for example the external electronic equipment EC) via the internal communication network RC.
- the third memory M3 can be a rewritable read-only memory of the EEPROM type (“Electrically-Erasable Programmable Read-Only Memory” - electrically erasable and programmable read-only memory).
- EEPROM Electrically-Erasable Programmable Read-Only Memory
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Traffic Control Systems (AREA)
- Closed-Circuit Television Systems (AREA)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR2001043A FR3106919B1 (fr) | 2020-02-03 | 2020-02-03 | Véhicule à caméra(s) d’analyse stockant des groupes d’images en présence d’évènements détectés |
PCT/FR2021/050011 WO2021156552A1 (fr) | 2020-02-03 | 2021-01-06 | Véhicule à caméra(s) d'analyse stockant des groupes d'images en présence d'évènements détectés |
Publications (1)
Publication Number | Publication Date |
---|---|
EP4100927A1 true EP4100927A1 (fr) | 2022-12-14 |
Family
ID=70978074
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP21704600.2A Pending EP4100927A1 (fr) | 2020-02-03 | 2021-01-06 | Véhicule à caméra(s) d'analyse stockant des groupes d'images en présence d'évènements détectés |
Country Status (4)
Country | Link |
---|---|
EP (1) | EP4100927A1 (zh) |
CN (1) | CN115053271B (zh) |
FR (1) | FR3106919B1 (zh) |
WO (1) | WO2021156552A1 (zh) |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2823048B1 (fr) * | 2001-03-30 | 2003-07-04 | Claude Bendavid | Dispositif pour la memorisation d'une sequence visuelle a la suite de l'emission d'un signal d'alarme a bord d'un vehicule |
US9019377B2 (en) * | 2007-02-13 | 2015-04-28 | Fujitsu Ten Limited | Drive recorder, drive recorder system, vehicle-mounted video recording apparatus, and vehicle-mounted video recording method |
KR101035488B1 (ko) * | 2009-10-05 | 2011-05-20 | 숭실대학교산학협력단 | 자동차 블랙박스 영상물 수집 방법 |
US8836784B2 (en) * | 2010-10-27 | 2014-09-16 | Intellectual Ventures Fund 83 Llc | Automotive imaging system for recording exception events |
GB2514151A (en) * | 2013-05-15 | 2014-11-19 | Nissan Motor Mfg Uk Ltd | Event detection and recording methods and systems |
AU2015249884B2 (en) * | 2014-04-21 | 2019-07-18 | Blast Motion Inc. | Motion event recognition and video synchronization system and method |
US9639995B2 (en) * | 2015-02-25 | 2017-05-02 | Snap-On Incorporated | Methods and systems for generating and outputting test drive scripts for vehicles |
FR3033150B1 (fr) * | 2015-02-26 | 2017-02-17 | Peugeot Citroen Automobiles Sa | Dispositif d'aide a la conduite d'un vehicule en fonction d'une estimation d'au moins un niveau de vigilance globale du conducteur |
EP3159853B1 (en) * | 2015-10-23 | 2019-03-27 | Harman International Industries, Incorporated | Systems and methods for advanced driver assistance analytics |
US10032318B1 (en) * | 2016-04-15 | 2018-07-24 | Allstate Insurance Company | Crowd-sourced driver grading |
CN110356344A (zh) * | 2019-07-24 | 2019-10-22 | 重庆长安汽车股份有限公司 | 一种应用于全景系统的车载事件记录方法、系统及汽车 |
-
2020
- 2020-02-03 FR FR2001043A patent/FR3106919B1/fr active Active
-
2021
- 2021-01-06 EP EP21704600.2A patent/EP4100927A1/fr active Pending
- 2021-01-06 WO PCT/FR2021/050011 patent/WO2021156552A1/fr unknown
- 2021-01-06 CN CN202180012474.6A patent/CN115053271B/zh active Active
Also Published As
Publication number | Publication date |
---|---|
WO2021156552A1 (fr) | 2021-08-12 |
CN115053271A (zh) | 2022-09-13 |
FR3106919A1 (fr) | 2021-08-06 |
CN115053271B (zh) | 2024-10-15 |
FR3106919B1 (fr) | 2022-03-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
FR3062944A1 (fr) | Procede de detection de faux-positifs relatifs a un feu de signalisation | |
WO2016066953A1 (fr) | Procédé, équipement et système d'aide au diagnostic | |
WO2016128648A1 (fr) | Procédé et système de réalisation de télédiagnostics sécurisés d'équipements électroniques communicants de véhicules | |
EP3627467B1 (fr) | Procédé et dispositif de détection de l état d'un capot avant d'un véhicule automobile par comparaison de champs de vision | |
EP4100927A1 (fr) | Véhicule à caméra(s) d'analyse stockant des groupes d'images en présence d'évènements détectés | |
US10843645B1 (en) | Independent power control and output access for vehicle devices | |
EP2988981B1 (fr) | Procédé de fourniture automatique d'informations de supervision d'un véhicule à l'équipement de communication du conducteur | |
FR3046770B1 (fr) | Dispositif et procede de fourniture d'informations relatives a des vehicules circulant incapables d'echanger des messages | |
FR3065690A1 (fr) | Dispositif et procede d’analyse de donnees d’un vehicule de location pour la determination de choc | |
FR3055986A1 (fr) | Dispositif de controle de la reinitialisation d'un calculateur embarque automobile | |
FR2927707A1 (fr) | Dispositif de fourniture d'images materialisant la position d'un vehicule automobile dans une zone situee en amont, et procede associe. | |
FR3146862A1 (fr) | Procédé et système de surveillance d’un véhicule automobile | |
FR3086250A1 (fr) | Procede d’assistance de l’utilisation d’un vehicule automobile a hayon arriere venant d’etre gare | |
FR3099897A1 (fr) | Alerte d’un usager d’un véhicule en cas de détection d’une surélévation anormale | |
FR3044144B1 (fr) | Procede de tenue d’une base de donnees de defauts d’un vehicule automobile | |
FR3139512A1 (fr) | Procédé et dispositif de détection fiabilisée d’ouverture d’un capot d’un véhicule | |
FR3100774A1 (fr) | Procédé et dispositif de contrôle à distance d’un véhicule en stationnement et sans passager | |
EP2153416B1 (fr) | Dispositif de diagnostic pour une analyse a posteriori du comportement d'un vehicule automobile et procede correspondant | |
WO2016142603A1 (fr) | Procédé et dispositif d'aide au dépassement d'un véhicule en présence d'un autre véhicule invisible et circulant à contresens | |
FR3125608A1 (fr) | Procédé de génération d’une base de données pour l’entrainement d’un réseau de neurones artificiels destiné à être implémenté à bord d’un véhicule automobile afin de détecter des chocs de faible intensité | |
FR3100077A1 (fr) | Alerte d’un conducteur d’un détournement prolongé d’attention pendant une phase de conduite manuelle d’un véhicule | |
FR3100516A1 (fr) | Procédé et dispositif d’alerte d’un problème rencontré par un conducteur d’un véhicule | |
FR3144379A1 (fr) | Procédé de détresse par satellite pour véhicule automobile, programme d’ordinateur et véhicule automobile associés | |
FR3085335A1 (fr) | Procede d’assistance de l’utilisation d’un vehicule automobile a hayon arriere lors d’un stationnement | |
FR3098325A1 (fr) | Procédé de détection d’une anomalie affectant une partie extérieure d’un véhicule automobile |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20220719 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
RAP3 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: STELLANTIS AUTO SAS |