DE102022111395A1 - Warning device for monitoring a small child on board a vehicle - Google Patents

Abstract

A warning device (100) for monitoring a small child on board a vehicle is proposed, the warning device (100) comprising the following: - at least one monitoring mirror (110) for monitoring a small child while driving, - a video camera (101a) which Monitoring mirror (110) detected in order to film a small child or his mirror image via the monitoring mirror (110), - a pattern recognition unit (102) which is set up to determine the body posture and/or on the basis of a video data stream (101c) from the video camera (101a). or to recognize a physical characteristic of a filmed infant; and - a danger detection unit (103) which is set up to determine a potential health risk for the small child on the basis of the posture and/or a body characteristic.

Description

The invention relates to a warning device for monitoring a small child on board a vehicle. The invention further relates to a method used for this purpose, a vehicle with a warning device and the use of an optical interior monitoring system of a vehicle for monitoring a small child.

In order to transport a baby or toddler up to the age of three in a vehicle or motor vehicle, there are child seats that are mounted on a passenger seat or (as recommended) in the back seat of the vehicle interior; There, the child is better protected from injuries in the event of an accident, especially since the seat belts are only tailored to the heights of young people and adults.

Parents of a small child often feel the need to regularly check the well-being of the child, especially the small child, even if it is just a quick glance in the rearview mirror; for example to check whether the child is awake or sleeping or has any needs. There are so-called baby mirrors that can be mounted in the rear area of the vehicle interior; for example on a headrest or on the rear window; The child can be observed via the rear-view mirror and the mounted baby mirror.

However, the rearview mirror is usually quite small and adjusted either only for the driver or only for the front passenger. In addition, looking through the very small rear-view mirror is only of limited use in gaining a reliable impression of the toddler's behavior or current condition.

It would be desirable to make it easier to observe small children in the vehicle.

On the other hand, there are video cameras from optical interior surveillance systems that are permanently installed in a vehicle for theft and burglary protection purposes. If movement is detected in the vehicle, they sound an alarm to deter burglars or thieves. However, such monitoring systems are unsuitable for monitoring small children because they would immediately trigger an alarm at the first movement of the child.

It is the object of the present invention to provide a device with which a small child can be observed while driving in a simpler and/or more reliable manner. In addition, the invention has the further task of not only observing a transported small child, but also monitoring the child's health, in particular any vital health functions, during the car journey. This invention also has the task of providing a warning device, a method and a suitably equipped vehicle as well as the use of an optical interior monitoring system that may already be present therein.

This task is solved by the subjects of claims 1, 13, 14 and 15.

• - mindestens einen Überwachungsspiegel zur Überwachung eines Kleinkinds während der Fahrt,
• - eine Videokamera, die den Überwachungsspiegel erfasst, um über den Überwachungsspiegel ein Kleinkind oder dessen Spiegelbild zu filmen,
• - eine Mustererkennungseinheit (insbesondere eine Bilderkennungseinheit und/oder eine Bewegungserkennungseinheit), die dazu eingerichtet ist, auf der Basis eines Videodatenstroms der Videokamera die Körperhaltung und/oder eine Körpereigenschaft eines gefilmten Kleinkinds zu erkennen; und
• - eine Gefahrermittlungseinheit, die dazu eingerichtet ist, auf der Basis der Körperhaltung und/oder einer Körpereigenschaft eine potenzielle Gesundheitsgefahr für das Kleinkind zu ermitteln.

The warning device according to the invention enables the monitoring of a child (for example his vital health functions) on board a vehicle and includes at least the following:

• - at least one surveillance mirror to monitor a small child while driving,
• - a video camera that captures the surveillance mirror in order to film a small child or his or her reflection via the surveillance mirror,
• - a pattern recognition unit (in particular an image recognition unit and/or a motion recognition unit), which is set up to recognize the posture and/or a body characteristic of a filmed small child on the basis of a video data stream from the video camera; and
• - a danger detection unit that is set up to determine a potential health risk for the small child based on posture and/or a physical characteristic.

Normally, the driver or front passenger must observe a child held in a child seat, especially in a rear seat using a child seat, through the vehicle's interior rearview mirror to make sure whether the child is okay or is missing something. Due to the small area of the rear-view mirror, the rocking due to driving movements and the concentration on the road traffic, reliable monitoring of the small child is only possible to a limited extent; In addition, there is approximately 1.5 to 2 meters of air space between the driver's eyes and a small child in a back seat or a child seat mounted on it. In addition, many child seats must be installed so that the child faces the opposite direction of travel while driving. These circumstances make it difficult to observe the child while driving.

The warning device proposed here includes a surveillance mirror, a video camera mera, a pattern recognition unit and a threat detection unit. In particular, it is provided that the video camera captures the surveillance mirror in order to film the small child himself, more precisely the mirror image of the child (ie his body and especially his face) generated by the surveillance mirror, via the surveillance mirror.

Normally, in order to be able to observe the child while driving without being distracted by traffic etc., a video camera would be placed in front of the child's face; for example by subsequently attaching it to a headrest in one of the rear seats or the seats in the row of seats further back in the vehicle. The video camera would then be facing the toddler's face, usually facing forward in the direction of travel, as most child seats are built in such a way that the child looks backwards while driving.

Instead, however, the present invention proposes to film the child using a video camera (usually already present at the front of the vehicle, typically arranged in the area of the interior rear-view mirror), but not directly from the direction in which he is looking, but by means of image redirection via a monitoring mirror, which is in the scanning or more precisely, the detection range of the video camera and is attached, positioned and/or oriented in such a way that, when viewed from the video camera, it shows the child, its body or at least its face (more precisely the mirror image of the child, its body or face).

Instead of directly observing the child from his line of sight or at least frontally through a video camera, it is proposed here to observe the child via the “intermediate” monitoring mirror, in particular in order to check his state of health.

A priori, such a suggestion may seem absurd, since the video camera, which is often already installed and is usually located at the front (i.e. in the area of a front row of seats), is not only as far away from the child as the rear-view mirror itself, but - due to the detour of reflection using a surveillance mirror - is used with an artificially increased optical distance to observe the child, instead of simply mounting the camera facing the child in front of the child, i.e. behind the child in the direction of travel and pointing it directly at the child or his or her face from a short distance.

However, according to the invention, it can be exploited that a video camera - in particular in conjunction with a pattern recognition unit arranged downstream of it - is able to compensate for this disadvantage through image or pattern recognition, for example by selectively selecting and examining an image area area of the camera's video data stream for pattern recognition which corresponds to the position and extent of the mirror in the field of view of the camera. This selective image section can also be electronically enlarged in order to monitor the toddler's behavior and/or movement patterns with greater accuracy. This more than compensates for the reduced angle of view due to the distance, which the child's face in particular occupies within the image area. The recorded behavioral and/or movement patterns can be evaluated by a danger detection unit, which determines whether and, if necessary, when a potential health risk to the small child exists and/or is imminent.

• - eine visuelle, optische, textliche, sprachliche, akustische und/oder anderweitige Warnung über die potenzielle Gesundheitsgefahr für das Kleinkind und/oder
• - den Videodatenstrom selbst

ausgibt, anzeigt und/oder aussendet.Finally, the warning device can have an output device, in particular a display unit, which, when an existing and/or impending health risk is detected,

• - a visual, optical, textual, verbal, acoustic and/or other warning of the potential health risk to the infant and/or
• - the video data stream itself

outputs, displays and/or sends out.

The warning device makes it possible to monitor a small child on board a vehicle, particularly while driving, which was previously impossible and, in particular, hardly comparably simple.

• 1 eine rein schematische Darstellung einer Ausführungsform der hier vorgeschlagenen Warnvorrichtung für und/oder in einem Fahrzeug,
• 2 ein Fahrzeug mit der vorgeschlagenen Warnvorrichtung gemäß einer Ausführungsform,
• 3 eine Ausführungsform der hier vorgeschlagenen Warnvorrichtung, hier schematisch dargestellt hinsichtlich einer denkbaren Aufteilung in Komponenten und hinsichtlich möglicher Informationsflüsse zwischen diesen Komponenten, und
• 4 ein exemplarisches Ablaufdiagramm des hier vorgeschlagenen Verfahrens.

Some exemplary embodiments are described below with reference to the accompanying figures. Show it:

• 1 a purely schematic representation of an embodiment of the warning device proposed here for and/or in a vehicle,
• 2 a vehicle with the proposed warning device according to one embodiment,
• 3 an embodiment of the warning device proposed here, shown here schematically with regard to a conceivable division into components and with regard to possible information flows between these components, and
• 4 an exemplary flowchart of the method proposed here.

1 shows purely schematically one in a vehicle 200 (cf. 2 ) furnished or at least Warning device 100 intended for a vehicle 200, as proposed in the present application, according to an exemplary embodiment in a purely schematic representation. The warning device 100 can be installed in the vehicle in its factory-new state. The warning device 100 (or at least the components still missing for this) can alternatively also be retrofitted into a vehicle 200, for example as a retrofit kit 150 to expand the functionality of a possibly already existing interior camera 201a ; 201b and/or a mounted baby mirror (not shown in the picture) or to expand the functionality of a display device 206 such as an HMI (Human-Machine Interface) 207 (cf. 2 ).

The warning device 100 according to 1 is used to monitor an infant on board a vehicle; especially for monitoring your vital health functions while driving. Such monitoring of health vital signs is traditionally carried out in places such as hospitals, where the health of children, among others, is at stake. However, when traveling in the car with a (normally healthy) small child, it is unusual to monitor the child's vital signs, let alone do so while driving, especially since most of the vital signs are usually monitored by sensors attached to the (possibly sick) child or by hand by touch or by manually examining the child. In addition, there are currently no devices or systems set up for this purpose in vehicles, which is why the driver is usually dependent on his own personal visual monitoring via the rear-view mirror, ie the interior rear-view mirror of the vehicle, which he has to carry out at least from time to time.

The warning device 100 according to 1 has a video unit 101, which includes at least one video camera 101a and/or a number of video signal lines 101b. In particular, the video camera 101a shown can be provided as the video unit 101, which outputs and/or stores a video data stream 101c while it is filming. It can also form part of an already installed (optical or visual) interior monitoring system 211a (cf. 2 and 3 ), which, according to the invention, has a functional expansion for monitoring small children. Alternatively or additionally, the video unit 101 or the video camera 101a can also be part of a retrofit kit 150, through which a brand-new or used vehicle is retrofitted or converted, or at least capable of a new function, namely monitoring small children.

The video unit can further comprise video data lines or video signal lines 101b. Alternatively, however, the video unit 101 or video camera 101a can communicate wirelessly, i.e., for example, via radio; for example via Bluetooth or WLAN. This applies to all exemplary embodiments mentioned in this application and in connection with all other features.

1 also shows that a surveillance mirror 110 is provided, towards which the video unit 101 or the video camera 101a is directed. At a minimum, the surveillance mirror 110 is required to be positioned to be captured by the video camera 101a; in particular lies within the image angle or image field of the video camera 101a. The monitoring mirror 110 is in 1 shown purely schematically in spatial proximity to the video camera 101a; In fact, however, the distance between the two in the vehicle is one to one and a half meters or even greater, since the video camera 101a is usually mounted or installed in the area of the interior rear-view mirror (and can therefore be used by the driver or front passenger from a row of seats further forward), whereas the Monitoring mirror 110 is attached in the area of a row of seats further back; for example on, above and/or next to one of the rear seats or their headrest.

The rough orientation of the video camera 101a in 1 thus only indicates that the monitoring mirror 110 is arranged in your field of vision, albeit at a greater distance.

On the one hand, at least a partial area of the mirror surface or the mirror 110 must be in the field of vision or image field or detection range of the video camera 101a so that the camera can capture and observe, i.e. film, the mirror image of the child or at least his face via this mirror 110.

On the other hand, however, it is preferred that the monitoring mirror 110 or its mirror surface lies completely within the image angle of the video camera 101a. In particular, the camera, which typically works in the wide-angle range with image angles of 90°, 100° or larger, can capture a significantly larger image angle range than - especially in view of the distance between video camera 101a and surveillance mirror 110 - for scanning, more precisely for complete capture of the surveillance mirror 110 is actually necessary. This means that the camera can, firstly, fulfill other tasks, such as wide-angle interior surveillance to prevent theft, but secondly, according to the invention, to monitor the condition of the small child via the monitoring spit (mounted at some distance). gel 110 can be used. The camera itself and/or an additionally provided pattern recognition unit 102 can compensate for the small image angle that the monitoring mirror 110 fills within the image area of the video camera 101a; for example, by selectively selecting and further processing an enlarged close-up of the toddler, his body and/or his face, instead of processing the entire image area of the video data stream.

Alternatively or additionally, provision can also be made to display, at a downstream location, namely by means of an output device 106, in particular a display 106d, as described further below, a partial image obtained, separated and/or partially enlarged from the video data stream 101c, which shows the selective close-up of the small child, his body and/or his face. This partial image can be displayed or represented in the vehicle by the output device 106 or the display 106d in such a way that it can be seen from a row of seats further forward in the vehicle, i.e. on the driver or front passenger seat on a larger scale and / or under a larger one Angle of view can be observed as if the small child were being observed through the interior rearview mirror.

First, however, according to the invention, an image or pattern recognition of the video data stream 101c of the video camera 101a takes place. This is according to 1a Pattern recognition unit 102 is provided, which is used to analyze the video data stream 101c provided by video unit 101, and this is preferably followed by a danger determination unit 103.

Finally, the visual, optical and/or acoustic output device 106 is provided; For example, a display unit that includes at least warning signal lines 106a, a display 106d and / or a warning signal transmitter 106b. The display unit or output device 106 can alternatively or additionally also include a loudspeaker 106c and/or a display 106d (for example a head-up display); for example an HMI (Human Machine Interface) 107; 207. The specific structure of the output device 106 depends on the manner in which a warning message or other warning message (and possibly also the video data stream itself) is output, sent or displayed; be it optical or visual or acoustic; be it wired or wireless or via radio etc. The connection to or communication with the output device 106 (e.g. on the part of the units 102 and / or 103) can also be done via radio or wireless instead of wired.

2 shows a schematic top view of a vehicle 200 that has the warning device 100 proposed here; 150 according to an exemplary embodiment (e.g. according to 1 and or 3 or different). In such a vehicle, for example, a small child is accommodated in a child seat 210 behind the passenger seat; usually in a child seat that is positioned and/or attached to a rear seat, ie a seat further back in the vehicle.

One way to observe the child in the child seat while driving is to use, in addition to the rear-view mirror itself, a camera 201a attached to it, which keeps an eye on the child in the child seat 210 between the driver's seat and the front passenger seat. Such cameras are actually in use, albeit for completely different purposes, namely anti-theft protection and/or burglary detection in order to immediately trigger an alarm in the event of unauthorized entry into the vehicle. Apart from that, a video camera can also be used continuously to monitor a child - if necessary in combination with a baby mirror, which can be installed, for example, in the rear area of the vehicle interior (not shown in the picture); e.g. on the rear window or a headrest.

However, observing the child in such a manner requires constant attention because a video camera is a continuously and indiscriminately recording image recording device that has no inherent awareness or knowledge of the content of the recorded image or video content.

In order to better capture the child's face, at least with regard to the viewing direction and the imaging scale, in addition to a front video camera 201a, a rear video camera 201b can also be installed (in particular on the side next to the monitoring mirror) to view the child or its face from several different viewing directions at the same time capture.

The child seat is often designed and/or installed in such a way that the toddler faces the opposite direction of travel, as shown by the downward facing arrow in 2 is indicated. There are also child seats in which the child lies and looks up. In this case, the monitoring mirror 110 is attached above and/or behind the child seat (or at the same time to the side of it) and oriented so that the child's reflection (viewed from the direction of the camera) is lower than the mirror itself.

Furthermore, the child seat 210 or the child can also be positioned on the front passenger seat facing the direction opposite to the direction of travel. Then the monitoring mirror 110 is arranged, for example, in the area of the center console and/or above it; preferably in such a way that it is aimed slightly from behind, i.e. diagonally forward, towards the child's face.

There are also other options for arranging the mirror, which can only be hinted at here. What is crucial, however, is that the child is not observed, i.e. filmed (and monitored), by the camera 101a directly, but rather through the monitoring mirror 110, so that the optical or visual detection is always carried out via the monitoring mirror 110. The mirror image of the child shown by the monitoring mirror 110 is recorded and evaluated.

It can also be provided that the monitoring mirror 110 is convexly curved and/or divided into several mirror surfaces in order to reflect a larger solid angle range and/or several solid angle ranges into a detection range of the video camera 101a. Here too, a reduced image scale, which is caused by the convex mirror shape (for example as a fisheye mirror), can be compensated for by post-processing the video data stream using the units 102, 103 and/or 106.

In the figures and other exemplary embodiments, a single monitoring mirror 110 is usually mentioned. Nevertheless, a plurality of monitoring mirrors 110 can also be provided, for example in order to be able to monitor two or more children in several child seats at the same time. If there are any time overlaps between warning messages, they can be displayed in time division multiplex, i.e. one after the other. Likewise, a single mirror can have two or more (partial) mirror surfaces pointing in different directions, with which several children (seats) can be observed at the same time.

All variants listed so far with regard to the arrangement, orientation, nature, number or other properties of the monitoring mirror or mirrors 110 can not only be used in conjunction with 1 or 2 , but are provided in conjunction with any other embodiment of this application.

If in accordance with 2 The warning device 100 proposed here is installed in the vehicle 200, observation of the child is achieved in a new, greatly improved quality, in which even vital health functions of the small child in the vehicle 200 or in the child seat 210 can be monitored, without this the driver and/or passenger would have to constantly keep an eye on the child while driving.

The pattern recognition unit 102 additionally provided according to the invention is set up to recognize a small child observed by the video unit 101, its posture and/or body characteristics on the basis of the video data stream 101c. For this purpose, the unit 102 recognizes, for example, the time-changing outlines of the child on the video film, with other changing image components such as the external environment of the vehicle visible through the windows or the movement of the adult driver or passenger preferably being ignored or at least given secondary consideration by appropriately selective selection of the image section to only capture the child while driving, even if, due to the orientation and angle of view of the camera, it is primarily the child (and the child seat) that fills the camera image anyway. Additionally or alternatively, the determination of the primarily relevant image section can also be made easier by a reference image (e.g. of the child seat without a child) or by another reference object.

In addition, a danger determination unit 103 is provided, which is set up based on the data from the video unit 101 or the camera 101a; 201a; 201b provided (and preferably analyzed by the pattern recognition unit 102) video data stream 101c to determine whether and / or when there is and / or is a potential health risk to the health of the small child in the vehicle 200.

In particular, the warning device 100 and its danger detection unit 103 work completely without contact and in particular without physical contact, namely on a purely visual basis, without any sensors or probes having to be attached to the child or his clothing or to the child seat, as is otherwise necessary to avoid any health risks recognize. The warning system 100 described here; 150 is therefore particularly suitable for contactless and, in particular, body-contactless monitoring based on the purely visually obtained video data stream 101c; also of those vital signs that normally require or provide for physical touch and examination of the child.

The warning device 100 and/or its display unit 106; 106b; 106c; 106d; 107; 206; If an existing and/or impending health hazard is identified, 207 issues a visual, optical, textual, verbal, acoustic and/or other warning, which also contains information about the specific type of health hazard that may exist or threaten. Alternatively or in addition to the warning, the video data stream 101c itself, ie the recorded video, can also be output; for example on a display 106; 106d; 206 or the HMI 107; 207, e.g. in the area of the center console or the dashboard or the glove compartment. Such a warning and/or the video can also be output or transmitted via loudspeakers 106c or via the warning signal lines 106a or can be output or transmitted wirelessly by a warning signal transmitter 106b; For example, the warning can be sent or transmitted wirelessly to a smartphone belonging to the driver or front passenger or to the display installed in the vehicle (HMI, etc.).

It is preferably provided that the pattern recognition unit 102 as in 1 shown (and/or the danger determination unit) comprises a body simulation unit 104, which reconstructs the position of the body, the posture and/or body characteristics of an observed small child in three dimensions from the video data stream 101c and/or tracks it over time. Furthermore, it can be provided that the danger determination unit 103 determines the existence and/or threat of a potential health hazard based on the three-dimensionally reconstructed and/or time-tracked body image. Thus, instead of the original two-dimensional video (which is not necessarily displayed continuously, but is at least continuously available), a three-dimensional reconstruction of the child, its body parts and body movements is created. Such a 3D simulation is missing from simple alarm systems that are intended to prevent break-ins or theft and only respond to changes in the two-dimensional image area (and then immediately sound the alarm).

• - aus dem Videodatenstrom 101 c und/oder
• - aus dem dreidimensional rekonstruierten und/oder zeitlich nachverfolgten Körperbild

tatsächliche und/oder momentane Vitalfunktionswerte des beobachteten Kleinkindes errechnet und/oder diese Werte mit menschlichen Vitalfunktionswerten, wie sie typischerweise bei einem Kleinkind zu erwarten sind, oder mit sonstigen Norm- oder Sollwerten vergleicht. Beispielsweise kann die Warnvorrichtung 100 und/oder die Gefahrermittlungseinheit 103 den Pupillenstand, die Gesichtsfarbe und/oder die Sichtbarkeit oder Zugänglichkeit des Kopfs, des Gesichts, der Augen, des Mundes und/oder der Nase eines Kleinkindes überwachen; dies sind rein visuell beobachtbare Eigenschaften des Kindes und/oder seiner Kleidung.Preferably, the warning device 100 and/or its danger detection unit 103 includes a vital function testing unit 105, which monitors compliance with at least one human vital function of the observed small child by

• - from the video data stream 101c and/or
• - from the three-dimensionally reconstructed and/or temporally tracked body image

calculates actual and/or current vital function values of the observed small child and/or compares these values with human vital function values, as can typically be expected in a small child, or with other standard or target values. For example, the warning device 100 and/or the danger detection unit 103 may monitor the pupil level, facial color, and/or the visibility or accessibility of an infant's head, face, eyes, mouth, and/or nose; These are purely visually observable characteristics of the child and/or their clothing.

In addition, however, the warning device 100 and/or the danger detection unit 103 can also monitor vital functions of the small child that can normally only be determined by touching or feeling or by measuring, such as breathing behavior or the pulse, for example by raising and lowering the chest as a function of time is recorded and evaluated. This makes it possible to detect incorrect breathing, such as pauses in breathing or pauses in breathing, but also an impending risk of suffocation if the child's face is facing away from the camera or if the arms or other objects in the video image cover the nose or mouth. Breathing can then be indirectly recognized based on the (particularly three-dimensionally reconstructed) positional movements of the head and/or occasional movements of the shoulders, arms or legs, etc.

When monitoring the posture, movement patterns and/or changes in position of the small child and/or its body parts, checking the vital signs goes beyond just passive observation or filming. With conventional use of video cameras, the video data is simply recorded, forwarded and possibly played back and perhaps collected for storage. However, the video data is normally not processed in the manner suggested here and used or converted to generate an actively or proactively issued danger warning.

All features, properties and explanations of the invention and its exemplary embodiments described so far apply except for 1 and 2 also for the remaining figures and other exemplary embodiments mentioned below; Therefore, repetitions are omitted for the sake of brevity.

• - hinsichtlich einer denkbaren Aufteilung der Warnvorrichtung 100; 150 in mehrere Komponenten und
• - hinsichtlich möglicher Informationsflüsse zwischen diesen Komponenten veranschaulicht wird.

3 shows a schematic representation of an embodiment of the warning device 100 according to the invention; 150. This can be identical to that of 1 and/or 2 or deviate from it. Opposite 1 the representation differs 3 in that here is an exemplary embodiment

• - with regard to a conceivable division of the warning device 100; 150 into several components and
• - is illustrated with regard to possible information flows between these components.

A central unit (head unit or control unit) can be provided, in which in particular the pattern recognition unit 102 (preferably including the body simulation unit 104) and the danger determination unit 103 (preferably including the vital function testing unit 105) are contained. The central unit can serve as a control unit and be installed somewhere on or in the vehicle; If necessary, as a retrofit kit 150 or a component thereof in order to subsequently expand the functions of other components.

The central unit can be radio or wireless or wired with a display 106; 106d; 206 or with an HMI unit 107; 207 be connected, where the user or operator 300 of the warning device 100 according to the invention; 150 (e.g. the driver or passenger in the vehicle) can enter their own operator or user input (e.g. manually by key or touchpad input or by voice instructions; if necessary while driving) to the warning device 100 according to the invention; 150 to program, train and/or correct through his own personal analyzes and instructions as to which supposedly recognized, existing or impending health danger corresponds to an actual existing or impending health risk for the small child and which does not. For this purpose, the warning device 100 according to the invention can be used; 150 can be designed as a learning, self-learning and / or interactively or iteratively programmable system, which over time, through the corrections of its operator 300, provides increasingly reliable forecasts about any dangers to the child.

Relevant instructions, inputs and/or settings that the operator 300 programs or otherwise enters (as in 3 recognizable by the lowest, upward arrow) from the operator via the display unit 106; 107; 106; 207 to the central unit and/or its components 102; 103; 104; 105 (and possibly also to other components connected to it).

• - ein Lautsprecher zur Sprachausgabe bzw. zur akustischen Warnung des Bedieners 300 bzw. Fahrers oder Beifahrers und/oder
• - ein Mikrofon zur Entgegennahme von Anweisungen und/oder Korrekturen des Bedieners 300 vorgesehen sein.

Alternatively or in addition to the display 106d; 106; 107 or the HMI unit 107; 207 or other display unit 106 (screen; monitor) for displaying textual, pictorial or graphical text warnings

• - a loudspeaker for voice output or for acoustic warning of the operator 300 or driver or passenger and / or
• - A microphone for receiving instructions and/or corrections from the operator 300 may be provided.

The central unit of the warning device 100 according to the invention can use this; 150 thus issue and/or cause acoustic, visual and/or other warnings. Such warnings and other information arrive (as in 3 indicated by the bottom downward arrow) from the central unit or one of its components to the display unit 106; 106d; 107; 206; 207 and via this to operator 300.

The warning device according to the invention preferably shows 100; 150 does not send the video recording 101c to the operator 300 constantly or continuously, but only when or only such occasional periods of time when a possible health risk has been recognized. This relieves the driver of unnecessary worries and distractions while driving.

• - durch eine oder mehrere Videokameras 101a; 101b etc. (ggfs. über etwaige Umlenkspiegel bzw. Baby-Spiegel),
• - durch eine Innenraumbeleuchtung 300 wie beispielsweise eine Infrarotquelle 340, einen Restlichtverstärker 350 oder ein Nachtsichtgerät 360 (welche ggfs. auch zusätzlich zur eigentlichen Videokamera ein- oder zuschaltbar sind, um bei Nacht oder während kürzerer Tunnelfahrten einen aussagekräftigen Bildinhalt sicherzustellen),
• - durch einen Bewegungssensor 310, wie er beispielsweise in einer Diebstahl-Warnanlage 320 enthalten ist, oder
• - durch sonstige, bereits zu anderen Zwecken installierten oder nachträglich eingebauten Komponenten.

The information, in particular the image material for the video data stream 101c, can be used by the warning device 100 according to the invention; 150 from different sources (see the upper arrows in 3 ); for example (optional or combined)

• - through one or more video cameras 101a; 101b etc. (if necessary via any deflection mirrors or baby mirrors),
• - through an interior lighting 300 such as an infrared source 340, a residual light amplifier 350 or a night vision device 360 (which can also be switched on or off in addition to the actual video camera in order to ensure meaningful image content at night or during shorter tunnel journeys),
• - by a motion sensor 310, such as that contained in an anti-theft alarm system 320, or
• - through other components already installed for other purposes or subsequently installed.

This allows subsequent functional expansions of existing components to be achieved. If, for example, the video camera or component of a motion sensor 310 or an anti-theft alarm system 320 is used, they receive a new function in that a detected movement is now not used to trigger an alarm immediately, but conversely the presence, the duration and / or the distance of breaks in movement during which the child does not move is used to generate a warning about a potential health risk (e.g. prolonged pause in breathing, etc.; see above). This means that the driver is actively informed and warned if there is no or no regular driving for a long time Movement of the child's (for example) chest can be measured or reconstructed, whereas if movement can be recognized at least at intervals, this is considered a harmless normal health condition, during which no warning is displayed and/or playback of the video data stream 101c is suppressed.

The warning device 100 according to the invention; 150 is particularly suitable for bringing together information from different sources and/or structural components that actually belong to other systems or devices or vehicle equipment and/or actually serve other purposes in order to issue warnings regarding possible risks to the child's health or to issue these with greater accuracy or reliability.

• - eine Einrichtung zur Überprüfung des Sicherheitsgurts des Kindersitzes oder des Kindes (zum Überprüfen, ob der Gurt korrekt angelegt ist),
• - eine Einrichtung zur Überprüfung der sicheren Befestigung des Kindersitzes selbst (z.B. am Rücksitz),
• - eine sonstige Infrarot-Sicherung gegen Einbruch, die verwendbar ist, um zu erkennen, ob ggfs. das Gesicht des Kindes und insbesondere seine Atemöffnungen oder der ansonsten freie Hals durch Kleidung, Plastiktüten oder sonstige Gegenstände verdeckt ist und möglicherweise Ersticken droht.

Apart from the components listed up to this point, further components can also be incorporated into the warning device 100 according to the invention; 150 be included and/or associated with it; for example

• - a device for checking the seat belt of the child seat or the child (to check whether the belt is correctly fastened),
• - a device for checking whether the child seat itself is securely fastened (e.g. on the back seat),
• - another infrared security device against burglary that can be used to detect whether the child's face and in particular its breathing openings or the otherwise free neck is covered by clothing, plastic bags or other objects and is potentially at risk of suffocation.

Any other components can therefore also be included in the warning device according to the invention. The communication between these components, if it is wireless, can take place in particular via WLAN or Bluetooth, otherwise via electrical lines or fiber optic lines.

4 shows schematically a possible flowchart of the method 400 proposed here. Only a process step sequence of method steps S101 to S106 is shown, which can lead to a single warning. Of course, this process sequence is constantly repeated, since the video data stream 101c also arrives uninterrupted and must be checked again and again to see whether a health risk is imminent or whether a warning needs to be generated.

• - den Verfahrensschritt S101 des Beobachtens eines in einem Fahrzeug befindlichen Kleinkindes mit Hilfe einer Videoeinheit 101 zum Erzeugen des Videodatenstroms 101c (bzw. neuer Bilder bzw. Bildfolgen davon),
• - den Verfahrensschritt S102 des Analysierens des Videodatenstroms 101c bzw. des Durchführens einer Mustererkennung, wobei auf Basis des Videodatenstroms 101c das Kleinkind, dessen Körper und/oder dessen Körperhaltung erkannt wird,
• - den Verfahrensschritt S103 des Durchführens einer Gefahrermittlung bei der auf der Grundlage (hauptsächlich oder zumindest unter anderen) des Videodatenstrom 101c ermittelt wird, ob und/oder wann für die Gesundheit eines in dem Fahrzeug befindlichen Kleinkindes eine potenzielle Gesundheitsgefahr besteht und/oder droht, und
• - den Verfahrensschritt S106 des Ausgebens, Anzeigens und/oder Aussendens einer visuellen, optischen, textlichen, sprachlichen, akustischen und/oder anderweitigen Warnung über die potenzielle Gesundheitsgefahr für das Kleinkind (und/oder des Videodatenstroms selbst), sofern eine bestehende und/oder drohende Gesundheitsgefahr ermittelt wird.

The method 400 proposed here for monitoring vital health functions can in particular include the following sequence of method steps and repeat this sequence of method steps continuously, at predetermined time intervals or in a time-interleaved manner:

• - the method step S101 of observing a small child in a vehicle with the aid of a video unit 101 for generating the video data stream 101c (or new images or image sequences thereof),
• - the method step S102 of analyzing the video data stream 101c or carrying out pattern recognition, the small child, its body and/or its posture being recognized on the basis of the video data stream 101c,
• - the method step S103 of carrying out a risk determination in which, on the basis (mainly or at least among others) of the video data stream 101c, it is determined whether and/or when there is and/or is a potential threat to the health of a small child in the vehicle, and
• - the method step S106 of issuing, displaying and/or sending a visual, optical, textual, linguistic, acoustic and/or other warning about the potential health risk to the small child (and/or the video data stream itself), if an existing and/or impending one health hazard is identified.

• - den Verfahrensschritt S104 des Durchführens einer Körpersimulation, bei der anhand des Videodatenstroms die Position des Körpers, die Körperhaltung und/oder Körpereigenschaften eines beobachteten Kleinkindes dreidimensional rekonstruiert und/oder zeitlich nachverfolgt werden, und
• - den Verfahrensschritt S105 des Durchführens einer Vitalfunktionsprüfung für das beobachtete Kleinkind, bei der aus dem Videodatenstrom und/oder aus einem dreidimensional rekonstruierten und/oder zeitlich nachverfolgten Körperbild tatsächliche und/oder momentane Vitalfunktionswerte des beobachteten Kleinkindes errechnet und mit menschlichen Vitalfunktionswerten, wie sie typischerweise bei einem Kleinkind zu erwarten sind, oder mit sonstigen Norm- oder Sollwerten verglichen werden.

The method 400 and/or the sequence of method steps can in particular also include the following steps:

• - the method step S104 of carrying out a body simulation, in which the position of the body, the posture and / or body properties of an observed small child are reconstructed three-dimensionally and / or tracked in time using the video data stream, and
• - the method step S105 of carrying out a vital function test for the observed small child, in which actual and/or current vital function values of the observed small child are calculated from the video data stream and/or from a three-dimensionally reconstructed and/or time-tracked body image and with human vital function values, as are typically the case are to be expected in a small child, or can be compared with other standard or target values.

Thanks to the warning device 100 according to the invention; 150 and method 400, health risks to the child can be identified at an early stage without the driver or passenger having to constantly concentrate on a video image of the child in the rear-view mirror, in a display or an HMI; This increases comfort and makes it easier to concentrate on the vehicle, the traffic or the surroundings and ultimately also increases driving safety.

The claimed warning device 100; 150 and the claimed method 400 may be configured to carry out all or part of the vital functions control described herein. The warning device 100; 150 may include a programmable microcomputer or microcontroller, and the method 400 may be in the form of a computer program product with program code means. The computer program product can also be stored on a computer-readable data carrier. Features or advantages of the method 400 can be applied to the device 100; 150 can be transferred and vice versa.

• Es kann vorgesehen sein, dass die Mustererkennungseinheit 102 und/oder die Gefahrermittlungseinheit 103 eine Körpersimulationseinheit 104 umfasst, die aus dem Videodatenstrom 101c die Position des Körpers, Körperhaltung und/oder Körpereigenschaften eines beobachteten Kleinkindes dreidimensional rekonstruiert und/oder zeitlich nachverfolgt, und dass die Gefahrermittlungseinheit 103 das Bestehen und/oder Drohen einer potenziellen Gesundheitsgefahr anhand des dreidimensional rekonstruierten und/oder zeitlich nachverfolgten Körperbildes ermittelt.

Finally, various embodiment variants are listed below, which can be combined with each embodiment described above, shown in the figures or claimed in the claims:

• It can be provided that the pattern recognition unit 102 and/or the danger determination unit 103 comprises a body simulation unit 104, which reconstructs the position of the body, posture and/or body characteristics of an observed small child in three dimensions from the video data stream 101c and/or tracks them over time, and that the danger determination unit 103 determines the existence and/or threat of a potential health hazard based on the three-dimensionally reconstructed and/or time-tracked body image.

• - aus dem Videodatenstrom 101c und/oder
• - aus dem dreidimensional rekonstruierten und/oder zeitlich nachverfolgten Körperbild

tatsächliche und/oder momentane Vitalfunktionswerte des beobachteten Kleinkindes errechnet und diese mit menschlichen Vitalfunktionswerten, wie sie typischerweise bei einem Kleinkind zu erwarten sind, oder mit sonstigen Norm-oder Sollwerten vergleicht.Furthermore, it can be provided that the warning device 100 and/or the danger determination unit 103 comprises a vital function testing unit 105, which monitors compliance with at least one human vital function of the observed small child by

• - from the video data stream 101c and/or
• - from the three-dimensionally reconstructed and/or temporally tracked body image

actual and/or current vital function values of the observed small child are calculated and these are compared with human vital function values, as can typically be expected in a small child, or with other standard or target values.

Furthermore, it can be provided that the warning device 100 and/or the danger determination unit 103
monitors pupil size, facial color, and/or visibility or accessibility of an infant's head, face, eyes, mouth, and/or nose.

Alternatively or additionally, it can be provided that the warning device 100 and/or the danger determination unit 103
monitors the breathing behavior, pulse, posture, movement patterns and/or changes in position of the infant and/or its body parts and/or any other vital function of the infant that can be determined by observing, touching and/or feeling,
wherein the monitoring is carried out without contact and in particular without physical contact on the basis of the purely visually obtained video data stream 101c.

• - die Position, Körperhaltung, Bewegung und/oder Körpereigenschaften eines in dem Kindersitz befindlichen Kleinkindes zu erfassen und/oder
• - außerhalb des Kindersitzes befindliche Bildbereiche nachrangig zu berücksichtigen und/oder zu ignorieren.

Furthermore, it can be provided that the video unit 101 and/or the video camera 101a of the warning device 100 is aligned and/or coordinated with a child seat arranged in a rear area of a vehicle interior and that the image recognition unit, ie pattern recognition unit 102 and/or the body simulation unit 104 is programmed to

• - to record the position, posture, movement and/or body characteristics of a small child in the child seat and/or
• - image areas outside the child seat should be given secondary consideration and/or ignored.

• - einen in einem hinteren Bereich eines Fahrzeug-Innenraums angeordneten und/oder nach hinten ausgerichteten Kindersitz,
• - einen sonstigen Gegenstand und/oder
• - ein Referenzbild

als statisches oder zumindest weniger stark veränderliches Referenzobjekt für die Beobachtung des Kleinkindes zu verwenden.Furthermore, it can be provided that the pattern recognition unit 102 and/or the body simulation unit 104 is programmed to

• - a child seat arranged in a rear area of a vehicle interior and/or facing backwards,
• - another item and/or
• - a reference image

to be used as a static or at least less changeable reference object for observing the small child.

• - eine Innenraumkamera 201a, die in oder an einem Innenraum-Rückspiegel, einem Armaturenbrett, einer Mittelkonsole oder einer HMI-Einheit 107; 207 angeordnet ist,
• - eine Innenraumkamera 201b und/oder einen Umlenkspiegel, die bzw. der in oder an einer Heckscheibe, an einer Rücksitz-Kopfstütze, an einem Fahrzeugdach oder anderswo in einem hinteren Bereich eines Fahrzeug-Innenraums angeordnet ist, und/oder
• - eine einschaltbare und/oder zuschaltbare Innenraumbeleuchtung 330 wie beispielsweise eine Infrarotquelle 340, einen Restlichtverstärker 350 oder ein Nachtsichtgerät 360

aufweist.Furthermore, it can be provided that the video unit 102

• - an interior camera 201a, which is located in or on an interior rearview mirror, an armature renbrett, a center console or an HMI unit 107; 207 is arranged,
• - an interior camera 201b and/or a deflection mirror which is arranged in or on a rear window, on a rear seat headrest, on a vehicle roof or elsewhere in a rear area of a vehicle interior, and/or
• - A switchable and/or switchable interior lighting 330 such as an infrared source 340, a residual light amplifier 350 or a night vision device 360

having.

Furthermore, it can be provided that the warning device 100 is a learning, self-learning and/or iteratively programmable warning device 100, in particular interactively programmable and/or trainable with the aid of user input.

Furthermore, a retrofit kit 150 is preferably provided for a vehicle for monitoring vital health functions in a small child, which includes the warning device 100 described here.

• - eine werksseitig installierte oder zusätzlich eingebaute Innenraumkamera 201a; 201b und/oder
• - eine werksseitig installierte oder zusätzlich eingebaute Anzeigeeinheit 206a aufweist.

The retrofit kit 150 and/or the warning device 100 can be installed in a vehicle 200, which

• - a factory-installed or additionally installed interior camera 201a; 201b and/or
• - Has a factory-installed or additionally installed display unit 206a.

The retrofit kit 150 and/or the warning device 100 can be used to expand the functionality of the interior camera 201a; 201b, i.e. an optical interior monitoring system 211a and in particular wired or wirelessly with the interior camera 201a; 201b or this interior monitoring system 211a or another display unit or output device 206a.

• - Beobachten S101 eines in einem Fahrzeug befindlichen Kleinkindes mit Hilfe einer Videoeinheit 101, wodurch ein Videodatenstrom 101c erzeugt wird,
• -Analysieren des Videodatenstroms 101c, wobei eine Bilderkennung, d.h. eine Mustererkennung S102 durchgeführt wird, bei der auf Basis des Videodatenstroms 101c ein durch die Videoeinheit 101 beobachtetes Kleinkind, dessen Körper und/oder dessen Körperhaltung erkannt wird,
• - Durchführen einer Gefahrermittlung S103, wobei auf dem Videodatenstrom 101c basierend ermittelt, ob und/oder wann für die Gesundheit eines in dem Fahrzeug befindlichen Kleinkindes eine potenzielle Gesundheitsgefahr besteht und/oder droht, und
• - Ausgeben S106, Anzeigen und/oder Aussenden
• - einer visuellen, optischen, textlichen, sprachlichen, akustischen und/oder anderweitigen Warnung über die potenzielle Gesundheitsgefahr für das Kleinkind und/oder
• - des Videodatenstroms 101c, wenn eine bestehende und/oder drohende Gesundheitsgefahr ermittelt wird.

Furthermore, a method 400 for monitoring vital health functions in an infant in a vehicle may be performed, comprising the following steps:

• - observing S101 a small child in a vehicle with the aid of a video unit 101, whereby a video data stream 101c is generated,
• -analyzing the video data stream 101c, whereby an image recognition, ie a pattern recognition S102, is carried out, in which, on the basis of the video data stream 101c, a small child observed by the video unit 101, whose body and/or its posture is recognized,
• - Carrying out a risk determination S103, which determines based on the video data stream 101c whether and/or when there is and/or is a potential threat to the health of a small child in the vehicle, and
• - Issue S106, display and/or broadcast
• - a visual, optical, textual, verbal, acoustic and/or other warning about the potential health risk to the infant and/or
• - the video data stream 101c if an existing and/or impending health risk is identified.

• - das Durchführen einer Körpersimulation S104, bei der anhand des Videodatenstroms 101c die Position des Körpers, die Körperhaltung und/oder Körpereigenschaften eines beobachteten Kleinkindes rekonstruiert und/oder zeitlich nachverfolgt wird, umfassen sowie
• - das Durchführen einer Vitalfunktionsprüfung S105 für das beobachtete Kleinkind, bei der
• - aus dem Videodatenstrom 101c und/oder
• - aus einem dreidimensional rekonstruierten und/oder zeitlich nachverfolgten Körperbild

tatsächliche und/oder momentane Vitalfunktionswerte des beobachteten Kleinkindes errechnet und mit menschlichen Vitalfunktionswerten, wie sie typischerweise bei einem Kleinkind zu erwarten sind, oder mit sonstigen Norm- oder Sollwerten verglichen werden.Furthermore, the procedure can

• - Carrying out a body simulation S104, in which the position of the body, the posture and/or body properties of an observed small child is reconstructed and/or tracked over time using the video data stream 101c, as well as
• - carrying out a vital function test S105 for the observed infant
• - from the video data stream 101c and/or
• - from a three-dimensionally reconstructed and/or time-tracked body image

Actual and/or current vital function values of the observed small child are calculated and compared with human vital function values, as can typically be expected in a small child, or with other standard or target values.

Reference symbols

100

Warning device

101

Video unit

101a

video camera

101b

Video signal line

101c

Video data stream

102

Pattern recognition unit

103

Hazard Investigation Unit

104

Body simulation unit

105

Vital functions testing unit

106

Output facility

106a

Warning signal line

106b

Warning signal transmitter

106c

speaker

106d

display

107

HMI; Human-machine interface

110

Surveillance mirror

150

Retrofit kit

200

vehicle

201a; 201b

Interior camera

205

row of seats further forward

206

Output facility

207

HMI; Human-machine interface

210

child seat

211a

optical interior surveillance system

215

row of seats further back

300

operator

310

Motion sensor

320

Anti-theft alarm system

330

Interior lighting

340

Infrared source

350

residual light amplifier

360

Night vision device

400

Proceedings

S101 - S106

Procedural step

Claims (15)

Warning device (100) for monitoring a small child on board a vehicle, the warning device (100) comprising: - at least one monitoring mirror (110) for monitoring a small child while driving, - a video camera (101a) which captures the surveillance mirror (110) in order to film a small child or its mirror image via the surveillance mirror (110), - a pattern recognition unit (102), which is set up to recognize the posture and/or a body characteristic of a filmed small child on the basis of a video data stream (101c) from the video camera (101a); and - a danger detection unit (103) which is set up to determine a potential health risk for the small child on the basis of the posture and/or a body characteristic. Warning device after Claim 1 , - the warning device (100) is installed in a vehicle with a row of seats (205) further forward and a row of seats (215) further back and - the video camera (101a) in the area of the row of seats (205) further forward vehicle is attached. Warning device after Claim 1 or 2 , wherein the at least one monitoring mirror (110) is located in the area of the further back row of seats (215) of the vehicle and is arranged in order to use the video camera (101a) to monitor a small child who is in a child seat (101a) via the monitoring mirror (110). 210) - is arranged in the row of seats (215) further back and / or - is aligned with its viewing direction opposite to the direction of travel of the vehicle (200) to film the face or its mirror image reflected by the monitoring mirror (110). Warning device according to one of the Claims 1 until 3 , further comprising an output device (106) in order to output a warning message and/or the video data stream (101c) to a person in the vehicle (200) in the event of an identified health risk. Warning device after Claim 4 , wherein the output device (106) comprises a display (106d) in order to visually output the warning message to a driver and/or passenger located in the further forward seat row (205) of the vehicle. Warning device after Claim 4 or 5 , wherein the output device (106) and / or an associated display (106d) is set up to display an enlarged partial image obtained from the video data stream (101c), which - contains a selective close-up of the small child, his body and / or his face and - Can be observed from the row of seats (205) further forward on a larger scale and/or from a larger angle of view than when looking at the small child through an interior rear-view mirror or from an interior rear-view mirror. Warning device according to one of the preceding claims, wherein the monitoring mirror (110) is mounted behind, next to and/or above the row of seats in which a child seat for a small child is mounted. Warning device according to one of the preceding claims, wherein the monitoring mirror (110) is - convexly curved and / or - divided into several mirror surfaces in order to - reflect a larger solid angle range and / or - several solid angle ranges into a detection range of the video camera (101a). Warning device according to one of the preceding claims, wherein the video camera (101a) is set up to detect visible light, amplify visible residual light and / or detect radiation in the infrared range. Warning device according to one of the preceding claims, wherein the video camera (101a) is mounted in the area of an interior rear-view mirror through which a driver or passenger can look into the monitoring mirror (110). Warning device according to one of the preceding claims, that the warning device (100) and / or the danger determination unit (103) comprises a vital function testing unit (105) which monitors compliance with at least one human vital function of the observed small child by - from the video data stream (101c) and/or - current vital function values of the toddler are calculated from a three-dimensionally reconstructed and/or time-tracked body image of the toddler and compared with expected standard or target values for small children. Warning device according to one of the preceding claims, wherein the warning device (100) is set up to determine by means of the video camera (101a) and via the monitoring mirror (110) by observing a child seat (210) located in the vehicle (200) whether and / or when a small child is in the child seat (210). Vehicle (200), wherein the vehicle (200) has a warning device (100) according to one of the preceding claims. Using an optical interior monitoring system (211a) of a vehicle (200) to monitor an infant on board the vehicle (200); - wherein the vehicle (200) comprises a row of seats (205) located further forward and a row of seats (215) located further back; - wherein in the vehicle (200) a small child is held in the row of seats (215) located further back and/or is aligned with his line of sight opposite to the direction of travel; - wherein at least one monitoring mirror (110) is provided, which is designed to enable or at least make it easier for a driver and/or front passenger to observe the small child from the row of seats (205) located further forward; and -wherein the optical interior monitoring system (211a) comprises a video camera (101a) which has a detection area in which at least a section of the monitoring mirror lies. Method for monitoring a small child on board a vehicle (200) which has a row of seats (205) located further forward and a row of seats (215) located further back, - wherein in the vehicle (200) a small child is held in the row of seats (215) located further back and/or is aligned with his line of sight opposite to the direction of travel; -wherein a monitoring mirror (110) is provided, which is designed to enable or at least make it easier for a driver and/or front passenger to observe the small child from the row of seats (205) located further forward; -wherein the vehicle (200) comprises an optical interior monitoring system (211a) with a video camera (101a) which has a detection area in which at least a portion of the monitoring mirror (110) lies, and - the method comprising at least the following steps: - Capturing (S101) a mirror image of the toddler filmed via the monitoring mirror (110) with the video camera (101a); - Detecting (S102) the posture and/or a physical characteristic of the child based on a video data stream (101c) output by the video camera (101a); and - Determine (S103) a potential health hazard to the infant based on the child's posture and/or physical characteristics.

Images