GB2608131A

GB2608131A - Monitoring device for monitoring the interior of a vehicle

Info

Publication number: GB2608131A
Application number: GB2108944.6A
Authority: GB
Inventors: Muntean Marius-Andrei
Original assignee: Continental Automotive GmbH
Current assignee: Continental Automotive GmbH
Priority date: 2021-06-22
Filing date: 2021-06-22
Publication date: 2022-12-28
Also published as: GB202108944D0

Abstract

The present invention is related to monitoring device 1 for monitoring the interior of a vehicle 1000 and associated method. The device comprising a Wi-Fi transmitter 2 for transmitting Wi-Fi signals, a Wi-Fi receiver 3 for receiving Wi-Fi signals, and a processor 4 that is operatively coupled to the receiver. The processor is configured to process the received Wi-Fi signals and to create, based on the processed Wi-Fi signals, a three-dimensional map of the interior of the vehicle. The receiver 3 detecting reflected signals from objects 10, 20, 30, 40, 50 in the vehicle 1000. The arrangement may track objects in the vehicle, recognise a state of the objects and be arranged to activate or control a vehicle function.

Description

Monitoring device for monitoring the interior of a vehicle The present invention relates to a monitoring device for monitoring the interior of a vehicle, and to a method of monitoring the interior of a vehicle.

Monitoring devices used for the monitoring of the interior of a vehicle are well known. For example, in-vehicle camera (often called vehicle interior camera) systems using a sensor in the visible or infrared (infrared: IR) range for the monitoring of the driver or other passengers of the vehicle are known. Use of in-vehicle camera systems has been introduced to passenger vehicles for various purposes, in particular, to monitor and gather information concerning driver's condition, or even to recognize gesture of drivers. Driver monitoring may provide gaze target recognition, face recognition or drowsiness classification. Standard swipe gestures or custom specific gestures can be implemented.

Furthermore, it is known to use seat occupancy sensors to recognize whether a seat in the interior of the vehicle is occupied or not.

There are some drawbacks known from these sort of monitoring devices. For example, in-vehicle camera systems using sensors in the visible range or IR range need a direct line of sight to capture passengers, e.g. the face of a passenger, gestures of a passenger or the condition of the interior of the vehicle itself. Thus, an in-vehicle camera system usually is used to monitor only the driver. If additional passengers in the vehicle interior or the vehicle interior itself are to be monitored with a camera system, additional sensors are usually required to observe each individual passenger inside the vehicle or the vehicle interior.

Seat occupancy sensors can be tricked by placing a heavy object on the seat. Furthermore, seat occupancy sensors only give limited information.

It is an object of the present invention to provide a monitoring device which enables easier monitoring of the vehicle interior.

This object is solved by a monitoring device for monitoring the interior of a vehicle 5 with the features of claim 1 and a method with the features of claim 11.

The dependent claims include advantageous further developments and improvements of the present principles as described below.

According to an aspect of the invention, a monitoring device for monitoring the interior of a vehicle comprises a Wi-Fi transmitter, a Wi-Fi receiver and a processor. Both the Wi-Fi transmitter and the receiver comprise an antenna or are configured as such to be able to transmit or receive Wi-Fi signals. The processor is operatively coupled to the receiver and processes the received Wi-Fi signals to create based on the processed Wi-Fi signals a three-dimensional map of the interior of the vehicle.

Several objects are transparent or almost transparent to Wi-Fi signals. By using Wi-Fi signals to monitor the vehicle interior, it becomes thus possible to monitor the interior without having to have a direct line of sight between an object inside the interior to be monitored and a sensor, as must be the case with camera systems, for

example.

Nowadays vehicles often comprise Wi-Fi systems. Therefore, existing Wi-Fi systems can be advantageously used, for example as Wi-Fi transmitter.

In a preferred embodiment of the present invention, the transmitter and the receiver are configured and/or arranged within the vehicle interior in such a way that the receiver receives Wi-Fi signals reflected and/or absorbed and/or scattered from an object within the vehicle interior. Additionally, the processor is configured to process these received Wi-Fi signals and to create the three-dimensional map of the interior of the vehicle based on the Signals indicating reflection and/or absorption and/or scattering from an object.

Wi-Fi signals are reflected and/or absorbed and/or scattered to different degrees depending on the object they hit. This makes it possible to determine the location, position, size and nature of an object inside the vehicle interior. Determining the nature of an object may, by way of example, include what material the particular object in the vehicle is made of.

In a further embodiment of the present invention, the processor is configured to track a movement of an object in the interior of the vehicle.

The processor can be configured to take measurements over any period of time by processing the received Wi-Fi signals over that time period. This makes it possible to determine whether monitored objects are moving and also how they are moving. For example, whether the entire object is moving or only a part of the object is moving. This makes it possible, for example, to distinguish animate objects from inanimate, e.g., fixed objects such as seats and the like. If the movements run in certain patterns, it can be concluded which object it is, for example a person or just a bottle rolling around inside the vehicle.

In a further embodiment of the present invention, the processor is configured to recognize a state of an object in the interior of the vehicle.

For example, the processor could be configured to infer what state the corresponding object is in based on movements of the object. For example, if the processor has determined an object to be a person when processing the Wi-Fi signals, the processor could be configured to determine the person's state based on the person's movement. For example, a certain movement pattern of an object identified as a person could be used to infer a sleeping state.

Additionally, the processor could, for example, also examine an object over a long period of time and determine that it has a uniformly flat surface, such as a car roof or a windowpane. If an accident occurs, the car roof may be dented and the windowpane broken. The processor can also use such a change of an object to infer a condition of the respective object.

In an embodiment of the present invention, the processor is configured to forward the three-dimensional map of the interior of the vehicle or single information of this map to any number of control units of the vehicle.

The three-dimensional map of the interior of the vehicle or single information of this map can be used by several vehicle functions. Therefore, the processor may be configured to forward the map or information of it to any number of control units of the vehicle.

In a further preferred embodiment of the present invention, the processor is configured to activate and/or control vehicle functions.

To activate and/or control vehicle functions, the processor can forward the three-dimensional map of the vehicle interior or information from it to control units of the vehicle. For this purpose, the processor can, for example, be operatively connected to one or more control units via an in-vehicle network or be designed modularly with one or more control units. Based on the processed Wi-Fi signals, the processor can then activate and/or control a vehicle function or cause a corresponding control unit to activate and/or control a corresponding vehicle function. The processor can be configured to automatically activate and/or control vehicle functions based on the processed Wi-Fi signals, without any action by a passenger in the vehicle.

In another preferred embodiment of the present invention, the vehicle function is at least one of an in-vehicle infotainment function, an in-vehicle climate function, an in-vehicle seat function and an in-vehicle safety function.

The following list is intended as an example of functions that correspond to the vehicle functions mentioned above. However, the list is not exhaustive. The in-vehicle infotainment functions may, for example, relate to functions of audio devices, video devices, navigation devices and/or interior lighting devices. In-vehicle climate functions may, for example, relate to air conditioning, temperature control within the vehicle, window controls, and/or ventilation systems. In-vehicle seating functions may, for example, relate to seat position adjustment and/or heating systems in seats. In-vehicle safety functions may, for example, include functions of a door lock system, of an alarm system, e.g., issuing an alarm with an infotainment system and/or seat vibration, of an emergency call system, and/or of an airbag system, e.g., concerning the deployment of airbags.

To activate and/or control corresponding vehicle functions, the processor can, for example, be connected to corresponding control units or systems via the in-vehicle network. For example, the processor via an in-vehicle network may be operatively coupled to an in-vehicle infotainment system, an in-vehicle climate system, in-vehicle seats and to an in-vehicle safety system.

For example, if the front passenger is asleep on the front passenger seat and this state is recognized by the monitoring unit, the processor can be configured to automatically adjust the seat position and turn down the volume of an audio system.

This can be used, for example, to increase comfort inside a vehicle.

Furthermore, the processor can, for example, automatically adjust ventilation direction based on the processed Wi-Fi signals.

As another example, based on the processed Wi-Fi signals, the processor can always determine the current location, position, and size of a person inside the vehicle. This information can be used, for example, by an airbag system for safe airbag deployment in a crash situation. This increases safety for vehicle occupants in crash situations.

In another embodiment of the present invention, the processor is configured for gesture recognition.

If the processor has determined that an object is a person, and the processed signals indicate, for example, a movement of a hand or finger, the processor can be configured to recognize such a movement as a gesture, causing it to activate and/or control a vehicle function.

Advantageously, gesture recognition can take place with the monitoring device throughout the vehicle interior without the need for a direct line of sight between sensors and the person performing the gesture. This makes it possible for gestures of all persons inside the vehicle to be monitored, regardless of where they are in the vehicle.

In conjunction with an embodiment in which the processor is configured to activate and/or control vehicle functions, vehicle functions can thus be activated and/or controlled via gesture recognition.

For example, the processor may be configured such that a first gesture turns up a volume of an in-vehicle infotainment system, while a second gesture turns down the volume.

Among other things, gesture recognition increases the comfort in vehicles and simplifies the operability of corresponding vehicle functions.

In another embodiment of the present invention, the processor is configured for the recognition of a child seat placed in the vehicle interior.

In conjunction with an embodiment in which the processor is configured to activate and/or control vehicle functions, for example, the recognition of a child seat placed inside the vehicle, e.g., an installed child seat, can automatically trigger a door lock system to lock a door on one or more corresponding doors of the vehicle. This increases safety for children in vehicles.

In another embodiment of the present invention, the processor is configured for the recognition of a pet in the vehicle interior.

In conjunction with an embodiment in which the processor is configured to activate and/or control vehicle functions, for example, the recognition of a pet can automatically trigger an in-vehicle climate function, e.g., turn on the air conditioning or heating as required. This increases among other things the safety for pets in vehicles.

In another embodiment of the present invention, the processor is configured for the recognition of a dangerous situation.

A dangerous situation may be any situation causing danger to the vehicle interior or an object or a passenger or a pet inside the interior of the vehicle. By way of example, a dangerous situation may be an accident, if the driver falls into sleep, if someone breaks into the vehicle or if an unauthorized person tries to start the vehicle.

In conjunction with an embodiment in which the processor is configured to activate and/or control vehicle functions, for example, based on the recognition of the dangerous situation an automatic activation and/or control of an in-vehicle safety function can be triggered. For example, if a crash situation is recognized by the monitoring device, due to recognition of deformation of seats or the like, the processor may automatically trigger to call emergency services. This among other things increases the safety of vehicles. Furthermore, such embodiment may be used to replace alarm ultrasonic sensors which are used for monitoring the interior of a vehicle when it is parked.

Further aspects of the invention are described below. It will be apparent to those skilled in the art that the above features of embodiments of the monitoring device may also be used in conjunction with the following aspects of the invention and vice versa.

According to another aspect of the invention, a vehicle comprises a monitoring device for monitoring the interior of a vehicle as described above. The vehicle can be any vehicle for which the invention may be advantageously. The monitoring device according to the invention may be used in any vehicle in which such monitoring device is required.

According to a further aspect of the invention, a method of monitoring the interior of a vehicle comprises transmitting Wi-Fi signals by a Wi-Fi transmitter into the interior of the vehicle, receiving Wi-Fi signals by a Wi-Fi receiver, processing by a processor the received Wi-Fi signal and creating by the processor a three-dimensional map of the interior of the vehicle based on the processed Wi-Fi signals.

In an embodiment of the invention, the method further comprises configuring and/or arranging the transmitter and the receiver such that the receiver receives Wi-Fi signals reflected and/or absorbed and/or scattered from an object within the vehicle interior. In this embodiment, the method further comprises configuring the processor such that the creation of the three-dimensional map of the interior of the vehicle is based on the Signals indicating reflection and/or absorption and/or scattering from an object inside the vehicle interior. The processor, thus, processes signals reflected and/or absorbed and/or scattered from objects in the interior of the vehicle and based on these signals creates the three-dimensional map of the interior of the vehicle.

In yet another embodiment of the invention, configuring the processor comprises configuring the processor to track a movement of an object in the interior of the 20 vehicle.

In yet another embodiment of the invention, configuring the processor comprises configuring the processor to activate and/or control a vehicle function.

In yet another embodiment of the invention, configuring the processor comprises configuring the processor for gesture recognition.

Further features of the present invention will become apparent from the following description and the appended claims in conjunction with the figures.

Figures Fig. 1 shows schematically a vehicle comprising an embodiment of the invention, and Fig. 2 shows a sketch of an embodiment of a method according to the invention.

Detailed description

For a better understanding of the principles of the present invention, embodiments of the invention will be explained in more detail below with reference to the figures.

Like reference numerals are used in the figures for the same or equivalent elements and are not necessarily described again for each figure. It is to be understood that the invention is not limited to the illustrated embodiments and that the features described may also be combined or modified without departing from the scope of the invention as defined in the appended claims.

Figure 1 schematically shows a vehicle 1000 comprising a monitoring device 1 for monitoring the interior of the vehicle 1000 according to the invention. Here, the vehicle is a passenger vehicle.

The monitoring device 1 comprises a Wi-Fi transmitter 2, a Wi-Fi receiver 3 and a processor 4. The Wi-Fi transmitter 2 comprises an antenna which is part of a Wi-Fi Hot spot arranged in the interior of the vehicle 1000. The Wi-Fi transmitter 2 transmits Wi-Fi signals into the interior of the vehicle 1000. The receiver 3 also comprises an antenna. The receiver 3 receives the Wi-Fi signals transmitted by the transmitter 2. The processor 4 is operatively coupled to the receiver 3 and processes the received Wi-Fi signals. Via an in-vehicle network, the processor 4 is further operatively coupled to an in-vehicle infotainment system, an in-vehicle climate system, an in-vehicle seat system and to an in-vehicle safety system (not shown). The processor 4 is configured to activate and control different vehicle functions, such as in-vehicle infotainment functions of the in-vehicle infotainment system, in-vehicle climate functions of the in-vehicle climate system, in-vehicle seat functions of the in-vehicle seat system and in-vehicle safety functions of the in-vehicle safety system.

The transmitter 2 is arranged in a front part of the vehicle 1000 and the receiver 3 is arranged in a rear part of the vehicle 1000. Thus, the Wi-Fi signals emitted by the transmitter 2 are scattered, absorbed, and/or reflected by objects inside the vehicle, such as seats, passengers, windows, and controls, to varying degrees, for example, based on their size, nature, and position before the signals reach the receiver 3. The Wi-Fi signals are received by the receiver 3 and passed on to the processor 4, which processes the signals. Based on the received signals, which indicate reflection and/or absorption and/or scattering at objects, the processor 4 creates a three-dimensional map of the interior of the vehicle 1000.

In the following, an exemplary scenario related to the embodiment shown in Figure 1 is used to further explain the functions of the monitoring device 1.

Here, the three-dimensional map generated by the processor 4 includes not only the general interiors of the vehicle, such as the driver's seat, passenger seat, rear seats, steering wheel, trunk, windows and dashboards (not shown here), but also passengers 10, 20, 30 and objects 40, 50 that are not part of the vehicle interior itself.

Based on movement tracking and movement patterns derived therefrom, as well as the position and nature of objects 10, 20, 30, 40, 50 inferred by the processor 4 from the received Wi-Fi signals, the processor 4 determines that there is present in the vehicle a driver 10 behind the wheel, a passenger 20 in a passenger seat, a child 30 in a child seat 40, and a pet 50 in the trunk.

Based on the recognition that a child seat 40 is placed in the rear seat, the processor 30 4 has performed an automatic door lock of the doors at the rear seat. Based on a hand movement by the driver 10 that the processor 4 recognizes as a gesture, the processor 4 causes the volume of the radio to increase. Based on a recognition of the pet 50 in the trunk, the processor 4 automatically causes a window to open and/or adjusts a climate control function accordingly.

Based on the movement patterns of the passenger 20 in the passenger seat, the processor 4 recognizes that this person is sleeping and automatically adjusts the seat to a sleeping position and reduces the volume of the radio again. In addition, the processor 4 forwards information, such as size, location, e.g., reclining position, and position of a person in the vehicle interior, e.g., of the passenger 20 in the front passenger seat, to the airbag system, which adjusts the front passenger airbag accordingly.

The processor 4 recognizes based on the processed Wi-Fi signals that the vehicle 1000 is involved in an accident, which causes the processor 4 to automatically call emergency services.

Figure 2 shows a sketch of an embodiment of a method 100 of monitoring the interior of a vehicle according to the invention. The method 100 comprises transmitting 101 Wi-Fi signals by a Wi-Fi transmitter into the interior of the vehicle and receiving 102 VVi-Fi signals by a Wi-Fi receiver. The transmitter and the receiver are configured 110 such that the receiver receives Wi-Fi signals reflected and/or absorbed and/or scattered from an object within the vehicle interior.

The method 100 further comprises processing 103 by a processor the received Wi-Fi signals and creating 104 by the processor a three-dimensional map of the interior of the vehicle based on the processed Wi-Fi signals. The processor is configured 120 to base the creation 104 of the three-dimensional map of the interior of the vehicle on the Signals indicating reflection and/or absorption and/or scattering from an object inside the vehicle interior.

Optionally, the processor is configured to track a movement of an object in the interior of the vehicle. Optionally and/or alternatively, the processor is configured to recognize a state of an object in the interior of the vehicle. Optionally and/or alternatively, the processor is configured to activate and/or control a vehicle function. Optionally and/or alternatively, the processor is configured is configured for gesture recognition. Optionally and/or alternatively, the processor is configured for the recognition of an installed child seat in the vehicle interior. Optionally and/or alternatively, the processor is configured for the recognition of a pet in the vehicle interior. Optionally and/or alternatively, the processor is configured for the recognition of a dangerous situation.

Claims

Patent claims 1. Monitoring device (1) for monitoring the interior of a vehicle, the monitoring device (1) comprising: -a Wi-Fi transmitter (2) for transmitting Wi-Fi signals, - a Wi-Fi receiver (3) for receiving Wi-Fi signals, and - a processor (4) operatively coupled to the receiver (3), the processor (4) being configured to process the received Wi-Fi signals and being configured to create based on the processed Wi-Fi signals a three-dimensional map of the interior of the vehicle.
2. Monitoring device (1) according to claim 1, characterized in that the transmitter (2) and the receiver (3) being configured such that the receiver (3) receives Wi-Fi signals reflected and/or absorbed and/or scattered from an object (10), (20), (30), (40), (50) within the vehicle interior and the processor (4) being configured to create the three-dimensional map of the interior of the vehicle based on the Signals indicating reflection and/or absorption and/or scattering from an object (10), (20), (30), (40), (50).
3. Monitoring device (1) according to one of claims 1 or 2, characterized in that the processor (4) being configured to track a movement of an object (10), (20), (30), (40), (50) in the interior of the vehicle.
4. Monitoring device (1) according to one of the previous claims, characterized in that the processor (4) is configured to recognize a state of an object (10), (20), (30), (40), (50) in the interior of the vehicle.
5. Monitoring device (1) according to one of the previous claims, characterized in that the processor (4) is configured to activate and/or control a vehicle function
6. Monitoring device (1) according to claim 5, characterized in that the vehicle function is at least one of an in-vehicle infotainment function, an in-vehicle climate function, an in-vehicle seat function and an in-vehicle safety function.
7. Monitoring device (1) according to one of the previous claims, characterized in that the processor (4) is configured for gesture recognition.
8. Monitoring device (1) according to one of the previous claims, characterized in that the processor (4) is configured for the recognition of an installed child seat (40) in the vehicle interior.
9. Monitoring device (1) according to one of the previous claims, characterized in that the processor (4) is configured for the recognition of a pet (50) in the vehicle interior.
10. Monitoring device (1) according to one of the previous claims, characterized in that the processor (4) is configured for the recognition of a dangerous situation
11. Method (100) of monitoring the interior of a vehicle, the method comprising: - transmitting (101) Wi-Fi signals by a Wi-Fi transmitter into the interior of the vehicle, - receiving (102) Wi-Fi signals by a Wi-Fi receiver, -processing (103) by a processor the received Wi-Fi signal and - creating (104) by the processor a three-dimensional map of the interior of the vehicle based on the processed Wi-Fi signals.
12. Method (100) according to claim 11, characterized in that the method further comprising: -configuring (110) the transmitter and the receiver such that the receiver receives Wi-Fi signals reflected and/or absorbed and/or scattered from an object within the vehicle interior and -configuring (120) the processor such that the creation of the three-dimensional map of the interior of the vehicle is based on the Signals indicating reflection and/or absorption and/or scattering from an object inside the vehicle interior.
13. Method (100) according to one of claims 11 or 12, characterized in that configuring (120) the processor comprising configuring the processor to track a movement of an object in the interior of the vehicle.
14. Method (100) according to one of claims 11 to 13, characterized in that configuring (120) the processor comprising configuring the processor to activate and/or control a vehicle function.
15. Method (100) according to one of claims 11 to 14, characterized in that configuring (120) the processor comprising configuring the processor for gesture recognition.