WO2013107550A1 - Method for monitoring the environment of a vehicle - Google Patents

Method for monitoring the environment of a vehicle Download PDF

Info

Publication number
WO2013107550A1
WO2013107550A1 PCT/EP2012/073981 EP2012073981W WO2013107550A1 WO 2013107550 A1 WO2013107550 A1 WO 2013107550A1 EP 2012073981 W EP2012073981 W EP 2012073981W WO 2013107550 A1 WO2013107550 A1 WO 2013107550A1
Authority
WO
WIPO (PCT)
Prior art keywords
environment
mobile device
vehicle
assistance system
data
Prior art date
Application number
PCT/EP2012/073981
Other languages
German (de)
French (fr)
Inventor
Henning Von Zitzewitz
Karsten Muehlmann
Jan Egelhaaf
Raphael Cano
Leo VEPA
Original Assignee
Robert Bosch Gmbh
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to DE102012200721.0 priority Critical
Priority to DE102012200721A priority patent/DE102012200721A1/en
Application filed by Robert Bosch Gmbh filed Critical Robert Bosch Gmbh
Publication of WO2013107550A1 publication Critical patent/WO2013107550A1/en

Links

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/0011Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot associated with a remote control arrangement
    • G05D1/0038Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot associated with a remote control arrangement by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/105Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using multiple cameras
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/301Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/806Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for aiding parking
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8093Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for obstacle warning
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D2201/00Application
    • G05D2201/02Control of position of land vehicles
    • G05D2201/0213Road vehicle, e.g. car or truck

Abstract

The invention proposes a method for monitoring the environment of a vehicle, said method comprising the following steps: • recording environment data using an environment sensor system of a transmitter; • transmitting the environment data from the transmitter to a receiver • displaying at least one detail of the recorded vehicle environment on a display apparatus of the receiver, wherein the transmitter or the receiver is designed as a mobile unit and the displayed detail is determined by orientating the mobile unit. The invention also proposes a driving assistance system.

Description

 Description title

 The invention relates to a method for monitoring a vehicle environment. In addition, the invention relates to a driver assistance system and a computer program product for carrying out the method.

Driver assistance systems are additional devices in a vehicle that serve to assist the driver in certain driving situations. For this purpose, a driver assistance system comprises several subsystems such as a parking assistant, blind spot monitoring or a lane change assistant. Typically, these subsystems use data from on-vehicle environment sensors that monitor the environment of the vehicle through sensors such as optical sensors, ultrasonic sensors, or the like. A typical functionality of driver assistance systems is to present the environment of the vehicle to the driver on the basis of environment sensor data on a display of a man-machine interface.

From DE 10 2009 020 328 A1 a method is known, the differently well visible objects from the environment of the vehicle for a user from the perspective of a

Represents inmates. This is the environment of the vehicle with a

Object detection device automatically detected and displayed. For example, the user may be a person who monitors the execution of a maneuver and wirelessly receives information from the vehicle. In particular, the display device may be part of an external device outside the vehicle, wherein information from the

Vehicle can be transmitted to the external device and the user can choose his own or the perspective of the occupant.

DE 10 2008 034 606 A1 describes the representation of the environment of a vehicle on a mobile unit by at least one image signal, which the mobile unit from Vehicle receives wirelessly. In this case, a representation on the mobile unit is generated by the image signal, which contains a perspective arranged virtual plane on which a captured with a recording means of the vehicle image is displayed. In particular, the mobile unit is designed as a mobile phone.

Known driver assistance systems represent image data of the vehicle environment on a mobile unit. High demands are placed on this representation, so that the driver can grasp his surroundings intuitively and quickly. In this case, situation-specific features may occur, for example, objects in the vicinity of the vehicle, which require an adaptation of the environment representation.

Disclosure of the invention

According to the invention, a method for monitoring a vehicle environment

proposed comprising the following steps:

Capturing environmental data with a surround sensor of a transmitter;

 Transmitting the environment data from the transmitter to a receiver;

 Displaying at least a portion of the detected vehicle environment on a display device of the receiver, wherein the transmitter or the receiver is designed as a mobile device and the displayed section is determined by an orientation of the mobile device.

In general, environmental sensor means any sensor means of the transmitter, which characterize the environment of the transmitter. In an implementation of the method according to the invention, the environment sensor system comprises a camera system with one or more

Cameras recording video views of the environment. Additionally or alternatively, the environmental sensor system may also include a system based on at least one ultrasonic sensor, at least one radar sensor or at least one LIDAR sensor.

The environment data can thus include data that are detected by the environment sensor system, in particular a camera system of the transmitter. Thus, the environmental data can represent video systems based on the camera system and / or visualizations of ultrasound, LIDAR or radar data. In a further implementation of the method according to the invention, the

Transfer environment data via an interface on at least one wireless or wired data transmission path between transmitter and receiver. So can the

Data transmission, for example via an Ethernet, a Media Oriented Systems Transport (MOST), a USB, a Firewire, a WLAN, a Bluetooth, infrared and / or a Near Field Communication (NFC) interface take place , Furthermore, the data can be wirelessly transmitted, ie transmitted and / or received via the Universal Mobile Telecommunications System (UMTS), Global System for Mobile Communications (GSM) and / or Long Term Evolution (LTE).

In a further implementation of the method according to the invention, the transmitter is a driver assistance system that transmits environmental data to a mobile device as a receiver.

Alternatively, the transmitter may be a mobile device that inputs environmental data

Driver assistance system as a receiver sends.

A driver assistance system in this context refers to an additional device in the vehicle, which supports the driver in different driving situations. Typically, a driver assistance system includes various subsystems, such as an input and output

Ausparkassistenten, a Cross-Traffic Assistant or a Back-Up Assistant

 Monitoring of the vehicle environment, which generally takes place with the aid of an on-vehicle environment sensor. In this context, the environment sensor provides environment data concerning the vehicle environment. For this purpose, individual sensors of the environment sensor can

be installed at different locations on the vehicle to each record or monitor another section of the vehicle environment. That's how it works

 Driver assistance system act as a transmitter and provide environment data that can be transmitted at least partially via an interface to a mobile device as a receiver. In addition, the driver assistance system can be assigned a human-machine interface (HMI), which transmits information in optical, acoustic and / or haptic form to the driver. For this purpose, among other things, a display device, such as a display, be provided in the field of vision of the driver, which displays information optically.

In particular, the driver assistance system can be designed with a display assigned to the HMI to display environment data received from the mobile device. A mobile device referred to in the present context, a portable device that can be used anywhere. Different components can be integrated into the mobile device. For example, environmental sensor technology, such as a camera system with at least one camera, can be integrated into the mobile device. Additional sensors such as a compass system with at least one compass, a motion sensor system with at least one motion sensor and / or a positioning system with at least one Global Positioning System (GPS) sensor can continue to position and

Provide alignment of the mobile device relative to its environment. Thus, the mobile device can capture environmental data by environmental sensors and additional sensors that characterize the environment of the mobile device and at least partially from acting as a transmitter mobile device via an interface to a driver assistance system as

Receiver can be transmitted. In addition, the mobile device for interacting with a user may be assigned an HMI, which transmits information in an optical, acoustic and / or haptic form to the user. For this purpose, the HMI of the mobile device may include, among other things, a display device, such as a display, which is designed to display environment data received from the driving assistance system. Additionally or alternatively, the HMI may be associated with an input device, such as a keyboard and / or a touch-sensitive display, via which the user can communicate with the mobile device.

Typical mobile devices are for example simple mobile phones or as a smartphone, personal digital assistant (PDA), tablet computer or tablet PC with additional

Computer functionality and connectivity. Also mobile cameras or stationary, if necessary, also swiveling cameras, for example, a

Infrastructural device, such as a parking lot monitoring, are assigned, can be used as mobile devices. For example, a camera in a garage can be used as a mobile device, installed and oriented so that the recorded and transmitted to the car (or the driver assistance system) video data support the driver visually during the parking process.

In a further embodiment of the method according to the invention, the displayed detail on the display device of the receiver substantially coincides with the field of view of the mobile device in the current orientation and comprises at least part of the vehicle environment. This essentially means that the displayed section on the display device of the receiver comprises at least a part of the field of view of the mobile device. For example, the extent of the field of view may vary and be adjustable depending on the function or also by the user. This makes the information easy to understand for the user (not too small, too big, too distorted, etc.). .). The orientation of the mobile device can thus define a field of view, which may for example be orthogonal to the display device of the mobile display. In this embodiment, the display device serves as the image plane of a virtual camera, which in its imaging properties can also deviate from the physical camera integrated in the mobile device.

To display a section, the environment data preferably includes data that is acquired by a camera system associated with the driving assistance system or the mobile device. From this data, the respective section can then be selected and displayed in accordance with the field of view of the mobile device in the current orientation. In this case, the field of view of the mobile device is essentially determined by the environmental sensor system, the field of vision substantially corresponding to the detection range of the environmental sensor system. The field of view can therefore in particular coincide substantially with the detection range of a camera integrated into the mobile device. The current orientation of the mobile device is determined by the user using the mobile device and determining the orientation of the mobile device relative to the environment.

In an implementation of the method according to the invention, environment data that are acquired with environment sensors of the mobile device can be transmitted via an interface from the mobile device to the driver assistance system. In this case, the mobile device can in particular provide video views of the camera system with at least one camera of the interfaces, wherein the video views reproduce a section of the environment of the mobile device. In particular, the reproduced section of the environment of the mobile device can be chosen arbitrarily due to its location independence. Thus, the reproduced section of the environment of the mobile device may include at least a part of the vehicle environment.

Environment data recorded with a camera system of the mobile device can thus be transmitted to a driver assistance system of the vehicle. Depending on the orientation of the mobile device, the environment data, in particular video views, so selected be that they reflect the vehicle environment. The environment data can furthermore be displayed on a display device of the driver assistance system, for example a display assigned to the HMI. In another implementation of the method, the transmission of environmental data, which is detected with environment sensors of the driver assistance system, can be made to the mobile device. In this case, the driver assistance system can provide environment data of the interface, the environment data representing a section of the vehicle environment. In particular, multiple cameras installed at different locations on the vehicle can provide video views representing different sections of the vehicle environment.

Environment data recorded with a camera system of the driver assistance system can thus be transmitted to the mobile device. Depending on the orientation of the mobile device, the environment data can be selected such that it contains the section of the mobile device

 Vehicle environment corresponding to the fictitious field of view of the mobile device in the current orientation. In this case, the orientation of the mobile device can be determined, for example, via a motion sensor or compass assigned to the mobile device.

The signal that characterizes the orientation of the mobile device can be connected to the

Driver assistance system are transferred so that in the driver assistance system from the

Environment data can be made a pre-selection concerning the section to be transmitted. Alternatively, the driver assistance system can transmit environment data to the mobile device and the selection of the section take place in the mobile device.

 Accordingly, the environment data can be selected so that the section of the vehicle environment on the mobile device corresponds to a fictitious field of view of the mobile device to the vehicle environment. The environment data can continue on one

Display device of the mobile device, such as a display, are displayed. In order to assign a corresponding environment detail to the orientation of the mobile device, different methods can be considered. Thus, the orientation of the vehicle and thus also the permanently installed cameras of the driver assistance system via a built-in vehicle GPS system, for example, over the course

or the heading, and / or compass sensors to be known. Alternatively or additionally, the one or more cameras of the mobile device and the Driver assistance system to capture outstanding visual characteristics. The correspondence of these features then allows the relative orientation of the systems to be reconstructed. Additionally or alternatively, the one or more cameras of the mobile device could detect outstanding visual features in the interior of the vehicle.

Examples of such features may be mirror or console parts in the interior of the vehicle. Furthermore, markers can be provided in the interior of the vehicle. If the location of such features in the vehicle is known, the orientation of the mobile device relative to the system vehicle can be determined. Further

Modifications and developments of the mentioned methods are within the scope

professional action possible.

In a further implementation of the method according to the invention, an application which processes environment data for display on a display device is installed on the mobile device and / or the driver assistance system. So the processing of the

Environment data, recorded with environment sensors of the driver assistance system, take place either on the mobile device or on the driver assistance system. This processing involves balancing the orientation of the mobile device with the resulting portion of the vehicle environment that is to be displayed. If the environment data is processed directly on the driver assistance system, the representations are immediately transmitted to the mobile device for display. Alternatively, environmental data from the

Driver assistance system are transmitted to the mobile device to be processed there for display on a display device. Conversely, environmental data recorded with environment sensor of the mobile device can be processed on the driver assistance system or the mobile device for display on a display device.

To display the data further adjustments of the presentation can be made. For example, an adjustment of the brightness, the selection of a

Image section and / or a superposition of, for example, camera field data with environmental data of other components, such as ultrasonic sensors or the like, take place. In addition, further methods of image processing known to the person skilled in the art can be used for comprehensible presentation of the environmental data. Furthermore, the

Environment data over a network, such as the Internet, are made available and published there in web applications or portals. According to the invention, a computer program is also proposed according to which one of the methods described herein is performed when the computer program is executed on a programmable computer device. The computer device can be, for example, a module for implementing a driver assistance system, or a subsystem thereof, in a vehicle. Additionally or alternatively, the computing device may also be a module for implementing a mobile device. The computer program can be on a machine-readable

Storage medium can be stored, such as on a permanent or

rewritable storage medium or in association with a computer device or on a removable CD-ROM DVD or a USB stick. Additionally or alternatively, the computer program may be provided for download on a computing device such as a server, for example via a data network such as the Internet or a communication link such as a telephone line or a wireless link.

In addition, the invention proposes a driver assistance system that is configured to receive environment data from a component of a mobile device and to display a section of a vehicle environment as a function of an orientation of the mobile device. The driver assistance system is preferably designed to carry out the method described above.

Finally, according to the invention, a mobile device for monitoring a

Vehicle environment proposed, which is adapted to receive environmental data from a component of a driving assistance system and display a section of a vehicle environment in response to an orientation of the mobile device.

The driver assistance system according to the invention and the mobile device according to the invention are preferably designed to carry out the method described above in its respective variations.

Advantages of the invention

The invention allows the driver an optimal overview of the

Vehicle environment by only selected sections of the vehicle environment are presented. By displaying a section of the vehicle environment can The driver can focus on this section of the vehicle environment and easily identify potential sources of danger. As a result, in particular at Ein- and

Ausparken of the vehicle the sections of the environment are displayed, in which threatens a collision with an obstacle.

Thus, it is possible, for example, to send the driver environment details recorded with a mobile device to the display of the driver assistance system and thus to give him a clear picture of the driving situation. In particular, when parking this embodiment is helpful because the user of the mobile device can send video views of the vehicle environment to the driver. For example, a camera in a garage can be used as a mobile device, the camera being installed and oriented so that the recorded and transmitted to the vehicle (or the driver assistance system) video data visually support the driver during parking. In the alternative embodiment, the driver may, for example, before using a mobile device to estimate the distances to obstacles directly from the displayed on the mobile device sections of the vehicle environment.

In particular, results in this embodiment, an "x-ray vision" for the driver, the interior of the vehicle, for example, through the body through the

Vehicle environment can rate.

Overall, the utility value of assisted driving can be increased and thus the acceptance of corresponding assistants. Situations in which only sections of the vehicle environment are relevant occur frequently, for example, when parking on or off parking, and a driving assistance system which is further developed according to the invention can be implemented in such a way

 Situations contribute to a relevant improvement.

The increased system availability is no additional installation effort

because no additional sensors, modules or other components must be installed. Most vehicles today have an environment sensor system with optical sensors in different positions on the vehicle and interfaces for data transmission. Even mobile devices are often equipped with such environmental sensors and interfaces for data transmission. As a rule, environment data and in particular video views of the vehicle environment are therefore readily available or are already available anyway, so that the invention is essentially additional Evaluation algorithms are to implement. The inventive method can therefore be retrofitted easily and inexpensively.

Brief description of the drawings

Further aspects and advantages of the invention will now be described in more detail with reference to the accompanying figures.

2 is a schematic representation of a driving situation in which a driver intends to maneuver his vehicle equipped with a driver assistance system according to the invention out of a parking space; FIG. 2 shows a flowchart of an operation of the driver assistance system according to FIG.

FIG. 3 is a schematic illustration of a parking situation in which the vehicle, equipped with a driver assistance system according to the invention, parks in a parking space;

FIG. 4 in the form of a flow chart of an operation of the driver assistance system according to FIG. 2.

Embodiments of the invention

Figure 1 shows an exemplary driving situation in which a vehicle 10 is in an environment with obstacles 12, such as columns. These obstacles 12 are not directly visible to the driver 13 in the situation shown in FIG. In particular, when reversing, for example when Rückwärtsausparken, it may therefore come to collision with the obstacles 12.

In order to prevent such collisions with obstacles 12 and to assist the driver 13 in such situations, the vehicle 10 is equipped with a driver assistance system 14. The driver assistance system 14 comprises different subsystems, for example a parking assistant and a monitoring system. In the shown Embodiment, the driver assistance system 14 comprises environmental sensor system comprising a system of optical sensors, in particular a front camera 18, side cameras 20 and a rear view camera 22. In addition, the driver assistance system 14

Ultrasonic sensors, radar sensors and / or lidar sensors include, which are not shown in Figure 1.

Furthermore, the driver assistance system 14 comprises a control unit 24, which enables the communication with subsystems, such as the parking assistant, and the processing of sensor data, such as video views of the camera system 18, 20, 22. In addition, that is

Control unit 24 configured with an interface 26, which is designed for example as a wireless data transmission interface for data transfer via Bluetooth, WLAN or Firewire.

Before the driver 13 of the vehicle 10 attaches to the reverse, that takes

Camera system 18, 20, 22 different sections of the vehicle environment. For example, the rearview camera 22 provides video views of the vehicle environment behind the vehicle 10. In Figure 1 are behind the vehicle 10 objects 12, with which the vehicle 10 could collide in a reverse drive. The video views of the camera system 18, 20, 22 are forwarded to the control unit 24 of the driver assistance system 14 and processed there, for example, for display on a display device, such as the display of an HMI.

In order to be able to provide the driver 13 with the sections of the vehicle environment which are relevant to him at his option, the video views of the camera system 18, 20, 22 are transmitted from the control unit 24 of the driver assistance system 14 to a mobile device 16, for example

Mobile phone, sent. The mobile device 16 has a

Data transmission interface 28, for example, as a wireless

Data transmission interface for data transfer via Bluetooth, WLAN or Firewire is formed, and a display for displaying the video views of the vehicle environment. To select the respective section of the vehicle environment, the mobile device 16 is further equipped with a motion sensor 31. In this way, the

Orientation of the mobile device 16 determines and from the video views that the

Represent vehicle environment, the respective section according to the orientation and thus the field of view 17 of the mobile device 16 selected. The orientation of the mobile device 16 relative to the vehicle 10 can be identified in different ways. For example, cameras of the mobile device 16 and the driver assistance system 14 may detect outstanding visual features that are then matched. The mobile device 16 essentially serves as a virtual camera, which defines a field of view 17 depending on the orientation of the mobile device 16.

On the mobile device 16 applications with a variety of display variants can be installed. For example, the applications can be used on a server for

Download deposited, wherein the execution of the application on the mobile device 16, the presentation of the video view is modified. For example, the video data with information of other environment sensors, such as distance information from

Ultrasonic sensors are superimposed. Also, an overlay with, for example, points of interest (POIs), such as sights, or an automatic assignment and

Overlay of license plates and their administrative district is conceivable.

Furthermore, the video views could resume over a network, such as the Internet

Be made available and published there in web applications or portals.

As shown in FIG. 1, in this embodiment, the driver 13 may select portions of the vehicle surroundings by the orientation of the mobile device 16 and display them on the mobile device 16 through the body. This allows the driver 13 to more intuitively detect the vehicle environment and detect any obstacles 12. Thus, the driver 13 can detect obstacles 12, which could cause a collision, for example, when reversing, even though they are outside his field of vision.

FIG. 2 illustrates the interaction of the components of the driver assistance system from FIG. 1 on the basis of a flowchart 30. In step 32, to monitor the

Vehicle environment first environment data with environment sensors 18, 20, 22 of the vehicle integrated in 10 driving assistance system 14 detected. The environment sensor system includes a

Camera system with multiple cameras that captures video views of the environment. The environment data accordingly contain video views of the camera system 18, 20, 22. In addition, the environment data and visualizations of ultrasound, radar or

LIDAR data include.

In step 34, the detected environment data is transmitted from the driving assistance system 14 to a mobile device 16. In this case, the driver assistance system 14 functions as a transmitter that transmits the environment data to the mobile device acting as a receiver. To Both are, so both the driver assistance system 14 and the mobile device 16 equipped with a wireless interface 26, 28, which allows data transmission via, for example, Bluetooth, Firewire or WLAN. In step 36, at least a portion of the detected vehicle environment is displayed on a display of the mobile terminal. In this case, an application installed on the mobile unit processes the received environment data for display on the display of the mobile unit. Depending on the orientation of the mobile device, the displayed section of environment data can be selected so that they reflect the section of the vehicle environment that matches the fictitious field of view of the mobile device in the current orientation. Consequently, the section of the vehicle environment displayed on the mobile terminal corresponds to a fictitious field of view of the mobile terminal on the vehicle environment. The inventive method allows the driver 13 a kind of "x-ray vision" with which the driver 13 can monitor the entire vehicle environment within the vehicle 10. Thus, the driver 13, for example, before parking the vehicle environment, which is not visible from the driver position, and see detect possible sources of danger.

FIG. 3 shows a further exemplary driving situation in which a driver 13 wants to park his vehicle 10 backwards in a narrow parking space 11, for example in a parking garage. The parking space boundaries 12, for example, pillars or walls constitute a potential obstacle in the vehicle environment. These obstacles 12 make it more difficult for the driver 13 to park in the situation shown in FIG

Maneuvering a potential risk of collision with the obstacles 12 is.

In order to prevent such collisions and to assist the driver 13 in such situations, the vehicle 10 is equipped with a driving assistance system 14. The driver assistance system 14 comprises different subsystems, for example a

Parking assistant and a surveillance system. In the illustrated embodiment, the driver assistance system 14 includes an HMI having a display 15 for optically outputting information. For example, video views of the camera system 18, 20, 22 integrated in the driver assistance system 14 can be displayed on the display. In the However, in this embodiment, the camera system 18, 20, 22 is optional and not mandatory.

Furthermore, the driver assistance system 14 provides a control unit 24 that enables communication with subsystems, such as the parking assistant and video surveillance, and the processing of sensor data, such as video views of the camera system 18, 20, 22. In addition, the controller 24 is configured with an interface 26, which is designed, for example, as a wireless data transmission interface for the data transfer, for example via Bluetooth, WLAN or Firewire.

While the driver 13 maneuvers the vehicle 10 into the parking space 1 1, a user assists him with his mobile device 16, for example his mobile phone. The mobile device 16 includes for this purpose a camera 29, which receives 16 video views depending on the orientation of the mobile device. So the user can take different sections of the

Record vehicle environment and provide the driving assistance system 14 via the interface 28 of the mobile device 16. In the illustrated embodiment, the controller 24 of the driver assistance system 14 receives these video views and processes them, for example, for display on a display device 16. From the illustration of a detail of the vehicle environment as shown in FIG. 3, the user of the mobile device 16 can assist the driver 13 in maneuvering into a parking space 11. Because the user can instruct instead of the driver 13 by hand signals in the parking space 1 1, the driver 13 provide a video view of the vehicle environment, the driver 13 critical points, in particular distances to the parking space boundary 12, show.

FIG. 4 illustrates the interaction of the components of the driver assistance system from FIG. 2 on the basis of a flow diagram 40. In step 42, environment data with environmental sensor technology of a mobile device 16 are recorded for monitoring the vehicle environment. For this purpose, a built-in mobile device 16 camera 29 is used, which supplies depending on the orientation of the mobile device 16 different sections of the vehicle environment.

In step 44, the environment data of the mobile terminal 16 is sent to the

Driver assistance system 14 transmitted. In this case, the mobile device 16 acts as a transmitter, which transmits the environment data to the driver assistance system 14 functioning as a receiver. For this purpose, both the driver assistance system 14 and the mobile device 16 are equipped with a wireless interface 26, 28 which transmits data via

For example, Bluetooth, Firewire or Wi-Fi enabled. In step 46, at least a section of the detected vehicle environment is displayed on a display 15 of the driver assistance system 14. One processed on the

Driving assistance system 14 installed application, the received environment data for display on the display 15 of the driving assistance system 15. Depending on the orientation of the mobile device 16, the displayed section of environment data can be selected so that it reproduces the section of the vehicle environment, with the field of view of the mobile device 16 in the current orientation. Consequently, the section of the vehicle environment indicated on the driver assistance system corresponds to the field of view 27 of the mobile device 16 on the vehicle environment. The inventive method allows the user of a mobile device 16, the driver 13 environment cutouts, recorded with the mobile device 16, on the

Display the driver assistance system 14 to send and thus give him a clear picture of the driving situation. In particular, when parking this embodiment is helpful because the user of the mobile device 16 can send video views of the vehicle environment and in particular critical points to the driver 13.

The invention is not limited to the embodiments described herein and the aspects highlighted therein. Rather, within the scope of the appended claims, a variety of modifications are possible that are within the scope of expert trade.

Claims

Claims 1. A method of monitoring a vehicle environment comprising the steps of:
Acquiring (32) environment data with environment sensors (18, 20, 22, 29) of a transmitter (14, 16);
 Transmitting (34) the environment data from the transmitter (14, 16) to a receiver (14, 16);
 Displaying (36) at least a portion of the detected vehicle environment on a display device of the receiver (14, 16), wherein the transmitter (14, 16) or the receiver (14, 16) is designed as a mobile device (16) and the displayed section through an orientation of the mobile device (16) is determined.
2. The method according to claim 1, characterized in that the environment sensor system (18, 20, 22, 29) comprises a camera system with one or more cameras, the
 Record video views of the vehicle environment.
3. The method according to any one of claims 1 or 2, characterized in that the environment data via an interface on at least one wireless or
 wired data transmission path between transmitter (14, 16) and receiver (14, 16) are transmitted.
4. The method according to any one of claims 1 to 3, characterized in that the
 Transmitter (14, 16) is a driving assistance system (14), the environmental data to a mobile device (16) as a receiver (14, 16) sends, or the transmitter (14, 16) is a mobile device (16), the environment data a driver assistance system (14) as a receiver (14, 16) sends.
5. The method according to any one of claims 1 to 4, characterized in that the
shown section of the vehicle environment coincides with the field of view (17) of the mobile device (16) in the current orientation and includes at least part of the vehicle environment.
6. The method according to any one of claims 1 to 5, characterized in that the section of the detected environment on a display device of the
 Driver assistance system (14) or a mobile device (16) associated HMIs is displayed.
7. The method according to any one of claims 1 to 6, characterized in that on the mobile unit (16) and / or the driver assistance system (14) installed application processes the environment data for display.
8. Computer program for carrying out a method according to one of the preceding claims, when the computer program on a programmable
 Computer device is running.
A driver assistance system (14) for monitoring a vehicle environment configured to receive environmental data from a component of a mobile device (16) and display a section of a vehicle environment in response to an orientation of the mobile device (16).
A mobile device (16) for monitoring a vehicle environment configured to receive environmental data from a component of a driver assistance system (14) and to display a section of a vehicle environment in response to an orientation of the mobile device (16).
PCT/EP2012/073981 2012-01-19 2012-11-29 Method for monitoring the environment of a vehicle WO2013107550A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
DE102012200721.0 2012-01-19
DE102012200721A DE102012200721A1 (en) 2012-01-19 2012-01-19 Method for monitoring a vehicle environment

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201280067213.5A CN104054033A (en) 2012-01-19 2012-11-29 Method for monitoring environment of vehicle
EP12810124.3A EP2805210A1 (en) 2012-01-19 2012-11-29 Method for monitoring the environment of a vehicle

Publications (1)

Publication Number Publication Date
WO2013107550A1 true WO2013107550A1 (en) 2013-07-25

Family

ID=47504838

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2012/073981 WO2013107550A1 (en) 2012-01-19 2012-11-29 Method for monitoring the environment of a vehicle

Country Status (4)

Country Link
EP (1) EP2805210A1 (en)
CN (1) CN104054033A (en)
DE (1) DE102012200721A1 (en)
WO (1) WO2013107550A1 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102014212819A1 (en) * 2014-07-02 2016-01-07 Zf Friedrichshafen Ag Location-dependent representation of vehicle environment data on a mobile unit
DE102014115521A1 (en) * 2014-10-24 2016-04-28 Deutsche Telekom Ag Driver assistance in the detection of the vehicle environment
DE102014222190A1 (en) * 2014-10-30 2016-05-04 Volkswagen Aktiengesellschaft Device and method for connecting a mobile camera device
DE102014017599B4 (en) * 2014-11-27 2017-01-05 Elektrobit Automotive Gmbh A portable device for use by a driver of a motor vehicle and method of using the device
DE102015004553B4 (en) * 2015-04-08 2017-02-16 Audi Ag Method for operating a vehicle system of a motor vehicle
DE102015210118B4 (en) * 2015-06-02 2019-03-21 Volkswagen Aktiengesellschaft Method and device for supporting the parking out of a vehicle
DE102015216920A1 (en) 2015-09-03 2017-03-23 Robert Bosch Gmbh Method and device for monitoring the environment of a vehicle
DE102016212181A1 (en) * 2016-07-05 2018-01-11 Volkswagen Aktiengesellschaft Method for determining the length and / or size relationships of a trailer
DE102016214477A1 (en) * 2016-08-04 2018-02-08 Bayerische Motoren Werke Aktiengesellschaft Arrangement, means of transport and method for defining a color in a means of transportation
DE102017209910A1 (en) * 2017-06-13 2018-12-13 Continental Teves Ag & Co. Ohg Vehicle localization by means of an in-vehicle mobile phone

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004004320A1 (en) * 2002-07-01 2004-01-08 The Regents Of The University Of California Digital processing of video images
EP1510849A1 (en) * 2003-08-29 2005-03-02 C.R.F. Società Consortile per Azioni A virtual display device for use in a vehicle
DE102008034606A1 (en) 2008-07-25 2010-01-28 Bayerische Motoren Werke Aktiengesellschaft Method for displaying environment of vehicle on mobile unit, involves wirelessly receiving image signal from vehicle, and generating display image signal on mobile unit through vehicle image signal, where mobile unit has virtual plane
DE102009020328A1 (en) 2009-05-07 2010-11-11 Bayerische Motoren Werke Aktiengesellschaft A method for displaying differently well visible objects from the environment of a vehicle on the display of a display device
US20110221692A1 (en) * 2010-03-11 2011-09-15 Parrot Method and an appliance for remotely controlling a drone, in particular a rotary wing drone
US20110288696A1 (en) * 2008-11-27 2011-11-24 Parrot Device for piloting a drone

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100548420B1 (en) * 2003-11-13 2006-02-02 엘지전자 주식회사 Dead zone monitoring system and method using a mobile communication terminal
US20060232670A1 (en) * 2004-10-19 2006-10-19 Fu-Lai Chu Vehicle monitoring apparatus
JP2009060499A (en) * 2007-09-03 2009-03-19 Sanyo Electric Co Ltd Driving support system, and combination vehicle
CN201197181Y (en) * 2008-04-30 2009-02-18 肖宽新 Vehicle monitoring system
CN102098497A (en) * 2010-12-23 2011-06-15 史立锦 Multi-purpose security monitoring system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004004320A1 (en) * 2002-07-01 2004-01-08 The Regents Of The University Of California Digital processing of video images
EP1510849A1 (en) * 2003-08-29 2005-03-02 C.R.F. Società Consortile per Azioni A virtual display device for use in a vehicle
DE102008034606A1 (en) 2008-07-25 2010-01-28 Bayerische Motoren Werke Aktiengesellschaft Method for displaying environment of vehicle on mobile unit, involves wirelessly receiving image signal from vehicle, and generating display image signal on mobile unit through vehicle image signal, where mobile unit has virtual plane
US20110288696A1 (en) * 2008-11-27 2011-11-24 Parrot Device for piloting a drone
DE102009020328A1 (en) 2009-05-07 2010-11-11 Bayerische Motoren Werke Aktiengesellschaft A method for displaying differently well visible objects from the environment of a vehicle on the display of a display device
US20110221692A1 (en) * 2010-03-11 2011-09-15 Parrot Method and an appliance for remotely controlling a drone, in particular a rotary wing drone

Also Published As

Publication number Publication date
DE102012200721A1 (en) 2013-07-25
EP2805210A1 (en) 2014-11-26
CN104054033A (en) 2014-09-17

Similar Documents

Publication Publication Date Title
CN102458964B (en) Camera system for use in vehicle parking
EP2163428B1 (en) Intelligent driving assistant systems
JP4900232B2 (en) Vehicle parking assist device and video display method
DE102015118489A1 (en) Remote control of an autonomous vehicle in an unexpected environment
JP2015516772A (en) Remote control of automobiles using portable communication devices
JP5099451B2 (en) Vehicle periphery confirmation device
US9656690B2 (en) System and method for using gestures in autonomous parking
US20110304444A1 (en) Portable vision system
US20080231702A1 (en) Vehicle outside display system and display control apparatus
JP2009067368A (en) Display device
DE102010051206A1 (en) A method of generating an image of a vehicle environment and imaging device
DE102011053999A1 (en) Detection system for optical detection of object and/or region of space for driver assistance and/or display systems of motor vehicle, has optical sensor arranged as light field sensor for detection of direction information of light beam
DE102008039136A1 (en) Camera system for a vehicle and method for controlling a camera system
WO2012145455A1 (en) Warning system with heads up display
US9805589B2 (en) Trainable transceiver and camera systems and methods
CN102280043A (en) A method for locating a parked car and portable locator
DE102008028303A1 (en) Display system and program
JP2007164549A (en) Image pickup apparatus, video signal selector, driving support apparatus, and automobile
DE102012102508B4 (en) Adjustment method and system of a smart vehicle imaging device
DE102011079703A1 (en) Method for assisting a driver of a motor vehicle
US8880344B2 (en) Method for displaying images on a display device and driver assistance system
US10369967B2 (en) Vehicle and program for vehicle
JP2007065902A (en) Parking position search support device, method and program
DE102012007984A1 (en) Shunting system and method for automatically maneuvering a motor vehicle, motor vehicle, portable communication device and computer program
JP2007104373A (en) On-vehicle image displaying device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12810124

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2012810124

Country of ref document: EP