EP2830030B1 - Method for determining and updating an occupancy map in a parking area - Google Patents
Method for determining and updating an occupancy map in a parking area Download PDFInfo
- Publication number
- EP2830030B1 EP2830030B1 EP14002059.5A EP14002059A EP2830030B1 EP 2830030 B1 EP2830030 B1 EP 2830030B1 EP 14002059 A EP14002059 A EP 14002059A EP 2830030 B1 EP2830030 B1 EP 2830030B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- motor vehicle
- data
- sensor
- parking
- sensor data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 39
- 238000004891 communication Methods 0.000 claims description 32
- 238000003384 imaging method Methods 0.000 claims description 12
- 239000002245 particle Substances 0.000 claims description 12
- 238000011156 evaluation Methods 0.000 claims description 9
- 238000012545 processing Methods 0.000 claims description 9
- 238000004422 calculation algorithm Methods 0.000 claims description 8
- 230000005540 biological transmission Effects 0.000 claims description 2
- 230000007613 environmental effect Effects 0.000 description 19
- 230000004807 localization Effects 0.000 description 8
- 230000033001 locomotion Effects 0.000 description 5
- 239000013598 vector Substances 0.000 description 5
- 239000003550 marker Substances 0.000 description 4
- 238000001514 detection method Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 238000013480 data collection Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 241000251468 Actinopterygii Species 0.000 description 1
- 230000005526 G1 to G0 transition Effects 0.000 description 1
- 238000000342 Monte Carlo simulation Methods 0.000 description 1
- 230000004888 barrier function Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000000052 comparative effect Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/14—Traffic control systems for road vehicles indicating individual free spaces in parking areas
- G08G1/141—Traffic control systems for road vehicles indicating individual free spaces in parking areas with means giving the indication of available parking spaces
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/14—Traffic control systems for road vehicles indicating individual free spaces in parking areas
- G08G1/145—Traffic control systems for road vehicles indicating individual free spaces in parking areas where the indication depends on the parking areas
- G08G1/146—Traffic control systems for road vehicles indicating individual free spaces in parking areas where the indication depends on the parking areas where the parking area is a limited parking space, e.g. parking garage, restricted space
Definitions
- the invention relates to a method for ascertaining and updating a debit card in a parking area having a plurality of parking spaces, in particular a parking lot or a parking garage, wherein the occupancy card is stored in a central computing device having a communication device designed to communicate with motor vehicles in the parking area contains a data structure, in or out of at least one position and its occupancy state for each parking lot as an additional attribute or can be derived.
- Parking areas in particular so parking lot or multi-storey car parks, are locations that have a variety of parking lots of motor vehicles. Often, the use of this parking is subject to a charge. For drivers who are looking for a parking space within such a parking area, it is sometimes difficult, especially at a high occupancy, to find a parking space. To solve this problem, it has already been proposed in the prior art to use occupancy sensors for the parking spaces. This provides the information as to whether a parking space is free or occupied. This information can be entered in a badge map, so that a data structure exists from which it can be determined which parking lots are occupied and which are free.
- various types of parking sensors are known, for example the use of an ultrasonic sensor installed in a ceiling, which determines via the distance to the next object (motor vehicle or floor) whether a parking space is occupied. Also, measurements of distortion of the earth's magnetic field and the like are possible.
- DE 10 2010 033 215 A1 discloses a method for assisting a parking operation in a parking garage.
- a parking system is provided with information about the parking garage at the entrance, from which control data for automatic navigation in the parking garage are generated.
- an occupancy state recognition system is described which is to receive information about the occupancy of parking spaces from the vehicles and to store it in a database.
- EP 1 006 503 A2 concerns the parking space detection in a traffic network.
- a vehicle-side terminal is to transmit parking space information, representing a stationary phase of the vehicle and the vehicle location, to a control center, which generates information regarding free parking space.
- DE 10 2011 086 268 A1 discloses a method for detecting a free parking space.
- a motor vehicle recognizes by means of a sensor, whether a parking space is free.
- a location of the free parking space is determined, after which the information about the free parking space and the location position are forwarded to an external receiver.
- a system for detecting the parking position of vehicles in an area, especially in parking garages, is disclosed in DE 10 2008 006 356 A1 described.
- a parking ticket is provided with an RFID tag to determine the parking position of a motor vehicle and to rediscover the motor vehicle to the driver.
- the invention is therefore based on the object, a method for determining and updating a badge map in a parking lot, in particular a parking garage, indicate which avoids the use of parking-specific occupancy sensors, can lead to a more extensive information containing occupancy map and in particular is easier and less expensive to implement.
- the parking area is preferably a parking garage.
- the idea of the present invention is therefore to use the surroundings sensor system which is already present anyway on the motor vehicle in order to create, update or refine an occupancy map of the parking area.
- Modern motor vehicles already have a plurality of sensors that can provide useful information, wherein at least one imaging sensor, in particular a camera and / or a PMD sensor, and / or a distance-measuring sensor, in particular a radar sensor and / or a lidar sensor and / or an ultrasonic sensor can be used.
- top-view cameras that is, wide-angle cameras, for example, use fish eyes and are arranged at the top of the body of the motor vehicle such that they , especially together with a front camera, can capture the entire environment of the motor vehicle.
- image data of the imaging sensor are at least partially evaluated in the motor vehicle and / or in the computing device by an image processing algorithm.
- the imaging sensor delivers two-dimensional image data, it can nevertheless be used to determine three-dimensional sensor data describing the environment using a suitable image processing algorithm.
- image processing algorithms are known, for example, under the keyword "structure from motion”.
- motor vehicles also have control units that are already suitable for carrying out such image processing algorithms, which in the present case can also suitably prepare the raw sensor data in order then to transmit the evaluated sensor data to the computing device.
- Such a determined and up-to-date occupancy map can serve as a basis for further navigation in the case of manual control of the motor vehicle, for automated allocation of a parking space and / or for automated guidance of the motor vehicle for path planning based thereon. Accordingly, it can be provided that the occupancy card is used for allocating a parking space to a motor vehicle to be parked and / or for route planning within the parking area by a motor vehicle and / or for determining at least one navigation instruction for a motor vehicle.
- the advantages of the present invention are particularly clear, because in addition to the simple information whether a parking space is occupied or free, additional useful additional attributes can be included or derivable to a parking lot, the navigation, especially the fully automatic guidance of the motor vehicle (piloted driving) significantly simplify.
- motor vehicles are known, in which an automatic parking is made possible without any intervention by the driver. It may then be expedient to provide for the additional attributes of at least one parking space adjacent to the target parking space to be taken into account when planning a parking procedure of a motor vehicle to be carried out, in particular automatically. Additional attributes may therefore be relevant for a piloted parking operation, for example, whether a larger vehicle protrudes on a neighboring parking space and the like. Damage can be avoided here.
- additional information can be considered, for example, "wild", ie outside a parking lot, parked vehicles and / or objects.
- the use of the sensor data of the environmental sensors of motor vehicles traveling in the parking area thus makes it possible to determine useful additional attributes.
- the invention provides that at least one position of a motor vehicle parked in the parking space relative to the parking space and / or at least one dimension of the parked motor vehicle and / or at least one identification feature of the parked motor vehicle are used as additional attributes.
- the occupancy information are enriched to each parking lot to concrete vehicle contours, color and appearance of the occupying vehicle and the exact position and dimension of the currently parked motor vehicle within the parking lot.
- the occupancy map expediently also contains information about the architecture may include the parking area itself, in particular the location of immovable components, such as walls, so that the occupancy map can be used as a whole as a basis for fully automatic control of the motor vehicle and the previous path planning.
- the occupancy card is used for identifying and locating a particular parked motor vehicle.
- the desired motor vehicle descriptive identification data must be compared with corresponding, contained in the occupancy map or derivable from this additional attributes.
- Corresponding inputs and searches can take place, for example, via suitable terminals in the parking area, for example terminals already used as automatic pay stations, whereby information stored on a parking card can also be taken into account if necessary.
- the use of different data structures is conceivable.
- the data structure it is possible for the data structure to be sorted mainly according to the parking spaces and their then explicitly stored additional attributes.
- the occupancy maps can also be used in the fully automatic operation of motor vehicles, however, other data structures are available, from which the additional attributes can be derived at least partially, but in some cases can also be explicitly stored.
- the data structure comprises a grid structure in which subareas associated with grid lines are assigned subarea attributes. Objects can then, for example, be linked via subordinate occupancy information be identified and the like.
- a CAD structure also proves advantageous. Usable data structures for occupancy maps are already widely known in the prior art and will not be discussed in more detail here.
- a grid structure is used as the data structure, it is also possible to define parking spaces within the grid, for example by entering the center vector of the parking marker at one end of the parking marker into the corresponding subarea or the respective grid point, indicating the direction of the vector in which direction the marker extends, the length of the vector describes the length of the marker.
- similar ways of entering parking spaces as certain vectors are also occupancy maps based on a CAD model. Also, such CAD-occupancy maps are useful in the process of the invention.
- the computing device acts as a data collection point and, with its calculations for updating the occupancy map, ensures that there is always a current occupancy map which matches the incoming sensor data of different motor vehicles. This can then be distributed via the communication device in turn to the motor vehicles or they can send special requests, for example for a free parking space and / or navigation instructions there.
- the sensor data from the motor vehicle can be transmitted at least partially wirelessly to the computing device-side communication device via a communication device on the motor vehicle side.
- the data transmission can expediently take place via a WLAN network.
- motor vehicle-to-X communication Car2X communication
- Car2X communication can be used in the context of the present invention, with corresponding standardized communication networks, in which motor vehicles can participate, are already known in the prior art.
- An expedient embodiment of the present invention further provides that a parked or parked motor vehicle also transmits ego data about the motor vehicle itself to the computing device, which are used in the determination or updating of the occupancy map, in particular with regard to a parked parking lot.
- a large amount of information about one's own motor vehicle is usually present, for example its dimensions, its type, special extensions and the like. If it is already known, in any case, that a motor vehicle has parked in a certain parking space, it may be useful, as described above, to store as far as possible information about the parked motor vehicle into the map which is obtained firsthand when the ego data is transmitted can.
- a development of the invention provides that in the evaluation of the sensor data for determining or updating the occupancy map, a position of the motor vehicle relative to the features described by the sensor data is taken into account.
- This position can be determined in the motor vehicle and transmitted with the sensor data, but it is also possible to assign the sensor data to a position of the motor vehicle determined, for example, via a position determination system, which can be done by the computing device. If the position of the motor vehicle to which the sensor data refer is first known in the parking area, it is possible in a simple manner to draw conclusions therefrom for the creation or updating of the occupancy map. To determine the position of the motor vehicle a variety of ways are conceivable. The position should also be comprehensively understood as the orientation of the motor vehicle.
- the position of the motor vehicle is provided by an evaluation of sensor data, in particular of sensor data of an imaging sensor, and / or position determination data of a positioning system installed at least partially in the parking area and / or by a communication network, the part of which forms the communication device Communication data and / or from the route of the motor vehicle from a known position descriptive position data is determined.
- sensor data in particular of sensor data of an imaging sensor
- position determination data of a positioning system installed at least partially in the parking area and / or by a communication network, the part of which forms the communication device Communication data and / or from the route of the motor vehicle from a known position descriptive position data is determined.
- some variants are already known in the prior art, by which the position of an object in a certain area can be determined, which can also be used in the context of the present invention.
- different positioning measures are often combined, which may also be useful in the context of the present invention.
- the aim is to determine the position of the motor vehicle as accurately as possible, in particular with a tolerance of less than 10 cm,
- the position determination system comprises lidar sensors which are arranged at tire height but below the body height of motor vehicles and which detect the tires of motor vehicles.
- lidar sensors which detect as objects in their detection range the tires of motor vehicles, which can be assigned to certain motor vehicles due to their special correlation. Is now, for example, from a barrier forth, possibly additionally in consideration of odometry, known to which motor vehicle an arrangement of four particular tires that have been detected, is assigned, can be highly accurately determine its position.
- a particle filter and / or a Kalman filter is used for position determination.
- the sensor data itself is used to derive the position from them by ultimately working with previously known information of the vehicle environment (the given description) to perform vehicle localization.
- the occupancy card itself is used as the a priori data, that is to say the predetermined description of the parking area.
- Particle filters often referred to as Monte Carlo localization or sequential Monte Carlo method, are already known from the field of robotics for solving the localization problem.
- the pose of the motor vehicle is represented by a particle cloud.
- Each particle represents a possible position of the motor vehicle.
- Via the particle filter each particle, ie each position represented thereby, is checked for plausibility. The probability of plausible particles can then be increased, for example, the probability of less plausible particles is reduced. If particles fall below a certain probability threshold, they are discarded.
- a data set describing at least the position of immovable, detectable components, in particular walls, of the parking area is determined from the sensor data and compared with hypothesis data records determined for different positions in the parking area by simulation of sensor data , wherein the position of the motor vehicle is determined by comparing the data set with the hypothesis data sets.
- the badge card is used, of course, in addition to immovable components such as the walls of a parking garage, other objects, such as parked cars, add.
- a simulation of sensor data in particular based on the occupancy map, is ultimately used here. This is particularly useful, because the a priori data thus correspond to a same or a similar environmental sensor as that which is used in the motor vehicle.
- the given description itself contains sensor data recorded with a sensor. This leads to an improvement of the localization quality, because similar data are compared and do not have to be adjusted lossy via a model.
- the position is slowly refined to reduce the computing power, so that, for example, after a comparison, all hypothesis data records having a plausibility threshold that are lower than a plausibility threshold and having a certain plausibility value for matching the positions are discarded and their Position in a predefined area around the positions of the non-discarded hypothesis data sets for the determination of new hypothesis data sets are awarded for at least one further comparison.
- Such a method for determining the position based on the perception of sensor data of the motor vehicle itself can also be improved by using additional markers visible to the environmental sensors, at least in sections of the parking area which differ little at different positions, for example driveways bordered by two walls become.
- the position of the motor vehicle is determined at least partially by comparing the sensor data with reference data of the parking area, in particular by comparing the sensor data with reference data recorded with the same type of environmental sensor and / or a same environmental sensor and / or correspondingly, in particular based on the occupancy card, simulated data.
- the occupancy map it is generally expedient for the occupancy map to be used at least partially when determining the position of the motor vehicle, in particular as a predetermined description of the parking area.
- the position data can also be at least partially determined and transmitted in the motor vehicle itself, with suitable data, in particular sensor data, also being able to be determined in the motor vehicle itself and transmitted by it to determine the position.
- a preferred embodiment of the invention provides that the raw sensor data are at least partially evaluated by the motor vehicle itself and the evaluated sensor data is transmitted to the computing device. This can take place in arbitrarily far-reaching configurations, so that it is also conceivable in particular for the raw sensor data to be used to update a copy of the occupancy card stored in the motor vehicle, wherein at least changed portions of the occupancy card are transmitted to the central processing unit as sensor data.
- the computing device receives proposals for modification, which must be entered, if appropriate, according to a temporal priority, only in the central version of the occupancy card, whereupon the updated central version of the occupancy card can be redistributed to the motor vehicles.
- this is less preferred since the motor vehicles should in principle always have access to the most recent version of the occupancy map.
- the raw sensor data for updating objects in the environment of the motor vehicle descriptive environment map are evaluated, wherein at least a portion of the data contained in the environment map, in particular parked motor vehicles as objects descriptive data, or the entire environment map as sensor data to the Computing device to be transmitted.
- environment maps often referred to as environment models, are already widely known in the art and are used in the motor vehicle as part of a sensor and information fusion to provide, for example, driver assistance systems that require environmental information to provide a standardized data collection from which the required environmental information is retrieved can. If such an environment map (such an environment model) kept up-to-date anyway in the motor vehicle, it can be usefully transmitted as sensor data to the central computing device. With the known position of the motor vehicle, it is then easily possible to convert the corresponding described objects and their attributes for the occupancy map and enter there.
- the present invention thus describes a system that is formed by the parking area with the central computing device and within the parking area, in particular powered vehicles, the motor vehicles have environmental sensors whose optionally already at least partially evaluated sensor data via a communication link, in particular part of Communication network forms can be transmitted to a communication device of the computing device.
- the computing device is designed to evaluate sensor data received from motor vehicles in order to determine or update a badge map designed as described with regard to the inventive method.
- the central computing device also fulfills certain functions in certain embodiments, for example the allocation of parking spaces to motor vehicles, the availability of the occupancy map to motor vehicles, the determination of navigation instructions for motor vehicles, the finding of parked motor vehicles and the like.
- all statements regarding the method according to the invention also apply to such a system.
- Fig. 1 shows a schematic diagram of a parking area 1, which in the present case is designed as a parking garage, which has several parking levels with parking lots 2, which in the present case for the sake of clarity only in a section 3 is shown. These parking spaces 2 are separated from each other by parking markings 4 and provide space for parked motor vehicles 5. Within the parking area 1 also move motor vehicles 6, which are to be parked or leave the park area 1 after parking.
- the motor vehicles 5, 6 or their drivers are provided by a central computer 7 information from which, for example, free parking 2 can be inferred as destination parking, navigation instructions to parking 2 or can be generated from the parking area 1 and / or even fully automatic motor vehicles 5, 6 even automatic parking planning is possible.
- the computing device 7 has a memory device 8 in which a busy map of the parking area 1 is stored.
- This occupancy map can be designed in various ways, but contains at least the positions of the parking spaces 2 and their occupancy state, which can be stored directly as an additional attribute or can be derived from the data of the occupancy map.
- the occupancy card preferably also contains further information, on the one hand, the basic architecture of the parking area 1, in particular the immovable components such as walls 9, as well as additional additional attributes to the parking spaces 2 and additional data from which further additional attributes to the parking spaces 2 can be derived.
- the occupancy map can have, for example, a CAD-like grid structure as a data structure into which various objects can be entered. Then, architectural data and the like are also preferably included. However, other possibilities are also conceivable, for example a data structure organized according to the parking spaces 2, in which, for example a record associated with a parking lot 2 may be realized as a container containing the additional attributes. Of course, further containers may be provided in such a data structure, for example, fixed components of the parking area 1 or parked outside parking 2 objects.
- a WLAN network is available as communication network, the central computing device 7 having a communication device 10 designed for communication in the WLAN network, so that a communication link 11 to motor vehicles 5, 6 can be established.
- the badge map and information derived therefrom can be made available to the motor vehicles 5, 6, for example a destination car park with an associated navigation instruction or without such when automatic planning of the vehicle 5, 6 is to be carried out automatically
- the occupancy card is made available to the motor vehicle 5, 6 as a whole. If the occupancy map, which, as explained, is also preferred, also contains architectural data for parking area 1, a path planning can be carried out on this basis, especially if variable objects, thus mainly parked motor vehicles 5, are also detected.
- the communication link 11 is also used to transmit from environmental sensors of the motor vehicles 6 in operation and optionally at least partially evaluated sensor data to the computing device 7, which uses the sensor data to create the occupancy map and keep current, thus to update , Overall, so in the in Fig. 1 In the parking area 1 system formed the inventive method can be performed.
- the use of the sensor data of the motor vehicle 6 not only allows to do without an additional parking-specific occupancy sensors, but it can also be a significantly improved occupancy map are created, after the additional attribute "free” or "occupied” for a parking lot 2 outgoing information, in particular additional attributes, can be stored.
- the position of a motor vehicle 5 parked in a parking space 2 relative to the parking space 2 and the dimensions of the parked motor vehicle 5 are also considered as additional attributes, and also identification features of the parked motor vehicles 5, for example their color, model, type and the like.
- motor vehicles 5, 6 can also provide data relating to themselves (ego data), which can be incorporated into the update of the occupancy map as soon as the motor vehicle 5, 6 has been parked and thus is a parked motor vehicle 5, its properties as an additional attribute the corresponding parking 2 can be assigned.
- Fig. 2 shows a schematic diagram of a co-operating in the inventive motor vehicle 12, which may correspond to one of the motor vehicles 5, 6.
- This has a plurality of environmental sensors, of which radar sensors 13 and ultrasonic sensors 14 are shown as distance sensors in the present case.
- the motor vehicle 12 has a forwardly directed, for example, behind the windshield camera 15 and three so-called top-view cameras 16, two of which are directed to the sides, one to the rear.
- the cameras 16 are all provided with a wide-angle lens in order to be able to record the widest possible area of the surroundings of the motor vehicle 12.
- the raw sensor data of the various environmental sensors 13 - 16 are already at least partially evaluated in at least one control unit 17 of the motor vehicle 12 in order to obtain at least partially evaluated sensor data, which can be transmitted to the communication device 10 of the computing device 7 via a communication device 18 on the motor vehicle side.
- a first example for this are image processing algorithms, in particular those which can evaluate two-dimensional image data of the imaging environment sensors, in this case the cameras 15, 16, in order to obtain three-dimensional information.
- image processing algorithms in particular those which can evaluate two-dimensional image data of the imaging environment sensors, in this case the cameras 15, 16, in order to obtain three-dimensional information.
- two-dimensional images taken at different positions of the motor vehicle 12 can be viewed, but the movement between these positions is known ("structure from movement").
- 3D cameras can be used, such as PMD sensors.
- Other image processing algorithms are also conceivable, for example those which detect and classify objects in images and the like.
- an environment map is managed in the control unit 17 of the motor vehicle 12.
- objects are registered in the environment of the motor vehicle 12 and their properties, after several vehicle systems that are not shown here require such information.
- the position of the motor vehicle 5, 6, 12 is taken into account. It is inventively preferred if the position of the motor vehicle 5, 6, 12 is determined by an evaluation of at least a portion of the sensor data itself, in addition, the occupancy map as a predetermined description of the environment of the motor vehicle 5, 6, 12 is taken into account.
- the badge card contains, in particular then, even if immovable components, ie architectural data, of the parking area 1 are included, already a large amount of information that allows a comparison with sensor data or creating an expectation result for sensor data at certain positions. In particular, this is made possible by the more detailed, determined and updated by the method according to the invention occupancy map. For example, it is conceivable to use a particle filter to localize the location of the sensor data, as is already known in principle from applications of robotics. In addition to objects by distance measurements detecting environmental sensors also generally environmental imaging sensors can provide the sensor data that allows entry into such a comparison. In areas of the parking area 1, for example driveways or the like, where positions can be distinguished only with difficulty, additional markers can be used.
- a positioning system of the parking area 1 which for the sake of clarity in Fig. 1 not shown.
- a position determination system may, for example, use lidar sensors whose detection range is at tire height, but below the body of motor vehicles 5, 6, 12, so that only the tires of the motor vehicles 5, 6, 12 are detected and further conclusions can be drawn therefrom.
- positioning systems of this kind may also use communication data, for example, when there are various receiving stations to enable coarse localization and the like.
- odometric approaches are, preferably complementary, conceivable in which the driving distance of the motor vehicle 5, 6, 12 from a known position descriptive position data are taken into account.
- sensor data which were recorded with the environmental sensors of the motor vehicle 5, 6, 12, report via the communication link 11 to the computing device 7, so that in the sensor data contained information can be entered from the perspective of the current (known) motor vehicle position in the occupancy map.
- Another useful application of the map created or updated by means of the method according to the present invention is locating parked motor vehicles 5.
- characteristics of the parked motor vehicles 5 are stored in the occupancy map, in particular as additional attributes, these can be used to identify and locate motor vehicles 5. This can be done for example via terminals in the parking area 1, for example, those that also serve to pay a fee for parking.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Traffic Control Systems (AREA)
Description
Die Erfindung betrifft ein Verfahren zur Ermittlung und Aktualisierung einer Belegtheitskarte in einem eine Mehrzahl von Parkplätzen aufweisenden Parkareal, insbesondere einem Parkplatzgelände oder einem Parkhaus, wobei die Belegtheitskarte in einer zentralen, eine zur Kommunikation mit in dem Parkareal befindlichen Kraftfahrzeugen ausgebildete Kommunikationseinrichtung aufweisenden Recheneinrichtung gespeichert wird und eine Datenstruktur enthält, in oder aus der für jeweils einen Parkplatz als Zusatzattribut wenigstens dessen Position und dessen Belegtheitszustand enthalten bzw. ableitbar ist.The invention relates to a method for ascertaining and updating a debit card in a parking area having a plurality of parking spaces, in particular a parking lot or a parking garage, wherein the occupancy card is stored in a central computing device having a communication device designed to communicate with motor vehicles in the parking area contains a data structure, in or out of at least one position and its occupancy state for each parking lot as an additional attribute or can be derived.
Parkareale, insbesondere also Parkplatzgelände oder Parkhäuser, sind Örtlichkeiten, die eine Vielzahl von Parkplätzen von Kraftfahrzeuge aufweisen. Häufig ist die Benutzung dieser Parkplätze entgeltpflichtig. Für Fahrer, die einen Parkplatz innerhalb eines solchen Parkareals suchen, ist es teilweise schwierig, insbesondere bei einem hohen Belegtheitsgrad, einen Parkplatz auffinden zu können. Zur Lösung dieser Problematik wurde im Stand der Technik bereits vorgeschlagen, für die Parkplätze Belegtheitssensorik zu verwenden. Diese liefert die Information, ob ein Parkplatz frei oder belegt ist. Diese Information kann in eine Belegtheitskarte eingetragen werden, so dass eine Datenstruktur existiert, aus der feststellbar ist, welche Parkplätze belegt und welche frei sind. Dabei sind verschiedene Arten von Belegtheitssensorik für Parkplätze bekannt, beispielsweise die Verwendung eines in einer Decke verbauten Ultraschallsensors, der über den Abstand zum nächsten Objekt (Kraftfahrzeug oder Boden) bestimmt, ob ein Parkplatz belegt ist. Auch Messungen einer Verzerrung des Erdmagnetfeldes und desgleichen sind möglich.Parking areas, in particular so parking lot or multi-storey car parks, are locations that have a variety of parking lots of motor vehicles. Often, the use of this parking is subject to a charge. For drivers who are looking for a parking space within such a parking area, it is sometimes difficult, especially at a high occupancy, to find a parking space. To solve this problem, it has already been proposed in the prior art to use occupancy sensors for the parking spaces. This provides the information as to whether a parking space is free or occupied. This information can be entered in a badge map, so that a data structure exists from which it can be determined which parking lots are occupied and which are free. In this case, various types of parking sensors are known, for example the use of an ultrasonic sensor installed in a ceiling, which determines via the distance to the next object (motor vehicle or floor) whether a parking space is occupied. Also, measurements of distortion of the earth's magnetic field and the like are possible.
Bei der Verwendung solcher parkplatzspezifischer Belegtheitssensoriken ist jedoch mit enormen Kosten zu rechnen, da jeder Parkplatz des Parkareals, insbesondere Parkhauses, einzeln ausgestattet werden muss. Neben der einfachen Belegtheitsinformation (frei, belegt) liefern diese Sensoren keine weiteren Informationen. Ein weiterer Aufwand entsteht, nachdem jeder Belegtheitssensor gewartet werden muss.In the use of such parking-specific occupancy sensors, however, is to be expected enormous costs, since each parking lot of the parking area, especially parking garage, must be equipped individually. In addition to the simple occupancy information (free, occupied), these sensors provide no further information. Another expense arises after every occupancy sensor has to be serviced.
Ein System zum Erfassen der Parkposition von Fahrzeugen in einem Gebiet, insbesondere in Parkhäusern, wird in
Der Erfindung liegt daher die Aufgabe zugrunde, ein Verfahren zur Ermittlung und Aktualisierung einer Belegtheitskarte in einem Parkareal, insbesondere einem Parkhaus, anzugeben, welches die Verwendung parkplatzspezifischer Belegtheitssensorik vermeidet, zu einer weitergehende Information enthaltenden Belegtheitskarte führen kann und insbesondere auch einfacher und kostengünstiger zu realisieren ist.The invention is therefore based on the object, a method for determining and updating a badge map in a parking lot, in particular a parking garage, indicate which avoids the use of parking-specific occupancy sensors, can lead to a more extensive information containing occupancy map and in particular is easier and less expensive to implement.
Zur Lösung dieser Aufgabe ist ein Verfahren mit den Merkmalen des Anspruchs 1 vorgesehen.To solve this problem, a method having the features of
Dabei sei bereits an dieser Stelle angemerkt, dass es sich bei den Sensordaten nicht zwangsläufig um Roh-Sensordaten handeln muss, sondern verschiedene Auswertungsstände vorliegen können, das bedeutet, die Sensordaten können wenigstens teilweise bereits durch das Kraftfahrzeug ausgewertet sein, bevor sie an die Kommunikationseinrichtung der Recheneinrichtung übermittelt werden. Bei dem Parkareal handelt es sich bevorzugt um ein Parkhaus.It should already be noted at this point that the sensor data does not necessarily have to be raw sensor data, but that different evaluation states can be present, that is to say the sensor data can at least partially be evaluated by the motor vehicle before it can be sent to the communication device of the Computing be transmitted. The parking area is preferably a parking garage.
Die Idee der vorliegenden Erfindung ist es also, die kraftfahrzeugseitig ohnehin vorhandene Umfeldsensorik zu nutzen, um eine Belegtheitskarte des Parkareals zu erstellen sowie zu aktualisieren bzw. zu verfeinern. Es werden mithin serienmäßig in den Kraftfahrzeugen ohnehin vorhandene Umgebungssensoren (häufig auch Umfeldsensoren) genutzt, um eine zusätzliche Funktion zu erfüllen, nämlich ständig eine möglichst aktuelle Belegtheitskarte des Parkareals vorliegen zu haben. Teure, zusätzliche Belegtheitssensorik für die einzelnen Parkplätte ist dann nicht mehr erforderlich. Moderne Kraftfahrzeuge weisen bereits eine Vielzahl von Sensoren auf, die nützliche Informationen liefern können, wobei als Umgebungssensor beispielsweise wenigstens ein bildgebender Sensor, insbesondere eine Kamera und/oder ein PMD-Sensor, und/oder ein Entfernungen messenden Sensor, insbesondere einen Radarsensor und/oder ein Lidarsensor und/oder ein Ultraschallsensor, verwendet werden können. Als besonders zweckmäßig als Umgebungssensoren des Kraftfahrzeugs erweisen sich auch die im Stand der Technik bereits vorgeschlagenen "Top-View-Kameras", das bedeutet, Weitwinkel-Kameras, die beispielsweise Fischaugen verwenden und am oberen Rand der Karosserie des Kraftfahrzeugs derart angeordnet sind, dass sie, insbesondere gemeinsam mit einer Frontkamera, das gesamte Umfeld des Kraftfahrzeugs erfassen können.The idea of the present invention is therefore to use the surroundings sensor system which is already present anyway on the motor vehicle in order to create, update or refine an occupancy map of the parking area. There are therefore standard in the vehicles already existing environmental sensors (often environment sensors) used to fulfill an additional function, namely to have constantly available a possible current occupancy map of the parking area. Expensive, additional occupancy sensors for each parking place is then no longer necessary. Modern motor vehicles already have a plurality of sensors that can provide useful information, wherein at least one imaging sensor, in particular a camera and / or a PMD sensor, and / or a distance-measuring sensor, in particular a radar sensor and / or a lidar sensor and / or an ultrasonic sensor can be used. Particularly useful as environmental sensors of the motor vehicle also prove in the prior art already proposed "top-view cameras", that is, wide-angle cameras, for example, use fish eyes and are arranged at the top of the body of the motor vehicle such that they , especially together with a front camera, can capture the entire environment of the motor vehicle.
In diesem Zusammenhang, aber auch allgemein bei bildgebenden Sensoren ist es zweckmäßig, wenn Bilddaten des bildgebenden Sensors wenigstens teilweise in dem Kraftfahrzeug und/oder in der Recheneinrichtung durch einen Bildverarbeitungsalgorithmus ausgewertet werden. Liefert der bildgebende Sensor zweidimensionale Bilddaten, können daraus dennoch unter Verwendung eines geeigneten Bildverarbeitungsalgorithmus dreidimensionale, das Umfeld beschreibende Sensordaten ermittelt werden, wobei beispielsweise von unterschiedlichen Positionen des Kraftfahrzeugs, zwischen denen die Bewegung des Kraftfahrzeugs bekannt ist, aufgenommene zweidimensionale Bilder betrachtet werden können, gegebenenfalls auch ganze Bewegungsvektorfelder. Derartige Bildverarbeitungsalgorithmen sind beispielsweise unter dem Schlagwort "Struktur aus Bewegung" bekannt. Meist weisen Kraftfahrzeuge auch bereits zur Durchführung solcher Bildverarbeitungsalgorithmen geeignete Steuergeräte auf, die auch im vorliegenden Fall die Roh-Sensordaten geeignet aufbereiten können, um dann die ausgewerteten Sensordaten an die Recheneinrichtung zu übertragen.In this context, but also generally in the case of imaging sensors, it is expedient if image data of the imaging sensor are at least partially evaluated in the motor vehicle and / or in the computing device by an image processing algorithm. If the imaging sensor delivers two-dimensional image data, it can nevertheless be used to determine three-dimensional sensor data describing the environment using a suitable image processing algorithm. For example, two-dimensional images taken of different positions of the motor vehicle between which the movement of the motor vehicle is known may also be considered whole motion vector fields. Such image processing algorithms are known, for example, under the keyword "structure from motion". In most cases, motor vehicles also have control units that are already suitable for carrying out such image processing algorithms, which in the present case can also suitably prepare the raw sensor data in order then to transmit the evaluated sensor data to the computing device.
Eine derart ermittelte und aktuell gehaltene Belegtheitskarte kann als Grundlage für weiterführende Navigation im Fall der manuellen Steuerung des Kraftfahrzeugs, für eine automatisierte Zuweisung eines Parkplatzes und/oder bei einer automatisierten Führung des Kraftfahrzeugs für eine darauf basierte Bahnplanung dienen. Es kann mithin vorgesehen sein, dass die Belegtheitskarte zur Zuweisung eines Parkplatzes an ein einzuparkendes Kraftfahrzeug und/oder zur Streckenplanung innerhalb des Parkareals durch ein Kraftfahrzeug und/oder zur Ermittlung wenigstens eines Navigationshinweises für ein Kraftfahrzeug verwendet wird. Gerade in diesem Zusammenhang zeigen sich die Vorteile der vorliegenden Erfindung besonders deutlich, denn neben der einfachen Information, ob ein Parkplatz belegt oder frei ist, können weitere nützliche Zusatzattribute zu einem Parkplatz enthalten oder ableitbar sein, die die Navigation, insbesondere die vollautomatische Führung des Kraftfahrzeugs (pilotiertes Fahren) deutlich vereinfachen. Bereits heute sind Kraftfahrzeuge bekannt, bei deren serienmäßig ein automatisches Einparken ohne Zutun des Fahrers ermöglicht wird. Dann kann zweckmäßigerweise vorgesehen sein, dass bei der Planung eines insbesondere automatisiert durchzuführenden Einparkvorgangs eines Kraftfahrzeugs die Zusatzattribute wenigstens eines dem Zielparkplatz benachbarten Parkplatzes berücksichtigt werden. Zusatzattribute können also für einen pilotierten Einparkvorgang relevant sein, beispielsweise, ob ein größeres Kraftfahrzeug auf einen Nachbarparkplatz ragt und dergleichen. Hier können Beschädigungen vermieden werden. Beim insgesamt pilotierten, also vollautomatischen Fahren eines Kraftfahrzeugs innerhalb des Parkareals, insbesondere Parkhauses, können selbstverständlich auch weitere, auf alle passierten Parkplätze bezogene Attribute sowie in der Belegtheitskarte enthaltene Zusatzinformation berücksichtigt werden, beispielsweise "wild", also außerhalb eines Parkplatzes, abgestellte Kraftfahrzeuge und/oder Gegenstände.Such a determined and up-to-date occupancy map can serve as a basis for further navigation in the case of manual control of the motor vehicle, for automated allocation of a parking space and / or for automated guidance of the motor vehicle for path planning based thereon. Accordingly, it can be provided that the occupancy card is used for allocating a parking space to a motor vehicle to be parked and / or for route planning within the parking area by a motor vehicle and / or for determining at least one navigation instruction for a motor vehicle. Especially in this context, the advantages of the present invention are particularly clear, because in addition to the simple information whether a parking space is occupied or free, additional useful additional attributes can be included or derivable to a parking lot, the navigation, especially the fully automatic guidance of the motor vehicle (piloted driving) significantly simplify. Already Today, motor vehicles are known, in which an automatic parking is made possible without any intervention by the driver. It may then be expedient to provide for the additional attributes of at least one parking space adjacent to the target parking space to be taken into account when planning a parking procedure of a motor vehicle to be carried out, in particular automatically. Additional attributes may therefore be relevant for a piloted parking operation, for example, whether a larger vehicle protrudes on a neighboring parking space and the like. Damage can be avoided here. When overall piloted, so fully automatic driving a motor vehicle within the parking area, especially parking garage, of course, further, related to all passed parking lot attributes and included in the occupancy map additional information can be considered, for example, "wild", ie outside a parking lot, parked vehicles and / or objects.
Die Nutzung der Sensordaten der Umgebungssensorik der Kraftfahrzeuge, die in dem Parkareal unterwegs sind, erlaubt es also, nützliche Zusatzattribute zu bestimmen. Die Erfindung sieht vor, dass als Zusatzattribute wenigstens eine Position eines auf dem Parkplatz geparkten Kraftfahrzeugs relativ zu dem Parkplatz und/oder wenigstens einer Abmessung des geparkten Kraftfahrzeugs und/oder wenigstens ein Identifikationsmerkmal des geparkten Kraftfahrzeugs verwendet werden. Neben den schlichten Aussagen "belegt" bzw. "frei" werden also die Belegtheitsinformationen (Zusatzattribute) zu jedem Parkplatz angereichert, um konkrete Fahrzeugkonturen, Farbe und Aussehen des belegenden Fahrzeugs sowie die genaue Position und die Abmessung des aktuell geparkten Kraftfahrzeugs innerhalb des Parkplatzes. Wie bereits dargestellt, sind solche Zusatzattribute größtenteils äußerst nützlich für eine sichere Bahnplanung beim vollautomatisierten Betrieb von Kraftfahrzeugen im Parkareal, nachdem beispielsweise über ihren Parkplatz hinausragende und/oder außerhalb eines Parkplatzes abgestellte Objekte ebenso adäquat berücksichtigt werden. Es wird bereits zu diesem Zeitpunkt darauf hingewiesen, dass es immer dann, wenn ein vollautomatisches (pilotiertes) Verfahren des Kraftfahrzeugs im Parkareal stattfinden soll, die Belegtheitskarte zweckmäßigerweise auch Informationen über die Architektur des Parkareals selbst enthalten kann, insbesondere die Lage von unverrückbaren Bauelementen, beispielsweise Wänden, so dass die Belegtheitskarte insgesamt als Basis zur vollautomatischen Steuerung des Kraftfahrzeugs und zur vorausgehenden Bahnplanung eingesetzt werden kann.The use of the sensor data of the environmental sensors of motor vehicles traveling in the parking area thus makes it possible to determine useful additional attributes. The invention provides that at least one position of a motor vehicle parked in the parking space relative to the parking space and / or at least one dimension of the parked motor vehicle and / or at least one identification feature of the parked motor vehicle are used as additional attributes. In addition to the simple statements "occupied" or "free" so the occupancy information (additional attributes) are enriched to each parking lot to concrete vehicle contours, color and appearance of the occupying vehicle and the exact position and dimension of the currently parked motor vehicle within the parking lot. As already stated, such additional attributes are for the most part extremely useful for safe rail planning in the fully automated operation of motor vehicles in the parking area after, for example, objects that project beyond their parking lot and / or parked outside a parking space are also adequately taken into account. It is already pointed out at this time that whenever a fully automatic (piloted) method of the motor vehicle is to take place in the parking area, the occupancy map expediently also contains information about the architecture may include the parking area itself, in particular the location of immovable components, such as walls, so that the occupancy map can be used as a whole as a basis for fully automatic control of the motor vehicle and the previous path planning.
Zweckmäßig ist es aber auch, als Zusatzattribute weitere, für die Navigation weniger relevante Informationen über geparkte Kraftfahrzeuge in der Belegtheitskarte abzuspeichern, beispielsweise die Farbe des Kraftfahrzeugs, das Modell und den Hersteller des Kraftfahrzeugs, falls in den Sensordaten detektierbar oder ohnehin von einem sendenden, eingeparkten oder einparkenden Kraftfahrzeug als Egodaten mitgesendet, beispielsweise ein Nummernschild des Kraftfahrzeugs und dergleichen. Dies erweist sich vor allem dann als zweckmäßig, wenn es um das Auffinden eines Kraftfahrzeugs geht. Es kann mithin vorgesehen sein, dass die Belegtheitskarte zur Identifikation und zum Auffinden eines bestimmten geparkten Kraftfahrzeugs verwendet wird. Hierzu müssen lediglich das gesuchte Kraftfahrzeug beschreibende Identifikationsdaten mit entsprechenden, in der Belegtheitskarte enthaltenden oder aus dieser ableitbaren Zusatzattributen verglichen werden. Entsprechende Eingaben und Suchvorgänge können beispielsweise über geeignete Terminals im Parkareal erfolgen, beispielsweise ohnehin als Kassenautomaten genutzte Terminals, wobei gegebenenfalls auch auf einer Parkkarte eingespeicherte Informationen berücksichtigt werden können.It is also useful, as additional attributes save more relevant for navigation information about parked vehicles in the occupancy map, for example, the color of the motor vehicle, the model and the manufacturer of the motor vehicle, if detectable in the sensor data or in any case from a sending, eingeparkten or parked motor vehicle as Egodaten sent, for example, a license plate of the motor vehicle and the like. This proves to be particularly useful when it comes to finding a motor vehicle. It can therefore be provided that the occupancy card is used for identifying and locating a particular parked motor vehicle. For this purpose, only the desired motor vehicle descriptive identification data must be compared with corresponding, contained in the occupancy map or derivable from this additional attributes. Corresponding inputs and searches can take place, for example, via suitable terminals in the parking area, for example terminals already used as automatic pay stations, whereby information stored on a parking card can also be taken into account if necessary.
Im erfindungsgemäßen Verfahren ist die Verwendung verschiedener Datenstrukturen denkbar. So ist es beispielsweise möglich, dass die Datenstruktur hauptsächlich nach den Parkplätzen und ihren dann explizit eingespeicherten Zusatzattributen sortiert ist. In Fällen, in denen die Belegtheitskarten auch beim vollautomatischen Betrieb von Kraftfahrzeugen eingesetzt werden können, bieten sich jedoch andere Datenstrukturen an, aus denen die Zusatzattribute wenigstens teilweise ableitbar sind, teilweise jedoch auch explizit eingespeichert sein können. Beispielsweise ist es denkbar, dass die Datenstruktur eine Gitterstruktur umfasst, in der von Gitterlinien eingeschlossenen Subarealen Subarealattribute zugeordnet werden. Objekte können dann beispielsweise über zusammenhängende Belegtheitsinformationen als Subattribute identifiziert werden und dergleichen. Selbstverständlich sind jedoch auch andere Datenstrukturen denkbar, wie sie beispielsweise aus Umgebungsmodellen in Kraftfahrzeugen bereits bekannt sind. Vorteilhaft erweist sich insbesondere auch eine CAD-Struktur. Nutzbare Datenstrukturen für Belegtheitskarten sind im Stand der Technik bereits weitgehend bekannt und sollen hier nicht näher diskutiert werden.In the method according to the invention, the use of different data structures is conceivable. For example, it is possible for the data structure to be sorted mainly according to the parking spaces and their then explicitly stored additional attributes. In cases in which the occupancy maps can also be used in the fully automatic operation of motor vehicles, however, other data structures are available, from which the additional attributes can be derived at least partially, but in some cases can also be explicitly stored. For example, it is conceivable that the data structure comprises a grid structure in which subareas associated with grid lines are assigned subarea attributes. Objects can then, for example, be linked via subordinate occupancy information be identified and the like. Of course, however, other data structures are conceivable, as they are already known for example from environmental models in motor vehicles. In particular, a CAD structure also proves advantageous. Usable data structures for occupancy maps are already widely known in the prior art and will not be discussed in more detail here.
Wird eine Gitterstruktur als Datenstruktur verwendet, ist es auch möglich, Parkplätze innerhalb des Gitters zu definieren, beispielsweise, indem der Mittenvektor der Parkmarkierung an einem Ende der Parkmarkierung in das entsprechende Subareal bzw. an dem entsprechenden Gitterpunkt eingetragen wird, wobei die Richtung des Vektors angibt, in welche Richtung sich die Markierung erstreckt, die Länge des Vektors die Länge der Markierung beschreibt. Selbstverständlich sind auch andere Möglichkeiten denkbar. Ähnliche Möglichkeiten zum Eintragen von Parkplätzen als bestimmte Vektoren sind im Übrigen auch Belegtheitskarten, die auf einem CAD-Modell basieren. Auch derartige CAD-Belegtheitskarten sind im erfindungsgemäßen Verfahren nutzbringend einsetzbar.If a grid structure is used as the data structure, it is also possible to define parking spaces within the grid, for example by entering the center vector of the parking marker at one end of the parking marker into the corresponding subarea or the respective grid point, indicating the direction of the vector in which direction the marker extends, the length of the vector describes the length of the marker. Of course, other possibilities are conceivable. Incidentally, similar ways of entering parking spaces as certain vectors are also occupancy maps based on a CAD model. Also, such CAD-occupancy maps are useful in the process of the invention.
Dabei sei an dieser Stelle nochmals darauf hingewiesen, dass die vorliegende Erfindung eine zentral verwaltete Belegtheitskarte betrifft. Die Recheneinrichtung wirkt dabei als eine Datensammelstelle und sorgt mit ihren Berechnungen zur Aktualisierung der Belegtheitskarte dafür, dass immer eine möglichst aktuelle, mit den eingehenden Sensordaten verschiedener Kraftfahrzeuge übereinstimmende Belegtheitskarte vorliegt. Diese kann dann über die Kommunikationseinrichtung wiederum an die Kraftfahrzeuge verteilt werden bzw. diese können spezielle Anfragen senden, beispielsweise nach einem freien Parkplatz und/oder Navigationshinweisen dorthin.It should again be noted at this point that the present invention relates to a centrally managed occupancy card. The computing device acts as a data collection point and, with its calculations for updating the occupancy map, ensures that there is always a current occupancy map which matches the incoming sensor data of different motor vehicles. This can then be distributed via the communication device in turn to the motor vehicles or they can send special requests, for example for a free parking space and / or navigation instructions there.
Zweckmäßig ist es, wenn die Sensordaten von dem Kraftfahrzeug über eine kraftfahrzeugseitige Kommunikationseinrichtung wenigstens teilweise drahtlos an die recheneinrichtungsseitige Kommunikationseinrichtung übertragen werden. Dabei kann die Datenübertragung zweckmäßigerweise über ein WLAN-Netzwerk erfolgen. Verschiedene Varianten der Kraftfahrzeug-zu-X-Kommunikation (Car2X-Kommunikation) können im Rahmen der vorliegenden Erfindung verwendet werden, wobei entsprechende standardisierte Kommunikationsnetzwerke, an denen Kraftfahrzeuge teilnehmen können, im Stand der Technik bereits bekannt sind.It is expedient for the sensor data from the motor vehicle to be transmitted at least partially wirelessly to the computing device-side communication device via a communication device on the motor vehicle side. In this case, the data transmission can expediently take place via a WLAN network. Various variants of motor vehicle-to-X communication (Car2X communication) can be used in the context of the present invention, with corresponding standardized communication networks, in which motor vehicles can participate, are already known in the prior art.
Eine zweckmäßige Ausgestaltung der vorliegenden Erfindung sieht ferner vor, dass ein einparkendes oder geparktes Kraftfahrzeug auch Egodaten über das Kraftfahrzeug selbst an die Recheneinrichtung überträgt, welche bei der Ermittlung oder Aktualisierung der Belegtheitskarte, insbesondere im Hinblick auf einen beparkten Parkplatz, verwendet werden. In Kraftfahrzeugen selbst ist meist eine Vielzahl von Informationen über das eigene Kraftfahrzeug vorhanden, beispielsweise dessen Abmessungen, dessen Typ, spezielle Erweiterungen und dergleichen. Ist nun ohnehin bekannt, dass sich ein Kraftfahrzeug auf einem bestimmten Parkplatz geparkt hat, kann es, wie beschrieben, von Nutzen sein, als Zusatzattribute möglichst weitgehende Information über das geparkte Kraftfahrzeug in die Karte einzuspeichern, die beim Mitübersenden von Egodaten aus erster Hand erhalten werden können.An expedient embodiment of the present invention further provides that a parked or parked motor vehicle also transmits ego data about the motor vehicle itself to the computing device, which are used in the determination or updating of the occupancy map, in particular with regard to a parked parking lot. In motor vehicles themselves, a large amount of information about one's own motor vehicle is usually present, for example its dimensions, its type, special extensions and the like. If it is already known, in any case, that a motor vehicle has parked in a certain parking space, it may be useful, as described above, to store as far as possible information about the parked motor vehicle into the map which is obtained firsthand when the ego data is transmitted can.
Eine Weiterbildung der Erfindung sieht vor, dass bei der Auswertung der Sensordaten zur Ermittlung oder Aktualisierung der Belegtheitskarte eine Position des Kraftfahrzeugs relativ zu den durch die Sensordaten beschriebenen Merkmalen berücksichtigt wird. Diese Position kann im Kraftfahrzeug bestimmt und mit den Sensordaten übertragen werden, möglich ist es jedoch auch, die Sensordaten einer beispielsweise über ein Positionsbestimmungssystem ermittelten Position des Kraftfahrzeugs zuzuordnen, was seitens der Recheneinrichtung geschehen kann. Ist die Position des Kraftfahrzeugs, auf die sich die Sensordaten beziehen, im Parkareal erst bekannt, ist es auf einfache Weise möglich, hieraus Schlussfolgerungen zur Erstellung oder Aktualisierung der Belegtheitskarte zu ziehen. Zur Ermittlung der Position des Kraftfahrzeugs sind eine Vielzahl von Möglichkeiten denkbar. Die Position soll dabei auch als die Orientierung des Kraftfahrzeugs umfassend verstanden werden.A development of the invention provides that in the evaluation of the sensor data for determining or updating the occupancy map, a position of the motor vehicle relative to the features described by the sensor data is taken into account. This position can be determined in the motor vehicle and transmitted with the sensor data, but it is also possible to assign the sensor data to a position of the motor vehicle determined, for example, via a position determination system, which can be done by the computing device. If the position of the motor vehicle to which the sensor data refer is first known in the parking area, it is possible in a simple manner to draw conclusions therefrom for the creation or updating of the occupancy map. To determine the position of the motor vehicle a variety of ways are conceivable. The position should also be comprehensively understood as the orientation of the motor vehicle.
So kann vorgesehen sein, dass die Position des Kraftfahrzeugs durch eine Auswertung von Sensordaten, insbesondere von Sensordaten eines bildgebenden Sensors, und/oder aus Positionsbestimmungsdaten eines wenigstens teilweise im Parkareal verbauten Positionsbestimmungssystems und/oder aus durch ein Kommunikationsnetzwerk, dessen Teil die Kommunikationseinrichtung bildet, gelieferten Kommunikationsdaten und/oder aus die Fahrtstrecke des Kraftfahrzeugs ab einer bekannten Position beschreibenden Positionsdaten ermittelt wird. Dabei sind im Stand der Technik bereits einige Varianten bekannt, durch die die Position eines Objekts in einem bestimmten Areal ermittelbar ist, die auch im Rahmen der vorliegenden Erfindung eingesetzt werden können. Dabei werden häufig unterschiedliche Positionsbestimmungsmaßnahmen kombiniert, was auch im Rahmen der vorliegenden Erfindung zweckmäßig möglich sein kann. Angestrebt ist dabei eine möglichst genaue Ermittlung der Position des Kraftfahrzeugs, insbesondere mit einer Toleranz kleiner als 10 cm, insbesondere kleiner als 5 cm. Einige konkrete Möglichkeiten sind im Folgenden näher dargestellt.Thus, it can be provided that the position of the motor vehicle is provided by an evaluation of sensor data, in particular of sensor data of an imaging sensor, and / or position determination data of a positioning system installed at least partially in the parking area and / or by a communication network, the part of which forms the communication device Communication data and / or from the route of the motor vehicle from a known position descriptive position data is determined. In this case, some variants are already known in the prior art, by which the position of an object in a certain area can be determined, which can also be used in the context of the present invention. In this case, different positioning measures are often combined, which may also be useful in the context of the present invention. The aim is to determine the position of the motor vehicle as accurately as possible, in particular with a tolerance of less than 10 cm, in particular less than 5 cm. Some concrete possibilities are described in more detail below.
So kann beispielsweise vorgesehen sein, dass das Positionsbestimmungssystem auf Reifenhöhe, aber unterhalb der Karosseriehöhe von Kraftfahrzeugen angeordnete, die Reifen von Kraftfahrzeugen detektierende Lidar-Sensoren umfasst. Ein derartiges Konzept wurde kürzlich unter dem Schlagwort "Outside-In-Lidar-Lokalisierung" vorgeschlagen, wobei auch auf die nachveröffentlichte deutsche Patentanmeldung
In einer anderen Variante der vorliegenden Erfindung kann vorgesehen sein, dass zur Auswertung der Sensordaten bei einer vorgegebenen Beschreibung des Parkareals, insbesondere der Belegtheitskarte, ein Partikelfilter und/oder ein Kaimanfilter zur Positionsbestimmung verwendet wird. In diesem Ansatz werden also die Sensordaten selbst genutzt, um die Position aus ihnen herzuleiten, indem letztlich mit vorab bekannten Informationen des Fahrzeugumfeldes (der vorgegebenen Beschreibung) gearbeitet wird, um eine Fahrzeuglokalisierung durchzuführen. Je genauer dabei das Umfeld des Kraftfahrzeugs a priori beschrieben ist, desto besser ist es mit solchen Verfahren möglich, sich darin zu lokalisieren. Besonders zweckmäßig ist es dabei, wenn als die A-Priori-Daten, also die vorgegebene Beschreibung des Parkareals, die Belegtheitskarte selbst verwendet wird.In another variant of the present invention can be provided that for the evaluation of the sensor data in a given description of the parking area, in particular the occupancy card, a particle filter and / or a Kalman filter is used for position determination. In this approach, therefore, the sensor data itself is used to derive the position from them by ultimately working with previously known information of the vehicle environment (the given description) to perform vehicle localization. The more accurately the environment of the motor vehicle is described a priori, the better it is possible with such methods to localize itself therein. It is particularly expedient if the occupancy card itself is used as the a priori data, that is to say the predetermined description of the parking area.
Partikelfilter, häufig auch als Monte-Carlo-Lokalisierung oder sequenzielle Monte-Carlo-Methode bezeichnet, sind aus dem Bereich der Robotik bereits zur Lösung des Lokalisierungsproblems bekannt. Bei der Lösung mittels Partikelfiltern wird die Pose des Kraftfahrzeugs über eine Partikelwolke repräsentiert. Jeder Partikel stellt eine mögliche Position des Kraftfahrzeugs dar. Über den Partikelfilter wird jeder Partikel, also jede dadurch repräsentierte Position, auf ihre Plausibilität überprüft. Die Wahrscheinlichkeit plausibler Partikel kann dann beispielsweise heraufgesetzt werden, die Wahrscheinlichkeit wenig plausibler Partikel wird reduziert. Fallen Partikel unter einen bestimmten Wahrscheinlichkeits-Schwellwert, werden sie verworfen.Particle filters, often referred to as Monte Carlo localization or sequential Monte Carlo method, are already known from the field of robotics for solving the localization problem. In the solution by means of particle filters, the pose of the motor vehicle is represented by a particle cloud. Each particle represents a possible position of the motor vehicle. Via the particle filter, each particle, ie each position represented thereby, is checked for plausibility. The probability of plausible particles can then be increased, for example, the probability of less plausible particles is reduced. If particles fall below a certain probability threshold, they are discarded.
Konkret im Rahmen der vorliegenden Erfindung kann dabei vorgesehen sein, dass aus den Sensordaten ein wenigstens die Lage von unverrückbaren, detektierbaren Bauelementen, insbesondere Wänden, des Parkareals beschreibender Datensatz ermittelt und mit für verschiedene Positionen im Parkareal durch Simulation von Sensordaten ermittelten Hypothesen-Datensätzen verglichen wird, wobei die Position des Kraftfahrzeugs durch Vergleich des Datensatzes mit den Hypothesen-Datensätzen ermittelt wird. Wird die Belegtheitskarte verwendet, lassen sich selbstverständlich zusätzlich zu unverrückbaren Bauelementen wie den Wänden eines Parkhauses auch andere Objekte, beispielsweise geparkte Kraftfahrzeuge, hinzufügen. Dabei wird hier letztlich eine Nachbildung von Sensordaten, insbesondere auf Grundlage der Belegtheitskarte, verwendet. Dies ist besonders zweckmäßig, denn die A-Priori-Daten entsprechen damit einem gleichen oder einem ähnlichen Umgebungssensor wie jenem, welcher im Kraftfahrzeug genutzt wird. Denkbar ist es im Übrigen auch, dass die vorgegebene Beschreibung selbst mit einem Sensor aufgenommene Sensordaten enthält. Dies führt zu einer Verbesserung der Lokalisierungsqualität, da gleichartige Daten verglichen werden und nicht über ein Modell verlustbehaftet angeglichen werden müssen.Specifically, within the scope of the present invention, it may be provided that a data set describing at least the position of immovable, detectable components, in particular walls, of the parking area is determined from the sensor data and compared with hypothesis data records determined for different positions in the parking area by simulation of sensor data , wherein the position of the motor vehicle is determined by comparing the data set with the hypothesis data sets. If the badge card is used, of course, in addition to immovable components such as the walls of a parking garage, other objects, such as parked cars, add. In the process, a simulation of sensor data, in particular based on the occupancy map, is ultimately used here. This is particularly useful, because the a priori data thus correspond to a same or a similar environmental sensor as that which is used in the motor vehicle. Incidentally, it is also conceivable that the given description itself contains sensor data recorded with a sensor. This leads to an improvement of the localization quality, because similar data are compared and do not have to be adjusted lossy via a model.
In diesem Zusammenhang kann es auch zweckmäßig sein, wenn zur Reduzierung der Rechenleistung eine langsame Verfeinerung der Positionsbestimmung erfolgt, so dass beispielsweise nach einem Vergleich alle einen eine Plausibilisierungsschwelle unterschreitenden, im Vergleich bestimmten Plausibilitätswert für die Übereinstimmung der Positionen aufweisenden Hypothesen-Datensätze verworfen werden und deren Position in einem vordefinierten Bereich um die Positionen der nicht verworfenen Hypothesen-Datensätze zur Ermittlung neuer Hypothesen-Datensätze für wenigstens einen weiteren Vergleich vergeben werden.In this context, it may also be expedient if the position is slowly refined to reduce the computing power, so that, for example, after a comparison, all hypothesis data records having a plausibility threshold that are lower than a plausibility threshold and having a certain plausibility value for matching the positions are discarded and their Position in a predefined area around the positions of the non-discarded hypothesis data sets for the determination of new hypothesis data sets are awarded for at least one further comparison.
Ein solches auf der Wahrnehmung von Sensordaten des Kraftfahrzeugs selbst basierendes Verfahren zur Positionsbestimmung kann auch dadurch verbessert werden, dass zumindest in Abschnitten des Parkareals, die sich an unterschiedlichen Positionen wenig unterscheiden, beispielsweise durch zwei Wände eingegrenzte Auffahrten, zusätzliche, für die Umgebungssensoren sichtbare Marker eingesetzt werden.Such a method for determining the position based on the perception of sensor data of the motor vehicle itself can also be improved by using additional markers visible to the environmental sensors, at least in sections of the parking area which differ little at different positions, for example driveways bordered by two walls become.
Wie bereits für den Fall der Verwendung des Partikelfilters und/oder Kalmanfilter dargelegt wurde, ist es äußerst zweckmäßig, dann, wenn die Sensordaten selbst zur Lokalisierung des Kraftfahrzeugs verwendet werden, Vergleichsdaten bereitzustellen, die mit einem gleichen oder ähnlichen Sensor aufgenommen wurden oder entsprechend simuliert wurden, insbesondere auf Grundlage der Belegtheitskarte. So kann allgemein konkret vorgesehen sein, dass die Position des Kraftfahrzeugs wenigstens teilweise durch Vergleich der Sensordaten mit Referenzdaten des Parkareals ermittelt wird, insbesondere durch Vergleich der Sensordaten mit mit demselben Typ von Umgebungssensor und/oder einem gleichen Umgebungssensor aufgenommenen Referenzdaten und/oder entsprechend, insbesondere auf Grundlage der Belegtheitskarte, simulierten Daten. So kann eine Steigerung der Lokalisierungsqualität erreicht werden.As already stated for the case of using the particulate filter and / or Kalman filter, it is most convenient, then, when using the sensor data itself to locate the motor vehicle, to provide comparative data that has been acquired with a same or similar sensor or simulated accordingly , in particular based on the occupancy card. Thus, in general terms, it can be provided that the position of the motor vehicle is determined at least partially by comparing the sensor data with reference data of the parking area, in particular by comparing the sensor data with reference data recorded with the same type of environmental sensor and / or a same environmental sensor and / or correspondingly, in particular based on the occupancy card, simulated data. Thus, an increase in the quality of localization can be achieved.
Ferner ist es, wie auch im Beispiel angedeutet wurde, allgemein zweckmäßig, wenn bei der Ermittlung der Position des Kraftfahrzeugs wenigstens teilweise die Belegtheitskarte verwendet wird, insbesondere also als vorgegebene Beschreibung des Parkareals.Furthermore, as was also indicated in the example, it is generally expedient for the occupancy map to be used at least partially when determining the position of the motor vehicle, in particular as a predetermined description of the parking area.
Die Positionsdaten können dabei selbstverständlich auch im Kraftfahrzeug selbst wenigstens teilweise ermittelt und übertragen werden, wobei auch zur Ermittlung der Position geeignete Daten, insbesondere Sensordaten, im Kraftfahrzeug selbst ermittelt und von diesen übertragen werden können.Of course, the position data can also be at least partially determined and transmitted in the motor vehicle itself, with suitable data, in particular sensor data, also being able to be determined in the motor vehicle itself and transmitted by it to determine the position.
Wie bereits erwähnt, kann es besonders zweckmäßig sein, wenn unterschiedliche Positionsbestimmungsverfahren bzw. Lokalisierungsverfahren in Kombination verwendet werden, beispielsweise zu Verfeinerungszwecken und/oder Plausibilisierungszwecken. So kann es beispielsweise grundsätzlich zweckmäßig sein, mit einem bildgebenden Umgebungssensor des Kraftfahrzeugs aufgenommene Sensordaten mit der Umgebung, wie sie beispielsweise durch die Belegtheitskarte beschrieben wird, zu vergleichen. Zweckmäßig ist hierbei die Verwendung von in verschiedenen Richtungen orientierten Kameras des Kraftfahrzeugs mit Weitwinkel-Objektiven als Umgebungssensoren. In diesem Zusammenhang erweisen sich im Übrigen auch die bereits erwähnten, das Aussehen eines eingeparkten Kraftfahrzeugs beschreibenden Zusatzattribute als nützlich. Zweckmäßig ist, insbesondere ergänzend, im Übrigen auch die Verwendung von Odometrie, das bedeutet, es wird anhand des von dem Kraftfahrzeug zurückgelegten Weg ausgehend von einem bekannten Ort auf einen aktuellen Ort schlussgefolgert. Dieser kann beispielsweise als Ausgangspunkt zur Definition eines Bereichs von Startwerten für einen Partikelfilter und dergleichen verwendet werden. Ersichtlich sind verschiedenste Möglichkeiten denkbar.As already mentioned, it can be particularly expedient if different positioning methods or localization methods are used in combination, for example for refinement purposes and / or plausibility purposes. For example, it may be fundamentally expedient to compare sensor data recorded with an imaging environment sensor of the motor vehicle with the environment, as described, for example, by the occupancy map. Appropriately here is the use of oriented in different directions cameras of the motor vehicle with wide-angle lenses as environmental sensors. Incidentally, the aforementioned additional attributes describing the appearance of a parked motor vehicle prove to be useful in this connection. In addition, the use of odometry, which means that it is concluded on the basis of the path traveled by the motor vehicle from a known location to a current location, is expedient. This may be used, for example, as a starting point for defining a range of start values for a particulate filter and the like. Obviously, various possibilities are conceivable.
Wie bereits erwähnt wurde, sieht eine bevorzugte Ausgestaltung der Erfindung vor, dass die Roh-Sensordaten wenigstens teilweise durch das Kraftfahrzeug selbst ausgewertet werden und die ausgewerteten Sensordaten an die Recheneinrichtung übertragen werden. Dies kann in beliebig weitgehenden Ausgestaltungen erfolgen, so dass es insbesondere auch denkbar ist, dass die Roh-Sensordaten zur Aktualisierung einer in dem Kraftfahrzeug abgelegten Kopie der Belegtheitskarte verwendet werden, wobei zumindest veränderte Anteile der Belegtheitskarte als Sensordaten an die zentrale Recheneinrichtung übertragen werden. Letztlich erhält die Recheneinrichtung dann Änderungsvorschläge, die, gegebenenfalls nach einer zeitlichen Priorität, nur noch in die zentrale Version der Belegtheitskarte eingetragen werden müssen, woraufhin die aktualisierte zentrale Version der Belegtheitskarte wieder an die Kraftfahrzeuge verteilt werden kann. Dies ist jedoch weniger bevorzugt, nachdem die Kraftfahrzeuge ohnehin grundsätzlich Zugriff auf die aktuellste Version der Belegtheitskarte haben sollten.As already mentioned, a preferred embodiment of the invention provides that the raw sensor data are at least partially evaluated by the motor vehicle itself and the evaluated sensor data is transmitted to the computing device. This can take place in arbitrarily far-reaching configurations, so that it is also conceivable in particular for the raw sensor data to be used to update a copy of the occupancy card stored in the motor vehicle, wherein at least changed portions of the occupancy card are transmitted to the central processing unit as sensor data. Ultimately, the computing device then receives proposals for modification, which must be entered, if appropriate, according to a temporal priority, only in the central version of the occupancy card, whereupon the updated central version of the occupancy card can be redistributed to the motor vehicles. However, this is less preferred since the motor vehicles should in principle always have access to the most recent version of the occupancy map.
Zweckmäßig ist es jedoch, wenn die Roh-Sensordaten zur Aktualisierung einer Objekte im Umfeld des Kraftfahrzeugs beschreibenden Umfeldkarte ausgewertet werden, wobei wenigstens ein Teil der in der Umfeldkarte enthaltenen Daten, insbesondere geparkte Kraftfahrzeuge als Objekte beschreibende Daten, oder die gesamte Umfeldkarte als Sensordaten an die Recheneinrichtung übertragen werden. Derartige Umfeldkarten, oft auch als Umfeldmodelle bezeichnet, sind im Stand der Technik bereits weitgehend bekannt und werden im Rahmen einer Sensor- und Informationsfusion im Kraftfahrzeug genutzt, um beispielsweise Fahrerassistenzsystemen, die Umfeldinformationen benötigen, eine standardisierte Datensammlung anzubieten, aus der die benötigten Umfeldinformationen abgerufen werden können. Wird eine derartige Umfeldkarte (ein derartiges Umfeldmodell) ohnehin im Kraftfahrzeug aktuell gehalten, kann sie nutzbringend als Sensordaten an die zentrale Recheneinrichtung übertragen werden. Mit der bekannten Position des Kraftfahrzeugs ist es dann problemlos möglich, die entsprechenden beschriebenen Objekte und ihre Attribute für die Belegtheitskarte umzurechnen und dort einzutragen.It is expedient, however, if the raw sensor data for updating objects in the environment of the motor vehicle descriptive environment map are evaluated, wherein at least a portion of the data contained in the environment map, in particular parked motor vehicles as objects descriptive data, or the entire environment map as sensor data to the Computing device to be transmitted. Such environment maps, often referred to as environment models, are already widely known in the art and are used in the motor vehicle as part of a sensor and information fusion to provide, for example, driver assistance systems that require environmental information to provide a standardized data collection from which the required environmental information is retrieved can. If such an environment map (such an environment model) kept up-to-date anyway in the motor vehicle, it can be usefully transmitted as sensor data to the central computing device. With the known position of the motor vehicle, it is then easily possible to convert the corresponding described objects and their attributes for the occupancy map and enter there.
Es sei an dieser Stelle noch angemerkt, dass (allein aus Gründen des Energieverbrauchs) davon ausgegangen wird, dass die Sensordaten von aktuell betriebenen Kraftfahrzeugen geliefert werden, nicht von abgestellten, außer Betrieb befindlichen Kraftfahrzeugen, wobei letzteres auch grundsätzlich denkbar wäre, beispielsweise dann, wenn es sich um Elektro- oder Hybridkraftfahrzeuge handelt, die mit einem Ladeanschluss verbunden sind, der die Bestromung der Umgebungssensoren ermöglichen würde.It should also be noted at this point that (for reasons of energy consumption alone) it is assumed that the sensor data are supplied by currently operated motor vehicles, not by parked, out of service motor vehicles, the latter also being conceivable in principle, for example, when They are electric or hybrid motor vehicles, which are connected to a charging port, which would enable the energization of the environmental sensors.
Insgesamt beschreibt die vorliegende Erfindung also ein System, dass durch das Parkareal mit der zentralen Recheneinrichtung und innerhalb des Parkareals befindliche, insbesondere betriebene Kraftfahrzeuge gebildet wird, wobei die Kraftfahrzeuge Umgebungssensoren aufweisen, deren gegebenenfalls bereits wenigstens teilweise ausgewertete Sensordaten über eine Kommunikationsverbindung, die insbesondere Teil eines Kommunikationsnetzwerks bildet, an eine Kommunikationseinrichtung der Recheneinrichtung übertragen werden können. Die Recheneinrichtung ist dazu ausgebildet, von Kraftfahrzeugen empfangene Sensordaten auszuwerten, um eine wie bezüglich des erfindungsgemäßen Verfahrens beschrieben ausgestaltete Belegtheitskarte zu ermitteln oder zu aktualisieren. Selbstverständlich erfüllt die zentrale Recheneinrichtung in bestimmten Ausgestaltungen auch weitere Funktionen, beispielsweise die Zuweisung von Parkplätzen an Kraftfahrzeuge, das zur Verfügungsstellen der Belegtheitskarte an Kraftfahrzeuge, das Ermitteln von Navigationshinweisen für Kraftfahrzeuge, das Auffinden von geparkten Kraftfahrzeugen und dergleichen. Für ein derartiges System gelten sämtliche Ausführungen bezüglich des erfindungsgemäßen Verfahrens selbstverständlich ebenso.Overall, the present invention thus describes a system that is formed by the parking area with the central computing device and within the parking area, in particular powered vehicles, the motor vehicles have environmental sensors whose optionally already at least partially evaluated sensor data via a communication link, in particular part of Communication network forms can be transmitted to a communication device of the computing device. The computing device is designed to evaluate sensor data received from motor vehicles in order to determine or update a badge map designed as described with regard to the inventive method. Of course, the central computing device also fulfills certain functions in certain embodiments, for example the allocation of parking spaces to motor vehicles, the availability of the occupancy map to motor vehicles, the determination of navigation instructions for motor vehicles, the finding of parked motor vehicles and the like. Of course, all statements regarding the method according to the invention also apply to such a system.
Weitere Vorteile und Einzelheiten der vorliegenden Erfindung ergeben sich aus den im Folgenden beschriebenen Ausführungsbeispielen sowie anhand der Zeichnungen. Dabei zeigen:
- Fig. 1
- ein Parkareal, in dem das erfindungsgemäße Verfahren durchgeführt wird und
- Fig. 2
- eine Prinzipskizze eines am Verfahren teilnehmenden Kraftfahrzeugs.
- Fig. 1
- a parking area in which the inventive method is carried out and
- Fig. 2
- a schematic diagram of a participant in the process vehicle.
Um den möglichst reibungslosen Betrieb im Parkareal 1 zu sichern, sollen den Kraftfahrzeugen 5, 6 bzw. ihren Fahrern von einer zentralen Recheneinrichtung 7 aus Informationen zur Verfügung gestellt werden, aus denen beispielsweise freie Parkplätze 2 als Zielparkplätze gefolgert werden können, Navigationsanweisungen zu Parkplätzen 2 oder aus dem Parkareal 1 erzeugt werden können und/oder bei vollautomatisch betriebenen Kraftfahrzeugen 5, 6 sogar eine automatische Parkplanung ermöglicht wird. Hierzu weist die Recheneinrichtung 7 eine Speichereinrichtung 8 auf, in der eine Belegtheitskarte des Parkareals 1 gespeichert ist. Diese Belegtheitskarte kann auf verschiedene Art und Weise ausgestaltet sein, enthält jedoch wenigstens die Positionen der Parkplätze 2 und ihren Belegtheitszustand, der als Zusatzattribut unmittelbar gespeichert sein kann oder aus den Daten der Belegtheitskarte ableitbar sein kann. Bevorzugt enthält die Belegtheitskarte jedoch auch weitere Informationen, zum einen die grundsätzliche Architektur des Parkareals 1, insbesondere die unverrückbaren Bauelemente wie Wände 9, sowie weitere Zusatzattribute zu den Parkplätzen 2 bzw. Zusatzdaten, aus denen weitere Zusatzattribute zu den Parkplätzen 2 ableitbar sind.In order to ensure the smoothest possible operation in the
Die Belegtheitskarte kann dabei beispielsweise eine CAD-artige Gitterstruktur als Datenstruktur aufweisen, in die verschiedene Objekte eingetragen werden können. Dann sind bevorzugt auch Architekturdaten und dergleichen enthalten. Es sind jedoch auch andere Möglichkeiten denkbar, beispielsweise eine nach den Parkplätzen 2 organisierte Datenstruktur, worin beispielsweise ein einem Parkplatz 2 zugeordneter Datensatz als ein Container realisiert sein kann, der die Zusatzattribute enthält. Selbstverständlich können auch in einer solchen Datenstruktur weitere Container vorgesehen werden, beispielsweise für feststehende Bauelemente des Parkareals 1 oder außerhalb von Parkplätzen 2 abgestellte Objekte.The occupancy map can have, for example, a CAD-like grid structure as a data structure into which various objects can be entered. Then, architectural data and the like are also preferably included. However, other possibilities are also conceivable, for example a data structure organized according to the
Im gesamten Parkareal 1 ist als Kommunikationsnetzwerk ein WLAN-Netzwerk verfügbar, wobei die zentrale Recheneinrichtung 7 eine zur Kommunikation in dem WLAN-Netzwerk ausgebildete Kommunikationseinrichtung 10 aufweist, so dass eine Kommunikationsverbindung 11 zu Kraftfahrzeugen 5, 6 aufgebaut werden kann. Über die Kommunikationsverbindung 11 können die Belegtheitskarte sowie daraus abgeleitete Informationen den Kraftfahrzeugen 5, 6 zur Verfügung gestellt werden, beispielsweise ein Zielparkplatz mit einer zugehörigen Navigationsanweisung bzw. ohne eine solche, wenn bei vollautomatischem Betrieb des Kraftfahrzeugs 5, 6 die Bahnplanung automatisch erfolgen soll, wobei bevorzugt die Belegtheitskarte insgesamt dem Kraftfahrzeug 5, 6 zur Verfügung gestellt wird. Enthält die Belegtheitskarte, was, wie dargelegt, bevorzugt ist, auch Architekturdaten zum Parkareal 1, lässt sich auf dieser Grundlage eine Bahnplanung durchführen, insbesondere wenn veränderliche Objekte, mithin hauptsächlich geparkte Kraftfahrzeuge 5, ebenso erfasst sind.In the
Vorliegend wird die Kommunikationsverbindung 11 jedoch auch genutzt, um von Umgebungssensoren der im Betrieb befindlichen Kraftfahrzeuge 6 aufgenommene und gegebenenfalls wenigstens teilweise ausgewertete Sensordaten an die Recheneinrichtung 7 zu übermitteln, welche die Sensordaten nutzt, um die Belegtheitskarte zu erstellen und aktuell zu halten, mithin zu aktualisieren. Insgesamt kann also in dem in
Die Nutzung der Sensordaten des Kraftfahrzeugs 6 erlaubt es nicht nur, ohne eine zusätzliche parkplatzspezifische Belegtheitssensorik auszukommen, sondern es kann auch eine deutlich verbesserte Belegtheitskarte geschaffen werden, nachdem über das Zusatzattribut "frei" bzw. "belegt" für einen Parkplatz 2 hinausgehende Informationen, insbesondere Zusatzattribute, eingespeichert werden können. Vorliegend werden als Zusatzattribute beispielsweise die Position eines auf einem Parkplatz 2 geparkten Kraftfahrzeugs 5 relativ zu dem Parkplatz 2 und die Abmessungen des geparkten Kraftfahrzeugs 5 betrachtet, ferner auch Identifikationsmerkmale der geparkten Kraftfahrzeuge 5, beispielsweise deren Farbe, Modell, Typ und dergleichen.The use of the sensor data of the
Solche Zusatzattribute werden durch den hohen Informationsgehalt serienmäßig in Kraftfahrzeugen 5, 6 verbauter Umgebungssensorik ermöglicht. Dabei sei darauf hingewiesen, dass Kraftfahrzeuge 5, 6 auch sich selbst betreffende Daten (Egodaten) mitliefern können, die in die Aktualisierung der Belegtheitskarte einfließen können, sobald das Kraftfahrzeug 5, 6 geparkt wurde und mithin ein geparktes Kraftfahrzeug 5 ist, dessen Eigenschaften als Zusatzattribut dem entsprechenden Parkplatz 2 zugeordnet werden können.Such additional attributes are made possible by the high information content as standard in
Dabei können verschiedene Auswertungsschritte bereits im Kraftfahrzeug 12 erfolgen, insbesondere solche, die ohnehin heutzutage bereits in Kraftfahrzeugen durchgeführt werden. Ein erstes Beispiel hierfür sind Bildverarbeitungsalgorithmen, insbesondere solche, die zweidimensionale Bilddaten der bildgebenden Umgebungssensoren, hier also der Kameras 15, 16, auswerten können, um dreidimensionale Informationen zu erhalten. Dabei können beispielsweise zweidimensionale Bilder, die an unterschiedlichen Positionen des Kraftfahrzeugs 12 aufgenommen wurden, betrachtet werden, wobei jedoch die Bewegung zwischen diesen Positionen bekannt ist ("Struktur aus Bewegung"). Es sei jedoch darauf hingewiesen, dass selbstverständlich auch 3D-Kameras eingesetzt werden können, beispielsweise PMD-Sensoren. Auch andere Bildverarbeitungsalgorithmen sind denkbar, beispielsweise solche, die Objekte in Bildern detektieren und klassifizieren und dergleichen.Various evaluation steps can already take place in the
Im vorliegenden Fall wird im Steuergerät 17 des Kraftfahrzeugs 12 eine Umfeldkarte (Umfeldmodell) verwaltet. In dieser sind Objekte im Umfeld des Kraftfahrzeugs 12 und deren Eigenschaften eingetragen, nachdem mehrere Fahrzeugsysteme, die hier nicht näher dargestellt sind, derartige Informationen benötigen. Zweckmäßig ist in diesem Ausführungsbeispiel dann vorgesehen, dass wenigstens für die Belegtheitskarte relevante Anteile der Umfeldkarte als Sensordaten an die Recheneinrichtung 7 übermittelt werden.In the present case, an environment map is managed in the
Für die Aktualisierung der Belegtheitskarte, bei manchen Datenstrukturen auch unmittelbar der Zusatzattribute, ist es relevant, die Sensordaten räumlich zuordnen zu können, was vorliegend über die Position des sendenden Kraftfahrzeugs 5, 6, 12 (die auch dessen Orientierung umfassen soll) geschieht. Das bedeutet, bei der Auswertung der Sensordaten zur Ermittlung oder Aktualisierung der Belegtheitskarte wird eine Position des Kraftfahrzeugs 5, 6, 12 relativ zu den durch die Sensordaten beschriebenen Merkmalen berücksichtigt. Dabei wird es erfindungsgemäß bevorzugt, wenn die Position des Kraftfahrzeugs 5, 6, 12 durch eine Auswertung wenigstens eines Teils der Sensordaten selber ermittelt wird, wobei zusätzlich die Belegtheitskarte als vorgegebene Beschreibung der Umgebung des Kraftfahrzeugs 5, 6, 12 mit berücksichtigt wird. Denn die Belegtheitskarte enthält, insbesondere dann, wenn auch unverrückbare Bauelemente, also Architekturdaten, des Parkareals 1 enthalten sind, bereits eine Vielzahl von Informationen, die einen Vergleich mit Sensordaten oder das Schaffen eines Erwartungsergebnisses für Sensordaten an bestimmten Positionen erlauben. Insbesondere wird dies ermöglicht durch die detailgenauere, mit dem erfindungsgemäßen Verfahren ermittelte und aktualisierte Belegtheitskarte. Beispielsweise ist es denkbar, einen Partikelfilter einzusetzen, um den Aufnahmeort der Sensordaten zu lokalisieren, wie dies beispielsweise aus Anwendungen der Robotik bereits grundsätzlich bekannt ist. Neben Objekte durch Abstandsmessungen detektierenden Umgebungssensoren können allgemein auch bildgebende Umgebungssensoren die Sensordaten liefern, die Eingang in einen derartigen Vergleich erlauben. In Bereichen des Parkareals 1, beispielsweise Auffahrten oder dergleichen, an denen Positionen nur schwer unterschieden werden können, können zusätzlich Marker verwendet werden.For the update of the occupancy map, in some data structures also directly the additional attributes, it is relevant to spatially assign the sensor data, which in the present case on the position of the sending
Selbstverständlich sind zusätzlich oder alternativ auch andere Möglichkeiten zur Positionsbestimmung denkbar, beispielsweise ein Positionsbestimmungssystem des Parkareals 1, welches der Übersichtlichkeit halber in
Zusammenfassend können also innerhalb des Parkareals 1 betriebene Kraftfahrzeuge 5, 6, 12 Sensordaten, die mit den Umgebungssensoren des Kraftfahrzeugs 5, 6, 12 aufgenommen wurden, über die Kommunikationsverbindung 11 an die Recheneinrichtung 7 melden, so dass die in den Sensordaten enthaltenen Informationen aus Perspektive der aktuellen (bekannten) Kraftfahrzeugposition in die Belegtheitskarte eingetragen werden können.In summary, therefore, within the
Es sei an dieser Stelle noch angemerkt, dass eine weitere nützliche Anwendung der mittels des erfindungsgemäßen Verfahrens erstellten bzw. aktualisierten Belegtheitskarte im Auffinden von geparkten Kraftfahrzeugen 5 liegt. Denn sind in der Belegtheitskarte, insbesondere als Zusatzattribute, Eigenschaften der geparkten Kraftfahrzeuge 5 gespeichert, können diese genutzt werden, um Kraftfahrzeuge 5 zu identifizieren und aufzufinden. Dies kann beispielsweise über Terminals im Parkareal 1 erfolgen, beispielsweise solche, die auch der Bezahlung eines Entgelts für das Parken dienen.It should also be noted at this point that another useful application of the map created or updated by means of the method according to the present invention is locating parked
Claims (17)
- Method for determining and updating an occupancy map in a parking area (1) having a plurality of parking spaces (2), more particularly a ground-level car park or multistorey car park, wherein the occupancy map is stored in a central computing device (7) having a communication device (10) configured for communication with motor vehicles (5, 6, 12) located within the parking area (1) and contains a data structure, in or from which for each particular parking space (2), as additional attribute, at least its position and its occupancy state is contained or derivable, wherein, for the determining and updating of the occupancy map, sensor data received via the communication device (10) from at least one surroundings sensor of at least one motor vehicle (5, 6, 12) located within the parking area (1) are used,
characterised in that,
as additional attributes, also at least one position of a motor vehicle (5) parked on the parking space (2) relative to the parking space (2) and/or at least one dimension of the parked motor vehicle (5) and/or at least one identification feature of the parked motor vehicle (5) are used. - Method according to claim 1,
characterised in that
the sensor data from the motor vehicle (5, 6, 12) are transmitted at least in part wirelessly via a communication device (18) on the vehicle side to the communication device (10) on the computing device side. - Method according to claim 2,
characterised in that
the data transmission takes place via a WLAN network. - Method according to any one of the preceding claims,
characterised in that
a motor vehicle (5, 6, 12) that is being parked or is already parked also transmits data about the motor vehicle (5, 6, 12) itself to the computing device (7), said data being used in the determining or updating of the occupancy map, more particularly with regard to an occupied parking space (2). - Method according to any one of the preceding claims,
characterised in that,
for the evaluation of the sensor data for the determining or updating of the occupancy map, a position of the motor vehicle (5, 6, 12) relative to the features described by the sensor data is taken into account. - Method according to claim 5,
characterised in that
the position of the motor vehicle (5, 6, 12) is determined through an evaluation of sensor data, more particularly of sensor data of an imaging sensor, and/or from position determination data of a position determination system installed at least in part in the parking area (1) and/or from communication data supplied by a communication network, the part of which forms the communication device (10), and/or from position data describing the route of the motor vehicle (5, 6, 12) from a known position. - Method according to claim 6,
characterised in that
the position determination system comprises lidar sensors, which are arranged at tyre height, but below the body of motor vehicles (5, 6, 12), and detect the tyres of motor vehicles (5, 6, 12). - Method according to any one of claims 5 to 7,
characterised in that,
for the evaluation of the sensor data in respect of a given description of the parking area (1), more particularly of a given description by the occupancy map, a particle filter and/or a Kalman filter is used to determine the position. - Method according to any one of claims 5 to 8,
characterised in that
the position of the motor vehicle (5, 6, 12) is determined at least in part through comparison of the sensor data with reference data of the parking area (1), more particularly through comparison of the sensor data with reference data recorded with the same type of surroundings sensor and/or an equivalent surroundings sensor and/or from reference data derived from the occupancy map. - Method according to any one of claims 5 to 9,
characterised in that,
in the determination of the position of the motor vehicle (5, 6, 12), the occupancy map is used at least in part. - Method according to any one of the preceding claims,
characterised in that
the raw sensor data are evaluated at least in part by the motor vehicle (5, 6, 12) itself and the evaluated sensor data are transmitted to the computing device (7). - Method according to claim 11,
characterised in that
the raw sensor data are evaluated to update a map of the surroundings describing objects around the motor vehicle (5, 6, 12), wherein at least some of the data contained in the map of the surroundings, more particularly data describing parked motor vehicles (5) as objects, or the entire map of the surroundings are transmitted as sensor data to the computing device (7). - Method according to any one of the preceding claims,
characterised in that
at least an imaging sensor, more particularly a camera (15, 16) and/or a PMD sensor, and/or a distance-measuring sensor, more particularly a radar sensor (13) and/or a lidar sensor and/or an ultrasonic sensor (14), are used as surroundings sensor. - Method according to claim 13,
characterised in that
image data of the imaging sensor are evaluated at least in part in the motor vehicle (5, 6, 12) and/or in the computing device (7) by an image-processing algorithm, more particularly an image-processing algorithm obtaining three-dimensional information from two-dimensional image data. - Method according to any one of the preceding claims,
characterised in that
the occupancy map is used to allocate a parking space to a motor vehicle (5, 6, 12) that is to be parked and/or to plan the route to be taken by a motor vehicle (5, 6, 12) within the parking area (1) and/or to determine at least a navigational instruction for a motor vehicle (5, 6, 12). - Method according to claim 15,
characterised in that,
in the planning of a parking operation for a motor vehicle (5, 6, 12) that is to be carried out more particularly in an automated way, the additional attributes of at least one parking space adjacent to the target parking space are taken into account. - Method according to any one of the preceding claims,
characterised in that
the occupancy map is used to identify and to find a certain parked motor vehicle (5).
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102013011824.7A DE102013011824A1 (en) | 2013-07-15 | 2013-07-15 | Method for determining and updating a debit card in a parking area |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2830030A1 EP2830030A1 (en) | 2015-01-28 |
EP2830030B1 true EP2830030B1 (en) | 2018-08-08 |
Family
ID=50972416
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP14002059.5A Active EP2830030B1 (en) | 2013-07-15 | 2014-06-14 | Method for determining and updating an occupancy map in a parking area |
Country Status (2)
Country | Link |
---|---|
EP (1) | EP2830030B1 (en) |
DE (1) | DE102013011824A1 (en) |
Families Citing this family (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102014015073B4 (en) * | 2014-10-11 | 2021-02-25 | Audi Ag | Method for updating and / or expanding a map data set in a limited environment |
DE102015206457A1 (en) * | 2015-04-10 | 2016-10-13 | Continental Teves Ag & Co. Ohg | Use of parking cards to support parking systems |
DE102015007531B3 (en) * | 2015-06-11 | 2016-09-01 | Audi Ag | Method for traffic control in a parking environment |
DE102015221237B4 (en) * | 2015-10-30 | 2019-01-03 | Robert Bosch Gmbh | Method and device for locating a motor vehicle located within a parking space |
DE102016207710A1 (en) * | 2016-05-04 | 2017-11-23 | Volkswagen Aktiengesellschaft | Device, means of transport and method for determining a ramp ride in a parking garage |
DE102016211107A1 (en) * | 2016-06-22 | 2017-12-28 | Robert Bosch Gmbh | Concept for determining an occupancy state of a truck parking space |
DE102016221680B4 (en) * | 2016-11-04 | 2022-06-15 | Audi Ag | Method for operating a semi-autonomous or autonomous motor vehicle and motor vehicle |
DE102019210533A1 (en) * | 2019-07-17 | 2021-01-21 | Continental Automotive Gmbh | Valet parking device for automatically bringing a vehicle to a parking space within a given parking space |
DE102020128937A1 (en) | 2020-11-03 | 2022-05-05 | Bayerische Motoren Werke Aktiengesellschaft | System, off-board unit and method for mapping a multi-vehicle parking area |
DE102021209783A1 (en) | 2021-09-06 | 2023-03-09 | Robert Bosch Gesellschaft mit beschränkter Haftung | Method for providing data to create a digital map |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE19856478C1 (en) * | 1998-12-02 | 2000-06-21 | Ddg Ges Fuer Verkehrsdaten Mbh | Parking space detection |
DE102008006356A1 (en) * | 2008-01-28 | 2009-07-30 | Siemens Aktiengesellschaft | System for detecting parking position of vehicles in area, particularly in multi-storey car parks, has radio frequency identification system for locating radio frequency identification tags within defined area |
DE102010033215A1 (en) * | 2010-08-03 | 2012-02-09 | Valeo Schalter Und Sensoren Gmbh | Method for supporting parking in a parking garage, parking system for a vehicle and occupancy status recognition system for a parking garage |
DE102011086268A1 (en) * | 2011-11-14 | 2013-05-16 | Robert Bosch Gmbh | Method for detecting a free parking space |
DE102013100953A1 (en) * | 2012-01-31 | 2013-08-01 | Deutsche Telekom Ag | Method for finding idle parking positions in e.g. multi-storey car parking region to park motor car, involves prioritizing transmitted idle parking positions based on probability data of respective position for predetermined time |
DE102012016800A1 (en) | 2012-08-23 | 2014-02-27 | Audi Ag | Method and device for determining a vehicle position in a mapped environment |
-
2013
- 2013-07-15 DE DE102013011824.7A patent/DE102013011824A1/en not_active Withdrawn
-
2014
- 2014-06-14 EP EP14002059.5A patent/EP2830030B1/en active Active
Non-Patent Citations (1)
Title |
---|
None * |
Also Published As
Publication number | Publication date |
---|---|
EP2830030A1 (en) | 2015-01-28 |
DE102013011824A1 (en) | 2015-01-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2830030B1 (en) | Method for determining and updating an occupancy map in a parking area | |
DE102015203016B4 (en) | Method and device for optical self-localization of a motor vehicle in an environment | |
EP3204279B1 (en) | Method for operating an automatically driven, driverless motor vehicle and monitoring system | |
DE102017125493A1 (en) | TRAFFIC SIGN RECOGNITION | |
EP2915152B1 (en) | Method for identifying a vehicle detected by a sensor device | |
DE102019104217A1 (en) | Providing Information-Rich Map Semantics to Navigation Metrics Maps | |
DE102015110812A1 (en) | Motor vehicle drone deployment system | |
DE102016211182A1 (en) | A method, apparatus and system for performing automated driving of a vehicle along a trajectory provided from a map | |
EP3164858A1 (en) | Method for determining parking spaces and free-parking space assistance system | |
WO2018197122A1 (en) | Method for automatically producing and updating a dataset for an autonomous vehicle | |
DE102017216442A1 (en) | Automatic parking system | |
WO2018189076A1 (en) | Method for detecting parking spaces in an environment region of a motor vehicle, evaluating apparatus, parking assistance system, motor vehicle and networked system | |
DE102016122990A1 (en) | Method for the autonomous maneuvering of a motor vehicle on a parking area with determination of a position deviation, infrastructure device, driver assistance systems, motor vehicle and communication system | |
DE102015202482A1 (en) | Method for operating a vehicle | |
DE112021006402T5 (en) | Estimating automatic exposure values of a camera by prioritizing an object of interest based on contextual input from 3D maps | |
DE102017212513A1 (en) | Method and system for detecting a free area within a parking lot | |
DE102016119729A1 (en) | Controlling a passenger transport vehicle with all-round vision camera system | |
DE102015207729A1 (en) | CONTROL DEVICE FOR A VEHICLE AND METHOD | |
DE102021112856A1 (en) | Method for locating a charging station set up for charging a plug-in electric vehicle | |
DE102019128253B4 (en) | Procedure for navigating an industrial truck | |
DE102020206134A1 (en) | Method for operating a motor vehicle | |
DE102016012814A1 (en) | Method for supporting a road user in finding a suitable parking space for a motor vehicle and motor vehicle | |
DE102021209575B3 (en) | Method and assistance device for supporting vehicle functions in a parking space and motor vehicle | |
DE102017212379A1 (en) | Method and system for detecting a free area within a parking lot | |
DE102014110173A1 (en) | A method for assisting a driver when parking a motor vehicle, driver assistance system and motor vehicle |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
17P | Request for examination filed |
Effective date: 20140614 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
R17P | Request for examination filed (corrected) |
Effective date: 20150728 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20161219 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20180523 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP Ref country code: AT Ref legal event code: REF Ref document number: 1027914 Country of ref document: AT Kind code of ref document: T Effective date: 20180815 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: GERMAN |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 502014009085 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20180808 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181208 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180808 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180808 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181109 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181108 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180808 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181108 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180808 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180808 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180808 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180808 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180808 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180808 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180808 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180808 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180808 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180808 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180808 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 502014009085 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180808 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180808 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180808 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20190509 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180808 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180808 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20190630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180808 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190614 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190614 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190630 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190630 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181208 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MM01 Ref document number: 1027914 Country of ref document: AT Kind code of ref document: T Effective date: 20190614 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190614 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180808 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20140614 Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180808 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180808 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230530 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20240625 Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240630 Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20240626 Year of fee payment: 11 |