EP2577227A1 - Verfahren zur bestimmung einer anordnung einer tragbaren kommunikationsvorrichtung innerhalb eines koordinatensystems eines fahrzeuges, zugehörige datenverarbeitungseinheit und tragbare kommunikationsvorrichtung - Google Patents

Verfahren zur bestimmung einer anordnung einer tragbaren kommunikationsvorrichtung innerhalb eines koordinatensystems eines fahrzeuges, zugehörige datenverarbeitungseinheit und tragbare kommunikationsvorrichtung

Info

Publication number
EP2577227A1
EP2577227A1 EP10725980.6A EP10725980A EP2577227A1 EP 2577227 A1 EP2577227 A1 EP 2577227A1 EP 10725980 A EP10725980 A EP 10725980A EP 2577227 A1 EP2577227 A1 EP 2577227A1
Authority
EP
European Patent Office
Prior art keywords
communication device
portable communication
vehicle
coordinate system
computing unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP10725980.6A
Other languages
English (en)
French (fr)
Inventor
Siav Kuong Kuoch
Patrick Bonhoure
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Valeo Schalter und Sensoren GmbH
Original Assignee
Valeo Schalter und Sensoren GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Valeo Schalter und Sensoren GmbH filed Critical Valeo Schalter und Sensoren GmbH
Publication of EP2577227A1 publication Critical patent/EP2577227A1/de
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/10Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
    • G01C21/12Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
    • G01C21/16Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
    • G01C21/166Mechanical, construction or arrangement details of inertial navigation systems
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C11/00Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
    • G01C11/04Interpretation of pictures
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C25/00Manufacturing, calibrating, cleaning, or repairing instruments or devices referred to in the other groups of this subclass
    • G01C25/005Manufacturing, calibrating, cleaning, or repairing instruments or devices referred to in the other groups of this subclass initial alignment, calibration or starting-up of inertial devices
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/80Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30181Earth observation
    • G06T2207/30188Vegetation; Agriculture
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30204Marker
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30248Vehicle exterior or interior
    • G06T2207/30252Vehicle exterior; Vicinity of vehicle

Definitions

  • the invention relates to a method for determining an arrangement of a portable communication device within a coordinate system defined for a vehicle.
  • the portable communication device is configured for supporting the driver in driving the vehicle; for instance, an application is running on the portable communication device that supports the driver during the driving task.
  • the invention also relates to a computing unit for performing such method as well as a portable communication device that comprises such computing unit.
  • portable communication devices such as for instance mobile telephones (smart phones) or mobile personal computers (personal digital assistants, for example) - are used for driver support in vehicles.
  • a portable communication device can be employed for recognition of road markings and it can warn the driver if the vehicle leaves the lane.
  • a camera of the portable communication device is used that records an image of the region in front of the vehicle; a computing unit of the portable communication device then processes the recorded image.
  • the computing unit determines the position of the vehicle relative to the recognized road markings, namely on the basis of the results rendered by the image processing.
  • An object of the present invention is to provide a solution as to how the reliability of a portable communication device when supporting the driver in driving the vehicle can be improved over the prior art.
  • An inventive method serves for determining the arrangement of a portable communication device within a coordinate system defined for a vehicle.
  • the portable communication device supports the driver in driving the vehicle.
  • the arrangement of the portable communication device within the coordinate system of the vehicle is determined by a computing unit on the basis of sensor data obtained by at least one sensor.
  • the arrangement of the portable communication device within the coordinate system of the vehicle is determined, namely on the basis of sensor data.
  • the portable communication device thus knows its current arrangement within the vehicle and thus is capable of determining with high accuracy for example the relative position of the vehicle with regard to a road marking.
  • the arrangement of the portable communication device within the coordinate system of the vehicle can be determined very accurately on the basis of sensor data provided by a sensor.
  • the portable communication device is a retrofit part that is retrofitted in the vehicle for driver support.
  • This may be for instance a mobile phone (smart phone) or a mobile personal computer, like personal digital assistant, organizer or the like.
  • Such devices nowadays have a high computing power and thus can be employed for driver assistance.
  • the portable communication device thus is not a factory-fitted component of a driver assistance system.
  • the term ..arrangement"- according to the present invention - comprises an absolute position within the coordinate system of the vehicle - this position can be unambiguously defined by coordinate values - and/or an orientation or alignment within the coordinate system of the vehicle - this in turn can be defined by a roll angle and/or a pitch angle and/or a yaw angle.
  • the coordinate system defined for the vehicle preferably is a Cartesian coordinate system.
  • the origin of the coordinate system can be defined to be located at any random point of the vehicle, namely for instance in a middle point of a rear axis or a middle point of a bottom edge of the windscreen.
  • sensor data are employed for determining the arrangement, the data being obtained exclusively by at least one internal sensor of the portable communication device. Then, the computing unit determines the arrangement on the basis of sensor data of at least one sensor of the portable communication device, and no further devices or external sensors need to be employed. Then, the method does not require additional external sensors. In an alternative embodiment, it may be provided that the arrangement is determined on the basis of sensor data of an external sensor that is separate from the portable communication device, namely for instance a separate camera.
  • the arrangement of the portable communication device within the coordinate system of the vehicle may be determined on the basis of an image provided by a camera - in particular of an internal camera of the portable communication device - and/or on the basis of measuring values provided by an acceleration sensor - in particular of an internal acceleration sensor of the portable communication device - and/or on the basis of measuring values provided by a compass - in particular by an internal compass of the portable communication device. All these sensors facilitate determination of the arrangement of the portable communication device within the coordinate system of the vehicle with a high accuracy and at a low effort.
  • the computing unit may be an internal computing unit of the portable communication device; in this case the arrangement is determined by an internal computing unit of the portable communication device.
  • the sensor data can be transmitted to an external, namely a remote host server; in this case the arrangement of the portable communication device can be calculated by a powerful computing unit of the host server, and data containing information about the arrangement can be transmitted by the host server to the portable communication device.
  • the determining of the arrangement may comprise determining an absolute position of the portable communication device within the coordinate system of the vehicle.
  • the actual position of the portable communication device in space is known, so that the portable communication device can reliably support the driver in driving the vehicle.
  • errors in determining the relative position of the vehicle with regard to a road marking are avoided, and a false alarm rate when warning the driver about the vehicle leaving the lane can be reduced to a minimum.
  • the absolute position of the portable communication device within the coordinate system of the vehicle preferably at least two coordinate values, in particular three coordinate values, are calculated. If the coordinate system is a Cartesian one, preferably all three coordinate values are calculated, so that the position of the portable communication device in three-dimensional space is known. In an alternative embodiment in the case of a Cartesian coordinate system equally as well only two coordinate values can be calculated, namely in particular in the transverse direction of the vehicle and in the vertical direction of the vehicle. This is due to the fact that portable communication devices as a rule are attached to a windscreen so that the position of the portable communication device in the longitudinal direction of the vehicle is largely known.
  • the determination of the absolute position of the portable communication device in the coordinate system may be effected in such a way that the position of the portable communication device itself is determined. It may, however, also be envisaged that the determination of the position of the portable communication device is indirectly effected by determining an absolute position of a holding device within the coordinate system. This means the position of the holding device - on which the portable communication device is mounted - may be determined; this position then corresponds to the position of the portable communication device, if same communication device is mounted on the holding device.
  • a distance of the portable communication device or a holding device is determined on the basis of the sensor data, and the absolute position then is calculated from the at least two distances.
  • At least two - in particular at least three - marking elements having a predetermined pattern can be provided that can be mounted at a predetermined place of the vehicle.
  • the marking elements may for instance be adhesive tags or stickers and/or so-called suction cup or sucking disc elements that can be attached to the windscreen or the dashboard of the vehicle at little effort.
  • an image can be recorded by a camera, the image containing all marking elements.
  • the user will preferably record an image in which the complete wind screen including the marking elements attached thereto is shown.
  • the computing unit detects the marking elements in the image and defines the at least two reference points in the image in dependence on the position of the marking elements. The actual distances (in space) between the portable communication device or its holding device and the reference points within the coordinate system of the vehicle then are calculated from the distances in the image.
  • the named image may be recorded either by a camera of the portable communication device itself or by a separate random camera.
  • the computing unit processes the image, recognizes the attached marking elements, determines the at least two reference points in dependence on the positions of the marking elements in the image, calculates the distances between the portable communication device (or the holding device) and the reference points in the image (in pixels) and subsequently calculates the actual distances within the coordinate system of the vehicle (in meters).
  • the computing unit can also use further information, namely vehicle-specific information, such as for instance the actual dimensions of the windscreen and/or the coordinate values of at least one point of the windscreen within the coordinate system of the vehicle and/or the orientation angle of the windscreen within the coordinate system.
  • a marking element may be provided, namely one with a predetermined pattern.
  • the computing unit can detect the portable communication device or the holding device in the recorded image and calculate the corresponding distances at little computing effort.
  • the above-described embodiment for instance can be realized in the following sequence:
  • the driver places three marking elements on the windscreen, namely a first marking element at a middle point of the top edge of the windscreen, a second marking element at a middle point of the bottom edge of the windscreen, and a third marking element in a top corner of the windscreen, e.g. on the driver's side of the vehicle.
  • On the windscreen moreover is attached a holding device for a portable communication device - namely for a mobile telephone. Also this holding device contains a marking element. All marking elements - for instance adhesive labels or sucking discs - have a predetermined pattern, for instance a circle, a ring, a cross or a similar pattern.
  • the driver records an image of the complete windscreen, namely with the aid of his portable communication device that is equipped with a camera.
  • An internal computing unit of the portable communication device receives this image and processes it.
  • the computing unit detects the predetermined pattern of the marking elements in the image. This means, the computing unit detects the marking elements in the image.
  • the computing unit calculates - in pixels - the distance between the first marking element (centre point of the top edge) and the second marking element (centre point of the bottom edge) as well as the distance between the first marking element and the third marking element (top corner above the driver).
  • the distance between the first and the second marking element corresponds to the width of the windscreen in pixels, whilst the distance between the first and the third marking element corresponds to half the length of the windscreen in pixels.
  • the computing unit determines two reference points, namely a first reference point that is located on a connection line between the first and the second marking element, as well as a second reference point that is located on a connection line between the first and the third marking element.
  • the reference points are determined with the aid of a corresponding algorithm, namely in particular the so-called AdaBoost algorithm.
  • the first reference point is the one on the connection line between the first and the second marking element through which runs a line extending through the marking element of the holding device and perpendicularly to said connection line.
  • the second reference point is the point on the connection line between the first and the third marking element through which runs a line extending through the marking element of the holding device that is perpendicular to the connection line between the first and the third marking element. Consequently, the distance between the marking element of the holding device and the first reference point corresponds to the distance between the marking element of the holding device and a middle axis of symmetry of the windscreen, whilst the distance between the marking element of the holding device and the second reference point corresponds to the distance of the marking element of the holding device and the top edge of the windscreen. In this process the computing unit calculates the two distances in pixels.
  • the computing unit moreover receives a piece of information about the model or the type series as well as about the manufacture year of the vehicle; these pieces of information are entered by the driver into the portable communication device. These pieces of information may also be stored in the portable communication device. From these pieces of information - for instance from the internet or a proprietary database - the computing unit gathers the dimensions of the windscreen as well as the coordinate values of at least one point of the windscreen within the coordinate system of the vehicle and an orientation angle of the windscreen relative to said coordinate system. The distances of the marking element of the holding device from the two reference points in pixels are now converted in corresponding actually distances in space (in meters, for example), namely in dependence on the dimensions of the windscreen.
  • the calculated distances and the orientation angle of the windscreen are calculated. Through these coordinate values the absolute position of the marking element of the holding device and thus also the portable communication device within the coordinate system of the vehicle is unambiguously known. These coordinates are then used by the portable communication device for supporting the driver in driving the vehicle.
  • the above-described method has the advantage that the absolute position of the portable communication device can be determined at little effort, namely by way of recording merely an image as well as with the aid of four marking elements. This determination of the position is very accurate, so that the portable communication device can
  • the computing unit can also detect the holding device or the portable communication device (if an external camera is used) in the recorded image at little expense and calculate the above-named distances.
  • the at least two distances - between the at least two reference points and the portable communication device or the holding device - can be determined from measuring values provided by an acceleration sensor.
  • This acceleration sensor is preferably an internal sensor of the portable communication device.
  • the computing unit can then calculate the distances between the holding device and the two reference points of the vehicle on the basis of the measuring values provided by the acceleration sensor - namely by way of integration. In this embodiment, no further marking elements are required, and the absolute position of the holding device within the coordinate system of the vehicle can still be determined with a high degree of accuracy.
  • This embodiment for instance can be realized in the following sequence: On the windscreen of the vehicle a holding device for a portable communication device - namely a mobile phone - is attached.
  • the portable communication device has an acceleration sensor for measuring the acceleration.
  • a computing unit of the portable communication device receives the measuring values provided by the acceleration sensor and processes them.
  • the driver takes the portable communication device and holds it in such a way that it touches the holding device sideways, for instance on the right side.
  • the driver subsequently moves the portable communication device horizontally from the holding device up to a right edge of the windscreen until the portable communication device touches the lateral wall.
  • the portable communication device bumps slightly against the lateral wall.
  • the driver then moves the portable communication device equally horizontally back towards the holding device, namely until the portable communication device has reached the holding device again.
  • the driver performs the same act in the vertical direction; he moves the portable communication device from the holding device along the windscreen upwards until the portable communication device touches the roof lining slightly. The driver then moves the portable communication device back to the holding device.
  • the acceleration sensor measures the acceleration of the portable communication device, and the computing unit receives the measuring values.
  • the computing unit integrates the measuring values twice and thus calculates two distances on the whole, namely the distance between the holding device and the side edge (first reference point) as well as the distance between the holding device and the top edge of the windscreen (second reference point).
  • the computing unit also knows - as has been set out in the above - the coordinate values of at least one point of the windscreen within the coordinate system of the vehicle, as well as the orientation angle of the windscreen.
  • the computing unit calculates the coordinate values of the holding device within the coordinate system of the vehicle. So, in one embodiment, the two distances are determined within a plane of a windscreen of the vehicle. Thus, it is possible to determine the absolute position of the portable communication device or the holding device on the basis of merely two reference points or the distances between the portable communication device or the holding device and two reference points.
  • the determination of the arrangement may also comprise that an orientation of the portable communication device within the coordinate system of the vehicle is determined on the basis of the sensor data. This orientation is preferably determined on the basis of such sensor data that are exclusively obtained through at least one internal sensor of the portable communication device.
  • the determination of the orientation of the portable communication device with regard to the coordinate system of the vehicle has the advantage that errors occurring in the provision of functions for driver support can be eliminated that are caused by an tilted orientation of the portable communication device in the prior art. This, too, proves particularly advantageous for such applications, in which the road markings are detected through the portable communication device - namely with the aid of a camera - and the driver is warned when leaving the lane. The false alarm rate can thus be reduced to a minimum.
  • What is particularly advantageous is to determine a roll angle and/or a pitch angle and/or a yaw angle of the portable communication device within the coordinate system of the vehicle for the determination of the orientation. For determining these angles a local coordinate system is defined for the portable communication device, and the
  • corresponding angles are determined on the basis of the orientation of the local coordinate system in relation to the coordinate system of the vehicle.
  • the roll angle and/or the pitch angle is/are preferably determined solely on the basis of the measuring values provided by an acceleration sensor of the portable communication device.
  • Such acceleration sensor also G-sensor
  • the portable communication device can do without additional sensors when calculating the roll angle and/or the pitch angle; just one acceleration sensor suffices in order to determine the roll angle and/or the pitch angle.
  • the yaw angle by contrast, describes the extent of the rotation of the portable
  • the computing unit receives measuring values provided by the acceleration sensor that are recorded during this motion and subsequently calculates the yaw angle.
  • the computing unit also ensures that the vehicle was driven straight on. This is preferably determined on the basis of measuring values provided by a compass of the portable communication device.
  • the computing unit Whilst the vehicle is driven, the computing unit also receives the measuring values of the compass and checks whether a predetermined calculation criterion is fulfilled or not.
  • This criterion includes the condition that the standard deviation of a certain predetermined number of measuring values of the compass or the standard deviation of the measuring values over a predetermined period of time remains below a predetermined limit value. If this calculation criterion is fulfilled, the computing unit determines that the vehicle essentially was driven straight on, and the computing unit assesses the yaw angle as correctly determined.
  • a computing unit that is configured for performing a method according to the invention.
  • a portable communication device according to the invention comprises a computing unit according to the invention.
  • the embodiments presented as preferable with regard to the method according to the invention and their advantages apply in analogy to the communication device according to the invention and the computing unit according to the invention.
  • each a schematic view of a marking element for employment in a method according to an embodiment of the invention; an image recorded with the aid of a camera, the image showing a windscreen of a vehicle with marking elements attached thereto, wherein a method according to an embodiment of the invention is explained in more detail; a schematic side view of the windscreen, wherein the calculation of the coordinate values of a holding device of a portable communication device within the coordinate system of the vehicle is explained in more detail; a schematic representation of the windscreen of the vehicle with a holding device for a portable communication device attached thereto, wherein a method according to a further embodiment of the invention is explained in more detail; a graph of an acceleration over time measured by means of an acceleration sensor of the portable communication device, a graph of a velocity calculated on the basis of the acceleration, and a graph of a distance calculated from the velocity; a graph of the distance over time, wherein a method according to a further embodiment of the invention is explained in more detail; a Cartesian coordinate system of the vehicle, wherein the
  • Fig. 11 time-dependent graphs of measuring values of a compass (left) as well as time-dependent graphs of the yaw angle, each for a first (top) and a second (bottom) driving situation, wherein a calculation criterion for the determination of the yaw angle is explained in more detail.
  • Marking elements 1 are provided, namely for instance three or four marking elements 1.
  • the marking elements 1 may be adhesive tags or suction cups that can be attached to a windscreen 2 of the vehicle, namely by the driver.
  • the marking elements 1 have a predetermined pattern, so that a computing unit can detect the marking elements in an image of a camera.
  • a first example of a marking element 1 is shown.
  • This marking element 1 is a circle element, for instance an adhesive tag or a suction cup.
  • the pattern of this marking element 1 comprises an inner circle 3 with a first colour, e.g. black.
  • Around the inner circle 3 there is an outer ring 4 that is concentric thereto and has a second colour, e.g. white or yellow.
  • the marking element 1 can for instance have a diameter from a range of values from 1 °cm to 10°cm.
  • Fig. 1 b shows a second example of a marking element 1. This equally has a
  • this marking element 1 equally is a circular element. It is subdivided into four equal circular sectors 5a to 5d that consist of pairs of the same colour. Namely two opposite circular sectors 5a, 5c have a first colour, for instance black, whilst the remaining two circular sectors 5b, 5d have a second colour, for instance white or yellow.
  • the marking element 1 according to Fig. 1 b may be an adhesive tag or a suction cup. It preferably has a diameter from a range of values from 1 cm to 10 cm.
  • the driver attaches three marking elements 1 to the windscreen 2. Namely the driver attaches - as shown in Fig. 2 - a first marking element 1a in a middle point of a top edge 6 of the windscreen 2. This is normally a foot point of the rear mirror.
  • a second marking element 1 b is attached by the driver in a middle point of a bottom edge 7 of the windscreen 2.
  • a third marking element 1c is attached by the driver in the top corner of the windscreen 2, for instance on the driver's side.
  • FIG. 2 the windscreen 2 is shown from outside of the vehicle.
  • a coordinate system x, y, z of the vehicle is equally shown in Fig. 2.
  • An additional marking element 1d which may have an identical or a differing pattern than marking elements 1a to 1c is provided for a holding device of the portable communication device.
  • This marking element 1d may be an element that is separate from the holding device or it may be integrated in the holding device; then a holding device with a particular pattern is provided.
  • the holding device, i.e. the additional marking element 1d is mounted in that half of the windscreen 2 in which the marking element 1c is mounted, too. This means that both the holding device and the marking element 1c are mounted in the same half of the windscreen 2.
  • the driver takes a photograph of the windscreen 2 with the marking elements 1 a to 1d attached thereto with the aid of a camera.
  • image of the windscreen 2 is recorded by means of the portable communication device itself, namely by means of the camera integrated therein.
  • the driver will preferably record an image - for instance from outside of the vehicle or also from inside - that essentially comprises exclusively the complete windscreen 2, so that the windscreen 2 is shown at maximum size.
  • the processing of the recorded image through a computing unit is then simplified.
  • an image of the windscreen 2 is preferably recorded by an internal camera of the portable communication device.
  • the processing of the image data is equally preferably performed through an internal computing unit of the communication device.
  • the image is recorded with the aid of any random camera, namely a camera that is separate from the portable communication device.
  • the image or the image data are transmitted to a remote host server. Then the host server performs the processing of the image data and transmits data with information about the absolute position back to the portable communication device.
  • the processing of the recorded image is effected as follows:
  • the computing unit receives the recorded image.
  • the computing unit detects the patterns of the marking elements 1a to 1d (circle detection) and thus recognizes the marking elements 1a to 1d in the image.
  • a particular algorithm is used, namely the Hough Transformation.
  • the computing unit calculates a first distance d between the first marking element 1a and the second marking element 1b. This distance d is then given in pixels.
  • This distance d corresponds to the width of the windscreen 2 in the image (pixels).
  • the computing unit moreover calculates a second distance D, namely between the first marking element 1a and the third marking elements 1 c.
  • the second distance D is equally given in pixels. This distance corresponds to half a length of the windscreen 2 in the image (pixels).
  • the computing unit determines a first reference point R1 in the image which is located on a connection line between the first and the second marking elements 1a, 1 b.
  • the computing unit determines a second reference point R2 which is located on a connection line between the first and the third marking element 1 a, 1c.
  • the first reference point R1 consequently is located on a middle symmetry axis of the windscreen 2, whilst the second reference point R2 is located essentially on the top edge 6 between the marking elements 1a, 1c.
  • the first reference point R1 is chosen so that it is located on a line 8 that, on the one hand, extends through the additional marking element 1d and, on the other hand, perpendicularly to the connection line between the first and the second marking elements 1a and 1 b.
  • the second reference point R2 is chosen in such a way that it is located on a line 9 that, on the one hand, extends through the additional marking element 1d and, on the other hand and considering the curvature of the windscreen 2, approximately perpendicularly to the connection line between the first and the third marking element 1a, 1c.
  • the computing unit then calculates a distance r1 between the additional marking element 1d and the first reference point R1 as well as a distance r2 between the additional marking element 1d and the second reference point R2.
  • the distance r1 corresponds to a distance of the marking element d from the middle symmetry axis of the windscreen 2 (pixels); the distance r2 corresponds to a distance of the marking element 1d from the upper edge 6 of the windscreen 2 (equally pixels).
  • the computing unit now knows the distances r1 and r2. Equally does the computing unit know the dimensions of the windscreen 2, namely its actual length L as well as its actual width B (in meters, for example).
  • the computing unit also knows the coordinate values of at least one point of the windscreen 2 within the coordinate system x, y, z of the vehicle. For instance the computing unit knows the coordinate values x P , yp, z P of a middle point P of the bottom edge 7 of the windscreen 2.
  • the computing unit knows an orientation angle a (see Fig. 3) of the windscreen 2; the orientation angle a is an angle between the windscreen 2 and the x axis of the coordinate system of the vehicle.
  • All this information is received by the computing device for instance from a host server; alternatively, these pieces of information may also be stored in a storage of the portable communication device.
  • the obtaining of this information may for instance consist in that the driver enters the model or the manufacture series of the vehicle as well as the manufacture year into the portable communication device, the computing unit sends same entry to the host server and the host server then transmits the required information to the portable communication device.
  • r2 (in meters, for example) (B/d) * r2 (in pixels).
  • the computing unit now knows the actual distances r1 , r2 of the holding device of the portable communication device both from the middle symmetry axis of the windscreen 2 and from the top edge 6 of the windscreen.
  • the computing unit calculates the coordinate values of the additional marking element 1d and thus of the holding device and thus of the portable communication device within the coordinate system x, y, z of the vehicle.
  • the distances r1 , r2 are the actual distances in space (in meters, for instance).
  • the computing unit knows the absolute position of the portable communication device within the coordinate system x, y, z of the vehicle. It may employ these coordinate values x s , ys, zs for the provision of the driver support functions, namely for instance for the calculation of the position of the vehicle on the road.
  • a holding device 10 is located on the windscreen 2.
  • the windscreen 2 is shown from inside the vehicle.
  • the driver takes its portable communication device 11 and moves it from the holding device 10 towards a reference point R3, namely towards the right edge 12 of the windscreen 2.
  • the driver moves the portable communication device 11 horizontally in the direction of the arrow A1.
  • the portable communication device 11 touches the edge 12 or the lateral wall of the vehicle slightly; then the driver moves the communication device 11 back to the holding device 10, namely in the direction of the arrow A2.
  • the driver moves the portable communication device 11 from the holding device 10 to the top - i.e. vertically - along the windscreen 2 up to the top edge 6, namely in the direction of the arrow A3.
  • the driver moves the device 11 from the holding device 10 up to a reference point R4.
  • the device 11 slightly bumps against the top edge 6 or the roof lining; then the driver moves the portable communication device 11 back to the holding device 10, namely in the direction of the arrow A4.
  • the portable communication device 1 comprises an acceleration sensor which measures the acceleration of the portable communication device 11. Also whilst the communication device 11 is moving between the holding device 10 and the reference points R3, R4 the acceleration sensor records measuring values. Depending on the measuring values for the acceleration the computing unit calculates a distance between the holding device 10 and the reference point R3, on the one hand, and between the holding device 10 and the reference point R4, on the other.
  • Fig. 5a shows a graph of the acceleration a over a time t, whilst the portable
  • the communication device 11 is moved between the holding device 10 and one of the reference points R3, R4. At the point in time t 0 the motion of the portable communication device 11 commences and the acceleration a increases. At the point in time ti the portable communication device 11 reaches the reference point R3 or R4 and the acceleration a changes its sign - it becomes negative. At the point in time t 2 the portable communication device 11 reaches the holding device 10 again.
  • Fig. 5b shows a graph of a velocity V of the portable communication device 1 1 over the time t.
  • the function of the velocity V is rendered by an integration of the funcion of the acceleration a.
  • Fig. 5c shows a time-dependent graph of a distance w covered over the time t. This function is rendered by an integration of the graph of the velocity V.
  • Fig. 6 shows a graph of the path w covered over the time t whilst the portable
  • the computing unit calculates a mean value from the distance values w1 , w2. This mean value then is used as actual distance between the holding device 10 and the reference point R3 or R4.
  • the computing unit knows the two distances: the distance between the holding device 10 and the reference point R3, on the one hand, and the distance between the holding device 10 and the reference point R4, on the other hand. From these distances the computing device - in analogy to the first embodiment - calculates the coordinate values for the absolute position of the holding device 10 within the coordinate system of the vehicle. For this purpose the computing unit - as in the first embodiment - uses the information about the actual length and width of the windscreen 2 as well as about the orientation angle a of the windscreen 2 and the coordinate values x P , y P , z P of the point P of the windscreen 2 within the coordinate system of the vehicle.
  • the determination of the arrangement of the portable communication device 11 within the coordinate system of the vehicle also comprises the determination of an orientation of the portable communication device 1.
  • an orientation of the portable communication device 1 In this embodiment, three various angles are calculated for the determination of the orientation, namely a roll angle ⁇ , a pitch angle ⁇ , as well as a yaw angle ⁇ . These angles are calculated by the computing unit and used by the portable communication device 11 whilst providing support to the driver.
  • Fig. 7 shows a coordinate system x, y, z which is defined for the vehicle. This means it is a coordinate system of the vehicle.
  • the yaw angle ⁇ describes the extent of a rotation of the portable communication device 11 about the z axis of the coordinate system - as shown by arrow B1.
  • the roll angle ⁇ describes the extent of a rotation of the portable communication device 11 about the x axis of the coordinate system, as shown by arrow B2.
  • the pitch angle ⁇ describes the extent of a rotation of the portable
  • Figs. 8 to 10 show the windscreen 2 as well as in each case two axes of the coordinate system x, y, z of the vehicle.
  • Fig. 8 shows the vertical axis z and the transverse axis y of the vehicle
  • Fig. 9 shows the vertical axis z and the longitudinal axis x
  • Fig. 10 shows the longitudinal axis x and the transverse axis y of the vehicle.
  • Figs. 8 and 10 moreover show the portable communication device 11 that is mounted to the windscreen 2, namely with the aid of a holding device that is not shown.
  • the portable communication device 11 is rotated slightly about the longitudinal axis x of the vehicle.
  • the roll angle ⁇ in this connection is an angle between the transverse axis y of the vehicle and the axis y' of the local coordinate system of the communication device 11.
  • the pitch angle ⁇ in this connection is an angle between the vertical axis z of the vehicle and the axis x' of the local coordinate system.
  • the yaw angle ⁇ is an angle between the transverse axis y of the vehicle coordinate system and the axis y' of the local coordinate system of the portable communication device 11.
  • the computing unit calculates all three angles, namely the roll angle ⁇ , the pitch angle ⁇ and the yaw angle ⁇ .
  • the roll angle ⁇ and the pitch angle ⁇ may be calculated by the computing unit whilst the vehicle is at a standstill, namely from the measuring values provided by an acceleration sensor of the portable communication device 11.
  • the acceleration sensor namely provides measuring values for the acceleration in all three directions x', y', z' of the local coordinate system. From these measuring values for the acceleration the computing unit directly calculates roll angle ⁇ as well as the pitch angle ⁇ .
  • the computing unit cannot calculate the yaw angle ⁇ whilst the vehicle is at a standstill.
  • these measuring values need to be obtained whilst the vehicle is in motion on a straight road. So, the driver is encouraged by the portable communication device 11 to drive the car straight on, namely for a predetermined period of time, for instance for five seconds. Whilst the vehicle is driven, the acceleration sensor records measuring values.
  • the portable communication device 11 moreover comprises a compass that equally provides measuring values during this motion.
  • the measuring values provided by the compass give information about the global orientation of the portable communication device 11 , so that the computing unit on the basis of these measuring values can determine whether the vehicle is driven along a straight road.
  • the computing unit receives both the measuring values provided by the acceleration sensor as well as the measuring values provided by the compass. From the measuring values for the acceleration the computing unit then calculates the yaw angle ⁇ . Depending on the measuring values provided by the compass the computing unit determines whether the vehicle was driven along a straight stretch or not. The yaw angle ⁇ is only then assessed as correctly determined if the vehicle was driven along a straight stretch. For this purpose the computing unit checks whether a predetermined calculation criterion is fulfilled or not. This calculation criterion includes the condition that the standard deviation of a predetermined number of measuring values provided by a compass remains below a predetermined value.
  • the computing unit assesses the calculated yaw angle ⁇ as correctly determined. If the calculation criterion is not fulfilled, the driver is encouraged once again to drive the vehicle along a straight stretch.
  • Fig. 11 shows time-dependent graphs of the measuring values provided by the compass (left), i.e. development of the global orientation ⁇ of the portable communication device 11 , as well as time-dependent graphs of the yaw angle ⁇ (right).
  • Fig. 1 1 illustrates the graphs for two different situations: In the case of the top graphs the calculation criterion is not fulfilled, whilst in the case of the bottom graphs the criterion is fulfilled.
  • the standard deviation from the measuring values of the orientation ⁇ is clearly larger than the standard deviation of the bottom graphic of the orientation ⁇ .
  • the bottom function of the yaw angle ⁇ is clearly more stable than the top one.
  • the computing unit averages these values and takes the mean of these values; the final value for the yaw angle ⁇ is then a mean value from a multitude of values of the yaw angle ⁇ that are calculated during the motion of the vehicle.

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • Manufacturing & Machinery (AREA)
  • Multimedia (AREA)
  • Length Measuring Devices With Unspecified Measuring Means (AREA)
EP10725980.6A 2010-06-01 2010-06-01 Verfahren zur bestimmung einer anordnung einer tragbaren kommunikationsvorrichtung innerhalb eines koordinatensystems eines fahrzeuges, zugehörige datenverarbeitungseinheit und tragbare kommunikationsvorrichtung Withdrawn EP2577227A1 (de)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2010/003322 WO2011150946A1 (en) 2010-06-01 2010-06-01 Method of determining an arrangement of a portable communication device within a coordinate system of a vehicle, corresponding computing unit and portable communication device

Publications (1)

Publication Number Publication Date
EP2577227A1 true EP2577227A1 (de) 2013-04-10

Family

ID=43708269

Family Applications (1)

Application Number Title Priority Date Filing Date
EP10725980.6A Withdrawn EP2577227A1 (de) 2010-06-01 2010-06-01 Verfahren zur bestimmung einer anordnung einer tragbaren kommunikationsvorrichtung innerhalb eines koordinatensystems eines fahrzeuges, zugehörige datenverarbeitungseinheit und tragbare kommunikationsvorrichtung

Country Status (2)

Country Link
EP (1) EP2577227A1 (de)
WO (1) WO2011150946A1 (de)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102014219326A1 (de) * 2014-09-24 2016-03-24 Continental Teves Ag & Co. Ohg Sensorfusion mit Smartphone im Fahrzeug
DE102015223471A1 (de) * 2015-11-26 2017-06-01 Bayerische Motoren Werke Aktiengesellschaft System zum Einparken eines Fahrzeugs
DE102017200148B4 (de) * 2017-01-09 2021-01-28 Ford Global Technologies, Llc Verfahren zur Verwendung von Sensoren eines mobilen Endgeräts mit einem Fahrzeug, Fahrzeug, Computerprogramm und computerlesbares Medium
US11376960B2 (en) 2018-09-25 2022-07-05 Aptiv Technologies Limited Object detection sensor alignment

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6542840B2 (en) * 2000-01-27 2003-04-01 Matsushita Electric Industrial Co., Ltd. Calibration system, target apparatus and calibration method
DE102006007343A1 (de) * 2006-02-17 2007-08-30 Robert Bosch Gmbh Bilderfassungseinrichtung für ein Fahrerassistenzsystem
JP4816340B2 (ja) * 2006-08-31 2011-11-16 ソニー株式会社 ナビゲーション装置、位置検出方法及び位置検出プログラム
US8086405B2 (en) * 2007-06-28 2011-12-27 Sirf Technology Holdings, Inc. Compensation for mounting misalignment of a navigation device
WO2011003461A1 (en) * 2009-07-10 2011-01-13 Tomtom International B.V. Accelerometer system and method

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
None *
See also references of WO2011150946A1 *

Also Published As

Publication number Publication date
WO2011150946A1 (en) 2011-12-08

Similar Documents

Publication Publication Date Title
JP7073315B2 (ja) 乗物、乗物測位システム、及び乗物測位方法
CN106289275B (zh) 用于改进定位精度的单元和方法
JP7082545B2 (ja) 情報処理方法、情報処理装置およびプログラム
JP4656408B2 (ja) 車両用周囲監視装置
US20140176714A1 (en) Collision prevention warning method and device capable of tracking moving object
CN105571606A (zh) 能够改进车辆定位的方法和系统
CN107235013A (zh) 车载导航定位全景云台
CN109085381A (zh) 车载加速度传感器方向校准方法
CN104048663A (zh) 一种车载惯性导航系统及导航方法
EP4026049A1 (de) Kalibrierung eines fahrzeugsensorsystems
CN109238221B (zh) 一种车辆周围环境的检测方法及装置
US20240053475A1 (en) Method, apparatus, and system for vibration measurement for sensor bracket and movable device
CN110458885B (zh) 基于行程感知与视觉融合的定位系统和移动终端
WO2018131258A1 (ja) 車載処理装置
CN103968837A (zh) 惯性导航系统中陀螺仪刻度因子的校正方法及装置
CN113156455A (zh) 基于路侧多激光雷达感知的车定位系统、方法、装置和介质
JP2019003613A (ja) 車両の車両カメラを較正するための方法および装置
WO2021001018A1 (en) Sourced lateral offset for adas or ad features
WO2011150946A1 (en) Method of determining an arrangement of a portable communication device within a coordinate system of a vehicle, corresponding computing unit and portable communication device
CN113850867A (zh) 相机参数标定及设备的控制方法、装置、设备及存储介质
CN111238490B (zh) 视觉定位方法、装置以及电子设备
CN108801253A (zh) 机器人建图定位系统及机器人
JP2018084960A (ja) 自己位置推定方法及び自己位置推定装置
US8331625B2 (en) Distance measuring device and method, and computer program
CN104501818A (zh) 一种基于盲区消除的车载导航系统

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20121126

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20180511

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN

18W Application withdrawn

Effective date: 20181119