DE102018106610A1 - A method of representing a surrounding area of a reference motor vehicle with vehicle registration numbers in an image, computer program product and display system - Google Patents

A method of representing a surrounding area of a reference motor vehicle with vehicle registration numbers in an image, computer program product and display system

Info

Publication number
DE102018106610A1
DE102018106610A1 DE102018106610.4A DE102018106610A DE102018106610A1 DE 102018106610 A1 DE102018106610 A1 DE 102018106610A1 DE 102018106610 A DE102018106610 A DE 102018106610A DE 102018106610 A1 DE102018106610 A1 DE 102018106610A1
Authority
DE
Germany
Prior art keywords
motor vehicle
image
license plate
method according
characterized
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
DE102018106610.4A
Other languages
German (de)
Inventor
Huanqing Guo
Rachana Gupta
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Connaught Electronics Ltd
Original Assignee
Connaught Electronics Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Connaught Electronics Ltd filed Critical Connaught Electronics Ltd
Priority to DE102018106610.4A priority Critical patent/DE102018106610A1/en
Publication of DE102018106610A1 publication Critical patent/DE102018106610A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Arrangement of adaptations of instruments
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2370/00Details of arrangements or adaptations of instruments specially adapted for vehicles, not covered by groups B60K35/00, B60K37/00
    • B60K2370/16Type of information
    • B60K2370/171Vehicle or relevant part thereof displayed
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2370/00Details of arrangements or adaptations of instruments specially adapted for vehicles, not covered by groups B60K35/00, B60K37/00
    • B60K2370/16Type of information
    • B60K2370/177Augmented reality
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2370/00Details of arrangements or adaptations of instruments specially adapted for vehicles, not covered by groups B60K35/00, B60K37/00
    • B60K2370/20Optical features of instruments
    • B60K2370/31Virtual images
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/304Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using merged images, e.g. merging camera image with stored images
    • B60R2300/305Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using merged images, e.g. merging camera image with stored images merging camera image with lines or icons
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/307Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing virtually distinguishing relevant parts of a scene from the background of the scene

Abstract

The invention relates to a method for representing a surrounding area (13) of a reference motor vehicle (1) in an image (17), in which the surrounding area (13) is detected by a camera system (K) of the reference motor vehicle (1) the camera system (K) is the image (17) is generated, wherein at least the reference motor vehicle (1) at least partially in the image (17) can be represented, wherein by a manual input, the motor vehicle license plate (19) of the reference motor vehicle (1 ) is input to an input system (20), and the inputted vehicle license plate (19) is provided to the camera system (K), wherein the input vehicle license plate (19) is displayed depending on a specific display situation of information in the image (17). The invention also relates to a computer program product and a display system (2) for a motor vehicle (1).

Description

  • The invention relates to a method for representing a surrounding area of a reference motor vehicle in an image, in which the surrounding area is detected by a camera system of the reference motor vehicle and the image is generated by the camera system. At least the reference motor vehicle can be represented at least in regions in the image. Furthermore, the invention also relates to a computer program product and a display system for a motor vehicle.
  • From the prior art, for example the DE 10 2015 105 529 A1 , a method is known in which multiple real images are taken with a plurality of real cameras, which are arranged on the motor vehicle, and from these images a common overall image is generated, which can be displayed on a display unit of the motor vehicle. From these real images, the overall picture is formed in a shell shape. This means that the image is shown in a "distorted" representation and thus, as it were, in a certain curved shape, which then gives the shell shape. This is also done so that the surrounding area around the vehicle is completely displayed. This means that the representation of the image is such that a representation of the surrounding area takes place closed and uninterrupted around the vehicle. By displaying the image in this curved view and thus in the shell shape, a larger area can be displayed with a greater distance to the motor vehicle, in particular in comparison to a planar representation.
  • As is also known from the prior art, a virtual camera can be arranged at different positions in this generated entire image, so that a three-dimensional perspective can also be displayed from different viewing directions.
  • Furthermore, methods for transforming an image in which an environmental region of a motor vehicle is at least partially represented by the image from the perspective of a virtual camera virtually arranged in the environmental region are known from the prior art.
  • So will in the DE 10 2013 013 364 A1 a method for low distortion mapping of environmental image data provided by a plurality of cameras arranged on a motor vehicle is provided.
  • Furthermore, in the US 2011/0032357 A1 an image processing apparatus is described, with which an image of a surrounding area of a motor vehicle is taken. The captured image is converted to an image viewed from the perspective of a virtual line of sight. The virtual line of sight travels from a predetermined position in the surrounding area in a predetermined direction.
  • Furthermore, it is known that an image is provided with a virtual camera. The virtual camera can then usually be arranged arbitrarily around a motor vehicle fictitious. The image is provided by transforming real images. The real images are usually provided by a plurality of real cameras of the motor vehicle. By the majority of real cameras usually a surrounding area of the motor vehicle is completely detected. Through the virtual camera, the real images can be selected and transformed so that the image is provided from the perspective of the virtual camera. The virtual camera in the surrounding area of the motor vehicle is thus not actually existing, but rather describes the transformation and selection of the real images, so that the desired perspective of the virtual camera is shown by the image. Typically, providing the image is determined by a transformation involving one translation and multiple rotations. Thus, for example, each of the real images is transformed from a camera coordinate system of the respective real camera into a motor vehicle coordinate system, and finally the position of the virtual camera can be determined in the motor vehicle coordinate system.
  • In the known methods, motor vehicle license plates of the reference motor vehicle, which has the camera system, are only partially or not displayed in the picture. So whether the license plate number is recognizable or not in the picture is unpredictable. Among other things, this depends on the perspective and the image sharpness.
  • It is an object of the present invention to provide a method in which the representation of specific information of the motor vehicle, which uniquely identify the motor vehicle, is made possible. It is also an object to provide a computer program product and a display system for a motor vehicle.
  • One aspect of the invention relates to a method for displaying an environmental region of a reference motor vehicle in an image. The surrounding area is detected by a camera system of the reference motor vehicle and the image is generated by the camera system. At least the reference motor vehicle can at least partially in to be shown in the picture. The vehicle registration number of this reference motor vehicle is input by an input to an input system. This entered vehicle registration number is provided to the camera system. The entered vehicle registration number is displayed as a function of a specific representation situation of information in the generated image. The proposed method thus makes it possible either to individually specify and individualize the reference motor vehicle shown in the image, namely by displaying the associated motor vehicle license plate explicitly and clearly traceable and legible on the image. It can thus be achieved that the own reference motor vehicle can be uniquely identified in a generated image and thus also the perceptibility and understanding of an environmental scenario, which is represented in the image, is improved. Especially when in the surrounding area relatively many objects and extensive information are arranged and thus detected and displayed in the image, an orientation of the observer of the image quickly, in particular with respect to their own reference motor vehicle allows. This makes it easier to understand the other other object and image information faster and more comprehensive and also with regard to their position, especially relative to the reference motor vehicle to be able to classify faster.
  • On the other hand, however, it is also possible that even in the cases where the reference motor vehicle is not shown in the image, the information about the vehicle registration number is still desired. Moreover, such a representation of the motor vehicle license plate of the reference motor vehicle can be very helpful to an observer even if the reference motor vehicle is displayed in such a perspective and / or only with such a partial area in the image, in which usually on the real Reference motor vehicle number plate is not arranged with the license plate and thus in this perspective or at this portion of the reference motor vehicle in the image, the license plate is basically not visible.
  • By explicitly entering the vehicle registration number in an input system and providing this inputted vehicle license plate, the size and / or the sharpness of this vehicle license plate and / or the font and / or the position of the license plate can be done individually in the image and can be perceived fully and safely. In conventional systems, in which the reference motor vehicle can also be shown at least partially in the image, a representation of the motor vehicle license plate is thus unaffected only possible if a front area or a rear area of the reference motor vehicle is displayed. Since in such a perspective, the license plate is then automatically displayed, but is not generated individually with regard to this specific information, a constantly secure display and perception of the vehicle registration plate in the image is not possible. It is therefore completely unpredictable in conventional images and purely arbitrary and random, whether the license plate will be in the picture and will be recognizable at all. Regardless, it is then also completely uncertain whether it is presented in a precision, so that an observer of the image can also read the license plate and fully understand. However, this is always possible and unrestricted by the proposed method. Regardless of the image actually taken and thus regardless of whether and from which position a reference motor vehicle then actually occurs in the image, the associated license plate can always be clearly and fully perceptible displayed on the screen.
  • It is preferably provided that a specific representation situation is characterized in that a front region or a rear region of the reference motor vehicle is represented in the image. This allows a very realistic image representation and then positioning of the entered vehicle registration number in the image, namely individually then also in the usually provided in the front area position of the license plate or in a license plate in the rear of the reference motor vehicle. As a result, an image display is made possible, which allows a very realistic representation of the surrounding area, but in which the own reference motor vehicle is mapped with the unique and secure traceable own license plate.
  • It can be provided that the representation of this motor vehicle license plate on an image is automatic. This may be dependent on whether a reference motor vehicle is displayed in the image and which portion of the reference motor vehicle is displayed. Likewise, it is possible for an automatic representation of the entered vehicle license plate to be dependent on, in particular, display criteria defined by a user. These presentation criteria can be individually specified and also changed individually.
  • It can also be provided that the representation of the entered Motor vehicle license plate in the image only if explicitly requested by a user. It may therefore be provided in the context that the reference motor vehicle is displayed in the image, for example, with a front area or a rear area, where each also a license plate with the applied license plate is visible, and in the context only by the camera system taken picture is shown. If, for example, in the context of an observer of the image, the exact perceptibility of the motor vehicle license plate is not possible, he can then start the representation of the entered vehicle license plate in the image. Not only in the context, but also here, then in an advantageous embodiment, the desired position of the display of the vehicle registration plate and / or the size and / or the font and / or the color can be selected. As a result, a highly individual and situation-dependent representation of the entered vehicle registration number is possible in an image.
  • In an advantageous embodiment, it is provided that the motor vehicle registration number entered via the input system is displayed on a license plate in the front area of the reference motor vehicle and / or on a license plate in the rear area of the reference motor vehicle in the image if the front area and / or the rear area of the reference motor vehicle is shown or will be. The achievable advantages have already been mentioned above.
  • It is preferably provided that the entered vehicle registration number is displayed in the image, depending on the position and / or the perspective and / or the size of the reference motor vehicle, on the corresponding position and / or perspective and / or size. This means that the vehicle registration number is displayed in terms of its proportions in relation to the reference motor vehicle in the image, as are the corresponding proportions in reality. A particularly realistic representation is thereby made possible.
  • It is preferably provided that the motor vehicle license plate is entered by operating numerical controls and / or letter controls and / or symbol controls of the input system, in particular manually entered by a user. As a result, individual and arbitrary vehicle license plates can be generated. Since different vehicle license plates are prescribed by the authorities in different states, the individual input can thus also be made across national borders. Thus, it is known that in countries license plates are formed of letters and numbers. In other states, the license plates are shown in addition to or instead of with special characters, which are also seen as symbols. These too can then be generated in the context.
  • In particular, it is then also possible in the context to associate an individual size design and / or font and / or coloring with the individual elements of the motor vehicle registration plate. This allows a particularly realistic representation of the entered vehicle registration number in the image.
  • It is preferably provided that the motor vehicle license plate is additionally or instead of this input by a voice signal in the input system. This can be done for example by a user of the motor vehicle. Again, as in the alternative embodiments above also be provided that not a vehicle user, in particular a vehicle owner makes this manual input, but a person otherwise authorized for this purpose. This can be, for example, a dealer. However, this may also be an official person, with this authority, the issue of a license plate can be done. These people can also be considered as users in a broader sense.
  • In a further advantageous embodiment, it is provided that the real license plate of the reference motor vehicle with the vehicle license plate is detected by an input system designed as a camera image information and this information image is provided to the camera system. As a camera, for example, serve the camera system of the reference motor vehicle. For this purpose, it may be provided that this camera system has at least one camera a recording mode that can be activated individually by a user. In this recording mode, this at least one camera of the camera system is then provided to generate an image of the real license plate. In this recording mode, the camera and in particular the camera system are preferably not connected to a driver assistance system or a vehicle guidance system of the motor vehicle, so that no undesired independent actions of the driver assistance system or of the electronic vehicle guidance system are initiated.
  • However, the camera for receiving this real number plate with the license plate may also be another portable camera. The camera may for example be part of a communication terminal, such as for example, a mobile station or a tablet or the like. Of course, any other camera can serve to produce a corresponding image. From this camera can then be a wired or wireless transmission of the image to the camera system of the motor vehicle. By such a configuration, a very simple and fast input of the vehicle registration number can be made possible. It is not necessary to enter the individual letters and / or numbers and / or symbols of the motor vehicle registration plate by a voice signal and / or by a manual input via operating elements. In particular, this allows a particularly error-minimized input, since this image acquisition is always accompanied by the correctness of the vehicle registration number to be entered.
  • It is preferably provided that the position of the motor vehicle license plate in the image is selected by manual input of a user. As a result, a user-adapted and in each case desired position in the image can take place. It can also be provided that the position of the motor vehicle license plate is changed in the image.
  • In an advantageous embodiment, it is provided that the image is displayed on an electronic display unit, in particular a display. In particular, this display unit is designed as a touch-sensitive user interface, in particular as a so-called touch display. Such a configuration makes it possible for a user to move the displayed motor vehicle license plate particularly quickly and easily to any position by touching the screen and moving along. Likewise, there may be a touch-sensitive zoom effect, so that the size and / or orientation of the displayed motor vehicle license plate can be changed quickly and easily in the context.
  • It is preferably provided that at least one type of virtual license plate into which the license plate number can be entered by entering into the input system is given as a template by the input system. As a result, individual license plate types can also be selected, in particular manually selected by a person. Also by the individual wishes and in particular possibly also the different designs of the number plates in the different states are taken into account.
  • It is preferably provided that in the input system, a plurality of virtual license plates are stored as electronic templates and one of these license plates is selected for entering the vehicle license plate, is selected in particular by a person. This person can also be, for example, a user of the vehicle, in particular a vehicle owner. Likewise, however, the person may also be an already mentioned dealer or an official.
  • It is preferably provided that the input of the motor vehicle license plate is performed by a user of the reference motor vehicle, in particular the vehicle owner, in particular after the delivery of the reference motor vehicle to the user. In an alternative embodiment, it may be provided that the input of the motor vehicle license plate is performed by a motor vehicle dealer or a government person, as has also already been stated above.
  • In an advantageous embodiment, it is provided that real images of the surrounding area are taken by a plurality and thus at least two real cameras of the camera system of the motor vehicle and the image is generated as an overall image from these real images. In this image, the surrounding area is at least partially displayed, wherein the image can also be displayed in particular from a perspective of a virtual camera arranged virtually in the surrounding area.
  • The position of the virtual camera may be outside the reference motor vehicle in the surrounding area itself. However, it can also be provided that the position of the virtual camera is inside a reference motor vehicle and thus in particular in a passenger compartment of the reference motor vehicle. As a result, the image can be displayed from a perspective as perceived by a passenger in the passenger compartment when looking from the reference motor vehicle.
  • The image can be a two-dimensional representation of the surrounding area or else a three-dimensional representation. In particular, the image may be displayed in an uneven and thus a curved image plane. This can be provided for example in a shell shape.
  • Preferably, the image is displayed on a display unit of the motor vehicle. This display unit can be installed fixed in the motor vehicle, but can also be, for example, a mobile display unit that can be removed non-destructively detachable from the motor vehicle and can be used again. For example, this may be a portable display or a portable screen. For example, this screen may also be part of a portable one Be functional unit, which also has at least one additional function in addition to the representation of images. For example, such a functional unit may be a portable communication terminal such as a tablet computer or a mobile radio terminal.
  • Another aspect relates to a computer program product for carrying out a method according to the above aspect or an advantageous embodiment thereof when the computer program product is implemented on a programmable computer device.
  • In addition, another aspect of the invention relates to a display system for a motor vehicle. The display system has at least one evaluation unit and a display unit and moreover has a plurality of real cameras. The display system is configured to carry out a method according to the above-mentioned aspect or an advantageous embodiment thereof.
  • Furthermore, an aspect of the invention relates to a motor vehicle with such a display system.
  • The preferred embodiments presented with respect to the method and their advantages apply correspondingly to the computer program product, the display system and the motor vehicle.
  • The terms "top", "bottom", "front", "rear", "horizontal", "vertical", "depth direction", "width direction", "height direction", etc. are the intended use and intended arrangement of the virtual Camera or the real camera or motor vehicle given positions and orientations.
  • Further features of the invention will become apparent from the claims, the figures and the description of the figures. The features and combinations of features mentioned above in the description, as well as the features and feature combinations mentioned below in the description of the figures and / or shown alone in the figures, can be used not only in the respectively indicated combination but also in other combinations without the scope of the invention leave. Thus, embodiments of the invention are to be regarded as encompassed and disclosed, which are not explicitly shown and explained in the figures, however, emerge and can be produced by separated combinations of features from the embodiments explained. Embodiments and combinations of features are also to be regarded as disclosed, which thus do not have all the features of an originally formulated independent claim. Moreover, embodiments and combinations of features, in particular by the embodiments set out above, are to be regarded as disclosed, which go beyond or deviate from the combinations of features set out in the back references of the claims.
  • Embodiments of the invention are explained in more detail below with reference to schematic drawings.
  • Showing:
    • 1 a schematic plan view of an embodiment of a reference motor vehicle with an embodiment of a display system;
    • 2 a schematic representation of a virtual arrangement of a virtual camera in a surrounding area of the reference motor vehicle;
    • 3 a representation of an image, as it can be displayed on a display unit, wherein in the image, a rear portion of the reference motor vehicle is shown with a license plate with an individually entered vehicle registration number of the reference motor vehicle;
    • 4 a schematic representation of an input system for inputting a vehicle registration of the reference motor vehicle; and
    • 5 a template of a virtual license plate for entering a license plate.
  • In the figures, identical or functionally identical elements are provided with the same reference numerals.
  • In 1 is a schematic plan view of a reference motor vehicle 1 with a display system 2 represented according to an embodiment of the invention. The display system 2 In the exemplary embodiment, an evaluation unit 3 and a display unit 4 on. Furthermore, the display system 2 in the embodiment, a first real camera 5 , a second real camera 6 , a third real camera 7 and a fourth real camera 8th on. According to the embodiment, the first real camera 5 at a front area 9 of the reference motor vehicle 1 arranged, the second real camera 6 is on a right side 10 of the reference motor vehicle 1 arranged, the third real camera 7 is at a stern area 11 of the reference motor vehicle 1 arranged and the fourth real camera 8th is on a left side 12 of the motor vehicle 1 arranged. The arrangement of real cameras 5 . 6 . 7 . 8th However, it is possible in many ways, but preferably in such a way that the reference motor vehicle 1 and / or a surrounding area 13 of the reference motor vehicle 1 at least partially.
  • The real cameras 5 . 6 . 7 . 8th In particular, have a wide detection range, which may be greater than 180 °, for example. The wide detection range can each be, for example, by a fisheye lens of a lens of the real camera 5 . 6 . 7 . 8th to be provided. So can the display system 2 For example, be designed as environment vision system (CMS - camera monitoring system) or electronic rearview mirror or as another driver assistance system of the reference motor vehicle 1 be formed, in which the surrounding area 13 is at least partially recorded.
  • The real cameras 5 . 6 . 7 . 8th may be complementary metal-oxide semiconductor (CMOS) or charge coupled device (CCD) cameras, or other image capture devices that capture a frame of the surrounding area 13 and / or the reference motor vehicle 1 can provide. The real cameras 5 . 6 . 7 . 8th In particular, video cameras are those which continuously provide an image sequence of still images. The evaluation unit 3 then processes the image sequence of the individual images, for example in real time. The evaluation unit 3 can, for example, within the respective real camera 5 . 6 . 7 . 8th or within the display unit 4 be arranged. The evaluation unit 3 but also outside the respective camera 5 . 6 . 7 . 8th or the display unit 3 at any other position within the reference motor vehicle 1 be arranged and thus as the real camera 5 . 6 . 7 . 8th and to the display unit 4 be formed separate unit.
  • The display unit 4 may for example be designed as a liquid crystal display (LCD - liquid crystal display). The display unit 4 can be varied in the reference motor vehicle 1 be arranged, but preferably so that a user of the reference motor vehicle 1 an obstacle-free view of the display unit 4 can judge.
  • Through the real cameras 5 . 6 . 7 . 8th is a variety of real images, so at least two real images taken. The real pictures show the surrounding area 13 at least partially from the perspective of the respective real camera 5 . 6 . 7 . 8th , Preferably, the real images are recorded at least partially overlapping.
  • By way of example four real cameras 5 to 8th is a camera system 14 of the reference motor vehicle 1 educated.
  • The car 1 has an electronic vehicle guidance system S. The vehicle guidance system S enables the reference motor vehicle 1 at least semi-autonomous, in particular to operate completely autonomously.
  • The display system 2 and / or the camera system K can be part of the vehicle guidance system S.
  • With at least one of the real cameras 5 to 8th will at least be a picture of the surrounding area 13 added.
  • 2 shows a virtual arrangement of a virtual camera 14 in the surrounding area 13 of the reference motor vehicle 1 , The virtual camera 14 can be varied in the surrounding area 13 to be ordered. Preferably, the virtual camera 14 at predetermined virtual camera positions, in particular the shell shape of the image, are arranged, wherein the reference motor vehicle 1 preferably on a floor 16 the shell shape is displayed. Exemplary camera positions may be due to the camera position 15 be formed, which lies on the shell shape. In this camera position 15 is viewed diagonally from back to front, so that here is a perspective that has this line of sight or this orientation.
  • The perspective of the virtual camera 14 can for example be adjusted in real time or within a predetermined computing time.
  • It should be mentioned again that this illustration is only an example and diverse other camera positions 15 the virtual camera 14 possible are. For example, there is also a camera position 15a or 15b or 15c possible. This results in different perspectives. These non-conclusive camera positions 15 . 15a . 15b . 15c are all outside the vehicle 1 , The virtual camera 14 can also in the reference motor vehicle 1 be arranged in particular in a passenger compartment and be oriented with a view to the outside.
  • In 3 is an image in an exemplary representation 17 shown as it is on the display unit 4 can be displayed. This picture 17 is recorded by the camera system K. The perspective of the virtual camera 14 , from whose line of sight the picture 17 is shown here is behind the motor vehicle 1 and offset to the left. In the picture 17 is the reference motor vehicle 1 thus recognizable from the rear, so that the rear area 11 is also shown.
  • In the picture 17 is thus a license plate in this advantageous embodiment 18 of Reference vehicle 1 shown. On this license plate 18 is a vehicle license plate 19 this reference motor vehicle 1 displayed. This license plate 19 is included as a real license plate on the real license plate and as a physical license plate on the motor vehicle 1 arranged in reality.
  • To the information about the license plate 19 in the picture 17 Being able to display and perceive more diverse and also more clearly, becomes this motor vehicle license plate 19 by an input, in particular a manual input, in an input system 20 ( 4 ). This therefore means that the vehicle registration number 19 of the reference motor vehicle 1 not here by the pictorial shot of the camera system K in the picture 17 is displayed. Rather, it is provided that this independent of the image recording with the camera system K via the input system 20 entered vehicle registration numbers 19 in the picture 17 is shown. The camera system K is preferably adapted to the given information about the vehicle registration number 19 to recycle and this entered vehicle number plate 19 in the picture 17 display.
  • On the license plate 18 is therefore in the representation of the picture 17 this entered vehicle registration number 19 in the place of the license plate 18 on the license plate 18 displayed. In particular, it is therefore not the vehicle license plate that has been accidentally picked up by the camera system K in the image 17 on the license plate 18 but this is especially hidden. Such a fade-out can take place, for example, by image processing, so that a possible camera-side recording of the real motor vehicle license plate in the image 17 is virtually eliminated or deleted. Instead, then in an advantageous embodiment at the position at which the camera system K the vehicle license plate 19 pictorially recorded, the manually entered license plate number 19 set.
  • Preferably, the entered vehicle registration number 19 depending on a specific presentation situation of information in the image 17 shown. It may be provided in the context that the entered vehicle registration number 19 only in the picture 17 is displayed when the reference motor vehicle 1 in the picture 17 is shown in a perspective in which a license plate, for example, in the front area 9 or in the rear area 11 , in the picture 17 is included. In particular, then this entered vehicle license plate 19 on the license plate 18 displayed.
  • The display of the entered vehicle registration number 19 in the picture 17 can be done for example by crossfade technique or by an image overlay. This is likewise not to be understood conclusively and it can also be provided otherwise image methods to the vehicle registration number, which via the input system 20 was entered on the picture 17 display.
  • Advantageously, a specific presentation situation is therefore characterized by a front area 9 or a rear area 11 of the reference motor vehicle 1 in the picture 17 is pictured.
  • In a further embodiment, it may be provided that the entered vehicle registration number 19 elsewhere in a picture 17 can be displayed and not explicitly on the license plate 18 is shown. This may for example be the case when the reference motor vehicle 1 not in such an area in the picture 17 is shown, in which usually a license plate 18 with the license plate 19 present is shown for example from the side or from the top. In such situations, it may then still be helpful to the license plate 19 in the picture 17 display. In particular, if necessary, depending on the environmental scenarios that exist in the picture 17 are shown to the reference motor vehicle 1 even faster and easier in the picture 17 to be able to identify. For example, this may be the case if in the picture 17 a plurality, and thus at least two, motor vehicles are displayed, one of which is the reference motor vehicle 1 is. Are more than two cars in the picture 17 contained, but possibly only partially recognizable therein, it may then be helpful that the entered vehicle number plate 19 on that motor vehicle in the picture 17 is displayed on the motor vehicle or immediately adjacent thereto, thereby detecting the reference motor vehicle 1 easy and fast to understand.
  • In an advantageous embodiment, it can also be provided that the display surface of the display unit 4 on which the picture 17 is displayed, at least partially, in particular completely, is designed as a touch-sensitive control and / or display surface. It may then be provided in an advantageous embodiment that a person when touching this control and / or display surface, the displayed vehicle registration number 19 can shift to an individual position and / or the size of the displayed motor vehicle license plate 19 can change. Also, by a specific input, for example, a tap on the operator-friendly and / or touch-sensitive display surface a specific location then a user-side selection made where the entered motor vehicle license plate number to be displayed 19 should be displayed.
  • In an advantageous embodiment, it is provided that the to be displayed and the input system 20 entered vehicle registration numbers 19 automatically at a specific place in the picture 17 is shown. By appropriate evaluation of the image information in the image 17 The system can then recognize itself in an advantageous manner, whether a desired presentation situation exists and where then the entered vehicle license plate 19 should be displayed. For example, in the illustration according to 3 be recognized by the system itself, what at the rear 11 is displayed and whether the license plate 18 in the picture 17 is present, so that this positionally recognized by appropriate image processing. As a result, the system can then automatically detect where the correct position of the vehicle registration number to be displayed 19 of the reference motor vehicle 1 has to take place, in particular also in which position and optionally in which perspective this display of the entered vehicle registration number 19 should be done.
  • In an advantageous embodiment, it is provided that the entered vehicle registration number 19 depending on the position and / or the perspective and / or the size of the reference motor vehicle 1 in the picture 17 is displayed to the corresponding position and / or perspective and / or size adapted in reality. This also means that, for example, in the illustration according to 3 the entered license plate on the license plate 18 positionally displayed correctly and also in terms of size is displayed so that it is within the area of the license plate 18 is included.
  • In 4 is a simplified representation of an embodiment of an input system 20 shown. It can be provided that the input system 20 Having controls with which the input of the vehicle registration number 19 can be done by one person. For example, the person may be the vehicle user, in particular the vehicle owner. However, the person may also be a motor vehicle dealer or an official, for example in an approval authority.
  • The controls may be, for example, representational elements, such as push buttons of a keyboard or a rotary knob. This is through the unit 21 in 4 symbolically characterizes. The input system 20 However, in addition to or instead of, for example, a touch-sensitive input unit 21 exhibit. This is indicated by the reference numeral 22 symbolizes. The input unit 21 can be designed controls for entering numbers and / or letters and / or symbols and have appropriate controls.
  • In a further embodiment may be additionally or instead provided that the input system 20 is designed for voice input and in the context of a voice input unit 23 having.
  • In a further embodiment it can be provided that the input system 20 in addition to or instead of an optical unit 24 has, which is designed for pictorial recording. For example, the unit 24 to be a camera. The camera 24 can be one of the real cameras 5 to 8th be. However, it may also be a camera of another device, such as a mobile station or the like. Basically, the camera can also be considered as a separate, portable camera. Such a configuration makes it possible for a real license plate with a real motor vehicle license plate of the reference motor vehicle already formed thereon to be realized 1 pictorially recorded. This image is then provided to the camera system K to call it an entered vehicle license plate 19 to have available.
  • In principle, however, also a variety of other units 25 be present, with which a vehicle registration number 19 can be entered, in particular manually entered.
  • In this case, manual input is understood as meaning, in particular, any input which is initiated either by a user himself, as in the case of pictorial recording with the unit 24 takes place, or is actually carried out by its own input. The input system 20 advantageously also has a computer unit 26 on, by means of which the inputs are processed and then the entered vehicle license plate 19 is generated and provided.
  • In an advantageous embodiment, it is also provided that the input system 20 an electronic template for a virtual license plate 18 and which then to enter the vehicle registration number 19 provided. It can also be provided that a plurality of templates for license plates 18 is stored and then a selection of one of these templates for entering the vehicle license plate 19 is selected. Such a selection may be made by a person as exemplified above or automatically. Through the input system 20 can thus at least one type of virtual license plate 18 into which the Motor vehicle registration 19 can be entered, provided as a template or provided.
  • It can thus also be provided that in the picture 17 not just the entered vehicle number plate 19 is shown virtually, but in particular a virtual license plate 18 , which is virtually present as a template, then in the picture 17 is shown. Also the license plate 18 can thus be understood as an input and displayed in the image. Even with such a configuration is then advantageously by the camera system K optionally directly recorded real number plate of the reference motor vehicle 1 deleted or by a transition with the virtual license plate 18 covered.
  • In particular, if on the display unit 4 not just a static picture 17 but a video from a variety of pictures 17 is displayed, the dynamically changing size and / or position and display of the entered vehicle license plate 18 change accordingly, so that in this regard a dynamic and realistic presentation of the vehicle registration 19 can be done. In particular, the selbiges also with an entered virtual license plate 18 respectively.
  • In the illustration in 5 , in which an exemplary template of a virtual license plate 18 are exemplary, are exemplary areas for entering the vehicle registration 19 shown.
  • QUOTES INCLUDE IN THE DESCRIPTION
  • This list of the documents listed by the applicant has been generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.
  • Cited patent literature
    • DE 102015105529 A1 [0002]
    • DE 102013013364 A1 [0005]
    • US 2011/0032357 A1 [0006]

Claims (16)

  1. A method of displaying a surrounding area (13) of a reference motor vehicle (1) in an image (17), in which the surrounding area (13) is detected by a camera system (K) of the reference motor vehicle (1) and detected by the camera system (K ) the image (17) is generated, wherein at least the reference motor vehicle (1) at least partially in the image (17) can be represented, characterized in that by an input the motor vehicle license plate (19) of the reference motor vehicle (1) in an input system (20) is input and the inputted license plate (19) is provided to the camera system (K), wherein the inputted license plate (19) is displayed depending on a specific presentation situation of information in the image (17).
  2. Method according to Claim 1 , characterized in that a specific representation situation is characterized in that a front area (9) and / or a rear area (11) of the reference motor vehicle (1) is represented in the image (17).
  3. Method according to Claim 1 or 2 characterized in that the inputted license plate (19) is displayed on a front portion (9) of the reference motor vehicle (1) and / or on a rear portion (11) of the reference motor vehicle (1) in the image (17) in the image (17) the front area (9) and / or the rear area (11) are shown.
  4. Method according to one of the preceding claims, characterized in that the entered vehicle registration number (19) depends on the position and / or the perspective and / or the size of the reference motor vehicle (1) in the image (17) to that in reality adjusted corresponding position and / or perspective and / or size in the image (17) is shown.
  5. Method according to one of the preceding claims, characterized in that the motor vehicle license plate (19) by operating numerical controls and / or letter controls and / or symbol controls of the input system (20) is entered.
  6. Method according to one of the preceding claims, characterized in that the motor vehicle license plate (19) is entered by a voice signal in the input system (20).
  7. Method according to one of the preceding claims, characterized in that the real license plate of the reference motor vehicle (1) with the real motor vehicle license plate in a specific input process by an input system (20) formed camera (24) is detected as an information image and this information image the camera system (K) at least as an inputted vehicle license plate (19) is provided.
  8. Method according to one of the preceding claims, characterized in that the position of the entered motor vehicle license plate (19) in the image (17) is selected by manual input of a user.
  9. Method according to one of the preceding claims, characterized in that by the input system (20) at least one type of virtual license plate (18), in which the motor vehicle license plate (19) can be entered, is given as a template.
  10. Method according to one of the preceding claims, characterized in that in the input system (20) a plurality of virtual number plates (18) is stored as templates, and one of these virtual number plates (18) is selected for entering the motor vehicle license plate (19), in particular by a user is selected.
  11. Method according to one of the preceding claims, characterized in that the input of the motor vehicle license plate (19) by a user of the reference motor vehicle (1), in particular after the delivery of the reference motor vehicle () to the user, is performed.
  12. Method according to one of the preceding claims, characterized in that the input of the motor vehicle license plate (19) is performed by a motor vehicle dealer.
  13. Method according to one of the preceding claims, characterized in that the font and / or the font size and / or the characters for the characters of the motor vehicle license plate (19) can be selected.
  14. Method according to one of the preceding claims, characterized in that by a plurality of real cameras (5, 6, 7, 8) of the camera system (K) of the motor vehicle (1) real images of the surrounding area (13) are recorded and from these real images the Image (17) which at least partially represents the surrounding area (13), the image (17) being displayed from a perspective of a virtual camera (14) virtually arranged in the surrounding area (13).
  15. Computer program product for carrying out a method according to one of the preceding Claims, when the computer program product is executed on a programmable computer device.
  16. Display system (2) for a motor vehicle (1), comprising an evaluation unit (3), a display unit (4), an input system (20) and a plurality of real cameras (5, 6, 7, 8), which is designed a method according to one of Claims 1 to 14 perform.
DE102018106610.4A 2018-03-21 2018-03-21 A method of representing a surrounding area of a reference motor vehicle with vehicle registration numbers in an image, computer program product and display system Pending DE102018106610A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
DE102018106610.4A DE102018106610A1 (en) 2018-03-21 2018-03-21 A method of representing a surrounding area of a reference motor vehicle with vehicle registration numbers in an image, computer program product and display system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE102018106610.4A DE102018106610A1 (en) 2018-03-21 2018-03-21 A method of representing a surrounding area of a reference motor vehicle with vehicle registration numbers in an image, computer program product and display system

Publications (1)

Publication Number Publication Date
DE102018106610A1 true DE102018106610A1 (en) 2019-09-26

Family

ID=67847835

Family Applications (1)

Application Number Title Priority Date Filing Date
DE102018106610.4A Pending DE102018106610A1 (en) 2018-03-21 2018-03-21 A method of representing a surrounding area of a reference motor vehicle with vehicle registration numbers in an image, computer program product and display system

Country Status (1)

Country Link
DE (1) DE102018106610A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102008034606A1 (en) * 2008-07-25 2010-01-28 Bayerische Motoren Werke Aktiengesellschaft Method for displaying environment of vehicle on mobile unit, involves wirelessly receiving image signal from vehicle, and generating display image signal on mobile unit through vehicle image signal, where mobile unit has virtual plane
US20110032357A1 (en) 2008-05-29 2011-02-10 Fujitsu Limited Vehicle image processing apparatus and vehicle image processing method
DE102013013364A1 (en) 2013-08-09 2014-03-06 Daimler Ag Method for low-distortion display of surround image data generated by multiple cameras of vehicle, involves designing plane surface in polygonal form with four sides, where curved surfaces extend from plane surface
DE102013016356A1 (en) * 2013-10-01 2015-04-02 Connaught Electronics Ltd. Method for using a camera system of a motor vehicle as an anti-theft alarm, camera system and motor vehicle
DE102015105529A1 (en) 2015-04-10 2016-10-13 Connaught Electronics Ltd. A method of transforming an image of a virtual camera, computer program product, display system and motor vehicle

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110032357A1 (en) 2008-05-29 2011-02-10 Fujitsu Limited Vehicle image processing apparatus and vehicle image processing method
DE102008034606A1 (en) * 2008-07-25 2010-01-28 Bayerische Motoren Werke Aktiengesellschaft Method for displaying environment of vehicle on mobile unit, involves wirelessly receiving image signal from vehicle, and generating display image signal on mobile unit through vehicle image signal, where mobile unit has virtual plane
DE102013013364A1 (en) 2013-08-09 2014-03-06 Daimler Ag Method for low-distortion display of surround image data generated by multiple cameras of vehicle, involves designing plane surface in polygonal form with four sides, where curved surfaces extend from plane surface
DE102013016356A1 (en) * 2013-10-01 2015-04-02 Connaught Electronics Ltd. Method for using a camera system of a motor vehicle as an anti-theft alarm, camera system and motor vehicle
DE102015105529A1 (en) 2015-04-10 2016-10-13 Connaught Electronics Ltd. A method of transforming an image of a virtual camera, computer program product, display system and motor vehicle

Similar Documents

Publication Publication Date Title
US9513702B2 (en) Mobile terminal for vehicular display system with gaze detection
JP6487231B2 (en) Generating an extended field of view
EP2914475B1 (en) System and method for using gestures in autonomous parking
EP3072710A1 (en) Vehicle, mobile terminal and method for controlling the same
US10029700B2 (en) Infotainment system with head-up display for symbol projection
US20170083087A1 (en) Eye gaze tracking utilizing surface normal identification
CN103870802B (en) System and method using the user interface in paddy operation vehicle is referred to
US10497174B2 (en) Method and device for augmented depiction
DE102012102508B4 (en) Adjustment method and system of a smart vehicle imaging device
DE102013209415A1 (en) Dynamic Note Overlay with Image Pruning
KR101446897B1 (en) Vehicle periphery monitoring device
US8085243B2 (en) Input device and its method
US8577601B2 (en) Navigation device with augmented reality navigation functionality
US8363010B2 (en) Operating input device for reducing input error
US8345098B2 (en) Displayed view modification in a vehicle-to-vehicle network
JP5999032B2 (en) In-vehicle display device and program
US7554461B2 (en) Recording medium, parking support apparatus and parking support screen
EP0567660B2 (en) Device for the guiding of vehicles
US7969294B2 (en) Onboard display device, onboard display system and vehicle
DE102014107155A1 (en) Improved front curb visualization system
KR20120118073A (en) Vehicle periphery monitoring device
US20120224060A1 (en) Reducing Driver Distraction Using a Heads-Up Display
JP5110438B2 (en) Input device
CN102740056B (en) Image display system
DE102010062282A1 (en) System for controlling a device in the vehicle using augmented reality and methods therefor

Legal Events

Date Code Title Description
R163 Identified publications notified