WO2017042276A1 - Method for operating a camera depending on a preset pulse frequency of an illumination source, camera and system - Google Patents
Method for operating a camera depending on a preset pulse frequency of an illumination source, camera and system Download PDFInfo
- Publication number
- WO2017042276A1 WO2017042276A1 PCT/EP2016/071184 EP2016071184W WO2017042276A1 WO 2017042276 A1 WO2017042276 A1 WO 2017042276A1 EP 2016071184 W EP2016071184 W EP 2016071184W WO 2017042276 A1 WO2017042276 A1 WO 2017042276A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- motor vehicle
- illumination source
- pulse frequency
- camera
- determined
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
- H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06V20/582—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of traffic signs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/745—Detection of flicker frequency or suppression of flicker wherein the flicker is caused by illumination, e.g. due to fluorescent tube illumination or pulsed LED illumination
Definitions
- the invention relates to a method for operating a camera of a motor vehicle.
- An environmental region of the motor vehicle is captured by means of the camera.
- an illumination source is operated pulsed with a preset pulse frequency.
- the invention also relates to a camera for a motor vehicle as well as to a system with a camera.
- the camera is for example operated such that an environmental region of the motor vehicle is captured.
- an environmental region for example, a periphery of the motor vehicle can be disposed, in which an illumination source is operated pulsed with a preset pulse frequency.
- this object is solved by a method, by a camera as well as by a system having the features according to the respective independent claims.
- a camera of a motor vehicle is operated.
- An environmental region of the motor vehicle is captured by means of the camera.
- an illumination source is operated pulsed with a preset pulse frequency in particular with respect to its emitted optical signals.
- the pulse frequency is determined and at least one setup parameter of the camera is adapted depending on the pulse frequency.
- the environmental region is captured by the camera of the motor vehicle.
- the environmental region can include the periphery of the motor vehicle.
- the camera also captures the illumination source, which is operated pulsed with the preset pulse frequency. The pulsed operation of the illumination source results in switching on and off of the illumination source - for example clocked with 50 Hz.
- the camera which is in particular formed as a video camera and captures a sequence of images of the environmental region and/or the periphery, does not each time completely capture the entire cycle of the preset pulse frequency of the illumination source due to its preset capturing frequency and/or preset exposure time.
- the periphery of the motor vehicle can be captured such that at least one complete cycle of the pulse frequency or a complete light pulse of the illumination source disposed in the periphery is preferably captured with each capture of the camera.
- An image of the periphery with the illumination source can therefore be provided in particular with high quality and with completely imaged illumination source by the camera with the adapted setup parameter.
- the pulse frequency of the illumination source is in particular characterized by a mains frequency, for example 50 Hz or 60 Hz. If the setup parameter of the camera is not adapted to the pulse frequency of the illumination source, thus, the periphery with the illumination source is for example captured such that the illumination source is for example imaged flickering in the image sequence. By the flickering, the illumination source is at least only partially imaged or represented in at least some images. This is prevented by the invention since the setup parameter is adapted to the pulse frequency such that the flickering is prevented. The same is also effected if the clock cycles of the setup parameter and the pulse frequency would be such that the illumination source is not captured even it would be in the capturing range of the camera.
- an image having the illumination source is captured by means of the camera.
- the image is in particular a component of an image sequence.
- the illumination source can be completely and with flicker mitigation imaged in the image.
- the setup parameter is selectively adapted to the illumination source.
- the image, which is captured of the illumination source can therefore be provided with the setup parameter selectively adapted to the pulse frequency of the illumination source.
- a shutter time of the camera is adapted as the setup parameter.
- An exposure time is referred to as the shutter time, which is preset by a camera shutter of the camera.
- the control of the shutter time can be effected either mechanically and/or electronically.
- the shutter time thus, the time is described, in which photons from the environmental region and/or the periphery are integrated or collected by a sensor of the camera.
- an image of the environmental region and/or the periphery is provided by means of the camera.
- a capturing frequency of the camera can for example also be adapted as the setup parameter.
- the pulse frequency of the illumination source is determined based on information in a database in the motor vehicle and/or information in a database external to motor vehicle.
- the pulse frequency of the illumination source can for example be kept available in the motor vehicle and be retrieved from the database on demand.
- the pulse frequency can for example also be kept available in the database external to motor vehicle, for example an external server, and be provided for the motor vehicle on demand.
- the setup parameter of the camera can be adapted.
- the pulse frequencies of all of the illumination sources within a certain geographic region can for example be kept available in the database and/or in the database external to motor vehicle.
- the pulse frequency can be effectively provided by the database and/or the database external to motor vehicle for adapting the setup parameter of the camera.
- an orientation of the motor vehicle and/or a speed of the motor vehicle are determined, and the pulse frequency is determined depending on the orientation of the motor vehicle, in particular relative, to the illumination source and/or the speed of the motor vehicle, in particular relative, to the illumination source.
- the orientation of the motor vehicle can be determined by odometry and/or visual odometry.
- the orientation of the motor vehicle can therefore be determined by means of sensors of the motor vehicle and for example be picked up on the CAN (Controller Area Network) Bus of the motor vehicle.
- the orientation of the motor vehicle is useful if more than one illumination source is located in the periphery of the motor vehicle.
- the respective camera of the motor vehicle can for example be selected for adapting the setup parameter, which captures the illumination source in the periphery with respect to its orientation.
- the respective camera of the motor vehicle can be selected for adapting the setup parameter, which captures the illumination source in the periphery with respect to its orientation.
- a direction of travel of the motor vehicle can for example also be determined.
- the direction of travel of the motor vehicle can for example be determined based on an engaged gear of the motor vehicle.
- the illumination source in the periphery of a camera of the motor vehicle can be associated for adapting the setup parameter.
- the speed of the motor vehicle can for example be taken into account in adapting the setup parameter.
- the relative speed between the illumination source and the motor vehicle can for example be taken into account with respect to the Doppler effect.
- the adaptation of the setup parameter can be effected depending on the Doppler effect.
- the motor vehicle moves towards the illumination source or moves away from the illumination source, this can have effects on the pulse frequency of the illumination source captured by the camera.
- the variation of the pulse frequency by the Doppler shift can be taken into account by the speed of the motor vehicle and the speed of the illumination source, which is in particular zero with a street lighting or street lamp in the periphery, for adapting the setup parameter.
- the setup parameter of the camera can be effectively and precisely adapted depending on the orientation of the motor vehicle and/or the speed of the motor vehicle.
- a GNSS position of the motor vehicle is determined, and the pulse frequency is determined depending on the GNSS position of the motor vehicle, in particular relative, to the illumination source.
- the GNSS position (GNSS - global navigation satellite system) can for example be provided by a GPS system (GPS - global positioning system) and/or a GLONASS system and/or a Galileo system.
- GPS global positioning system
- GLONASS GLONASS system
- Galileo system Galileo system
- a near zone to an illumination source is determined depending on the GNSS position and the pulse frequency is determined if the motor vehicle is in the near zone.
- the near zone can for example be characterized as a certain region around the motor vehicle.
- the near zone can be determined by a radius around the motor vehicle.
- the near zone can for example be determined in a map including the environmental region and/or the periphery by drawing a certain radius around the GNSS position of the motor vehicle and determining the near zone within this radius.
- the pulse frequencies of all of the illumination sources in the near zone can for example be queried from the database and/or the database external to motor vehicle based on the GNSS position and can be provided for adapting the setup parameter of the camera.
- An association of the pulse frequencies of the illumination sources disposed in the near zone with the respective camera of the motor vehicle can for example be effected based on the orientation of the motor vehicle.
- the near zone can be described restricting by a range of the camera. This means that the near zone in particular does not have to extend substantially further than the range of the capturing area of the camera.
- the pulse frequency of the illumination source can therefore be effectively and simply determined by the near zone.
- the pulse frequency is determined independently of whether the illumination source is contained in an image of the environmental region captured before the pulse frequency determination.
- the adaptation of the setup parameter can for example be effected based on the near zone, while the camera does not yet capture the illumination source.
- the setup parameter of the camera is therefore adapted independently of whether or not the illumination source is captured by the camera. In particular, this can be advantageous if the camera does not know at all if the illumination source is captured.
- the adaptation of the setup parameter is for example effected exclusively based on the near zone even if the illumination source is not present in the image. This is advantageous because thereby detection of the illumination source in the image of the camera does not have to be effected.
- the adaptation of the setup parameter can therefore be performed without the detection of the illumination source in the image and thus for example without the employment of object recognition methods.
- the pulse frequency of the illumination source is determined if the illumination source is present in the image.
- the illumination source in the image can for example be recognized in the image by means of an object recognition method.
- the pulse frequency of the recognized illumination source can be determined.
- setup parameter of the camera is only adapted if the illumination source is captured by the camera.
- the pulse frequency is stored as information in the illumination source itself and is requested by the motor vehicle and the pulse frequency is wirelessly transmitted from the illumination source to the motor vehicle as a result of the request.
- the setup parameter of the camera can now be adapted.
- the pulse frequency can for example be requested from the illumination source by means of a radio signal or another active signal.
- the motor vehicle in particular has a transmitter, while the illumination source in particular has a receiver.
- the illumination source sends its own pulse frequency to the motor vehicle.
- the illumination source in particular has a transmitter and the motor vehicle in particular has a receiver.
- the illumination source and the motor vehicle each have in particular a communication device for communication with each other.
- the pulse frequency can thereby be effectively and simply determined.
- the pulse frequency can for example be determined based on a modulated illumination sequence.
- the pulse frequency of the illumination source can for example be determined by the modulated illumination sequence.
- the pulse frequency of the illumination source can for example also be determined by analysis of the image sequence with respect to the complete depiction of the illumination source.
- the advantage is that the pulse frequency can be determined by the motor vehicle itself and therefore in particular the database and/or the database external to motor vehicle are not necessarily required.
- the GNSS position of the motor vehicle is for example also not necessarily required.
- the pulse frequency of the illumination source can therefore be determined more independently of other information sources.
- the pulse frequency of an illumination source formed as a light emitting diode is determined.
- the light emitting diode can be operated with a pulse width modulation method.
- the illumination source can for example be characterized by a street lighting or a street lamp in the environmental region and/or in the periphery.
- the illumination source can also be characterized as a hazard warning light of for example a construction site or as a traffic sign or road sign.
- the illumination source can also be characterized by a headlight of another motor vehicle in the periphery of the motor vehicle.
- the setup parameter of the camera can be adapted to the pulse frequency of various illumination sources, which have at least one light emitting diode.
- traffic information is emitted by the illumination source such that the capture by the camera is particularly important such that especially then the invention is particularly advantageous.
- the illumination source In a further embodiment it can be provided that information or a signal in the infrared spectral range, in particular in the near infrared range (NIR), of the electromagnetic spectrum is emitted by the illumination source.
- the camera is then preferably configured to capture radiation from the infrared spectral range. It is advantageous, for example, that thus information can be emitted by the illumination source, which can be captured only by the camera and not by a human observer.
- the setup parameter of the camera can also in particular be adjusted if the illumination source is operated in the infrared spectral range.
- the invention also relates to a camera for a motor vehicle with a control unit or an evaluation unit and/or a communication device, wherein the camera is adapted to perform a method according to the invention.
- the control unit and/or the communication device can for example be integrated in the camera or be present as a separate unit.
- the invention relates to a system with a motor vehicle and a camera according to the invention disposed on the motor vehicle.
- the system is in particular adapted to perform a method according to the invention.
- the system includes a database external to vehicle with pulse frequencies of illumination sources and/or an illumination source with a
- the motor vehicle includes a communication device for wireless communication with the database external to vehicle and/or a communication device for transmitting an information request and for receiving the stored pulse frequency from the illumination source.
- Fig. 1 a schematic illustration of an embodiment of a system according to the invention with a motor vehicle and a camera disposed on the motor vehicle;
- FIG. 2 a schematic illustration of an embodiment of a motor vehicle according to the invention with a communication device
- Fig. 3 a schematic illustration of an image sequence with three images containing an illumination source
- Fig. 4 a diagrammatic illustration of a pulse frequency of the illumination source and of a non-adapted setup parameter of the camera;
- Fig. 5 a diagrammatic illustration of the pulse frequency and of an adapted setup parameter of the camera
- Fig. 6 a schematic illustration of a GNSS position of the motor vehicle and of a near zone
- Fig. 7 a flow diagram for determining the pulse frequency and for adapting the setup parameter of the camera
- Fig. 8 a further flow diagram for determining the pulse frequency and for adapting the setup parameter of the camera.
- Fig. 9 a further flow diagram for determining the pulse frequency and for adapting the setup parameter of the camera.
- a system 1 with a motor vehicle 2 and a camera 3 disposed on the motor vehicle 2 is schematically illustrated.
- the camera 3 at least partially captures an environmental region 4 of the motor vehicle 2.
- An illumination source 6 is disposed in a periphery 5 of the motor vehicle 2.
- the environmental region 4 in particular includes the periphery 5.
- the system 1 includes a data base 7 external to vehicle.
- the motor vehicle 2 has a communication device 8 for communicating with the database 7 external to vehicle.
- the motor vehicle 2 has a GNSS receiver 9.
- the motor vehicle 2 of the system 1 includes a database 10.
- a pulse frequency 1 1 of the illumination source 6 is provided for example for a control unit 26 of the motor vehicle 1 .
- the control unit 26 can be separate from the camera 3 or integrated into the camera 3.
- the motor vehicle 2 can also include multiple cameras 3.
- the illumination source 6 can be formed as a traffic sign, street lighting, construction site warning light or headlight of another motor vehicle.
- the illumination source 6 emits optical signals by means of a light emitting diode.
- the light emitting diode is operated by means of a pulse width modulation method.
- Fig. 2 shows the system 1 analogous to Fig. 1 , wherein the motor vehicle 2 has a communication device 12 and the communication device 12 is formed to communicate with a communication device 13 of the illumination source 6.
- the pulse frequency 1 1 is stored in the illumination source 6.
- the own pulse frequency 1 1 of the illumination source 6 is stored to be transmitted to the communication device 12 by means of the communication device 13.
- the communication device 12 can for example be integrated in the camera 3 or be present as a separate unit.
- Fig. 3 shows an image sequence 14 with a first image 15, a second image 16 and a third image 17.
- the image sequence 14 is provided by the camera 3.
- the illumination source 6 is imaged by the image sequence 14.
- the first image 15, the second image 16 and the third image 17 thus show a picture 18 of the illumination source 6.
- the illumination source 6 is captured with a setup parameter of the camera 3 non-adapted with respect to the pulse frequency 1 1 of the illumination source 6.
- This entails that a shutter time 19 of the camera 3 - as shown in Fig. 4 - and thus an exposure time of the image 15, 16, 17 is not synchronized with the pulse frequency 1 1 .
- the capture of the respective cycle of the pulse frequency 1 1 is not always completely effected.
- This entails that the picture 18 in the second image 16 and the third image 17 is incomplete.
- Fig. 4 shows the pulse frequency 1 1 .
- the pulse frequency 1 1 is in particular characterized by a mains frequency.
- the mains frequency is in particular 50 Hz or 60 Hz.
- the pulse frequency 1 1 can also have another value in manifold manner. It is shown, with which shutter time 19 the camera 3 provides the image sequence 14 if the shutter time 19 is not adapted with respect to the pulse frequency 1 1 .
- the light pulse 20 and thus the information, more specifically the optical information of the illumination source 6, can therefore not be completely imaged in the respective image 15, 16, 17.
- the illumination source 6 and thus for example traffic information is not at all or only incompletely recognizable for a user of the motor vehicle 2. Furthermore, the information of the illumination source 6 can be only insufficiently provided by automatic methods such as for example an automatic traffic sign recognition method.
- Fig. 5 shows the pulse frequency 1 1 of the illumination source 6 and a shutter time 21 of the camera 3 adapted with respect to the pulse frequency 1 1 .
- the adapted shutter time 21 is taken as a basis for capturing an image as a setup parameter of the camera 3, thus, the aim can be achieved that the respective light pulse 20 of the illumination source 6 is substantially completely within the period of time of the shutter time 21 .
- the illumination source 6 can be completely imaged in the respective image 15, 16, 17 of the image sequence 14.
- Fig. 6 shows a map 22, as it can for example be stored in the database 7 external to vehicle and/or the database 10. Positions 23 of illumination sources 6 are contained in the map 22.
- a GNSS position 24 of the motor vehicle 2 can be determined.
- a near zone 25 to the respective illumination source 6 can be determined.
- the near zone 25 can for example be formed as a certain radius around the GNSS position 24.
- the setup parameters of the camera 3, in particular the shutter time 19, 21 of the camera 3 can for example be adapted to the pulse frequency 1 1 of the illumination source 6 if the illumination source 6 is within the near zone 25.
- one of the illumination sources 6 is in the near zone 25.
- the pulse frequency 1 1 associated with the respective illumination source 6 in the near zone 25 is queried from the database 7 external to vehicle and/or the database 10.
- Fig. 7 shows an embodiment for adapting the setup parameter, in particular the shutter time 19, 21 of the camera 3.
- the GNSS position 24 is provided by means of the GNSS receiver 9 for the control unit 26 of the motor vehicle 2.
- the control unit 26 can be integrated in the camera 3 or be present as a separate unit.
- the pulse frequency frequency 1 1 for the illumination source 6, in particular in the near zone 25 is provided for the control unit 26 by the database 10 in a step S3.
- the pulse frequencies 1 1 of all of the illumination sources 6 within at least the map 22 are stored in the database 10.
- the control unit 26 determines the adapted shutter time 21 based on the pulse frequency 1 1 from the data base 10.
- the setup parameter of the camera 3 is determined by the control unit 26 based on the pulse frequency 1 1 .
- the adapted setup parameter of the camera 3, in particular in the form of the adapted shutter time 21 is transmitted to the camera 3 in a step S4.
- the setup parameter, in particular the shutter time 19 is adapted to the adapted shutter time 21 transmitted in step S4.
- Fig. 8 shows a further embodiment for determining the pulse frequency 1 1 and adapting the setup parameter of the camera 3.
- a step S6 an image 27 is captured by means of the camera 3 and transmitted to the control unit 26.
- the control unit 26 evaluates the image 27 in a step S7 and determines if the illumination source 6 is in the image 27. If the illumination source 6 is present in the image 27, thus, the GNSS position 24 is queried from the GNSS receiver 9 by the control unit 26 in a step S8.
- the GNSS position 24 is transmitted from the GNSS receiver 9 to the control unit 26 in a step S9.
- the control unit 26 queries an orientation and a speed of the motor vehicle 2 from an odometry device 28 of the motor vehicle 2 in a step S10.
- the odometry device 28 can for example include sensors of the motor vehicle 2, which provide information about the orientation of the motor vehicle 2 and/or the speed of the motor vehicle 2. However, the orientation of the motor vehicle 2 and/or the speed of the motor vehicle 2 can also be picked up from the CAN Bus of the motor vehicle 2.
- the orientation of the motor vehicle 2 and the speed of the motor vehicle 2 are transmitted from the odometry device 28 to the control unit 26.
- the position 23 of the illumination source 6 is determined in particular by the control unit 26.
- the pulse frequency 1 1 is queried from the database 10 by the control unit 26.
- the pulse frequency 1 1 is provided by the database 10 for the control unit 26 in a step S14.
- the setup parameter in particular the shutter time 19, 21
- the setup parameter of the camera 2 is accordingly adapted to the determined pulse frequency 1 1 .
- Fig. 9 shows a further embodiment for determining the pulse frequency 1 1 and for adapting the setup parameter of the camera.
- the image 27 is provided by the camera 3 for the control unit 26.
- step S19 analogously to step S7, it is checked if the illumination source 6 is present in the image 27. If the illumination source 6 is present in the image 27, the orientation of the motor vehicle 2 and the speed of the motor vehicle 2 are queried from the odometry device 28 by the control unit 26 in a step S20. The orientation of the motor vehicle 2 and the speed of the motor vehicle 2 are provided for the control unit 26 in a step S21 . Furthermore, in a step S22, analogously to step S10, the GNSS position 24 is requested from the GNSS receiver 9, and in a step S23, analogously to step S1 1 , provided from the GNSS receiver 9 to the control unit 26.
- the GNSS position 24 is transmitted to the communication device 12 of the motor vehicle 2 in a step S24.
- the communication device 12 requests the pulse frequency 1 1 from the communication device 13 of the illumination source 6.
- the pulse frequency 1 1 is transmitted from the communication device 13 of the illumination source 6 to the communication device 12 in a step S26.
- the request of the pulse frequency 1 1 in the step S25 and the transmission of the pulse frequency 1 1 in the step S26 can for example be performed depending on the GSM standard.
- step S27 which is performed analogously to step S14
- a step S28 which is performed analogously to step S15
- a step S29 which is performed analogously to step S16
- a step S30 which is performed analogously to step S17.
- the pulse frequency 1 1 can be determined in different manners, which are described by the embodiments according to Fig. 7 to Fig. 9 among other things.
- the determination of the pulse frequency 1 1 can for example also be effected by a mixed form of the described embodiments.
- the pulse frequency 1 1 can also be determined multiple times, whereby for example an examination of the determined pulse frequency 1 1 can be performed in the sense of an error check.
- a further embodiment - not further illustrated in the figures - for determining the pulse frequency 1 1 and adapting the setup parameter provides that the pulse frequency 1 1 is determined based on an image sequence with at least two images of the illumination source 6.
- the pulse frequency 1 1 can for example be determined or decoded by means of a modulated illumination sequence.
- the illumination source 6 can for example be operated in the infrared spectral range.
- the infrared spectral range extends at least within wavelengths from 780 nm to 1 mm.
- the illumination source 6 is operated in the near infrared range (NIR) between 780 nm and 1400 nm.
- NIR near infrared range
- the information of the illumination source 6 is thus, for example, emitted to the environmental region 4 by electromagnetic radiation in the infrared spectral range and there captured by the camera 3, which in this case is additionally or alternatively configured to capture electromagnetic radiation from the infrared spectral range.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Studio Devices (AREA)
Abstract
The invention relates to a method for operating a camera (3) of a motor vehicle (2), in which an environmental region (4) of the motor vehicle (2) is captured by means of the camera (3), wherein an illumination source (6) is operated pulsed with a preset pulse frequency (11) in a periphery (5) of the motor vehicle (2), wherein the pulse frequency (11) is determined and at least one setup parameter of the camera (3) is adapted depending on the pulse frequency (11).
Description
Method for operating a camera depending on a preset pulse frequency of an illumination source, camera and system
The invention relates to a method for operating a camera of a motor vehicle. An environmental region of the motor vehicle is captured by means of the camera. In a periphery of the motor vehicle, an illumination source is operated pulsed with a preset pulse frequency. The invention also relates to a camera for a motor vehicle as well as to a system with a camera.
Methods for operating a camera of a motor vehicle are known from the prior art. Thus, the camera is for example operated such that an environmental region of the motor vehicle is captured. In the environmental region, for example, a periphery of the motor vehicle can be disposed, in which an illumination source is operated pulsed with a preset pulse frequency.
It is the object of the invention to provide a method, a camera as well as a system, by which or in which a camera of a motor vehicle is operated such that an environmental region of the motor vehicle can be more adequately captured.
According to the invention, this object is solved by a method, by a camera as well as by a system having the features according to the respective independent claims.
In a method according to the invention, a camera of a motor vehicle is operated. An environmental region of the motor vehicle is captured by means of the camera. In a periphery of the motor vehicle, an illumination source is operated pulsed with a preset pulse frequency in particular with respect to its emitted optical signals. As an essential idea of the invention, it is provided that the pulse frequency is determined and at least one setup parameter of the camera is adapted depending on the pulse frequency.
Thus, in particular adaptation of a temporal clock cycle of a setup parameter to the clock cycle of the illumination source, which is the pulse frequency, is performed.
By the method according to the invention, it becomes possible that the environmental region of the motor vehicle, in particular the periphery of the motor vehicle, is captured more accurately und thus more adequately in particular due to operational modes of objects in the periphery.
Thus, the environmental region is captured by the camera of the motor vehicle. For example, the environmental region can include the periphery of the motor vehicle. Thus, it can for example be that the environmental region and the periphery are captured by the camera. In this case, the camera also captures the illumination source, which is operated pulsed with the preset pulse frequency. The pulsed operation of the illumination source results in switching on and off of the illumination source - for example clocked with 50 Hz. By the pulsed operation of the illumination source, it can occur that the camera, which is in particular formed as a video camera and captures a sequence of images of the environmental region and/or the periphery, does not each time completely capture the entire cycle of the preset pulse frequency of the illumination source due to its preset capturing frequency and/or preset exposure time. By adapting the setup parameter of the camera, the periphery of the motor vehicle can be captured such that at least one complete cycle of the pulse frequency or a complete light pulse of the illumination source disposed in the periphery is preferably captured with each capture of the camera. An image of the periphery with the illumination source can therefore be provided in particular with high quality and with completely imaged illumination source by the camera with the adapted setup parameter.
The pulse frequency of the illumination source is in particular characterized by a mains frequency, for example 50 Hz or 60 Hz. If the setup parameter of the camera is not adapted to the pulse frequency of the illumination source, thus, the periphery with the illumination source is for example captured such that the illumination source is for example imaged flickering in the image sequence. By the flickering, the illumination source is at least only partially imaged or represented in at least some images. This is prevented by the invention since the setup parameter is adapted to the pulse frequency such that the flickering is prevented. The same is also effected if the clock cycles of the setup parameter and the pulse frequency would be such that the illumination source is not captured even it would be in the capturing range of the camera.
In particular, it is provided that after adapting the setup parameter, an image having the illumination source is captured by means of the camera. The image is in particular a component of an image sequence. By the adapted setup parameter, the illumination
source can be completely and with flicker mitigation imaged in the image. In particular, it is provided that the setup parameter is selectively adapted to the illumination source. The image, which is captured of the illumination source, can therefore be provided with the setup parameter selectively adapted to the pulse frequency of the illumination source.
Furthermore, it is in particular provided that a shutter time of the camera is adapted as the setup parameter. An exposure time is referred to as the shutter time, which is preset by a camera shutter of the camera. The control of the shutter time can be effected either mechanically and/or electronically. By the shutter time, thus, the time is described, in which photons from the environmental region and/or the periphery are integrated or collected by a sensor of the camera. In particular, based on this light, which is incident on the sensor of the camera within the shutter time, an image of the environmental region and/or the periphery is provided by means of the camera. Additionally or alternatively to the adaptation of the shutter time, a capturing frequency of the camera can for example also be adapted as the setup parameter. By the preferable adaptation of the shutter time of the camera, the periphery with the illumination source can therefore be captured with higher quality than with non-adapted shutter time.
Preferably, it is provided that the pulse frequency of the illumination source is determined based on information in a database in the motor vehicle and/or information in a database external to motor vehicle. Thus, the pulse frequency of the illumination source can for example be kept available in the motor vehicle and be retrieved from the database on demand. Additionally or alternatively, the pulse frequency can for example also be kept available in the database external to motor vehicle, for example an external server, and be provided for the motor vehicle on demand. Based on the pulse frequency of the illumination source provided by the database and/or the database external to motor vehicle, the setup parameter of the camera can be adapted. Thus, the pulse frequencies of all of the illumination sources within a certain geographic region can for example be kept available in the database and/or in the database external to motor vehicle. Thus, it is advantageous that the pulse frequency can be effectively provided by the database and/or the database external to motor vehicle for adapting the setup parameter of the camera.
Furthermore, it is preferably provided that an orientation of the motor vehicle and/or a speed of the motor vehicle are determined, and the pulse frequency is determined depending on the orientation of the motor vehicle, in particular relative, to the illumination source and/or the speed of the motor vehicle, in particular relative, to the illumination source. For example, the orientation of the motor vehicle can be determined by odometry
and/or visual odometry. The orientation of the motor vehicle can therefore be determined by means of sensors of the motor vehicle and for example be picked up on the CAN (Controller Area Network) Bus of the motor vehicle. The orientation of the motor vehicle is useful if more than one illumination source is located in the periphery of the motor vehicle. Thus, the respective camera of the motor vehicle can for example be selected for adapting the setup parameter, which captures the illumination source in the periphery with respect to its orientation. For example, the respective camera of the motor vehicle can be selected for adapting the setup parameter, which captures the illumination source in the periphery with respect to its orientation. A direction of travel of the motor vehicle can for example also be determined. The direction of travel of the motor vehicle can for example be determined based on an engaged gear of the motor vehicle. By considering the orientation of the motor vehicle, thus, the illumination source in the periphery of a camera of the motor vehicle can be associated for adapting the setup parameter. Furthermore, the speed of the motor vehicle can for example be taken into account in adapting the setup parameter. Thus, the relative speed between the illumination source and the motor vehicle can for example be taken into account with respect to the Doppler effect. Thus, the adaptation of the setup parameter can be effected depending on the Doppler effect. Thus, if the motor vehicle moves towards the illumination source or moves away from the illumination source, this can have effects on the pulse frequency of the illumination source captured by the camera. The variation of the pulse frequency by the Doppler shift can be taken into account by the speed of the motor vehicle and the speed of the illumination source, which is in particular zero with a street lighting or street lamp in the periphery, for adapting the setup parameter. Thus, it is advantageous that the setup parameter of the camera can be effectively and precisely adapted depending on the orientation of the motor vehicle and/or the speed of the motor vehicle.
Furthermore preferably it is provided that a GNSS position of the motor vehicle is determined, and the pulse frequency is determined depending on the GNSS position of the motor vehicle, in particular relative, to the illumination source. The GNSS position (GNSS - global navigation satellite system) can for example be provided by a GPS system (GPS - global positioning system) and/or a GLONASS system and/or a Galileo system. By the GNSS position, the current position of the motor vehicle in a global coordinate system can be determined. In the global coordinate system, for example, the positions or sites of illumination sources can also be described. Thus, it can for example be determined, which illumination source is in the periphery of the motor vehicle. Thus, it is advantageous in the determination of the GNSS position that the pulse frequency of the illumination source can thereby be effectively and simply determined.
In particular, it is provided that a near zone to an illumination source is determined depending on the GNSS position and the pulse frequency is determined if the motor vehicle is in the near zone. The near zone can for example be characterized as a certain region around the motor vehicle. For example, the near zone can be determined by a radius around the motor vehicle. Thus, the near zone can for example be determined in a map including the environmental region and/or the periphery by drawing a certain radius around the GNSS position of the motor vehicle and determining the near zone within this radius. Thus, the pulse frequencies of all of the illumination sources in the near zone can for example be queried from the database and/or the database external to motor vehicle based on the GNSS position and can be provided for adapting the setup parameter of the camera. An association of the pulse frequencies of the illumination sources disposed in the near zone with the respective camera of the motor vehicle can for example be effected based on the orientation of the motor vehicle. For example, the near zone can be described restricting by a range of the camera. This means that the near zone in particular does not have to extend substantially further than the range of the capturing area of the camera. The pulse frequency of the illumination source can therefore be effectively and simply determined by the near zone.
In a further embodiment, it can be provided that the pulse frequency is determined independently of whether the illumination source is contained in an image of the environmental region captured before the pulse frequency determination. Thus, the adaptation of the setup parameter can for example be effected based on the near zone, while the camera does not yet capture the illumination source. Thus, the setup parameter of the camera is therefore adapted independently of whether or not the illumination source is captured by the camera. In particular, this can be advantageous if the camera does not know at all if the illumination source is captured. Thus, the adaptation of the setup parameter is for example effected exclusively based on the near zone even if the illumination source is not present in the image. This is advantageous because thereby detection of the illumination source in the image of the camera does not have to be effected. The adaptation of the setup parameter can therefore be performed without the detection of the illumination source in the image and thus for example without the employment of object recognition methods.
In a further embodiment, it can be provided that before determining the pulse frequency, at least one image is captured, and it is evaluated if the illumination source is in the image, and the pulse frequency of the illumination source is determined if the illumination
source is present in the image. Thus, the illumination source in the image can for example be recognized in the image by means of an object recognition method. Thus, if the illumination source is recognized in the image, thus, subsequently thereto, the pulse frequency of the recognized illumination source can be determined. Thus, it is
advantageous that the setup parameter of the camera is only adapted if the illumination source is captured by the camera.
In an embodiment, it can be provided that the pulse frequency is stored as information in the illumination source itself and is requested by the motor vehicle and the pulse frequency is wirelessly transmitted from the illumination source to the motor vehicle as a result of the request. Based on the transmitted pulse frequency, the setup parameter of the camera can now be adapted. Thus, the pulse frequency can for example be requested from the illumination source by means of a radio signal or another active signal. Hereto, the motor vehicle in particular has a transmitter, while the illumination source in particular has a receiver. As a result of the request, the illumination source sends its own pulse frequency to the motor vehicle. Hereto, the illumination source in particular has a transmitter and the motor vehicle in particular has a receiver. Thus, the illumination source and the motor vehicle each have in particular a communication device for communication with each other. Thus, it can for example be determined that the illumination source is in the near region and/or in the image, and the pulse frequency can be requested from the illumination source. Thus, it is advantageous that the pulse frequency can thereby be effectively and simply determined.
Furthermore, it can be provided that before determining the pulse frequency, an image sequence with at least two images containing the illumination source is captured and the pulse frequency is determined based on the image sequence. Thus, the pulse frequency can for example be determined based on a modulated illumination sequence. Thus, the pulse frequency of the illumination source can for example be determined by the modulated illumination sequence. However, the pulse frequency of the illumination source can for example also be determined by analysis of the image sequence with respect to the complete depiction of the illumination source. Thus, the advantage is that the pulse frequency can be determined by the motor vehicle itself and therefore in particular the database and/or the database external to motor vehicle are not necessarily required. Furthermore, in determining the pulse frequency based on the image sequence, the GNSS position of the motor vehicle is for example also not necessarily required. Thereby, the pulse frequency of the illumination source can therefore be determined more independently of other information sources.
Preferably, it is provided that the pulse frequency of an illumination source formed as a light emitting diode is determined. For example, the light emitting diode can be operated with a pulse width modulation method. The illumination source can for example be characterized by a street lighting or a street lamp in the environmental region and/or in the periphery. However, the illumination source can also be characterized as a hazard warning light of for example a construction site or as a traffic sign or road sign.
Additionally or alternatively, the illumination source can also be characterized by a headlight of another motor vehicle in the periphery of the motor vehicle. Thus, it is advantageous that the setup parameter of the camera can be adapted to the pulse frequency of various illumination sources, which have at least one light emitting diode.
In particular, traffic information is emitted by the illumination source such that the capture by the camera is particularly important such that especially then the invention is particularly advantageous.
In a further embodiment it can be provided that information or a signal in the infrared spectral range, in particular in the near infrared range (NIR), of the electromagnetic spectrum is emitted by the illumination source. The camera is then preferably configured to capture radiation from the infrared spectral range. It is advantageous, for example, that thus information can be emitted by the illumination source, which can be captured only by the camera and not by a human observer. Thus, the setup parameter of the camera can also in particular be adjusted if the illumination source is operated in the infrared spectral range.
The invention also relates to a camera for a motor vehicle with a control unit or an evaluation unit and/or a communication device, wherein the camera is adapted to perform a method according to the invention. The control unit and/or the communication device can for example be integrated in the camera or be present as a separate unit.
In addition, the invention relates to a system with a motor vehicle and a camera according to the invention disposed on the motor vehicle. The system is in particular adapted to perform a method according to the invention.
Preferably, it is provided that the system includes a database external to vehicle with pulse frequencies of illumination sources and/or an illumination source with a
communication device and in particular own pulse frequency stored therein, and the motor
vehicle includes a communication device for wireless communication with the database external to vehicle and/or a communication device for transmitting an information request and for receiving the stored pulse frequency from the illumination source.
The preferred embodiments presented with respect to the method according to the invention and the advantages thereof correspondingly apply to the camera according to the invention as well as to the system according to the invention.
With the statements of "top", "bottom", "front", "rear", "horizontal", "vertical" etc., the positions and orientations given with intended use and intended arrangement of the camera and with an observer then standing in front of the camera and looking in the direction of the camera are specified.
Further features of the invention are apparent from the claims, the figures and the description of figures. The features and feature combinations mentioned above in the description as well as the features and feature combinations mentioned below in the description of figures and/or shown in the figures alone are usable not only in the respectively specified combination, but also in other combinations or alone, without departing from the scope of the invention. Thus, implementations are also to be considered as encompassed and disclosed by the invention, which are not explicitly shown in the figures and explained, but arise from and can be generated by separated feature combinations from the explained implementations. Implementations and feature combinations are also to be considered as disclosed, which thus do not have all of the features of an originally formulated independent claim.
Below, the embodiments of the invention are explained in more detail based on schematic drawings.
There show:
Fig. 1 a schematic illustration of an embodiment of a system according to the invention with a motor vehicle and a camera disposed on the motor vehicle;
Fig. 2 a schematic illustration of an embodiment of a motor vehicle according to the invention with a communication device;
Fig. 3 a schematic illustration of an image sequence with three images containing an illumination source;
Fig. 4 a diagrammatic illustration of a pulse frequency of the illumination source and of a non-adapted setup parameter of the camera;
Fig. 5 a diagrammatic illustration of the pulse frequency and of an adapted setup parameter of the camera;
Fig. 6 a schematic illustration of a GNSS position of the motor vehicle and of a near zone;
Fig. 7 a flow diagram for determining the pulse frequency and for adapting the setup parameter of the camera;
Fig. 8 a further flow diagram for determining the pulse frequency and for adapting the setup parameter of the camera; and
Fig. 9 a further flow diagram for determining the pulse frequency and for adapting the setup parameter of the camera.
In the figures, identical or functionally identical elements are provided with the same reference characters.
In Fig. 1 , a system 1 with a motor vehicle 2 and a camera 3 disposed on the motor vehicle 2 is schematically illustrated. The camera 3 at least partially captures an environmental region 4 of the motor vehicle 2. An illumination source 6 is disposed in a periphery 5 of the motor vehicle 2. The environmental region 4 in particular includes the periphery 5.
Furthermore, the system 1 includes a data base 7 external to vehicle. The motor vehicle 2 has a communication device 8 for communicating with the database 7 external to vehicle. Furthermore, the motor vehicle 2 has a GNSS receiver 9. Additionally or alternatively to the database 7 external to vehicle, the motor vehicle 2 of the system 1 includes a database 10. By the database 7 external to vehicle and/or the database 10, a pulse frequency 1 1 of the illumination source 6 is provided for example for a control unit 26 of
the motor vehicle 1 . The control unit 26 can be separate from the camera 3 or integrated into the camera 3.
The arrangement of the database 10 and/or the GNSS receiver 9 and/or the
communication device 8 is variously possible on the motor vehicle 2. Similarly, the arrangement of the camera 3 is variously possible on the motor vehicle 2. The motor vehicle 2 can also include multiple cameras 3.
For example, the illumination source 6 can be formed as a traffic sign, street lighting, construction site warning light or headlight of another motor vehicle. In particular, the illumination source 6 emits optical signals by means of a light emitting diode. In particular, the light emitting diode is operated by means of a pulse width modulation method.
Fig. 2 shows the system 1 analogous to Fig. 1 , wherein the motor vehicle 2 has a communication device 12 and the communication device 12 is formed to communicate with a communication device 13 of the illumination source 6. According to the embodiment of Fig. 2, the pulse frequency 1 1 is stored in the illumination source 6. In the illumination source 6, thus, the own pulse frequency 1 1 of the illumination source 6 is stored to be transmitted to the communication device 12 by means of the communication device 13. The communication device 12 can for example be integrated in the camera 3 or be present as a separate unit.
Fig. 3 shows an image sequence 14 with a first image 15, a second image 16 and a third image 17. The image sequence 14 is provided by the camera 3. The illumination source 6 is imaged by the image sequence 14. The first image 15, the second image 16 and the third image 17 thus show a picture 18 of the illumination source 6. According to the illustration of Fig. 3, the illumination source 6 is captured with a setup parameter of the camera 3 non-adapted with respect to the pulse frequency 1 1 of the illumination source 6. This entails that a shutter time 19 of the camera 3 - as shown in Fig. 4 - and thus an exposure time of the image 15, 16, 17 is not synchronized with the pulse frequency 1 1 . Thus, the capture of the respective cycle of the pulse frequency 1 1 is not always completely effected. This entails that the picture 18 in the second image 16 and the third image 17 is incomplete.
Fig. 4 shows the pulse frequency 1 1 . The pulse frequency 1 1 is in particular characterized by a mains frequency. The mains frequency is in particular 50 Hz or 60 Hz. However, the pulse frequency 1 1 can also have another value in manifold manner. It is shown, with
which shutter time 19 the camera 3 provides the image sequence 14 if the shutter time 19 is not adapted with respect to the pulse frequency 1 1 . By the non-adaptation of the shutter time 19, as shown in Fig. 4, it can occur that a light pulse 20 or a cycle of the illumination source 6 is not completely within the period of time of the shutter time 19. The light pulse 20 and thus the information, more specifically the optical information of the illumination source 6, can therefore not be completely imaged in the respective image 15, 16, 17. This entails that the illumination source 6 and thus for example traffic information is not at all or only incompletely recognizable for a user of the motor vehicle 2. Furthermore, the information of the illumination source 6 can be only insufficiently provided by automatic methods such as for example an automatic traffic sign recognition method.
Fig. 5 shows the pulse frequency 1 1 of the illumination source 6 and a shutter time 21 of the camera 3 adapted with respect to the pulse frequency 1 1 . Thus, if the adapted shutter time 21 is taken as a basis for capturing an image as a setup parameter of the camera 3, thus, the aim can be achieved that the respective light pulse 20 of the illumination source 6 is substantially completely within the period of time of the shutter time 21 . Thus, the illumination source 6 can be completely imaged in the respective image 15, 16, 17 of the image sequence 14.
Fig. 6 shows a map 22, as it can for example be stored in the database 7 external to vehicle and/or the database 10. Positions 23 of illumination sources 6 are contained in the map 22. By the GNSS receiver 9, a GNSS position 24 of the motor vehicle 2 can be determined. Depending on the GNSS position 24, now, a near zone 25 to the respective illumination source 6 can be determined. The near zone 25 can for example be formed as a certain radius around the GNSS position 24. Thus, the setup parameters of the camera 3, in particular the shutter time 19, 21 of the camera 3, can for example be adapted to the pulse frequency 1 1 of the illumination source 6 if the illumination source 6 is within the near zone 25. According to Fig. 6, one of the illumination sources 6 is in the near zone 25. Thus, the pulse frequency 1 1 associated with the respective illumination source 6 in the near zone 25 is queried from the database 7 external to vehicle and/or the database 10.
Fig. 7 shows an embodiment for adapting the setup parameter, in particular the shutter time 19, 21 of the camera 3. Hereto, in a step S1 , the GNSS position 24 is provided by means of the GNSS receiver 9 for the control unit 26 of the motor vehicle 2. For example, the control unit 26 can be integrated in the camera 3 or be present as a separate unit. In a step S2, depending on the GNSS position 24 of the motor vehicle 2, the pulse frequency
frequency 1 1 for the illumination source 6, in particular in the near zone 25, is provided for the control unit 26 by the database 10 in a step S3. Thus, in particular the pulse frequencies 1 1 of all of the illumination sources 6 within at least the map 22 are stored in the database 10. By the GNSS position 24 of the motor vehicle 2, the pulse frequency 1 1 of the respective illumination source 6 within the near zone 25 can be queried from the database 10. Now, the control unit 26 determines the adapted shutter time 21 based on the pulse frequency 1 1 from the data base 10. Thus, in particular the setup parameter of the camera 3 is determined by the control unit 26 based on the pulse frequency 1 1 . The adapted setup parameter of the camera 3, in particular in the form of the adapted shutter time 21 , is transmitted to the camera 3 in a step S4. In a step S5, the setup parameter, in particular the shutter time 19, is adapted to the adapted shutter time 21 transmitted in step S4. By adapting the shutter time 19, 21 in step S5, the illumination source 6 can now be completely imaged in the image sequence 14.
Fig. 8 shows a further embodiment for determining the pulse frequency 1 1 and adapting the setup parameter of the camera 3. In a step S6, an image 27 is captured by means of the camera 3 and transmitted to the control unit 26. The control unit 26 evaluates the image 27 in a step S7 and determines if the illumination source 6 is in the image 27. If the illumination source 6 is present in the image 27, thus, the GNSS position 24 is queried from the GNSS receiver 9 by the control unit 26 in a step S8. The GNSS position 24 is transmitted from the GNSS receiver 9 to the control unit 26 in a step S9. Furthermore, the control unit 26 queries an orientation and a speed of the motor vehicle 2 from an odometry device 28 of the motor vehicle 2 in a step S10. The odometry device 28 can for example include sensors of the motor vehicle 2, which provide information about the orientation of the motor vehicle 2 and/or the speed of the motor vehicle 2. However, the orientation of the motor vehicle 2 and/or the speed of the motor vehicle 2 can also be picked up from the CAN Bus of the motor vehicle 2. In a step S1 1 , the orientation of the motor vehicle 2 and the speed of the motor vehicle 2 are transmitted from the odometry device 28 to the control unit 26. In a step S12, the position 23 of the illumination source 6 is determined in particular by the control unit 26. Furthermore, in a step S13, the pulse frequency 1 1 is queried from the database 10 by the control unit 26. Due to the query, the pulse frequency 1 1 is provided by the database 10 for the control unit 26 in a step S14. Finally, the setup parameter, in particular the shutter time 19, 21 , can be determined by the control unit 26 based on the pulse frequency 1 1 in a step S15. The shutter time 19, 21 determined in step S15 is provided for the camera 3 in a step S16. In a step S17, the setup parameter of the camera 2, in particular the shutter time 19, 21 of the camera 3, is accordingly adapted to the determined pulse frequency 1 1 .
Fig. 9 shows a further embodiment for determining the pulse frequency 1 1 and for adapting the setup parameter of the camera. In a step S18, the image 27 is provided by the camera 3 for the control unit 26. In a step S19, analogously to step S7, it is checked if the illumination source 6 is present in the image 27. If the illumination source 6 is present in the image 27, the orientation of the motor vehicle 2 and the speed of the motor vehicle 2 are queried from the odometry device 28 by the control unit 26 in a step S20. The orientation of the motor vehicle 2 and the speed of the motor vehicle 2 are provided for the control unit 26 in a step S21 . Furthermore, in a step S22, analogously to step S10, the GNSS position 24 is requested from the GNSS receiver 9, and in a step S23, analogously to step S1 1 , provided from the GNSS receiver 9 to the control unit 26. Finally, the GNSS position 24 is transmitted to the communication device 12 of the motor vehicle 2 in a step S24. In a step S25, the communication device 12 requests the pulse frequency 1 1 from the communication device 13 of the illumination source 6. Finally, the pulse frequency 1 1 is transmitted from the communication device 13 of the illumination source 6 to the communication device 12 in a step S26. The request of the pulse frequency 1 1 in the step S25 and the transmission of the pulse frequency 1 1 in the step S26 can for example be performed depending on the GSM standard. There follow a step S27, which is performed analogously to step S14, a step S28, which is performed analogously to step S15, a step S29, which is performed analogously to step S16, and a step S30, which is performed analogously to step S17.
Thus, the pulse frequency 1 1 can be determined in different manners, which are described by the embodiments according to Fig. 7 to Fig. 9 among other things. Thus, the determination of the pulse frequency 1 1 can for example also be effected by a mixed form of the described embodiments. The pulse frequency 1 1 can also be determined multiple times, whereby for example an examination of the determined pulse frequency 1 1 can be performed in the sense of an error check.
A further embodiment - not further illustrated in the figures - for determining the pulse frequency 1 1 and adapting the setup parameter provides that the pulse frequency 1 1 is determined based on an image sequence with at least two images of the illumination source 6. Thus, the pulse frequency 1 1 can for example be determined or decoded by means of a modulated illumination sequence.
In a further embodiment the illumination source 6 can for example be operated in the infrared spectral range. The infrared spectral range extends at least within wavelengths
from 780 nm to 1 mm. Preferably the illumination source 6 is operated in the near infrared range (NIR) between 780 nm and 1400 nm. The information of the illumination source 6 is thus, for example, emitted to the environmental region 4 by electromagnetic radiation in the infrared spectral range and there captured by the camera 3, which in this case is additionally or alternatively configured to capture electromagnetic radiation from the infrared spectral range.
Claims
1 . Method for operating a camera (3) of a motor vehicle (2), in which an environmental region (4) of the motor vehicle (2) is captured by means of the camera (3), wherein an illumination source (6) is operated pulsed with a preset pulse frequency (1 1 ) in a periphery (5) of the motor vehicle (2),
characterized in that
the pulse frequency (1 1 ) is determined and at least one setup parameter (19, 21 ) of the camera (3) is adapted depending on the pulse frequency (1 1 ) while
the pulse frequency (1 1 ) is stored as information in the illumination source (6) itself and is requested by the motor vehicle (2), and the pulse frequency (1 1 ) is wirelessly transmitted from the illumination source (6) to the motor vehicle (2) as a result of the request.
2. Method according to claim 1 ,
characterized in that
after adapting the setup parameter (19, 21 ), an image having the illumination source (6) is captured by means of the camera (3).
3. Method according to claim 1 or 2,
characterized in that
a shutter time (19, 21 ) of the camera (3) is adapted as the setup parameter.
4. Method according to any one of the preceding claims,
characterized in that
the pulse frequency (1 1 ) of the illumination source (6) is determined based on information in a database (10) in the motor vehicle (2) and/or information in a database (7) external to motor vehicle.
SIE0262
2017/042276 PCT/EP2016/071184
16
5. Method according to any one of the preceding claims,
characterized in that
an orientation of the motor vehicle (2) and/or a speed of the motor vehicle (2) are determined, and the pulse frequency (1 1 ) is determined depending on the orientation of the motor vehicle (2) to the illumination source (6) and/or the speed of the motor vehicle (2) to the illumination source (6).
6. Method according to any one of the preceding claims,
characterized in that
a GNSS position (24) of the motor vehicle (2) is determined and the pulse frequency (1 1 ) is determined depending on the GNSS position (24) of the motor vehicle (2) to the illumination source (6).
7. Method according to claim 6,
characterized in that
a near zone (25) to an illumination source (6) is determined depending on the GNSS position (24) and the pulse frequency (1 1 ) is determined if the motor vehicle (2) is in the near zone (25).
8. Method according to any one of claims 5 to 7,
characterized in that
the pulse frequency (1 1 ) is determined independently of whether the illumination source (6) is contained in an image (15, 16, 17) of the environmental region (4) captured before the pulse frequency determination.
9. Method according to any one of claims 1 to 7,
characterized in that
before determining the pulse frequency (1 1 ), at least one image (15, 16, 17) is captured, and it is evaluated if the illumination source (6) is in the image (15, 16, 17), and the pulse frequency (1 1 ) of the illumination source (6) is determined if the illumination source (6) is present in the image (15, 16, 17).
10. Method according to claim 9,
characterized in that
before determining the pulse frequency (1 1 ), an image sequence (14) with at least
SIE0262
2017/042276 PCT/EP2016/071184
17 two images (15, 16, 17) containing the illumination source (6) is captured, and the pulse frequency (1 1 ) is determined based on the image sequence (14).
1 1 . Method according to any one of the preceding claims,
characterized in that
the pulse frequency (1 1 ) of an illumination source (6) formed as a light emitting diode is determined.
12. Camera (3) for a motor vehicle (2) including a control unit (26) and/or a
communication device (8, 12), which is formed to perform a method according to any one of the preceding claims.
13. System (1 ) with a motor vehicle (2) and a camera (3) disposed on the motor vehicle (2) according to claim 12.
14. System (1 ) according to claim 13,
characterized in that
the system (1 ) includes a database (7) external to vehicle with pulse frequencies (1 1 ) of illumination sources (6) and/or an illumination source (6) with a
communication device (13) and pulse frequency (1 1 ) stored therein, and the motor vehicle (2) includes a communication device (8) for wireless communication with the database (7) external to vehicle and/or a communication device (12) for transmitting an information request and for receiving the stored pulse frequency (1 1 ) from the illumination source (6).
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE102015115351.3A DE102015115351A1 (en) | 2015-09-11 | 2015-09-11 | Method for operating a camera depending on a given pulse frequency of a lighting source, camera and system |
| DE102015115351.3 | 2015-09-11 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2017042276A1 true WO2017042276A1 (en) | 2017-03-16 |
Family
ID=56889078
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/EP2016/071184 Ceased WO2017042276A1 (en) | 2015-09-11 | 2016-09-08 | Method for operating a camera depending on a preset pulse frequency of an illumination source, camera and system |
Country Status (2)
| Country | Link |
|---|---|
| DE (1) | DE102015115351A1 (en) |
| WO (1) | WO2017042276A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110855895A (en) * | 2019-12-06 | 2020-02-28 | 深圳市大富科技股份有限公司 | Camera shooting control method and terminal |
| EP3496512B1 (en) * | 2017-12-06 | 2025-08-06 | Rockwell Collins, Inc. | Synchronized camera and lighting system |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102022112084A1 (en) | 2022-05-13 | 2023-11-16 | Bayerische Motoren Werke Aktiengesellschaft | Controlling a camera's shutter speed |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030193981A1 (en) * | 2001-06-05 | 2003-10-16 | Oleg Matveev | Device and method for object illumination and imaging using light pulses |
| EP2709356A2 (en) * | 2012-09-13 | 2014-03-19 | Valeo Schalter und Sensoren GmbH | Method for operating a front camera of a motor vehicle considering the light of the headlight, corresponding device and motor vehicle |
| DE102013100804A1 (en) * | 2013-01-28 | 2014-07-31 | Conti Temic Microelectronic Gmbh | Method for detecting pulsed light sources |
| US20140300759A1 (en) * | 2013-04-05 | 2014-10-09 | Google Inc. | Automatic location-based camera frame rate settings |
| GB2522799A (en) * | 2015-03-30 | 2015-08-05 | Vysionics Its Ltd | A camera system |
-
2015
- 2015-09-11 DE DE102015115351.3A patent/DE102015115351A1/en not_active Withdrawn
-
2016
- 2016-09-08 WO PCT/EP2016/071184 patent/WO2017042276A1/en not_active Ceased
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030193981A1 (en) * | 2001-06-05 | 2003-10-16 | Oleg Matveev | Device and method for object illumination and imaging using light pulses |
| EP2709356A2 (en) * | 2012-09-13 | 2014-03-19 | Valeo Schalter und Sensoren GmbH | Method for operating a front camera of a motor vehicle considering the light of the headlight, corresponding device and motor vehicle |
| DE102013100804A1 (en) * | 2013-01-28 | 2014-07-31 | Conti Temic Microelectronic Gmbh | Method for detecting pulsed light sources |
| US20140300759A1 (en) * | 2013-04-05 | 2014-10-09 | Google Inc. | Automatic location-based camera frame rate settings |
| GB2522799A (en) * | 2015-03-30 | 2015-08-05 | Vysionics Its Ltd | A camera system |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3496512B1 (en) * | 2017-12-06 | 2025-08-06 | Rockwell Collins, Inc. | Synchronized camera and lighting system |
| CN110855895A (en) * | 2019-12-06 | 2020-02-28 | 深圳市大富科技股份有限公司 | Camera shooting control method and terminal |
| CN110855895B (en) * | 2019-12-06 | 2021-06-25 | 深圳市大富科技股份有限公司 | Camera shooting control method and terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| DE102015115351A1 (en) | 2017-03-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| RU2406232C2 (en) | Method and device for locating moving object through communication using light from visible spectrum | |
| US20200344421A1 (en) | Image pickup apparatus, image pickup control method, and program | |
| JP6536984B2 (en) | Ranging imaging system, solid-state imaging device, and ranging imaging method | |
| CA2638520C (en) | Vehicle illumination system | |
| US10152886B2 (en) | Driver assistance system with traffic light alert | |
| JP6570425B2 (en) | Vehicle projection device and vehicle projection system | |
| KR101014105B1 (en) | Vehicle headlamp control device | |
| KR101950850B1 (en) | The apparatus and method of indoor positioning with indoor posioning moudule | |
| WO2014188903A1 (en) | Lighting control device | |
| US20200282921A1 (en) | Systems and methods for low light vision through pulsed lighting | |
| KR20190003409A (en) | Light system for a motor vehicle | |
| WO2017042276A1 (en) | Method for operating a camera depending on a preset pulse frequency of an illumination source, camera and system | |
| KR20190074769A (en) | Apparatus for Light Detection and Ranging | |
| US20190196499A1 (en) | System and method for providing overhead camera-based precision localization for intelligent vehicles | |
| JP2013145530A (en) | Road-vehicle communication system and vehicle position detection device | |
| JP2017215285A (en) | Satellite signal processing method and satellite signal processing apparatus | |
| CN111086451A (en) | Head-up display system, display method and automobile | |
| JP2010002225A (en) | Apparatus, system and method for measuring position by utilizing visible light communication | |
| WO2020054258A1 (en) | Information processing device, terminal device, information processing method, and information processing program | |
| WO2020075506A1 (en) | Distance measurement system, calibration method, program, and electronic device | |
| CN210591607U (en) | Warning sound system and automobile | |
| CN111645593A (en) | Warning sound system and automobile | |
| JP2012054689A (en) | Visible light data processing device, visible light communication system, visible light data processing method, and program thereof | |
| TWI608949B (en) | Automobile and aotomobile shading method | |
| US11216677B2 (en) | Signal processing apparatus, signal processing method, program, and moving body |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16763030 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 16763030 Country of ref document: EP Kind code of ref document: A1 |