DE102018125790A1 - Device for the validatable output of images - Google Patents

Abstract

An apparatus for the validatable output of images is proposed, which has a number N1 of screens for outputting images based on image data, with N1 ≥ 1, and a number N2 of camera devices, with N2 ≥ 1. Each camera device comprises a camera for providing image data based on a recording of camera images and an integration unit for outputting extended image data based on an integration of a coded information block which contains a source specification and specific for the camera includes a timestamp specific to the recording. Furthermore, the device comprises a transmission channel connected between the N1 screens and the N2 camera devices for transmitting the extended image data from the N2 camera devices to the N1 screens, and a validation unit that can be coupled to the N1 screens for validating those transmitted via the transmission channel Extended image data using the integrated information block.

Description

The present invention relates to a device for the validatable output of images from one or more cameras on one or more screens. Furthermore, the present invention relates to a vehicle with such a device for the validatable output of images from one or more cameras on one or more screens.

For example, in military vehicles such as tanks, devices for outputting images are used which have cameras arranged on the outer skin of the vehicle and at least one screen arranged in the interior of the vehicle for outputting the images recorded by the cameras. A multiplexer is coupled between the cameras and the screen, which provides the images of a selected camera from the set of coupled cameras for the screen.

It is possible that a camera arranged on the outer skin of the vehicle delivers a still image, that is to say it is frozen, and the user within the vehicle has no possibility of noticing this.

A particularly high risk arises if the camera is linked, for example, to a weapon station and the image displayed on the screen is used for shooting at sight.

Against this background, it is an object of the present invention to provide a solution for the validatable output of images.

Accordingly, a device for the validatable output of images is proposed which has a number N1 of screens for outputting images based on image data with N1 ≥ 1, and a number N2 of camera devices with N2> 1. Each camera device comprises a camera for providing image data based on a recording of camera images and an integration unit for outputting extended image data based on an integration of a coded information block which contains a source specification and specific for the camera includes a timestamp specific to the recording. Furthermore, the device comprises a between the N1 Screens and the N2 Camera-switched transmission channel for transmitting the extended image data from the N2 Camera facilities to the N1 Screens, and one with the N1 Validation unit that can be coupled to screens for validating the extended image data transmitted via the transmission channel using the integrated information block.

Advantageously, the entire path can be validated via the transmission channel by using the coded information block comprising the indication of the source and the time stamp, which is imprinted on the image data before the transmission channel and is read out after the transmission channel. The expanded image data can be validated, for example, using the information block to determine whether the correct image source is displayed on the corresponding screen. In addition, this can also detect a masking of a relevant image, for example by means of another video image or an incorrect image composition within the transmission channel, a still image, and the transmission of a cyclic image or a strongly delayed image.

The fact that the information block is impressed into the image data provided by the camera advantageously creates a security channel between the recording camera and the display screen.

The indication of the source as part of the coded information block and thus as part of certain extended image data is suitable for specifying the camera providing the image data. The source information can also be referred to as identification information or ID or source ID.
The source information is preferably generated on the basis of a hardware ID of the camera.

The time stamp indicates the point in time or the period of time when the camera took the camera images, which provides the image data.

The device can also be referred to as a vision system. In particular, a control unit is provided, which is set up to control the integration unit and the camera. The control unit is in particular part of the camera device. The control unit includes, for example, electronics, such as a microprocessor or a CPLD (CPLD; Complex Programmable Logic Device).

The camera can be designed, for example, as a video camera, as a day view camera, as a thermal imaging camera, as an infrared camera or as a photo camera. In particular, the N2 Camera devices include different types of cameras.

The screen can be designed, for example, as a flat screen arranged in a vehicle interior of a military vehicle. The screen can also be called a monitor.

According to one embodiment, the integration unit is set up to encode the To encode the information block in a region of the extended image data which is not visible to a user, in particular in a black level region of the extended image data.

According to a further embodiment, the integration unit is set up to additionally encode a hash value calculated from the image data into the encoded information block.

According to a further embodiment, the integration unit is set up to generate a QR code in such a way that it has the source information and the time stamp in coded form.

The use of a QR code as an information block advantageously allows a certain fault tolerance and thus a configurable permissible coverage rate.

According to a further embodiment, the integration unit is set up to code the generated QR code in an area of the image data which is not visible to a user, in particular in a black-level area of the extended image data. The Least Significant Bit (LSB) is preferably used.

Thus, the QR code is preferably coded in the image so that it is not visible to a user and therefore cannot disturb the user. The position of the QR code is preferably distributed randomly over a central image area, in particular in order to reduce losses in terms of image dynamics.

According to a further embodiment, the integration unit is set up to additionally encode a hash value calculated from the image data into the QR code.

The hash values calculated and integrated in the QR code can advantageously be used for a subsequent image check, for example with regard to still images or with regard to cyclic images. Such an image check can be carried out, for example, in a downstream screen monitoring device. This is detailed below.

According to a further embodiment, the respective camera device comprises a camera monitoring device, which comprises the integration unit and is connected to the camera and the transmission channel by means of a respective image transmission interface, in particular by means of a camera link. The camera monitoring device can also be referred to as a camera watchdog.

According to a further embodiment, the validation unit and the respective integration unit are time-synchronized using a common time base.

Due to the time synchronization of the integration unit and the validation units, it is possible to reliably calculate latency times during the transmission of the image data via the transmission channel from the transmitted time stamps as part of the information blocks.

According to a further embodiment, the respective screen is coupled to the transmission channel via a screen monitoring device. The screen monitoring device is in this case by means of a respective image transmission interface, in particular by means of DVI or Camera-Link, connected to the screen and to the transmission channel.

According to a further embodiment, the common time base is correlated with a time of the camera monitoring device and a time of the screen monitoring device.

According to a further embodiment, the common time base is provided by an external source.

According to a further embodiment, the device comprises a control device, which comprises the validation unit, and via a respective interface, for example via an Ethernet networking interface N1 Camera surveillance facilities is connected.

According to a further embodiment, the screen monitoring device is set up to extract the source specification and the time stamp from the extended image data transmitted via the transmission channel and the extracted source specification and the extracted time stamp via the interface to the control device transfer. This ensures the correct assignment between the display and recording and the time delay, i.e. the latency of the image data can be determined.

According to a further embodiment, the screen monitoring device is set up to perform an image check with regard to a still image supplied by the camera, or repetitive image data, in the expanded image data by means of a comparison of hash values transmitted by the expanded image data and / or depending on a fast -Fourier transform to perform.

According to a further embodiment, the transmission channel comprises a compression unit downstream of the camera monitoring devices for compressing the extended image data, an image distribution unit downstream of the compression unit, an image processing unit downstream of the image distribution unit, and N1 preprocessing units connected downstream of the image processing unit. The respective preprocessing unit is assigned to a respective screen monitoring device.

The compression unit can also be referred to as a data compression unit. The image distribution unit can also be referred to as a video distribution unit. The image processing unit can also be referred to as a video processing unit. The image processing unit can, for example, carry out a stitching process in order to combine different images from different cameras. The respective preprocessing unit can also be referred to as a crew terminal processing unit.

According to a further embodiment, the control device is set up to initiate or execute an action depending on the validation carried out by the validation unit.

According to a further embodiment, the control device is set up to block a weapon that can be coupled to the device if the validation indicates a display of an image of a wrong camera on the screen.

If, for example, the validation shows that a certain screen should output the images from a camera A but actually output the images from a camera B, the weapon that can be coupled to the device can be blocked as an action to be carried out.

According to a further embodiment, the screen monitoring device is set up to display an overlay or a black image on the screen if the validation indicates that the corresponding camera is covered.

According to a further embodiment, the control device is set up to block the weapon that can be coupled to the device if the validation indicates that a relevant image is hidden.

A relevant image can be obscured, for example, by an incorrect image composition in the image distribution unit. In such a case, too, it is advantageous to block the weapon that can be coupled to the device for safety reasons.

According to a further embodiment, the screen monitoring device is set up to mark the transmitted image data as a still image if the validation indicates a display of a still image or a display of a cyclic image or a display of a strongly delayed image. A strongly delayed image is an image that has a delay greater than a predetermined threshold.

A cyclic picture can result, for example, if reading from a memory is erroneously repeated instead of outputting current video pictures.

According to a further embodiment, the control device is set up to mark or prevent forwarding of the transmitted image data if the validation indicates a display of a still image or a display of a cyclic image or a display of a strongly delayed image.

According to a further embodiment, the control device is set up to block the weapon that can be coupled to the device if the validation indicates a display of a still picture or a display of a cyclical picture or a display of a strongly delayed picture.

According to a further embodiment, the control device is set up, depending on the validation, to provide a safe failure indicator which indicates a failure of one or more of the N2 Camera devices indicated to control.

The user thus has reliable information that a particular camera device has failed and preferably which camera has failed. This significantly increases the safety of the entire device.

According to a further embodiment, the safe failure display comprises backlighting of the screen, a dedicated display element arranged on the screen, for example at least one LED, and / or a touch film arranged on the screen.

The respective unit, for example the validation unit, can be implemented in terms of hardware and / or also in terms of software. In the case of a hardware implementation, the respective unit can be designed as a device or as part of a device, for example as a computer or as a microprocessor or FPGA. In the case of a software implementation, the respective unit as a computer program product, as a function, as a routine, as part of a program code or as an executable object.

Furthermore, a vehicle with a device as described above for the validatable output of images is proposed, the cameras of the N2 Camera devices on the outer skin of the vehicle and the N1 Screens are arranged in a room of the vehicle.

The vehicle is preferably a military vehicle. The vehicle can be a tank, a truck, a special vehicle, such as a crane, a loader or an excavator, or a ship.

Further possible implementations of the invention also include combinations of features or embodiments described above or below with reference to the exemplary embodiments that are not explicitly mentioned. The person skilled in the art will also add individual aspects as improvements or additions to the respective basic form of the invention.

• 1 zeigt ein schematisches Blockschaltbild eines ersten Ausführungsbeispiels einer Vorrichtung zur validierbaren Ausgabe von Bildern.

Further advantageous refinements and aspects of the invention are the subject of the subclaims and the exemplary embodiments of the invention described below. The invention is explained in more detail below on the basis of preferred embodiments with reference to the attached figure.

• 1 shows a schematic block diagram of a first embodiment of a device for validatable output of images.

In 1 is a schematic block diagram of a first embodiment of a device 10th shown for validatable output of images. The device 10th of the 1 includes a number N1 of screens 21 , 22 to output images based on image data BD1 , BD2 . Without restricting generality, the device has 10th of the 1 two screens 21 , 22 (N1 = 2).

The device further comprises 10th a number N2 of camera facilities 30th , 40 , with N2 ≥ 1. Without restricting generality, the device has 10th of the 1 two camera facilities 30th and 40 (N2 = 2).

Each of the camera facilities 30th , 40 includes a camera 31 , 41 to provide image data BD1 , BD2 based on a recording of camera images and a camera monitoring device 32 , 42 . The camera surveillance facility 32 , 42 can also be called a camera watchdog.

The respective camera 31 , 41 is with the respective camera monitoring device 32 , 42 via an interface, for example via Camera Link CL , connected.

The respective camera monitoring device 32 , 42 includes an integration unit. For reasons of clarity, the respective integration unit is also identified by the reference symbol 32 respectively. 42 Mistake.

The integration unit 32 , 42 is for the output of extended image data eBD1 , eBD2 based on an integration of a coded information block. The coded information block includes one for the camera 31 , 41 specific source Q and a timestamp specific to the recording T . For example, it has the extended image data eBD1 which is the output side of the camera device 30th be provided, a source Q who the camera 31 indexed, and a timestamp Z. which is the recording by the camera 31 with regard to the time of admission or the period of admission. For camera setup 40 the same applies. For example, the integration unit 32 , 42 set up to generate a QR code such that it cites the source Q and the timestamp Z. in coded form. The generated QR code is in particular in an area of the extended image data that is not visible to a user eBD1 , eBD2 coded. The invisible area of the image data eBD1 , eBD2 is in particular a black level area of the extended image data eBD1 , eBD2 .

In addition, the integration unit 32 , 42 to be set up, one from the image data BD1 , BD2 to encode the calculated hash value in the respective QR code.

Between the screens 21 , 22 and the camera facilities 30th , 40 is a transmission channel 50 switched, which for transmitting the extended image data eBD1 , eBD2 from the camera facilities 30th , 40 to the screens 21 , 22 is set up. The transmission channel 50 is preferably based on Ethernet. The characteristics of the transmission channel 50 may vary or may not be known a priori. For these reasons, the transmission channel 50 also be referred to as a black channel. The camera facilities 30th , 40 are for example via Camera-Link CL to the transmission channel 50 connected to the advanced image data eBD1 , eBD2 to the transmission channel 50 transferred to.

The respective screen 21 , 22 is via a screen monitor 71 , 72 with the transmission channel 50 coupled. The respective screen monitoring device 71 , 72 is by means of a respective digital image transmission interface, for example by means of a digital visual interface DVI , with the assigned screen 21 , 22 and with the transmission channel 50 connected. At the screen monitoring facilities 71 , 72 is also a control device 80 connected, for example via a dedicated interface, preferably an Ethernet networking interface ETH .

The control device 80 includes a validation unit 60 , which is set up over the transmission channel 50 transmitted extended image data eBD1 , eBD2 validate using the integrated information block.

The validation unit 60 and the respective integration unit 32 , 42 are preferably time-synchronized using a common time base. The common time base is, for example, with a time of the camera monitoring device 32 , 42 and a time of the screen monitor 71 , 72 correlated. Additionally or alternatively, the common time base can also be provided by an external source (not shown).

The respective screen monitoring device 71 , 72 set up to indicate the source Q and the timestamp Z. from the over the transmission channel 50 transmitted extended image data eBD1 , eBD2 to extract and the extracted source Q and the extracted timestamp Z. over the interface ETH to the control device 80 transferred to. Based on the extracted source Q and the extracted timestamp Z. can that in the control device 80 integrated validation unit 60 the transmitted, expanded image data eBD1 , eBD2 validate. The transmitted extended image data can eBDl , eBD2 also parallel to the respective screen monitoring device 71 , 72 are branched off, in particular incorrect image outputs by the respective screen monitoring device 71 , 72 to avoid.

In particular, the control device 80 set up depending on the validation unit 60 to carry out or carry out an action carried out. For example, the control device 80 be set up one with the device 10th blockable weapon to block if the validation is a display of an image of a wrong camera 31 , 41 through the screen 21 , 22 indicates.

Like the example of the 1 shows the screen 21 the extended image data eBD1 the camera setup 30th and thus the camera 31 Show. But gives that from the validation unit 60 performed validation indicates that currently not the extended image data eBD1 the camera setup 30th to the screen 21 transmitted, but incorrectly the extended image data eBD2 the camera 41 the camera setup 40 , the control device 80 block the coupled weapon.

Furthermore, the screen monitoring device 71 , 72 to be set up, an overlay or a black image on the respective screen 21 , 22 display if the validation of the validation unit 60 reveals that the corresponding camera 31 , 41 is covered. According to a further example, the control device 80 the one with the device 10th Block the linkable weapon even if the validation reveals a relevant image. As a further alternative, the screen monitoring device 71 , 72 to be set up, depending on the validation, the transmitted image data eBD1 , eBD2 to mark as a still image, for example when the validation indicates a transmission of a still image or a cyclic image or a strongly delayed image.

The respective screen monitoring device can also be used 71 , 72 to be set up an image check for one from the camera 31 , 41 delivered still image in the extended image data eBD1 , eBD2 by means of a comparison of through the extended image data eBD1 , eBD2 transmitted hash values and / or as a function of a temporal Fast Fourier Transformation (FFT).

Although the present invention has been described using exemplary embodiments, it can be modified in many ways.

Reference list

10th

contraption

21

screen

22

screen

30th

Camera setup

31

camera

32

Integration unit

40

Camera setup

41

camera

42

Integration unit

50

Transmission channel

60

Validation unit

71

Screen monitoring device

72

Screen monitoring device

80

Control device

BD1

Image data

BD2

Image data

eBD1

extended image data

eBD2

extended image data

CL

Camera link

DVI

Digital visual interface

ETH

Ethernet networking interface

Q

Sources

Z.

time stamp

Claims (21)

Device (10) for the validatable output of images, with: a number N1 of screens (21, 22) for outputting images based on image data, with N1 ≥ 1, a number N2 of camera devices (30, 40), with N2 ≥ 1, each of the camera devices (30, 40) having a camera (31, 41) for providing image data (BD1, BD2) based on a picture of camera images and an integration unit (32, 42) for outputting extended image data (eBD1, eBD2) based on an integration of a coded information block which contains a source specification (Q ) and includes a time stamp (Z) specific to the recording, a transmission channel (50) connected between the N1 screens (21, 22) and the N2 camera devices (30, 40) for transmitting the extended image data (eBD1, eBD2) from the N2 camera devices (30, 40) to the N1 Screens (21, 22), and a validation unit (60) that can be coupled to the N1 screens (21, 22) for validating the extended image data (eBD1, eBD2) transmitted via the transmission channel (50) using the integrated information block. Device after Claim 1 , characterized in that the integration unit (32, 42) is set up to encode the information block in a region of the extended image data (eBD1, eBD2) which is not visible to a user, in particular in a black-level region of the encoded image data (eBD1, eBD2). Device after Claim 1 or 2nd , characterized in that the integration unit (32, 42) is set up to additionally encode a hash value calculated from the image data (BD1, BD2) into the coded information block. Device after Claim 1 , characterized in that the integration unit (32, 42) is set up to generate a QR code in such a way that it has the source information (Q) and the time stamp (Z) in coded form. Device after Claim 4 , characterized in that the integration unit (32, 42) is set up to use the generated QR code in an area of the extended image data (eBD1, eBD2) which is not visible to a user, in particular in a black level area of the encoded image data (eBD1, eBD2). Device after Claim 4 or 5 , characterized in that the integration unit (32, 42) is set up to additionally encode a hash value calculated from the image data (BD1, BD2) into the QR code. Device according to one of the Claims 1 to 6 , characterized in that the respective camera device (30, 40) has a camera monitoring device which comprises the integration unit (32, 42) and by means of a respective image transmission interface (CL), in particular by means of a camera link , is connected to the camera (31, 41) and the transmission channel (50). Device according to one of the Claims 1 to 7 , characterized in that the respective screen (21, 22) is coupled to the transmission channel (50) via a screen monitoring device (71, 72), the screen monitoring device (71, 72) using a respective digital Image transmission interface (DVI), in particular by means of a digital visual interface, is connected to the screen (21, 22) and to the transmission channel (50). Device according to one of the Claims 1 to 8th , characterized by a control device (80) which comprises the validation unit (60) and via a respective interface (ETH), for example via an Ethernet networking interface, with the N1 screen monitoring devices (71, 72 ) connected is. Device after Claim 9 , characterized in that the Screen monitoring device (71, 72) is set up to extract the source information (Q) and the time stamp (Z) from the extended image data (eBD1, eBD2) transmitted via the transmission channel (50) and to extract the extracted source data. Information (Q) and the extracted time stamp (Z) to be transmitted to the control device (80) via the interface (ETH). Device according to one of the Claims 7 to 10th , characterized in that the screen monitoring device (71, 72) is set up to perform an image check with regard to a still image or cyclic images supplied by the camera (31, 41) in the expanded image data (eBD1, eBD2) by means of a comparison of by means of hash values transmitted using the extended image data (eBD1, eBD2) and / or as a function of a Fast Fourier transformation. Device according to one of the Claims 9 to 11 , characterized in that the control device (80) is set up to initiate or execute an action depending on the validation carried out by the validation unit (60). Device after Claim 12 , characterized in that the control device (80) is set up to block a weapon which can be coupled to the device (10) if the validation shows an image of an incorrect camera (31, 41) on the screen (21, 22 ) indicates. Device after Claim 12 or 13 , characterized in that the screen monitoring device (71, 72) is set up to display an overlay or a black image on the screen (21, 22) if the validation indicates that the corresponding camera (31, 41) is covered . Device according to one of the Claims 12 to 14 , characterized in that the control device (80) is set up to block the weapon which can be coupled to the device (10) if the validation indicates that a relevant image is hidden. Device according to one of the Claims 12 to 15 , characterized in that the screen monitoring device (71, 72) is set up to mark the transmitted image data as a still image if the validation indicates a display of a still image or a display of a cyclic image or a display of a strongly delayed image. Device according to one of the Claims 12 to 16 , characterized in that the control device (80) is set up to prevent forwarding of the transmitted extended image data (eBD1, eBD2) if the validation shows a display of a still picture or a display of a cyclic picture or a display of a strongly delayed picture indicates. Device according to one of the Claims 12 to 17th , characterized in that the control device (80) is set up to block the weapon which can be coupled to the device (10) if the validation indicates a display of a still picture or a display of a cyclical picture or a display of a strongly delayed picture. Device according to one of the Claims 12 to 18th , characterized in that the control device (80) is set up to control, depending on the validation, a safe failure indicator which indicates a failure of one or more of the N2 camera devices (30, 40). Device after Claim 19 , characterized in that the safe failure display is backlighting of the screen (21, 22), a dedicated display element arranged on the screen (21, 22), for example an LED, and / or one on the screen (21, 22 ) arranged touch foil comprises. Vehicle, in particular a military vehicle, with a device (10) for the validatable output of images according to one of the Claims 1 to 20th , wherein the N camera devices (30, 40) on an outer skin of the vehicle and the N1 screens (21, 22) are arranged in a space of the vehicle.

Images