EP3921804A1

EP3921804A1 - Calibration unit for a monitoring device, monitoring device for man-overboard monitoring and method for calibration

Info

Publication number: EP3921804A1
Application number: EP20700878.0A
Authority: EP
Inventors: Hans-Dieter Bothe; Holger Fillbrandt; Gabriele Mangiafico; Claudio Scaravati; Stefano Riboli; Paolo Mario France Terzon; Sarah Schuette
Original assignee: Robert Bosch GmbH
Current assignee: Robert Bosch GmbH
Priority date: 2019-02-06
Filing date: 2020-01-13
Publication date: 2021-12-15
Also published as: US20220191467A1; WO2020160874A1; DE102019201490A1; US11595638B2

Abstract

The invention relates to a calibration unit (2) for a monitoring device (1), wherein the monitoring device (1) is designed as man-overboard monitoring of a ship section (4), wherein the monitoring device has at least one camera (5a, 5b) for video-monitoring the ship section (4) and for providing video data, wherein the camera (5a, 5b) has at least one intrinsic calibration parameter (11) and at least one extrinsic calibration parameter (12), wherein the video data is provided to the calibration unit (2), comprising an input module (9) for a user to input one or more calibration elements (10) and comprising an evaluation module (8), wherein the evaluation module (8) is designed to determine the unknown calibration parameters (11, 12) based on the calibration elements (10), in particular their orientation and/or extension.

Description

description

Calibration device for a monitoring device,

Monitoring device for man-overboard monitoring and calibration procedures

State of the art

It becomes a calibration device for a monitoring device

suggested. The monitoring device is designed as a man-overboard monitoring of a ship section. The monitoring device has at least one camera for video monitoring of the

Ship section, the video monitoring is provided as video data. The camera has intrinsic calibration parameters and extrinsic calibration parameters. The video data are provided to the calibration device.

On ships, and in particular on passenger ships, it is a known problem that passengers can fall overboard unnoticed during the journey. Such events are referred to as man-overboard events. The chances of survival from such an event decrease progressively with the time it takes for the event to be discovered. Shipping companies are interested in being able to notice such events as quickly as possible.

In particular, there are government regulations and / or requirements of

Insurance companies that require increased monitoring and improved detection of such events. Such monitoring is carried out on cargo ships using wristbands or transponders.

With video surveillance and with others

Contactless monitoring devices are a conceivable problem that moving objects, such as spray, birds, or things thrown overboard could be incorrectly detected as a man-overboard event. A monitoring device must reduce such false detections below a certain value in order to be practical. For example, the ISO standard ISO / PAS21195 "Ships and marine technology" requires that Monitoring systems for man-overboard monitoring have a "true positive" detection rate of more than 95 percent and on average have a false alarm rate ("false positive rate") of less than a single false alarm per day per ship.

Disclosure of the invention

A calibration device for a monitoring device having the features of claim 1 is proposed. Furthermore, a

Monitoring device with the calibration device with the features of claim 11 and a method for calibration with the features of claim 15. Preferred and / or advantageous

Embodiments of the invention emerge from the dependent claims, the description and the attached figures.

It becomes a calibration device for a monitoring device

suggested. The calibration device forms, in particular, a human-machine interface for the monitoring device. By means of the

Calibration device, the monitoring device can be calibrated, in particular initially calibrated or recalibrated. The calibration device is designed, for example, as a graphical user interface for initializing, setting up and / or setting the monitoring device.

The monitoring device is designed for man-overboard monitoring of a ship section. The monitoring device is part of and / or can be integrated into a ship, in particular a passenger ship. Man-overboard monitoring by means of the monitoring device provides, for example, to distinguish whether a person and / or a test manikin (dummy) modeled on the person has gone overboard or another object. The ship section is, for example, part of a stay area of the ship, preferably a section where a person can go overboard, and in particular an area with railings or windows, but also mechanically unsecured areas, such as. B. Places where service work is carried out or where rescue boats are located. Furthermore, it is preferably provided that the ship section a

Monitoring section forms. The ship section should also ideally in particular capture part of the water surface; but this is not absolutely necessary. The monitoring device can also monitor a number of sections of the ship and a number of monitoring devices, in particular a surrounding area around the ship. For example, the monitoring device is designed to output an alarm when a man-overboard event is detected.

The monitoring device has at least one camera. The camera is preferably a color camera. In particular, it can be provided that the camera or at least one camera is designed as an infrared camera. It is particularly preferred that one camera comprises two camera units, one camera unit representing a normal video camera in the visual wavelength range (color or black-and-white camera) and the other camera unit representing an infrared camera, preferably a thermal camera (far infrared Camera), represents; Such cameras image the thermal radiation from objects (thermography). This makes it possible to monitor the ship section 24 hours a day, i.e. both in the dark using thermal image data and in daylight using color or black-and-white image data, with each camera being suitable for all-day operation with sufficient sensitivity is. In particular, the monitoring device has a plurality of cameras, the cameras being able to monitor a plurality of ship sections, the ship sections

can be arranged overlapping or non-overlapping. It is particularly preferred that the camera is laterally, for example on a

Ship's side wall, is mounted. The camera monitors the ship section using video and / or image technology. For example, an area of the ship and an outer area of the ship facing the sea and / or the sea surface are monitored by video technology. The video monitoring is used by the camera and / or cameras as video data. The

Monitoring can also be provided by the camera as metadata (man overboard event: when, at which ship position, fall trajectory in the image and in 3D, object size, etc.).

The camera has at least one intrinsic calibration parameter and at least one extrinsic calibration parameter. In particular, each camera has a plurality of intrinsic calibration parameters and a plurality on extrinsic calibration parameters. The intrinsic calibration parameters are, in particular, calibration parameters that are specified by the camera itself, in particular as a result of manufacture, which means in particular that it

Are parameters that do not depend on the location and orientation of the camera. Intrinsic calibration parameters are for example

Imaging parameters of the camera, for example the focal length of a camera. In particular, the intrinsic calibration parameters are fixed parameters, that is to say parameters which ideally do not change at all or in reality only change slightly over the lifetime and / or functional time of the camera and / or the monitoring device. For example, the intrinsic calibration parameters can be known in advance and / or initially determined during or before the installation of the monitoring device and / or calibration device and / or camera.

Extrinsic calibration parameters are understood to mean, in particular, camera parameters that are dependent on an arrangement, orientation and / or mounting of the camera. For example, describe extrinsic

Calibration parameters the alignment of the optical axis of a camera with respect to a horizontal, for example the sea surface, or a vertical, for example the ship plane defined by a ship's side, plane. The orientation can include, for example, an angle of inclination or the distance between the camera and a reference surface. Furthermore, extrinsic

Calibration parameters such as the distance from a camera to one

Describe the reference point and / or a reference plane. The extrinsic calibration parameters are assembly-dependent parameters. The extrinsic

Calibration parameters are therefore preferably determined by the installation and / or arrangement of the camera and / or can be changed by shifting, changing the alignment and / or dismantling the camera. In particular, it is possible, based on the knowledge of the intrinsic and extrinsic calibration parameters, for objects or other structures in the image, distances, expansions, speeds, accelerations,

Orientations and / or positions in the ship section and / or on the

To determine the water surface from the video data, especially in 3D spatial dimensions. The calibration device is connected to the cameras in terms of data. The video data are provided to the calibration device. In particular, the calibration device can be provided with the intrinsic calibration parameters. The calibration device can preferably form a decentralized module.

For example, the calibration device forms a computer unit or a software module.

The calibration device has an input module. The input module is designed in particular for graphical input by a user. By means of the input module, graphic areas can be displayed, drawn in and / or selected. In particular, a numeric or alphanumeric input can preferably be made by means of the input module. For example, the input module is designed as a touchscreen.

By means of the input module, a user can enter, select, define and / or draw in a calibration element, the calibration element preferably having an orientation and / or an extension.

In particular, the user can enter a plurality of calibration elements. A calibration element is understood to mean, for example, information and / or a structure in the image and / or the ship section. In particular, it is provided that the user and / or the calibration device

Has and / or has additional information about the calibration element. In particular, conclusions about calibration parameters should be made possible by means of the calibration element. Calibration elements are, for example, lines, areas, intersections, two-dimensional or three-dimensional objects. A

Calibration element has in particular an orientation and / or a

Extension and / or a distance from the camera. The extent is, for example, the distance in 3D between two points and / or a length, a width or a depth. The orientation of the calibration element is

for example, a direction in a world coordinate system and / or another reference coordinate system. An orientation can in particular also include and / or describe angles and / or orientations of calibration elements to one another. For example, a calibration element can be a perpendicular to a water surface, a ship's plane or the horizon.

Calibration elements can also be angular positions of the hull, for example the railing relative to the ship's surface and / or the Ship bottom. The calibration element can, for example, be specified and / or entered manually in the form of lines, points and / or polygons. In particular, the orientation and / or the extent can be entered in the form of numerical information by the user using the input module. For example, the user assigns lengths, angles and / or orientation numerically or alpha-numerically to the calibration element.

The calibration device has an evaluation module. The evaluation module forms, for example, a software module or a computer module. For example, the evaluation module can be implemented on the input module and / or form a common module with it. The calibration elements and / or the video data and / or a scene model are related to the evaluation module

provided. Furthermore, all are made available to the evaluation module

Information about the calibration elements. In particular, the intrinsic and extrinsic ones, which are already known in advance, are also available to the evaluation module

Calibration parameters known and / or provided. The evaluation module is designed based on the calibration elements, in particular including all associated information and / or the information known in advance

Calibration parameters, and / or the scene model to determine the still unknown calibration parameters. For example, the unknown calibration parameters are determined once when the

Monitoring device or regularly, for example too

Inspection times. In particular, the evaluation module is designed based on the intrinsic calibration parameters, for example focal length and lens distortion, as well as the calibration elements provided, the orientation, viewing direction and / or mounting arrangement, for example the distances from reference surfaces, that is in particular the water surface or the ship's plane, of the camera to determine. Calibration elements

correspond in particular to elements, structures and / or real objects in the ship section that is monitored by the camera as video data. For example, a calibration element is a visible line in the real section of the ship which has a known length and / or orientation. This line is mapped by the camera so that the evaluation module is based on the map of the line and the known length and / or

Orientation the unknown intrinsic and / or extrinsic

Can determine calibration parameters. Determining the unknown Calibration parameters through the known calibration parameters, the known calibration elements and / or the scene model are preferably based on the lens equation and / or imaging equation of the camera.

The invention is based on the idea that when monitoring a ship section with cameras for man-overboard monitoring, the cameras must be calibrated with sufficient precision in order to enable good and safe monitoring with few false alarms. By means of the

Calibration devices can be optically and / and numerically determined by a user calibration elements which are located in the ship area, an evaluation module determining the required unknown calibration parameters based on this selection. This provides a calibration device that is particularly easy to operate and that enables the monitoring device to be calibrated reliably and precisely. In particular, a large number of cameras can be used by means of the calibration device

Calibrate the monitoring system quickly and thus cost-effectively.

It is optionally provided that the extrinsic calibration parameters describe an alignment of the camera in a three-dimensional world coordinate system. The three-dimensional world coordinate system is preferably a Cartesian coordinate system. The world coordinate system is, for example, the coordinate system of the ship, the ship section and / or spanned by the sea surface and a vertical line, for example the “ship plane”. The extrinsic calibration parameters can also include an angle of inclination and a distance, in particular in the three-dimensional coordinate system and / or to the water surface. Furthermore, extrinsic calibration parameters can include, for example, a distance and an orientation to a vertical ship plane, for example to the center of the ship, and / or to a side wall .

It is particularly preferred that the intrinsic calibration parameters

Lens parameters, imaging parameters, a focal length or a

Include lens distortion of the camera. For example, the intrinsic calibration parameters are stored and / or implemented by the manufacturer in terms of data in the camera, the camera when connected to the

Monitoring device and / or with the calibration device the intrinsic Passes on and / or provides calibration parameters. The intrinsic

Calibration parameters are the parameters that are required and / or necessary to describe the optical imaging by the camera.

One embodiment of the invention provides that the input module is designed so that the user can input, set and / or select the intrinsic calibration parameters. For example, by means of the

Input module of the user and / or an installer of the

Monitoring device and / or cameras that are intrinsic

Enter calibration parameters. For example, the input module has an input mask into which the user can enter the necessary parameters, values and / or parameters. Furthermore, it can be provided that a type or model designation of the camera can be selected by means of the input module, with the type designation and / or model designation in

Input module or evaluation module a data set with the intrinsic

Calibration parameters are stored and / or can be called up.

It is particularly preferred that a calibration element is formed by at least two alignment lines. An alignment line is formed, for example, by a horizontal line on the outer side wall of the ship, for example by a section of the railing or a ship deck. As an alternative and / or in addition, an alignment line can generally be formed by a horizontal line on another structure, for example a wall of cabins, in the ship section. Furthermore, it is possible that a calibration element is formed from a horizon line, for example the water level at a great distance, or the vanishing point from the ship level at a great distance and the

Horizon line, or straight lines on the ship, the lengths and orientation of which are known, or other appropriately aligned structures are formed.

One embodiment of the invention provides that the calibration device comprises a model module which can model the view of the ship section in a more complex manner than through a single plane. In particular, the model module can be made available by the setter via the input module by the setter marking and / or spatially delimiting structures on the ship in the video image shown, for example with a polygon, and assigning them an orientation and position in 3D. This information can, for example, be taken manually or automatically from a CAD plan of the ship. In particular, the model module can be part of the evaluation module. The model module comprises a 3D model of the ship and / or a ship section. In particular, the 3D model is a model of the ship section monitored by video technology. The 3D model can form a CAD model. In particular, the 3D model includes dimensions, angles,

Orientations and / or lengths of the ship section. The evaluation module is designed to determine the unknown, intrinsic and / or extrinsic, calibration parameters based on the 3D model. For example, the evaluation module can extract orientations of lines and / or surfaces to one another from the 3D model and map them into the

Video data determine the unknown calibration parameters. For example, the evaluation module can consider the video data as an image of the 3D model with the intrinsic calibration parameters and determine the unknown calibration parameters based on this. In particular, provision can be made for the user to select, dimension and / or set a calibration element in the 3D model. This refinement is based on the consideration of providing a calibration device which enables the cameras and / or the monitoring device to be calibrated intuitively and easily.

It is optionally provided that the calibration device is a

Includes calibration control module. The calibration device also includes a display module for displaying the video data. In particular, can

Calibration control module and display module form a common module. The calibration module is designed to make one or more model calibration elements definable, selectable and / or adjustable. A

Model calibration element is, for example, a calibration element. It has a spatial reference to the 3D model, for example the base point of a vertically aligned linear calibration element is located on a visible surface of the 3D model. The model calibration element also has

in particular also a base point. For example, this can

Model calibration element can be selected, marked and / or adjusted in the 3D model.

The calibration control module is designed to create a model calibration element based on its specified reference point in the image, for example the base point, and to determine the known calibration to be checked as a mapping and / or to draw and / or draw in the video data on the display module (“overlay” display). By comparing the displayed and / or drawn in model calibration element in the video data on the display module, the user can assess whether the calibration parameters to be checked, for example the initially determined, calibration parameters are accurate enough

("Error-free") are determined. For example, the user can determine this in that the model calibration element drawn does not deviate from the corresponding structure in the video data or only deviates insignificantly. For example, the user defines a line in the model or, in particular, a door or area, this element defined in the model being converted and displayed optically in the video data. Describe the items to be tested

Calibration parameters error-free the image, the selected element is displayed in the correct position in the video data, but there was an incorrect or inaccurate determination of the calibration parameters and / or a

Decalibration, the elements are not displayed in the correct position in the video data. A calibration device that can be operated simply and intuitively is thus provided which in particular makes it possible to quickly and easily determine the correctness of calibration parameters and / or a decalibration. If inaccurate or incorrect calibration parameters are found, the calibration parameters should be determined again.

It is particularly preferred that the calibration device is a

Having change determination module. The

Change determination module is designed to change the

Calibration parameters or the 3D structures in the scene, for example through modifications, to be determined as a decalibration. Finding the

Decalibration takes place in particular on a temporal evaluation of the

Video data, in particular whether there is a temporal, long-term and persistent variation in the environment, the ship section or other parts. For example, the camera attachment may have loosened and / or the ship section may have been converted so that the extrinsic calibration parameters have changed or the 3D ship model no longer accurately reflects the 3D structure of the scene. Through an automatic image-technical evaluation of the video data over time and / or through a manual comparison with an image at the time of the calibration Parameter determination recorded image, for example by

A superimposed representation (“overlay”) of old and current image, for example an edge image), such a change can be determined. In particular, the automatically working

Change determination module be designed to report the decalibration to a user so that he can perform a new calibration.

One embodiment of the invention provides that the input module is a module for graphical input, definition and / or selection of the calibration element and / or the model calibration element. For example, the input module is provided with a touch screen or a computer mouse, with the aid of which the user can draw in the calibration element or the model calibration element or can define it by means of points or a polygon. This refinement is based on the idea of providing a calibration device that is easy to operate and does not require any complex programming languages or numerical inputs.

It is particularly preferred that the input module is designed to enable the user to dimension calibration elements. The dimensions can be numerically or alpha-numerically. In particular, it can also be provided that known calibration elements are already stored and / or can be selected with dimensions and / or additional information as a data record.

Another object of the invention is a monitoring device for man-overboard monitoring of a ship section. The

Monitoring device has at least one camera, the camera being designed to monitor a section of the ship using video technology. in the

In particular, the camera is part of the surveillance device. The

The monitoring device has the calibration device as previously described. The calibration device is connected to the camera in terms of data, the video data being provided to the calibration device. The monitoring device also has an evaluation device. The

Evaluation device is designed, for example, as a computer unit. The evaluation device is designed to calculate a kinematic variable of an object moving in the monitoring area based on the video data determine. For example, the evaluation device determines and / or the evaluation device detects a moving object and determines for it

moving object the kinematic quantity. The kinematic variable can be a speed or an acceleration, for example. Based on the kinematic variable, the evaluation device is designed to infer the presence of a man-overboard event. For example, the evaluation device is designed to determine the path and / or speed or acceleration profile of the moving object and to infer the presence of a man overboard event using known case hypotheses such as a case parabola. Furthermore, the evaluation device can preferably be designed to infer a size of the moving object based on the kinematic variable, the size being, for example, the extent and / or the length or the diameter of the object. For example, it is known that falling objects are accelerated to the center of the earth at approximately 9.81 meters per second ² , whereby a size ratio can be inferred by determining the speed of the moving object in pixels per second. Only objects that are of sufficient size are identified as man-overboard events, for example, so that false alarms, such as those caused by cleaning water, spray or cigarettes, can be ruled out.

It is particularly preferred that the evaluation device is designed to determine a starting position of the moving object based on the intrinsic calibration parameters and / or the extrinsic calibration parameters and / or the kinematic variable. After the extrinsic

Calibration parameters define the alignment and position of the camera, for example, and the intrinsic calibration parameters define the imaging equation, a starting position in three dimensions can be determined by the kinematic variable, for example by comparison with the acceleration. Based on the starting position, it can be concluded that a man-overboard event has occurred.

For example, the monitoring device provides that by means of the

Input module a hazardous area can be defined. The danger area is

for example part of the ship and / or the ship section. The danger area is characterized in particular by the fact that these areas of the Ship from which a person could go overboard.

Sections of the ship outside and / or on the ship's side wall are, for example, part of the danger area. The evaluation device can

be designed, for example, to evaluate man-overboard events as such if they have a start position in the danger zone.

Starting positions outside the hazardous area can be controlled by the

Evaluation device, for example, are discarded and are not evaluated as man-overboard events.

It is particularly preferred that the evaluation device is designed to have a starting position in the event of a person falling off board in a higher-level

To determine the ship's coordinate system, in particular to determine a number of the deck, a ship's side, a longitudinal and lateral coordinate.

In particular, the monitoring device is designed to output the starting position in the ship's coordinate system on an, in particular central, output device. This refinement is based on the consideration that the 3D starting position relative to the camera position and the mounting location of the camera are known in the superordinate ship coordinate system and the starting position in the superordinate ship coordinate system can be determined based on this.

Another object of the invention is a method for calibrating a camera of a monitoring device for man-overboard monitoring or a monitoring device for man-overboard monitoring with the camera. The procedure can be carried out by a user or a setter

Calibration elements are entered. A calibration element is an element which, for example, has a position, an orientation and an extent. In particular, the calibration element is an element or a structure that is located in the ship section and / or can be fixed. The camera has intrinsic and extrinsic calibration parameters. In the process, the unknown calibration parameters are based on the

Calibration elements and preferably on the previously known

Calibration parameters and / or the scene model determined. For this purpose, it is calculated with which values for the calibration parameters a correct

Mapping of a calibration element from the 3D world into the 2D video data can be achieved. For example, it determines how the The calibration element of reality (3D world) is mapped onto the calibration element mapped by video technology using the calibration parameters. The unknown calibration parameters can be determined through this comparison.

Further advantages, effects and configurations emerge from the attached figures and their description. Show:

FIG. La shows a section monitored by a monitoring device;

Figure lb schematically a monitoring device with a

Calibration device;

FIG. 2 shows a picture of the ship section with a calibration element;

FIG. 3 shows a further recording with an alternative calibration element;

FIG. 4 shows a picture of the ship section with defined danger areas.

Figures la and lb show the monitoring of a ship section 4 with a monitoring device 1 with a calibration device 2. The

Monitoring device 1 is designed to monitor a ship 3. A ship section 4 of the ship 3 is monitored by video using the monitoring device 1. The monitoring device 1 has two cameras 5a and 5b. The camera 5a is designed as a camera for recording images in the visual area, the camera 5b being designed as an infrared camera and being able to record and / or create recordings even in complete darkness. The monitoring device can also consist of just one of the two cameras. The cameras 5a and 5b are aimed at the ship section 4 and reproduce it with video and / or image technology. The recordings are made available to the calibration device 2 as video data. Man-overboard monitoring takes place in the ship section 4 by means of the monitoring device 1. This monitors whether a person 6 goes overboard and is in danger. To this end, the monitoring device 1 determines a moving object in the ship section 4. The moving object can be a person 6, for example. By means of the monitoring device 1 a

Differentiation whether the moving object is a person 6 or another object such as garbage or water. An alarm is only output if the moving object has been characterized as a falling person 6. Other falling or flying objects like

Cigarettes, birds or the like are not counted as a man-overboard event, so no alarm is given.

A person 6 who falls overboard describes a parabolic trajectory 19. The trajectory ends at the water surface 18 of the sea. The person 6 and also objects are accelerated towards the sea with the acceleration of gravity. Any horizontal speed components of a falling person 6 and also falling objects are in particular not or almost not accelerated. The trajectory can be described by the horizontal and vertical object positions or speed (v _x , v _y ) over time. The speed v _y represents the accelerated movement perpendicular to the sea surface, the speed v _{x being} a constant or almost constant speed parallel to the water surface. The person 6 and / or the falling object has a length which is understood as a diameter, for example. For example, the diameter and / or the length can also be determined in that a rectangle is circumscribed around the falling object, the diameter describing the diagonal of the rectangle.

The video data are provided to the evaluation device 7. The

Evaluation device 7 is part of the monitoring device 1 and

for example designed as a software module or as a computer unit. An evaluation device I 7 can in particular be connected to a camera 5a or 5b or to a plurality of cameras 5a and 5b. Based on the video data, the evaluation module determines whether the moving object is a person 6. The video data from a plurality of cameras are evaluated in a manner not linked to one another. In particular, the moving object is tracked by the evaluation device 7, for example in successive images of the video data. The evaluation device 7 is designed to determine a kinematic variable for the moving object based on the video data. The kinematic variable is, for example, a speed profile and / or acceleration values of the moving object. The evaluation device is designed based on the kinematic variable, a variable and / or an extension or the To determine the diameter of the moving object. For example, the evaluation device uses the acceleration due to gravity for this purpose. after the

Gravitational acceleration or gravitational acceleration is known in numerical terms, a size can be assigned to a pixel by comparing the pixels passing per second or the pixels per square second of the moving object. By determining the pixels along the

The size of the moving object can be deduced from the diagonal or the extent of the moving object. If the specific size of the moving object corresponds to an expected size of a person or person, an assessment is made as to whether or not it is a man overboard event.

So that the determination of the kinematic size and / or an extent of the moving object is possible, the monitoring device 1 and in particular the cameras 5a and 5b must be calibrated. The setting and / or determination of the intrinsic and extrinsic ones is used for calibration

Calibration parameters and, if necessary, a ship model.

In particular, parameters are understood as extrinsic calibration parameters which are dependent on the ship section 4 and / or on the ship 3 due to the installation, alignment and / or removal of the camera 5a or 5b. For example, an extrinsic calibration parameter is the viewing angle and / or inclination angle of the camera 5a, 5b with respect to a horizontal and / or the water surface. Intrinsic calibration parameters are understood to be parameters of the camera 5a, 5b which are particularly dependent on the imaging and / or imaging ratio of the cameras 5a, 5b. For example, intrinsic calibration parameters are a lens distortion, a focal length. The intrinsic calibration parameters can in particular be set and / or established numerically. These can be a

Product data sheet to be taken from the camera 5a, 5b. The intrinsic

Calibration parameters are typically independent of assembly

(Exception: cameras with varifocal optics) and therefore constant. The extrinsic calibration parameters, on the other hand, depend on the installation of the camera and can therefore vary over time and must in particular be established and / or determined after the cameras have been installed. For this purpose, the monitoring device 1 comprises the calibration device 2. The calibration device 2 has an evaluation module 8 and an input module 9. The input module 9 is connected to the evaluation module 8 in terms of data. The evaluation module 8 is designed so that a user can enter data graphically. For example, the input module 9 has for this purpose a display, for example a screen, on which a model of the ship 3, of the ship section 4 or the video data are displayed. The user can select calibration elements 10 by means of the input module 9.

For example, the user draws points and / or a line in the video data for this purpose. A calibration element 10 is a geometric object which has a position, length and orientation in the image, for example given by the start and end point of a line, and also has an orientation and / or length in the 3D world, for example perpendicular to

Horizontal. Furthermore, the user can use the input module 9 to assign dimensions to the calibration element 10, for example the length of a line in the 3-D world.

The video data are provided to the evaluation module 8. The intrinsic calibration parameters 11 are also provided to the evaluation module 8. These can, for example, have been sent and / or transmitted by the camera 5a, 5b. Alternatively, the intrinsic calibration parameters 11 can be transferred to the evaluation module 8 by input by the user on the input module 9

be provided. The evaluation module 8 is designed based on the intrinsic calibration parameters 11, the calibration element 10 and the

Video data to determine the extrinsic calibration parameters 12.

The calibration element 10 is structural information in the video data. For example, the calibration element 10 is designed as an alignment line, as the horizon line or a fixed line in the video data. The calibration elements 11 can also encompass known angles on the ship 3 and / or in the ship section 4. For example, known angles are that one object is perpendicular to another. In particular, it can

Evaluation module 8 comprise a ship model 13. The ship model 13 is designed, for example, as a 3D model. For example, the calibration element 10 can also be selected in the displayed 3D model. The evaluation module 8 is now designed based on the information from Calibration element 10, such as position, length and / or orientation and the comparison of how this calibration element appears in the video data to determine the extrinsic calibration parameters 12 such as the orientation and / or inclination of the view of the camera 5a, 5b on the ship section 4. The determined extrinsic calibration parameters 12 are provided in terms of data, in particular to the evaluation module 8.

Figure 2 shows schematically an image and / or an image of the

Section 4 in the video data. The ship section 4 and / or its image shows the ship 3 recorded from the perspective of the camera 5a. The horizon and / or the horizon line 13, which is delimited by the sea and / or the sea surface, is also shown. As a result of the perspective recording of the camera 5a, the image has several alignment lines 24. The alignment lines 24 are set for example by horizontal lines in the 3D world on the deck of the ship and / or its side wall 14, which run towards the horizon and / or the horizon line 22. The escape lines 24 intersect with a ship's horizon 23 at the vanishing point 58. The ship 3 floats on the water, so that the height of the ship is perpendicular to the sea. A line on the ship's wall 14, for example, has been selected by the user in the model as the calibration element 10. This is perpendicular to the surface of the water, and the user can enter and / or store this information, for example, by means of the input module 9. The

Calibration element 10 in particular also has a length and / or a

Extension, the length being here, for example, two meters. The user can also access the information about the extension with the

Enter input module 9 and / or provide. The evaluation module 8 is now designed to provide all information d. H. to offset previously known calibration parameters and calibration elements 10 with one another in such a way that the unknown calibration parameters are determined. The calibration parameters can be made available to the evaluation module 7.

FIG. 3 shows a further example of a recording of the ship section 4 by the camera 5a. In the picture, the ship 3 is shown again, which again narrows towards the horizon. The alignment line is defined, for example, by a railing 15 and / or set by the user. The course of the railing 15 as an alignment line can be used to determine the orientation, position and / or rotation of the camera can be taken when recording the ship section 4. This rotation and / or orientation is provided to the evaluation module as an extrinsic calibration parameter after the analysis, for example. For example, a post 26 of known height, which is arranged on the deck 27, can be selected as the calibration element 10.

FIG. 4 shows the ship section 4 in the form of an image in the video data, recorded with the camera 5a. This image is drawn and / or displayed on the input module 9, for example. The user can define areas in this image for which a monitoring and / or evaluation of moving objects is provided if the starting point of the movement of the moving object is in this area. The areas selected in this way form danger areas 16. The danger areas 16 can be selected and / or entered, for example, in the form of a surface. For example, the user defines the corner points and / or edge points for this purpose, with a closed contour then being formed that is stored as the danger area 16. Here, a section along the railing 15 and the window openings 28 form the danger areas 16. For example, the evaluation module 8 does not interpret a moving object that has no starting point in the danger area 16 as a man overboard event. The evaluation module 8, it is possible, data and

To enable a safe evaluation to save resources. Furthermore, false alarms are also reduced by the fact that uninteresting and / or

excluded areas are excluded from the evaluation.

Claims

Expectations

1. Calibration device (2) for a monitoring device (1), the monitoring device (1) being designed as a man-overboard monitoring of a ship section (4), the monitoring device (1) having at least one camera (5a, 5b) for video technology Has monitoring of the ship section (4) and for providing video data, the camera (5a, 5b) having at least one intrinsic calibration parameter (11) and at least one extrinsic calibration parameter (12), the calibration device (2) being provided with the video data, with an input module (9) for the input of at least one calibration element (10) by a user, with an evaluation module (8), wherein the evaluation module (8) is designed based on the calibration element (10), in particular an orientation and / or an extension of the Calibration element (10), unknown

Determine calibration parameters (11, 12).

2. Calibration device (2) according to claim 1, characterized in that the extrinsic calibration parameters (11) an alignment of the camera (5a, 5b) in a three-dimensional world coordinate system, an angle of inclination to a water surface and / or a vertical ship plane (4) and / or a distance to a water surface and / or a vertical ship plane.

3. calibration device (2) according to claim 1 or 2, characterized in that the intrinsic calibration parameters (11) a focal length and / or

Include lens distortion of the camera (5a, 5b).

4. Calibration device (2) according to one of the preceding claims, characterized in that the input module (9) is designed to specify some or all of the intrinsic (11) and / or some or all of the extrinsic (12) calibration parameters by a user, to enter and / or select.

5. calibration device (2) according to one of the preceding claims, characterized in that calibration elements (10) of one or more

Alignment lines or lines of known length and known orientation are formed in 3D.

6. Calibration device (2) according to one of the preceding claims, characterized by a model module, wherein the model module has a 3D model (13) of the ship (3) and / or of the ship section (4), the evaluation module (8) being designed , based on the 3D model (13) the unknown

To determine the calibration parameters (12).

7. Calibration device (2) according to one of the preceding claims, characterized by a calibration control module and a display module for displaying the video data, with one or more of the calibration control module

Model calibration elements definable, selectable, adjustable and / or

can be positioned, the calibration control module being designed

To display and / or draw in model calibration elements based on the intrinsic calibration parameters (11) and the extrinsic calibration parameters (12) on the display module in accordance with their position on the 3D model in the video data.

8. calibration device (2) according to any one of the preceding claims, characterized by a change determination module, wherein the

Change determination module is formed, a change in the

To recognize calibration parameters (12), for example a rotation of a camera, and / or a change in the 3D surface of the scene as a decalibration, based on a temporal variation of local structures in the video data.

9. Calibration device (2) according to one of the preceding claims, characterized in that the input module (9) forms a module for graphical input, definition and / or selection of the calibration element (10).

10. Calibration device (2) according to one of the preceding claims, characterized in that the input module (9) is designed to allow a type definition, orientation and / or dimensioning of a calibration element (10) by the user.

11. Monitoring device (1) for man-overboard monitoring with a calibration device (2) according to one of the preceding claims, with a

Evaluation device (7), wherein the evaluation device (7) is designed, based on the video data, a kinematic variable of an im

To determine the monitoring area (4) of the moving object, the evaluation device (7) being designed to examine the object for the presence of a man-overboard event based on the kinetic variable.

12. Monitoring device (1) according to claim 11, characterized in that the evaluation device (7) is designed based on the intrinsic calibration parameters (11) and / or the extrinsic calibration parameters (12) and / or the kinetic variable of a starting position of the moving object to determine, the evaluation device (7) being designed to examine the object for the presence of a man-overboard event based on the starting position.

13. Monitoring device (1) according to one of claims 11 or 12, characterized in that the input module (9) is designed to define a danger area as part of the ship section, wherein the

Evaluation device (7) is designed, starting positions outside the

To discard the danger zone as a man overboard event.

14. Monitoring device (1), characterized in that the

Evaluation device (7) is designed to assign a starting position in the event of a person from on board in a higher-level ship coordinate system determine, in particular a number of the deck, a ship side, a longitudinal and lateral coordinate.

15. A method for calibrating a monitoring device (1) for man-overboard monitoring, in particular with the calibration device (2) according to any one of claims 1 to 10, wherein one or more calibration elements (10) are defined, based on video data from a camera (5a , 5b) and the one or more calibration elements (10) unknown

Calibration parameters (11, 12) are determined.