CN112154491A - Method of setting an imaging sensor, computer program product for setting an imaging sensor, sensor setting system and facility - Google Patents

Method of setting an imaging sensor, computer program product for setting an imaging sensor, sensor setting system and facility Download PDF

Info

Publication number
CN112154491A
CN112154491A CN201980035835.1A CN201980035835A CN112154491A CN 112154491 A CN112154491 A CN 112154491A CN 201980035835 A CN201980035835 A CN 201980035835A CN 112154491 A CN112154491 A CN 112154491A
Authority
CN
China
Prior art keywords
sensor
imaging sensor
parameter set
actual
imaging
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201980035835.1A
Other languages
Chinese (zh)
Inventor
A·舍恩贝格尔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Siemens Mobility GmbH
Original Assignee
Siemens Mobility GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens Mobility GmbH filed Critical Siemens Mobility GmbH
Publication of CN112154491A publication Critical patent/CN112154491A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B29/00—Checking or monitoring of signalling or alarm systems; Prevention or correction of operating errors, e.g. preventing unauthorised operation
    • G08B29/18—Prevention or correction of operating errors
    • G08B29/20—Calibration, including self-calibrating arrangements
    • G08B29/22—Provisions facilitating manual calibration, e.g. input or output provisions for testing; Holding of intermittent values to permit measurement
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source

Abstract

In order to simplify the effort and to improve the costs associated with the arrangement of imaging sensors, such as passenger counting sensors and surveillance cameras, in particular for commissioning and maintenance purposes, it is proposed to use an imaging sensor (S)BG) With the actual individual image (I-EB) or the actual video (I-VD) and the marked reference individual image (R-EB)M) Or reference video (R-VD)M) Comparing to check the set imaging sensor (S)BG) Whether properly aligned, configured, and wired, the imaging sensor is connected to the sensor identification information or connection technology portInformation and sensor-specific reference conditions relating to positioning, alignment, configuration of reference parameter sets (R-PS) and data transmission technology and electrical connections are correctly set and compared and at least one reference individual image (R-EB) or reference video (R-VD) in which the markers are respectively positioned is recorded with the imaging sensor. If not, a first error message (FM 1) is generated during a first comparison check, or a first error message (FM 1) is generated along with a corrected correct parameter set (PS 1) resulting from a parameter set comparisonK) And on the other hand a second error message (FM 2) is generated during the second comparison check.

Description

Method of setting an imaging sensor, computer program product for setting an imaging sensor, sensor setting system and facility
Technical Field
The present invention relates to a method for setting up an imaging sensor according to the preamble of patent claim 1, a computer program product for setting up an imaging sensor according to the preamble of patent claim 9, a sensor setting system according to the preamble of patent claim 17 and an arrangement according to the preamble of patent claim 25.
Background
In the setting up of imaging sensors (for example passenger counting sensors or surveillance cameras) of installations (for example vehicles for transporting passengers, in particular in rail and road traffic) or of devices for space surveillance, it is often necessary for the sensors to be set up by experts in order to ensure functionally correct positioning and alignment of the sensors (for example, where the counting sensors are functionally correctly aligned with the counting lines), to ensure correct configuration using parameter sets (for example recording by means of a video camera with the required resolution and frame rate), and to ensure operable wiring to a network or bus system. The use of such specialists is expensive in the context of the development, manufacture, commissioning and maintenance (in short: engineering) of complex technical systems, such as vehicles (trains) in a track complex.
Furthermore, in the case where multiple identical facilities are to be built (e.g., multiple identically constructed trains of the same fleet), such expert use is initially redundant, as the same setup must always be made.
In practice, it has been shown that the same arrangement of the sensors in a plurality of installations of the same construction fails over and over again. On the one hand, due to carelessness of the expert or due to insufficient execution of the setting instructions by the installer.
It has finally been shown that the sensors can be misaligned during continuous operation due to maintenance work, human damage or material fatigue of the support, or that the sensors are supplied with the wrong parameter set in the scope of an update. In this case, the corresponding sensor may no longer be able to perform its function correctly.
Up to now, this problem has been solved, in particular, by detailed method instructions regarding setup and configuration, by regular visual inspection of the installation or by regular manual analysis of the acquired image material.
In addition to the known incorrectly set situation, it is also possible to attribute to the "unreported number" of defective devices that are not noticeable in continuous operation, for example a passenger counting sensor, which, although providing an incorrect counting value, is only a non-significantly incorrect counting value, which is just noticeable in continuous operation.
Disclosure of Invention
The object on which the invention is based is to specify a method for setting an imaging sensor, a computer program product for setting an imaging sensor, a sensor setting system and a facility with which the effort for setting an imaging sensor (for example a passenger counting sensor and a surveillance camera), in particular for commissioning and maintenance purposes, is simplified and the costs resulting therefrom are improved.
This object is achieved by the features specified in the characterizing part of patent claim 1, starting from the method for setting an imaging sensor defined in the preamble of patent claim 1.
Furthermore, this object is achieved by the features specified in the characterizing part of patent claim 9, starting from a computer program product for setting an imaging sensor as defined in the preamble of patent claim 9.
This object is achieved, furthermore, by the features specified in the characterizing part of patent claim 17, starting from the sensor arrangement system defined in the preamble of patent claim 17.
The object is furthermore achieved by the features specified in the characterizing part of patent claim 25, starting from the means defined in the preamble of patent claim 25.
The invention according to the independent claims 1, 9, 17 and 25 is based on the idea of checking whether a set imaging sensor, in which markers are respectively located, is correctly aligned, configured and wired by comparing an actual individual image or an actual video of the imaging sensor with a marked reference individual image or a reference video, which are correctly set and compared with respect to sensor identification information or port information of a connection technology and with respect to a sensor-specific reference situation, which relates to the location, alignment, configuration of a reference parameter set and data transmission technology and electrical connection, and recording at least one reference individual image or reference video with the imaging sensor.
If not, a first error message is generated during a first comparison check, or a first error message and a corrected correct parameter set resulting from a parameter set comparison is generated, and on the other hand a second error message is generated during a second comparison check.
In order to be able to identify a wrong sensor alignment, a wrong set of parameters and a wrong wiring, the following procedure should be performed according to the ideas outlined above.
First, to detect a possible installation condition of the imaging sensor for a reference facility, e.g. the first vehicle (train) in a track complex of a train fleet, the correct positioning, alignment, configuration with parameters and wiring are defined by an expert.
The sensors are then set up in the reference facility according to these presets, and the correct settings are checked by an expert. The sensor is then stored with the particular installation conditions and the selected parameter set, and a plurality of reference individual images and reference videos are recorded, possibly under different light conditions and external conditions that may occur during operation, as necessary.
Finally, salient objects are marked in these reference individual images or reference videos, which distinguish the installation situation and must always appear in the same location in the reference individual images or the reference videos, for example a grab bar in a train. If there is no such object, a manual marker (e.g., a red dot) may also be placed in the facility where the imaging sensor is located.
For the next identically constructed installation, the sensors are then first set up according to the expert's specification. The method according to the invention for setting up an imaging sensor, the computer program product according to the invention for setting up an imaging sensor and/or the sensor setting system according to the invention are then used to check the settings thereof for any sensor. Here, it is first assumed that the sensors have been correctly set. The sensor may then be invoked accordingly according to the method, the computer program product and/or the sensor setting system based on the wiring or parameter set.
Then in a first step it is checked whether the sensor reports the correct actual sensor Id and/or the correct actual sensor type. This is done by first comparing with the stored actual Id and/or stored nominal type of the sensor. If the sensor does not know its actual Id or actual type, the actual port number of the correct connection technology is compared to the nominal port number.
In a second step, it is then checked whether the configured actual parameter set reported by the sensor corresponds to the required setpoint parameter set based on the installation situation and, if necessary, the sensor type. If not, a first error message is sent to a downstream commissioning/maintenance system and/or to the sensor. In parallel with this, optionally the correct corrected parameter set can also be transmitted to the sensor directly or indirectly via the commissioning/maintenance system by correspondingly introducing it into the sensor.
Then in a third step the actual individual image or the actual video provided by the sensor is compared with the reference individual image and the reference video with respect to the markers (salient objects or artificial markers) located therein. If none of these markings are in the specified position, the sensor is misaligned, miswired, or incorrectly installed. In this case, a second error message is sent to the commissioning/maintenance system and/or the sensor. Since the wrong settings are not a standard case, these errors can be corrected manually. Occasional incorrect error messages can also be corrected manually.
In an extension of the invention, the method, the computer program product and/or the sensor setting system may also be used for monitoring the setting of the sensor during continuous operation. This is relevant, for example, if modifications in the sensor arrangement (e.g. due to sensor misalignment, due to software updates) are to be expected for environmental or maintenance reasons. In this case, the reference individual image or the reference video will be recorded only for the set sensor, and will not be used for other sensors.
In a further development of the invention, the context of the facility in which the sensor is present, e.g. a vehicle (train) in a track complex, can also be taken into account when analyzing the individual images or videos, e.g. whether the door of the train is just open or closed, or is just on or off, etc.
In an additional development of the invention, a poor alignment of the imaging sensor can be compensated by the intelligent software of the sensor, i.e. the acquired image material can be converted. For example, passenger count sensors may often see a larger area than necessary for counting. In this case, the mis-alignment can be compensated for by observing the image portions shifted by the mis-alignment (provided that the mis-alignment is moderate).
In a further development of the invention, this concept can be extended in principle to all types of sensors. But thereby necessarily affecting environmental factors, if necessary. For example, it is possible to play an audio sequence in order to check the microphones and then check whether the audio sequence is correctly detected by the microphones. For example, an automatic announcement may be sent in a train and then checked whether the announcement was correctly detected. Both the announcement system and the microphone can thus be checked (for example in the call station).
By comparing the installation situation, the parameter set and the reference individual image or the reference video with the corresponding actual situation as described above, it is possible to achieve:
an error in the setting of the imaging sensor can be automatically recognized in the case of multiple uses in the same facility;
errors due to setting changes can be automatically detected during continuous operation.
Drawings
Further advantages of the invention emerge from the following description of an embodiment of the invention on the basis of the sole figure.
The figure shows a sensor arrangement system for arranging imaging sensors in a facility, such as a vehicle for transporting passengers, in particular in rail and road traffic, or a device for space surveillance.
Detailed Description
The figure shows a sensor arrangement SES for arranging imaging sensors in a facility AL, for example a vehicle FZ for transporting passengers, in particular in rail and road traffic, or a device VR Ü for spatial monitoring. According to the figure, "option a", the sensor setup system SES comprises at least one imaging sensor SBGAnd an imaging sensor SBGConnected database DBK and imaging sensor SBGAnd a control unit STE connected to the database DBK. Thus, according to "option A", the system components mentionedAlso belonging to the facility AL, the vehicle FZ or the device VR Ü for room monitoring.
Imaging sensor SBGPreferably a passenger counting sensor or a monitoring camera, with nominal sensor identification information S-SKI, for example formed by a configured nominal sensor identification S-SK and/or configured nominal sensor type data S-STD, and nominal port information S-PI of the connection technology. In this respect and in terms of sensor-specific reference conditions relating to positioning, alignment, configuration of the reference parameter set R-PS and data transmission techniques and electrical connections, the imaging sensor SBG is correctly set up.
Sensor-specific reference situations are given in the facility AL, preferably in vehicles FZ for passenger transport with passenger counting sensors, for example in vehicles FZ in rail and road traffic, or in the device VR Ü for spatial monitoring with monitoring cameras, relating to positioning, alignment, configuration of the reference parameter set R-PS, data transmission technology and electrical connection, and the imaging sensor SBGIs correctly set.
With the imaging sensor S arranged in this wayBGAt least one reference individual image R-EB or reference video R-VD, respectively, is recorded.
Each reference individual image R-EB or reference video R-VD recorded in this way is transmitted by the imaging sensor S together with the reference parameter set R-PS, the nominal sensor identification information S-SKI, S-SK, S-STD and the nominal port information S-PI of the connection technologyBGProvided to a database DBK and stored in said database.
Imaging sensor SBGIs also configured in terms of software and hardware in such a way that in the recorded reference individual images R-EB or reference videos R-VD at least one marking relating to a salient object or at least one artificial marking created for recording the reference individual images R-EB or reference videos R-VD for sensor-specific reference conditions is located and the reference individual images R-EB provided with said marking is processedMOr reference video R-VDMIs again provided to the databaseAnd the DBK is stored in the database.
To set up the imaging sensor SBGThe imaging sensor together with the database DBK forms a common functional unit with the control unit STE. For this purpose and in order to design the functional units, the control unit STE contains a computer program product CPP for setting up the imaging sensor, which has a non-volatile readable memory SP in which processor-readable control program commands for executing the set-up program module PGM are stored, and a processor PZ connected to the memory SP, which executes the control program commands for the program module PGM for setting up the imaging sensor.
The pair of imaging sensors S with the functional units formed and designed in this way is now examined as followsBGIs set.
Upon execution of the set imaging sensor SBGIn a first step of such an examination, an image R-EB of a reference individual provided with said marker is approximated as a preparationMOr reference video R-VDMAnd the reference parameter set R-PS, the rated sensor identification information S-SKI, S-SK, S-STD and the rated port information S-PI of the connection technology are loaded into the processor PZ.
Thereafter in a second step, the set imaging sensor S is examinedBGThe method comprises the following steps:
-imaging sensor SBGOr comparing the actual sensor identification information I-SKI loaded into the processor PZ, which is preferably and analogously to the nominal sensor identification information S-SKI, S-SK, S-STD, formed by the configured actual sensor identification I-SK and/or the configured actual sensor type data I-STD, with the nominal sensor identification information S-SKI, S-SK, S-STD of the connection technology from the database DBK,
-imaging sensor SBGCompares the actual parameter set I-PS loaded into the processor PZ with the reference parameter set R-PS from the database DBKIn comparison, the method has the advantages that,
-imaging sensor SBGAt least one actual individual image I-EB or actual video I-VDR loaded into the processor PZ is in respect of the respective marker compared with a respective reference individual image R-EB with the markerMOr reference video R-VDMA comparison is made.
If these comparison checks have ended, then
1) If the comparison check according to the second dash or the first and second dash does not provide consistency between the actual parameter set I-PS and the reference parameter set R-PS, a first error message FM1 is generated, or a first error message FM1 is generated together with the corrected correct parameter set PS resulting from the parameter set comparisonKAnd an
2) If the comparison check according to the third dash marks obtains the marks in the actual individual image I-EB or the actual video I-VD and the reference individual image R-EBMOr reference video R-VDMIs not located substantially at the same position in the corresponding individual image or video, a second error message FM2 is generated.
Error messages FM1, FM2 generated by the control unit STE and, if necessary, additionally generated corrected correct parameter sets PSKFor debugging and maintenance purposes is transmitted to the debugging/maintenance system IWS, to which end the debugging/maintenance system is connected to the control unit STE. Corrected correct parameter set PSKThe set imaging sensor S can be directly supplied from the control unit STE or indirectly via the commissioning/maintenance system IWSBGFor parameter set correction.
The commissioning/maintenance system IWS may now belong to the sensor setup system SES and thus to the facility AL, preferably to the vehicle FZ or the space monitoring device VR Ü, according to "option I" in the drawing, or not be a system component of the sensor setup system SES and thus not a component of the facility AL, the vehicle FZ or the space monitoring device VR Ü, according to "option II" in the drawing.
The difference between the actual parameter set I-PS and the reference parameter set R-PS is signaled by means of a first error message FM1, while the second error isThe message FM2 is used to signal and display the imaging sensor SBGError setup/error alignment.
Imaging sensor SBGThe incorrect setting/incorrect alignment of the sensors can occur, for example, as a result of a misalignment of the sensors, an incorrect data transmission technology and electrical connection of the sensors (for example, as a result of incorrect wiring or installation), a faulty alignment of the sensors, or a software update that has not yet been performed.
Preferably, the mis-set/mis-alignment due to poor alignment of the sensor may be loaded to the imaging sensor SBGIn or pre-mounted to the imaging sensor SBGIs compensated by the intelligent software in that the conversion is performed by the imaging sensor SBGImage material is provided, the smart software can be configured, for example, as "App", or-as an imaging sensor S-in a passenger counting sensor or a monitoring cameraBGIn which case they typically cover a larger area than is required for counting or monitoring-compensated by observing the image portions shifted by the wrong settings/mis-alignments.
Further, for the above reason, the imaging sensor S can be manually corrected at all timesBGError setup/error alignment.
Additionally, the control unit STE may also be connected to a storage means SPE for storing information specific to the context of the installation. The control unit STE forms a further common functional unit together with the storage SPE and is designed as an imaging sensor S arranged for checking the facilities AL, FZ, VR ÜBGConsider a facility context (particularly a facility type, such as a rail vehicle of the structural series ICE 3), a component or subsystem installed in the facility, a facility status (e.g., operational mode), a status of a component (e.g., opening of a door).
In terms of facility membership, the same applies to the storage SPE as applies to the debugging/maintenance system IWS. Thus, the storage device SPE can also belong to the sensor arrangement system SES and thus to the facility AL, preferably to the vehicle FZ or to the space monitoring system VR Ü, again according to "option I" in the drawing, or the storage device SPE is not a system component of the sensor arrangement system SES and thus not a component of the facility AL, the vehicle FZ or the space monitoring system VR Ü, according to "option II" in the drawing.
In addition to the sensor arrangement system SES described above according to "option a" in the installation AL according to "option a", the vehicle FZ or the device VR Ü for spatial monitoring, it is also possible on the basis of the drawings to:
-including at least one imaging sensor S in a sensor setup system SES according to "option BBGAnd a control unit STE, which thus belong to the facility AL, the vehicle FZ or the device for space monitoring VR Ü according to "option B",
the computer program product CPP of the control unit STE only is included in the sensor setting system SES according to "option C", and only the at least one imaging sensor SBGBelonging to the facility AL according to "option C", to the vehicle FZ or to the device VR Ü for space monitoring.
In "option A" and "option B", the imaging sensor S is setBGThe software-implemented check is carried out in the facility AL, the vehicle FZ or the device VR Ü for spatial monitoring, while the imaging sensor S provided in "option C" is usedBGThe software-implemented check is carried out outside the facility AL, the vehicle FZ or the device VR Ü for spatial monitoring, for example in the cloud in which the computer program product CPP is installed or corresponding software is running.

Claims (25)

1. Method for setting up an imaging sensor, wherein:
a) at least one imaging sensor (S)BG) At least one reference individual image (R-EB) or reference video (R-VD) is recorded in each case, the imaging sensor being, for example, a passenger counting sensor or a surveillance camera, having nominal sensor identification information (S-SKI), in particular formed from a configured nominal sensor identification (S-SK) and/or configured nominal sensor type data (S-STD), and nominal port information (S-PI) of the connection technologyAre correctly set in terms of sensor-specific reference conditions relating to positioning, alignment, configuration of reference parameter sets (R-PS) and data transmission techniques and electrical connections,
b) storing the recorded reference individual image (R-EB) or reference video (R-VD), the reference parameter set (R-PS), the nominal sensor identification information (S-SKI, S-SK, S-STD) and nominal port information (S-PI) of the connection technology,
it is characterized in that the preparation method is characterized in that,
c) locating in the recorded reference individual images (R-EB) or reference videos (R-VD) at least one marker relating to a salient object or at least one artificial marker created for recording the reference individual images (R-EB) or reference videos (R-VD) for a sensor-specific reference situation, and storing the reference individual images (R-EB) equipped with the markerM) Or reference video (R-VD)M），
d) Checking the set imaging sensor (S)BG) In a manner that
dl) coupling the imaging sensor (S)BG) Or comparing actual sensor identification information (I-SKI) of the connection technology with the nominal sensor identification information (S-SKI, S-SK, S-STD) or actual port information (I-PI) of the connection technology with the nominal port information (S-PI) of the connection technology, the actual sensor identification information I-SKI being formed in particular by the configured actual sensor identification (I-SK) and/or the configured actual sensor type data (I-STD),
d2) the imaging sensor (S)BG) Is compared with the reference parameter set (R-PS),
d3) the imaging sensor (S)BG) With respect to the respective marker, and with respect to the respective reference individual image (R-EB) having said marker, at least one actual individual image (I-EB) or actual video (I-VD)M) Or reference video (R-VD)M) The comparison is carried out in such a way that,
e) if the comparison check according to feature d 2) or according to features d 1) and d 2) does not provide consistency between the actual parameter set (I-PS) and the reference parameter set (R-PS), a first error message (FM 1) is generated or a first error message (FM 1) is generated together with the corrected correct Parameter Set (PSK) resulting from the parameter set comparison is generated,
f) if the comparison according to the feature d 3) checks that the markers in the actual individual image (I-EB) or in the actual video (I-VD) and the reference individual image (R-EB) are presentM) Or reference video (R-VD)M) Is not located substantially at the same position in the corresponding individual image or video, a second error message (FM 2) is generated.
2. The method of claim 1,
the method is used for debugging and maintenance purposes and provides error messages (FM 1, FM 2) and, if necessary, correct Parameter Sets (PS)K) To a commissioning/maintenance system (IWS) in which a set-up imaging sensor (S) is activatedBG) Applying the corrected correct Parameter Set (PS)K) By importing the parameter set into the sensor.
3. The method according to claim 1 or 2,
signaling (S) the imaging sensor with the second error message (FM 2)BG) Error setup/error alignment.
4. The method of claim 3,
manually correcting the imaging sensor (S)BG) Error setup/error alignment.
5. The method of claim 3,
the imaging Sensor (SB)G) Due to variations in positioning, e.g. due to said sensingMisalignment of the device, incorrect data transmission technology and electrical connection of the sensor, for example, occurs as a result of incorrect wiring or mounting, incorrect alignment of the sensor or a software update that has not yet been performed.
6. The method of claim 5,
the imaging sensor (S) due to poor alignment of the sensorBG) Is passed through the imaging sensor (S)BG) By switching the imaging sensor (S)BG) Providing image material, or using passenger counting sensor or monitoring camera as imaging sensor (S)BG) In this case, the passenger counting sensor or the monitoring camera usually covers an area larger than the area required for counting or monitoring, compensated by observing the image portion shifted by the wrong setting/wrong alignment.
7. The method according to any one of claims 1 to 6,
the sensor-specific reference situation is specified in the installation (AL), in particular in a vehicle (FZ) for passenger transport with a passenger counting sensor, for example in a vehicle (FZ) in rail and road traffic, or in a device (VR Ü) for spatial monitoring with a monitoring camera, relating to the positioning, alignment, configuration of the reference parameter set (R-PS) and data transmission technology and electrical connection and the imaging sensor (S)BG) Is correctly set.
8. The method of claim 7,
for checking imaging sensors (S) arranged in a facility (AL, FZ, VR Ü)BG) Taking into account the context of the installation, in particular the type of installation, e.g. rail vehicle of the structural series ICE 3, a component or subsystem installed in said installation (AL, FZ, VR Ü), an installationStatus, e.g. operating mode, status of the component, e.g. opening of the door.
9. Computer Program Product (CPP) for setting up an imaging sensor (SES according to "option C"), having a non-volatile readable memory (SP) in which processor-readable control program commands of a program module (PGM) for executing the setting are stored, and having a Processor (PZ) connected to the memory (SP) which executes the control program commands of the program module (PGM) for setting up the imaging sensor,
it is characterized in that the preparation method is characterized in that,
a) for loading image material into the Processor (PZ)
al) by at least one imaging sensor (S)BG) Recording at least one reference individual image (R-EB) or reference video (R-VD), respectively, the imaging sensor, for example a passenger counting sensor or a surveillance camera, having nominal sensor identification information (S-SKI) and nominal port information (S-PI) of the connection technology, in particular formed by a configured nominal sensor identification (S-SK) and/or a configured nominal sensor type data (S-STD), the imaging sensor being correctly set with regard to sensor-specific reference conditions relating to positioning, alignment, configuration of a reference parameter set (R-PS) and data transmission technology and electrical connection,
a2) storing the recorded reference individual image (R-EB) or reference video (R-VD), the reference parameter set (R-PS), the nominal sensor identification information (S-SKI, S-SK, S-STD) and nominal port information (S-PI) of the connection technology,
a3) locating in the recorded reference individual image (R-EB) or reference video (R-VD) at least one marker relating to a salient object or at least one artificial marker created for recording the reference individual image (R-EB) or reference video (R-VD) for a sensor-specific reference situationMarking and storing images (R-EB) of reference individuals provided with said markingM) Or reference video (R-VD)M），
b) In order to perform the setting of the imaging sensor (S)BG) Will be provided with said marked reference individual image (R-EB)M) Or reference video (R-VD)M) The reference parameter set (R-PS), the nominal sensor identification information (S-SKI, S-SK, S-STD) and nominal port information (S-PI) of the connection technology are loaded into the Processor (PZ),
c) the Processor (PZ) and the program module (PGM) are designed to execute a set-up of the imaging sensor (S) using the reference individual image (R-EB) or reference video (R-VD), the reference parameter set (R-PS) and the target sensor identification information (S-SKI, S-SK, S-STD)BG) Is inspected such that
c1) The imaging sensor (S)BG) Or comparing actual sensor identification information (I-SKI) of the connection technology with the nominal sensor identification information (S-SKI, S-SK, S-STD) or actual port information (I-PI) of the connection technology with the nominal port information (S-PI) of the connection technology, the actual sensor identification information I-SKI being formed in particular by the configured actual sensor identification (I-SK) and/or the configured actual sensor type data (I-STD),
c2) the imaging sensor (S)BG) Is loaded into the Processor (PZ) is compared with the reference parameter set (R-PS),
c3) the imaging sensor (S)BG) At least one actual individual image (I-EB) or actual video (I-VD) loaded into said Processor (PZ) is compared in respect of a respective marker with a respective reference individual image (R-EB) having said markerM) Or reference video (R-VD)M) The comparison is carried out in such a way that,
d) if a comparison check according to feature c 2) or according to features c 1) and c 2) does not provide consistency between the actual parameter set (I-PS) and the reference parameter set (R-PS), a first error message (FM 1) is generated or a first error message (FM 1) is generated together with the corrected correct Parameter Set (PSK) resulting from the parameter set comparison is generated,
e) if the comparison according to feature c 3) checks that the markers in the actual individual image (I-EB) or actual video (I-VD) and the reference individual image (R-EB) are presentM) Or reference video (R-VD)M) Is not located substantially at the same position in the corresponding individual image or video, a second error message (FM 2) is generated.
10. The Computer Program Product (CPP) of claim 9,
the Processor (PZ) and the program modules (PGM) are designed to send error messages (FM 1, FM 2) and, if appropriate, correct Parameter Sets (PS) for debugging and maintenance purposesK) To a commissioning/maintenance system (IWS), wherein said corrected correct Parameter Set (PS) is passed on by said Processor (PZ) or commissioning/maintenance system (IWS)K) Importing the set of parameters into the sensor and transferring the set of parameters to a set imaging sensor (S)BG）。
11. The Computer Program Product (CPP) according to claim 9 or 10,
signaling (S) the imaging sensor with the second error message (FM 2)BG) Error setup/error alignment.
12. The Computer Program Product (CPP) of claim 11,
manually correcting the imaging sensor (S)BG) Error setup/error alignment.
13. The Computer Program Product (CPP) of claim 11,
the image sensorSensors (SB)G) Are due to variations in positioning, for example due to misalignment of the sensors, incorrect data transmission technology and electrical connections of the sensors, for example due to incorrect wiring or mounting, poor alignment of the sensors or a software update that has not yet been performed.
14. The Computer Program Product (CPP) of claim 13,
the imaging sensor (S) due to poor alignment of the sensorBG) Is passed through the imaging sensor (S)BG) By switching the imaging sensor (S)BG) Providing image material, or using passenger counting sensor or monitoring camera as imaging sensor (S)BG) In this case, the passenger counting sensor or the monitoring camera usually covers an area larger than the area required for counting or monitoring, compensated by observing the image portion shifted by the wrong setting/wrong alignment.
15. The Computer Program Product (CPP) according to any one of claims 9 to 14,
the sensor-specific reference situation is specified in the installation (AL), in particular in a vehicle (FZ) for passenger transport with a passenger counting sensor, for example in a vehicle (FZ) in rail and road traffic, or in a device (VR Ü) for spatial monitoring with a monitoring camera, relating to positioning, alignment, configuration of the reference parameter set (R-PS), data transmission technology and electrical connection, and the imaging sensor (S)BG) Is correctly set.
16. The Computer Program Product (CPP) of claim 15,
the Processor (PZ) and the program module (PGM) are configured,for checking imaging sensors (S) arranged in a facility (AL, FZ, VR Ü)BG) The facility context, in particular the facility type, such as a rail vehicle of the structural series ICE 3, a component or subsystem installed in the facility (AL, FZ, VR Ü), the facility status, such as the operating mode, the status of the component, such as the opening of a door, is taken into account.
17. Sensor setting system (SES), it
a) Comprising at least one imaging sensor (S)BG) Such as passenger counting sensors or surveillance cameras, having nominal sensor identification information (S-SKI) formed in particular by a configured nominal sensor identification (S-SK) and/or configured nominal sensor type data (S-STD), and nominal port information (S-PI) of the connection technology, the at least one imaging sensor being correctly set with respect to a sensor-specific reference situation involving positioning, alignment, configuration of a reference parameter set (R-PS) and data transmission technology and electrical connections, recording at least one reference individual image (R-EB) or reference video (R-VD), respectively,
b) comprising and said imaging sensor (S)BG) A connected Database (DBK) in which the recorded reference individual images (R-EB) or reference videos (R-VD), the reference parameter set (R-PS), the nominal sensor identification information (S-SKI, S-SK, S-STD) and nominal port information (S-PI) of the connection technology are stored,
c) an imaging sensor (S) connected to the Database (DBK)BG) Is designed to locate in the recorded reference individual images (R-EB) or reference videos (R-VD) at least one marking relating to a salient object or at least one artificial marking created for recording the reference individual images (R-EB) or reference videos (R-VD) for a sensor-specific reference situation, and to provide the marked reference individual images (R-EB)M) Or reference video (R-VD)M) Is stored in the Database (DBK)，
It is characterized in that
d) A control unit (STE) comprising a Computer Program Product (CPP) for setting an imaging sensor, having a non-volatile readable memory (SP) in which processor-readable control program commands are stored for executing a program module (PGM) of the setting and a Processor (PZ) connected to the memory (SP), the processor executing the control program commands of the program module (PGM) for setting the imaging sensor, and the control unit and the imaging sensor (S)BG) The Database (DBK) is connected to and forms a common functional unit with the Database (DBK), the control unit is designed to,
dl) in order to perform a set imaging sensor (S)BG) Will be provided with said marked reference individual image (R-EB)M) Or reference video (R-VD)M) The reference parameter set (R-PS), the nominal sensor identification information (S-SKI, S-SK, S-STD) and nominal port information (S-PI) of the connection technology are loaded into the Processor (PZ),
d2) performing the imaging sensor (S) to the setBG) By inspection of
d21) The imaging sensor (S)BG) Or comparing actual sensor identification information (I-SKI) loaded into the Processor (PZ) with the nominal sensor identification information (S-SKI, S-SK, S-STD) or comparing actual port information (I-PI) of the connection technology loaded into the Processor (PZ) with nominal port information (S-PI) of the connection technology, the actual sensor identification information I-SKI being formed in particular by the configured actual sensor identification (I-SK) and/or the configured actual sensor type data (I-STD),
d22) the imaging sensor (S)BG) Is loaded into the Processor (PZ) is compared with the reference parameter set (R-PS),
d23) The imaging sensor (S)BG) At least one actual individual image (I-EB) or actual video (I-VD) loaded into said Processor (PZ) is compared in respect of a respective marker with a respective reference individual image (R-EB) having said markerM) Or reference video (R-VD)M) The comparison is carried out in such a way that,
d3) if the comparison check according to feature d 22) or according to features d 21) and d 22) does not provide consistency between the actual parameter set (I-PS) and the reference parameter set (R-PS), a first error message (FM 1) is generated or a first error message (FM 1) is generated together with the corrected correct Parameter Set (PSK) resulting from the parameter set comparison is generated,
d4) if the comparison according to the feature d 23) checks that the markers in the actual individual image (I-EB) or in the actual video (I-VD) and the reference individual image (R-EB) are presentM) Or reference video (R-VD)M) Is not located substantially at the same position in the corresponding individual image or video, a second error message (FM 2) is generated.
18. The sensor setup system (SES) of claim 17,
the control unit (STE) is connected for debugging and maintenance purposes to a debugging/maintenance system (IWS) ("option I"; "option II"), and transmits error messages (FM 1, FM 2) and, if necessary, corrected correct Parameter Sets (PS) to the debugging/maintenance system (IWS)K) Wherein said corrected correct Parameter Set (PS) is passed on by said control unit (STE) or said commissioning/maintenance system (IWS)K) Importing the sensor to transfer the parameter set to a set imaging sensor (S)BG）。
19. The sensor setup system (SES) according to claim 17 or 18,
signaling (S) the imaging sensor with the second error message (FM 2)BG) Is mistakenly setPut/mis-align.
20. The sensor setup system (SES) of claim 19,
manually correcting the imaging sensor (S)BG) Error setup/error alignment.
21. The sensor setup system (SES) of claim 19,
the imaging Sensor (SB)G) Are due to variations in positioning, for example due to misalignment of the sensors, incorrect data transmission technology and electrical connections of the sensors, for example due to incorrect wiring or mounting, poor alignment of the sensors or a software update that has not yet been performed.
22. The sensor setup system (SES) of claim 21, characterized in that,
the imaging sensor (S) due to poor alignment of the sensorBG) Is passed through the imaging sensor (S)BG) By switching the imaging sensor (S)BG) Providing image material, or using passenger counting sensor or monitoring camera as imaging sensor (S)BG) In this case, the passenger counting sensor or the monitoring camera usually covers an area larger than the area required for counting or monitoring, compensated by observing the image portion shifted by the wrong setting/wrong alignment.
23. The sensor setup system (SES) according to one of the claims 17 to 22,
the sensor-specific reference situation is specified in an installation (AL), in particular in a vehicle (FZ) for passenger transport with a passenger counting sensor, for example in a vehicle (FZ) in rail and road traffic, or with a surveillance cameraGiven in the device for spatial monitoring (VR Ü), the sensor-specific reference conditions relate to positioning, alignment, configuration of the reference parameter set (R-PS), data transmission techniques and electrical connections, and the imaging sensor (S)BG) Is correctly set.
24. The sensor setup system (SES) of claim 23,
the control unit (STE) which is connected to a storage device (SPE) for storing information specific to the installation context ("option I"; "option II") and forms a further common functional unit with the storage device (SPE) is designed such that,
for checking imaging sensors (S) arranged in a facility (AL, FZ, VR Ü)BG) The facility context, in particular the facility type, such as a rail vehicle of the structural series ICE 3, a component or subsystem installed in the facility (AL, FZ, VR Ü), the facility status, such as the operating mode, the status of the component, such as the opening of a door, is taken into account.
25. Installation (AL), in particular a vehicle (FZ) for passenger transport, for example in rail and road traffic, or a device (VR Ü) for spatial monitoring,
integrating the sensor setup system (SES) according to any of claims 17 to 24 into the installation (AL, FZ, VR Ü) ("option a") or integrating the control unit (STE) and at least one imaging Sensor (SBG) of the sensor setup system (SES) according to any of claims 17 to 24 into the installation (AL, FZ, VR Ü) ("option B").
CN201980035835.1A 2018-05-29 2019-05-08 Method of setting an imaging sensor, computer program product for setting an imaging sensor, sensor setting system and facility Pending CN112154491A (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
DE102018208515.3 2018-05-29
DE102018208515.3A DE102018208515A1 (en) 2018-05-29 2018-05-29 Method for setting up imaging sensors, computer program product for setting up imaging sensors, sensor device system and installation
PCT/EP2019/061859 WO2019228770A1 (en) 2018-05-29 2019-05-08 Method for setting up imaging sensors, computer program product for setting up imaging sensors, sensor setup system and facility

Publications (1)

Publication Number Publication Date
CN112154491A true CN112154491A (en) 2020-12-29

Family

ID=66685562

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201980035835.1A Pending CN112154491A (en) 2018-05-29 2019-05-08 Method of setting an imaging sensor, computer program product for setting an imaging sensor, sensor setting system and facility

Country Status (4)

Country Link
EP (1) EP3776507A1 (en)
CN (1) CN112154491A (en)
DE (1) DE102018208515A1 (en)
WO (1) WO2019228770A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102022205398A1 (en) * 2022-05-30 2023-11-30 Siemens Mobility GmbH Passenger counting system and monitoring procedures
DE102022206624A1 (en) * 2022-06-29 2024-01-04 Siemens Mobility GmbH Passenger counting system

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5850254A (en) * 1994-07-05 1998-12-15 Hitachi, Ltd. Imaging system for a vehicle which compares a reference image which includes a mark which is fixed to said vehicle to subsequent images
EP0984412A2 (en) * 1998-09-02 2000-03-08 Geutebrück Gmbh & Co. Kg Video image surveillance system
US20090303324A1 (en) * 2006-03-29 2009-12-10 Curtin University Of Technology Testing surveillance camera installations
EP2164232A1 (en) * 2008-09-10 2010-03-17 Axis AB Network connector device
CN103253193A (en) * 2013-04-23 2013-08-21 上海纵目科技有限公司 Method and system of calibration of panoramic parking based on touch screen operation
CN103595957A (en) * 2013-11-04 2014-02-19 浙江宇视科技有限公司 Method and device for adjusting work pattern of network interface of monitor terminal
DE102013002375A1 (en) * 2013-02-09 2014-08-14 GM Global Technology Operations LLC (n. d. Gesetzen des Staates Delaware) Method for calibrating camera of motor car in parking aid, involves detecting reference object in image using camera, and processing image, in order to recognize parameter stored in reference pattern of camera
US20140267751A1 (en) * 2013-03-15 2014-09-18 Canon Kabushiki Kaisha Information processing apparatus, information processing method, camera system, control method for camera system, and storage medium
CN104506857A (en) * 2015-01-15 2015-04-08 苏州阔地网络科技有限公司 Camera position deviation detection method and device
CN107273327A (en) * 2017-05-11 2017-10-20 建荣半导体（深圳）有限公司 Variable bit rate serial communication method, device, communication chip, storage device and system
US9928594B2 (en) * 2014-07-11 2018-03-27 Agt International Gmbh Automatic spatial calibration of camera network

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016154321A1 (en) * 2015-03-24 2016-09-29 Carrier Corporation Floor-plan based learning and registration of distributed devices

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5850254A (en) * 1994-07-05 1998-12-15 Hitachi, Ltd. Imaging system for a vehicle which compares a reference image which includes a mark which is fixed to said vehicle to subsequent images
EP0984412A2 (en) * 1998-09-02 2000-03-08 Geutebrück Gmbh & Co. Kg Video image surveillance system
US20090303324A1 (en) * 2006-03-29 2009-12-10 Curtin University Of Technology Testing surveillance camera installations
EP2164232A1 (en) * 2008-09-10 2010-03-17 Axis AB Network connector device
DE102013002375A1 (en) * 2013-02-09 2014-08-14 GM Global Technology Operations LLC (n. d. Gesetzen des Staates Delaware) Method for calibrating camera of motor car in parking aid, involves detecting reference object in image using camera, and processing image, in order to recognize parameter stored in reference pattern of camera
US20140267751A1 (en) * 2013-03-15 2014-09-18 Canon Kabushiki Kaisha Information processing apparatus, information processing method, camera system, control method for camera system, and storage medium
CN103253193A (en) * 2013-04-23 2013-08-21 上海纵目科技有限公司 Method and system of calibration of panoramic parking based on touch screen operation
CN103595957A (en) * 2013-11-04 2014-02-19 浙江宇视科技有限公司 Method and device for adjusting work pattern of network interface of monitor terminal
US9928594B2 (en) * 2014-07-11 2018-03-27 Agt International Gmbh Automatic spatial calibration of camera network
CN104506857A (en) * 2015-01-15 2015-04-08 苏州阔地网络科技有限公司 Camera position deviation detection method and device
CN107273327A (en) * 2017-05-11 2017-10-20 建荣半导体（深圳）有限公司 Variable bit rate serial communication method, device, communication chip, storage device and system

Also Published As

Publication number Publication date
DE102018208515A1 (en) 2019-12-05
WO2019228770A1 (en) 2019-12-05
EP3776507A1 (en) 2021-02-17

Similar Documents

Publication Publication Date Title
CN105607623B (en) A kind of auto production line off-line test method
CN107808430B (en) Computer readable storage medium, fault detection method and device
US8560160B2 (en) Adaptive central maintenance system and method for planning maintenance operation for systems
US6886472B2 (en) Method and system for autonomously resolving a failure
US20160007018A1 (en) Failure detection apparatus and failure detection program
CN108566407B (en) Method for establishing communication connection with tire pressure monitoring system, device and electronic equipment thereof
CN108398932B (en) Automatic driving vehicle detection system and method
CN107733942A (en) A kind of detection method of car-mounted terminal, apparatus and system
JP2005048770A (en) Method of utilizing model-based intelligent agent for diagnosing failure for separation
CN112154491A (en) Method of setting an imaging sensor, computer program product for setting an imaging sensor, sensor setting system and facility
US11442095B2 (en) Cable harness test system and test method for checking cable harnesses
CN109901554B (en) Upper computer execution method based on UDS diagnosis
US9043044B2 (en) System and method for communicating data in a consist
CN108599989B (en) MVB bus detection method and device
JP2010206697A (en) Onboard communication network system and malfunction diagnostic method of the same
US20180017417A1 (en) System and method for identifying and predicting faults in sensors of locomotives
US11526976B2 (en) Using augmented reality to assist in device installation
JP6543877B2 (en) Communication area definition method, charge collection system and program
CN207571783U (en) A kind of LNG filling machines fault diagnosis removal system
RU2772235C1 (en) Method for tuning visualisation sensors, computer software product for tuning visualisation sensors, sensor tuning system, and unit
CN115018759A (en) Automobile part assembly mistake-proofing system and method
KR102179597B1 (en) Apparatus for Diagnosis Based on Automatic Process Recognition and Driving Method Thereof
US8078429B2 (en) Diagnosis agent for remote plant diagnosis
KR102242227B1 (en) System and method for providing vehicle diagnosis information using vehicle gateway device
KR100644226B1 (en) Automatic train telemetering testing system and method using network of cbtc

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination