CN115719383A

CN115719383A - Gun and ball calibration data acquisition method, gun and ball calibration method and device and electronic equipment

Info

Publication number: CN115719383A
Application number: CN202210897475.XA
Authority: CN
Inventors: 黄池军
Original assignee: Hangzhou Micro Image Software Co ltd
Current assignee: Hangzhou Micro Image Software Co ltd
Priority date: 2021-08-24
Filing date: 2021-08-24
Publication date: 2023-02-28
Also published as: CN113658276A; CN113658276B

Abstract

The embodiment of the invention provides a gun and ball calibration data acquisition method, a gun and ball calibration device and electronic equipment, and is applied to the technical field of image data processing. The method comprises the following steps: controlling the dome camera to move to an initial position of the center of the dome camera picture corresponding to the reference position in the gun camera picture; determining a calibration motion control parameter of the dome camera by using a reference position in a gunlock picture and a gunlock field angle of the gunlock; wherein, the calibration motion control parameter can control the ball machine to move until the center of the picture of the ball machine corresponds to the target area in the picture of the gun camera; controlling the ball making machine to move to a target position by using the calibration motion control parameter, and acquiring a calibration picture acquired by the ball making machine at the target position; and determining a pair of calibration point pair data between the gunlock and the dome camera by using the target area, the calibration picture and the calibration motion control parameters in the gunlock picture. By the scheme, the data acquisition process of the calibration point can be simplified.

Description

Gun and ball calibration data acquisition method, gun and ball calibration method and device and electronic equipment

Technical Field

The invention relates to the technical field of image data processing, in particular to a gun and ball calibration data acquisition method, a gun and ball calibration device and electronic equipment.

Background

Currently, the mainstream video surveillance cameras are classified into a gun camera (hereinafter, referred to as a gun camera) and a dome camera (hereinafter, referred to as a dome camera). For video monitoring of a target object moving in a large range, in order to monitor the moving condition of the target object as a whole and the details of the target object, a video monitoring method of gun-ball linkage is generally adopted, wherein the gun-ball linkage refers to jointly monitoring the same scene through a gun and a ball machine.

In order to realize gun and ball linkage, calibration point data is needed to be used for gun and ball linkage calibration. In the related art, calibration point pair data are mainly acquired manually, so that the acquisition process of the calibration point pair data is complicated.

Disclosure of Invention

The embodiment of the invention aims to provide a method and a device for acquiring gun and ball calibration data so as to simplify the data acquisition process of a calibration point. The specific technical scheme is as follows:

in a first aspect, an embodiment of the present invention provides a method for acquiring calibration data of a gun and a ball, where the method includes:

controlling the dome camera to move to an initial position of the center of the dome camera picture corresponding to the reference position in the gun camera picture;

determining a calibration motion control parameter of the ball machine by using a reference position in the gunlock picture and a gunlock field angle of the gunlock; the calibration motion control parameters can control the dome camera to move to the center of a dome camera picture corresponding to a target area in the gunlock picture;

controlling the ball machine to move to a target position by using the calibration movement control parameters, and acquiring a calibration picture acquired by the ball machine at the target position;

and determining a pair of calibration point pair data between the bolt and the ball machine by using the target area in the bolt picture, the calibration picture and the calibration motion control parameters.

Optionally, the bolt face picture contains a plurality of different target areas; the calibration motion control parameters can control the ball machine to move to the center of the picture of the ball machine and correspond to one target area in the picture of the gun camera.

Optionally, the reference position in the bolt face picture is the center of the bolt face picture; alternatively, the reference position in the bolt face picture is one of the target areas in the bolt face picture.

Optionally, when the reference position in the bolt face picture is one of the target areas in the bolt face picture, the method further includes:

and determining a pair of calibration point pair data between the gunlock and the dome camera by using the reference position in the gunlock picture and the motion control parameter of the dome camera moving to the initial position.

Optionally, in a case that the reference position in the gun camera picture is one of the target areas in the gun camera picture, the calibration motion control parameter may control the dome camera to move to a center of the dome camera picture corresponding to one of the target areas in the gun camera picture except the reference position.

Optionally, the determining a calibration motion control parameter of the dome camera by using a reference position in the gun camera picture and a gun camera view angle of the gun camera includes: determining a calibration motion control parameter of the dome camera according to a preset sequence of a target area in the gunlock picture and by using a reference position in the gunlock picture and a gunlock field angle of the gunlock;

the calibration motion control parameters are used for controlling the dome camera to move to the center of the picture of the dome camera and correspond to the target area determined according to the preset sequence; and the calibration picture is a picture acquired by the dome camera in a state that the center of the picture of the dome camera corresponds to the target area determined according to the preset sequence.

Optionally, the determining a pair of calibration point pair data between the bolt machine and the ball machine by using the target area in the bolt machine picture, the calibration picture, and the calibration motion control parameter includes:

identifying a first sub-area of a target area in the bolt face picture and a second sub-area in the calibration picture; the picture contents of the first sub-area and the second sub-area are matched;

and determining a pair of calibration point pair data between the rifle bolt and the dome camera by utilizing the position information of the first sub-area in the picture of the rifle bolt and the motion control parameters which can control the center of the picture of the dome camera and correspond to the first sub-area.

Optionally, the identifying a first sub-area of a target area in the bolt face picture and a second sub-area in the calibration picture includes:

identifying characteristic points in a target area in the gunlock picture and characteristic points in the calibration picture by using a characteristic point identification algorithm;

comparing the characteristic points of the target area in the gunlock picture with the characteristic points in the calibration picture to determine a plurality of first characteristic points in the target area in the gunlock picture and a plurality of second characteristic points in the calibration picture; wherein the plurality of first feature points and the plurality of second feature points characterize the same object;

and determining a minimum region containing the plurality of first characteristic points from the target region of the gunlock picture as a first sub-region, and taking the minimum region containing the plurality of second characteristic points in the calibration picture as a second sub-region.

Optionally, the determining, by using the position information of the first sub-area in the gun camera image and the motion control parameter that may control the center of the dome camera image of the dome camera to correspond to the first sub-area, a pair of calibration point pair data between the gun camera and the dome camera includes:

determining pixel coordinates of pixel points at the center point of the first subarea in the gunlock picture as position information of the first subarea in the gunlock picture;

sending the position information of the second sub-area in the calibration picture to the dome camera, and acquiring a motion control parameter which can control the center of the dome camera picture of the dome camera and corresponds to the first sub-area;

determining a pair of calibration point pair data between the bolt face and the ball machine using the determined position information and the obtained motion control parameters.

Optionally, the bolt face field angle of the bolt face comprises: a horizontal maximum field of view of the bolt, and a vertical maximum field of view of the bolt;

the determining the calibration motion control parameters of the ball machine by using the reference position in the picture of the gun machine and the field angle of the gun machine comprises the following steps:

determining the distance of the target area relative to a reference position in the bolt face picture, a first offset angle in the horizontal direction and a second offset angle in the vertical direction;

determining a horizontal movement position of the dome camera based on a horizontal maximum field angle of the bolt face, the first offset angle, and a horizontal component of the distance;

determining a vertical movement position of the dome camera based on a vertical maximum field angle of the bolt face, the second offset angle, and a vertical component of the distance;

and determining the calibration motion control parameters of the dome camera by using the horizontal moving position and the vertical moving position.

Optionally, the determining a horizontal movement position of the ball machine based on the horizontal maximum field angle of the bolt face, the first offset angle, and the horizontal component of the distance includes:

determining the horizontal moving position of the ball machine according to the following formula:

wherein P is a horizontal movement position of the dome camera, x is an abscissa of the center position of the target area, x 'is an abscissa of the reference position, (x-x') is the horizontal component, and P is _d Setting the horizontal maximum field angle as alpha, wherein alpha is a preset horizontal parameter corresponding to the first offset angle, and A is a multiple of the sampling precision of the dome camera relative to the sampling precision of the gunlock;

the determining a vertical movement position of the dome camera based on the vertical maximum field angle of the bolt face, the second offset angle, and the vertical component of the distance includes:

determining the vertical movement position of the ball machine according to the following formula:

wherein T is a vertical rotation position of the dome camera, y is a vertical coordinate of the center position of the target area, y 'is a vertical coordinate of the reference position, (y-y') is the vertical component, T _d And beta is a vertical parameter preset to correspond to the second offset angle for the vertical maximum field angle.

Optionally, the bolt is an infrared thermal imaging bolt.

In a second aspect, an embodiment of the present invention further provides a gun and ball calibration method, where the method includes:

obtaining a plurality of pairs of calibration point pair data by using the gun and ball calibration data obtaining method of the first aspect;

and determining the mapping relation between each position in the gunlock picture of the gunlock and the motion control parameter of the dome camera by using the plurality of pairs of calibration point pair data.

In a third aspect, an embodiment of the present invention further provides a rifle ball calibration data obtaining apparatus, where the apparatus includes:

the dome camera motion control module is used for controlling the dome camera to move to an initial position of which the center of a dome camera picture corresponds to a reference position in a gun camera picture;

the parameter determining module is used for determining a calibration motion control parameter of the dome camera by utilizing a reference position in the gunlock picture and a gunlock field angle of the gunlock; the calibration motion control parameters can control the dome camera to move to the center of the dome camera picture and correspond to the target area in the gun camera picture;

the image acquisition module is used for controlling the ball machine to move to a target position by utilizing the calibration movement control parameters and acquiring a calibration image acquired by the ball machine at the target position;

and the data determining module is used for determining a pair of calibration point pair data between the gunlock and the dome camera by utilizing the target area in the gunlock picture, the calibration picture and the calibration motion control parameters.

Optionally, the bolt face picture contains a plurality of different target areas; the calibration motion control parameters can control the dome camera to move to the center of a dome camera picture corresponding to one target area in the gun camera picture.

Optionally, the data determining module is further configured to determine a pair of calibration point pair data between the rifle bolt and the ball machine by using the reference position in the rifle bolt picture and the motion control parameter of the ball machine moving to the initial position when the reference position in the rifle bolt picture is one of the target areas in the rifle bolt picture.

Optionally, the parameter determining module is specifically configured to determine a calibration motion control parameter of the dome camera according to a preset sequence of a target area in the image of the gun camera and by using a reference position in the image of the gun camera and a field angle of the gun camera;

the calibration motion control parameters are used for controlling the dome camera to move to the center of the picture of the dome camera and correspond to the target area determined according to the preset sequence; and the calibration picture is a picture acquired by the dome camera under the state that the center of the picture of the dome camera corresponds to the target area determined according to the preset sequence.

Optionally, the data determining module includes:

the region identification submodule is used for identifying a first sub-region of a target region in the gunlock picture and a second sub-region in the calibration picture; wherein the picture contents of the first sub-area and the second sub-area are matched;

and the data determination submodule is used for determining a pair of calibration point pair data between the gun camera and the dome camera by utilizing the position information of the first sub-area in the gun camera picture and the motion control parameters which can control the dome camera picture center of the dome camera and correspond to the first sub-area.

Optionally, the area identification sub-module is specifically configured to identify, by using a feature point identification algorithm, a feature point in a target area in the bolt face picture and a feature point in the calibration picture; comparing the characteristic points of the target area in the gunlock picture with the characteristic points in the calibration picture to determine a plurality of first characteristic points in the target area in the gunlock picture and a plurality of second characteristic points in the calibration picture; wherein the plurality of first feature points and the plurality of second feature points characterize the same object; and determining a minimum region containing the plurality of first characteristic points from the target region of the gunlock picture as a first sub-region, and taking the minimum region containing the plurality of second characteristic points in the calibration picture as a second sub-region.

Optionally, the data determining submodule is specifically configured to determine, in the bolt face picture, a pixel coordinate of a pixel point at a center point of the first sub-area as position information of the first sub-area in the bolt face picture; sending the position information of the second sub-area in the calibration picture to the dome camera, and acquiring a motion control parameter which can control the center of the dome camera picture of the dome camera and corresponds to the first sub-area; determining a pair of calibration point pair data between the bolt face and the ball machine using the determined position information and the obtained motion control parameters.

the parameter determination module comprises:

the access determination submodule is used for determining the distance of the target area relative to a reference position in the bolt face picture, a first offset angle in the horizontal direction and a second offset angle in the vertical direction;

a horizontal position determination submodule for determining a horizontal movement position of the dome camera based on a horizontal maximum field angle of the bolt face, the first offset angle, and a horizontal component of the distance;

a vertical position determination submodule for determining a vertical movement position of the dome camera based on a vertical maximum field angle of the bolt face, the second offset angle, and a vertical component of the distance;

and the parameter determination submodule is used for determining the calibration motion control parameters of the dome camera by utilizing the horizontal moving position and the vertical moving position.

Optionally, the horizontal position determining submodule is specifically configured to determine a horizontal movement position of the ball machine according to the following formula:

wherein P is the horizontal movement of the ball machineA motion position, x being the abscissa of the central position of said target area, x 'being the abscissa of said reference position, (x-x') being said horizontal component, P _d Setting the horizontal maximum field angle as alpha, setting a horizontal parameter corresponding to the first offset angle in advance, and setting A as a multiple of the sampling precision of the dome camera relative to the sampling precision of the gunlock;

the vertical position determining submodule is specifically configured to determine a vertical movement position of the dome camera according to the following formula:

wherein T is a vertical rotational position of the ball machine, y is an ordinate of the target area center position, y 'is an ordinate of the reference position, (y-y') is the vertical component, T _d And beta is a vertical parameter preset to correspond to the second offset angle for the vertical maximum field angle.

Optionally, the bolt is an infrared thermographic bolt.

According to the scheme provided by the embodiment of the invention, the calibration data between the gun camera and the ball machine can be automatically acquired, and the ball machine does not need to be manually controlled to acquire the video picture of the target object, so that the process of acquiring the calibration data is simplified.

In a fourth aspect, an embodiment of the present invention further provides a gun and ball calibration apparatus, where the apparatus includes:

a data obtaining module, configured to obtain, by using the gun and ball calibration data obtaining apparatus according to the third aspect, a plurality of pairs of calibration point pair data;

and the relationship determination module is used for determining the mapping relationship between each position in the gunlock picture of the gunlock and the motion control parameter of the dome camera by using the plurality pairs of calibration point pair data.

In a fifth aspect, an embodiment of the present invention provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor and the communication interface complete communication between the memory and the processor through the communication bus;

a memory for storing a computer program;

and the processor is used for realizing the gun and ball calibration data acquisition method of the first aspect or the gun and ball calibration method of the second aspect when executing the program stored in the memory.

In a sixth aspect, an embodiment of the present invention provides a computer-readable storage medium, in which a computer program is stored, and the computer program, when executed by a processor, implements the method for obtaining calibration data of a gun and ball according to the first aspect or the steps of the method for calibrating a gun and ball according to the second aspect.

The embodiment of the invention has the following beneficial effects:

in the method for acquiring calibration data of the gun and the ball, the ball machine is controlled to move to an initial position corresponding to a reference position in a picture of the gun and then to determine a target position of a center of the picture of the ball machine corresponding to a target area in the picture of the gun and to control the ball machine to move to the target position by using the reference position and a field angle of the gun, and finally, a pair of calibration point pair data is determined by using the target area, the calibration picture and the calibration motion control parameters.

On the basis, the embodiment of the invention also provides a gun and ball calibration method, multiple pairs of calibration point pair data can be obtained by the gun and ball calibration data obtaining method provided by the invention, and the gun and ball machine are calibrated by using the multiple pairs of calibration point pair data.

Of course, not all of the advantages described above need to be achieved at the same time in the practice of any one product or method of the invention.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other embodiments can be obtained by using the drawings without creative efforts.

FIG. 1 is a schematic view of a gun and ball linkage system;

FIG. 2 is a flow chart of manual gun and ball linkage calibration and tracking;

FIG. 3 is a flow chart of the process for manual gun and ball linkage calibration;

FIG. 4 is a flowchart of a gun and ball calibration data acquisition method according to an embodiment of the present invention;

FIG. 5 is a schematic view of a gun and ball linkage system capturing video frames;

fig. 6 is a schematic diagram of dividing a frame of a bolt face according to an embodiment of the present invention;

FIG. 7 is a schematic diagram of a predetermined sequence according to an embodiment of the present invention;

FIG. 8 is another flow chart of a method for acquiring calibration data of a gun and ball according to an embodiment of the present invention;

FIG. 9 is another flowchart of a method for acquiring calibration data of a gun and ball according to an embodiment of the present disclosure;

FIG. 10 is a flow chart of a gun and ball calibration method according to an embodiment of the present invention;

fig. 11 is a schematic structural diagram of a gun and ball calibration data acquiring apparatus according to an embodiment of the present invention;

FIG. 12 is a schematic structural diagram of a gun and ball calibration provided in an embodiment of the present invention;

fig. 13 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

To more clearly illustrate the technical solution of the present invention, the following describes a gun and ball linkage system.

Fig. 1 is a schematic view of a gun and ball linkage system. In the figure, a represents a bolt face a, an included angle between an inclined dotted line and a horizontal solid line is a view angle of the bolt face a, and c represents a ball machine c which finishes gun ball calibration with the bolt face a in advance. The figure containing a human figure represents an object in monitoring, arrows positioned on the right side of the object indicate the moving direction of the object, and Pc, tc and Zc positioned below the object are PTZ coordinate values of the object in a coordinate system of the ball machine, wherein P (Pan, translation) in the PTZ coordinate values is a horizontal moving parameter of the ball machine, such as a horizontal rotating angle, T (Tilt) is a vertical moving parameter, such as a vertical rotating angle or a high-low pitch angle, and Z (Zoom) is the focal length of the ball machine.

When the object triggers an alarm in the gunlock picture, the gunlock a can generate PTZ coordinate values (Pc, tc, zc in the figure) of the object in a dome coordinate system through a gun and ball calibration algorithm based on the position of the object in the gunlock picture. Then, the gun camera a sends the generated PTZ coordinate values to the dome camera c through a communication protocol such as an SDK (Software Development Kit) protocol, and the dome camera c moves according to the received PTZ coordinate values after receiving the PTZ coordinate values, and at this time, the dome camera c automatically tracks the position of the object. As the object moves, the gun camera a continuously transmits PTZ coordinate values of the object to the dome camera c, so that the dome camera c continuously captures a screen of the object until the object disappears in the field of view of the gun camera a.

In order to construct a gun and ball linkage system, gun and ball calibration needs to be performed on a gun camera and a ball machine in advance so as to establish a mapping relation between coordinates in a gun camera picture and corresponding PTZ coordinate values of the ball machine. When gun and ball calibration is performed, calibration point pair data needs to be acquired first.

In order to clearly illustrate the difference between the technical solution provided by the present invention and the solution in the related art, the following describes the data acquisition process of the calibration point in the related art.

In the related art, the process of manually acquiring calibration point pair data includes: and manually selecting a target object in the gun camera picture, and manually controlling the ball machine to enable the ball machine to move to the position for collecting the target object, wherein a pair of calibration point pair data is generated by utilizing the position information of the target object in the gun camera picture and the motion control parameters when the ball machine moves to the position for collecting the target object.

Fig. 2 is a flow chart of manual gun and ball linkage calibration and tracking in the related art. The client can receive the images of the gunlock collected by the gunlock and the images of the ball machine collected by the ball machine, such as a smart phone, a computer and the like. When gun and ball linkage calibration is needed, a user can firstly observe a gun camera picture, a target object for calibration is selected from the gun camera picture, the user can observe a dome camera picture fed back by a dome camera through a client after the target object is selected, meanwhile, a PTZ monitoring command capable of controlling the dome camera to move is sent to the dome camera through an operation client, and the dome camera picture fed back by the dome camera is observed in real time. After the dome camera acquires the dome camera image of the target object, the dome camera may feed back the corresponding PTZ coordinate value (i.e., the PTZ position in fig. 2) to the client. Meanwhile, the client records the coordinate positions (X, Y) of the target object in the bolt face picture (i.e., the bolt faces P and T in fig. 2), and further generates a pair of calibration point pair data in the format of (X, Y, P, T, and Z). Generally, the above process needs to be repeated for multiple times to obtain multiple pairs of calibration point pair data. And ending the data acquisition process of the calibration point in the related scheme.

After the calibration point pair data is obtained, the gunlock application layer can send the calibration point pair data to a Digital Signal Processing (DSP) layer of the gunlock, and perform arithmetic operation Processing to obtain a calibration model, so as to complete the calibration of the gun and the ball.

When the gunlock detects a target object, the gunlock application layer can convert the position of the target object in the gunlock picture into a PTZ coordinate value of the dome camera through the generated calibration model, and sends a command carrying the PTZ coordinate value to the dome camera, so that the dome camera can move according to the PTZ coordinate value, and starts to track the target object after acquiring the dome camera picture of the target object.

The following describes a process flow of manual gun and ball calibration in the related art.

As shown in fig. 3, the process flow of the manual gun ball calibration includes: and clicking an interface to issue a command, namely starting the gun and ball linkage calibration after the client receives a trigger operation of starting the gun and ball linkage calibration. At this time, the calibration main entry of the client is started, that is, the data acquisition process of the calibration point is entered. After entering the calibration main entrance and starting, displaying a configuration interface of the main tracking configuration interface and the slave tracking configuration interface, and enabling a worker to configure interface parameters of a gun camera (a main machine) and a dome camera (a slave machine) on the configuration interface, so that the configured interface parameters can be utilized to receive frames fed back by the gun camera and the dome camera in real time in the subsequent process. After the configuration of the master-slave tracking configuration interface is completed, the user is required to determine the current calibration type, that is, the user is required to confirm whether to enter the manual calibration, if so, the subsequent process is continued, and if not, the process is ended.

And at the moment, a pair of calibration point pair data is generated by utilizing the position information of the target object in the gun camera picture and the motion control parameters when the ball machine moves to the position of the acquisition target object. After a pair of calibration point pair data is acquired, the acquired calibration point pair data needs to be subjected to legality conversion processing, the acquired calibration point pair data is converted into data in a preset legal format, the converted data is checked, whether the format of the converted data is correct or not is judged, if the check is successful, the converted calibration point pair data is continuously subjected to legality judgment, whether unreasonable conditions such as too large and too small values exist in the calibration point pair data or not is judged, and if the legality judgment is correct, a pair of calibration point pair data meeting the requirements is determined to be generated.

After determining that a pair of required calibration point pair data is generated, judging whether 9 times of manual calibration is completed currently, if not, returning to the manual calibration process to continuously acquire the calibration point pair data, if so, sending the generated 9 pairs of calibration point pair data into an algorithm library, and after further parameter judgment is carried out to be correct, utilizing the generated 9 pairs of calibration point pair data to carry out gun-ball linkage calibration. And after the calibration is finished, returning a mark of the finished calibration, and simultaneously prompting the finished calibration by the client.

As can be known from the above description of the related art, in order to obtain the calibration point pair data in the related art, the target object needs to be manually selected, and the ball machine needs to be manually controlled to move, so that the process of obtaining the calibration point pair data is complicated. In the related technology, a user needs to manually control the ball control machine to move to a specified position, time is consumed, the calibration effect is influenced because a target object is not easy to find, the field implementation difficulty is high, the maintainability is poor, and the construction cost is high. If the field environment does not have available reference objects as target objects, multiple persons are needed to cooperate, one person operates the client, and the other person serves as the reference object. Meanwhile, in the related art, a reference object is required to be used as a target object, so that the related art is only suitable for an open-view scene.

In order to simplify the process of acquiring data of a calibration point, the embodiment of the invention provides a method for acquiring calibration data of a gun and a ball.

It should be noted that the method for acquiring calibration data of a gun and a ball provided by the embodiment of the present invention may be applied to a gun camera, and may also be applied to other electronic devices with data processing capability, such as a mobile phone, a server, a computer, and the like. Moreover, the method for acquiring calibration data of the gun and the ball provided by the embodiment of the invention can be realized by software, hardware or a combination of software and hardware.

The gun and ball calibration data acquisition method provided by the embodiment of the invention comprises the following steps:

determining a calibration motion control parameter of the ball machine by using a reference position in a gunlock picture and a gunlock field angle of a gunlock; the calibration motion control parameters can control the dome camera to move to the center of a dome camera picture corresponding to a target area in a gunlock picture;

controlling the ball making machine to move to a target position by using the calibration motion control parameter, and acquiring a calibration picture acquired by the ball making machine at the target position;

and determining a pair of calibration point pair data between the gunlock and the dome camera by using the target area, the calibration picture and the calibration motion control parameters in the gunlock picture.

According to the scheme provided by the embodiment of the invention, the ball machine can be controlled to move to the target position corresponding to the target area in the picture center of the ball machine through the determined calibration motion control parameters, so that the ball machine can acquire the calibration picture containing the same object as the target area in the target position, the automatic acquisition of the calibration picture containing the same object as the target area is realized, the calibration point pair data between the gun camera and the ball machine can be automatically acquired, and the acquisition process of the calibration point pair data is simplified.

Meanwhile, manual operation is not needed, so that the arrangement of a gun and ball linkage system can be simplified, the field construction difficulty is reduced, and the construction cost is reduced.

Furthermore, the ball machine can be controlled to move to the target position corresponding to the target area in the center of the picture of the ball machine through calibrating the motion control parameters, so that the calibration picture containing the same object with the target area can be automatically acquired, and the method and the device can be applied to complex environments with irregular landform, uneven height, narrow visual field and the like.

The following describes a method for acquiring calibration data of a gun and a ball according to an embodiment of the present invention in detail with reference to the accompanying drawings.

As shown in fig. 4, the method for obtaining calibration data of a gun and a ball according to an embodiment of the present invention may include:

s401, controlling the dome camera to move to an initial position of the center of the dome camera picture corresponding to the reference position in the gun camera picture;

the dome camera is a dome camera, such as a high-speed dome camera, an intelligent dome camera and the like, which can rotate horizontally or vertically, and the visual field range of the camera can be changed through rotation, and the picture center of the dome camera is the center of the picture acquired by the dome camera.

The image of the gun camera is a video image acquired by the gun camera, wherein the gun camera is a gun type camera, such as a camera with a cuboid appearance like an infrared thermal imaging gun camera. The reference position in the bolt face screen may be a position of any one point designated in advance in the gun ball screen, and for example, the reference position may be the center of the bolt face screen. Alternatively, when a plurality of areas divided in advance are included in the bolt face screen, the reference position may be one of the areas. Optionally, the reference position represents for one of the regions: the reference position is a position of any point in the area, for example, the reference position may be the center of the area.

It should be noted that after the bolt machine is deployed, the field of view of the bolt machine is fixed, that is, after the bolt machine is deployed, the field of view of the bolt machine picture acquired by the bolt machine is fixed and unchanged, and since the field of view of the bolt machine is large, the bolt machine picture can be regarded as a global video picture of a monitoring scene. Unlike a gun bolt, a ball machine can change the field of view by rotating horizontally or vertically.

For example, as shown in fig. 5, a schematic diagram of a picture collected for a gun and ball linkage system is shown. In the figure, a ball machine picture A1 is a ball machine picture acquired by a ball machine in a visual field range 1, corresponds to an A2 area in a gun camera picture, and changes the visual field range of the ball machine from the visual field range 1 to a visual field range 2 by rotating, at this time, the ball machine picture acquired by the ball machine is a ball machine picture B1, and the ball machine picture B1 corresponds to a B2 area in the gun camera picture.

In this step, a control operation for the ball machine may be received, and based on the received control operation, an instruction for controlling the movement of the ball machine is generated, and the generated instruction is sent to the ball machine to control the movement of the ball machine. In the process of controlling the ball machine to move, the picture of the ball machine can be displayed in real time, so that field personnel can observe the moving position of the ball machine. If the movement stopping operation of the ball machine is received, it indicates that the scene personnel observe that the center of the picture of the ball machine corresponds to the reference position in the picture of the gun camera, and stops giving a command to the ball machine continuously, and at the moment, the position to which the ball machine moves is the initial position.

In the process of controlling the dome camera to move, when receiving a dome camera movement stopping operation executed when a field person observes that the center of a dome camera screen moves to the object A, the dome camera continues to generate an instruction, and at the moment, the dome camera moves to the initial position of the object A even when the center of the dome camera screen moves to the initial position of the object A.

S402, determining a calibration motion control parameter of the dome camera by using a reference position in a gunlock picture and a gunlock field angle of the gunlock; wherein, the calibration motion control parameter can control the ball machine to move until the center of the picture of the ball machine corresponds to the target area in the picture of the gun camera;

the target area may be an area at any position in the bolt face picture, and in order to ensure that the first sub-area can be identified from the target area later, the target area should not be too small, that is, the area of the target area should be larger than an area threshold.

In one implementation, in order to improve the accuracy of the gun ball calibration, multiple pairs of calibration point pair data need to be obtained, and therefore, in order to obtain the multiple pairs of calibration point pair data, the frame of the gun camera may include multiple different target areas, and at this time, the calibration motion control parameter may control the ball camera to move until the center of the frame of the gun camera corresponds to one of the target areas in the frame of the gun camera.

Illustratively, the bolt face picture includes 4 target areas, namely target area 1, target area 2, target area 3, and target area 4. In this case, the calibration motion control parameter may control the dome camera to move to a position where the center of the dome camera screen corresponds to any one of the target area 1, the target area 2, the target area 3, or the target area 4, for example, the calibration motion control parameter may control the dome camera to move to a position where the center of the dome camera screen corresponds to the target area 1.

Optionally, in an implementation, the multiple target areas may be partitioned from the frame of the bolt face according to a preset partition rule, and the preset partition rule may be determined based on experience and requirements. Optionally, in one implementation, the frame of the bolt face may be evenly divided into a predetermined number of target areas. For example, as shown in fig. 6, a schematic diagram of dividing a frame of a rifle bolt is shown, and taking a preset number of 4 as an example, the frame of the rifle bolt is evenly divided into 4 frame areas.

The calibration motion control parameter can control the ball machine to move to the position where the center of the picture of the ball machine corresponds to the target area in the picture of the gun camera. The center of the picture of the dome camera corresponds to the target area in the picture of the gun camera, and the picture of the dome camera collected by the dome camera at the moment and the target area contain the same object. It should be noted that, the objects mentioned in the embodiments of the present invention may be whole or part of any type of objects such as people, trees, flowers, buildings, cloud layers, and the like.

Since the position of the target area in the bolt face picture is known, the direction of the target area relative to the reference position can be determined, and further, the view angle between the reference position and the target area can be determined by combining the bolt face view angle of the bolt face. Furthermore, because the center of the picture of the dome camera at the initial position of the dome camera corresponds to the reference position, the calibration motion control parameters which can control the dome camera to move to the center of the picture of the dome camera and correspond to the target area in the picture of the gun camera can be estimated based on the determined view included angle.

The calibration motion parameters at least comprise a P value and a Z value in PTZ coordinate values of the ball machine, namely the horizontal moving position of the ball machine after motion and the vertical moving position of the ball machine after motion. And under the condition that the calibrated motion parameters only comprise the P value and the Z value, the dome camera can adopt a default focal length to acquire the picture of the dome camera.

S403, controlling the ball making machine to move to a target position by using the calibration motion control parameter, and acquiring a calibration picture acquired by the ball making machine at the target position;

in the step, the motion control parameters can be calibrated and sent to the ball machine, so that the ball machine can move according to the received calibrated motion control parameters, and the position of the ball machine after the movement is finished is the target position.

After the ball machine moves to the target position, a calibration picture acquired by the ball machine at the target position can be acquired. Optionally, after the ball machine finishes moving, a picture acquisition instruction may be sent to the ball machine to acquire the calibration picture fed back by the ball machine, or the ball machine may actively feed back the calibration picture acquired at the target position after moving to the target position, which is all possible.

S404, determining a pair of calibration point pair data between the gunlock and the dome camera by using the target area, the calibration picture and the calibration motion control parameters in the gunlock picture.

In this step, since the calibration motion control parameter can control the dome camera to move until the center of the dome camera picture corresponds to the target area in the gun camera picture, the same object as the target area exists in the calibration picture obtained by using the calibration motion control parameter, at this time, the same object in the target area and the calibration picture can be determined first, and then a pair of calibration point pair data between the gun camera and the dome camera can be determined by using the position of the object in the target area and the calibration motion control parameter.

According to the technical scheme provided by the embodiment of the invention, the ball machine can be controlled to move to the target position corresponding to the target area in the center of the picture of the ball machine through the determined calibration movement control parameters, so that the ball machine can collect the calibration picture containing the same object as the target area in the target position, the calibration picture containing the same object as the target area is automatically obtained, the calibration point pair data between the gun camera and the ball machine can be automatically obtained, and the acquisition process of the calibration point pair data is simplified.

In an embodiment of the present invention, when the bolt face picture includes a plurality of different target areas, the reference position in the bolt face picture may be the center of the bolt face picture, or the reference position in the bolt face picture may be one target area in each target area in the bolt face picture. It is to be understood that, in the case where the target area is divided in the bolt face screen, the reference position in the bolt face screen may be the center of the bolt face screen or one of the target areas in the bolt face screen.

Illustratively, the bolt face picture includes 4 target areas, which are a target area 1, a target area 2, a target area 3, and a target area 4, wherein the target area 4 is located at the center of the bolt face picture, and in this case, the reference position is the target area 4 while the reference position is the center of the bolt face picture, that is, the reference position is both the center of the bolt face picture and the target area 4.

In the case where the reference position in the gun camera screen is one of the target areas in the gun camera screen, it will be described that the center of the camera screen at the initial position of the dome camera corresponds to one of the target areas, and in order to reduce the number of times the dome camera is moved, it is not necessary to control the dome camera to move again to a position where the center of the camera screen corresponds to the target area.

At the moment, the calibration motion control parameters can control the dome camera to move until the center of the dome camera picture corresponds to a target area except the reference position in the gun camera picture.

Still by way of example, if the reference positions are the center of the gun camera image and the target area 4, the calibration motion control parameters may control the ball machine to move until the center of the gun camera image corresponds to any one of the

target areas

1, 2 and 3, and do not need to control the ball machine to move until the center of the gun camera image corresponds to the target area 4.

In another embodiment, in a case where the reference position in the picture of the gun camera is one of the target areas in the picture of the gun camera, the motion control parameter of the ball machine at the initial position and the reference position may already be used to generate a pair of calibration point pair data between the gun camera and the ball machine, at this time, another gun ball calibration data obtaining method provided by the embodiment of the present invention may further include:

and determining a pair of calibration point pair data between the gunlock and the dome camera by using the reference position in the gunlock picture and the motion control parameters of the dome camera moving to the initial position.

In this step, the reference position in the image of the bolt machine and the motion control parameter of the ball machine moving to the initial position may be determined as a pair of calibration point pair data between the bolt machine and the ball machine.

For example, the reference position in the frame of the gunlock is (Xo, yo), the motion control parameter for moving the ball machine To the initial position is (Po, to, zo), and the pair of calibration point pair data generated is (Xo, yo, po, to, zo).

In the above scheme of the embodiment of the present invention, when the reference position in the picture of the bolt face is one of the target areas in the picture of the bolt face, a pair of calibration point pair data between the bolt face and the ball machine can be determined directly by using the reference position in the picture of the bolt face and the motion control parameter of the ball machine moving to the initial position, so that calibration point pair data corresponding to the target area is generated without the need of calibrating the motion control parameter based on the target area, and the efficiency of acquiring the calibration point pair data can be improved.

In an embodiment of the present invention, when the image of the rifle bolt includes a plurality of target areas, an embodiment of the present invention further provides another method for obtaining calibration parameters of a rifle ball, where the determining the calibration motion control parameters of the ball machine by using the reference position in the image of the rifle bolt and the field angle of the rifle bolt may include:

and determining the calibration motion control parameters of the dome camera according to the preset sequence of the target area in the gunlock picture and by using the reference position in the gunlock picture and the gunlock field angle of the gunlock.

The preset sequence of the target areas in the bolt face picture can be determined according to experience and requirements. Illustratively, as shown in fig. 7, a schematic diagram of a preset sequence is provided for the embodiment of the present invention. The preset sequence is a target area 1, a target area 2, a target area 3 and a target area 4, namely, firstly, a calibration motion control parameter which controls the ball machine to move to the center of a picture of the ball machine and corresponds to the target area 1 is determined, then a calibration motion control parameter which controls the ball machine to move to the center of the picture of the ball machine and corresponds to the target area 2 is determined, then the calibration motion control parameter which controls the ball machine to move to the center of the picture of the ball machine and corresponds to the target area 3 is determined, and finally the calibration motion control parameter which controls the ball machine to move to the center of the picture of the ball machine and corresponds to the target area 4 is determined.

The target area of each target area, which needs to be determined corresponding to the calibrated motion control parameter, can be determined based on the preset sequence of the target areas in the gunlock picture, and then the calibrated motion control parameter of the dome camera for the target area is determined based on the reference position in the gunlock picture and the gunlock field angle of the gunlock.

The determined calibration motion control parameters can control the dome camera to move to the center of the picture of the dome camera and correspond to the target area determined according to the preset sequence. Illustratively, when the calibration motion control parameters corresponding to the target area 2 are determined according to the preset sequence, the calibration motion control parameters can control the dome camera to move to the center of the dome camera picture corresponding to the target area 2.

On the basis, the calibration picture is a picture acquired by the dome camera under the condition that the center of the picture of the dome camera corresponds to the target area determined according to the preset sequence. Illustratively, the calibration picture is a picture acquired by the dome camera in a state that the center of the picture of the dome camera corresponds to the target area 2.

Through the preset sequence, the calibration pictures corresponding to each target area can be sequentially collected, and then a pair of calibration point pair data corresponding to each target area is determined. It should be noted that, in the embodiment of the present invention, the determining process of the calibration motion control parameter and the acquiring process of the calibration point pair data may be synchronous, that is, each calibration motion control parameter of a target area is determined based on a preset sequence, that is, the acquiring process of the calibration point pair data corresponding to the target area is executed, or the determining process of the calibration motion control parameter and the acquiring process of the calibration point pair data may also be asynchronous, for example, the calibration motion control parameter corresponding to each target area may be predetermined based on the preset sequence, and then the calibration point pair data corresponding to each target area may be sequentially determined.

In the above scheme of the embodiment of the invention, calibration pictures corresponding to the target regions can be sequentially acquired through the preset sequence, and then a pair of calibration point pair data corresponding to each target region is determined, therefore, automatic and ordered acquisition of a plurality of pairs of calibration point pair data is realized through the preset sequence, the acquisition process of the calibration point pair data is further simplified, and meanwhile, the accuracy of gun and ball calibration by using the calibration point pair data subsequently can be improved by acquiring the plurality of pairs of calibration point pair data.

Based on the embodiment of fig. 4 and as shown in fig. 8, another method for obtaining calibration data of a gun ball according to an embodiment of the present invention, the determining a pair of calibration point pair data between a gun camera and a ball machine by using a target area in a gun camera image, a calibration image, and a calibration motion control parameter, may include:

s801, identifying a first sub-area of a target area in a gunlock picture and a second sub-area in a calibration picture; the picture contents of the first sub-area and the second sub-area are matched;

as can be seen from the foregoing, if the same object exists in the target region and the calibration picture, the matching between the picture contents of the first sub-region and the second sub-region means that the object described by the picture content of the first sub-region is the same as the object described by the picture content of the second sub-region. Therefore, the area where the picture content describing the same object in the gun camera picture is located can be taken as a first sub-area, and the area where the picture content describing the same object in the calibration picture is located can be taken as a second sub-area.

Optionally, after the calibration picture is obtained, the picture content of the target region and the calibration picture may be compared, and the same object described in the target region and the calibration picture is determined, so that the sub-region of the object in the target region is used as the first sub-region, and the region of the object in the calibration picture is used as the second sub-region.

For example, the target area includes person a, person B, and person C, and the target area includes person C and person D. The sub-area of the person B in the target area is taken as the first sub-area and the area of the person B in the calibration picture is taken as the second sub-area.

In one implementation, identifying a first sub-region of a target region in a bolt face view and a second sub-region in a calibration view may include:

step 1: identifying characteristic points in a target area in a gunlock picture and characteristic points in a calibration picture by using a characteristic point identification algorithm;

the feature point recognition algorithm may be any algorithm capable of realizing feature point recognition, such as a Scale-invariant feature transform (SIFT) algorithm. By utilizing a characteristic point identification algorithm, the characteristic points in the target area in the gunlock picture can be identified, and the characteristic points in the calibration picture can be calibrated. The feature point refers to a point where the image gray value changes drastically or a point where the curvature is large on the edge of the image (i.e., the intersection of two edges).

Optionally, before the feature point identification is performed on the calibration picture, distortion elimination, parameter processing and image validity judgment processing may be performed on the calibration picture. The distortion elimination is used for eliminating the distortion of the calibration picture, the parameter processing is used for obtaining the image parameters of the calibration picture, such as the image size and the channel information of the calibration picture, and the parameters of the size of the gunlock picture and the like can also be obtained.

Step 2: comparing the characteristic points of the target area in the gunlock picture with the characteristic points in the calibration picture to determine a plurality of first characteristic points in the target area in the gunlock picture and a plurality of second characteristic points in the calibration picture; the plurality of first characteristic points and the plurality of second characteristic points represent the same object;

the characteristic points of the same object in the target area and the characteristic points in the calibration picture can be determined by performing characteristic point-to-point comparison on the characteristic points of the target area in the bolt picture and the characteristic points in the calibration picture, namely a plurality of first characteristic points in the target area and a plurality of second characteristic points in the calibration picture in the bolt picture are determined.

And step 3: and determining a minimum region containing a plurality of first characteristic points from the target region of the gunlock picture as a first sub-region, and determining a minimum region containing a plurality of second characteristic points in the calibration picture as a second sub-region.

Since the plurality of first feature points and the plurality of second feature points represent the same object, the minimum region including the plurality of first feature points in the gun camera image is determined to match the image content of the minimum region including the plurality of second feature points in the dome camera image, that is, after the plurality of first feature points are determined, the minimum region including the plurality of first feature points in the target region may be determined as a first sub-region, and similarly, after the plurality of second feature points are determined, the minimum region including the plurality of second feature points in the calibration image may be determined as a second sub-region.

S802, determining a pair of calibration point pair data between the gun camera and the dome camera by utilizing the position information of the first sub-area in the gun camera picture and the motion control parameters corresponding to the first sub-area and the center of the dome camera picture of the controllable dome camera.

The position information may be a pixel coordinate of a designated pixel point in the first sub-region, such as a pixel coordinate of a center point of the first sub-region in the frame of the bolt.

In one implementation, step S802 may include:

step a: determining the pixel coordinates of pixel points at the center point of the first subarea in the gunlock picture as the position information of the first subarea in the gunlock picture;

illustratively, the pixel point at the central point of the first sub-area is a pixel point a, and the coordinate of the pixel point a in the image of the bolt face is (Xa, ya), then the position information of the first sub-area in the image of the bolt face is (Xa, ya).

Step b: sending the position information of the second sub-area in the calibration picture to the dome camera, and acquiring the motion control parameters of the center of the picture of the dome camera capable of controlling the dome camera corresponding to the first sub-area;

the movement control parameters corresponding to the picture center of the controllable ball machine and the first sub-area and the calibration movement control parameters corresponding to the picture center of the controllable ball machine and the target area may be the same or different.

When the second sub-area is the picture center of the dome camera, the motion control parameter is the same as the calibration motion control parameter, and when the second sub-area is not the picture center of the dome camera, the motion control parameter is different from the calibration motion control parameter.

When the motion control parameters are different from the calibrated motion control parameters, the position information of the second sub-area in the calibrated picture can be sent to the ball machine, and then the ball machine determines the motion control parameters when the ball machine picture taking the second sub-area as the center is collected according to the conversion rule of the ball machine, namely the motion control parameters corresponding to the center of the picture of the ball machine and the first sub-area are determined, and the determined motion parameters are sent to the electronic equipment executing the embodiment of the invention.

Step c: and determining a pair of calibration point pair data between the bolt and the ball machine by using the determined position information and the acquired motion control parameters.

And determining the thickness of the motion control parameter corresponding to the first sub-area and the center of the picture of the dome camera of the controllable dome camera, namely determining a pair of calibration point pair data between the gunlock and the dome camera by using the determined position information and the obtained motion control parameter.

Alternatively, the determined position information and the acquired motion control parameters may be determined as a pair of calibration point pair data between the bolt and the ball machine. Illustratively, the determined position information is (Xa, ya), the acquired motion control parameter is (Pa, ta, za), and the determined pair of calibration point pair data is (Xa, ya, pa, ta, za).

According to the technical scheme provided by the embodiment of the invention, the calibration point pair data between the gunlock and the dome camera can be automatically acquired, and the acquisition process of the calibration point pair data is simplified. Furthermore, a mode of automatically determining the motion control parameters is provided by identifying the first sub-area and the second sub-area which are matched with the picture content and further utilizing the position information of the first sub-area in the gunlock picture and the motion control parameters of the center of the picture of the dome camera of the controllable dome camera corresponding to the first sub-area, and a basis is provided for simplifying the data acquisition process of the calibration point.

In another embodiment of the present invention, the bolt view angle of the bolt includes: the horizontal maximum field of view of the bolt, and the vertical maximum field of view of the bolt; at this time, as shown in fig. 9, another method for obtaining calibration data of a gun ball according to an embodiment of the present invention based on the embodiment of fig. 4 may include, as described above, determining a calibration motion control parameter of a ball machine by using a reference position in a frame of the gun camera and a field angle of the gun camera:

s901, determining the distance of a target area relative to a reference position in a gunlock picture, a first offset angle in the horizontal direction and a second offset angle in the vertical direction;

the distance between the target area and the reference position in the bolt face picture can be the distance between the center point of the target area and the reference position. Optionally, the distance may be a straight-line distance between a center point of the target region and the reference position, or the distance may further include a horizontal component and a vertical component, where the horizontal component is an absolute value of a difference between horizontal coordinates of the center point of the target region and the reference position, and the vertical component is an absolute value of a vertical coordinate value of the center point of the target region and the reference position.

The first offset angle in the horizontal direction is an included angle between a target vector and a horizontal unit vector, and the second offset angle in the vertical direction is an included angle between the target vector and a vertical unit vector, wherein the target vector is a vector with a reference position as a starting point and a central point of the target area as an end point.

S902, determining the horizontal moving position of the dome camera based on the horizontal maximum field angle, the first offset angle and the horizontal component of the distance of the gunlock;

wherein, the horizontal movement position of the ball machine is determined according to the following formula:

wherein P is the horizontal movement position of the dome camera, x is the abscissa of the center position of the target area, x 'is the abscissa of the reference position, (x-x') is the horizontal component, and P is the horizontal component _d And the horizontal angle is the horizontal maximum field angle, alpha is a horizontal parameter preset to correspond to the first offset angle, and A is a multiple of the sampling precision of the dome camera relative to the sampling precision of the gunlock.

Wherein,% is the residual budget. For the horizontal direction, the angle in the horizontal direction may be divided into a plurality of angle intervals in advance, and each angle interval corresponds to one angle parameter. For example, three angular intervals are divided, respectively interval 1: 0 °,60 °), corresponding to α = -1, interval 2: [60 °,120 °), corresponding to α =0 and interval 3: [120 °,180 ° ], corresponding to α =1. In general, the progress of the gun is 0.0001, and the accuracy of the ball machine is 0.01, in which case a is 100.

S903, determining the vertical moving position of the dome camera based on the vertical maximum field angle, the second offset angle and the vertical component of the distance of the gunlock;

determining the vertical moving position of the ball machine according to the following formula:

wherein T is the vertical rotation position of the dome camera, y is the ordinate of the center position of the target area, y 'is the ordinate of the reference position, (y-y') is the vertical component, T _d And beta is a vertical parameter which is preset to correspond to the second offset angle and is the vertical maximum field angle.

The angle parameter is obtained by dividing the angle of the vertical direction into a plurality of angle intervals, and each angle interval corresponds to one angle parameter. For example, three angular intervals are divided, respectively interval 1: [0 °,60 °), corresponding to β = -1, interval 2: [60 °,120 °), corresponding to β =0 and interval 3: [120 °,180 ° ], corresponding to β =1.

And S904, determining the calibration motion control parameters of the dome camera by using the horizontal movement position and the vertical movement position.

In this step, the horizontal movement position and the vertical movement position may be determined as the calibration motion control parameters. For example, the horizontal movement position is Px, the vertical movement position is Tx, and the determined nominal motion control parameter may be (Px, tx).

According to the scheme provided by the embodiment of the invention, the calibration point pair data between the gunlock and the dome camera can be automatically acquired, and the acquisition process of the calibration point pair data is simplified. Furthermore, the calibration motion control parameters of the dome camera can be determined by utilizing the distance of the target area relative to the reference position in the picture of the gun camera, the first offset angle in the horizontal direction and the second offset angle in the vertical direction, so that the calibration motion control parameters corresponding to the center of the picture of the dome camera of the controllable dome camera and the target area can be accurately determined, and a basis is provided for simplifying the data acquisition process of the calibration points.

Based on the method for acquiring the calibration data of the gun and the ball, the embodiment of the invention also provides a method for calibrating the gun and the ball.

As shown in fig. 10, a gun ball calibration method provided in an embodiment of the present invention includes the steps of:

s1001, acquiring a plurality of pairs of calibration point pair data by using the gun and ball calibration data acquisition method;

in this step, a plurality of pairs of calibration point pairs may be obtained by using the method for obtaining calibration data of a gun and a ball provided by the embodiment of the present invention, and for a specific implementation process, reference is made to the relevant description of the above embodiment, which is not described herein again.

The plurality of pairs of calibration point pair data may be at least 4 pairs of calibration point pair data, and for example, 4 pairs of calibration point pair data, 9 pairs of calibration point pair data, or 16 pairs of calibration point pair data may be used.

S1002, determining the mapping relation between each position in the gunlock picture of the gunlock and the motion control parameters of the dome camera by using a plurality of pairs of calibration point pair data.

After obtaining the data of the plurality of pairs of calibration points, the data of the plurality of pairs of calibration points may be utilized to determine a mapping relationship between each position in the bolt picture of the bolt and the motion control parameter of the ball machine. Optionally, the pairs of calibration point pair data may be generated to a DSP layer of the bolt, and the DSP layer performs arithmetic operation on the pairs of calibration point pair data to generate a mapping relationship between each position in the bolt picture of the bolt and the motion control parameter of the dome camera.

According to the technical scheme provided by the embodiment of the invention, a plurality of pairs of calibration point pair data can be obtained by the method for obtaining the gun and ball calibration data provided by the invention, and the gun and ball machine are calibrated by utilizing the plurality of pairs of calibration point pair data.

Corresponding to the method for obtaining calibration data of a gun and a ball provided in the foregoing embodiment, as shown in fig. 11, an embodiment of the present invention further provides a device for obtaining calibration data of a gun and a ball, including:

the dome camera movement control module 1101 is used for controlling the dome camera to move to an initial position of which the center of the dome camera picture corresponds to the reference position in the gun camera picture;

the parameter determining module 1102 is configured to determine a calibration motion control parameter of the dome camera by using a reference position in a frame of the gun camera and a field angle of the gun camera; wherein, the calibration motion control parameter can control the ball machine to move until the center of the picture of the ball machine corresponds to the target area in the picture of the gun camera;

the image acquisition module 1103 is configured to control the reference number to control the ball manufacturing machine to move to a target position by using the calibration movement, and acquire a calibration image acquired by the ball manufacturing machine at the target position;

and the data determining module 1104 is used for determining a pair of calibration point pair data between the gunlock and the dome camera by using the target area, the calibration picture and the calibration motion control parameters in the gunlock picture.

Optionally, the bolt face picture contains a plurality of different target areas; the calibration motion control parameters can control the ball machine to move until the center of the picture of the ball machine corresponds to one target area in the picture of the gun camera.

Optionally, the reference position in the bolt face picture is the center of the bolt face picture; alternatively, the reference position in the bolt face screen is one of the target areas in the bolt face screen.

Optionally, the data determining module is further configured to determine a pair of calibration point pair data between the gun camera and the ball machine by using the reference position in the gun camera picture and the motion control parameter of the ball machine moving to the initial position when the reference position in the gun camera picture is one of the target areas in the gun camera picture.

Optionally, in the case that the reference position in the gun camera picture is one of the target areas in the gun camera picture, the calibration motion control parameter may control the dome camera to move to a position where the center of the dome camera picture corresponds to one of the target areas in the gun camera picture except the reference position.

Optionally, the parameter determining module is specifically configured to determine a calibration motion control parameter of the dome camera according to a preset sequence of a target area in a frame of the gun camera and by using a reference position in the frame of the gun camera and a field angle of the gun camera;

calibrating the motion control parameters to control the dome camera to move to the center of the dome camera picture and correspond to the target area determined according to the preset sequence; the calibration picture is a picture collected by the dome camera under the state that the center of the picture of the dome camera corresponds to the target area determined according to the preset sequence.

Optionally, the data determining module includes:

the area identification submodule is used for identifying a first sub-area of a target area in a gunlock picture and a second sub-area in a calibration picture; the picture contents of the first sub-area and the second sub-area are matched;

and the data determination submodule is used for determining a pair of calibration point pair data between the gunlock and the dome camera by utilizing the position information of the first sub-area in the picture of the gunlock and the motion control parameter which can control the dome camera to move to the picture center and is a second sub-area.

Optionally, the area identification submodule is specifically configured to identify feature points in a target area in the bolt face picture and feature points in the calibration picture by using a feature point identification algorithm; comparing the characteristic points of the target area in the gunlock picture with the characteristic points in the calibration picture to determine a plurality of first characteristic points in the target area in the gunlock picture and a plurality of second characteristic points in the calibration picture; the plurality of first characteristic points and the plurality of second characteristic points represent the same object; and determining a minimum region containing a plurality of first characteristic points from the target region of the gunlock picture as a first sub-region, and determining a minimum region containing a plurality of second characteristic points in the calibration picture as a second sub-region.

Optionally, the data determining submodule is specifically configured to determine, in the bolt face picture, a pixel coordinate of a pixel point at a center point of the first sub-area, and use the pixel coordinate as position information of the first sub-area in the bolt face picture; sending the position information of the second sub-area in the calibration picture to the dome camera, and acquiring the motion control parameters of the center of the picture of the dome camera capable of controlling the dome camera, which correspond to the first sub-area; and determining a pair of calibration point pair data between the bolt and the ball machine by using the determined position information and the acquired motion control parameters.

Optionally, the bolt face field angle of the bolt face comprises: the horizontal maximum field of view of the bolt, and the vertical maximum field of view of the bolt;

a parameter determination module comprising:

the horizontal position determining submodule is used for determining the horizontal moving position of the dome camera based on the horizontal maximum field angle, the first offset angle and the horizontal component of the distance of the gunlock;

the vertical position determining submodule is used for determining the vertical moving position of the dome camera based on the vertical maximum field angle, the second offset angle and the vertical component of the distance of the gunlock;

and the parameter determination submodule is used for determining the calibration motion control parameters of the dome camera by utilizing the horizontal movement position and the vertical movement position.

Optionally, the horizontal position determining submodule is specifically configured to determine the horizontal movement position of the ball machine according to the following formula:

wherein P is the horizontal movement position of the dome camera, x is the abscissa of the center position of the target area, x 'is the abscissa of the reference position, (x-x') is the horizontal component, and P is the horizontal component _d The horizontal maximum field angle is set, alpha is a preset horizontal parameter corresponding to the first offset angle, and A is a multiple of the sampling precision of the dome camera relative to the sampling precision of the gunlock;

the vertical position determining submodule is specifically used for determining the vertical moving position of the dome camera according to the following formula:

wherein T is the vertical rotation position of the dome camera, y is the ordinate of the center position of the target area, y 'is the ordinate of the reference position, (y-y') is the vertical component, T _d And beta is a vertical parameter preset to correspond to the second offset angle for the vertical maximum field angle.

Optionally, the bolt is an infrared thermographic bolt.

Corresponding to the rifle ball calibration method provided by the embodiment of the present invention, as shown in fig. 12, the embodiment of the present invention further provides a rifle ball calibration apparatus, which includes:

a data obtaining module 1201, configured to obtain multiple pairs of calibration point pair data by using any one of the above gun and ball calibration data obtaining apparatuses;

the relationship determining module 1202 is configured to determine a mapping relationship between each position in the image of the bolt and the motion control parameter of the ball machine by using the pairs of calibration point data.

According to the technical scheme provided by the embodiment of the invention, as the plurality of pairs of calibration point pair data can be acquired by the gun and ball calibration data acquisition device provided by the invention, and the gun and the ball machine are calibrated by utilizing the plurality of pairs of calibration point pair data, the gun and ball calibration data acquisition method simplifies the acquisition process of the calibration point pair data, so that the whole gun and ball calibration process can be simplified, and the gun and ball calibration efficiency is further improved.

An embodiment of the present invention further provides an electronic device, as shown in fig. 13, including a processor 1301, a communication interface 1302, a memory 1303, and a communication bus 1304, where the processor 1301, the communication interface 1302, and the memory 1303 complete mutual communication through the communication bus 1304,

a memory 1303 for storing a computer program;

the processor 1301 is configured to implement any one of the gun and ball calibration data obtaining methods or gun and ball calibration method steps described above when executing the program stored in the memory 1303.

The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.

The communication interface is used for communication between the electronic equipment and other equipment.

The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Alternatively, the memory may be at least one memory device located remotely from the processor.

The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), application Specific Integrated Circuits (ASICs), field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.

In another embodiment of the present invention, a computer-readable storage medium is further provided, in which a computer program is stored, and the computer program, when executed by a processor, implements the steps of any of the above-mentioned methods for obtaining calibration data of a gun and ball or gun and ball calibration methods.

In yet another embodiment of the present invention, there is also provided a computer program product containing instructions which, when run on a computer, cause the computer to perform any of the above-described methods for gun and ball calibration data acquisition or gun and ball calibration.

In the above embodiments, all or part of the implementation may be realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk (SSD)), among others.

It should be noted that, in this document, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising one of 8230; \8230;" 8230; "does not exclude the presence of additional like elements in a process, method, article, or apparatus that comprises the element.

All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on differences from other embodiments. In particular, as for the apparatus, device, and system embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference may be made to some descriptions of the method embodiments for relevant points.

The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.

Claims

1. A gun-ball calibration data acquisition method, the method comprising:

determining a calibration motion control parameter of the ball machine by using a reference position in the gunlock picture and a gunlock field angle of the gunlock; the calibration motion control parameters can control the dome camera to move to the center of the dome camera picture and correspond to the target area in the gun camera picture;

and determining a pair of calibration point pair data between the rifle bolt and the ball machine by using the target area in the rifle bolt picture, the calibration picture and the calibration motion control parameters.

2. The method of claim 1, wherein the bolt face view includes a plurality of different target areas; the calibration motion control parameters can control the ball machine to move to the center of the picture of the ball machine and correspond to one target area in the picture of the gun camera.

3. The method of claim 2, wherein the reference position in the bolt face view is a center of the bolt face view; alternatively, the reference position in the bolt face picture is one of the target areas in the bolt face picture.

4. The method according to claim 3, wherein when the reference position in the bolt face picture is one of the target areas in the bolt face picture, the method further comprises:

5. The method according to claim 3, wherein in the case that the reference position in the gun camera view is one of the target areas in the gun camera view, the calibration motion control parameter controls the ball machine to move to a center of the ball machine view corresponding to the one of the target areas in the gun camera view other than the reference position.

6. The method of claim 2,

the determining the calibration motion control parameters of the dome camera by using the reference position in the gun camera picture and the gun camera view angle of the gun camera comprises the following steps:

determining a calibration motion control parameter of the dome camera according to a preset sequence of a target area in the gunlock picture and by using a reference position in the gunlock picture and a gunlock field angle of the gunlock;

the calibration motion control parameters can control the dome camera to move to the center of the picture of the dome camera and correspond to the target area determined according to the preset sequence; and the calibration picture is a picture acquired by the dome camera under the state that the center of the picture of the dome camera corresponds to the target area determined according to the preset sequence.

7. The method of claim 1, wherein the calibration point pair data comprises: the position information of a first sub-area in the target area and a motion control parameter which controls the picture center of a dome camera of the dome camera to correspond to the position of the first sub-area; the first sub-area is an area in the target area, which is matched with the picture content in the calibration picture.

8. The method of claim 1, wherein said determining a pair of calibration point pair data between the bolt face and the ball machine using the target area in the bolt face view, the calibration view, and the calibration motion control parameter comprises:

identifying a first sub-area of a target area in the bolt face picture and a second sub-area in the calibration picture; wherein the picture contents of the first sub-area and the second sub-area are matched;

9. The method of claim 8, wherein the identifying a first sub-region of a target region in the bolt face view and a second sub-region in the calibration view comprises:

10. The method according to claim 8 or 9, wherein the determining a pair of calibration point pair data between the bolt machine and the ball machine by using the position information of the first sub area in the bolt machine picture and the motion control parameter which can control the ball machine picture center of the ball machine to correspond to the first sub area comprises:

determining pixel coordinates of pixel points at the central point of the first sub-area in the image of the gunlock as position information of the first sub-area in the image of the gunlock;

11. The method of claim 1, wherein a bolt face field angle of the bolt face comprises: a horizontal maximum field of view of the bolt face or a vertical maximum field of view of the bolt face;

determining the distance of the target area relative to a reference position in the bolt face picture;

when the bolt face field angle of the bolt face includes the horizontal maximum field angle, determining a first offset angle in a horizontal direction of the target area with respect to a reference position in the bolt face picture, and determining a horizontal movement position of the dome camera based on the horizontal maximum field angle of the bolt face, the first offset angle, and a horizontal component of the distance; or,

determining a second offset angle in a direction perpendicular to a reference position in the bolt face screen in a case where a bolt face field angle of the bolt face includes the vertical maximum field angle, and determining a vertical movement position of the dome camera based on the vertical maximum field angle of the bolt face, the second offset angle, and a vertical component of the distance;

and determining the calibration motion control parameters of the dome camera by using the horizontal movement position or the vertical movement position.

12. The method of claim 10,

the determining a horizontal movement position of the dome camera based on a horizontal maximum field angle of the bolt face, the first offset angle, and a horizontal component of the distance includes:

determining the horizontal movement position of the ball machine according to the following formula:

wherein P is a horizontal movement position of the dome camera, x is an abscissa of the center position of the target area, x 'is an abscissa of the reference position, (x-x') is the horizontal component, and P is _d Setting the horizontal maximum field angle as alpha, setting a horizontal parameter corresponding to the first offset angle in advance, and setting A as a multiple of the sampling precision of the dome camera relative to the sampling precision of the gunlock;

the determining a vertical movement position of the ball machine based on the vertical maximum field angle of the bolt face, the second offset angle, and the vertical component of the distance includes:

13. The method of claim 1, wherein the bolt is an infrared thermal imaging bolt.

14. A gun and ball calibration method, the method comprising:

acquiring a plurality of pairs of calibration point pair data by using the gun and ball calibration data acquisition method of any one of claims 1 to 13;

and determining the mapping relation between each position in the gun camera picture of the gun camera and the motion control parameters of the dome camera by using the pairs of calibration point pair data.

15. A gun and ball calibration data acquisition apparatus, comprising:

the dome camera motion control module is used for controlling the dome camera to move to an initial position of which the center of the dome camera picture corresponds to the reference position in the gun camera picture;

16. A gun and ball calibration device, the device comprising:

a data acquisition module for acquiring a plurality of pairs of calibration point pair data by using the gun ball calibration point pair data acquisition apparatus as claimed in claim 15;

and the relation determining module is used for determining the mapping relation between each position in the gunlock picture of the gunlock and the motion control parameter of the ball machine by utilizing the pairs of calibration point pair data.

17. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;

a memory for storing a computer program;

a processor for implementing the method steps of any one of claims 1-13 or 14 when executing a program stored in a memory.