CN113673330A - Monitoring display method and device, electronic equipment and storage medium - Google Patents
Monitoring display method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN113673330A CN113673330A CN202110797521.4A CN202110797521A CN113673330A CN 113673330 A CN113673330 A CN 113673330A CN 202110797521 A CN202110797521 A CN 202110797521A CN 113673330 A CN113673330 A CN 113673330A
- Authority
- CN
- China
- Prior art keywords
- target object
- real
- monitoring
- symbol
- pixel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 205
- 238000000034 method Methods 0.000 title claims abstract description 56
- 238000012806 monitoring device Methods 0.000 claims description 31
- 238000004590 computer program Methods 0.000 claims description 15
- 238000009877 rendering Methods 0.000 claims description 6
- 238000004458 analytical method Methods 0.000 description 24
- 230000006855 networking Effects 0.000 description 23
- 238000010586 diagram Methods 0.000 description 19
- 230000008569 process Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 238000005538 encapsulation Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000009432 framing Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Abstract
The application provides a monitoring display method, a monitoring display device, electronic equipment and a storage medium, wherein the method comprises the following steps: acquiring a pixel coordinate set corresponding to a target object in a monitored image, wherein the pixel coordinate in the pixel coordinate set is used for determining the contour of the target object in the monitored image; drawing a symbol for marking the target object according to the pixel coordinates in the pixel coordinate set; and displaying the real-time monitoring video stream containing the monitoring image, and displaying the symbol in the real-time monitoring video stream, wherein the symbol moves along with the target object in real time. The method can draw the symbol for highlighting the target object and display the symbol moving along with the target object in real time in the video picture when playing the real-time monitoring video stream containing the target object appointed by the user, so that the user can visually see the target object in the picture and the watching experience of the user is enhanced, the target object monitoring purpose is achieved, and the real-time tracking of the target object is realized.
Description
Technical Field
The present application relates to the field of video processing technologies, and in particular, to a monitoring display method and apparatus, an electronic device, and a storage medium.
Background
Currently, with the popularization and development of the video networking service in the whole country, the video networking high-definition video networking interaction technology plays a significant role in other industries already in government departments. The most advanced worldwide Vision Vera real-time high-definition video exchange technology is adopted in the video networking, and the real-time transmission of the whole network high-definition video which cannot be realized by the Internet at present is realized. In the field of video networking, when a user analyzes a target object according to a surveillance video, the user can only view the surveillance video containing the target object on a display screen. However, the performance of this method for monitoring the target object is limited, and in some scenarios, it takes a long time for a user to identify the target object in the surveillance video, which results in a reduction in the efficiency of identification and analysis of the target object. Therefore, how to improve the efficiency of identifying and analyzing the target object becomes an urgent problem to be solved.
Disclosure of Invention
In view of the foregoing, the present application provides a monitoring display method, an apparatus, an electronic device, and a storage medium, which can draw a symbol for highlighting a target object when playing a real-time monitoring video stream containing the target object specified by a user, and display the symbol moving along with the target object in a video frame in real time, thereby implementing real-time tracking of the target object and improving the efficiency of identifying and analyzing the target object.
A first aspect of the present application provides a monitoring display method, including:
obtaining a pixel coordinate set corresponding to a target object in a monitored image, wherein pixel coordinates in the pixel coordinate set are used for determining the contour of the target object in the monitored image;
drawing a symbol for marking the target object according to the pixel coordinates in the pixel coordinate set;
and displaying a real-time monitoring video stream containing the monitoring image, and displaying the symbol in the real-time monitoring video stream, wherein the symbol moves along with the target object in real time.
Optionally, drawing a symbol for marking the target object according to the pixel coordinates in the pixel coordinate set includes:
determining the central coordinates of each pixel coordinate in the pixel coordinate set;
and drawing a symbol for marking the target object according to the central coordinate.
Optionally, rendering a symbol for marking the target object according to the center coordinates includes:
connecting pixel points corresponding to the pixel coordinates in the pixel coordinate set to obtain a curve frame of the target object in the monitored image;
drawing a preset image frame which takes the central coordinate as a geometric center and comprises the curve frame; or
And drawing an identifier associated with the target object at a position which is a preset distance away from the central coordinate in the outer area of the curve frame according to a preset direction by taking the central coordinate as a starting point.
Optionally, determining the center coordinate of each pixel coordinate in the pixel coordinate set includes:
obtaining a minimum rectangular frame containing each pixel coordinate in the pixel coordinate set;
and determining the coordinate at the diagonal intersection of the minimum rectangular frame as the center coordinate of the target object.
Optionally, obtaining a pixel coordinate set corresponding to a target object in the monitored image includes:
acquiring monitoring equipment information and characteristic information of a target object in a target area;
acquiring real-time monitoring video streams in the target area according to the monitoring equipment information in the target area;
identifying each frame of monitoring image containing the target object in the real-time monitoring video stream according to the characteristic information of the target object;
and aiming at the monitored images of the frames containing the target object, obtaining a pixel coordinate set corresponding to the target object.
Optionally, the method further comprises:
determining the equipment identifier of target monitoring equipment to which the real-time monitoring video stream containing the target object belongs;
displaying a real-time surveillance video stream containing the surveillance images, comprising:
and reading and displaying the real-time monitoring video stream containing the monitoring image from the target monitoring equipment according to the equipment identification of the target monitoring equipment.
Optionally, displaying a real-time surveillance video stream including the surveillance image, and displaying the symbol in the real-time surveillance video stream, where the symbol moves along with the target object in real time, includes:
when the target monitoring devices are multiple, dividing a display area into multiple sub-areas according with the number of the target monitoring devices;
displaying the real-time monitoring video stream corresponding to each target monitoring device in the display area according to the mode that one sub-area displays the real-time monitoring video stream of one target monitoring device, and displaying the symbol in each real-time monitoring video stream respectively, wherein the symbol moves along with the target object in real time.
A second aspect of the present application provides a monitoring display device, comprising:
the system comprises an obtaining module, a judging module and a judging module, wherein the obtaining module is used for obtaining a pixel coordinate set corresponding to a target object in a monitored image, and the pixel coordinate in the pixel coordinate set is used for determining the outline of the target object in the monitored image;
a drawing module for drawing a symbol for marking the target object according to the pixel coordinates in the pixel coordinate set;
and the display module is used for displaying the real-time monitoring video stream containing the monitoring image and displaying the symbol in the real-time monitoring video stream, wherein the symbol moves along with the target object in real time.
Optionally, the rendering module includes:
the first determining submodule is used for determining the central coordinate of each pixel coordinate in the pixel coordinate set;
and the first drawing submodule is used for drawing a symbol for marking the target object according to the central coordinate.
Optionally, the first rendering submodule includes:
the connection sub-module is used for connecting pixel points corresponding to the pixel coordinates in the pixel coordinate set to obtain a curve frame of the target object in the monitored image;
the second drawing submodule is used for drawing a preset image frame which takes the central coordinate as a geometric center and contains the curve frame; or
And the third drawing submodule is used for drawing the identifier associated with the target object at a position which is a preset distance away from the central coordinate in the outer area of the curve frame according to a preset direction by taking the central coordinate as a starting point.
Optionally, the first determining sub-module includes:
a first obtaining submodule, configured to obtain a minimum rectangular frame including coordinates of each pixel in the pixel coordinate set;
and the second determining submodule is used for determining the coordinate at the diagonal intersection of the minimum rectangular frame as the central coordinate of the target object.
Optionally, the obtaining module includes:
the second obtaining submodule is used for obtaining monitoring equipment information and characteristic information of a target object in the target area;
a third obtaining submodule, configured to obtain a real-time monitoring video stream in the target area according to the monitoring device information in the target area;
the identification submodule is used for identifying each frame containing the monitoring image of the target object in the real-time monitoring video stream according to the characteristic information of the target object;
and the fourth obtaining submodule is used for obtaining a pixel coordinate set corresponding to the target object aiming at the monitored images containing the target object in each frame.
Optionally, the apparatus further comprises:
the determining module is used for determining the equipment identifier of the target monitoring equipment to which the real-time monitoring video stream containing the target object belongs;
the display module includes:
and the first display sub-module is used for reading and displaying the real-time monitoring video stream containing the monitoring image from the target monitoring equipment according to the equipment identifier of the target monitoring equipment.
Optionally, the display module comprises:
the dividing submodule is used for dividing a display area into a plurality of sub-areas which are consistent with the number of the target monitoring devices when the target monitoring devices are multiple;
and the second display sub-module is used for displaying the real-time monitoring video streams corresponding to the target monitoring devices in the display area according to the mode that one sub-area displays the real-time monitoring video stream of one target monitoring device, and displaying the symbols in the real-time monitoring video streams respectively, wherein the symbols move along with the target object in real time.
A third aspect of the present application provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps in the method for monitoring a display as described in the first aspect of the present application.
A fourth aspect of the present application provides an electronic device, comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the steps of the monitoring display method according to the first aspect of the present application when executing the computer program.
By adopting the monitoring display method, the pixel coordinate set corresponding to the target object in the monitoring image is obtained, and the pixel coordinate in the pixel coordinate set is used for determining the outline of the target object in the monitoring image. Then, a symbol for marking the target object is drawn based on the pixel coordinates in the pixel coordinate set. And then displaying the real-time monitoring video stream containing the monitoring images, and displaying symbols in the real-time monitoring video stream, wherein the symbols move along with the target object in real time. The method can draw the symbol for highlighting the target object and display the symbol moving along with the target object in real time in the video picture when playing the real-time monitoring video stream containing the target object appointed by the user, so that the user can visually see the target object in the picture and the watching experience of the user is enhanced on one hand, the aim of monitoring the target object is achieved on the other hand, the real-time tracking of the target object is realized, and the identification and analysis efficiency of the target object is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings used in the description of the embodiments of the present application will be briefly described below.
FIG. 1 is a schematic diagram of a video networking system according to an embodiment of the present application;
FIG. 2 is a flow chart illustrating a monitoring display method according to an embodiment of the present application;
FIG. 3 is a diagram illustrating a curved box of a target object according to an embodiment of the present application;
FIG. 4 is a diagram illustrating a curved box of another target object according to an embodiment of the present application;
FIG. 5 is a schematic view of a surveillance video display result according to an embodiment of the present application;
FIG. 6 is a schematic diagram illustrating a process for obtaining a set of pixel coordinates according to an embodiment of the present application;
fig. 7 is a block diagram of a monitoring display device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Fig. 1 is a schematic structural diagram of an internet of view system according to an embodiment of the present application. In fig. 1, the video networking system comprises a video networking scheduling server, an intelligent analysis server, a feature recognition server, a protocol conversion server, a database and a video networking terminal. The video networking dispatching server is in communication connection with the database, the intelligent analysis server and the video networking terminal respectively, the feature recognition server is in communication connection with the intelligent analysis server, the cooperation server is in communication connection with the intelligent analysis server and the video networking terminal respectively, and all devices in the video networking system can communicate through a video networking protocol.
The application provides a monitoring display method which is applied to a video networking system shown in figure 1. Fig. 2 is a flowchart illustrating a monitoring display method according to an embodiment of the present application. With reference to fig. 2, the monitoring display method of the present application may specifically include the following steps:
step S21: and obtaining a pixel coordinate set corresponding to the target object in the monitored image, wherein the pixel coordinate in the pixel coordinate set is used for determining the contour of the target object in the monitored image.
In the present embodiment, steps S21-S23 may be performed by the video network terminal in the video network system shown in fig. 1.
In this embodiment, the target object may be an object pre-specified by a user, where the user refers to a user watching a real-time monitoring video stream. The target object may be any movable entity object, the types of which may include: a person, a vehicle, an animal, etc., and this embodiment is not particularly limited thereto.
The monitoring image is composed of a plurality of pixel points, and each pixel point has a pixel coordinate. The target object occupies a certain pixel area in the monitored image, and pixel coordinates of each pixel point on the edge contour of the pixel area form a pixel coordinate set corresponding to the target object.
The corresponding pixel coordinate sets of the same target object in different monitoring images are different. For example, the pose of the same person in different monitored images is different, which causes the outline thereof in the monitored image to be different, and thus the pixel coordinate set is also different. Illustratively, if the person 1 appears on the back side in the monitored image 1, appears on the front side in the monitored image 2, and appears on the side in the monitored image 3, the set a of pixel coordinates corresponding to the person 1 in the monitored image 1 is different from the set B of pixel coordinates corresponding to the person 1 in the monitored image 2, and the set C of pixel coordinates corresponding to the person 1 in the monitored image 3 is different.
In this embodiment, the video network terminal may obtain a pixel coordinate set corresponding to the target object in the monitored image from the video network scheduling server.
Step S22: and drawing a symbol for marking the target object according to the pixel coordinates in the pixel coordinate set.
In this embodiment, the symbol serves to highlight the target object so that the user can better monitor the target object while watching the real-time surveillance video stream. The type of the symbol may be a pattern, a letter, etc., and this embodiment is not particularly limited thereto.
In a specific implementation, step S22 may include:
and drawing a symbol for marking the target object according to a preset incidence relation between the pixel coordinates in the pixel coordinate set and the symbol.
In this embodiment, a plurality of association relationships between the symbol and the pixel coordinate may be preset, for example, the symbol is located at the center of a plurality of pixel coordinates, the symbol is a preset distance from a certain pixel coordinate, and the association relationships are not specifically limited in this embodiment.
Step S23: and displaying the real-time monitoring video stream containing the monitoring image, and displaying the symbol in the real-time monitoring video stream, wherein the symbol moves along with the target object in real time.
In this embodiment, the video network terminal may play a real-time monitoring video stream including a monitoring image, and display a symbol moving along with the target object in real time in a playing picture, so that a user can visually see the target object in the picture, thereby implementing real-time monitoring of the target object.
By adopting the monitoring display method, the pixel coordinate set corresponding to the target object in the monitoring image is obtained, and the pixel coordinate in the pixel coordinate set is used for determining the outline of the target object in the monitoring image. Then, a symbol for marking the target object is drawn based on the pixel coordinates in the pixel coordinate set. And then displaying the real-time monitoring video stream containing the monitoring images, and displaying symbols in the real-time monitoring video stream, wherein the symbols move along with the target object in real time. The method can draw the symbol for highlighting the target object and display the symbol moving along with the target object in real time in the video picture when playing the real-time monitoring video stream containing the target object appointed by the user, so that the user can visually see the target object in the picture and the watching experience of the user is enhanced on one hand, the aim of monitoring the target object is achieved on the other hand, the real-time tracking of the target object is realized, and the identification and analysis efficiency of the target object is improved.
In one implementation, in combination with the above embodiments, the present application further provides a method of drawing a symbol for marking a target object. Specifically, the step S22 may specifically include:
determining the central coordinates of each pixel coordinate in the pixel coordinate set;
from the center coordinates, a symbol for marking the target object is drawn.
For a frame of monitored image, after obtaining a pixel coordinate set corresponding to a target object therein, the terminal of the video network may calculate a center coordinate of each pixel coordinate in the pixel coordinate set.
In a specific implementation, drawing a symbol for marking the target object according to the center coordinates may include:
and drawing a symbol for marking the target object according to the central coordinate of the target object and a preset incidence relation between the central coordinate and the symbol. For example, the terminal of the internet of view may draw the symbol for marking the target object at the center coordinate, or may draw the symbol for marking the target object at a position away from the center coordinate by a preset distance, and the preset association relationship between the center coordinate and the symbol is not particularly limited in this embodiment.
In the embodiment, the symbol used for marking the target object is drawn for the target object in each frame of the monitoring image, so that the user can more intuitively see the target object when watching the real-time monitoring video stream.
With reference to the foregoing embodiment, in an implementation manner, drawing a symbol for marking a target object according to a center coordinate may specifically include:
connecting pixel points corresponding to the pixel coordinates in the pixel coordinate set to obtain a curve frame of the target object in the monitored image;
drawing a preset image frame which takes the central coordinate as a geometric center and comprises a curve frame; or
And drawing the identifier associated with the target object at a position which is a preset distance away from the central coordinate in the outer area of the curve frame according to a preset direction by taking the central coordinate as a starting point.
In this embodiment, since the pixel coordinates in the pixel coordinate set are used to determine the contour of the target object in the monitored image, a curve frame of the target object in the monitored image can be obtained by connecting the pixel points corresponding to the pixel coordinates in the pixel coordinate set, where the curve frame is the contour of the target object.
In order to better describe the monitoring display method of the present application, it is specifically explained herein that the target object in the following embodiments refers to a face image, and of course, the target object may also be a complete figure of a person, a complete figure of a vehicle, a complete figure of an animal, and the like.
When the target object is a face image, the resulting contour may be as shown in fig. 3. Fig. 3 is a diagram illustrating a curved box of a target object according to an embodiment of the present application.
In practical implementation, if the more pixel coordinates in the pixel coordinate set, the drawn curve frame is closer to the outline of the real target object. The more the time duration is needed when the pixel coordinates with the larger number are collected, and the more the time duration is needed by the video network terminal to calculate the outline of the target object according to the pixel coordinate set, so that the efficiency of drawing the symbol is reduced. Thus, the present application also provides a simplified version of the outline, as shown in FIG. 4. Fig. 4 is a diagram illustrating a curve box of another target object according to an embodiment of the present application. In fig. 4, the outer thick solid line rectangular box is the outline of the simplified target object, and the rectangular box is actually the smallest rectangular box that can contain the real outline of fig. 3. Therefore, the simplified outline can be directly determined according to the A, B, C and the pixel coordinates of the four pixels D, so that the pixel coordinates of all the pixels on the real outline do not need to be collected in advance, and only the pixel coordinates on the four vertexes of the minimum rectangular frame need to be collected, so that the time for collecting the pixel coordinates and the time for calculating the outline of the target object are reduced, and the efficiency of drawing the symbol is improved.
On this basis, the present embodiment provides two methods for drawing symbols, including:
firstly, drawing a preset image frame which takes the central coordinate as a geometric center and comprises a curve frame.
And secondly, drawing an identifier associated with the target object at a position which is a preset distance away from the central coordinate in the outer area of the curve frame according to a preset direction by taking the central coordinate as a starting point.
The preset image frame may be a graphic frame with any shape, such as a rectangular frame, a circular frame, and the like, and the mark may be a pattern mark or a character mark. Associated with the target object means that the target object may be highlighted. The present embodiment does not specifically limit the shape, the type, and the content of the image frame.
For the first way, if the contour of the target object is a real contour (as in fig. 3), a preset image frame completely containing the real contour can be drawn by taking the center coordinate as the geometric center, and a rectangular frame in the monitoring image 1 as in fig. 5 is a symbol for marking the target object. If the contour of the target object is a simplified contour (see fig. 4), since the center coordinates are the diagonal intersection position coordinates of the simplified contour, the simplified contour can be directly used as a symbol for marking the target object, as shown in the monitoring image 2 in fig. 5. Fig. 5 is a schematic diagram of a monitoring video display result according to an embodiment of the present application.
With respect to the second way, if the contour of the target object is a real contour, the identifier associated with the target object may be drawn at a position outside the real contour and at a preset distance from the center coordinate according to a preset direction with the center coordinate as a starting point, and the character "target object" in the monitoring image 3 in fig. 5 is a symbol for marking the target object. If the contour of the target object is a simplified contour, the identifier associated with the target object may be rendered at a position outside the simplified contour at a preset distance from the center coordinate according to a preset direction with the center coordinate as a starting point, and the exclamation point in the monitoring image 4 in fig. 5 is a symbol for marking the target object.
The embodiment provides a plurality of symbols which can be drawn to mark the target object, so that a user can monitor the target object in a key mode, and display modes of monitoring time frequency are enriched.
With reference to the foregoing embodiment, in an implementation manner, determining a center coordinate of each pixel coordinate in a pixel coordinate set may specifically include the following steps:
obtaining a minimum rectangular frame containing each pixel coordinate in the pixel coordinate set;
and determining the coordinate at the diagonal intersection of the minimum rectangular frame as the center coordinate of the target object.
In the present embodiment, the smallest rectangular frame containing the coordinates of each pixel in the pixel coordinate set is the rectangular frame in fig. 4, i.e., the simplified outline. The center of the smallest rectangular box (simplified outline) can be the center coordinate of the target object.
In this embodiment, the terminal of the video network may obtain a pixel coordinate set from the scheduling server of the video network, where the pixel coordinate set includes pixel coordinates of four vertices of the minimum rectangular frame, and the terminal of the video network may determine the minimum rectangular frame and the coordinate center according to the pixel coordinates of the four vertices.
In this embodiment, the terminal of the video network does not need to perform complex calculation, and can quickly obtain the coordinate center according to the pixel coordinates of the four vertexes of the minimum rectangular frame, thereby further improving the efficiency of drawing the symbol.
With reference to the foregoing embodiments, in one implementation manner, the present application further provides a method for obtaining a pixel coordinate set corresponding to a target object in a monitored image. Specifically, the step S21 may include:
acquiring monitoring equipment information and characteristic information of a target object in a target area;
acquiring real-time monitoring video streams in a target area according to monitoring equipment information in the target area;
identifying each frame of monitoring image containing the target object in the real-time monitoring video stream according to the characteristic information of the target object;
and aiming at the monitored images of the frames containing the target object, obtaining a pixel coordinate set corresponding to the target object.
In this embodiment, a user may log in the video networking scheduling server, select a target area on a user configuration page, and input feature information of a target object to be monitored. The target area is a geographical area or an administrative area that is divided in advance, and the size and the range of the target area are not particularly limited in this embodiment. The feature information of the target object may be feature information for uniquely identifying the target object, for example, when the target object is a person, the feature information may be face information, and when the target object is a vehicle, the feature information may be a license plate number of the vehicle, for example, the embodiment does not specifically limit the target object and the feature information thereof.
And the video network scheduling server acquires the monitoring equipment information in the target area according to the target area selected by the user, and then stores the target area, the characteristic information of the target object and the monitoring equipment information in the target area in a database. The monitoring device information refers to device IDs of respective monitoring devices, and one device ID may uniquely correspond to one monitoring device in the target area. And then, the video networking dispatching server issues the characteristic information of the target object and the monitoring equipment information in the target area to the intelligent analysis server through a video networking protocol. The intelligent analysis server transmits the characteristic information of the target object to the characteristic identification server on one hand, and on the other hand, according to the monitoring equipment information, the real-time monitoring video stream is called and received from the coordination server through the video networking protocol, the real-time monitoring video stream is converted into an RTSP protocol encapsulation packet, and the encapsulation packet is transmitted to the characteristic identification server in real time. Wherein, transfer and receive the real-time monitoring video stream from the cooperative conversion server through the video networking agreement, include: the intelligent analysis server sends the monitoring equipment information to the coordination server, the coordination server calls real-time monitoring video streams from the monitoring equipment corresponding to the monitoring equipment IDs, and the called real-time monitoring video streams are transmitted to the intelligent analysis server.
Then, the feature recognition server recognizes each frame of monitoring image containing the target object in the real-time monitoring video stream according to the feature information of the target object, and then obtains a pixel coordinate set corresponding to the target object for each frame of monitoring image containing the target object.
When obtaining the pixel coordinate set corresponding to the target object, the feature recognition server may perform the following steps:
obtaining the farthest pixel points of the region where the target object is located in the upper, lower, left and right directions of the monitored image;
determining a first horizontal line containing the farthest pixel points in the upper direction and a second horizontal line containing the farthest pixel points in the lower direction;
determining a first vertical line including a farthest pixel point in a left direction and a second vertical line including a farthest pixel point in a right direction;
the frame surrounded by the first horizontal line, the second horizontal line, the first vertical line and the second vertical line is a minimum rectangular frame. The pixel point at the intersection point (the upper left vertex of the minimum rectangular frame) of the first horizontal line and the first vertical line is a first pixel point, the pixel point at the intersection point (the upper right vertex of the minimum rectangular frame) of the first horizontal line and the second vertical line is a second pixel point, the pixel point at the intersection point (the lower left vertex of the minimum rectangular frame) of the first horizontal line and the first vertical line is a third pixel point, and the pixel point at the intersection point (the lower right vertex of the minimum rectangular frame) of the second horizontal line and the second vertical line is a fourth pixel point.
Fig. 6 is a schematic diagram illustrating a process of obtaining a pixel coordinate set according to an embodiment of the present application. In fig. 6, four black dots on the contour of the target object represent the farthest pixel points in the four directions of the monitoring image, and the first horizontal line, the second horizontal line, the first vertical line, and the second vertical line can be determined according to the four farthest pixel points, so as to obtain the first pixel point a, the second pixel point B, the third pixel point C, and the fourth pixel point D.
And then, adding the first pixel point to the fourth pixel point into a pixel coordinate set by the characteristic identification server, sending the identified monitoring image containing the target object and the pixel coordinate set corresponding to the target object in each frame of monitoring image to an intelligent analysis server, and sending the pixel coordinate set to a video network terminal by the intelligent analysis server through a video network scheduling server.
With reference to the above embodiments, in one implementation, the method of the present application may further include:
and determining the equipment identification of the target monitoring equipment to which the real-time monitoring video stream containing the target object belongs.
On the basis, the real-time monitoring video stream containing the monitoring image is displayed, and the method comprises the following steps:
and reading and displaying the real-time monitoring video stream containing the monitoring image from the target monitoring equipment according to the equipment identification of the target monitoring equipment.
In this embodiment, when the feature recognition server recognizes that each frame includes a monitoring image of a target object in the real-time monitoring video stream, it may also determine target monitoring devices to which the monitoring images belong, and obtain device identifiers of the target monitoring devices.
And then, the feature recognition server can also send the equipment identifier of the target monitoring equipment to the intelligent analysis server, and the intelligent analysis server sends the equipment identifier to the video network terminal through the video network scheduling server, so that the video network terminal can subsequently call the monitoring video stream containing the target object from the target monitoring equipment.
In combination with the above embodiment, in an implementation manner, the step S23 may include:
when a plurality of target monitoring devices are arranged, dividing the display area into a plurality of sub-areas which are consistent with the number of the target monitoring devices;
displaying the real-time monitoring video streams corresponding to the target monitoring devices in the display area according to the mode that one sub-area displays the real-time monitoring video stream of one target monitoring device, and displaying symbols in the real-time monitoring video streams respectively, wherein the symbols move along with the target object in real time.
In this embodiment, there may be a plurality of target monitoring devices including a target object, and when there are a plurality of target monitoring devices, the video network terminal may divide the display area into a plurality of sub-areas having the same number as the target monitoring devices, and one sub-area is used to display the real-time monitoring video stream of one target monitoring device.
In the embodiment, the real-time monitoring video stream can be displayed through the plurality of sub-areas, so that a user can better monitor the target object and realize real-time tracking of the target object.
The monitoring display method of the present application will be described in detail with reference to fig. 1 as an embodiment.
Step 1: and the user logs in the video network scheduling server, and inputs the face information of the target person A to be monitored and the longitude and latitude information of the target geographic area on a user configuration page.
Step 2: and the video network scheduling server acquires the monitoring equipment information in the target geographic area according to the longitude and latitude information of the target geographic area, and then stores the target geographic area, the face information of the target person A and the monitoring equipment information in the target geographic area in a database.
And step 3: and the video networking scheduling server issues the monitoring equipment information in the target geographic area and the face information of the target person A to the intelligent analysis server through a video networking protocol.
And 4, step 4: and the intelligent analysis server sends the face information of the target person A to the feature recognition server through the IP network.
And 5: the intelligent analysis server sends the monitoring equipment information to the coordination server through a video networking protocol, the coordination server calls real-time monitoring video streams from the monitoring equipment corresponding to the monitoring equipment IDs, and the called real-time monitoring video streams are transmitted to the intelligent analysis server.
Step 6: the intelligent analysis server converts the real-time monitoring video stream into an RTSP protocol and transmits the RTSP protocol to the feature recognition server in real time through an IP network.
And 7: the feature recognition server starts to analyze the real-time monitoring video stream, recognizes the monitoring images containing the face information of the target person A, and then sends the monitoring images, the equipment identification of the monitoring equipment to which the monitoring images belong, and the pixel coordinate set corresponding to the target object in the monitoring images to the intelligent analysis server in real time.
And 8: and the intelligent analysis server transmits the monitoring image, the equipment identifier of the monitoring equipment to which the monitoring image belongs and the pixel coordinate set corresponding to the target object in the monitoring image to the video network scheduling server through a video network protocol.
And step 9: and the video network scheduling server sends the monitoring image, the equipment identifier of the monitoring equipment to which the monitoring image belongs and the pixel coordinate set corresponding to the target object in the monitoring image to the video network terminal through a video network protocol.
Step 10: and the video network terminal calls the real-time monitoring video stream from the cooperative conversion server according to the returned equipment identification of the monitoring equipment and plays the real-time monitoring video stream. During playing, the video network terminal determines a center coordinate according to each pixel coordinate in the pixel coordinate set aiming at each frame of the monitoring picture image containing the target person A, then draws a rectangular frame for framing the target person A according to the center coordinate, and finally displays the rectangular frame moving along with the target person A in the monitoring picture image in real time.
The method can carry out linkage control on the monitoring point positions of the heavy point area, fully utilizes the characteristic identification analysis technology, can realize real-time tracking display on the control object according to the identified position information and coordinate information of the control object, and improves the identification analysis efficiency of the control object.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
Based on the same inventive concept, the present application provides a monitoring display device 700. Fig. 7 is a block diagram of a monitoring display device according to an embodiment of the present application. Referring to fig. 7, the monitoring display device 700 of the present application may include:
an obtaining module 701, configured to obtain a pixel coordinate set corresponding to a target object in a monitored image, where a pixel coordinate in the pixel coordinate set is used to determine a contour of the target object in the monitored image;
a drawing module 702, configured to draw a symbol for marking the target object according to the pixel coordinates in the pixel coordinate set;
a display module 703, configured to display a real-time monitoring video stream including the monitoring image, and display the symbol in the real-time monitoring video stream, where the symbol moves along with the target object in real time.
Optionally, the drawing module 702 includes:
the first determining submodule is used for determining the central coordinate of each pixel coordinate in the pixel coordinate set;
and the first drawing submodule is used for drawing a symbol for marking the target object according to the central coordinate.
Optionally, the first rendering submodule includes:
the connection sub-module is used for connecting pixel points corresponding to the pixel coordinates in the pixel coordinate set to obtain a curve frame of the target object in the monitored image;
the second drawing submodule is used for drawing a preset image frame which takes the central coordinate as a geometric center and contains the curve frame; or
And the third drawing submodule is used for drawing the identifier associated with the target object at a position which is a preset distance away from the central coordinate in the outer area of the curve frame according to a preset direction by taking the central coordinate as a starting point.
Optionally, the first determining sub-module includes:
a first obtaining submodule, configured to obtain a minimum rectangular frame including coordinates of each pixel in the pixel coordinate set;
and the second determining submodule is used for determining the coordinate at the diagonal intersection of the minimum rectangular frame as the central coordinate of the target object.
Optionally, the obtaining module 701 includes:
the second obtaining submodule is used for obtaining monitoring equipment information and characteristic information of a target object in the target area;
a third obtaining submodule, configured to obtain a real-time monitoring video stream in the target area according to the monitoring device information in the target area;
the identification submodule is used for identifying each frame containing the monitoring image of the target object in the real-time monitoring video stream according to the characteristic information of the target object;
and the fourth obtaining submodule is used for obtaining a pixel coordinate set corresponding to the target object aiming at the monitored images containing the target object in each frame.
Optionally, the apparatus 700 further comprises:
the determining module is used for determining the equipment identifier of the target monitoring equipment to which the real-time monitoring video stream containing the target object belongs;
the display module 703 includes:
and the first display sub-module is used for reading and displaying the real-time monitoring video stream containing the monitoring image from the target monitoring equipment according to the equipment identifier of the target monitoring equipment.
Optionally, the display module 703 includes:
the dividing submodule is used for dividing a display area into a plurality of sub-areas which are consistent with the number of the target monitoring devices when the target monitoring devices are multiple;
and the second display sub-module is used for displaying the real-time monitoring video streams corresponding to the target monitoring devices in the display area according to the mode that one sub-area displays the real-time monitoring video stream of one target monitoring device, and displaying the symbols in the real-time monitoring video streams respectively, wherein the symbols move along with the target object in real time.
Based on the same inventive concept, the present application provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and capable of running on the processor, and when the processor executes the computer program, the electronic device implements the steps in the conference resuming method according to any of the embodiments of the present application.
Based on the same inventive concept, the present application provides a computer-readable storage medium, on which a computer program is stored, which when executed by a processor implements the steps in the conference resuming method according to any of the above-mentioned embodiments of the present application.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or terminal equipment comprising the element.
The monitoring display method, the monitoring display device, the electronic device and the storage medium provided by the invention are described in detail, a specific example is applied in the text to explain the principle and the implementation of the invention, and the description of the above embodiment is only used to help understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. A method for monitoring display, the method comprising:
obtaining a pixel coordinate set corresponding to a target object in a monitored image, wherein pixel coordinates in the pixel coordinate set are used for determining the contour of the target object in the monitored image;
drawing a symbol for marking the target object according to the pixel coordinates in the pixel coordinate set;
and displaying a real-time monitoring video stream containing the monitoring image, and displaying the symbol in the real-time monitoring video stream, wherein the symbol moves along with the target object in real time.
2. The method of claim 1, wherein rendering a symbol for marking the target object according to pixel coordinates in the set of pixel coordinates comprises:
determining the central coordinates of each pixel coordinate in the pixel coordinate set;
and drawing a symbol for marking the target object according to the central coordinate.
3. The method of claim 2, wherein rendering a symbol for marking the target object based on the center coordinates comprises:
connecting pixel points corresponding to the pixel coordinates in the pixel coordinate set to obtain a curve frame of the target object in the monitored image;
drawing a preset image frame which takes the central coordinate as a geometric center and comprises the curve frame; or
And drawing an identifier associated with the target object at a position which is a preset distance away from the central coordinate in the outer area of the curve frame according to a preset direction by taking the central coordinate as a starting point.
4. The method of claim 2, wherein determining the center coordinate of each pixel coordinate in the set of pixel coordinates comprises:
obtaining a minimum rectangular frame containing each pixel coordinate in the pixel coordinate set;
and determining the coordinate at the diagonal intersection of the minimum rectangular frame as the center coordinate of the target object.
5. The method of claim 1, wherein obtaining a set of pixel coordinates corresponding to a target object in the monitored image comprises:
acquiring monitoring equipment information and characteristic information of a target object in a target area;
acquiring real-time monitoring video streams in the target area according to the monitoring equipment information in the target area;
identifying each frame of monitoring image containing the target object in the real-time monitoring video stream according to the characteristic information of the target object;
and aiming at the monitored images of the frames containing the target object, obtaining a pixel coordinate set corresponding to the target object.
6. The method of claim 5, further comprising:
determining the equipment identifier of target monitoring equipment to which the real-time monitoring video stream containing the target object belongs;
displaying a real-time surveillance video stream containing the surveillance images, comprising:
and reading and displaying the real-time monitoring video stream containing the monitoring image from the target monitoring equipment according to the equipment identification of the target monitoring equipment.
7. The method of claim 6, wherein displaying a real-time surveillance video stream containing the surveillance images and displaying the symbol in the real-time surveillance video stream, the symbol moving in real-time with the target object, comprises:
when the target monitoring devices are multiple, dividing a display area into multiple sub-areas according with the number of the target monitoring devices;
displaying the real-time monitoring video stream corresponding to each target monitoring device in the display area according to the mode that one sub-area displays the real-time monitoring video stream of one target monitoring device, and displaying the symbol in each real-time monitoring video stream respectively, wherein the symbol moves along with the target object in real time.
8. A monitor display device, comprising:
the system comprises an obtaining module, a judging module and a judging module, wherein the obtaining module is used for obtaining a pixel coordinate set corresponding to a target object in a monitored image, and the pixel coordinate in the pixel coordinate set is used for determining the outline of the target object in the monitored image;
a drawing module for drawing a symbol for marking the target object according to the pixel coordinates in the pixel coordinate set;
and the display module is used for displaying the real-time monitoring video stream containing the monitoring image and displaying the symbol in the real-time monitoring video stream, wherein the symbol moves along with the target object in real time.
9. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method for monitoring a display according to any one of claims 1 to 7.
10. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor when executing performs the steps of the method for monitoring display of any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110797521.4A CN113673330A (en) | 2021-07-14 | 2021-07-14 | Monitoring display method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110797521.4A CN113673330A (en) | 2021-07-14 | 2021-07-14 | Monitoring display method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113673330A true CN113673330A (en) | 2021-11-19 |
Family
ID=78539165
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110797521.4A Pending CN113673330A (en) | 2021-07-14 | 2021-07-14 | Monitoring display method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113673330A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117407480A (en) * | 2023-12-14 | 2024-01-16 | 杭州计算机外部设备研究所(中国电子科技集团公司第五十二研究所) | Map display method and device based on photoelectric holder |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104519319A (en) * | 2014-12-11 | 2015-04-15 | 北京中星微电子有限公司 | Method and device for surveillance video display of electronic map |
| US20170116496A1 (en) * | 2013-02-08 | 2017-04-27 | Chuck Fung | Method, system and processor for instantly recognizing and positioning an object |
| CN111243105A (en) * | 2020-01-15 | 2020-06-05 | Oppo广东移动通信有限公司 | Augmented reality processing method and device, storage medium and electronic equipment |
| CN111918023A (en) * | 2020-06-29 | 2020-11-10 | 北京大学 | Monitoring target tracking method and device |
| CN112468765A (en) * | 2019-09-06 | 2021-03-09 | 杭州海康威视系统技术有限公司 | Method, device, system, equipment and storage medium for tracking target object |
-
2021
- 2021-07-14 CN CN202110797521.4A patent/CN113673330A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170116496A1 (en) * | 2013-02-08 | 2017-04-27 | Chuck Fung | Method, system and processor for instantly recognizing and positioning an object |
| CN104519319A (en) * | 2014-12-11 | 2015-04-15 | 北京中星微电子有限公司 | Method and device for surveillance video display of electronic map |
| CN112468765A (en) * | 2019-09-06 | 2021-03-09 | 杭州海康威视系统技术有限公司 | Method, device, system, equipment and storage medium for tracking target object |
| CN111243105A (en) * | 2020-01-15 | 2020-06-05 | Oppo广东移动通信有限公司 | Augmented reality processing method and device, storage medium and electronic equipment |
| CN111918023A (en) * | 2020-06-29 | 2020-11-10 | 北京大学 | Monitoring target tracking method and device |
Non-Patent Citations (3)
| Title |
|---|
| 李弈星;: "视联网的特征与关键技术研究", 科技展望, no. 28, 10 October 2016 (2016-10-10) * |
| 潘安君，张凯，李强，张桂林: "多目标跟踪", 系统工程与电子技术, no. 08, 20 August 1994 (1994-08-20) * |
| 盛家川;杨巍;海岩;: "监控视频中运动目标的自动检测、跟踪和提取", 企业技术开发, no. 12, 26 April 2015 (2015-04-26) * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117407480A (en) * | 2023-12-14 | 2024-01-16 | 杭州计算机外部设备研究所(中国电子科技集团公司第五十二研究所) | Map display method and device based on photoelectric holder |
| CN117407480B (en) * | 2023-12-14 | 2024-03-19 | 杭州计算机外部设备研究所(中国电子科技集团公司第五十二研究所) | Map display method and device based on photoelectric holder |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109862414B (en) | Mask bullet screen display method and device and server | |
| CN107004271B (en) | Display method, display apparatus, electronic device, computer program product, and storage medium | |
| CN107977922B (en) | Image analysis method, device and system | |
| CN102750555B (en) | Expression identification device applied to instant messaging tool | |
| WO2021031731A1 (en) | Remote assistance method, apparatus and system | |
| WO2017101487A1 (en) | Method and device for submitting transcoding attribute information | |
| CN108304839B (en) | Image data processing method and device | |
| CN111985373A (en) | Safety early warning method and device based on traffic intersection identification and electronic equipment | |
| CN113673330A (en) | Monitoring display method and device, electronic equipment and storage medium | |
| CN114095722A (en) | Definition determining method, device and equipment | |
| CN114267213A (en) | Real-time demonstration method, device, equipment and storage medium for practical training | |
| US20160117553A1 (en) | Method, device and system for realizing visual identification | |
| CN111314649B (en) | Method and device for establishing video conference and video conference system | |
| CN108427935B (en) | Street view comparison image generation method and device | |
| CN110381353A (en) | Video scaling method, apparatus, server-side, client and storage medium | |
| CN115633147A (en) | Multi-user remote cooperative guidance system based on 5G multiple visual angles | |
| EP4290452A1 (en) | Data generation method and apparatus, and electronic device | |
| CN113536129A (en) | Service push method and related product | |
| CN113486941B (en) | Live image training sample generation method, model training method and electronic equipment | |
| CN114697603A (en) | Meeting place picture detection method and system for video conference | |
| CN103051934A (en) | Intelligent television human-machine interaction method, device and system | |
| CN112422907A (en) | Image processing method, device and system | |
| CN111259182A (en) | Method and device for searching screen shot image | |
| CN110740256A (en) | ring camera cooperation method and related product | |
| CN111340656A (en) | Method, system and storage medium for checking legitimacy of land resource law enforcement site |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |