CN114120231A - Intelligent monitoring system and method for court - Google Patents
Intelligent monitoring system and method for court Download PDFInfo
- Publication number
- CN114120231A CN114120231A CN202111414156.0A CN202111414156A CN114120231A CN 114120231 A CN114120231 A CN 114120231A CN 202111414156 A CN202111414156 A CN 202111414156A CN 114120231 A CN114120231 A CN 114120231A
- Authority
- CN
- China
- Prior art keywords
- court
- data
- module
- intelligent
- players
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses an intelligent monitoring system and method for a court, and relates to the technical field of court monitoring. The intelligent player tracking system comprises a hardware module, an intelligent chip, a data processing module and a front-end host, wherein the hardware module is used for video stream acquisition, video stream processing and video display, the intelligent chip is used for identifying players and tracking and switching players and generating player positioning information and running data, the data processing module is used for transcoding and distributing data in media protocols such as rtsp, rtmp, hls and the like, and the front-end host is used for controlling the system. The invention can identify players in the court, judge whether to hold the ball or not, automatically follow the focus, track the players, position the players, generate player positioning information, running data and the like by arranging the intelligent chip, and realize transcoding and distribution of media protocols such as rtsp, rtmp, hls and the like by adopting a data processing module based on an FFmpeg frame.
Description
Technical Field
The invention belongs to the technical field of court monitoring, and particularly relates to an intelligent court monitoring system and method.
Background
The monitoring system is one of the most applied systems in the security system, is also commonly used in a court and is used for capturing players in pictures and tracking the players, but the existing court monitoring system and the existing monitoring equipment do not have an intelligent identification chip, do not have the functions of player identification, zoom tracking, picture coordinate positioning and the like, and support a single video stream protocol.
Disclosure of Invention
The invention aims to provide a system and a method for intelligently monitoring a court, which aim to solve the existing problems: the existing court monitoring system and the existing monitoring equipment do not have an intelligent identification chip, and do not have the functions of player identification, zooming tracking, picture coordinate positioning and the like, and the supported video stream protocol is single.
In order to solve the technical problems, the invention is realized by the following technical scheme: an intelligent monitoring system for a court comprises a hardware module, an intelligent chip, a data processing module and a front-end host;
the hardware module is used for video stream acquisition, video stream processing and video display;
the intelligent chip is used for identifying players, tracking and switching players and generating player positioning information and running data;
the data processing module is used for transcoding and distributing the data in media protocols such as rtsp, rtmp, hls and the like;
the front-end host is used for controlling the system.
Furthermore, the hardware module comprises a camera, a development board and a display, the camera is used for collecting video streams, the camera is connected with the development board through an MIPI interface, the development board identifies the video streams, and the development board outputs results to the display through an HDMI interface.
Furthermore, the intelligent chip comprises a face recognition module, an automatic focus following module and a positioning module.
Furthermore, the face recognition module is used for recognizing the face, the color and the number of clothes of the player and whether the player holds the ball.
Further, the automatic focus following module is used for tracking the player, judging the person who holds the ball, and following, the person who holds the ball changes the back, follows the player of replacing.
Furthermore, the positioning module is used for capturing the edge in the monitoring picture, forming a complete two-dimensional plane map of the court, and generating player positioning information and running data.
Furthermore, the Face recognition module is based on an opencv frame, uses an Ultra Light Fast Generic Face Detector lightweight universal Face detection model, and realizes the prediction of the Face position through the pre-training of a data set, thereby completing the Face detection.
Furthermore, the automatic focus following module is a self-adaptive zooming algorithm developed based on opencv, analyzes the gray difference between adjacent pixels through received image signals, drives the zoom lens to adjust the focal length and calculates the change of the gray difference result, and achieves the purpose of automatic zooming.
Further, the positioning module manually calibrates 4 points at the corner of the court in the camera picture based on a homography algorithm, and marks the position of a player according to the yolov3 model based on the homography algorithm, so as to calculate the relative position of the player in the court.
An intelligent monitoring method for a court;
the method comprises the following steps:
s1: collecting video stream through a camera;
s2: the acquired video stream is transmitted to an intelligent chip, and the video stream is subjected to data processing;
s3: the collected data is pre-trained through a face recognition module, the face position is predicted, face detection is completed, and data such as the color and the number of clothes of players, whether the players hold a ball and the like are acquired;
s4: meanwhile, the automatic focus following module judges the ball holding person and follows the ball holding person, and the ball holding person follows the replacement player after changing;
s5: meanwhile, the edges in the monitoring picture can be captured through the positioning module, a complete two-dimensional plane graph of the court is formed, and player positioning information, running data and the like are generated;
s6: transmitting the obtained data to a development board, and processing the data;
s7: then, the data is transmitted to a data processing module, and the data is transcoded and distributed according to media protocols such as rtsp, rtmp, hls and the like;
s8: and (5) transferring the transcoded data to a front-end host and then putting the data on a display.
The invention has the following beneficial effects:
the invention can identify players in the court, judge whether to hold the ball or not, automatically follow the focus, track the players, position the players, generate player positioning information, running data and the like by arranging the intelligent chip, and realize transcoding and distribution of media protocols such as rtsp, rtmp, hls and the like by adopting a data processing module based on an FFmpeg frame.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic structural diagram of an intelligent monitoring system for a court of ball of the present invention;
FIG. 2 is a flow chart of face detection of an intelligent monitoring system for a court of ball of the invention;
FIG. 3 is a flow chart of adaptive zooming of an intelligent monitoring system for a court of ball game according to the present invention;
FIG. 4 is a flow chart of personnel location of an intelligent monitoring system for a court of ball of the present invention;
fig. 5 is a data acquisition flow chart of an intelligent monitoring system for a court of ball.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The invention relates to an intelligent monitoring system for a court, which comprises a hardware module, an intelligent chip, a data processing module and a front-end host, wherein the data processing module is based on an FFmpeg frame, can realize transcoding and distribution of media protocols such as rtsp, rtmp, hls and the like, and transmits video data after transcoding and distribution to the front-end host, thereby being capable of supporting various video stream protocols;
the intelligent chip consists of a face recognition module, an automatic focus following module and a positioning module;
referring to fig. 2, the Face recognition module may recognize a Face, a color and a number of clothes of a player, whether the player holds a ball, and the like, the Face recognition is based on an opencv frame, and the prediction of a Face position is realized by using an Ultra Light Fast Generic Face Detector lightweight universal Face detection model through pre-training of a data set, so as to complete Face detection;
referring to fig. 3, the automatic focus following module can track a player, judge a ball holder, follow the ball holder, and follow a replacement player after the ball holder is changed, the automatic focus following module adopts an opencv-based adaptive zooming algorithm, analyzes gray level differences between adjacent pixels through received image signals, drives a zoom lens to adjust focal length, and calculates the change of the gray level difference result, so as to achieve the purpose of automatic zooming;
referring to fig. 4, the positioning module can capture the edge in the monitoring picture to form a complete two-dimensional plane diagram of the court, generate player positioning information, running data and the like, and the positioning module manually marks 4 points at the corner of the court in the camera picture based on a homography algorithm and marks the position of a player according to a yolov3 model based on the homography algorithm, so as to calculate the relative position of the player in the court;
referring to fig. 1, the hardware module includes a camera, a development board and a display, the camera is used for collecting video streams, the model of the camera is Sony IMX 274, the camera is connected with the development board through an MIPI interface, the model of the development board is Zynq ZCU 102, the development board identifies the video streams, and the development board outputs results to the display through an HDMI interface.
An intelligent monitoring method for a court;
the method comprises the following steps:
the first step is as follows: collecting video stream and audio data in the stadium through a camera;
the second step is that: the acquired video stream and audio data are transmitted to an intelligent chip and are processed;
the third step: the collected data is pre-trained through a face recognition module, the face position is predicted, face detection is completed, and data such as the color and the number of clothes of players, whether the players hold a ball and the like are acquired;
the fourth step: meanwhile, the image signals received by the automatic focus following module are used for analyzing the gray difference between adjacent pixels, driving the zoom lens to adjust the focal length and calculating the change of the gray difference result, so that the purpose of automatic zooming is achieved, meanwhile, the ball holding person is judged and followed, and the ball holding person is changed and then follows the player;
the fifth step: meanwhile, the edges in the monitoring picture can be captured through the positioning module, a complete two-dimensional plane graph of the court is formed based on a homography conversion algorithm by combining preset court sizes, and player positioning information, running data and the like are generated;
and a sixth step: transmitting the obtained data to a development board, and processing the data;
the seventh step: then, the processed data is transmitted to a data processing module, and the data is transcoded and distributed according to media protocols such as rtsp, rtmp, hls and the like;
eighth step: and (5) transferring the transcoded data to a front-end host and then putting the data on a display.
In the description herein, references to the description of "one embodiment," "an example," "a specific example" or the like are intended to mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
The preferred embodiments of the invention disclosed above are intended to be illustrative only. The preferred embodiments are not intended to be exhaustive or to limit the invention to the precise embodiments disclosed. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the invention and the practical application, to thereby enable others skilled in the art to best utilize the invention. The invention is limited only by the claims and their full scope and equivalents.
Claims (10)
1. The utility model provides a court intelligence monitored control system which characterized in that: the system comprises a hardware module, an intelligent chip, a data processing module and a front-end host;
the hardware module is used for video stream acquisition, video stream processing and video display;
the intelligent chip is used for identifying players, tracking and switching players and generating player positioning information and running data;
the data processing module is used for transcoding and distributing the data in media protocols such as rtsp, rtmp, hls and the like;
the front-end host is used for controlling the system.
2. The intelligent court monitoring system of claim 1, characterized in that: the hardware module comprises a camera, a development board and a display, the camera is used for collecting video streams, the camera is connected with the development board through an MIPI interface, the development board identifies the video streams, and the development board outputs results to the display through an HDMI interface.
3. The intelligent court monitoring system of claim 1, characterized in that: the intelligent chip comprises a face recognition module, an automatic focus following module and a positioning module.
4. The intelligent court monitoring system of claim 3, characterized in that: the face recognition module is used for recognizing faces, clothes colors and numbers of players and whether the players hold balls or not.
5. The intelligent court monitoring system of claim 3, characterized in that: the automatic focus following module is used for tracking the player, judging the ball holding personnel and following the ball holding personnel, and the player is replaced by following the ball holding personnel after being changed.
6. The intelligent court monitoring system of claim 3, characterized in that: the positioning module is used for capturing the edge in the monitoring picture, forming a complete two-dimensional plane diagram of the court, and generating player positioning information and running data.
7. The intelligent court monitoring system of claim 4, characterized in that: the Face recognition module is based on an opencv frame, uses an Ultra Light Fast Generic Face Detector lightweight universal Face detection model, realizes the prediction of the Face position through the pre-training of a data set, and completes the Face detection.
8. The intelligent court monitoring system of claim 5, characterized in that: the automatic focus following module is a self-adaptive zooming algorithm developed based on opencv, analyzes the gray difference between adjacent pixels through received image signals, drives the zoom lens to adjust the focal length and calculates the change of the gray difference result, and achieves the purpose of automatic zooming.
9. The intelligent court monitoring system of claim 6, characterized in that: the positioning module manually calibrates 4 points at the corner of the court in the picture of the camera based on a homography algorithm, and marks the positions of the players according to the yolov3 model based on the homography algorithm, so that the relative positions of the players in the court are calculated.
10. An intelligent monitoring method for a court is characterized in that:
the method comprises the following steps:
s1: collecting video stream through a camera;
s2: the acquired video stream is transmitted to an intelligent chip, and the video stream is subjected to data processing;
s3: the collected data is pre-trained through a face recognition module, the face position is predicted, face detection is completed, and data such as the color and the number of clothes of players, whether the players hold a ball and the like are acquired;
s4: meanwhile, the automatic focus following module judges the ball holding person and follows the ball holding person, and the ball holding person follows the replacement player after changing;
s5: meanwhile, the edges in the monitoring picture can be captured through the positioning module, a complete two-dimensional plane graph of the court is formed, and player positioning information, running data and the like are generated;
s6: transmitting the obtained data to a development board, and processing the data;
s7: then, the data is transmitted to a data processing module, and the data is transcoded and distributed according to media protocols such as rtsp, rtmp, hls and the like;
s8: and (5) transferring the transcoded data to a front-end host and then putting the data on a display.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111414156.0A CN114120231A (en) | 2021-11-25 | 2021-11-25 | Intelligent monitoring system and method for court |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111414156.0A CN114120231A (en) | 2021-11-25 | 2021-11-25 | Intelligent monitoring system and method for court |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114120231A true CN114120231A (en) | 2022-03-01 |
Family
ID=80373111
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111414156.0A Pending CN114120231A (en) | 2021-11-25 | 2021-11-25 | Intelligent monitoring system and method for court |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114120231A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115460135A (en) * | 2022-11-10 | 2022-12-09 | 易方信息科技股份有限公司 | Resource display method, system, storage medium and terminal equipment |
-
2021
- 2021-11-25 CN CN202111414156.0A patent/CN114120231A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115460135A (en) * | 2022-11-10 | 2022-12-09 | 易方信息科技股份有限公司 | Resource display method, system, storage medium and terminal equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11860511B2 (en) | Image pickup device and method of tracking subject thereof | |
| US11790504B2 (en) | Monitoring method and apparatus | |
| CN100551048C (en) | Multiple-camera supervisory control system and tracking thereof based on the three-dimensional video-frequency dynamic tracking | |
| WO2018032921A1 (en) | Video monitoring information generation method and device, and camera | |
| CN103716594B (en) | Panorama splicing linkage method and device based on moving target detecting | |
| US8063972B2 (en) | Image capture device and control method thereof | |
| CN104394363B (en) | A kind of Online class director method and system | |
| JP4715909B2 (en) | Image processing apparatus and method, image processing system, and image processing program | |
| US11037308B2 (en) | Intelligent method for viewing surveillance videos with improved efficiency | |
| CN106650671A (en) | Human face identification method, apparatus and system | |
| CN105959575B (en) | Variable-focus panoramic camera | |
| CN103079034A (en) | Perception shooting method and system | |
| JP4911472B2 (en) | Output device, output method, and program | |
| CN1980384A (en) | Space mobile-object locking aim-searching device and method | |
| CN114120231A (en) | Intelligent monitoring system and method for court | |
| US11044399B2 (en) | Video surveillance system | |
| US20220327732A1 (en) | Information processing apparatus, information processing method, and program | |
| WO2021164082A1 (en) | Video data acquisition controlling method, transmission control apparatus and wireless transmission system | |
| US20120075467A1 (en) | Image capture device and method for tracking moving object using the same | |
| Lee et al. | A real-time face tracking system based on a single PTZ camera | |
| KR20200010690A (en) | Moving Object Linkage Tracking System and Method Using Multiple Cameras | |
| CN100359921C (en) | Imaging apparatus, imaging method, imaging system, program | |
| US20110249124A1 (en) | Monitoring system and method | |
| KR100457302B1 (en) | Auto tracking and auto zooming method of multi channel by digital image processing | |
| Babu et al. | Subject Tracking with Camera Movement Using Single Board Computer |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |