CN115174844A - Intelligent system based on video monitoring and video conference fusion - Google Patents
Intelligent system based on video monitoring and video conference fusion Download PDFInfo
- Publication number
- CN115174844A CN115174844A CN202210768285.8A CN202210768285A CN115174844A CN 115174844 A CN115174844 A CN 115174844A CN 202210768285 A CN202210768285 A CN 202210768285A CN 115174844 A CN115174844 A CN 115174844A
- Authority
- CN
- China
- Prior art keywords
- processor
- conference
- data
- client
- media
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 96
- 230000004927 fusion Effects 0.000 title claims abstract description 11
- 230000005540 biological transmission Effects 0.000 claims abstract description 24
- 238000007405 data analysis Methods 0.000 claims abstract description 22
- 238000012545 processing Methods 0.000 claims description 15
- 238000000034 method Methods 0.000 claims description 14
- 238000004458 analytical method Methods 0.000 claims description 6
- 230000000977 initiatory effect Effects 0.000 claims description 3
- 230000007774 longterm Effects 0.000 abstract description 2
- 238000012795 verification Methods 0.000 abstract 1
- 230000002265 prevention Effects 0.000 description 4
- 238000007792 addition Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
- H04L63/0876—Network architectures or network communication protocols for network security for authentication of entities based on the identity of the terminal or configuration, e.g. MAC address, hardware or software configuration or device fingerprint
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/403—Arrangements for multi-party communication, e.g. for conferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/22—Parsing or analysis of headers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/155—Conference systems involving storage of or access to video conference sessions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Abstract
The invention discloses an intelligent system based on video monitoring and video conference fusion, which comprises a conference terminal, an authentication module, a data analysis module, a client module, a monitoring module, a server and a controller, wherein the authentication module is arranged to carry out identity verification on the client and the monitoring terminal, so that data in the system is prevented from being stolen, media files of the conference terminal and the client are acquired and transmitted according to a TCP RTCP protocol through a self-customized authentication protection message header, the media files are prevented from being lost in the transmission process, the client and the monitoring terminal are simultaneously transmitted according to the RTCP protocol, the media files of the conference terminal and the media files of the client are separately stored, expiration time is set, and the occurrence of the jam condition caused by long-term use of the system is avoided.
Description
Technical Field
The invention belongs to the field of intelligent systems for video monitoring and video conference fusion, and particularly relates to an intelligent system based on video monitoring and video conference fusion.
Background
The video monitoring system and the video conference system are two completely independent systems, which are not related in management and use, and the two systems can not be communicated with each other. The video monitoring system is mainly used for realizing local or remote video image display and storage and the like, only unidirectional video transmission is realized, and audio and video communication cannot be carried out in real time. In fact, the video monitoring system and the video conference system have many common characteristics, both adopt the same video coding and decoding technology, and both realize the exchange and distribution of video code streams by the central control unit; in real-time command scheduling, video images of a monitoring site need to be transmitted to a video conference site. Therefore, the video monitoring system and the video conference system should not be two independent systems, and should be converged technically and more converged from the practical application point of view.
The system based on video monitoring and video conference fusion can not guarantee that data of the video conference is not lost and is not stuck in the transmission process, development and monitoring of the video conference are not facilitated, smoothness of the system can not be guaranteed under the condition of long-term use, and safety of audio and video data generated in the using process of the system can not be guaranteed.
Disclosure of Invention
The invention aims to provide an intelligent system based on video monitoring and video conference fusion.
The technical problem to be solved by the invention is as follows:
(1) The data can not be ensured not to be lost and the data can not be stuck in the transmission process of the video conference, so that the video conference is inconvenient to develop and inquire the monitoring;
(2) How to ensure the smoothness of the system under the condition of long service life of the system;
(3) How to ensure the safety of audio-video data generated in the using process of the system.
The purpose of the invention can be realized by the following technical scheme:
the intelligent system based on video monitoring and video conference fusion comprises a conference terminal, an authentication module, a data analysis module, a client module, a monitoring module, a server and a controller;
the conference terminal is used for initiating and recording conference media files and comprises a first processor, a conference audio and video codec and a conference display unit, the first processor sends a conference instruction to the controller, the controller receives the conference instruction sent by the first processor, the controller generates an inquiry instruction after receiving the conference instruction sent by the first processor, and the controller transmits the inquiry instruction to the authentication module after generating the inquiry instruction;
the client is used for developing and displaying a conference, the client module comprises a third processor, a client audio and video acquisition unit, a media database and a client display unit, the third processor generates a conference receiving instruction after receiving a conference opening instruction transmitted by the controller, the third processor transmits the conference receiving instruction to the controller after generating the conference receiving instruction, the controller receives the conference receiving instruction transmitted by the third processor, the controller transmits an opening instruction to the conference end after receiving the conference receiving instruction transmitted by the third processor, the first processor receives the opening instruction transmitted by the controller, the first processor simultaneously transmits the opening instruction to the conference display unit after receiving the conference opening instruction transmitted by the controller, the conference display unit receives the opening instruction transmitted by the first processor, the conference display unit opens the conference and displays the conference on the conference end desktop after receiving the conference opening instruction transmitted by the first processor, the conference display unit opens the conference and synchronously transmits conference contents to the RTCP client module according to an RTCP protocol after displaying on the conference end desktop, and the specific steps are as follows:
c1: the first processor generates and initiates a one-to-many mode session to the client according to the SIP protocol;
c2: the first processor acquires audio and video media data after a conference is started by the conference display unit and transmits the audio and video media data to the conference audio and video codec;
c3: the conference audio and video codec encodes the acquired audio and video media data according to an H.264 format and generates a conference media file;
c4: the first processor transmits the conference media file to the server according to a certain transmission step;
the specific transmission steps are as follows:
d1: the first processor converts the media file into a media data stream;
d2: the first processor obtains the size of the media data stream and transmits the media data stream according to a certain packet loss prevention rule through a TCP (transmission control protocol), wherein the specific packet loss prevention rule is as follows:
e1: the first processor converting the media data stream into fixed length bytes using a struct module;
e2: the first processor converts the media data stream into bytes with fixed length by using a struct module in turn to serve as a header of the media data stream and the media data stream as data and sends the data to the server;
the server is used for receiving and processing media data streams, the server comprises an audio and video codec, the server receives and processes the media data according to a certain receiving rule, and the specific processing rule is as follows:
f1: the server receives data transmitted by the first processor;
f2: the server reads the data transmitted by the first processor to obtain bytes with fixed length;
f3: the server receives the data transmitted by the first processor for the second time according to the acquired fixed length bytes;
f4: the server converts the data transmitted by the first processor for the second time into media data, converts the media data into a media file through the audio and video decoding module and sets an expiration time for one month;
the server transmits the media file to the client module, the third processor receives the media file transmitted to the client module by the server, the third processor transmits the media file to the client display unit after receiving the media file transmitted to the client module by the server, the client display unit receives the media file transmitted by the third processor, and the client display unit displays the media file on a client display screen after receiving the media file transmitted by the third processor;
the client audio and video acquisition unit is used for acquiring audio and video files of a client, and the acquisition steps are as follows:
the method comprises the following steps: time division is carried out, and the time is divided into 24 standard time periods, wherein the standard time period is from 00 to 01:00 is a standard time period, and all the standard time periods Tn are obtained by analogy in sequence, wherein n =1.. 24;
step two: sequentially collecting videos and audios of a client according to a standard time period, and generating recording data;
the third processor acquires recording data and recording time, generates a corresponding recording media file by taking the recording time as a file name after acquiring the recording data and the recording time, and stores the recording media file in a media database after generating the corresponding recording media file, wherein the media database is used for storing a local address of the recording media file.
The authentication module is used for registering and authenticating MAC address information of the conference terminal and the monitoring terminal, the authentication module comprises a second processor, a client information database and a monitoring information database, the second processor receives the query instruction transmitted to the authentication module by the controller, the second processor queries the conference client data in the conference client information database according to a certain rule after receiving the query instruction transmitted to the authentication module by the controller and generates client information data, and the specific query rule is as follows:
a1: the MAC is used as a query field to perform accurate query on a client information database through an sql structured query statement;
a2: splicing the inquired data according to a certain splicing rule to generate client information data;
the specific splicing rule is as follows:
b1: the second processor respectively acquires MAC address data Mn corresponding to MAC fields in a conference client information database, wherein n = 1.;
b2: storing data corresponding to MAC fields in a conference client information database respectively acquired by the second processor in a list so as to separate the data and obtain information data composed of a group of lists in the form of [ M1, M2,.. Multidot.. Multidot.Mn ];
b3: the second processor splices the MAC as a key of a field, and a list [ M1, M2, & ltSUB & gt, mn ] is used as a value of a dictionary to obtain a group of conference client information data consisting of dictionaries { MAC: [ M1, M2, & ltSUB & gt, mn ] };
the second processor transmits the client information data to the data analysis module, the data analysis module receives the client information data transmitted by the second processor, the data analysis module analyzes the client information data to multiple groups of MAC address data according to a certain analysis rule after receiving the client information data transmitted by the second processor, and the specific analysis rule is as follows:
s1: the second processor acquires information data of the client and acquires a key MAC of the dictionary;
s2: acquiring a value list [ M1, M2.. Mn ] corresponding to a key MAC of the dictionary through the key MAC of the dictionary;
s3: taking out each data in the list in a list index slicing mode to obtain multiple groups of MAC address data;
the data analysis module transmits a plurality of groups of MAC address data to the controller, the controller is used for sending a conference starting instruction to the client module, the controller receives the plurality of groups of MAC address data transmitted by the data analysis module, and the controller transmits the conference starting instruction to the client module after receiving the plurality of groups of MAC address data transmitted by the data analysis module.
The video monitoring terminal comprises a fourth processor and a monitoring terminal display unit, the video monitoring module is used for monitoring the conference terminal and the client terminal, and the method comprises the following specific steps:
g1: the fourth processor transmits an authentication instruction to the controller;
g2: the controller transmits a query instruction to the authentication module;
g2: the second processor receives the query instruction transmitted from the controller to the authentication module, and queries the monitoring authentication data in the monitoring information database according to a certain rule after receiving the query instruction transmitted from the controller to the authentication module to generate authentication data, wherein the specific query rule is as follows:
h1: using MAC as a query field to perform accurate query on a monitoring information database through an sql structured query statement and generating authentication data;
the second processor transmits authentication data to a monitoring end, the fourth processor receives authentication data transmitted by the second processor, the fourth processor obtains an MAC address of the authentication data after receiving the authentication data transmitted by the second processor, the fourth processor compares the obtained MAC address of the monitoring end with the obtained MAC address of the authentication data to generate a monitoring permission instruction after the comparison is successful, the fourth processor transmits the monitoring permission instruction to the controller, the controller receives the monitoring permission instruction transmitted by the fourth processor, the controller respectively transmits a media transmission instruction to the server and transmits a query instruction to the client after receiving the monitoring permission instruction transmitted by the fourth processor, the server receives the media transmission instruction transmitted by the controller, the server synchronously transmits a media file transmitted to the client module to the monitoring end after receiving the media control instruction transmitted by the controller, the fourth processor displays the media file in a display unit of the monitoring end after receiving the media file transmitted to the monitoring end, the third processor receives a media control instruction transmitted by the controller, and acquires a specific media file query rule of a media database after the media file is transmitted to the monitoring end, and the controller acquires a specific media database, and the media database of the media database, the media database server:
l1: the third processor transmits the media file to the client audio and video codec;
l2: the client audio and video codec encodes the acquired audio and video media data according to an H.264 format and generates a client media file;
l3: the third processor transmits the client-side media file to the server according to a certain transmission step;
the specific transmission steps are as follows:
p1: the third processor converts the media file into a media data stream;
p2: the third processor obtains the size of the media data stream, and transmits the media data stream according to a certain packet loss prevention rule through a TCP protocol, wherein the specific packet loss prevention rule is as follows:
q1: the third processor converting the media data stream into fixed length bytes using a struct module;
q2: the third processor converts the media data stream into bytes with fixed length by using a struct module in sequence to serve as a header of the media data stream and send the media data stream serving as data to the server;
the server is used for receiving and processing the media data stream, the server receives and processes the media data according to a certain receiving rule, and the specific processing rule is as follows:
r1: the server receives the data transmitted by the third processor;
r2: the server reads the data transmitted by the third processor to obtain bytes with fixed length;
r3: the server receives the data transmitted by the third processor for the second time according to the acquired fixed length bytes;
r4: the server converts the data transmitted by the third processor for the second time into media data, converts the media data into a media file through an audio and video encoder, and sets an expiration time of one month;
the server transmits the media file to the monitoring end, the fourth processor receives the media file and transmits the media file to the monitoring end display unit, and the monitoring end display unit receives the media file transmitted by the fourth processor and displays the media file on the monitoring screen.
The invention has the beneficial effects that:
(1) The invention uses the size of the media data to make the message header with fixed length, the server receives and analyzes the message header and receives the media data according to the information transmitted by the message header, thereby avoiding the phenomena of data loss and packet sticking in the transmission process;
(2) According to the invention, the media data stored in the conference end is stored in the server, so that the phenomenon of pause in the process of starting the conference by the conference end is avoided, the media data of the client is stored in the client, and the phenomenon that the system is not smooth under the condition that the service time limit of the system is long due to the fact that the server stores excessive media data is avoided.
(3) The authentication data transmitted by the client and the monitoring terminal and the MAC addresses stored in the client information database and the monitoring information database are acquired through the second processor, and the second processor sends the MAC addresses to the client and the monitoring terminal respectively and compares the MAC addresses of the client and the monitoring terminal, so that the video in the system is prevented from being checked by other unauthorized operations, and the safety of audio and video data generated in the using process of the system is ensured.
Drawings
To facilitate understanding for those skilled in the art, the present invention will be further described with reference to the accompanying drawings.
FIG. 1 is a system block diagram of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, the intelligent system based on video monitoring and video conference integration of the present invention includes a conference end, an authentication module, a data analysis module, a client module, a monitoring module, a server, and a controller.
The conference terminal is used for initiating and recording conference media files and comprises a first processor, a conference audio and video codec and a conference display unit, the first processor sends a conference instruction to the controller, the controller receives the conference instruction sent by the first processor, the controller generates a query instruction after receiving the conference instruction sent by the first processor, and the controller transmits the query instruction to the authentication module after generating the query instruction;
the authentication module is used for registering and authenticating MAC address information of the conference terminal and the monitoring terminal, the authentication module comprises a second processor, a client information database and a monitoring information database, the second processor receives the query instruction transmitted to the authentication module by the controller, the second processor queries the conference client data in the conference client information database according to a certain rule after receiving the query instruction transmitted to the authentication module by the controller and generates client information data, and the specific query rule is as follows:
a1: the MAC is used as a query field to perform accurate query on a client information database through an sql structured query statement;
a2: splicing the inquired data according to a certain splicing rule to generate client information data;
the specific splicing rule is as follows:
b1: the second processor respectively obtains MAC address data Mn corresponding to MAC fields in a conference client information database, wherein n = 1;
b2: storing data corresponding to MAC fields in a conference client information database respectively acquired by the second processor in a list so as to separate the data and obtain information data composed of a group of lists in the form of [ M1, M2,.. Multidot.. Multidot.Mn ];
b3: and the second processor splices the MAC as a key of a field and the list [ M1, M2., mn ] as a value of a dictionary to obtain a group of conference client information data consisting of dictionaries { MAC: [ M1, M2., mn ] }.
The second processor transmits the client information data to the data analysis module, the data analysis module receives the client information data transmitted by the second processor, the data analysis module analyzes the client information data to multiple groups of MAC address data according to a certain analysis rule after receiving the client information data transmitted by the second processor, and the specific analysis rule is as follows:
s1: the second processor acquires information data of the client and acquires a key MAC of the dictionary;
s2: acquiring a value list [ M1, M2.. Mn ] corresponding to a key MAC of the dictionary through the key MAC of the dictionary;
s3: and taking out each data in the list in a list index slicing mode to obtain multiple groups of MAC address data.
The data analysis module transmits a plurality of groups of MAC address data to the controller, the controller is used for sending a conference starting instruction to the client module, the controller receives the plurality of groups of MAC address data transmitted by the data analysis module, and the controller transmits the conference starting instruction to the client module after receiving the plurality of groups of MAC address data transmitted by the data analysis module.
The client is used for developing and displaying a conference, the client module comprises a third processor, a client audio and video acquisition unit, a media database and a client display unit, the third processor generates a conference receiving instruction after receiving a conference opening instruction transmitted by the controller, the third processor transmits the conference receiving instruction to the controller after generating the conference receiving instruction, the controller receives the conference receiving instruction transmitted by the third processor, the controller transmits an opening instruction to the conference end after receiving the conference receiving instruction transmitted by the third processor, the first processor receives the opening instruction transmitted by the controller, the first processor simultaneously transmits the opening instruction to the conference display unit after receiving the conference opening instruction transmitted by the controller, the conference display unit receives the opening instruction transmitted by the first processor, the conference display unit opens the conference and displays the conference on the conference end desktop after receiving the conference opening instruction transmitted by the first processor, the conference display unit opens the conference and synchronously transmits conference contents to the RTCP client module according to an RTCP protocol after displaying on the conference end desktop, and the specific steps are as follows:
c1: the first processor generates and initiates a one-to-many mode session to the client according to the SIP protocol;
c2: the first processor acquires audio and video media data after a conference is started by the conference display unit and transmits the audio and video media data to the conference audio and video codec;
c3: the conference audio and video codec encodes the acquired audio and video media data according to an H.264 format and generates a conference media file;
c4: the first processor transmits the conference media file to the server according to a certain transmission step;
the specific transmission steps are as follows:
d1: the first processor converts the media file into a media data stream;
d2: the first processor obtains the size of the media data stream and transmits the media data stream according to a certain anti-lost packet rule through a TCP (transmission control protocol), wherein the specific anti-lost packet rule is as follows:
e1: the first processor converting the media data stream into fixed length bytes using a struct module;
e2: the first processor converts the media data stream into bytes with fixed length by using a struct module in turn to serve as a header of the media data stream and sends the media data stream as data to the server.
The server is used for receiving and processing media data streams, the server comprises an audio and video codec, the server receives and processes the media data according to a certain receiving rule, and the specific processing rule is as follows:
f1: the server receives data transmitted by the first processor;
f2: the server reads the data transmitted by the first processor to obtain bytes with fixed length;
f3: the server receives the data transmitted by the first processor for the second time according to the acquired fixed length bytes;
f4: and the server converts the data transmitted by the first processor for the second time into media data, converts the media data into a media file through the audio and video decoding module and sets an expiration time for one month.
The server transmits the media file to the client module, the third processor receives the media file transmitted to the client module by the server, the third processor transmits the media file to the client display unit after receiving the media file transmitted to the client module by the server, the client display unit receives the media file transmitted by the third processor, and the client display unit displays the media file on a client display screen after receiving the media file transmitted by the third processor.
The client audio and video acquisition unit is used for acquiring audio and video files of a client, and the acquisition steps are as follows:
the method comprises the following steps: time division is carried out, and the time is divided into 24 standard time periods, wherein the standard time period is from 00 to 01:00 is a standard time period, and all the standard time periods Tn are obtained by analogy in sequence, wherein n =1.. 24;
step two: and sequentially collecting the video and the audio of the client according to the standard time period, and generating recording data.
The third processor acquires recording data and recording time, generates a corresponding recording media file by taking the recording time as a file name after acquiring the recording data and the recording time, and stores the recording media file in a media database after generating the corresponding recording media file, wherein the media database is used for storing a local address of the recording media file.
The video monitoring terminal comprises a fourth processor and a monitoring terminal display unit, the video monitoring module is used for monitoring the conference terminal and the client terminal, and the method comprises the following specific steps:
g1: the fourth processor transmits an authentication instruction to the controller;
g2: the controller transmits a query instruction to the authentication module;
g2: the second processor receives the query instruction transmitted from the controller to the authentication module, and queries the monitoring authentication data in the monitoring information database according to a certain rule after receiving the query instruction transmitted from the controller to the authentication module to generate authentication data, wherein the specific query rule is as follows:
h1: using MAC as a query field to perform accurate query on a monitoring information database through an sql structured query statement and generating authentication data;
the second processor transmits authentication data to a monitoring end, the fourth processor receives the authentication data transmitted by the second processor, the fourth processor acquires an MAC address of the authentication data after receiving the authentication data transmitted by the second processor, the fourth processor compares the acquired MAC address of the monitoring end with the MAC address of the authentication data to generate a monitoring permission instruction after the comparison is successful, the fourth processor transmits the monitoring permission instruction to the controller, the controller receives the monitoring permission instruction transmitted by the fourth processor, the controller respectively transmits a media transmission instruction to the server and transmits a query instruction to a client after receiving the monitoring permission instruction transmitted by the fourth processor, the server receives the media transmission instruction transmitted by the controller, the server synchronously transmits a media file transmitted to a client module to the monitoring end after receiving the media control instruction transmitted by the controller, the fourth processor displays the media file in a monitoring end display unit after receiving the media file transmitted to the monitoring end, the third processor receives the media control instruction transmitted by the controller, the third processor acquires the media file processing rule of a media library after receiving the media file processing rule of the media file, and acquires the media data from the third processor, and the fourth processor acquires the media data, the media data base, the following steps:
l1: the third processor transmits the media file to the client audio and video codec;
l2: the client audio and video codec encodes the acquired audio and video media data according to an H.264 format and generates a client media file;
l3: the third processor transmits the client media file to the server according to a certain transmission step;
the specific transmission steps are as follows:
p1: the third processor converts the media file into a media data stream;
p2: the third processor obtains the size of the media data stream, and transmits the media data stream according to a certain anti-lost packet rule through a TCP protocol, wherein the specific anti-lost packet rule is as follows:
q1: the third processor converting the media data stream into fixed length bytes using a struct module;
q2: and the third processor converts the media data stream into bytes with fixed length by using a struct module in turn to serve as a header of the media data stream and sends the media data stream as data to the server.
The server is used for receiving and processing the media data stream, the server receives and processes the media data according to a certain receiving rule, and the specific processing rule is as follows:
r1: the server receives the data transmitted by the third processor;
r2: the server reads the data transmitted by the third processor to obtain bytes with fixed length;
r3: the server receives the data transmitted by the third processor for the second time according to the acquired fixed length bytes;
r4: and the server converts the data transmitted by the third processor for the second time into media data, converts the media data into a media file through an audio and video encoder and sets an expiration time for one month.
The server transmits the media file to the monitoring end, the fourth processor receives the media file and transmits the media file to the monitoring end display unit, and the monitoring end display unit receives the media file transmitted by the fourth processor and displays the media file on the monitoring screen.
In the description of the specification, reference to the description of "one embodiment," "an example," "a specific example" or the like means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
The foregoing is illustrative and explanatory only and is not intended to be exhaustive or to limit the invention to the precise embodiments described, and various modifications, additions, and substitutions may be made by those skilled in the art without departing from the scope of the invention or exceeding the scope of the claims.
Claims (3)
1. The intelligent system based on video monitoring and video conference fusion is characterized by comprising a conference terminal, an authentication module, a data analysis module, a client module, a monitoring module, a server and a controller;
the conference terminal is used for initiating and recording conference media files and comprises a first processor, a conference audio and video codec and a conference display unit, the first processor sends a conference instruction to the controller, the controller receives the conference instruction sent by the first processor, the controller generates an inquiry instruction after receiving the conference instruction sent by the first processor, and the controller transmits the inquiry instruction to the authentication module after generating the inquiry instruction;
the client is used for developing and displaying a conference, the client module comprises a third processor, a client audio and video acquisition unit, a media database and a client display unit, the third processor generates a conference receiving instruction after receiving a conference opening instruction transmitted by the controller, the third processor transmits the conference receiving instruction to the controller after generating the conference receiving instruction, the controller receives the conference receiving instruction transmitted by the third processor, the controller transmits an opening instruction to the conference end after receiving the conference receiving instruction transmitted by the third processor, the first processor receives the opening instruction transmitted by the controller, the first processor simultaneously transmits the opening instruction to the conference display unit after receiving the conference opening instruction transmitted by the controller, the conference display unit receives the opening instruction transmitted by the first processor, the conference display unit opens the conference and displays the conference on the conference end desktop after receiving the conference opening instruction transmitted by the first processor, the conference display unit opens the conference and synchronously transmits conference contents to the RTCP client module according to an RTCP protocol after displaying on the conference end desktop, and the specific steps are as follows:
c1: the first processor generates and initiates a one-to-many mode session to the client according to the SIP protocol;
c2: the first processor acquires audio and video media data after the conference display unit starts the conference and transmits the audio and video media data to the conference audio and video coder-decoder;
c3: the conference audio and video codec encodes the acquired audio and video media data according to an H.264 format and generates a conference media file;
c4: the first processor transmits the conference media file to the server according to a certain transmission step;
the specific transmission steps are as follows:
d1: the first processor converts the media file into a media data stream;
d2: the first processor obtains the size of the media data stream and transmits the media data stream according to a certain anti-lost packet rule through a TCP (transmission control protocol), wherein the specific anti-lost packet rule is as follows:
e1: the first processor converting the media data stream into fixed length bytes using a struct module;
e2: the first processor converts the media data stream into bytes with fixed length by using a struct module in sequence, the bytes serve as a header of the media data stream, and the media data stream serves as data and is sent to a server;
the server is used for receiving and processing media data streams, the server comprises an audio and video codec, the server receives and processes the media data according to a certain receiving rule, and the specific processing rule is as follows:
f1: the server receives data transmitted by the first processor;
f2: the server reads the data transmitted by the first processor to obtain bytes with fixed length;
f3: the server receives the data transmitted by the first processor for the second time according to the acquired fixed length bytes;
f4: the server converts the data transmitted by the first processor for the second time into media data, converts the media data into a media file through the audio and video decoding module and sets an expiration time for one month;
the server transmits the media file to the client module, the third processor receives the media file transmitted to the client module by the server, the third processor transmits the media file to the client display unit after receiving the media file transmitted to the client module by the server, the client display unit receives the media file transmitted by the third processor, and the client display unit displays the media file on a client display screen after receiving the media file transmitted by the third processor;
the client audio and video acquisition unit is used for acquiring audio and video files of a client, and the acquisition steps are as follows:
the method comprises the following steps: time division is carried out, and the time is divided into 24 standard time periods, wherein the standard time period is from 00 to 01:00 is a standard time period, and all the standard time periods Tn are obtained by analogy in sequence, wherein n =1.. 24;
step two: sequentially collecting videos and audios of a client according to a standard time period, and generating recording data;
the third processor acquires recording data and recording time, generates a corresponding recording media file by taking the recording time as a file name after acquiring the recording data and the recording time, and stores the recording media file in a media database after generating the corresponding recording media file, wherein the media database is used for storing a local address of the recording media file.
2. The intelligent system based on video monitoring and video conference fusion as claimed in claim 1, wherein the authentication module is configured to register and authenticate MAC address information of the conference terminal and the monitoring terminal, the authentication module includes a second processor, a client information database, and a monitoring information database, the second processor receives the query instruction transmitted from the controller to the authentication module, and after receiving the query instruction transmitted from the controller to the authentication module, the second processor queries the conference client data in the conference client information database according to a certain rule and generates client information data, where the specific query rule is as follows:
a1: the MAC is used as a query field to perform accurate query on a client information database through an sql structured query statement;
a2: splicing the inquired data according to a certain splicing rule to generate client information data;
the specific splicing rule is as follows:
b1: the second processor respectively obtains MAC address data Mn corresponding to MAC fields in a conference client information database, wherein n = 1;
b2: storing data corresponding to MAC fields in a conference client information database respectively acquired by the second processor in a list so as to separate the data and obtain information data composed of a group of lists in the form of [ M1, M2,.. Multidot.. Multidot.Mn ];
b3: the second processor splices the MAC as a key of a field, and a list [ M1, M2, & ltSUB & gt, mn ] is used as a value of a dictionary to obtain a group of conference client information data consisting of dictionaries { MAC: [ M1, M2, & ltSUB & gt, mn ] };
the second processor transmits the client information data to the data analysis module, the data analysis module receives the client information data transmitted by the second processor, the data analysis module analyzes the client information data to a plurality of groups of MAC address data according to a certain analysis rule after receiving the client information data transmitted by the second processor, and the specific analysis rule is as follows:
s1: the second processor acquires information data of the client and acquires a key MAC of the dictionary;
s2: obtaining a value list [ M1, M2.. Mn ] corresponding to a key MAC of the dictionary through the key MAC of the dictionary;
s3: taking out each data in the list in a list index slicing mode to obtain multiple groups of MAC address data;
the data analysis module transmits a plurality of groups of MAC address data to the controller, the controller is used for sending a conference starting instruction to the client module, the controller receives the plurality of groups of MAC address data transmitted by the data analysis module, and the controller transmits the conference starting instruction to the client module after receiving the plurality of groups of MAC address data transmitted by the data analysis module.
3. The intelligent system based on video monitoring and video conference fusion as claimed in claim 1, wherein the video monitoring terminal comprises a fourth processor and a monitoring terminal display unit, the video monitoring module is used for monitoring the conference terminal and the client terminal, and the specific steps are as follows:
g1: the fourth processor transmits an authentication instruction to the controller;
g2: the controller transmits a query instruction to the authentication module;
g2: the second processor receives the query instruction transmitted from the controller to the authentication module, and queries the monitoring authentication data in the monitoring information database according to a certain rule after receiving the query instruction transmitted from the controller to the authentication module to generate authentication data, wherein the specific query rule is as follows:
h1: using MAC as a query field to perform accurate query on a monitoring information database through an sql structured query statement and generating authentication data;
the second processor transmits authentication data to a monitoring end, the fourth processor receives authentication data transmitted by the second processor, the fourth processor obtains an MAC address of the authentication data after receiving the authentication data transmitted by the second processor, the fourth processor compares the obtained MAC address of the monitoring end with the obtained MAC address of the authentication data to generate a monitoring permission instruction after the comparison is successful, the fourth processor transmits the monitoring permission instruction to the controller, the controller receives the monitoring permission instruction transmitted by the fourth processor, the controller respectively transmits a media transmission instruction to the server and transmits a query instruction to the client after receiving the monitoring permission instruction transmitted by the fourth processor, the server receives the media transmission instruction transmitted by the controller, the server synchronously transmits a media file transmitted to the client module to the monitoring end after receiving the media control instruction transmitted by the controller, the fourth processor displays the media file in a display unit of the monitoring end after receiving the media file transmitted to the monitoring end, the third processor receives a media file processing instruction transmitted by the controller, the third processor acquires a media file processing database after receiving the media file processing instruction transmitted by the controller, and transmits a media file query rule C2 of a media database after the media file is acquired by the controller, and the media file is transmitted to the server;
the server transmits the media files to the monitoring end, the fourth processor receives the media files and transmits the media files to the monitoring end display unit, and the monitoring end display unit receives the media files transmitted by the fourth processor and then displays the media files on the monitoring screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210768285.8A CN115174844A (en) | 2022-07-01 | 2022-07-01 | Intelligent system based on video monitoring and video conference fusion |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210768285.8A CN115174844A (en) | 2022-07-01 | 2022-07-01 | Intelligent system based on video monitoring and video conference fusion |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115174844A true CN115174844A (en) | 2022-10-11 |
Family
ID=83489657
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210768285.8A Pending CN115174844A (en) | 2022-07-01 | 2022-07-01 | Intelligent system based on video monitoring and video conference fusion |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115174844A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116614682A (en) * | 2023-04-26 | 2023-08-18 | 天地阳光通信科技（北京）有限公司 | All-media integrated audio and video recording and on-demand system and processing method |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040230655A1 (en) * | 2003-05-16 | 2004-11-18 | Chia-Hsin Li | Method and system for media playback architecture |
| CN1913533A (en) * | 2006-09-05 | 2007-02-14 | 北京天地互连信息技术有限公司 | Remote video monitoring system based on session initialize protocol and its implementing method |
| CN101483758A (en) * | 2008-01-11 | 2009-07-15 | 天地阳光通信科技（北京）有限公司 | Fusion system for video monitoring system and video meeting system |
| CN101583021A (en) * | 2009-05-21 | 2009-11-18 | 上海华平信息技术股份有限公司 | Monitoring device used in video conferencing monitoring system |
| KR101008753B1 (en) * | 2010-01-14 | 2011-01-14 | 주식회사 씨앤드디큐브 | Multimedia data streaming system |
| CN102387339A (en) * | 2011-10-24 | 2012-03-21 | 中兴通讯股份有限公司 | Method and system for integrating video conference with video monitoring |
| CN103795962A (en) * | 2012-11-01 | 2014-05-14 | 华平信息技术股份有限公司 | Monitoring video conference system |
| CN105898187A (en) * | 2016-05-04 | 2016-08-24 | 广州颐希颉信息科技有限公司 | Method, device and system for implementation of remote communications |
| CN106791576A (en) * | 2016-12-23 | 2017-05-31 | 安徽四创电子股份有限公司 | The emerging system and its fusion method of video monitoring system and video conferencing system |
| US9843606B1 (en) * | 2017-01-13 | 2017-12-12 | Ringcentral, Inc. | Systems and methods for conferencing |
| CN109348163A (en) * | 2018-11-12 | 2019-02-15 | 上海赛连信息科技有限公司 | Video conference and video monitoring fusion system and method |
| CN113645434A (en) * | 2021-10-14 | 2021-11-12 | 深圳市鹏创软件有限公司 | Video conference and video monitoring fusion method, system, terminal and storage medium |
-
2022
- 2022-07-01 CN CN202210768285.8A patent/CN115174844A/en active Pending
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040230655A1 (en) * | 2003-05-16 | 2004-11-18 | Chia-Hsin Li | Method and system for media playback architecture |
| CN1913533A (en) * | 2006-09-05 | 2007-02-14 | 北京天地互连信息技术有限公司 | Remote video monitoring system based on session initialize protocol and its implementing method |
| CN101483758A (en) * | 2008-01-11 | 2009-07-15 | 天地阳光通信科技（北京）有限公司 | Fusion system for video monitoring system and video meeting system |
| CN101583021A (en) * | 2009-05-21 | 2009-11-18 | 上海华平信息技术股份有限公司 | Monitoring device used in video conferencing monitoring system |
| KR101008753B1 (en) * | 2010-01-14 | 2011-01-14 | 주식회사 씨앤드디큐브 | Multimedia data streaming system |
| CN102387339A (en) * | 2011-10-24 | 2012-03-21 | 中兴通讯股份有限公司 | Method and system for integrating video conference with video monitoring |
| CN103795962A (en) * | 2012-11-01 | 2014-05-14 | 华平信息技术股份有限公司 | Monitoring video conference system |
| CN105898187A (en) * | 2016-05-04 | 2016-08-24 | 广州颐希颉信息科技有限公司 | Method, device and system for implementation of remote communications |
| CN106791576A (en) * | 2016-12-23 | 2017-05-31 | 安徽四创电子股份有限公司 | The emerging system and its fusion method of video monitoring system and video conferencing system |
| US9843606B1 (en) * | 2017-01-13 | 2017-12-12 | Ringcentral, Inc. | Systems and methods for conferencing |
| CN109348163A (en) * | 2018-11-12 | 2019-02-15 | 上海赛连信息科技有限公司 | Video conference and video monitoring fusion system and method |
| CN113645434A (en) * | 2021-10-14 | 2021-11-12 | 深圳市鹏创软件有限公司 | Video conference and video monitoring fusion method, system, terminal and storage medium |
Non-Patent Citations (3)
| Title |
|---|
| PENGFEI ZENG等: "A Grouped Network Video Conference System Based on JMF in Collaborative Design Environment", 2007 THIRD INTERNATIONAL IEEE CONFERENCE ON SIGNAL-IMAGE TECHNOLOGIES AND INTERNET-BASED SYSTEM, 3 September 2008 (2008-09-03), pages 129 - 136 * |
| 侯文超: "浅析视频会议系统和视频监控系统的融合建设", 信息技术与信息化, no. 5, 25 May 2019 (2019-05-25), pages 228 - 230 * |
| 褚典;江春华;郝宗波;江维;: "基于SIP、RTP/RTCP和RTSP协议的视频监控系统", 计算机与现代化, no. 11, 15 November 2013 (2013-11-15), pages 139 - 142 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116614682A (en) * | 2023-04-26 | 2023-08-18 | 天地阳光通信科技（北京）有限公司 | All-media integrated audio and video recording and on-demand system and processing method |
| CN116614682B (en) * | 2023-04-26 | 2024-04-02 | 天地阳光通信科技（北京）有限公司 | All-media integrated audio and video recording and on-demand system and processing method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109889762B (en) | Conference control method and device | |
| US7305010B2 (en) | Multicast communication system | |
| CN109309806B (en) | Video conference management method and system | |
| CN110493554B (en) | Method and system for switching speaking terminal | |
| CN110809026B (en) | File processing method and device, electronic equipment and storage medium | |
| CN109672857B (en) | Information processing method and device for monitoring resources | |
| WO2016145981A1 (en) | Data transmission system and method | |
| CN109660753B (en) | Resource synchronization method and device | |
| CN109246135B (en) | Method and system for acquiring streaming media data | |
| CN115174844A (en) | Intelligent system based on video monitoring and video conference fusion | |
| CN110545405A (en) | video transmission method and system based on video network | |
| CN108965220B (en) | Method and system for synchronizing conference control right | |
| CN111951457A (en) | Electronic voting method, device, terminal equipment and storage medium | |
| CN110113558B (en) | Data processing method, device, system and computer readable storage medium | |
| CN108632075B (en) | Method and device for programming video network terminal | |
| CN110557273A (en) | Terminal state warning method and device | |
| CN110381285B (en) | Conference initiating method and device | |
| CN109963107B (en) | Audio and video data display method and system | |
| CN109922302B (en) | Conference reservation information acquisition method, system, device and machine readable medium | |
| CN110557370B (en) | Method, system, electronic equipment and storage medium for pamir synchronization of terminal information | |
| CN110012063B (en) | Data packet processing method and system | |
| CN110708493A (en) | Method and device for acquiring permission of participating in video networking conference | |
| CN109194896B (en) | Calling method and system for video networking terminal | |
| CN109802944B (en) | Method and system for releasing live broadcast based on video network | |
| CN109413460B (en) | Method and system for displaying function menu of video network terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |