CN111988308A - Video monitoring device, implementation method of video monitoring device and readable storage medium - Google Patents
Video monitoring device, implementation method of video monitoring device and readable storage medium Download PDFInfo
- Publication number
- CN111988308A CN111988308A CN202010830937.7A CN202010830937A CN111988308A CN 111988308 A CN111988308 A CN 111988308A CN 202010830937 A CN202010830937 A CN 202010830937A CN 111988308 A CN111988308 A CN 111988308A
- Authority
- CN
- China
- Prior art keywords
- layer
- data processing
- library
- video
- video monitoring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 30
- 238000012806 monitoring device Methods 0.000 title claims abstract description 28
- 238000012545 processing Methods 0.000 claims abstract description 190
- 238000012544 monitoring process Methods 0.000 claims abstract description 102
- 230000003068 static effect Effects 0.000 claims abstract description 53
- 230000002452 interceptive effect Effects 0.000 claims abstract description 19
- 238000011161 development Methods 0.000 claims abstract description 18
- 230000007246 mechanism Effects 0.000 claims description 11
- 238000005538 encapsulation Methods 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 6
- 230000005540 biological transmission Effects 0.000 claims description 3
- 230000003993 interaction Effects 0.000 abstract description 11
- 238000010586 diagram Methods 0.000 description 8
- 238000004806 packaging method and process Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000000977 initiatory effect Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/70—Media network packetisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/764—Media network packet handling at the destination
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Abstract
The invention provides a video monitoring device, an implementation method of the video monitoring device and a readable storage medium. The video monitoring device includes: the application layer comprises a plurality of service scenes and is used for calling a corresponding JNI interface according to each service scene; the middle layer comprises a plurality of JNI interfaces and is used for calling the corresponding bottom layer data processing interfaces according to the JIN interfaces; and the bottom data processing layer comprises a plurality of bottom data processing interfaces and a plurality of static library modules, and is used for performing message and streaming media data interactive processing on the monitoring platform according to the static library modules corresponding to the bottom data processing interfaces and calling back the processing result to the middle layer through the corresponding call-back function so that the middle layer calls back the processing result to the application layer. By the video monitoring device, detailed and complicated interaction of the underlying protocol is not needed to be concerned again in android upper layer development, and various services of an android SIP client based on a national standard monitoring platform can be realized.
Description
Technical Field
The invention relates to the technical field of security protection, in particular to a video monitoring device, an implementation method of the video monitoring device and a computer readable storage medium.
Background
With the continuous development of the technology in the field of security protection in China, the popularization of the 3G/4G communication technology and the rise of the 5G communication technology, the mobile video monitoring system based on the mobile terminal becomes a trend of the development of the video monitoring system. At present, products or successful schemes for playing video resources on a national standard GB28181 monitoring platform on an android client are relatively few, and the analysis reason is mainly caused by cross-platform limitation of a support system or complex and various functions of a server/client.
Disclosure of Invention
The present invention is directed to solving at least one of the problems of the prior art or the related art.
To this end, an aspect of the present invention is to provide a video monitoring apparatus.
Another aspect of the present invention is to provide a method for implementing a video monitoring apparatus.
Yet another aspect of the present invention is directed to a computer-readable storage medium.
In view of the above, according to an aspect of the present invention, there is provided a video monitoring apparatus for an android device, the video monitoring apparatus including: the application layer comprises a plurality of service scenes and is used for calling a corresponding JNI (Java native interface) interface according to each service scene; the middle layer is used for calling the corresponding bottom layer data processing interface according to the JIN interface and registering the at least one callback function to the bottom layer data processing layer; and the bottom data processing layer comprises a plurality of bottom data processing interfaces and a plurality of static library modules, and is used for performing message and streaming media data interactive processing on the monitoring platform according to the static library modules corresponding to the bottom data processing interfaces and calling back the processing result to the middle layer through the corresponding call-back function so that the middle layer calls back the processing result to the application layer.
The video monitoring device provided by the invention is used for android equipment, the android equipment refers to equipment using an android system, such as a mobile phone, a tablet and the like, and the video monitoring device comprises an application layer, a middle layer and a bottom data processing layer. The application layer, namely the upper Java layer of android, comprises a plurality of service scenes. The bottom layer data processing layer comprises a plurality of static library modules and a plurality of bottom layer data processing interfaces which are in one-to-one correspondence with the static library modules, and the static library modules and the bottom layer data processing interfaces are displayed in a static library form through packaging processing. When the bottom data processing interface is called, the bottom data processing layer carries out message and streaming media data interactive processing corresponding to the conversation with the monitoring platform according to the static library module corresponding to the bottom data processing interface. Static libraries relied on in the android system can be used in the android system only by compiling in the android system environment, and can be used only by converting through a JNI layer when being called in the integrated Java environment in the android system. The middle layer is a JNI layer, the middle layer is mainly used for interactive processing of business logic of a bottom layer data processing layer (C + + layer) and an application layer (Java layer), encapsulated bottom layer messages are notified to the middle layer through registration callback, and the middle layer is notified to the application layer through message callback. The middle layer comprises a plurality of JNI interfaces, each JNI interface corresponds to at least one callback function, and during initialization, the middle layer registers all the callback functions to the bottom layer data processing layer, so that the bottom layer data processing layer can call back processing results to the middle layer according to the callback functions, and the middle layer notifies the application layer after receiving the processing results. Specifically, the application layer calls a corresponding JNI interface according to a service scene, the middle layer calls a corresponding bottom layer data processing interface based on the JNI interface, the bottom layer data processing layer interacts with the monitoring platform and calls back a processing result to the middle layer through a corresponding callback function, and the middle layer calls back the application layer, so that various services of the application layer based on the monitoring platform are finally realized. The monitoring platform is specifically based on national standard GB 28181. The video monitoring device provided by the invention isolates the service from the bottom layer data processing through callback processing of different levels, and utilizes the callback of the middle layer message and the independent packaging of the bottom layer data processing, so that the detailed and complicated interaction of the bottom layer protocol is not needed to be concerned again in the android upper layer development, and various services of an android SIP (Session Initiation protocol) client based on a national standard GB28181 monitoring platform can be realized. Meanwhile, the bottom data processing layer basically covers all the service processing modules aiming at complex and various service scenes of the national standard monitoring platform, so the bottom data processing layer can be used as an independent module to be provided for a third party to develop an android SIP client based on the national standard GB28181 monitoring platform.
The video monitoring device according to the present invention may further have the following technical features:
in the above technical solution, the static library module is a C + + class library compiled by a compiler based on ndk (native Development kit).
In the technical scheme, the C + + class libraries depended on by each static library module of the static library can acquire engineering or source codes from the network, and because the application layer is based on a Java environment, a compiler based on an NDK (native Development kit) is required to compile each C + + class library to obtain a so or a dynamic link library for a bottom data processing layer.
Wherein the C + + class library includes, but is not limited to, any one or combination of the following: exosip, boost, tinyxml, log4cpp, live 555. The bottom layer data processing layer and a national standard monitoring platform message protocol use exosip in an interactive mode, the messages use tinyxml for coding and decoding, the bottom layer system library integrates boost, the log module uses log4cpp for packaging, and the bottom layer media data forwarding processing uses live 555.
In any of the above technical solutions, the service scenario includes any one or a combination of the following: logging in, acquiring user authority, acquiring video resources, controlling and processing a heartbeat keep-alive mechanism in an off-line state, playing the video resources in real time, controlling a related holder, capturing pictures and screenshots, closing the video resources in real time, logging out and logging out.
In this solution, the service scenario includes, but is not limited to, any one or a combination of the following: logging in, acquiring user authority, acquiring video resources, controlling and processing a heartbeat keep-alive mechanism in an off-line state, playing the video resources in real time, controlling a related holder, capturing pictures and screenshots, closing the video resources in real time, logging out and logging out. The cloud platform comprises a camera device and the like connected with the android equipment.
In any of the above technical solutions, the bottom layer data processing layer is configured to perform interactive processing on the message and the streaming media data with the monitoring platform based on a udp (user data program) protocol or a tcp (transmission Control protocol) protocol.
In the technical scheme, a bottom data processing layer and a national standard GB28181 monitoring platform perform message and streaming media data interactive processing, and two modes of a UDP (user Datagram protocol) protocol and a TCP (Transmission control protocol) protocol are supported.
In any of the above technical solutions, the application layer includes an android decoding play library; and the android decoding play library is used for decoding, playing and displaying the streaming media data.
In the technical scheme, an android decoding play library is integrated in an application layer, and the streaming media data is decoded, played and displayed through the android decoding play library. For example, when a real-time video is played, an application layer (android upper layer) calls a JNI interface corresponding to a middle layer, specifically a real-time playing interface, the middle layer calls a corresponding bottom layer data processing interface, specifically a bottom layer on-demand interface, an on-demand message is sent to a monitoring platform, after the bottom layer message is processed interactively, a socket opens a corresponding receiving data port to receive video stream data and calls the video stream data back to the application layer in real time, and the application layer calls an android decoding play library (specifically a dahua android decoding play library) to decode, play and display the data stream in real time.
According to another aspect of the present invention, an implementation method of a video monitoring apparatus is provided, which is used for an android device, the video monitoring apparatus includes an application layer, a middle layer, and a bottom data processing layer, and the implementation method of the video monitoring apparatus includes: creating a plurality of service scenes on an application layer; creating a corresponding JNI interface and at least one callback function on the middle layer according to each service scene, and registering the at least one callback function to the bottom layer data processing layer; creating a dynamic link library according to the C + + class library; integrating the dynamic link library into a bottom layer data processing layer, and performing module development and encapsulation on the dynamic link library according to a plurality of service scenes to obtain a plurality of static library modules and a plurality of bottom layer data processing interfaces which correspond to the static library modules one by one; the application layer is used for calling the corresponding bottom layer data processing interface according to the service scene.
The implementation method of the video monitoring device is used for android equipment, the android equipment refers to equipment using an android system, such as a mobile phone, a tablet and the like, and the video monitoring device comprises an application layer, a middle layer and a bottom data processing layer. Firstly, according to complex and various service types of a monitoring platform, a plurality of service scenes such as login and logout of the monitoring platform, user permission acquisition, video resource acquisition and the like are created on an application layer. And then, a plurality of JNI interfaces and at least one callback function included by each JNI interface are created on the middle layer according to the service scene. And then creating a dynamic link library according to the C + + class library, integrating the dynamic link library by a bottom layer data processing layer, and carrying out module development and encapsulation on the dynamic link library according to a service scene to obtain a plurality of static library modules and a plurality of bottom layer data processing interfaces which are in one-to-one correspondence with the static library modules, wherein the static library modules and the bottom layer data processing interfaces are displayed in a static library form through encapsulation processing. When the bottom data processing interface is called, the bottom data processing layer carries out message and streaming media data interactive processing corresponding to the conversation with the monitoring platform according to the static library module corresponding to the bottom data processing interface. The application layer calls a corresponding JNI interface according to a service scene, the middle layer calls a corresponding bottom layer data processing interface based on the JNI interface, the bottom layer data processing layer interacts with the monitoring platform and calls back a processing result to the middle layer through a corresponding callback function, and the middle layer calls back the application layer, so that various services of the application layer based on the monitoring platform are finally realized. The monitoring platform is specifically based on national standard GB 28181. According to the implementation method of the video monitoring device provided by the embodiment of the invention, the video monitoring device isolates the service from the bottom layer data processing through callback processing of different levels, the middle layer message callback and the bottom layer data processing are independently packaged, the detailed and complicated interaction of the bottom layer protocol is not needed to be concerned again in the android upper layer development, and various services of an android SIP (Session Initiation protocol) client based on a national standard GB28181 monitoring platform can be realized. Meanwhile, the static library basically covers all the service processing modules aiming at complex and various service scenes of the national standard monitoring platform, so the static library can be used as an independent module to be provided for a third party to develop an android SIP client based on the national standard GB28181 monitoring platform.
In the above technical solution, the step of creating a dynamic link library according to the C + + class library specifically includes: and compiling the C + + class library by a compiler based on the NDK to obtain a dynamic link library.
In the technical scheme, the C + + class libraries on which the static libraries depend can all obtain engineering or source codes from the network, and because the application layer is based on a Java environment, a compiler based on an ndk (native Development kit) is required to compile each C + + class library to obtain a so or a dynamic link library for the use of a bottom data processing layer. The bottom data processing layer integrates the dynamic link library, module development and encapsulation are carried out on the dynamic link library based on complex and diverse service scenes of a national standard monitoring platform, so that a static library is obtained, a plurality of bottom data processing interfaces are provided, and each bottom data processing interface corresponds to one processing module.
Wherein the C + + class library includes, but is not limited to, any one or combination of the following: exosip, boost, tinyxml, log4cpp, live 555. The bottom layer data processing layer and a national standard monitoring platform message protocol use exosip in an interactive mode, the messages use tinyxml for coding and decoding, the bottom layer system library integrates boost, the log module uses log4cpp for packaging, and the bottom layer media data forwarding processing uses live 555.
In any of the above technical solutions, the service scenario includes any one or a combination of the following: logging in, acquiring user authority, acquiring video resources, controlling and processing a heartbeat keep-alive mechanism in an off-line state, playing the video resources in real time, controlling a related holder, capturing pictures and screenshots, closing the video resources in real time, logging out and logging out.
In this solution, the service scenario includes, but is not limited to, any one or a combination of the following: logging in, acquiring user authority, acquiring video resources, controlling and processing a heartbeat keep-alive mechanism in an off-line state, playing the video resources in real time, controlling a related holder, capturing pictures and screenshots, closing the video resources in real time, logging out and logging out. The cloud platform comprises a camera device and the like connected with the android equipment.
In any of the above technical solutions, the android decoding play library is integrated into an application layer.
In the technical scheme, an android decoding play library is integrated in an application layer, and the streaming media data is decoded, played and displayed through the android decoding play library. For example, when a real-time video is played, an application layer (android upper layer) calls a JNI interface corresponding to a middle layer, specifically a real-time playing interface, the middle layer calls a corresponding bottom layer data processing interface, specifically a bottom layer on-demand interface, an on-demand message is sent to a monitoring platform, after the bottom layer message is processed interactively, a socket opens a corresponding receiving data port to receive video stream data and calls the video stream data back to the application layer in real time, and the application layer calls an android decoding play library (specifically a dahua android decoding play library) to decode, play and display the data stream in real time.
According to still another aspect of the present invention, a computer-readable storage medium is provided, on which a computer program is stored, and the computer program, when executed by a processor, implements the method for implementing the video monitoring apparatus according to any of the above technical solutions.
In the computer-readable storage medium provided by the present invention, when being executed by a processor, the computer program implements the steps of the method for implementing the video monitoring apparatus according to any one of the above technical solutions, so that the computer-readable storage medium includes all the beneficial effects of the method for implementing the video monitoring apparatus according to any one of the above technical solutions.
Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
Drawings
The above and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 shows a schematic block diagram of a video surveillance apparatus of one embodiment of the invention;
FIG. 2 is a schematic diagram of the software architecture of a video surveillance apparatus according to an embodiment of the present invention;
FIG. 3 is a schematic diagram illustrating the operation of a video surveillance apparatus according to an embodiment of the present invention;
FIG. 4 is a schematic diagram illustrating interaction of an application layer, an underlying data processing layer and a monitoring platform according to an embodiment of the present invention;
FIG. 5 is a schematic diagram illustrating interaction of an application layer, an underlying data processing layer and a monitoring platform according to another embodiment of the present invention;
fig. 6 is a flow chart illustrating a method for implementing the video monitoring apparatus according to an embodiment of the present invention.
Detailed Description
In order that the above objects, features and advantages of the present invention can be more clearly understood, a more particular description of the invention will be rendered by reference to the appended drawings. It should be noted that the embodiments of the present invention and features of the embodiments may be combined with each other without conflict.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, the present invention may be practiced in other ways than those specifically described herein, and therefore the scope of the present invention is not limited to the specific embodiments disclosed below.
A video surveillance apparatus and a method of implementing the video surveillance apparatus according to some embodiments of the present invention are described below with reference to fig. 1 to 6.
As shown in fig. 1, according to an embodiment of an aspect of the present invention, there is provided a video monitoring apparatus 100 for an android device, the video monitoring apparatus 100 including: the application layer 104, the application layer 104 includes a plurality of service scenes, and the application layer 104 is configured to call a corresponding jni (java native interface) interface according to each service scene; the middle layer 106 is used for calling the corresponding bottom layer data processing interface according to the JIN interface, and the middle layer 106 is also used for registering at least one callback function to the bottom layer data processing layer 102; the bottom data processing layer 102 includes a plurality of bottom data processing interfaces and a plurality of static library modules, and the bottom data processing layer 102 is configured to perform interactive processing on the message and the streaming media data with the monitoring platform according to the static library module corresponding to the bottom data processing interface, and call back a processing result to the middle layer 106 through a corresponding call-back function, so that the middle layer 106 calls back the processing result to the application layer 104.
The video monitoring apparatus 100 provided in the embodiment of the present invention is used for an android device, where the android device refers to a device using an android system, such as a mobile phone, a tablet, and the like, and the video monitoring apparatus includes an application layer 104, a middle layer 106, and a bottom data processing layer 102. The application layer 104, i.e., the upper android Java layer, includes a plurality of business scenarios. The bottom layer data processing layer 102 includes a plurality of static library modules and a plurality of bottom layer data processing interfaces corresponding to the static library modules one to one, and the static library modules and the bottom layer data processing interfaces are displayed in the form of static libraries through encapsulation processing. When the bottom data processing interface is called, the bottom data processing layer 102 performs interactive processing on the message and the streaming media data corresponding to the session with the monitoring platform according to the static library module corresponding to the bottom data processing interface. Static libraries relied on in the android system can be used in the android system only by compiling in the android system environment, and can be used only by converting through a JNI layer when being called in the integrated Java environment in the android system. The middle layer 106, i.e. a JNI layer, the middle layer 106 is mainly used for interactive processing of business logic between the bottom layer data processing layer 102(C + + layer) and the application layer 104(Java layer), encapsulated bottom layer messages are notified to the middle layer 106 through registration callbacks, and the middle layer 106 is notified to the application layer 104 through message callbacks. The middle layer 106 includes a plurality of JNI interfaces, each JNI interface corresponds to at least one callback function, and when initializing, the middle layer 106 registers all callback functions in the bottom layer data processing layer 102, so that the bottom layer data processing layer 102 can call back a processing result to the middle layer 106 according to the callback function, and the middle layer 106 notifies the application layer 104 after receiving the processing result. Specifically, the application layer 104 calls a corresponding JNI interface according to a service scene, the middle layer 106 calls a corresponding bottom layer data processing interface based on the JNI interface, the bottom layer data processing layer 102 interacts with the monitoring platform and calls back a processing result to the middle layer 106 through a corresponding callback function, and the middle layer 106 calls back to the application layer 104, so that various services of the application layer 104 based on the monitoring platform are finally realized. The monitoring platform is specifically based on national standard GB 28181. According to the video monitoring device provided by the invention, services and bottom layer data processing are isolated through callback processing of different levels, the intermediate layer 106 message callback and the bottom layer data processing are independently packaged, detailed and complicated interaction of bottom layer protocols is not required to be concerned again in android upper layer development, and various services of an android SIP client based on a national standard GB28181 monitoring platform can be realized. Meanwhile, the bottom data processing layer 102 basically covers all the service processing modules aiming at complex and various service scenes of the national standard monitoring platform, so that the bottom data processing layer can be used as an independent module to be provided for a third party to develop an android SIP client based on the national standard GB28181 monitoring platform.
The monitoring platform is specifically based on national standard GB 28181.
In one embodiment of the invention, the static library module is a C + + class library compiled by an NDK-based compiler.
In this embodiment, the C + + class libraries depended on by each static library module of the static library can acquire engineering or source codes from the network, and since the application layer is based on a Java environment, it is necessary to compile each C + + class library by using an NDK-based compiler, so as to obtain a so or a dynamic link library for use by the underlying data processing layer.
In one embodiment of the invention, source code engineering of exosip, boost, log4cpp and live555 of open sources is downloaded on the official website, and then the exoip, tinyxml, boost, log4cpp and live555 of the so or a library are compiled by using android ndk-build for use by an underlying data processing module. The bottom layer data processing layer and a national standard monitoring platform message protocol use exosip in an interactive mode, the messages use tinyxml for coding and decoding, the bottom layer system library integrates boost, the log module uses log4cpp for packaging, and the bottom layer media data forwarding processing uses live 555.
In one embodiment of the invention, the service scenario comprises any one or a combination of the following: logging in, acquiring user authority, acquiring video resources, controlling and processing a heartbeat keep-alive mechanism in an off-line state, playing the video resources in real time, controlling a related holder, capturing pictures and screenshots, closing the video resources in real time, logging out and logging out.
In this embodiment, the business scenario includes, but is not limited to, any one or combination of the following: logging in, acquiring user authority, acquiring video resources, controlling and processing a heartbeat keep-alive mechanism in an off-line state, playing the video resources in real time, controlling a related holder, capturing pictures and screenshots, closing the video resources in real time, logging out and logging out. The cloud platform comprises a camera device and the like connected with the android equipment.
In an embodiment of the present invention, the underlying data processing layer 102 is configured to perform interactive processing on the messages and the streaming media data with the monitoring platform based on a UDP protocol or a TCP protocol.
In this embodiment, the underlying data processing layer 102 performs interactive processing on messages and streaming media data with a national standard GB28181 monitoring platform, and supports two modes, namely, UDP protocol and TCP protocol.
In an embodiment of the present invention, as shown in fig. 2, an application layer 104 calls a corresponding JNI interface according to a service scenario, a middle layer 106 calls a corresponding bottom data processing interface based on the JNI interface, a bottom data processing layer 102 interacts with a national standard GB28181 monitoring platform, and calls back a processing result to the middle layer 106 through a corresponding callback function, and the middle layer 106 calls back to the application layer 104. With the video monitoring apparatus 100 according to the embodiment of the present invention, services and underlying data processing are isolated by callback processing at different levels, and all messages and stream data are supported in UDP and TCP modes. By utilizing the message callback of the middle layer 106 and the independent packaging of the bottom layer data processing, the android upper layer development does not need to pay attention to the specific and complicated interaction of the bottom layer protocol, the user can log in the national standard monitoring platform, obtain the video resources under the user right corresponding to the platform, keep the heartbeat of the platform alive with the national standard monitoring platform, and control and process the point video in an off-line state, control the basic functions of the national standard client side such as the related cloud deck, the capture, the local video, the logout, the log record and the like.
In one embodiment of the invention, the application layer 104 includes an android decoding play library; and the android decoding play library is used for decoding, playing and displaying the streaming media data.
In this embodiment, the application layer 104 is integrated with an android decoding play library, and the streaming media data is decoded, played and displayed through the android decoding play library. For example, when a real-time video is played, the application layer 104(android upper layer) calls a JNI interface corresponding to the middle layer 106, specifically a real-time playing interface, the middle layer 106 calls a corresponding bottom layer data processing interface, specifically a bottom layer on-demand interface, and sends an on-demand message to the monitoring platform, after the bottom layer message is processed interactively, the socket opens a corresponding data receiving port to receive video stream data, and calls the video stream data back to the application layer 104 in real time, and the application layer 104 calls an android decoding play library (specifically a dawa android decoding play library) to decode, play and display the data stream in real time.
Fig. 3 shows a schematic operation diagram of the video surveillance apparatus 100 according to an embodiment of the present invention. As shown in fig. 3, after the video monitoring apparatus 100 is installed and operated, the application layer 104, i.e. the client, requests to log in the monitoring platform according to the user name, the password, the IP of the monitoring platform, and the port. After login is successful, the video monitoring device 100 and the monitoring platform automatically maintain a heartbeat keep-alive mechanism, and if the heartbeat is overtime, offline prompt is performed. In addition, after login is successful, if the video resource list fails to be acquired, a failure prompt is given by the client interface; if the video resource list is successfully acquired, the video resources are played in real time, the playing fails, and a failure prompt is given by a client interface; if the decoding and playing are successful, performing relevant operations such as pan-tilt control, screenshot, local video recording and the like; then, closing the real-time video; and finally logging out the monitoring platform.
Fig. 4 shows an interaction diagram of the application layer 104, the underlying data processing layer 102 and the monitoring platform according to a specific embodiment of the present invention. As shown in fig. 4, during login, the application layer 104 calls the login interface of the middle layer 106, and the middle layer 106 calls the login interface exposed in the static library of the bottom data processing layer 102 to send a registration signaling packet to the monitoring platform, and complete the interaction of the login and registration processes. After the login is successful, the bottom layer data processing layer 102, on one hand, maintains heartbeat keep-alive detection, on the other hand, requests the monitoring platform to acquire video resources, and calls back and notifies the middle layer 106 through the initially registered call-back function, and after the middle layer 106 receives the video resource list, calls back and notifies the application layer 104. The application layer 104 logs out and the underlying data processing layer 102 sends a logout message to the monitoring platform.
Fig. 5 shows an interaction diagram of the application layer 104, the underlying data processing layer 102 and the monitoring platform according to an embodiment of the present invention. As shown in fig. 5, when a real-time video is played, the application layer 104 calls the real-time playing interface of the middle layer 106, the middle layer 106 calls the on-demand interface of the bottom data processing layer 102, a real-time video request message is sent to the monitoring platform, after the bottom message is processed interactively, the socket of the bottom data processing layer 102 opens the corresponding data receiving port, receives the real-time video data stream, and returns the video data stream to the application layer 104 in real time, and the application layer 104 calls the da hua android decoding playing library to decode, play and display the data stream in real time.
In addition, when the control message is sent, specifically, a cradle head related operation request, the application layer 104 calls the control interface of the middle layer 106, the control interface of the middle layer 106 called the bottom data processing layer 102 sends a corresponding cradle head operation message to the monitoring platform, and the monitoring platform completes control of the equipment after forwarding to the front-end equipment.
In the above embodiments, the underlying data processing interface of the underlying data processing layer 102 is embodied as a control interface, a play interface, and a login interface, and it is understood that the underlying data processing interface includes, but is not limited to, a control interface, a play interface, and a login interface.
According to another aspect of the present invention, an implementation method of a video monitoring apparatus is provided, where the video monitoring apparatus is used for an android device, and the video monitoring apparatus includes an application layer, a middle layer, and a bottom data processing layer, and fig. 6 shows a flowchart of the implementation method of the video monitoring apparatus according to an embodiment of the present invention. The implementation method of the video monitoring device comprises the following steps:
The implementation method of the video monitoring device provided by the embodiment of the invention is used for android equipment, wherein the android equipment refers to equipment using an android system, such as a mobile phone, a tablet and the like, and the video monitoring device comprises an application layer, a middle layer and a bottom data processing layer. Firstly, according to complex and various service types of a monitoring platform, a plurality of service scenes such as login and logout of the monitoring platform, user permission acquisition, video resource acquisition and the like are created on an application layer. And then, a plurality of JNI interfaces and at least one callback function included by each JNI interface are created on the middle layer according to the service scene. And then creating a dynamic link library according to the C + + class library, integrating the dynamic link library by a bottom layer data processing layer, and carrying out module development and encapsulation on the dynamic link library according to a service scene to obtain a plurality of static library modules and a plurality of bottom layer data processing interfaces which are in one-to-one correspondence with the static library modules, wherein the static library modules and the bottom layer data processing interfaces are displayed in a static library form through encapsulation processing. When the bottom data processing interface is called, the bottom data processing layer carries out message and streaming media data interactive processing corresponding to the conversation with the monitoring platform according to the static library module corresponding to the bottom data processing interface. The application layer calls a corresponding JNI interface according to a service scene, the middle layer calls a corresponding bottom layer data processing interface based on the JNI interface, the bottom layer data processing layer interacts with the monitoring platform and calls back a processing result to the middle layer through a corresponding callback function, and the middle layer calls back the application layer, so that various services of the application layer based on the monitoring platform are finally realized. The monitoring platform is specifically based on national standard GB 28181. According to the implementation method of the video monitoring device, the video monitoring device isolates services from bottom layer data processing through callback processing of different levels, intermediate layer message callback and bottom layer data processing are independently packaged, detailed complicated interaction of a bottom layer protocol is not needed to be concerned again in android upper layer development, and multiple services of an android SIP client based on a national standard GB28181 monitoring platform can be achieved. Meanwhile, the static library basically covers all the service processing modules aiming at complex and various service scenes of the national standard monitoring platform, so the static library can be used as an independent module to be provided for a third party to develop an android SIP client based on the national standard GB28181 monitoring platform.
In the above embodiment, the step of creating the dynamic link library according to the C + + class library specifically includes: and compiling the C + + class library by a compiler based on the NDK to obtain a dynamic link library.
In this embodiment, the C + + class libraries on which the static libraries depend can both obtain engineering or source codes from the network, and since the application layer is based on a Java environment, it is necessary to compile each C + + class library using a compiler based on NDK to obtain the so or a dynamic link library for use by the underlying data processing layer. The bottom data processing layer integrates the dynamic link library, module development and encapsulation are carried out on the dynamic link library based on complex and diverse service scenes of a national standard monitoring platform, so that a static library is obtained, a plurality of bottom data processing interfaces are provided, and each bottom data processing interface corresponds to one processing module.
Wherein the C + + class library includes, but is not limited to, any one or combination of the following: exosip, boost, tinyxml, log4cpp, live 555. The bottom layer data processing layer and a national standard monitoring platform message protocol use exosip in an interactive mode, the messages use tinyxml for coding and decoding, the bottom layer system library integrates boost, the log module uses log4cpp for packaging, and the bottom layer media data forwarding processing uses live 555.
In any of the above embodiments, the business scenario includes any one or combination of: logging in, acquiring user authority, acquiring video resources, controlling and processing a heartbeat keep-alive mechanism in an off-line state, playing the video resources in real time, controlling a related holder, capturing pictures and screenshots, closing the video resources in real time, logging out and logging out.
In this embodiment, the business scenario includes, but is not limited to, any one or combination of the following: logging in, acquiring user authority, acquiring video resources, controlling and processing a heartbeat keep-alive mechanism in an off-line state, playing the video resources in real time, controlling a related holder, capturing pictures and screenshots, closing the video resources in real time, logging out and logging out. The cloud platform comprises a camera device and the like connected with the android equipment.
In any of the above embodiments, the android decoding playback library is integrated into the application layer.
In this embodiment, the application layer is integrated with an android decoding play library, and the streaming media data is decoded, played and displayed through the android decoding play library. For example, when a real-time video is played, an application layer (android upper layer) calls a JNI interface corresponding to a middle layer, specifically a real-time playing interface, the middle layer calls a corresponding bottom layer data processing interface, specifically a bottom layer on-demand interface, an on-demand message is sent to a monitoring platform, after the bottom layer message is processed interactively, a socket opens a corresponding receiving data port to receive video stream data and calls the video stream data back to the application layer in real time, and the application layer calls an android decoding play library (specifically a dahua android decoding play library) to decode, play and display the data stream in real time.
According to an embodiment of a further aspect of the present invention, a computer-readable storage medium is provided, on which a computer program is stored, which, when being executed by a processor, implements the method of implementing the video surveillance apparatus according to any one of the above embodiments.
In the computer-readable storage medium provided by the embodiment of the present invention, when being executed by a processor, a computer program implements the steps of the method for implementing the video monitoring apparatus according to any one of the above embodiments, so that the computer-readable storage medium includes all the beneficial effects of the method for implementing the video monitoring apparatus according to any one of the above embodiments.
In the description herein, the terms "first" and "second" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance unless explicitly stated or limited otherwise; the terms "connected," "mounted," "secured," and the like are to be construed broadly and include, for example, fixed connections, removable connections, or integral connections; may be directly connected or indirectly connected through an intermediate. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
In the description herein, the description of the terms "one embodiment," "some embodiments," "specific embodiments," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A video monitoring apparatus for an android device, the video monitoring apparatus comprising:
the application layer comprises a plurality of service scenes, and is used for calling a corresponding JNI interface according to each service scene;
the middle layer comprises a plurality of JNI interfaces, each JNI interface comprises at least one callback function, the middle layer is used for calling a corresponding bottom layer data processing interface according to the JIN interface, and the middle layer is also used for registering the at least one callback function to a bottom layer data processing layer;
the bottom layer data processing layer comprises a plurality of static library modules and a plurality of bottom layer data processing interfaces which correspond to the static library modules one by one;
and the bottom data processing layer is used for performing message and streaming media data interactive processing on the monitoring platform according to the static library module corresponding to the bottom data processing interface, and calling back a processing result to the middle layer through the corresponding call-back function, so that the middle layer calls back the processing result to the application layer.
2. The video monitoring apparatus of claim 1,
the static library module is a C + + class library compiled by an NDK-based compiler.
3. The video monitoring apparatus of claim 2,
the business scenario includes any one or combination of: logging in, acquiring user authority, acquiring video resources, controlling and processing a heartbeat keep-alive mechanism in an off-line state, playing the video resources in real time, controlling a related holder, capturing pictures and screenshots, closing the video resources in real time, logging out and logging out.
4. The video monitoring apparatus of claim 3,
and the bottom data processing layer is used for carrying out message and streaming media data interactive processing with the monitoring platform based on a UDP (user Datagram protocol) protocol or a TCP (Transmission control protocol).
5. The video monitoring apparatus of claim 4,
the application layer comprises an android decoding play library;
and the android decoding play library is used for decoding, playing and displaying the streaming media data.
6. An implementation method of a video monitoring device is used for android equipment, and is characterized in that the video monitoring device comprises an application layer, a middle layer and a bottom data processing layer, and the implementation method of the video monitoring device comprises the following steps:
creating a plurality of service scenes on the application layer;
creating a corresponding JNI interface and at least one callback function on the middle layer according to each service scene, and registering the at least one callback function to the bottom layer data processing layer;
creating a dynamic link library according to the C + + class library;
and integrating the dynamic link library to the bottom layer data processing layer, and performing module development and encapsulation on the dynamic link library according to the plurality of service scenes to obtain a plurality of static library modules and a plurality of bottom layer data processing interfaces which are in one-to-one correspondence with the plurality of static library modules.
7. The method according to claim 6, wherein the step of creating a dynamic link library from a C + + class library specifically includes:
and compiling the C + + class library by a compiler based on the NDK to obtain the dynamic link library.
8. The method for implementing a video surveillance device according to claim 7, further comprising:
the business scenario includes any one or combination of: logging in, acquiring user authority, acquiring video resources, controlling and processing a heartbeat keep-alive mechanism in an off-line state, playing the video resources in real time, controlling a related holder, capturing pictures and screenshots, closing the video resources in real time, logging out and logging out.
9. The method for implementing a video surveillance device according to claim 8, further comprising:
and integrating the android decoding play library into the application layer.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a method of carrying out a video surveillance apparatus according to any one of claims 6 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010830937.7A CN111988308A (en) | 2020-08-18 | 2020-08-18 | Video monitoring device, implementation method of video monitoring device and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010830937.7A CN111988308A (en) | 2020-08-18 | 2020-08-18 | Video monitoring device, implementation method of video monitoring device and readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111988308A true CN111988308A (en) | 2020-11-24 |
Family
ID=73435756
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010830937.7A Pending CN111988308A (en) | 2020-08-18 | 2020-08-18 | Video monitoring device, implementation method of video monitoring device and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111988308A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113381925A (en) * | 2021-06-16 | 2021-09-10 | 圆通速递有限公司 | Express delivery information interaction device based on 5G message |
| CN113452721A (en) * | 2021-08-30 | 2021-09-28 | 湖南高至科技有限公司 | Network interaction function optimization system, method, computer equipment and medium |
| CN114244758A (en) * | 2021-12-13 | 2022-03-25 | 武汉斗鱼鱼乐网络科技有限公司 | Network diagnosis method, storage medium, electronic device and system of android platform |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106817562A (en) * | 2015-12-01 | 2017-06-09 | 欧阳卓明 | A kind of platform software with video monitoring image intellectual analysis function |
| WO2018031794A1 (en) * | 2016-08-11 | 2018-02-15 | Tuxera Inc | Systems and methods for writing back data to a storage device |
| CN108200482A (en) * | 2018-01-16 | 2018-06-22 | 威创集团股份有限公司 | A kind of cross-platform high resolution audio and video playback method, system and client |
| CN111381922A (en) * | 2020-03-05 | 2020-07-07 | 深圳中兴网信科技有限公司 | Remote monitoring control system and terminal |
-
2020
- 2020-08-18 CN CN202010830937.7A patent/CN111988308A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106817562A (en) * | 2015-12-01 | 2017-06-09 | 欧阳卓明 | A kind of platform software with video monitoring image intellectual analysis function |
| WO2018031794A1 (en) * | 2016-08-11 | 2018-02-15 | Tuxera Inc | Systems and methods for writing back data to a storage device |
| CN108200482A (en) * | 2018-01-16 | 2018-06-22 | 威创集团股份有限公司 | A kind of cross-platform high resolution audio and video playback method, system and client |
| CN111381922A (en) * | 2020-03-05 | 2020-07-07 | 深圳中兴网信科技有限公司 | Remote monitoring control system and terminal |
Non-Patent Citations (3)
| Title |
|---|
| 扶松柏: "基于回调机制的事件处理", 《ANDROID从入门到精通》 * |
| 王忠 等: "《程序设计基础教程》", 31 August 2015 * |
| 邢静宇: "JAVA事件与监听器的类型", 《JAVA语言程序设计》 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113381925A (en) * | 2021-06-16 | 2021-09-10 | 圆通速递有限公司 | Express delivery information interaction device based on 5G message |
| CN113452721A (en) * | 2021-08-30 | 2021-09-28 | 湖南高至科技有限公司 | Network interaction function optimization system, method, computer equipment and medium |
| CN114244758A (en) * | 2021-12-13 | 2022-03-25 | 武汉斗鱼鱼乐网络科技有限公司 | Network diagnosis method, storage medium, electronic device and system of android platform |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111988308A (en) | Video monitoring device, implementation method of video monitoring device and readable storage medium | |
| CN110115835B (en) | Cloud game running method based on Android system and server | |
| CN111381922A (en) | Remote monitoring control system and terminal | |
| CN101960822B (en) | SIP-HTTP application correlator | |
| CN109981607B (en) | Media stream processing method and device, electronic equipment and storage medium | |
| CN102196248B (en) | Mobile video monitoring system and method | |
| US8869141B2 (en) | Scalable high-performance interactive real-time media architectures for virtual desktop environments | |
| US11601583B2 (en) | System and method for controlling surveillance cameras | |
| CN110830777A (en) | Method for previewing GB/T28181 standard monitoring video through cross-browser based on WebRTC protocol | |
| US20080158336A1 (en) | Real time video streaming to video enabled communication device, with server based processing and optional control | |
| CN101212654B (en) | Network video monitoring system and data acquisition method | |
| US8612932B2 (en) | Unified framework and method for call control and media control | |
| Dutton | WebRTC in the real world: STUN, TURN and signaling | |
| CN111803922A (en) | Game interaction method based on cloud mobile phone system | |
| CN111885252A (en) | Mobile phone expansion use method | |
| CN112291514A (en) | Remote audio and video call method and device and OTT platform | |
| CN114710473A (en) | Method and system for realizing audio-video interaction between applet and SIP contact center | |
| CN114143386A (en) | Communication method, system, equipment and storage medium based on QUIC protocol | |
| CN103581695A (en) | System and method for achieving access of mobile terminal to global eye | |
| CN108712417B (en) | Method, device and system for realizing single-double registration of multi-chip compatibility of RCS client | |
| CN114245057A (en) | Audio and video call method, device, equipment and storage medium based on insurance service | |
| Liu et al. | An approach to integrating SIP in converged multimodal/multimedia communication services | |
| CN113923396B (en) | Remote desktop control method, device and medium based on video conference scene | |
| CN117939068A (en) | Telephone monitoring method and device supporting two-way video call | |
| CN112135095A (en) | Virtual camera creating method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201124 |