CN107948602B - Intelligent bus video monitoring method based on BS - Google Patents
Intelligent bus video monitoring method based on BS Download PDFInfo
- Publication number
- CN107948602B CN107948602B CN201711274882.0A CN201711274882A CN107948602B CN 107948602 B CN107948602 B CN 107948602B CN 201711274882 A CN201711274882 A CN 201711274882A CN 107948602 B CN107948602 B CN 107948602B
- Authority
- CN
- China
- Prior art keywords
- video
- audio
- header
- nal
- bits
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses an intelligent bus video monitoring system method based on BS, which carries a 3G/4G mobile network on a vehicle-mounted terminal device for communication and supports the access of a network camera, an analog camera and a sound pick-up, and the realization steps comprise: 101. equipment plug flow; 102. issuing the media stream; 103. the media stream is distributed. The method can play real-time videos, request videos and download videos in a mainstream browser under the condition of not additionally downloading and installing software, and compared with the traditional C/S framework, the user experience is more convenient, fast and smooth.
Description
Technical Field
The invention belongs to the technical field of public transport systems, and particularly relates to a method for analyzing information of a passenger getting on/off bus stop based on an IC card and GPS data.
Background
The bus is an important component in a public transport system, plays an important role in improving the urban transport pattern and facilitating the trip of citizens, is also a symbol of urban image, and is an attractive landscape in cities. In order to maintain the safety of the vehicle form and count the people on the trip, people install a video monitoring system on the vehicle.
For example, patent application 201310044697.8 discloses a video monitoring system, which includes a management server module, a client module, a streaming media forwarding module, an electronic map module, an alarm host management module, a centralized storage module, an analog quantity acquisition module, a digital matrix module and a WEB function management module, wherein the management server module is bridged with each module, the streaming media forwarding module, the electronic map module, the centralized storage module, the analog quantity acquisition module, the digital matrix module or the WEB function management module is provided with an alarm subsystem, the alarm subsystem is connected with the alarm host management module through a serial port or a network, the video monitoring system is a distributed cluster architecture, the monitoring system manages monitoring nodes through cascading, and the video monitoring system is provided with at least one secondary development interface. The video monitoring system has compatibility, can perform parameter level management on the front-end camera, and can modify the configuration of the front-end camera.
In a video monitoring system with a traditional C/S framework, a user needs to additionally install a client program to play streaming media, and smooth user experience cannot be provided.
Disclosure of Invention
In view of the above problems, an object of the present invention is to provide an intelligent bus video monitoring method based on BS, which can play real-time video, request video, and download video in a mainstream browser without additionally downloading and installing software.
The invention also aims to provide an intelligent bus video monitoring system method based on the BS, which is convenient for realizing rapid data transmission and user experience.
In order to achieve the purpose, the technical scheme of the invention is as follows:
a BS-based intelligent bus video monitoring system method is characterized in that vehicle-mounted terminal equipment carries a 3G/4G mobile network for communication and supports access of a network camera, an analog camera and a sound pickup, and the method comprises the following specific implementation steps:
101. equipment plug flow;
the vehicle-mounted terminal equipment firstly collects video images and audio data of a camera, compresses the audio and video data by adopting H.264 and G.711 codes, packages the compressed audio and video data through a real-time control protocol, and then pushes the compressed audio and video data to a video access gateway server.
The packets are FU-A packets, and the FU-A packet pattern is described as follows:
1) single NAL packet unit
A 12 byte RTP header is followed by audio-video data.
2) FU-A slicing format
H264 video packets with larger frame data are sent by RTP fragments. A 12 byte RTP header is followed by an FU-a slice,
3) unpacking and packing
Unpacking: when an encoder needs to slice an original NAL according to FU-A during encoding, a unit header of the original NAL and a unit header of the FU-A after slicing have the following relationship:
the first three bits of the original NAL head are the first three bits of the FU indicator, the last five bits of the original NAL head are the last five bits of the FU header, and the remaining bits of the FU indicator and the FU header are determined according to actual conditions.
And (3) group packaging: when a receiving end receives fragment data of FU-A and needs to combine and restore all fragment packets into an original NAL packet, the relationship between the FU-A unit header and the restored NAL is as follows:
the eight bits of the restored NAL header are composed of the first three bits of the FU indicator plus the last five bits of the FU header, namely:
nal_unit_type＝(fu_indicator&0xe0)|(fu_header&0x1f)。
102. issuing the media stream;
the video access gateway server receives the audio and video stream of the equipment and performs framing; and according to the RTMP (real-time message transfer protocol) standard, pushing the audio and video stream to the SRS stream server cluster to form a real-time live video source.
Meanwhile, the video access gateway server stores the audio and video stream data into the disk array, and establishes a video index in the MySQL database to realize a cloud storage function; and the video files in the array are called through the video index, so that the on-demand playback function is realized.
103. The media stream is distributed.
The Web client player firstly logs in a service platform, calls online equipment, acquires a real-time live broadcast path of the online equipment, is connected with an SRS streaming server cluster through the live broadcast path, and the SRS streaming server sends real-time audio and video streams to the Web client through an RTMP standard protocol.
And after receiving the real-time audio and video stream, the Web client player decodes and displays the real-time audio and video stream.
The method can play real-time videos, request videos and download videos in a mainstream browser under the condition of not additionally downloading and installing software, and compared with the traditional C/S framework, the user experience is more convenient, fast and smooth.
Drawings
FIG. 1 is a diagram of an architecture in which the present invention is implemented.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Fig. 1 is an architecture diagram of a method for implementing the present invention, and the method for implementing the intelligent bus video monitoring system based on the BS according to the present invention is shown in the figure, and the method for implementing the intelligent bus video monitoring system based on the BS according to the present invention includes that a vehicle-mounted terminal device carries a 3G/4G mobile network for communication, and supports access of a network camera, an analog camera, and a sound pickup.
The method specifically comprises the following steps:
a. equipment plug flow
The vehicle-mounted terminal equipment firstly collects video images and audio data of a camera, compresses the audio and video data by adopting H.264 and G.711 codes, packages the compressed audio and video data through a real-time control protocol, and then pushes the compressed audio and video data to a video access gateway server.
The packets are FU-A packets, and the FU-A packet pattern is described as follows:
1. single NAL packet unit
A 12 byte RTP header is followed by audio-video data.
2. Sliced format of FU-A
H264 video packets with larger frame data are sent by RTP fragments. The 12 byte RTP header is followed by the FU-a slice:
FU indicator has the following format:
+---------------+
|0|1|2|3|4|5|6|7|
+-+-+-+-+-+-+-+-+
|F|NRI|Type|
+---------------+
FU indicates that the Type field Type of byte 28 denotes FU-a. The value of the NRI field must be set according to the value of the NRI field of the sliced NAL unit.
The format of the FU header is as follows:
+---------------+
|0|1|2|3|4|5|6|7|
+-+-+-+-+-+-+-+-+
|S|E|R|Type|
+---------------+
S：1bit
when set to 1, the start bit indicates the start of the sliced NAL unit. The start bit is set to 0 when the following FU payload is not the start of the sliced NAL unit payload.
E：1bit
When set to 1, the end bit indicates the end of the fragmentation NAL unit, i.e. the last byte of the payload is also the last byte of the fragmentation NAL unit. The end bit is set to 0 when the following FU payload is not the last slice of a sliced NAL unit.
R：1bit
The reserved bit must be set to 0 and the receiver must ignore the bit.
Type：5bits
NAL unit payload type definitions are given in the following table
| Type | packet | Type name |
| 0 | undefined | - |
| 1-23 | NAL unit | Single NAL unit packet per H.264 |
| 24 | STAP-A | Single-time aggregation packet |
| 25 | STAP-B | Single-time aggregation packet |
| 26 | MTAP16 | Multi-time aggregation packet |
| 27 | MTAP24 | Multi-time aggregation packet |
| 28 | FU-A | Fragmentation unit |
| 29 | FU-B | Fragmentation unit |
| 30-31 | undefined | - |
3. Unpacking and packing
Unpacking: when an encoder needs to slice an original NAL according to FU-A during encoding, a unit header of the original NAL and a unit header of the FU-A after slicing have the following relationship:
the first three bits of the original NAL head are the first three bits of the FU indicator, the last five bits of the original NAL head are the last five bits of the FU header, and the remaining bits of the FU indicator and the FU header are determined according to actual conditions.
And (3) group packaging: when a receiving end receives fragment data of FU-A and needs to combine and restore all fragment packets into an original NAL packet, the relationship between the FU-A unit header and the restored NAL is as follows:
the eight bits of the restored NAL header are composed of the first three bits of the FU indicator plus the last five bits of the FU header, namely:
nal_unit_type＝(fu_indicator&0xe0)|(fu_header&0x1f)。
b. publishing media streams
The video access gateway server receives the audio and video stream of the equipment and performs framing; and according to the RTMP (real-time message transfer protocol) standard, pushing the audio and video stream to the SRS stream server cluster to form a real-time live video source.
Meanwhile, the video access gateway server stores the audio and video stream data into the disk array, and establishes a video index in the MySQL database to realize the cloud storage function. And the video files in the array are called through the video index, so that the on-demand playback function is realized.
c. Distributing media streams
The Web client player firstly logs in a service platform and calls the online equipment. And acquiring a real-time live broadcast path of the online equipment. The method comprises the steps that an SRS streaming server cluster is connected through a live broadcast path, and real-time audio and video streams are sent to a Web client by the SRS streaming server through an RTMP standard protocol;
and after receiving the real-time audio and video stream, the Web client player decodes and displays the real-time audio and video stream.
The system mainly comprises terminal equipment, a stream server cluster, a video management server and a service system server. The terminal video acquisition equipment is installed on the bus, and after the bus is powered on, the equipment automatically registers to the video management server and pushes audio and video stream data to the stream server cluster.
A browser client logs in a service system server, acquires a terminal list and a playing address, and plays a real-time video; inquiring a device video list, ordering video and the like.
Therefore, the method can play real-time videos, request videos and download videos in a mainstream browser under the condition of not additionally downloading and installing software, and compared with the traditional C/S framework, the user experience is more convenient and smooth.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.
Claims (1)
1. An intelligent bus video monitoring method based on BS is characterized in that vehicle-mounted terminal equipment carries a 3G/4G mobile network and supports access of a network camera, an analog camera and a sound pickup, and the method comprises the following implementation steps:
101. equipment plug flow; the vehicle-mounted terminal equipment firstly collects video images and audio data of a camera, compresses the audio and video data by adopting H.264 and G.711 codes, packages the compressed audio and video data through a real-time control protocol and then pushes the compressed audio and video data to a video access gateway server;
the packets are FU-A packets, and the FU-A packet pattern is described as follows:
1) single NAL packet unit
The audio and video data is followed by the RTP head of 12 bytes;
2) sliced format of FU-A
H264 video packets with larger frame data are sent by RTP fragments, and FU-A fragments follow a 12-byte RTP header;
3) unpacking and packing
Unpacking: when an encoder needs to slice an original NAL according to FU-A during encoding, a unit header of the original NAL and a unit header of the FU-A after slicing have the following relationship:
the first three bits of the original NAL head are the first three bits of the FU indicator, the last five bits of the original NAL head are the last five bits of the FU header, and the remaining bits of the FU indicator and the FU header are determined according to actual conditions;
and (3) group packaging: when a receiving end receives fragment data of FU-A and needs to combine and restore all fragment packets into an original NAL packet, the relationship between the FU-A unit header and the restored NAL is as follows:
the eight bits of the restored NAL header are composed of the first three bits of the FU indicator plus the last five bits of the FU header, namely:
nal_unit_type = (fu_indicator & 0xe0) | (fu_header & 0x1f) ；
102. issuing the media stream; the video access gateway server receives the audio and video stream of the equipment and performs framing; according to RTMP standard, pushing audio and video stream to SRS stream server cluster to form real-time video live broadcast source; meanwhile, the video access gateway server stores the audio and video stream data into the disk array, and establishes a video index in the MySQL database to realize a cloud storage function; the video files in the array are called through the video index, so that the video-on-demand playback function is realized;
103. distributing the media stream: the Web client player firstly logs in a service platform, calls online equipment, acquires a real-time live broadcast path of the online equipment, is connected with an SRS streaming server cluster through the live broadcast path, sends real-time audio and video streams to the Web client through an RTMP standard protocol, and decodes and displays the real-time audio and video streams after receiving the real-time audio and video streams.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711274882.0A CN107948602B (en) | 2017-12-05 | 2017-12-05 | Intelligent bus video monitoring method based on BS |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711274882.0A CN107948602B (en) | 2017-12-05 | 2017-12-05 | Intelligent bus video monitoring method based on BS |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107948602A CN107948602A (en) | 2018-04-20 |
| CN107948602B true CN107948602B (en) | 2021-04-06 |
Family
ID=61945856
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711274882.0A Active CN107948602B (en) | 2017-12-05 | 2017-12-05 | Intelligent bus video monitoring method based on BS |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107948602B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101873481A (en) * | 2010-03-01 | 2010-10-27 | 杭州海康威视数字技术股份有限公司 | Method and system for playing back videos in video monitoring system and network monitoring client side |
| CN103595973A (en) * | 2013-11-28 | 2014-02-19 | 惠州华阳通用电子有限公司 | Real-time vehicle audio/video monitoring system and method |
| KR101366112B1 (en) * | 2012-09-04 | 2014-02-24 | 전자부품연구원 | Avm system of vehicle for dividing and managing camera networks and avm method thereof |
| CN104219500A (en) * | 2014-08-27 | 2014-12-17 | 天津市中信互联科技有限公司 | Device and method for monitoring video live broadcast |
| CN105407351A (en) * | 2014-09-15 | 2016-03-16 | 杭州海康威视数字技术股份有限公司 | Method and apparatus for reconstructing encoding mode from real-time transport protocol packet |
-
2017
- 2017-12-05 CN CN201711274882.0A patent/CN107948602B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101873481A (en) * | 2010-03-01 | 2010-10-27 | 杭州海康威视数字技术股份有限公司 | Method and system for playing back videos in video monitoring system and network monitoring client side |
| KR101366112B1 (en) * | 2012-09-04 | 2014-02-24 | 전자부품연구원 | Avm system of vehicle for dividing and managing camera networks and avm method thereof |
| CN103595973A (en) * | 2013-11-28 | 2014-02-19 | 惠州华阳通用电子有限公司 | Real-time vehicle audio/video monitoring system and method |
| CN104219500A (en) * | 2014-08-27 | 2014-12-17 | 天津市中信互联科技有限公司 | Device and method for monitoring video live broadcast |
| CN105407351A (en) * | 2014-09-15 | 2016-03-16 | 杭州海康威视数字技术股份有限公司 | Method and apparatus for reconstructing encoding mode from real-time transport protocol packet |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107948602A (en) | 2018-04-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102457707B (en) | Safety monitoring video data transmission, storage and order method | |
| KR20170005178A (en) | Method and apparatus for generating, playing adaptive stream based on file format, and thereof readable medium | |
| CN110545405B (en) | Video transmission method and system based on video network | |
| CN105264846A (en) | Transmission apparatus, transfer stream transmission method and processing apparatus | |
| CN105308974A (en) | Transmission apparatus, transmission method, reproduction apparatus, reproduction method and reception apparatus | |
| CN109379254B (en) | Network connection detection method and system based on video conference | |
| CN109450982B (en) | Network communication method and system | |
| CN104093088A (en) | System and method for achieving self-adaptive stream media play control | |
| CN108965930B (en) | Video data processing method and device | |
| CN108574816B (en) | Video networking terminal and communication method and device based on video networking terminal | |
| CN111147859A (en) | Video processing method and device | |
| CN106713361A (en) | Multi-terminal multi-protocol streaming media release method | |
| CN109544879B (en) | Alarm data processing method and system | |
| WO2016003244A1 (en) | Method and device for receiving media packets in multimedia system | |
| CN107948602B (en) | Intelligent bus video monitoring method based on BS | |
| CN203387627U (en) | Live broadcast and order system of mobile streaming media | |
| CN110661992A (en) | Data processing method and device | |
| CN109286603A (en) | A kind of method and apparatus for realizing network direct broadcasting | |
| CN109802990B (en) | Resource log reading and writing method and device for reducing data redundancy | |
| CN108965914B (en) | Video data processing method and device based on video network | |
| CN109451030B (en) | Method and system for downloading video network file | |
| CN111193619B (en) | Log file acquisition method and device | |
| CN109327729B (en) | Wireless recording and broadcasting method and system for multimedia data | |
| CN110351247B (en) | Parameter acquisition method, device and system | |
| CN110012064B (en) | Data synchronization method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220812 Address after: 518000 a2901-2902, building 10, Shenzhen Bay science and technology ecological park, No. 10, Gaoxin South ninth Road, high tech Zone community, Yuehai street, Nanshan District, Shenzhen City, Guangdong Province Patentee after: SHENZHEN EMPEROR TECHNOLOGY Co.,Ltd. Address before: 518107 504, northwest of 5th floor, scientific research building, aerospace micromotor building, Langshan 2nd Road, gaoxinyuan North District, Nanshan District, Shenzhen City, Guangdong Province Patentee before: SHENZHEN LANTAIYUAN INFORMATION TECHNOLOGY Co.,Ltd. |