CN108616722A - A kind of embedded high definition video acquisition and data streaming system - Google Patents
A kind of embedded high definition video acquisition and data streaming system Download PDFInfo
- Publication number
- CN108616722A CN108616722A CN201810346509.XA CN201810346509A CN108616722A CN 108616722 A CN108616722 A CN 108616722A CN 201810346509 A CN201810346509 A CN 201810346509A CN 108616722 A CN108616722 A CN 108616722A
- Authority
- CN
- China
- Prior art keywords
- data
- image
- module
- video
- rtp
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/23614—Multiplexing of additional data and video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8166—Monomedia components thereof involving executable data, e.g. software
- H04N21/8193—Monomedia components thereof involving executable data, e.g. software dedicated tools, e.g. video decoder software or IPMP tool
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Abstract
The invention discloses a kind of embedded high definition video acquisition and data streaming systems, based on Samsung S5P6818 core boards, board is integrated using OV5640 cameras and acquires high-definition image data, compressed encoding is carried out to image using the multimedia hardware codec that core board is internally integrated, and characteristics of image is extracted using algorithm process algorithm, real-time video and characteristic parameter data flow are issued into LAN by the streaming media server built on plate.Design and realization remote pc client receive video stream data and image features data, by decoding, show and are locally stored, support the functions such as historical query.
Description
Technical field
The present invention relates to real-time video monitoring analysis field, more particularly to a kind of embedded high definition video acquisition and data flow
Transmission system.
Background technology
As machine vision is in the extensive use of industrial circle, exploitation is existing artificial using monitoring system substitution industry spot
View mode, and carry out round-the-clock being possibly realized property of on-line monitoring.On the one hand, monitoring system obtains area by image collecting device
Domain realtime graphic is sent to remote terminal and preserves and check, instead of artificial monitor mode on duty by centainly handling；Another party
Face, using image processing algorithm and operating mode's switch algorithm, to the specified object in industry spot carry out characteristics of image extraction and
Respectively, judge is made to the virtual condition of industry spot according to extraction result.
Generally difference is respectively adopted after respective handling using the video flowing that will be collected in existing monitoring system
Transmission channel data are separately sent to designated equipment.With the expansion of monitoring area in industry spot, monitoring device increases,
Seem cumbersome for the management of remote monitoring and administration terminal-pair on-site monitoring equipment, on the one hand, different data uses different transmissions
Channel needs terminal corresponding receiving thread is specified to be received and handled, and receiving channel increases for performance requirement
Increase；On the other hand, monitoring device wired connection mode stores many physical limits in movement in deployed with devices, is unfavorable for
It is a wide range of to use.
In conclusion monitoring and the demand of Data Integration are driving force in a distributed manner, in conjunction with existing embedded technology and
Machine vision technique is studied and is designed a kind of embedded high definition video acquisition and data streaming system, both supports network distribution
The functions such as formula monitoring, analysis, guidance, also ensure to reduce development cost under the premise of meeting performance requirements.
Invention content
In view of the intelligentized demand of above-mentioned distributed monitoring, based on existing monitoring technology, main purpose of the present invention exists
In a kind of embedded high definition video acquisition of exploitation design and data streaming system, realize on the lower platform of hardware complexity
Complete the function of high-definition image acquisition, analysis, coding, transmission.
In order to achieve the above technical purposes, the technical scheme is that：
A kind of embedded high definition video acquisition and data streaming system, including the on-site supervision terminal of deployment at the scene with
Remote administration terminal at the far end is disposed, the remote administration terminal is connected to on-site supervision terminal, institute by network communication
The on-site supervision terminal stated includes image capture module, image processing and analyzing module, image compression encoding module and video flowing matchmaker
Body server module, the image compression encoding module communicate to connect image capture module, image processing and analyzing module respectively
With video stream server module；
The image capture module includes that camera integrates board, for realizing the image real-time acquisition to scene；Figure
As processing analysis module is extracted by carrying out image feature data to the image obtained to obtain image feature data；Image pressure
Contracting coding module carries out compressed encoding to image and forms video flowing；Video stream server module is by image feature data and
The video flowing of compressed encoding is packaged respectively, and is established streaming media server and transmitted data in network；Terminal management mould
Block receives image feature data and video streaming data packet, and carries out separating treatment to packet content, and is decoded and stores,
Image is sent to show to display device simultaneously；
Image processing and analyzing module, image compression encoding module and the video stream server module is integrated in
On same integrated circuit board and form the embedded processing terminal of monoblock type.
A kind of embedded flotation high definition video steaming acquires and Transmission system, the image capture module obtain high
Clear color image data completes the structure of original video data on this basis.
A kind of embedded high definition video flowing acquisition and Transmission system, the image processing and analyzing module pass through master
Thread pre-processes the frame image in original video data, and accommodates multiple sub-line journeys using multithreading establishment
Thread pool, then start thread pool in sub-line journey to execute different image characteristics extraction tasks respectively, when any sub-line
Journey stops the sub-line journey after completing corresponding characteristic parameter extraction result, until all sub-line journeys complete characteristic parameter extraction, it is main
Thread does convergence and data to the extraction result of all sub-line journeys and is packaged, and is sent to video stream server module, then after
Continuous processing next frame image.
A kind of embedded high definition video flowing acquisition and Transmission system, the main thread carry out original image pre-
Processing includes carrying out gray processing, binaryzation and watershed segmentation processing to original image.
A kind of embedded high definition video flowing acquisition and Transmission system, the image compression encoding module is to having obtained
The original video stream taken cut and compressed encoding is handled, and obtains H.264 video flowing after compressed encoding, and it is stored frame by frame
In buffering area, so that video stream server module is spare.
A kind of embedded high definition video flowing acquisition and Transmission system, the video stream server module base
In building video stream server in RTP/RTCP agreements at the scene monitor terminal, i.e., according to transmission requirement in advance to being completed
The video flowing and image feature data of compressed encoding carry out packing and encapsulation process, are then loaded using RTP/RTCP agreements
And complete to send, and receive remote administration terminal and the control of network video stream is fed back.
A kind of embedded high definition video flowing acquisition and Transmission system, the video to compressed encoding is completed
Stream and image feature data carry out packing and encapsulation process, are that mixed video stream and image feature data are packaged and are encapsulated,
And distinguished using the extension flag position X of Real-time Transport Protocol data message as label in the data packet messages for being packaged and encapsulating, two kinds are mixed
It closes data packet and is loaded by established streaming media server and sent, receiving terminal receives right according to extension flag position after data packet
Data packet detached, framing and sequence.
A kind of embedded high definition video flowing acquisition and Transmission system, the receiving terminal receive root after data packet
Data packet is detached according to extension flag position, framing and sequence include the following steps：
When the RTP data package sizes received are 12+3+N byte, data packet is image features data, is read
The data of N number of byte after data packet, and be respectively stored in corresponding characteristic parameter structure；Otherwise, which is
Video streaming data packet simultaneously carries out framing processing；
The relative ranks between picture frame are determined by the timestamp in RTP video streaming data packets, are determined and are schemed according to serial number
As the sequence of fragment；
When building storage and sequence that three double buffering chained lists are used for video streaming data packet, and one set for each chained list
Between stamp parameter be used for indicate its organize frame timestamp, these three framing chained lists are divided into idle chained list and framing chained list, in framing
It is given after the complete frame image of chained list group after decoding thread is decoded it, then the framing chained list is put into idle chained list
In, three chained lists recycle；
In framing process, when for timestamp earlier than present frame, being abandoned as timeout treatment should in the RTP data packets received
Data packet, and continue to receive next RTP data packets；Belong to current framing timestamp when the RTP packet times received stab,
Correct position in chained list is inserted it into using sort algorithm；When the RTP packet times stamp received is later than current framing
Between stab, i.e., the RTP data packets of next frame image have arrived at, and transfer in all framing chained lists timestamp earlier one at this time
It is a, copy decoding data buffering area after the frame data of its all elements are spliced to, the RTP numbers that will be currently received later
It is saved in the chained list as header element according to packet, and deletes remaining element, change the timestamp of framing chained list.
A kind of embedded high definition video flowing acquisition and Transmission system, the remote administration terminal is to Internet video
The play operation that on-site supervision terminal in order to control carries out network video stream, including broadcasting, termination, pause and tune are fed back in the control of stream
Whole video parameter.
A kind of described embedded high definition video flowing acquisition and Transmission system, the termination management module independent operating in
Long-range PC machine, for flow media data packet reception, decode, be locally stored and connect with interface real-time display, image feature data
It receives, local data library storage and interface chart update.
The technical effects of the invention are that：Image capture device used by monitoring system supports image resolution ratio that can support
High-resolution and high frame per second export image, and the original image constituted provides more details to subsequent image processing；Monitoring system
System selects suitable processor platform, and be internally integrated hardware compression device using it carries out compressed encoding to high-definition image, ensures
Video streaming services efficiency is provided under the premise of system performance；Monitoring system issues encoded video flowing by streaming media server
To network, each monitor terminal provides streaming media service as separate server in distributed network, supports client's endpoint pair
Point video stream obtains and storage, and supports client can to controls such as the pauses, broadcasting and recording of live video stream；Client
Management software supports that, to the management of industry spot monitor terminal and data storage, display and historical query function, it is long-range right to realize
The feedback control of embedded monitoring platform.
Description of the drawings
Fig. 1 is the hardware master-plan frame of the present invention；
Fig. 2 is the general design of software frame of the present invention；
Fig. 3 is the embedded processing terminal image collecting flowchart figure of the present invention；
Fig. 4 is that the embedded processing terminal image compression hardware of the present invention encodes flow chart；
Fig. 5 is the embedded processing terminal image characteristic parameter extraction and network transmission flow figure of the present invention；
Fig. 6 is that the embedded processing terminal video streaming media server of the present invention builds flow chart；
The remote pc client video flowing of Fig. 7 present invention receives the decode schematic diagram.
Specific implementation mode
Below in conjunction with the accompanying drawings and specific implementation mode is described in further details the present invention again.
Shown in the hardware master-plan frame diagram 1 of the present invention, this system can be divided into embedded processing from deployed position difference
Terminal and pc client.The high-definition image acquisition device of embedded processing terminal integrates board by OV5640 cameras and forms.It is embedding
Enter formula processing terminal and be based on Samsung S5P6818 multi-core processors extension peripheral circuit composition, according to functions difference
High-definition image acquisition module, memory module and peripheral interface module are divided on hardware.Wherein, peripheral interface module is main
It is made of power module, debugging interface module, HDMI display modules and network transmission module.Pc client is the additional of this system
Module is used for the remote management of industry spot real time inspection monitor video and embedded processing terminal.
The image capture module collection interface of embedded processing terminal is realized using DVP interfaces, connects OV5640 camera collection
RGB high-definition images are acquired at board, OV5640 camera shootings are transmitted using the FIMC that core board is internally integrated as camera controller
The RGB image of head, iic bus are used for transmission camera control signal.Power module is realized by power management chip TW6037, is used
In providing different output voltages for each module of embedded processing terminal.Memory module includes 2GB DDR3SDRAM memories
With 16GB eMMC memories.Debugging interface module is made of jtag interface and UART interface.Network transmission module is by Ethernet collection
Line device and RJ45 interfaces composition.HDMI display modules are made of microHDMI type interfaces, for connecting HDMI display display prison
Control video.
Based on above-mentioned hardware platform system, the software structure composed of function of the present invention is as shown in Figure 2.It completes embedded
Platform base system software builds the Driver Design with respective peripheral device, and is provided and led to application layer using generic structure
Calling interface.Application layer software includes mainly that high-definition image acquisition module, image features extraction and network send mould
Block, video compression coding module and video stream server such as build at the modules composition.Wherein, high-definition image acquisition relies primarily on
It drives OV5640 high-definition cameras to acquire industry spot image, obtains original video data stream.Image features extraction module
It is completed by running specific image characteristics extraction algorithm, extracts characteristic parameter.After the characteristic parameter extraction for completing a frame image
It is filled packing according to the class encapsulated.Video compression coding module is by calling Samsung S5P6618 to integrate
Primitive color video is carried out H264 compressions by multimedia hardware codec MFC by image format conversion and Video coding,
Units of video data volume is reduced to be suitable for network transmission.Video stream server is opened based on the real time streaming increased income
Source third party library JRTPLIB is built, and realizes the RTP/RTCP streaming media services end of lightweight.Video stream media is obtained through excessive matchmaker
The H264 video flowings and image feature data that body hardware compression device encodes, by the operations such as subpackage and encapsulation, by data
Stream is sent to target remote client.
Long-range PC machine monitoring software is mainly used for monitoring and managing using, and includes mainly real-time stream receiving module, number
According to packet handing module and remote supervision module.Wherein, long-range PC monitoring softwares are developed based on cross-platform C++ graphical user interfaces Qt
Frame carries out exploitation design.Real-time stream processing module receives the data that embedded processing terminal streaming media server is sent
Stream carries out video streaming data packet according to header information to the data packet received and image feature data packet detaches.Pass through calling
The audio/video decoder library FFMPEG that increases income is decoded video flowing, and synchronous real-time display and local on monitor terminal software
It preserves.The storage of image feature data is based on Mysql database sharings, realizes the work(being locally stored with data icon simultaneous display
Energy.Remote supervision module is supported the inquiry of historical data and is controlled the distinct feed-back of embedded processing terminal.
The image capture module of embedded processing terminal of the present invention completes the driving of OV5640 Image Acquisition boards
Design, Image Acquisition work realize that implementation step is as shown in figure 3, be as follows based on V4l2 frames：
(1) open () function is used to open OV5640 camera devices file/dev/video0；
(2) information such as driving, the bus of VIDIOC_QUERYCAP orders inquiry OV5640 cameras support are used, are confirmed
The normal operation of OV5640 equipment associated drives；
(3) VIDIOC_G_FMT orders are used to obtain the video format that OV5640 cameras are supported；
(4) it is 1920 × 1080 to use the acquisition resolution of VIDIOC_S_FMT orders setting OV5640 cameras, format
It is encoded for subsequent H264 for YUYV formats；
(5) VIDIOC_REQBUFS orders are used to apply for three image frame buffers, the frame buffer zone obtained according to application
Address and its offset map that user's space using mmap () function, make user can be from user's space memory directly
Read image data；
(6) apply for that obtained frame buffer zone is all put into video input buffer by last using VIDIOC_QBUF orders
Qu Zhong, and pass through the video acquisition of VIDIOC_STREAMON orders startup OV5640 cameras.Meanwhile by OV5640 equipment
Filec descriptor is put into monitoring file descriptor set；
(7) when picture frame is readable and image acquisition procedure does not stop, picture frame is taken out using VIDIOC_DQBUF orders,
And copied and copied in appointed buffer, the subsequent video compression coding of user and image features extraction respectively.It
The frame image frame buffer is reentered into input video buffering area using VIDIOC_QBUF orders afterwards, in Image Acquisition journey
Before sequence does not stop, this step of recursive call continuously reads video stream data from OV5640 camera devices.
(8) at the end of image acquisition procedure, stop regarding for OV5640 cameras using VIDIOC_STREAMOFF orders
Frequency stream acquisition, and all memories that front is distributed are discharged, it avoids causing memory overflow.Finally close () function is used to close
Camera device.
The image compression encoding module of embedded processing terminal of the present invention is based on Samsung S5P6818 cores
The integrated multimedia hardware codec MFC of intralamellar part, realizes the H264 hardware encodings of live video stream.The hardware compression device
Calling be integrated into V4L2 frames, implement as shown in figure 4, steps are as follows：
(1) it opens and initializes FIMC converters.FIMC device files are opened using open () function, and to the figure of FIMC
It is configured as data output and input address of cache type, input terminal is set as IO_MMAP, and output end is set as IO_
USERPTR.The image frame sign of FIMC input terminals and output end is finally set.
(2) it opens and initializes MFC encoders.It is similar with FIMC, MFC device files are opened using open () function,
And MFC image data I/O Address map types are both configured to IO_MMAP.MFC input and output picture frames are set later
Size, type of coding and frame per second.The target video stream format needed herein is H.264, therefore to set MFC encoder types to
V4L2_PIX_FMT_H264.By ioctl interfaces V4L2_EVENT_ is subscribed to using VIDIOC_SUBSCRIBE_EVENT orders
EOS Service events.
(3) it is modules allocation buffer, including Camera-FIMC buffering areas, FIMC-MFC buffering areas and MFC outputs
Each buffering area carry band is specified on module object after completing Buffer allocation, is used for image format conversion and volume by buffering area
The input and output of code process.
(4) the H.264 coding of original image.By using poll () function pair camera device, FIMC and MFC equipment
The state of filec descriptor is monitored, when there is new data readable in the equipment, is called ioctl () interface function, is used
Data are read from the output queue of the equipment and are stored in appointed buffer by VIDIOC_DQBUF orders.When inquiring down
When one processing device status is idle, the buffering area for storing data to be handled is put into down using VIDIOC_QBUF orders
The input rank of one equipment is used for the data processing of next step.It is waited for if when equipment is busy condition, if equipment is to terminate
State then terminates conversion and coding work.In this way, realize FIMC to the reading of initial data, handle and export, MFC
To reading, coding and the output of format conversion image is completed.Before coding thread or processing equipment do not send out stop signal, follow
This step of ring realizes the H.264 coding to original video stream.
(5) when coding thread receives stop signal, close () function is called to close FIMC and MFC equipment, and discharge volume
The memory source that code line journey is distributed, avoids memory overflow.
The image processing and analyzing module of embedded processing terminal of the present invention, as the core work(designed by this system
One of can.This system is using the extraction process of the mentality of designing designed image characteristic parameter of multithreading, and specific implementation flow is such as
Shown in Fig. 5.By the difference by image parameter, it is divided into different subtasks and concurrently executes.One frame image is by multiple
After the processing of subtask, the characteristic that each subtask is obtained merges and is packaged, and streaming media server processing is transferred to be sent out
It is sent to Terminal Server Client.
The streaming media server module of embedded processing terminal of the present invention, this system are based on third party library
JRTPLIB carries out secondary development, and building for streaming media server is realized in embedded processing terminal.Its implementation process such as Fig. 6
It is shown, it is as follows：
(1) establishment and initialization of RTP sessions
The RTPSession classes in the libraries JRTPLIB are called to instantiate a connection object for indicating this RTP session, and
It is initialized member function Create () function pair of calling instance object, includes the port numbers of specified data transmission
Etc. configured transmissions and other session parameters.RTPSession classes, which provide, automatically processes RTCP data packets, RTPSession
After instance object completes initialization, two port numbers of system are occupied, one of them is used for the RTP port numbers of data transmission,
Another is used as rtcp protocol.In data transmission procedure, server end periodicity sending SR groupings receive client
RR is grouped, according to parameters such as grouping information dynamic adjustment transmission rates.
(2) setting reasonable time stabs
By calling SetTimeStamp () function setup satisfactory Real-time Transport Protocol time in RTPSession classes
Stamp.For the limitation of MTU in network transmission, each frame data may carry out subpackage transmission according to its length.In order to make reception
End each frame video image is restored after receiving RTP data packets, receiving terminal must according in RTP packet headers when
Between stamp carry out data frame identification, sequence and recombination.
(3) it adds, delete RTP destination addresses
The support of RTPSession classes is managed destination address list.It is acquired according to the connection with Terminal Server Client
Its IP and port numbers, by calling the member function AddDestination () of session object by the IP of Terminal Server Client and end
Slogan is added in destination address list, and it is managed by associated member's function pair in class.All destination addresses
It deposits in the Hash table of an entitled destination, video stream data reads destination address when sending from the Hash table.
(4) SendPacket () function loops transmission data packet is used
The member function SendPacket () of session object is called to send RTP data packets to all destination addresses.The member
Function calls another class RTPPacketBuilder in the libraries JRTPLIB first, passes through such member function
Data to be sent are packaged into a RTP data packet by BuildPacket ().Later call RTPTransmitter classes at
Member function SendRTPData () reads destination address, and sendto () function is called to send RTP data packets to network.By following
Ring call should member function, complete the real-time transmission task of data packet.
(5) terminate session and destroy all resources
When streaming media server no longer needs in use, streaming media service thread need to be terminated, and occupies money to the thread
Source is destroyed, and avoids causing memory overflow.Wherein, terminate RTP sessions and use the member function in RTPSession classes
BYEDestroy () function.
The data packet that streaming media server of the present invention is sent includes the video flowing of compressed encoding and having passed through image
Handle obtained image features data.For video streaming data packet in transmission process, after the compressed coding of a frame
Image data amount may it is larger, data packet length can exceed that 1400 bytes in network transmission MTU limitation, need
Its data packet length is controlled when RTP packet encapsulations；For image features data packet, size is much smaller than MTU
Limitation need to specify its specific format in order to which receiving terminal is identified from the data packet received.Assuming that image feature data
Size is fixed as N number of byte, and the present invention is by the transmission buffering area of N+3 byte of assignment of allocation, by first three of the buffering area
Byte is set as 0xFF, and residual buffer area is filled for image feature data.In streaming media server transmission process, by turn
Cycle inquires the characteristics of image buffering area and video stream buffer area, clear after the buffering area being asked not is sky, is then sent to
It is empty.
Transmission for video flowing needs to carry out respective handling according to the size of its single-frame images, and process flow is as schemed
It is shown, it is as follows：
(1) NAL unit in video stream buffer area is read, each NAL unit is by initial code 0001, NALU cell datas
Content forms.The length of each NAL unit data content is calculated, the length of NAL total lengths subtract the length that its initial code obtains
Degree.
(2) judge whether each NAL unit data content length is more than 1388 bytes, if length is less than 1388 bytes, then
Packing processing is carried out according to NAL unit modes, i.e., its initial code, remaining NALU data contents are removed to each NALU units
The payload of (including NALU header and NALU data) as RTP data packets；When length is more than 1388 byte, then press
FU-A modes are packaged processing.NALU data content length is obtained first, is made for 1388 bytes by each RTP data packet payloads
For base unit carry out fragment, wherein the last one fragment less than the NALU data contents of 1388 bytes as a RTP data
The payload of packet.Each fragment is added into RTP data packet messages in order and completes encapsulation.
(3) arrange parameter M, PT, timestamp.Parameter M accounts for one in the rtp header, for video flowing, label
The end of one video frame.Parameter PT is used to illustrate the type of payload in RTP messages, is 96 according to standard setting.Time
Stamp timestamp is used to reflect the sampling instant of first eight hyte of the RTP messages, and recipient is according to the timestamp received
Computing relay and shake, and carry out synchronous control.For NAL unit Packet types, parameter M is set as 1, timestamp timestamp
That be passed in SendPacket () function is its increment timestamp_inc；For FU-A types, in addition to the NAL unit
The last one fragment is set as outside 1, other fragments are disposed as 0.Although a NAL unit has carried out FU-A fragments, receiving
Termination, which receives, is reassembled into a NAL unit after data, therefore for all FU-A fragment packets of the same NAL unit,
Timestamp values are answered identical.
(4) after NAL unit being carried out RTP packet encapsulations, after specifying network transmission function transmission to be packaged by calling
Data packet.
(5) before streaming media service thread does not stop, circulating repetition (2) step following procedure is handled in buffering area
Next frame image.
So far, the data packet transmission processing in video stream buffer area is completed.
Remote pc client of the present invention, as the attached management software of the present invention, operating personnel are in remote terminal
After starting monitoring software, monitoring software sends connection request to the embedded processing terminal of industry spot.With embedded processing end
After holding successful connection, video stream media receiving terminal port numbers are sent.Stream medium data receiving module is after receiving data packet, warp
Cross the separation to data packet and the decoding of video flowing, and it is played out by the player of autonomous Design, screenshotss, recording,
The play operation such as pause.Image features data module carries out bent in real time after separation in the corresponding chart of software interface
Line is drawn, and characteristic is stored in Mysql databases.Finally, monitoring software is supported logical by the inquiry of historical data module
It crosses screening condition query history feature and history image has access to function.
Remote pc client of the present invention is in flow media data packet receiving module, by right in windows systems
JRTPLIB is transplanted in library, and the construction of function session object in its library of the similar calling of embedded end, realizes connecing for data packet
It receives, receives flow as shown in fig. 7, being as follows：
(1) initiating RTP session instances object
Built with embedded processing terminal streaming media server it is similar, pass through call RTPSession classes instantiation one
A receiving terminal transmission session object, and the member function in instance object is called to initialize it.
(2) reception pattern and address list are set
The libraries JRTPLIB define three kinds of reception patterns, for providing receiving terminal to the data receiver from different senders
Selection.Program is by calling the member function SetReceiveMode () of session object to set its reception pattern to
RECEIVEMODE_ACCEPTSOME patterns make client only receive the RTP data packets of specified embedded end, and call
The IP address of AddToAcceptList () member function addition embedded processing terminal, completion reception pattern and address list
Setting.
(3) reception of RTP data packets
The RTP data packets of multiple data sources are supported while being received in the libraries JRTPLIB, and by the RTP data packets of each data source
It is stored in respectively in independent order caching.According to the setting of step (2) reception pattern, the receiving terminal designed by this paper can receive
The RTP data packets of multiple data sources.Program call first the member function Poll () in session object receive RTP data packets or
RTCP data packets, later by recursive call its member function GotoFirstSourceWithData () and
GotoNextSourceWithData () traverses all data sources.After obtaining data source success, member function is called
BeginDataAccess () locks to the data source, calls GetNextPacket () member function to obtain currently assigned
Next RTP data packets of data source call DeletePacket () function pair after completing the framing processing to RTP data packets
The RTP data packets are deleted and discharge its space occupied resource.Finally call EndDataAccess () member function real
Now to the unlock of data source.In this way, completing the reception of a complete RTP data packet.
(4) separation of RTP data packets, framing and sequence
Each RTP data packets are separated rout ing in network transmission, and the sequence for reaching receiving terminal does not ensure that and it
Transmission sequence is consistent.Particularly with the NAL data cells sent by subpackage processing, it is not processed directly by receiving sequence group
Dress reduction, can not ensure the accuracy of data.Meanwhile RTP data packets contain video streaming data packet and image features number
According to data packet, need according to setting it is detached.Therefore, RTP data packets need to detach it after receiving, framing and
Sequence.In view of the requirement of real-time, 3 frame buffer image of program setting ensures when decoding first frame image, the second frame image
It receives, third frame image is just in the reception.
The framing of RTP data packets is according to timestamp and serial number in mainly RTP data packet messages.Its timestamp indicates image
All RTP packet times stamp of the acquisition time of frame, same frame image is identical.After serial number indicates image segmentation, each fragment
Relative position in complete image frame.Therefore, it is determined by the timestamp in RTP data packets relatively suitable between picture frame
Sequence determines the sequence of image slices according to serial number.
According to above-mentioned analysis, this program utilizes flexibility of the chained list in terms of data movement, builds three double buffering chains
Table is used for the storage and sequence of data packet, and sets a timestamp parameter for each chained list and be used to indicate the time that it organizes frame
Stamp.These three framing chained lists are divided into idle chained list and framing chained list, and program is given after the complete frame image of framing chained list group
After decoding thread is decoded it, then the framing chained list is put into idle chained list, three chained lists recycle.
When the RTP data package sizes received are 12+3+N byte, i.e., the data packet is image features data,
The data of N number of byte after read data packet, and be respectively stored in corresponding characteristic parameter structure；Otherwise, the data
Packet is video streaming data packet, and framing processing is carried out to it.
In framing process, when for timestamp earlier than present frame, being abandoned as timeout treatment should in the RTP data packets received
Data packet, and continue to receive next RTP data packets；Belong to current framing timestamp when the RTP packet times received stab,
Correct position in chained list is inserted it into using sort algorithm；When the RTP packet times stamp received is later than current framing
Between stab, i.e., the RTP data packets of next frame image have arrived at.Timestamp earlier one is transferred in all framing chained lists at this time
It is a, copy decoding data buffering area after the frame data of its all elements are spliced to.The RTP numbers that will be currently received later
It is saved in the chained list as header element according to packet, and deletes remaining element, change the timestamp of framing chained list.So far, RTP data
The framing process of packet is completed.
(5) end of RTP sessions
When image receiving thread no longer receives image data, before exiting thread, call in session object
BYEDestroy () function terminates this session, and the system resource of destroying threads distribution, avoids memory overflow.
The image decoding section of remote pc client of the present invention, based on FFMPEG pairs of the audio/video decoding library increased income
Picture frame is decoded and image scaling.The decoding of video frame is as follows：
(1) avcodec_register_all () function registration codec is registered.Decoder is being defined and is being initialized
Before, it is necessary to the function is called, FFMPEG could be used to decode codec, resolver and hardware accelerator etc. in library.
(2) registered decoder is found according to specified encoder ID.Program is by calling avcodec_find_
The encoder of decoder () function lookup H264, IDs of the H264 in the libraries FFMPEG are AV_CODEC_ID_H264.
(3) encoder is initialized.It defines an AVCodecContext object to be used to describe decoder context, the object
The important parameter information needed for decoder, including media flow type and decoded picture format are contained, is distinguished here
It is defined as AVMEDIA_TYPE_VIDEO and AV_PIX_FMT_YUV420P.Avcodec_open2 () function pair is called later
AVCodecContext objects complete structure.
(4) it is decoding frame and image converted frames storage allocation.By calling av_frame_alloc () function pair decoding frame
With image converted frames storage allocation space, the image data being respectively used to after storage decoding and image scaling.
(5) decoding of video frame and image scaling.After searching and obtaining decoder, it is in program circular test buffering area
It is no to there is new framing to generate.When buffering area is not empty, a video frame is read, by calling avcodec_decode_
It is decoded and locally preserves video2 () function pair, and the picture format after the completion of decoding is YUV420P formats.It adjusts later
Format conversion and image scaling are carried out with the decoded image of sws_scale () function pair, RGB24 format-patterns is obtained and is used for
Interface, which is realized, to be used.After each video frame completes decoding and scaling work, buffering area occupied by the video frame is discharged, as
The parking space of next video frame.This step is recycled, until decoding thread is terminated.
(6) decoder and system resource are discharged.Program is by calling avcodec_close () function pair solution currently in use
Code device is closed, and the system resource for calling FFMPEG to decode the memory release function pair thread distribution provided in library is released
It puts, finally terminates receiving thread.
The chart of remote pc client of the present invention is shown and data inquiry module, calls Qt to provide in a program
The module librarys QtChart api function is packaged into the chart class Chart_Builder of autonomous Design, by chart creation, destruction, parameter
The function packages such as setting, Refresh Data are member function.After the completion of chart shows thread creation, placed according to demand in main interface
Chart control, and corresponding chart class instance object is created in thread, the function of being provided by each instance object connects
Mouth completes related setting, and chart shows that thread waiting characteristic receiving thread receives characteristic later.Obtain it is primary complete
After whole characteristic packet, data different parameters are assigned to different graph objects, are updated using Refresh Data interface next
Data refresh UI interface displays later.Client is in main interface to two screening conditions of data query function setting, difference
It is temporally to screen and by Feature Selection.As shown below, the selection result is respectively in the form of graph mode and curvilinear trend figure
It embodies, and supports to export data the function choosing-item of Excel tables, facilitate subsequent statistics and be viewed locally.
Claims (10)
1. a kind of embedded high definition video acquisition and data streaming system, which is characterized in that including disposing scene at the scene
Monitor terminal is connected to live prison with remote administration terminal at the far end, the remote administration terminal is disposed by network communication
Control terminal, the on-site supervision terminal include image capture module, image processing and analyzing module, image compression encoding module and
Video stream server module, the image compression encoding module communicate to connect image capture module, image procossing respectively
Analysis module and video stream server module；
The image capture module includes that camera integrates board, for realizing the image real-time acquisition to scene；At image
Reason analysis module is extracted by carrying out image feature data to the image obtained to obtain image feature data；Compression of images is compiled
Code module carries out compressed encoding to image and forms video flowing；Video stream server module is by image feature data and has compressed
The video flowing of coding is packaged respectively, and is established streaming media server and transmitted data in network；Termination management module connects
Image feature data and video streaming data packet are received, and separating treatment is carried out to packet content, and is decoded and stores, simultaneously
Image is sent to show to display device；
Image processing and analyzing module, image compression encoding module and the video stream server module is integrated in same
On integrated circuit board and form the embedded processing terminal of monoblock type.
2. a kind of embedded flotation high definition video steaming acquisition according to claim 1 and Transmission system, which is characterized in that institute
The image capture module stated obtains high clear colorful image data, completes the structure of original video data on this basis.
3. a kind of embedded high definition video flowing acquisition according to claim 1 and Transmission system, which is characterized in that described
Image processing and analyzing module pre-processes the frame image in original video data by main thread, and uses multithreading skill
Art creates the thread pool for accommodating multiple sub-line journeys, and it is special to execute different images respectively then to start the sub-line journey in thread pool
Extraction task is levied, stops the sub-line journey after any sub-line journey completes corresponding characteristic parameter extraction result, until all sub-lines
Journey completes characteristic parameter extraction, and main thread does convergence to the extraction result of all sub-line journeys and data are packaged, and is sent to video flowing
Media server module then proceedes to processing next frame image.
4. a kind of embedded high definition video flowing acquisition according to claim 3 and Transmission system, which is characterized in that described
It includes carrying out gray processing, binaryzation and watershed segmentation processing to original image that main thread carries out pretreatment to original image.
5. a kind of embedded high definition video flowing acquisition according to claim 1 and Transmission system, which is characterized in that described
Image compression encoding module to the original video stream obtained cut and compressed encoding is handled, and is obtained after compressed encoding
H.264 video flowing, and it is stored in buffering area frame by frame, so that video stream server module is spare.
6. a kind of embedded high definition video flowing acquisition according to claim 1 and Transmission system, which is characterized in that described
Video stream server module is pressed based on video stream server is built in RTP/RTCP agreements at the scene monitor terminal
Packing and encapsulation process are carried out to video flowing and image feature data that compressed encoding is completed in advance according to transmission requirement, then adopted
It is loaded with RTP/RTCP agreements and completes to send, and received remote administration terminal and the control of network video stream is fed back.
7. a kind of embedded high definition video flowing acquisition according to claim 6 and Transmission system, which is characterized in that described
Packing and encapsulation process are carried out to video flowing and image feature data that compressed encoding is completed, are that mixed video stream and image are special
Sign data are packaged and are encapsulated, and with the extension flag of Real-time Transport Protocol data message in the data packet messages for being packaged and encapsulating
Position X is distinguished as label, and two kinds of blended data packets are loaded by established streaming media server and sent, and receiving terminal receives number
According to data packet is detached according to extension flag position after packet, framing and sequence.
8. a kind of embedded high definition video flowing acquisition according to claim 7 and Transmission system, which is characterized in that described
Receiving terminal detaches data packet according to extension flag position after receiving data packet, framing and sequence include the following steps：
When the RTP data package sizes received are 12+3+N byte, data packet is image features data, reads data
The data of N number of byte after packet, and be respectively stored in corresponding characteristic parameter structure；Otherwise, which is video
Stream packets simultaneously carry out framing processing；
The relative ranks between picture frame are determined by the timestamp in RTP video streaming data packets, and image point is determined according to serial number
The sequence of piece；
Three double buffering chained lists of structure are used for the storage and sequence of video streaming data packet, and set a timestamp for each chained list
Parameter is used to indicate the timestamp of its tissue frame, these three framing chained lists are divided into idle chained list and framing chained list, in framing chained list
It has organized and has been given after a frame image after decoding thread is decoded it, then the framing chained list has been put into idle chained list, three
A chained list recycles；
In framing process, when timestamp abandons the data earlier than present frame as timeout treatment in the RTP data packets received
Packet, and continue to receive next RTP data packets；Belong to current framing timestamp when the RTP packet times received stab, uses
Sort algorithm inserts it into correct position in chained list；It is later than current framing timestamp when the RTP packet times received stab,
The RTP data packets of i.e. next frame image have arrived at, and timestamp one earlier in all framing chained lists are transferred at this time, by it
The frame data of all elements copy decoding data buffering area to after being spliced, later make the RTP data packets being currently received
It is saved in the chained list for header element, and deletes remaining element, change the timestamp of framing chained list.
9. a kind of embedded high definition video flowing acquisition according to claim 6 and Transmission system, which is characterized in that described
Remote administration terminal feeds back the control of network video stream the play operation that on-site supervision terminal in order to control carries out network video stream,
Including broadcasting, termination, pause and adjustment video parameter.
10. a kind of embedded high definition video flowing acquisition according to claim 1 and Transmission system, which is characterized in that described
Termination management module independent operating in long-range PC machine, for flow media data packet reception, decode, be locally stored and interface is real
When show, the reception of image feature data, local data library storage and the update of interface chart.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810346509.XA CN108616722B (en) | 2018-04-18 | 2018-04-18 | Embedded high-definition video acquisition and data stream transmission system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810346509.XA CN108616722B (en) | 2018-04-18 | 2018-04-18 | Embedded high-definition video acquisition and data stream transmission system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108616722A true CN108616722A (en) | 2018-10-02 |
| CN108616722B CN108616722B (en) | 2021-02-26 |
Family
ID=63660310
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810346509.XA Active CN108616722B (en) | 2018-04-18 | 2018-04-18 | Embedded high-definition video acquisition and data stream transmission system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108616722B (en) |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109729284A (en) * | 2018-12-17 | 2019-05-07 | 惠州Tcl移动通信有限公司 | Image processing method, intelligent terminal and the storage device of intelligent terminal |
| CN110062296A (en) * | 2019-04-09 | 2019-07-26 | 南昌嘉研科技有限公司 | A kind of real time flow medium player and its framework method |
| CN110351533A (en) * | 2019-08-12 | 2019-10-18 | 桂林电子科技大学 | The network transmission monitoring system and its implementation of video image processing based on Linux |
| CN110545449A (en) * | 2019-08-30 | 2019-12-06 | 华中科技大学 | Industrial field data transmission method based on streaming media |
| CN110650307A (en) * | 2019-10-30 | 2020-01-03 | 广州河东科技有限公司 | QT-based audio and video plug flow method, device, equipment and storage medium |
| CN110650308A (en) * | 2019-10-30 | 2020-01-03 | 广州河东科技有限公司 | QT-based audio and video stream pulling method, device, equipment and storage medium |
| CN111125978A (en) * | 2019-12-31 | 2020-05-08 | 国微集团(深圳)有限公司 | Simulation data processing method and system |
| CN111343415A (en) * | 2018-12-18 | 2020-06-26 | 杭州海康威视数字技术股份有限公司 | Data transmission method and device |
| CN111800388A (en) * | 2020-06-09 | 2020-10-20 | 盐城网之易传媒有限公司 | Media information processing method and media information processing device |
| CN112468887A (en) * | 2019-09-06 | 2021-03-09 | 杭州海康微影传感科技有限公司 | Thermal imaging data transmission method and device and thermal imaging equipment |
| CN112487034A (en) * | 2020-12-01 | 2021-03-12 | 上海思客琦智能装备科技股份有限公司 | Double-queue asynchronous image processing method and device |
| CN112486487A (en) * | 2020-11-30 | 2021-03-12 | 中船重工（武汉）凌久电子有限责任公司 | Fast development method based on SoC NVR display system |
| CN112565679A (en) * | 2020-11-03 | 2021-03-26 | 合肥工业大学 | Monitoring method and monitoring device based on machine vision |
| CN113473106A (en) * | 2021-06-18 | 2021-10-01 | 青岛小鸟看看科技有限公司 | Image transmission method, image display and processing device, and image transmission system |
| CN113703948A (en) * | 2021-09-03 | 2021-11-26 | 四川宇德中创信息科技有限公司 | Test paper splitting system and splitting method thereof |
| CN113709518A (en) * | 2021-08-24 | 2021-11-26 | 天津津航计算技术研究所 | RTSP (real time streaming protocol) -based video real-time transmission mode design method |
| CN113709495A (en) * | 2021-08-24 | 2021-11-26 | 天津津航计算技术研究所 | Synchronous decoding method based on PCIE (peripheral component interface express) buffer mechanism |
| CN114363583A (en) * | 2022-03-17 | 2022-04-15 | 长沙金维信息技术有限公司 | Linux-based embedded video monitoring system construction method |
| CN114584538A (en) * | 2022-03-01 | 2022-06-03 | 北京智慧星光信息技术有限公司 | Mobile streaming media data transmission method, device and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101083576A (en) * | 2006-05-29 | 2007-12-05 | 腾讯科技（深圳）有限公司 | Point-to-point data transmission method and system |
| CN101771599A (en) * | 2008-12-26 | 2010-07-07 | 中国移动通信集团公司 | Method and device for receiving RTP data packets |
| CN101984638A (en) * | 2010-11-10 | 2011-03-09 | 河海大学常州校区 | Storage agent system used for cross-IPv4 and IPv6-network processing and method thereof |
| CN102547239A (en) * | 2011-12-29 | 2012-07-04 | 浙江工业大学 | Android mobile terminal-based video monitoring system |
| CN103457874A (en) * | 2012-05-28 | 2013-12-18 | 华为技术有限公司 | Data package scheduling method and data package scheduling device |
| CN104835212A (en) * | 2015-05-19 | 2015-08-12 | 湖南大麓管道工程有限公司 | Pipeline patrol, maintenance and checking method |
| CN104980682A (en) * | 2015-07-02 | 2015-10-14 | 湖北贝力思智能科技有限公司 | Intelligent dynamic high-definition video transmission system |
-
2018
- 2018-04-18 CN CN201810346509.XA patent/CN108616722B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101083576A (en) * | 2006-05-29 | 2007-12-05 | 腾讯科技（深圳）有限公司 | Point-to-point data transmission method and system |
| CN101771599A (en) * | 2008-12-26 | 2010-07-07 | 中国移动通信集团公司 | Method and device for receiving RTP data packets |
| CN101984638A (en) * | 2010-11-10 | 2011-03-09 | 河海大学常州校区 | Storage agent system used for cross-IPv4 and IPv6-network processing and method thereof |
| CN102547239A (en) * | 2011-12-29 | 2012-07-04 | 浙江工业大学 | Android mobile terminal-based video monitoring system |
| CN103457874A (en) * | 2012-05-28 | 2013-12-18 | 华为技术有限公司 | Data package scheduling method and data package scheduling device |
| CN104835212A (en) * | 2015-05-19 | 2015-08-12 | 湖南大麓管道工程有限公司 | Pipeline patrol, maintenance and checking method |
| CN104980682A (en) * | 2015-07-02 | 2015-10-14 | 湖北贝力思智能科技有限公司 | Intelligent dynamic high-definition video transmission system |
Non-Patent Citations (2)
| Title |
|---|
| 徐箐: "嵌入式网络视频监控系统的研究与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
| 胡峻: "嵌入式高清泡沫图像监控系统的研究与设计", 《中国优秀硕士学位论文全文数据库 工程科技Ⅰ辑》 * |
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109729284A (en) * | 2018-12-17 | 2019-05-07 | 惠州Tcl移动通信有限公司 | Image processing method, intelligent terminal and the storage device of intelligent terminal |
| CN111343415A (en) * | 2018-12-18 | 2020-06-26 | 杭州海康威视数字技术股份有限公司 | Data transmission method and device |
| CN110062296A (en) * | 2019-04-09 | 2019-07-26 | 南昌嘉研科技有限公司 | A kind of real time flow medium player and its framework method |
| CN110062296B (en) * | 2019-04-09 | 2021-06-29 | 南昌嘉研科技有限公司 | Real-time streaming media player and architecture method thereof |
| CN110351533A (en) * | 2019-08-12 | 2019-10-18 | 桂林电子科技大学 | The network transmission monitoring system and its implementation of video image processing based on Linux |
| CN110545449A (en) * | 2019-08-30 | 2019-12-06 | 华中科技大学 | Industrial field data transmission method based on streaming media |
| CN112468887A (en) * | 2019-09-06 | 2021-03-09 | 杭州海康微影传感科技有限公司 | Thermal imaging data transmission method and device and thermal imaging equipment |
| CN110650308A (en) * | 2019-10-30 | 2020-01-03 | 广州河东科技有限公司 | QT-based audio and video stream pulling method, device, equipment and storage medium |
| CN110650307A (en) * | 2019-10-30 | 2020-01-03 | 广州河东科技有限公司 | QT-based audio and video plug flow method, device, equipment and storage medium |
| CN111125978A (en) * | 2019-12-31 | 2020-05-08 | 国微集团(深圳)有限公司 | Simulation data processing method and system |
| CN111800388A (en) * | 2020-06-09 | 2020-10-20 | 盐城网之易传媒有限公司 | Media information processing method and media information processing device |
| CN112565679A (en) * | 2020-11-03 | 2021-03-26 | 合肥工业大学 | Monitoring method and monitoring device based on machine vision |
| CN112486487A (en) * | 2020-11-30 | 2021-03-12 | 中船重工（武汉）凌久电子有限责任公司 | Fast development method based on SoC NVR display system |
| CN112487034A (en) * | 2020-12-01 | 2021-03-12 | 上海思客琦智能装备科技股份有限公司 | Double-queue asynchronous image processing method and device |
| CN113473106A (en) * | 2021-06-18 | 2021-10-01 | 青岛小鸟看看科技有限公司 | Image transmission method, image display and processing device, and image transmission system |
| CN113709518A (en) * | 2021-08-24 | 2021-11-26 | 天津津航计算技术研究所 | RTSP (real time streaming protocol) -based video real-time transmission mode design method |
| CN113709495A (en) * | 2021-08-24 | 2021-11-26 | 天津津航计算技术研究所 | Synchronous decoding method based on PCIE (peripheral component interface express) buffer mechanism |
| CN113709495B (en) * | 2021-08-24 | 2023-11-24 | 天津津航计算技术研究所 | Synchronous decoding method based on PCIE buffer mechanism |
| CN113709518B (en) * | 2021-08-24 | 2023-11-28 | 天津津航计算技术研究所 | Real-time video transmission mode design method based on RTSP protocol |
| CN113703948A (en) * | 2021-09-03 | 2021-11-26 | 四川宇德中创信息科技有限公司 | Test paper splitting system and splitting method thereof |
| CN114584538A (en) * | 2022-03-01 | 2022-06-03 | 北京智慧星光信息技术有限公司 | Mobile streaming media data transmission method, device and storage medium |
| CN114584538B (en) * | 2022-03-01 | 2024-03-22 | 北京智慧星光信息技术股份有限公司 | Mobile streaming media data transmission method, device and storage medium |
| CN114363583A (en) * | 2022-03-17 | 2022-04-15 | 长沙金维信息技术有限公司 | Linux-based embedded video monitoring system construction method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108616722B (en) | 2021-02-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108616722A (en) | A kind of embedded high definition video acquisition and data streaming system | |
| CN102137151B (en) | Remote protocol with multi connection channels | |
| CN1110958C (en) | Decompression process for video signal | |
| US6359656B1 (en) | In-band synchronization of data streams with audio/video streams | |
| CN101827242B (en) | Method for realizing video phone system based on IPTV set-top box | |
| CN110022297B (en) | High-definition video live broadcast system | |
| EP0912064A2 (en) | A selectable depacketizer architecture | |
| CN101238457B (en) | Remote protocol support for communication of large objects in arbitrary format | |
| CN102668495A (en) | Method and system for low-latency transfer protocol | |
| JP2002344880A (en) | Contents distribution system | |
| WO1994001824A1 (en) | A single chip integrated circuit system architecture for video-instruction-set-computing | |
| CN101494547A (en) | Method and system for implementing conference combining local conference and network conference equipment | |
| WO2022037386A1 (en) | Data processing method and apparatus for point cloud media, and device and storage medium | |
| CN104768009A (en) | Image transmission method under desktop virtual SPICE protocol | |
| CN109874027A (en) | A kind of low delay educational surgery demonstration live broadcasting method and its system | |
| CN101094090B (en) | Video/audio network | |
| CN108632679B (en) | A kind of method that multi-medium data transmits and a kind of view networked terminals | |
| CN101237583B (en) | A decoding and coding method and device for multiple screen | |
| CN112087631A (en) | Synchronous parallel video coding and decoding and streaming media transmission system and method based on GPU | |
| CN102938839A (en) | Monitoring front-end equipment and encoding server | |
| WO2023073283A1 (en) | A method, an apparatus and a computer program product for video encoding and video decoding | |
| WO2023062271A1 (en) | A method, an apparatus and a computer program product for video coding | |
| CN109104635A (en) | The method and system of instant delivery screen picture | |
| CN103916671A (en) | OSD dynamic overlaying method and device | |
| CN110012307A (en) | Video transmission method, device and main terminal equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |