CN109040640A - A kind of distributed video storage-playback - Google Patents
A kind of distributed video storage-playback Download PDFInfo
- Publication number
- CN109040640A CN109040640A CN201810873451.4A CN201810873451A CN109040640A CN 109040640 A CN109040640 A CN 109040640A CN 201810873451 A CN201810873451 A CN 201810873451A CN 109040640 A CN109040640 A CN 109040640A
- Authority
- CN
- China
- Prior art keywords
- video
- module
- playback
- storage
- distributed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/765—Interface circuits between an apparatus for recording and another apparatus
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/78—Television signal recording using magnetic recording
- H04N5/781—Television signal recording using magnetic recording on disks or drums
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Television Signal Processing For Recording (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a kind of distributed video storage-playbacks, comprising: video acquisition module obtains the video flowing of terminal in real time and carries out processing formation Video stream information to it；Upload transmission module is cached, dispatched and is transmitted to the Video stream information of video acquisition module processing；Management of video module, handles Video stream information and is stored；Playback module is retrieved, the storage information in real-time retrieval management of video module simultaneously generates upload signal and gives upload transmission module；Client display module, for showing video storage information and video playback.Present invention employs the distributed flow media server architectures based on Hadoop, using multimode tupe, independently divide the work between each module, cooperate, and meet requirement of the system to performances such as high concurrent access, mass data processing, real-time, scalabilities.
Description
Technical field
The present invention relates to video monitoring and storage playback fields, and in particular to a kind of distributed video storage-playback,
For acquisition, transmission, real-time high-efficiency storage and the quick, intelligent retrieval to video stream data.
Background technique
In recent years, the carrying out in a deep going way in China with the projects such as " safe city ", " day net ", security industry development
Rapidly, video surveillance network and high-definition camera deployment radix largely increase, and thus bring the monitor video data of magnanimity.Such as
What reliable memory to these data progress high-quality and high-efficiency and real time inspection orderly rapidly, become current all video monitorings
The major issue that storage system must solve.
Strategy is locally stored using based on legacy operating system in current most Video Storage System, can be right
The video file of storage carries out quickly retrieval access.But this storage strategy depends on the file management function of operating system
The problems such as energy can generate the index information of many redundancies, and long-play can also generate fragmentation of data, file is lost.Therefore, this
A little existing systems are in the video stream data of the characteristics such as orderly, big, the height Time-Dependent of data volume of processing, due to its storage efficiency
Problem low, that search delay is big, concurrent capability is limited will be difficult to meet the needs of high-definition network video monitoring storage.
Summary of the invention
In view of the above-mentioned deficiencies in the prior art, the technical problem to be solved by the present invention is that proposing a kind of distribution
Video storage-playback.
In order to achieve the above object, the present invention is achieved by the following scheme:
A kind of distributed video storage-playback, comprising:
Video acquisition module obtains the video flowing of terminal in real time and carries out processing formation Video stream information to it；
Upload transmission module is cached, dispatched and is transmitted to the Video stream information of video acquisition module processing；
Management of video module, handles Video stream information and is stored；
Playback module is retrieved, the storage information in real-time retrieval management of video module simultaneously generates upload signal and gives upload transmission mould
Block；
Client display module；For showing video storage information and video playback.
Further, the video acquisition module uses Device Net SDK access interface.
Further, the upload transmission module uses the distributed flow media server architecture based on Hadoop, right
Video acquisition module acquires and the Video stream information handled is cached, dispatched and transmitted.
Further, the management of video module uses naked disk storage mode, is basic unit to naked magnetic using video frame
It is read and write on disk.
Further, the management of video module is handled and is stored to Video stream information, is specifically included: management of video
Video stream information is carried out linearly the index information of the key frame addition coding of Video stream information according to the index information by module
It sorts and is stored in database.
Further, video broadcast control system and mobile client that the client display module is constructed based on HTML5 technology
End.
The medicine have the advantages that
Present invention employs the distributed flow media server architectures based on Hadoop, using multimode tupe, each module
Between independently divide the work, cooperate, meet system to performances such as high concurrent access, mass data processing, real-time, scalabilities
Requirement.
Present invention employs the flow data storage mode based on naked disk, solves the redundancy letter generated by operating system
The problems such as breath, fragmentation of data and loss of data.
Present invention employs " crucial frame index " methods, substantially increase the recall precision and retrieval essence of document retrieval module
Degree.
The present invention has the function of " intelligent repeating query ", can periodically check whether video file lacks, ensure that video data
Integrality.
The present invention is based on HTML5 technologies to construct cross-platform, cross-terminal, video broadcast control system and mobile client without plug-in unit
End will support the access of the various ways such as Web, APP, wechat.
Detailed description of the invention
Fig. 1 is a kind of distributed video storage-playback structure chart proposed by the present invention；
Fig. 2 is the podium level architecture diagram provided by the invention.
Specific embodiment
The specific embodiment of the invention is described with reference to the accompanying drawings and embodiments:
For the demand of the high-quality storage video recording of user's real-time high-efficiency, in conjunction with the advantage and characteristic of current cloud storage technology, design is simultaneously
The general frame of system is developed, distributed flow media server architecture of the system based on Hadoop uses " intelligent repeating query
The mode of+linear retrieval+stream storage " carries out tissue to video data, it is possible to prevente effectively from fragmentation of data and video recording loss etc. are asked
Topic, while the mass data transfers for meeting high concurrent, realizes the efficient storage and real-time retrieval to video data.
Referring to Fig. 1 and Fig. 2, wherein Fig. 1 is a kind of distributed video storage-playback structure chart proposed by the present invention；Figure
2 be the podium level architecture diagram provided by the invention.
As depicted in figs. 1 and 2, a kind of distributed video storage-playback, comprising:
Video acquisition module obtains the video flowing of terminal in real time and carries out processing formation Video stream information to it；
Upload transmission module is cached, dispatched and is transmitted to the Video stream information of video acquisition module processing；
Management of video module, handles Video stream information and is stored；
Playback module is retrieved, the storage information in real-time retrieval management of video module simultaneously generates upload signal and gives upload transmission mould
Block；
Client display module；For showing video storage information and video playback.
In the embodiment of the present invention, independently divide the work between each module, cooperate, meets system to high concurrent access, magnanimity
The requirement of the performances such as data processing, real-time, scalability.
Video acquisition module uses Device Net SDK access interface, it is shielded between each equipment manufacturer's access protocol
Difference, take out unified equipment access interface.Device Net SDK is not only supported using ONVIF(style of opening network video
Frequency interface protocol), RTSP(real-time streaming protocol), SIP(session initiation protocol) etc. standard agreements front end hardware acquire equipment, also
Support web camera (IPC), hard disk video recorder (NVR, DVR) and the smart phone or collection of the proprietary protocols such as Haikang, big China
At the access of the Intelligent hardware product of video acquisition function.
Server-side is recorded according to the plan of user setting, by calling Device Net SDK to obtain the view of terminal in real time
Frequency flows, and by calling customized Streaming Media video recording interface Recorder SDK to protect the video flowing real-time transcoding obtained in real time
The file (ts, ps or privately owned form) of fixed size is saved as into recording caching, and passes through system protocol and notifies upload transmission mould
Block carries out file loading.
Upload transmission module uses the distributed flow media server architecture based on Hadoop, adopts to video acquisition module
The data flow of collection is cached, dispatched and is transmitted.Real-time reception records the notice of module and retrieval module, records the inspection of layer data library
Rope, cache file retrieval mode, the file loading in real time completing recording to storage server, and data are written into corresponding information
Library.The distributed structure/architecture of upload transmission module improves the transmission rate of whole system, alleviates the transmission pressure of backbone network,
Effectively avoid choking phenomenon when management of video module is concurrently written in multi-path video stream.Turned using distributed flow media multistage
Hair technology adapts to different transmission environments, has very strong scalability and adaptivity, can support big concurrent, high quality
Service request.Simultaneously as the nearest deployment feature of distributed structure/architecture, can effectively mitigate the transmission burden of backbone network.
Management of video module uses the flow data storage mode based on naked disk, has abandoned legacy operating system as video recording
The file management method of the cumbersome information of file addition.It reads and writes, solves because of behaviour on naked disk using video frame as basic unit
Make system and generate redundancy, fragmentation of data and loss of data the problems such as.Meanwhile management of video module is additionally used and " is closed
Key frame index " method, the i.e. index information to the key frame of video file addition specific coding, according to the information by video file
It carries out linear ordering and is stored in database, reduce retrieval time and its losing probability of video file, substantially increase file
The recall precision and retrieval precision of retrieval module.
Retrieval playback module has the function of " intelligent repeating query ", can periodically check whether video file lacks, and guarantees video counts
According to integrality, with the presence or absence of the text not transmitted in the index information and recording and storing file in real-time retrieval database
Part if not transmitted, and notifies upload transmission module, carries out uploading for file, prevents the loss of video file.
The client display module constructs cross-platform, cross-terminal, the video Broadcast Control system without plug-in unit based on HTML5 technology
System and mobile client support the access of Web, APP, the various ways such as wechat, can be used for various having that video stores and playback needs
The application scenarios asked.
Retrieval playback module specifically includes: client layer requests playback server-side by Http API mode, obtains specified
The video flowing of period, Play Back Server obtain the specified file in central store server by access database
Group, and by VODSDK, this document is combined into pushing video streaming to client layer；Client layer is requested by Http API mode
Playback service is supported the video flowing seek of set period to a certain frame function (such as F.F., retrogressing, dragging play)；Playback
Specified stream is pushed to client layer by VODSDK by service；Client layer requests playback server-side by Http API mode, will refer to
The video flowing of timing section saves as specified format file (mp4, mpeg2, mov, wmv, flv, mkv) etc.；Client layer passes through
The video flowing real-time transcoding that Convert SDK will acquire is to corresponding format and saves；
Client display module is for effective management of entire platform, all information inspections, recording plan, video file
Carry plan, video playback is requested, video return visit is checked, video file saves；Specifically: by database access interface,
It checks all information of system, realizes effective management to data；By Http api interface, notice is recorded server-side and is executed newly
Video flowing records plan；By Http api interface, upload service end is notified to execute new video file embarkation plan；Pass through
Http api interface, notice playback service, obtains the video flowing of set period, and the Stream returned by the service of paying a return visit
The reception of Receive interface progress video flowing；Pass through Http api interface, notice playback service, by the video flowing of set period
Specified format file is saved as, and carries out the reception of video file by the Stream Receive interface that the service of paying a return visit returns.
The preferred embodiment for the present invention is explained in detail above in conjunction with attached drawing, but the present invention is not limited to above-mentioned implementations
Mode within the knowledge of a person skilled in the art can also be without departing from the purpose of the present invention
It makes a variety of changes, these variations are related to the relevant technologies well-known to those skilled in the art, these both fall within the invention patent
Protection scope.
Many other changes and remodeling can be made by not departing from the spirit and scope of the present invention.It should be appreciated that the present invention is not
It is limited to specific embodiment, the scope of the present invention is defined by the following claims.
Claims (6)
1. a kind of distributed video storage-playback characterized by comprising
Video acquisition module obtains the video flowing of terminal in real time and carries out processing formation Video stream information to it；
Upload transmission module is cached, dispatched and is transmitted to the Video stream information of video acquisition module processing；
Management of video module, handles Video stream information and is stored；
Playback module is retrieved, the storage information in real-time retrieval management of video module simultaneously generates upload signal and gives upload transmission mould
Block；
Client display module, for showing video storage information and video playback.
2. a kind of distributed video storage-playback according to claim 1, which is characterized in that the video acquisition mould
Block uses Device Net SDK access interface.
3. a kind of distributed video storage-playback according to claim 1, which is characterized in that the upload transmission mould
Block uses the distributed flow media server architecture based on Hadoop, the video flowing letter for acquiring and handling to video acquisition module
Breath is cached, dispatched and is transmitted.
4. a kind of distributed video storage-playback according to claim 1, which is characterized in that the management of video mould
Block uses naked disk storage mode, reads and writes using video frame as basic unit on naked disk.
5. a kind of distributed video storage-playback according to claim 1, which is characterized in that the management of video mould
Block is handled and stored to Video stream information, is specifically included: management of video module is added the key frame of Video stream information and is compiled
Video stream information is carried out linear ordering according to the index information and is stored in database by the index information of code.
6. a kind of distributed video storage-playback according to claim 1, which is characterized in that the client is shown
The video broadcast control system and mobile client that module is constructed based on HTML5 technology.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810873451.4A CN109040640A (en) | 2018-08-02 | 2018-08-02 | A kind of distributed video storage-playback |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810873451.4A CN109040640A (en) | 2018-08-02 | 2018-08-02 | A kind of distributed video storage-playback |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109040640A true CN109040640A (en) | 2018-12-18 |
Family
ID=64649022
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810873451.4A Pending CN109040640A (en) | 2018-08-02 | 2018-08-02 | A kind of distributed video storage-playback |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109040640A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109685734A (en) * | 2018-12-21 | 2019-04-26 | 陈柯帆 | High sharpness video acquisition interface and method |
| CN111711835A (en) * | 2020-05-18 | 2020-09-25 | 深圳市东微智能科技股份有限公司 | Multi-channel audio and video integration method and system and computer readable storage medium |
| CN115278343A (en) * | 2022-06-21 | 2022-11-01 | 上海芯翌智能科技有限公司 | Video management system based on object storage |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101917389A (en) * | 2009-12-17 | 2010-12-15 | 新奥特（北京）视频技术有限公司 | Network television direct broadcasting system |
| CN101917590A (en) * | 2009-12-17 | 2010-12-15 | 新奥特（北京）视频技术有限公司 | Network live broadcasting system with playback function and player |
| CN102497542A (en) * | 2011-12-27 | 2012-06-13 | 前卫视讯（北京）科技发展有限公司 | Video positioning playback system and method thereof |
| CN104184998A (en) * | 2014-09-15 | 2014-12-03 | 四川省科本哈根能源科技有限公司 | Distributed video monitoring system based on Internet |
| CN104581406A (en) * | 2014-12-25 | 2015-04-29 | 桂林远望智能通信科技有限公司 | Network video recording and playback system and method |
-
2018
- 2018-08-02 CN CN201810873451.4A patent/CN109040640A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101917389A (en) * | 2009-12-17 | 2010-12-15 | 新奥特（北京）视频技术有限公司 | Network television direct broadcasting system |
| CN101917590A (en) * | 2009-12-17 | 2010-12-15 | 新奥特（北京）视频技术有限公司 | Network live broadcasting system with playback function and player |
| CN102497542A (en) * | 2011-12-27 | 2012-06-13 | 前卫视讯（北京）科技发展有限公司 | Video positioning playback system and method thereof |
| CN104184998A (en) * | 2014-09-15 | 2014-12-03 | 四川省科本哈根能源科技有限公司 | Distributed video monitoring system based on Internet |
| CN104581406A (en) * | 2014-12-25 | 2015-04-29 | 桂林远望智能通信科技有限公司 | Network video recording and playback system and method |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109685734A (en) * | 2018-12-21 | 2019-04-26 | 陈柯帆 | High sharpness video acquisition interface and method |
| CN111711835A (en) * | 2020-05-18 | 2020-09-25 | 深圳市东微智能科技股份有限公司 | Multi-channel audio and video integration method and system and computer readable storage medium |
| CN111711835B (en) * | 2020-05-18 | 2022-09-20 | 深圳市东微智能科技股份有限公司 | Multi-channel audio and video integration method and system and computer readable storage medium |
| CN115278343A (en) * | 2022-06-21 | 2022-11-01 | 上海芯翌智能科技有限公司 | Video management system based on object storage |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102740159B (en) | Media file storage format and self-adaptation transfer system | |
| CN102439578B (en) | Dynamic variable rate media delivery system | |
| CN110012300B (en) | Video live broadcasting method and device | |
| CN103069769B (en) | For the special-effect mode transmitted through the network crossfire of decoded video data | |
| CN104469433A (en) | Live video replay method and device | |
| CN103460667B (en) | The network flow of the video data asked using bytes range | |
| CN101977218B (en) | Internet playing file transcoding method and system | |
| CN102547478B (en) | Triggered slice on-demand system and method of streaming media based on CDN (Content Distribution Network) | |
| US8090761B2 (en) | Storage and distribution of segmented media data | |
| CN109040640A (en) | A kind of distributed video storage-playback | |
| CN105659623B (en) | Sending device, sending method, reception device and method of reseptance | |
| CN110493657A (en) | OnStream intelligent online steaming media platform system | |
| CN109698943B (en) | Network camera access platform with telescopic capacity | |
| CN101119278A (en) | Method and system for processing mass data | |
| CN108881942A (en) | A kind of super fusion normality recording and broadcasting system based on distributed objects storage | |
| CN102510519A (en) | Streaming media data processing method, playing method and device | |
| CN103634616A (en) | Cloud storage-based streaming media video-on-demand method and apparatus | |
| CN112019905A (en) | Live broadcast playback method, computer equipment and readable storage medium | |
| CN109074347A (en) | Real time content editor with limitation interactivity | |
| CN113676750A (en) | Stream media server cluster management system | |
| CN101127578A (en) | A method and system for processing a magnitude of data | |
| CN102404607A (en) | Internet video-on-demand system | |
| CN103561013A (en) | Streaming media data distributing system | |
| WO2012092901A2 (en) | Media storage system and method | |
| CN105049876B (en) | A kind of method and device that time shift is realized based on real-time transcoding |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181218 |