CN102279711B - Plug-in-based real-time data storage method and device - Google Patents
Plug-in-based real-time data storage method and device Download PDFInfo
- Publication number
- CN102279711B CN102279711B CN201110226586.XA CN201110226586A CN102279711B CN 102279711 B CN102279711 B CN 102279711B CN 201110226586 A CN201110226586 A CN 201110226586A CN 102279711 B CN102279711 B CN 102279711B
- Authority
- CN
- China
- Prior art keywords
- data
- plug
- unit
- uncorrected
- source data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a plug-in-based real-time data storage method and a plug-in-based real-time data storage device. The plug-in-based real-time data storage method comprises the steps of: acquiring a format type, a reception type and a target type corresponding to source data according to a communication protocol; determining a first plug-in corresponding to the source data according to the reception type so as to determine the reception address of the source data through the first plug-in; determining the second plug-in necessary for the source data analysis according to the format type; analyzing the source data through the second plug-in to remove the real-time transport protocol of the source data and form bare data; and storing the bare data. The plug-in-based real-time data storage method can store different types of data, simplify the data storage process and reduce the usage amount of the storage equipment. In addition, because the bare data is only stored in the real-time transport protocol in which the data are deleted, great storage space occupation of a large number of real-time transport protocols is avoided, and the utilization rate of the storage space is improved effectively.
Description
Technical field
The present invention relates to technical field of data storage, relate in particular to a kind of method for storing real-time data and device based on plug-in unit.
Background technology
At present, along with the development of computer technology, the type of data is more and more, for example: and video data or voice data, and video data or voice data have multiple different data layout.Memory device of the prior art can only be stored the data of single form, and need to increase corresponding memory device to the data of different-format, stores separately.As from the foregoing, in prior art, memory device can only be stored the data of single form, and the data that can't simultaneously store different-format, causes the data storage procedure complexity of different-format, need take a large amount of memory devices.
Summary of the invention
The invention provides a kind of method for storing real-time data and device based on plug-in unit, in order to solve the data storage procedure complexity of different-format in prior art, need take the defect of a large amount of memory devices, the method for storing real-time data of realization based on plug-in unit can be stored the data of different-format simultaneously, and the reduced data storing process also reduces the use amount of memory device.
The invention provides a kind of method for storing real-time data based on plug-in unit, comprising:
According to communications protocol, obtain Format Type corresponding to source data, type of receipt and target type;
According to type of receipt, determine the first plug-in unit that source data is corresponding, to determine the receiver address of source data by the first plug-in unit;
According to Format Type, determine that source data resolves the second required plug-in unit, resolve source data by the second plug-in unit and form uncorrected data with the real time transport protocol that removes source data;
The storage uncorrected data.
Method for storing real-time data based on plug-in unit provided by the invention, by obtain Format Type corresponding to source data, type of receipt and target type according to communications protocol, the first plug-in unit will be corresponding according to the type of receipt specified data receiver address, thereby can receive the data that send in the different pieces of information source; The second plug-in unit will be processed the real time transport protocol of deleting in data to the data that receive according to Format Type and form uncorrected data, thereby just uncorrected data can be unified to storage, realized that the method for storing real-time data based on plug-in unit can store the data of different-format simultaneously, the reduced data storing process also reduces the use amount of memory device.In addition, owing to having deleted the real time transport protocol in data, only store uncorrected data, avoid a large amount of real time transport protocols to take more storage space, effectively raise the utilization factor of storage space.
The present invention also provides a kind of real-time data memory device based on plug-in unit, comprising:
Acquisition module, for according to communications protocol, obtain Format Type corresponding to source data, type of receipt and target type;
The first processing module, for according to type of receipt, determine the first plug-in unit that source data is corresponding, to determine the receiver address of source data by the first plug-in unit;
The second processing module, for according to Format Type, determine that source data resolves the second required plug-in unit, resolves source data by the second plug-in unit and form uncorrected data with the real time transport protocol that removes source data;
Memory module, for storing uncorrected data.
Real-time data memory device based on plug-in unit provided by the invention, by obtaining Format Type corresponding to source data, type of receipt and target type, the first plug-in unit will be corresponding according to the type of receipt specified data receiver address, thereby can receive the data that send in the different pieces of information source; The second plug-in unit will be processed the real time transport protocol of deleting in data to the data that receive according to Format Type and form uncorrected data, thereby just uncorrected data can be unified to storage, realized that the method for storing real-time data based on plug-in unit can store the data of different-format simultaneously, the reduced data storing process also reduces the use amount of memory device.In addition, owing to having deleted the real time transport protocol in data, only store uncorrected data, avoid a large amount of real time transport protocols to take more storage space, effectively raise the utilization factor of storage space.
The accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, below will the accompanying drawing of required use in embodiment or description of the Prior Art be briefly described, apparently, accompanying drawing in the following describes is some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Fig. 1 is the process flow diagram that the present invention is based on the method for storing real-time data embodiment of plug-in unit;
Fig. 2 is the structural representation that the present invention is based on the real-time data memory device embodiment of plug-in unit.
Embodiment
For the purpose, technical scheme and the advantage that make the embodiment of the present invention clearer, below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is the present invention's part embodiment, rather than whole embodiment.Embodiment based in the present invention, the every other embodiment that those of ordinary skills obtain under the prerequisite of not making creative work, belong to the scope of protection of the invention.
Fig. 1 is the process flow diagram that the present invention is based on the method for storing real-time data embodiment of plug-in unit.As shown in Figure 1, the method for storing real-time data of the present embodiment based on plug-in unit comprises:
Step 1, according to communications protocol, obtain Format Type corresponding to source data, type of receipt and target type.Concrete, step 1, according to communications protocol, just can be learnt Format Type corresponding to source data, type of receipt and target type.Wherein, communications protocol refers to the communication between user and program, the user by web come the assigned source data Format Type, type of receipt, target type, whether the parameters such as audio frequency and video are arranged simultaneously.
Step 2, according to type of receipt, determine the first plug-in unit that source data is corresponding, to determine the receiver address of source data by the first plug-in unit.Concrete, obtain type of receipt corresponding to data according to step 1, determine the first plug-in unit that source data is corresponding, thereby the receiver address that the first plug-in unit is corresponding is set.Specifically be divided into following several situation: if the type of receipt of source data receives with multicast or clean culture receives, creating the first plug-in unit is User Datagram Protocol (User Datagram Protocol, hereinafter to be referred as UDP) plug-in unit, and receiving port number or the multicast address of source data are set by the first plug-in unit; If the type of receipt of source data is with real time streaming transport protocol (Real Time Streaming Protocol, hereinafter to be referred as: RTSP) receive, creating the first plug-in unit is real time streaming transport protocol (User Datagram Protocol, hereinafter to be referred as UDP) plug-in unit, and the reception real time streaming transport protocol address of source data is set by the first plug-in unit; If the type of receipt of source data is with HTML (Hypertext Markup Language) (Hyper Text Transfer Protocol, hereinafter to be referred as: HTTP) receive, creating the first plug-in unit is the HTML (Hypertext Markup Language) plug-in unit, and the reception HTML (Hypertext Markup Language) address of source data is set by the first plug-in unit.
Step 4, storage uncorrected data.Concrete, after step 3 processes data into uncorrected data, by step 4, uncorrected data is stored.In order to improve the stability of memory device, step 4 can be according to the principle storage uncorrected data of load balancing, for example: uncorrected data can be stored into to storage area network (Storage Area Network, hereinafter to be referred as SAN) on, be specially: create for by user-defined format, storing uncorrected data into the 3rd plug-in unit on storage area network, by the 3rd plug-in unit, uncorrected data is stored in storage area network, wherein, the detailed process that the 3rd plug-in unit stores uncorrected data on SAN into by user-defined format is: the data of every circuit-switched data source output are a corresponding object machine on SAN, when this circuit-switched data source need to be stored, want first to separate the storage space of 512 bytes as device head in object machine, in object machine, remaining storage space is divided into a plurality of memory pages, include a plurality of storage blocks in each memory page, each storage block can be stored the uncorrected data of a minutes, indicated the sum of memory page in device head, the sequence number of the memory page of current operation, the offset information of current write operation address, indicate the start time of current memory page in the top margin of memory page, the build of storage block has indicated the skew of current storage block and the write time of current storage block.When carrying out write operation, can at first from device head, read out current page sequence number, then read out current side-play amount, navigate to relevant position according to this side-play amount, create storage block, the write-in block header is current time and side-play amount, write again uncorrected data, after one minute, just finish this storage block, then the block size information in the backfill build, and then write next storage block, until write a full memory page, after memory page is full, then write next memory page.The self-defining storage mode of the method for storing real-time data of the present embodiment based on plug-in unit, both improved disk utilization, also improved the recall precision of historical media data.
Further, the method for storing real-time data of the present embodiment based on plug-in unit can also comprise before step 4: step 4a, according to target type judges whether uncorrected data needs to carry out elementary stream and change into transmitting data stream; If step 4b, carry out master data to uncorrected data and flow to the transmitting data stream conversion.Concrete, by step 4a and 4b, uncorrected data to be processed, the uncorrected data that makes to store in SAN is all stored with the form of transmitting data stream.
The method for storing real-time data of the present embodiment based on plug-in unit, by obtaining Format Type corresponding to source data, type of receipt and target type, the first plug-in unit will be corresponding according to the type of receipt specified data receiver address, thereby can receive the data that send in the different pieces of information source; The second plug-in unit will be processed the real time transport protocol of deleting in data to the data that receive according to Format Type and form uncorrected data, thereby just uncorrected data can be unified to storage, realized that the method for storing real-time data based on plug-in unit can store the data of different-format simultaneously, the reduced data storing process also reduces the use amount of memory device.In addition, owing to having deleted the real time transport protocol in data, only store uncorrected data, avoid a large amount of real time transport protocols to take more storage space, effectively raise the utilization factor of storage space.
Fig. 2 is the structural representation that the present invention is based on the real-time data memory device embodiment of plug-in unit.As shown in Figure 2, the real-time data memory device of the present embodiment based on plug-in unit comprises:
Acquisition module 1, for according to communications protocol, obtains Format Type corresponding to source data, type of receipt and target type;
The first processing module 2, for according to type of receipt, is determined the first plug-in unit that source data is corresponding, to determine the receiver address of source data by the first plug-in unit;
The second processing module 3 is for according to Format Type, determines that source data resolves the second required plug-in unit, resolves source data by the second plug-in unit and forms uncorrected data with the real time transport protocol that removes source data;
Memory module 4 is for storing uncorrected data.
Particularly, in the real-time data memory device of the present embodiment based on plug-in unit, the course of work of modules can, referring to the record in the method for storing real-time data embodiment that the present invention is based on plug-in unit, not repeat them here.
The real-time data memory device of the present embodiment based on plug-in unit, by obtaining Format Type corresponding to source data, type of receipt and target type, the first plug-in unit will be corresponding according to the type of receipt specified data receiver address, thereby can receive the data that send in the different pieces of information source; The second plug-in unit will be processed the real time transport protocol of deleting in data to the data that receive according to Format Type and form uncorrected data, thereby just uncorrected data can be unified to storage, realized that the method for storing real-time data based on plug-in unit can store the data of different-format simultaneously, the reduced data storing process also reduces the use amount of memory device.In addition, owing to having deleted the real time transport protocol in data, only store uncorrected data, avoid a large amount of real time transport protocols to take more storage space, effectively raise the utilization factor of storage space.
Finally it should be noted that: above embodiment only, in order to technical scheme of the present invention to be described, is not intended to limit; Although with reference to previous embodiment, the present invention is had been described in detail, those of ordinary skill in the art is to be understood that: its technical scheme that still can put down in writing aforementioned each embodiment is modified, or part technical characterictic wherein is equal to replacement; And these modifications or replacement do not make the essence of appropriate technical solution break away from the spirit and scope of various embodiments of the present invention technical scheme.
Claims (3)
1. the method for storing real-time data based on plug-in unit, is characterized in that, comprising:
According to communications protocol, obtain Format Type corresponding to source data, type of receipt and target type;
According to type of receipt, determine the first plug-in unit that source data is corresponding, to determine the receiver address of source data by the first plug-in unit;
According to Format Type, determine that source data resolves the second required plug-in unit, resolve source data by the second plug-in unit and form uncorrected data with the real time transport protocol that removes source data;
According to target type, judge whether uncorrected data needs to carry out elementary stream and change into transmitting data stream;
If uncorrected data is carried out to master data and flows to the transmitting data stream conversion;
The storage uncorrected data;
Wherein, if the type of receipt of source data receives with multicast or clean culture receives, creating the first plug-in unit is the User Datagram Protocol plug-in unit, and receiving port number or the multicast address of source data are set by the first plug-in unit; If the type of receipt of source data receives with real time streaming transport protocol, creating the first plug-in unit is the real time streaming transport protocol plug-in unit, and the reception real time streaming transport protocol address of source data is set by the first plug-in unit; If the type of receipt of source data receives with HTML (Hypertext Markup Language), creating the first plug-in unit is the HTML (Hypertext Markup Language) plug-in unit, and the reception HTML (Hypertext Markup Language) address of source data is set by the first plug-in unit.
2. the method for storing real-time data based on plug-in unit according to claim 1, is characterized in that, describedly resolves source data by the second plug-in unit and form uncorrected data with the real time transport protocol that removes source data, is specially:
Judge in source data and whether contain video data and voice data simultaneously;
If, source data is split into to video data and voice data, and resolve respectively video data and voice data by the second plug-in unit and form video uncorrected data and audio frequency uncorrected data to remove corresponding real time transport protocol, then video uncorrected data and audio frequency uncorrected data are merged into to uncorrected data;
If not, by the second plug-in unit, resolve source data and form uncorrected data with the real time transport protocol that removes source data.
3. the method for storing real-time data based on plug-in unit according to claim 1 and 2, is characterized in that, described storage uncorrected data is specially:
According to the principle of load balancing, uncorrected data is stored on storage area network, be specially:
Create for by user-defined format, storing uncorrected data into the 3rd plug-in unit on storage area network, by the 3rd plug-in unit, uncorrected data is stored in storage area network;
Wherein, the detailed process that the 3rd plug-in unit stores uncorrected data on storage area network into by user-defined format is: the data of every circuit-switched data source output are a corresponding object machine on storage area network, when this circuit-switched data source need to be stored, want first to separate the storage space of 512 bytes as device head in object machine, in object machine, remaining storage space is divided into a plurality of memory pages, include a plurality of storage blocks in each memory page, each storage block can be stored the uncorrected data of a minutes
Indicated the sequence number, the offset information of current write operation address of memory page of sum, the current operation of memory page in device head; Indicate the start time of current memory page in the top margin of memory page, the build of storage block has indicated the skew of current storage block and the write time of current storage block.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110226586.XA CN102279711B (en) | 2011-08-09 | 2011-08-09 | Plug-in-based real-time data storage method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110226586.XA CN102279711B (en) | 2011-08-09 | 2011-08-09 | Plug-in-based real-time data storage method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102279711A CN102279711A (en) | 2011-12-14 |
| CN102279711B true CN102279711B (en) | 2014-01-01 |
Family
ID=45105185
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110226586.XA Active CN102279711B (en) | 2011-08-09 | 2011-08-09 | Plug-in-based real-time data storage method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102279711B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102984571B (en) * | 2012-12-07 | 2015-04-22 | 青岛海信信芯科技有限公司 | External data reading method of Gstreamer in digital television and device thereof |
| CN109979109B (en) * | 2019-03-13 | 2021-04-27 | 上海网之易璀璨网络科技有限公司 | Rental server processing method, processor, terminal and storage medium |
| CN111026735B (en) * | 2019-12-10 | 2023-03-21 | 腾讯科技（深圳）有限公司 | Data transmission method, device, equipment and medium |
| CN111562945B (en) * | 2020-04-01 | 2021-12-21 | 杭州博雅鸿图视频技术有限公司 | Multimedia processing method, device, equipment and storage medium |
| CN117632035B (en) * | 2023-12-13 | 2024-06-04 | 中国电子投资控股有限公司 | Data storage method, system, storage medium and computer equipment |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101409937A (en) * | 2008-01-25 | 2009-04-15 | 聂沫平 | Method and apparatus for converting script into data format supported by target system |
| CN101646995A (en) * | 2007-03-26 | 2010-02-10 | 国际商业机器公司 | Data stream filters and plug-ins for storage managers |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7171670B2 (en) * | 2001-02-14 | 2007-01-30 | Ricoh Co., Ltd. | Method and system of remote diagnostic, control and information collection using multiple formats and multiple protocols with verification of formats and protocols |
-
2011
- 2011-08-09 CN CN201110226586.XA patent/CN102279711B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101646995A (en) * | 2007-03-26 | 2010-02-10 | 国际商业机器公司 | Data stream filters and plug-ins for storage managers |
| CN101409937A (en) * | 2008-01-25 | 2009-04-15 | 聂沫平 | Method and apparatus for converting script into data format supported by target system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102279711A (en) | 2011-12-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102279711B (en) | Plug-in-based real-time data storage method and device | |
| CN102800065B (en) | Based on the augmented reality Apparatus and method for of Quick Response Code recognition and tracking | |
| CN105100963A (en) | Audio-video media file synthetic method and service system | |
| CN102694831B (en) | Mobile terminal streaming compensation data method and system, content distributing network | |
| CN103414949A (en) | Multimedia editing system and method based on smart television | |
| CN104581406A (en) | Network video recording and playback system and method | |
| CN103299600A (en) | Apparatus and method for transmitting live media content | |
| CN109634824B (en) | Distributed storage performance test method and system in broadcasting and television service scene | |
| CN103414798B (en) | The communication means of address transition Network Based, equipment and system | |
| CN105430534A (en) | Intelligent device reporting data method and system | |
| CN102438004A (en) | Method and system for acquiring metadata information of media file and multimedia player | |
| CN103702176A (en) | HLS (http live streaming) protocol-based video downloading method and device | |
| CN105447146A (en) | Massive data collecting and exchanging system and method | |
| CN110515797A (en) | A kind of data processing method, device, equipment and computer readable storage medium | |
| CN104104972A (en) | Multimedia playing method, apparatus and system | |
| CN103220587A (en) | Method and device for obtaining time shifting contents | |
| CN104536700A (en) | Code stream data rapid storage/reading method and system | |
| CN103152605A (en) | Method and device for audio data transcoding and transcoding server | |
| CN104753811A (en) | Streaming medium service optimizing method, device and system | |
| CN103761194B (en) | A kind of EMS memory management process and device | |
| CN102833241A (en) | Streaming media service traffic record merged-processing method and device | |
| CN104202309A (en) | Data transmission control method and apparatus | |
| CN115866331A (en) | Video frame extraction analysis method, device, equipment and storage medium | |
| CN102647584A (en) | Video file generation method and system | |
| CN103036929A (en) | Multimedia file processing method and network side equipment in communication system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |