CN110035307A - A kind of fragment storage method and device - Google Patents

A kind of fragment storage method and device Download PDF

Info

Publication number
CN110035307A
CN110035307A CN201910177294.8A CN201910177294A CN110035307A CN 110035307 A CN110035307 A CN 110035307A CN 201910177294 A CN201910177294 A CN 201910177294A CN 110035307 A CN110035307 A CN 110035307A
Authority
CN
China
Prior art keywords
recording service
subfiles
audio
file
storage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910177294.8A
Other languages
Chinese (zh)
Inventor
靳伟明
牛永会
王艳辉
杨春晖
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Visionvera Information Technology Co Ltd
Original Assignee
Visionvera Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Visionvera Information Technology Co Ltd filed Critical Visionvera Information Technology Co Ltd
Priority to CN201910177294.8A priority Critical patent/CN110035307A/en
Publication of CN110035307A publication Critical patent/CN110035307A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network-specific arrangements or communication protocols supporting networked applications
    • H04L67/06Network-specific arrangements or communication protocols supporting networked applications adapted for file transfer, e.g. file transfer protocol [FTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/231Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/233Processing of audio elementary streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/27Server based end-user applications
    • H04N21/274Storing end-user multimedia data in response to end-user request, e.g. network recorder
    • H04N21/2743Video hosting of uploaded data from client
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845Structuring of content, e.g. decomposing content into time segments
    • H04N21/8455Structuring of content, e.g. decomposing content into time segments involving pointers to the content, e.g. pointers to the I-frames of the video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • H04N7/155Conference systems involving storage of or access to video conference sessions

Abstract

The embodiment of the invention provides a kind of fragment storage method and devices, it networks applied to view, the view networking includes autonomous server, object storage server, storage gateway and recording service device, which comprises the audio and video data streams of the spokesman of video conference are sent in storage gateway by autonomous server;It stores gateway and audio and video data streams is forwarded to recording service device;File where audio and video data streams is divided into one or more subfiles by recording service device;Recording service device is that one or more subfiles respectively correspond one object of creation;The corresponding object of one or more subfiles is uploaded to object storage server by recording service device.Through the embodiment of the present invention, the risk that big document recording mode causes entire file that can not play because recording mistake is avoided.Meanwhile when needing to download file, can partial data corresponding to the corresponding object of subfile where download part data, avoid the waste of network bandwidth, promote the performance of terminal.

Description

A kind of fragment storage method and device
Technical field
The present invention relates to technical field of memory, more particularly to a kind of fragment storage method and a kind of fragment storage device.
Background technique
It is the important milestone of network Development depending on networking, is a real-time network, can be realized HD video real-time Transmission, Push numerous Internet applications to HD video, high definition is face-to-face.
Object storage is mainly used in the storage of mass data, and object storage system is in a flat container organization Storage file, and the file for each storage is correspondingly arranged a unique identification code, passes through unique identification code, Ke Yi The file of storage is retrieved in object storage system.
But in object storage system, the partial content of entire file or this document is either uploaded or downloaded It is required to complete file changing into object and is uploaded or downloaded, due to requiring to upload or download complete file every time Content in turn results in the significant wastage of network bandwidth and the performance loss of user terminal.
Summary of the invention
In view of the above problems, it proposes the embodiment of the present invention and overcomes the above problem or at least partly in order to provide one kind A kind of fragment storage method to solve the above problems and a kind of corresponding fragment storage device.
To solve the above-mentioned problems, the embodiment of the invention discloses a kind of fragment storage methods, are applied to view networking, described It include autonomous server, object storage server, storage gateway and recording service device depending on networking, which comprises
The audio and video data streams of the spokesman of video conference are sent in the storage gateway by the autonomy server;
The audio and video data streams are forwarded to recording service device by the storage gateway;
File where the audio and video data streams is divided into one or more subfiles by the recording service device;
The recording service device is that one or more of subfiles respectively correspond one object of creation;
The corresponding object of one or more of subfiles is uploaded to the object storage service by the recording service device Device.
Optionally, the file where the audio and video data streams is divided into one or more subfiles by the recording service device The step of, comprising:
The recording service device according to it is preset write offset, write length and preset maximum capacity judgement write-in described in Whether the data of the file where audio and video data streams exceed maximum capacity;Wherein, described to write offset for indicating write-in number According to position, it is described write length for indicates be written data shared by file capability value;
If so, according to the number for increasing subfile, and newly-built subfile is determined beyond value and the maximum capacity.
Optionally, further includes:
When the data of file where the audio and video data streams are written in judgement are without departing from maximum capacity, then do not create Subfile.
Optionally, the recording service device is the step that one or more of subfiles respectively correspond one object of creation Suddenly, comprising:
The recording service device is arranged one or more of subfiles by the sequence of storing data, and by described The sequence of storing data is that one or more of subfiles respectively correspond one object of creation.
Optionally, one or more of subfiles file identification having the same, the recording service device is by described one The step of corresponding object of a or multiple subfiles is uploaded to the object storage server, comprising:
The recording service device will be on the corresponding object of one or more of subfiles of file identification having the same Reach the object storage server.
The embodiment of the invention also discloses a kind of fragment storage devices, are applied to view networking, the view networking includes autonomy Server, object storage server, storage gateway and recording service device, described device include:
Audio and video data streams sending module, for the autonomous server by the audio, video data of the spokesman of video conference Stream is sent in the storage gateway;
The audio and video data streams are forwarded to recording service for the storage gateway by audio and video data streams forwarding module Device;
Module is split, the file where the audio and video data streams is divided into one or more for the recording service device Subfile;
Object Creation module is that one or more of subfiles respectively correspond creation one for the recording service device Object;
The corresponding object of one or more of subfiles is uploaded to described by uploading module for the recording service device Object storage server.
Optionally, the fractionation module includes:
Judging submodule writes offset, writes length and preset maximum hold for the recording service device according to preset Magnitude judges whether the data for the file being written where the audio and video data streams exceed maximum capacity;Wherein, described to write partially It diverts from one use to another in the position for indicating write-in data, the length of writing is for indicating the capability value of file shared by write-in data;
Subfile creates submodule, is used for if so, increasing subfile according to determining beyond value and the maximum capacity Number, and newly-built subfile.
Optionally, further includes:
Submodule is kept, the data for the file where the audio and video data streams are written in judgement are held without departing from maximum When magnitude, then subfile is not created.
Optionally, the Object Creation module includes:
Object Creation submodule, for the recording service device by one or more of subfiles by the suitable of storing data Sequence is arranged, and is that one or more of subfiles respectively correspond one object of creation by the sequence of the storing data.
Optionally, one or more of subfiles file identification having the same, the uploading module include:
Submodule is uploaded, for the recording service device by one or more of Ziwens of file identification having the same The corresponding object of part is uploaded to the object storage server.
The embodiment of the invention also provides a kind of devices, comprising:
One or more processors;With
One or more machine readable medias of instruction are stored thereon with, are executed when by one or more of processors When, so that described device executes one or more method as described above.
The embodiment of the invention also provides one or more machine readable medias, are stored thereon with instruction, when by one or When multiple processors execute, so that the processor executes one or more method as described above.
The embodiment of the present invention includes following advantages: the embodiment of the present invention is by by the audio-video number of the spokesman of video conference It is sent in storage gateway according to stream;Audio and video data streams are forwarded to recording service device by storage gateway;Pass through video recording clothes again File where audio and video data streams is divided into one or more subfiles by business device;And it is respectively corresponded for one or more subfiles Create an object;The corresponding object of one or more subfiles is finally uploaded to object storage server.So as to incite somebody to action Data flow depending on meeting of networking is recorded in multiple subfiles, and avoiding big document recording mode because recording mistake leads to entire text The risk that part can not play.Meanwhile when needing to download file, can subfile where download part data it is corresponding right As corresponding partial data, the waste of network bandwidth is avoided, promotes the performance of terminal.
Detailed description of the invention
Fig. 1 is a kind of networking schematic diagram of view networking of the invention;
Fig. 2 is a kind of hardware structural diagram of node server of the invention;
Fig. 3 is a kind of hardware structural diagram of access switch of the invention;
Fig. 4 is the hardware structural diagram that a kind of Ethernet association of the invention turns gateway;
Fig. 5 is a kind of step flow chart of fragment storage method embodiment of the invention;
Fig. 6 is a kind of structural block diagram of fragment memory device embodiment of the invention.
Specific embodiment
In order to make the foregoing objectives, features and advantages of the present invention clearer and more comprehensible, with reference to the accompanying drawing and specific real Applying mode, the present invention is described in further detail.
It is the important milestone of network Development depending on networking, is a real-time network, can be realized HD video real-time Transmission, Push numerous Internet applications to HD video, high definition is face-to-face.
Real-time high-definition video switching technology is used depending on networking, it can be such as high in a network platform by required service Clear video conference, Intellectualized monitoring analysis, emergency command, digital broadcast television, delay TV, the Web-based instruction, shows video monitoring Field live streaming, VOD program request, TV Mail, individual character records (PVR), Intranet (manages) channel by oneself, intelligent video Broadcast Control, information publication All be incorporated into a system platform etc. services such as tens of kinds of videos, voice, picture, text, communication, data, by TV or Computer realizes that high-definition quality video plays.
Embodiment in order to enable those skilled in the art to better understand the present invention is introduced to depending on networking below:
Depending on networking, applied portion of techniques is as described below:
Network technology (Network Technology)
Traditional ethernet (Ethernet) is improved depending on the network technology innovation networked, with potential huge on network Video flow.(Circuit is exchanged different from simple network packet packet switch (Packet Switching) or lattice network Switching), Streaming demand is met using Packet Switching depending on networking technology.Has grouping depending on networking technology Flexible, the simple and low price of exchange, is provided simultaneously with the quality and safety assurance of circuit switching, it is virtually electric to realize the whole network switch type The seamless connection of road and data format.
Switching technology (Switching Technology)
Two advantages of asynchronous and packet switch that Ethernet is used depending on networking eliminate Ethernet under the premise of complete compatible and lack It falls into, has the end-to-end seamless connection of the whole network, direct user terminal, directly carrying IP data packet.User data is in network-wide basis It is not required to any format conversion.It is the more advanced form of Ethernet depending on networking, is a real-time exchange platform, can be realized at present mutually The whole network large-scale high-definition realtime video transmission that networking cannot achieve pushes numerous network video applications to high Qinghua, unitizes.
Server technology (Server Technology)
It is different from traditional server, its Streaming Media depending on the server technology in networking and unified video platform Transmission be built upon it is connection-oriented on the basis of, data-handling capacity is unrelated with flow, communication time, single network layer energy Enough transmitted comprising signaling and data.For voice and video business, handled depending on networking and unified video platform Streaming Media Complexity many simpler than data processing, efficiency substantially increase hundred times or more than traditional server.
Reservoir technology (Storage Technology)
The ultrahigh speed reservoir technology of unified video platform in order to adapt to the media content of vast capacity and super-flow and Using state-of-the-art real time operating system, the programme information in server instruction is mapped to specific hard drive space, media Content is no longer pass through server, and moment is directly delivered to user terminal, and user waits typical time less than 0.2 second.It optimizes Sector distribution greatly reduces the mechanical movement of hard disc magnetic head tracking, and resource consumption only accounts for the 20% of the internet ad eundem IP, but The concurrent flow greater than 3 times of traditional disk array is generated, overall efficiency promotes 10 times or more.
Network security technology (Network Security Technology)
Depending on the structural design networked by servicing independent licence system, equipment and the modes such as user data is completely isolated every time The network security problem that puzzlement internet has thoroughly been eradicated from structure, does not need antivirus applet, firewall generally, has prevented black The attack of visitor and virus, structural carefree secure network is provided for user.
It services innovative technology (Service Innovation Technology)
Business and transmission are fused together by unified video platform, whether single user, private user or a net The sum total of network is all only primary automatic connection.User terminal, set-top box or PC are attached directly to unified video platform, obtain rich The multimedia video service of rich colorful various forms.Unified video platform is traditional to substitute with table schema using " menu type " Complicated applications programming, considerably less code, which can be used, can be realized complicated application, realize the new business innovation of " endless ".
Networking depending on networking is as described below:
It is a kind of central controlled network structure depending on networking, which can be Tree Network, Star network, ring network etc. class Type, but centralized control node is needed to control whole network in network on this basis.
As shown in Figure 1, being divided into access net and Metropolitan Area Network (MAN) two parts depending on networking.
The equipment of access mesh portions can be mainly divided into 3 classes: node server, access switch, terminal (including various machines Top box, encoding board, memory etc.).Node server is connected with access switch, and access switch can be with multiple terminal phases Even, and it can connect Ethernet.
Wherein, node server is the node that centralized control functions are played in access net, can control access switch and terminal. Node server can directly be connected with access switch, can also directly be connected with terminal.
Similar, the equipment of metropolitan area mesh portions can also be divided into 3 classes: metropolitan area server, node switch, node serve Device.Metropolitan area server is connected with node switch, and node switch can be connected with multiple node servers.
Wherein, node server is the node server for accessing mesh portions, i.e. node server had both belonged to access wet end Point, and belong to metropolitan area mesh portions.
Metropolitan area server is the node that centralized control functions are played in Metropolitan Area Network (MAN), can control node switch and node serve Device.Metropolitan area server can be directly connected to node switch, can also be directly connected to node server.
It can be seen that be entirely a kind of central controlled network structure of layering depending on networking network, and node server and metropolitan area The network controlled under server can be the various structures such as tree-shaped, star-like, cyclic annular.
Visually claim, access mesh portions can form unified video platform (part in virtual coil), and multiple unified videos are flat Platform can form view networking;Each unified video platform can be interconnected by metropolitan area and wide area depending on networking.
Classify depending on networked devices
1.1 embodiment of the present invention can be mainly divided into 3 classes: server depending on the equipment in networking, interchanger (including ether Net gateway), terminal (including various set-top boxes, encoding board, memory etc.).Depending on networking can be divided on the whole Metropolitan Area Network (MAN) (or National net, World Wide Web etc.) and access net.
1.2 equipment for wherein accessing mesh portions can be mainly divided into 3 classes: node server, access switch (including ether Net gateway), terminal (including various set-top boxes, encoding board, memory etc.).
The specific hardware structure of each access network equipment are as follows:
Node server:
As shown in Fig. 2, mainly including Network Interface Module 201, switching engine module 202, CPU module 203, disk array Module 204;
Wherein, Network Interface Module 201, the Bao Jun that CPU module 203, disk array module 204 are come in enter switching engine Module 202;Switching engine module 202 look into the operation of address table 205 to the packet come in, to obtain the navigation information of packet; And the packet is stored according to the navigation information of packet the queue of corresponding pack buffer 206;If the queue of pack buffer 206 is close It is full, then it abandons;All pack buffer queues of 202 poll of switching engine mould, are forwarded: 1) port if meeting the following conditions It is less than to send caching;2) the queue package counting facility is greater than zero.Disk array module 204 mainly realizes the control to hard disk, including The operation such as initialization, read-write to hard disk;CPU module 203 is mainly responsible between access switch, terminal (not shown) Protocol processes, to address table 205 (including descending protocol packet address table, uplink protocol package address table, data packet addressed table) Configuration, and, the configuration to disk array module 204.
Access switch:
As shown in figure 3, mainly including Network Interface Module (downstream network interface module 301, uplink network interface module 302), switching engine module 303 and CPU module 304;
Wherein, the packet (upstream data) that downstream network interface module 301 is come in enters packet detection module 305;Packet detection mould Whether mesh way address (DA), source address (SA), type of data packet and the packet length of the detection packet of block 305 meet the requirements, if met, It then distributes corresponding flow identifier (stream-id), and enters switching engine module 303, otherwise abandon;Uplink network interface mould The packet (downlink data) that block 302 is come in enters switching engine module 303;The data packet that CPU module 204 is come in enters switching engine Module 303;Switching engine module 303 look into the operation of address table 306 to the packet come in, to obtain the navigation information of packet; If the packet into switching engine module 303 is that downstream network interface is gone toward uplink network interface, in conjunction with flow identifier (stream-id) packet is stored in the queue of corresponding pack buffer 307;If the queue of the pack buffer 307 is close full, It abandons;If the packet into switching engine module 303 is not that downstream network interface is gone toward uplink network interface, according to packet Navigation information is stored in the data packet queue of corresponding pack buffer 307;If the queue of the pack buffer 307 is close full, Then abandon.
All pack buffer queues of 303 poll of switching engine module, are divided to two kinds of situations in embodiments of the present invention:
If the queue is that downstream network interface is gone toward uplink network interface, meets the following conditions and be forwarded: 1) It is less than that the port sends caching;2) the queue package counting facility is greater than zero;3) token that rate control module generates is obtained;
If the queue is not that downstream network interface is gone toward uplink network interface, meets the following conditions and is forwarded: 1) it is less than to send caching for the port;2) the queue package counting facility is greater than zero.
Rate control module 208 is configured by CPU module 204, to all downlink networks in programmable interval Interface generates token toward the pack buffer queue that uplink network interface is gone, to control the code rate of forwarded upstream.
CPU module 304 is mainly responsible for the protocol processes between node server, the configuration to address table 306, and, Configuration to rate control module 308.
Ethernet association turns gateway:
As shown in figure 4, mainly including Network Interface Module (downstream network interface module 401, uplink network interface module 402), switching engine module 403, CPU module 404, packet detection module 405, rate control module 408, address table 406, Bao Huan Storage 407 and MAC adding module 409, MAC removing module 410.
Wherein, the data packet that downstream network interface module 401 is come in enters packet detection module 405;Packet detection module 405 is examined Ethernet mac DA, ethernet mac SA, Ethernet length or frame type, the view networking mesh way address of measured data packet DA, whether meet the requirements depending on networking source address SA, depending on networking data Packet type and packet length, corresponding stream is distributed if meeting Identifier (stream-id);Then, MAC DA, MAC SA, length or frame type are subtracted by MAC removing module 410 (2byte), and enter corresponding receive and cache, otherwise abandon;
Downstream network interface module 401 detects the transmission caching of the port, according to the view of packet networking mesh if there is Bao Ze Address D A knows the ethernet mac DA of corresponding terminal, adds the ethernet mac DA of terminal, Ethernet assists the MAC for turning gateway SA, Ethernet length or frame type, and send.
The function that Ethernet association turns other modules in gateway is similar with access switch.
Terminal:
It mainly include Network Interface Module, Service Processing Module and CPU module;For example, set-top box mainly connects including network Mouth mold block, video/audio encoding and decoding engine modules, CPU module;Encoding board mainly includes Network Interface Module, video encoding engine Module, CPU module;Memory mainly includes Network Interface Module, CPU module and disk array module.
The equipment of 1.3 metropolitan area mesh portions can be mainly divided into 2 classes: node server, node switch, metropolitan area server. Wherein, node switch mainly includes Network Interface Module, switching engine module and CPU module;Metropolitan area server mainly includes Network Interface Module, switching engine module and CPU module are constituted.
2, networking data package definition is regarded
2.1 access network data package definitions
Access net data packet mainly include following sections: destination address (DA), source address (SA), reserve bytes, payload(PDU)、CRC。
As shown in the table, the data packet for accessing net mainly includes following sections:
DA SA Reserved Payload CRC
Wherein:
Destination address (DA) is made of 8 bytes (byte), and first character section indicates type (such as the various associations of data packet Discuss packet, multicast packet, unicast packet etc.), be up to 256 kinds of possibility, the second byte to the 6th byte is metropolitan area net address, Seven, the 8th bytes are access net address;
Source address (SA) is also to be made of 8 bytes (byte), is defined identical as destination address (DA);
Reserve bytes are made of 2 bytes;
The part payload has different length according to the type of different datagrams, is if it is various protocol packages 64 bytes are 32+1024=1056 bytes if it is single group unicast packets words, are not restricted to above 2 kinds certainly;
CRC is made of 4 bytes, and calculation method follows the Ethernet CRC algorithm of standard.
2.2 Metropolitan Area Network (MAN) packet definitions
The topology of Metropolitan Area Network (MAN) is pattern, may there is 2 kinds, connection even of more than two kinds, i.e. node switching between two equipment It can all can exceed that 2 kinds between machine and node server, node switch and node switch, node switch and node server Connection.But the metropolitan area net address of metropolitan area network equipment is uniquely, to close to accurately describe the connection between metropolitan area network equipment System, introduces parameter in embodiments of the present invention: label, uniquely to describe a metropolitan area network equipment.
(Multi-Protocol Label Switch, multiprotocol label are handed over by the definition of label and MPLS in this specification Change) label definition it is similar, it is assumed that between equipment A and equipment B there are two connection, then data packet from equipment A to equipment B just There are 2 labels, data packet also there are 2 labels from equipment B to equipment A.Label is divided into label, outgoing label, it is assumed that data packet enters The label (entering label) of equipment A is 0x0000, and the label (outgoing label) when this data packet leaves equipment A may reform into 0x0001.The networking process of Metropolitan Area Network (MAN) is to enter network process under centralized control, also means that address distribution, the label of Metropolitan Area Network (MAN) Distribution be all to be dominated by metropolitan area server, node switch, node server be all passively execute, this point with The label distribution of MPLS is different, and the distribution of the label of MPLS is the result that interchanger, server are negotiated mutually.
As shown in the table, the data packet of Metropolitan Area Network (MAN) mainly includes following sections:
DA SA Reserved Label Payload CRC
That is destination address (DA), source address (SA), reserve bytes (Reserved), label, payload (PDU), CRC.Its In, the format of label, which can refer to, such as gives a definition: label is 32bit, wherein high 16bit retains, only with low 16bit, its position Set is between the reserve bytes and payload of data packet.
Referring to Fig. 5, a kind of step flow chart of fragment storage method embodiment of the invention is shown, can specifically include Following steps:
Step 501: the audio and video data streams of the spokesman of video conference are sent to the storage by the autonomy server In gateway;
In the concrete realization, the fragment storage method that the embodiment of the present invention proposes is applied in view networking, relates generally to regard Autonomous server, object storage server, storage gateway and recording service device in networking.
Firstly, Conference control terminal (Pamir) is sent to conference management server (can manage) starts meeting instruction, can manage It is forwarded after receiving to autonomous server and starts meeting instruction, autonomous server receives rear preliminary conference environment.Then, Pamir to Meeting pipe sends the dynamic addition side's of attending a meeting instruction, and participant pulls in meeting including the virtual terminal in storage gateway.It connects again , Pamir to can pipe send switching spokesman's instruction, the audio, video data of spokesman is issued all participants after receiving by autonomy Person and storage gateway in virtual terminal, open video conference.
Step 502: the audio and video data streams are forwarded to recording service device by the storage gateway;
In the concrete realization, when storage gateway receives the audio and video data streams of autonomous server forwarding, which can be regarded Frequency data stream is forwarded to recording service device.
Step 503: the file where the audio and video data streams is divided into one or more Ziwens by the recording service device Part;
In the concrete realization, the file where audio and video data streams can be divided by one or more by recording service device Subfile.
In embodiments of the present invention, step 503 may include following sub-step:
The recording service device according to it is preset write offset, write length and preset maximum capacity judgement write-in described in Whether the data of the file where audio and video data streams exceed maximum capacity;Wherein, described to write offset for indicating write-in number According to position, it is described write length for indicates be written data shared by file capability value;If so, according to beyond value and it is described most Large capacity value determines the number for increasing subfile, and newly-built subfile.
When the data of file where the audio and video data streams are written in judgement are without departing from maximum capacity, then do not create Subfile.
In embodiments of the present invention, recording service device can according to the file size value of file where audio and video data streams and File where audio and video data streams is divided into one or more subfiles by preset maximum capacity, wherein each subfile The capability value of maximum capacity having the same, file can be KB or MB, can also be GB, the maximum of subfile Capability value can be arranged on demand, and the present invention is not specifically limited.The embodiment of the present invention is by taking file size value unit is MB as an example It is illustrated.Assuming that the capability value of file be 15MB, maximum capacity 3MB, then can be by the text where audio and video data streams Part is divided into the subfile of 5 3MB.If the capability value of file be 14MB, maximum capacity 3MB, then can be by audio, video data File where stream is divided into 4 3MB, the subfile of 1 2MB.
In practical applications, if the file size of file is too small where audio and video data streams, son can not also be split File.
Step 504: the recording service device is that one or more of subfiles respectively correspond one object of creation;
In the concrete realization, one object of creation can be corresponded to for the one or more subfiles split.
In embodiments of the present invention, step 504 may comprise steps of:
The recording service device is arranged one or more of subfiles by the sequence of storing data, and by described The sequence of storing data is that one or more of subfiles respectively correspond one object of creation.
In the concrete realization, since audio and video data streams have timing can be when being split data flow on time Between sequentially split, and respectively to each subfile setting flag, such as subfile 1, subfile 2 ... is splitting subfile Afterwards, corresponding file object can be created for each subfile, such as 1 corresponding objects 1 of subfile, 2 corresponding objects 2 ... of subfile.
Step 505: the corresponding object of one or more of subfiles is uploaded to the object by the recording service device Storage server.
It in the concrete realization, can be by each text after recording service device creates the corresponding file object of each subfile Part object is uploaded to object storage server.
In embodiments of the present invention, the subfile that can be come out for file declustering where the same audio/video flow data is arranged Identical Data Identification, at this point, step 505 may include following sub-step:
The recording service device will be on the corresponding object of one or more of subfiles of file identification having the same Reach the object storage server.
In the concrete realization, the corresponding object of one or more subfiles identified with same file can be uploaded to It is stored in object storage server.It, can when so that user needing to upload or download the partial content of the audio and video data streams With according to identification retrieval to associated documents, and the corresponding object of subfile needed for therefrom determining where data, with upload or under The corresponding object of subfile where carrying the partial data promotes the performance of terminal so as to avoid the waste of network bandwidth.
The audio and video data streams of the spokesman of video conference by being sent in storage gateway by the embodiment of the present invention;Pass through It stores gateway and audio and video data streams is forwarded to recording service device;Pass through recording service device again for the text where audio and video data streams Part is divided into one or more subfiles;And one object of creation is respectively corresponded for one or more subfiles;Finally by one or The corresponding object of multiple subfiles is uploaded to object storage server.It is more so as to be recorded in depending on the data flow for meeting of networking In a subfile, the risk that big document recording mode causes entire file that can not play because recording mistake is avoided.Meanwhile when need When downloading file, can partial data corresponding to the corresponding object of subfile where download part data, avoid net The waste of network bandwidth promotes the performance of terminal.
It should be noted that for simple description, therefore, it is stated as a series of action groups for embodiment of the method It closes, but those skilled in the art should understand that, embodiment of that present invention are not limited by the describe sequence of actions, because according to According to the embodiment of the present invention, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art also should Know, the embodiments described in the specification are all preferred embodiments, and the related movement not necessarily present invention is implemented Necessary to example.
Referring to Fig. 6, show a kind of structural block diagram of fragment memory device embodiment of the invention, can specifically include as Lower module:
Audio and video data streams sending module 601, for the autonomous server by the audio-video of the spokesman of video conference Data flow is sent in the storage gateway;
The audio and video data streams are forwarded to video recording for the storage gateway by audio and video data streams forwarding module 602 Server;
Split module 603, for the recording service device by the file where the audio and video data streams be divided into one or Multiple subfiles;
Object Creation module 604 is that one or more of subfiles respectively correspond creation for the recording service device One object;
The corresponding object of one or more of subfiles is uploaded to by uploading module 605 for the recording service device The object storage server.
In embodiments of the present invention, splitting module may include following sub-step:
Judging submodule writes offset, writes length and preset maximum hold for the recording service device according to preset Magnitude judges whether the data for the file being written where the audio and video data streams exceed maximum capacity;Wherein, described to write partially It diverts from one use to another in the position for indicating write-in data, the length of writing is for indicating the capability value of file shared by write-in data;
Subfile creates submodule, is used for if so, increasing subfile according to determining beyond value and the maximum capacity Number, and newly-built subfile.
In embodiments of the present invention, splitting module can also include following submodule:
Submodule is kept, the data for the file where the audio and video data streams are written in judgement are held without departing from maximum When magnitude, then subfile is not created.
In embodiments of the present invention, Object Creation module may include following submodule:
Object Creation submodule, for the recording service device by one or more of subfiles by the suitable of storing data Sequence is arranged, and is that one or more of subfiles respectively correspond one object of creation by the sequence of the storing data.
In embodiments of the present invention, uploading module may include following submodule:
Submodule is uploaded, for the recording service device by one or more of Ziwens of file identification having the same The corresponding object of part is uploaded to the object storage server.
For device embodiment, since it is basically similar to the method embodiment, related so being described relatively simple Place illustrates referring to the part of embodiment of the method.
The embodiment of the invention also provides a kind of devices, comprising:
One or more processors;With
One or more machine readable medias of instruction are stored thereon with, are executed when by one or more of processors When, so that described device executes method described in the embodiment of the present invention.
The embodiment of the invention also provides one or more machine readable medias, are stored thereon with instruction, when by one or When multiple processors execute, so that the processor executes method described in the embodiment of the present invention.
All the embodiments in this specification are described in a progressive manner, the highlights of each of the examples are with The difference of other embodiments, the same or similar parts between the embodiments can be referred to each other.
It should be understood by those skilled in the art that, the embodiment of the embodiment of the present invention can provide as method, apparatus or calculate Machine program product.Therefore, the embodiment of the present invention can be used complete hardware embodiment, complete software embodiment or combine software and The form of the embodiment of hardware aspect.Moreover, the embodiment of the present invention can be used one or more wherein include computer can With in the computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) of program code The form of the computer program product of implementation.
The embodiment of the present invention be referring to according to the method for the embodiment of the present invention, terminal device (system) and computer program The flowchart and/or the block diagram of product describes.It should be understood that flowchart and/or the block diagram can be realized by computer program instructions In each flow and/or block and flowchart and/or the block diagram in process and/or box combination.It can provide these Computer program instructions are set to general purpose computer, special purpose computer, Embedded Processor or other programmable data processing terminals Standby processor is to generate a machine, so that being held by the processor of computer or other programmable data processing terminal devices Capable instruction generates for realizing in one or more flows of the flowchart and/or one or more blocks of the block diagram The device of specified function.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing terminal devices In computer-readable memory operate in a specific manner, so that instruction stored in the computer readable memory generates packet The manufacture of command device is included, which realizes in one side of one or more flows of the flowchart and/or block diagram The function of being specified in frame or multiple boxes.
These computer program instructions can also be loaded into computer or other programmable data processing terminal devices, so that Series of operation steps are executed on computer or other programmable terminal equipments to generate computer implemented processing, thus The instruction executed on computer or other programmable terminal equipments is provided for realizing in one or more flows of the flowchart And/or in one or more blocks of the block diagram specify function the step of.
Although the preferred embodiment of the embodiment of the present invention has been described, once a person skilled in the art knows bases This creative concept, then additional changes and modifications can be made to these embodiments.So the following claims are intended to be interpreted as Including preferred embodiment and fall into all change and modification of range of embodiment of the invention.
Finally, it is to be noted that, herein, relational terms such as first and second and the like be used merely to by One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation Between there are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant meaning Covering non-exclusive inclusion, so that process, method, article or terminal device including a series of elements not only wrap Those elements are included, but also including other elements that are not explicitly listed, or further includes for this process, method, article Or the element that terminal device is intrinsic.In the absence of more restrictions, being wanted by what sentence "including a ..." limited Element, it is not excluded that there is also other identical elements in process, method, article or the terminal device for including the element.
Above to a kind of fragment storage method provided by the present invention and a kind of fragment storage device, detailed Jie has been carried out It continues, used herein a specific example illustrates the principle and implementation of the invention, and the explanation of above embodiments is only It is to be used to help understand method and its core concept of the invention;At the same time, for those skilled in the art, according to this hair Bright thought, there will be changes in the specific implementation manner and application range, in conclusion the content of the present specification should not manage Solution is limitation of the present invention.

Claims (12)

1. a kind of fragment storage method, be applied to view networking, the view networking include autonomy server, object storage server, Store gateway and recording service device, which is characterized in that the described method includes:
The audio and video data streams of the spokesman of video conference are sent in the storage gateway by the autonomy server;
The audio and video data streams are forwarded to recording service device by the storage gateway;
File where the audio and video data streams is divided into one or more subfiles by the recording service device;
The recording service device is that one or more of subfiles respectively correspond one object of creation;
The corresponding object of one or more of subfiles is uploaded to the object storage server by the recording service device.
2. method according to claim 1, which is characterized in that the recording service device will be where the audio and video data streams File is divided into the step of one or more subfiles, comprising:
The recording service device writes offset, writes length and the judgement of preset maximum capacity is written the sound and regards according to preset Whether the data of the file where frequency data stream exceed maximum capacity;Wherein, described to write offset for indicating write-in data Position, the length of writing is for indicating the capability value of file shared by write-in data;
If so, according to the number for increasing subfile, and newly-built subfile is determined beyond value and the maximum capacity.
3. method according to claim 2, which is characterized in that further include:
When the data of file where the audio and video data streams are written in judgement are without departing from maximum capacity, then Ziwen is not created Part.
4. method according to claim 1, which is characterized in that the recording service device is one or more of subfiles point A step of object Dui Ying not created, comprising:
The recording service device is arranged one or more of subfiles by the sequence of storing data, and presses the storage The sequence of data is that one or more of subfiles respectively correspond one object of creation.
5. method according to claim 1, which is characterized in that one or more of subfile files-designateds having the same Know, the corresponding object of one or more of subfiles is uploaded to the step of the object storage server by the recording service device Suddenly, comprising:
The corresponding object of one or more of subfiles of file identification having the same is uploaded to by the recording service device The object storage server.
6. a kind of fragment storage device, be applied to view networking, the view networking include autonomy server, object storage server, Store gateway and recording service device, which is characterized in that described device includes:
Audio and video data streams sending module sends out the audio and video data streams of the spokesman of video conference for the autonomous server It send into the storage gateway;
The audio and video data streams are forwarded to recording service device for the storage gateway by audio and video data streams forwarding module;
Module is split, the file where the audio and video data streams is divided into one or more Ziwens for the recording service device Part;
Object Creation module, for the recording service device be one or more of subfiles respectively correspond creation one it is right As;
The corresponding object of one or more of subfiles is uploaded to the object for the recording service device by uploading module Storage server.
7. device according to claim 6, which is characterized in that the fractionation module includes:
Judging submodule writes offset, writes length and preset maximum capacity for the recording service device according to preset Judge whether the data for the file being written where the audio and video data streams exceed maximum capacity;Wherein, described to write offset use In the position for indicating write-in data, the length of writing is for indicating the capability value of file shared by write-in data;
Subfile creates submodule, for if so, according to for increasing subfile is determined beyond value and the maximum capacity Number, and newly-built subfile.
8. device according to claim 7, which is characterized in that further include:
Submodule is kept, the data for the file where the audio and video data streams are written in judgement are without departing from maximum capacity When, then do not create subfile.
9. device according to claim 6, which is characterized in that the Object Creation module includes:
Object Creation submodule, for the recording service device by one or more of subfiles by storing data sequence into Row arrangement, and be that one or more of subfiles respectively correspond one object of creation by the sequence of the storing data.
10. device according to claim 6, which is characterized in that one or more of subfile files-designateds having the same Know, the uploading module includes:
Submodule is uploaded, for the recording service device by one or more of subfiles pair of file identification having the same The object answered is uploaded to the object storage server.
11. a kind of device characterized by comprising
One or more processors;With
One or more machine readable medias of instruction are stored thereon with, when being executed by one or more of processors, are made Obtain the method that described device executes one or more as claimed in claims 1-5.
12. one or more machine readable medias, are stored thereon with instruction, when executed by one or more processors, so that The method that the processor executes one or more as claimed in claims 1-5.
CN201910177294.8A 2019-03-08 2019-03-08 A kind of fragment storage method and device Pending CN110035307A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910177294.8A CN110035307A (en) 2019-03-08 2019-03-08 A kind of fragment storage method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910177294.8A CN110035307A (en) 2019-03-08 2019-03-08 A kind of fragment storage method and device

Publications (1)

Publication Number Publication Date
CN110035307A true CN110035307A (en) 2019-07-19

Family

ID=67235226

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910177294.8A Pending CN110035307A (en) 2019-03-08 2019-03-08 A kind of fragment storage method and device

Country Status (1)

Country Link
CN (1) CN110035307A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110572462A (en) * 2019-09-11 2019-12-13 杭州数梦工场科技有限公司 Cross-network file sharing method, device, equipment and medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100211603A1 (en) * 2009-02-13 2010-08-19 Cognitive Edge Pte Ltd, A Singapore Company Computer-aided methods and systems for pattern-based cognition from fragmented material
CN103825945A (en) * 2014-02-25 2014-05-28 华为技术有限公司 Fragmentation storage method and user terminal
CN103870602A (en) * 2014-04-03 2014-06-18 中国科学院地理科学与资源研究所 Database spatial sharding replication method and system
CN104461378A (en) * 2014-10-30 2015-03-25 华为技术有限公司 Method, device and system for writing data object in IP hard disk

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100211603A1 (en) * 2009-02-13 2010-08-19 Cognitive Edge Pte Ltd, A Singapore Company Computer-aided methods and systems for pattern-based cognition from fragmented material
CN103825945A (en) * 2014-02-25 2014-05-28 华为技术有限公司 Fragmentation storage method and user terminal
CN103870602A (en) * 2014-04-03 2014-06-18 中国科学院地理科学与资源研究所 Database spatial sharding replication method and system
CN104461378A (en) * 2014-10-30 2015-03-25 华为技术有限公司 Method, device and system for writing data object in IP hard disk

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110572462A (en) * 2019-09-11 2019-12-13 杭州数梦工场科技有限公司 Cross-network file sharing method, device, equipment and medium

Similar Documents

Publication Publication Date Title
CN108111474B (en) A kind of sound mixing method and device
CN108307212B (en) A kind of file order method and device
CN109617956A (en) A kind of data processing method and device
CN110049273A (en) A kind of meeting method for recording and transfer server based on view networking
CN109284265A (en) A kind of date storage method and system
CN109547728A (en) A kind of method and system of recorded broadcast source membership and recorded broadcast of session
CN108632559B (en) A kind of video data handling procedure and device
CN108989850A (en) A kind of video playing control method and control system
CN109963109A (en) A kind of processing method and system of video conference
CN109788235A (en) A kind of processing method and system of the minutes information based on view networking
CN109922297A (en) Call method and device
CN109151061A (en) A kind of date storage method and device
CN109743550A (en) A kind of method and apparatus of monitoring data tune stream
CN109640115A (en) A kind of files in stream media code-transferring method and device
CN109121017A (en) A kind of view intranet network method for evaluating quality and device
CN110035307A (en) A kind of fragment storage method and device
CN110475102A (en) A kind of monitoring data processing method and system based on view networking
CN110198345A (en) A kind of data request method, system and device and storage medium
CN110287248A (en) A kind of data read-write method and system
CN109714706A (en) A kind of view connected network communication method and apparatus
CN110035249A (en) A kind of video gets method and apparatus ready
CN110187846A (en) Print system, method and apparatus
CN110049346A (en) A kind of method and system of net cast
CN110072154A (en) A kind of group building method and transfer server based on view networking
CN109714558A (en) A kind of communication connection detection method and system based on view networking

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination