KR101664188B1 - Data manage device and data managing method based on peer-to-peer network - Google Patents
Data manage device and data managing method based on peer-to-peer network Download PDFInfo
- Publication number
- KR101664188B1 KR101664188B1 KR1020160018514A KR20160018514A KR101664188B1 KR 101664188 B1 KR101664188 B1 KR 101664188B1 KR 1020160018514 A KR1020160018514 A KR 1020160018514A KR 20160018514 A KR20160018514 A KR 20160018514A KR 101664188 B1 KR101664188 B1 KR 101664188B1
- Authority
- KR
- South Korea
- Prior art keywords
- data
- peer
- request rate
- peers
- fragment
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
-
- H04L67/322—
Abstract
The present invention provides a data management apparatus and method capable of simultaneously securing efficiency of storage space and data streaming performance in a P2P network environment. A peer-to-peer network-based data management apparatus for storing and managing data in a plurality of storage spaces provided by a plurality of peers according to an embodiment of the present invention includes a peer- The number of copies of the data is determined based on a request rate indicating the number of times the data is requested.
Description
The present invention relates to a P2P (peer-to-peer) network-based data management apparatus and a data management method.
With the recent development of computer networks, cloud computing has emerged, which is a service that allows broadband networks to be borrowed and used without the need to install IT resources, as high-speed networks are becoming common and storage devices are becoming cheaper. Initially, the client / server architecture was common, but P2P cloud storage devices appeared to solve installation and maintenance cost problems caused by server expansion due to user increase.
A P2P cloud is a system that allows users to securely access cloud storage space from any device connected to a P2P network, instead of donating a portion of the local storage space of each user's device to the virtual storage space in the cloud. In order to ensure data availability in a situation where each peer repeats joining and leaving, various techniques for storing data redundantly have been used, but it has been difficult to secure the storage space efficiency and data streaming performance at the same time .
An object of the present invention is to provide a data management apparatus and method capable of simultaneously securing efficiency of storage space and data streaming performance in a P2P (Peer-to-Peer) environment.
The problems to be solved by the present invention are not limited to the above-mentioned problems. Other technical subjects not mentioned will be apparent to those skilled in the art from the description below.
According to an embodiment of the present invention, there is provided a peer-to-peer network-based data management apparatus for storing and managing data in a plurality of storage spaces provided by a plurality of peers, And a controller for determining a number of copies of the data based on a request rate that indicates the number of times data is requested from the peers for a predetermined time.
The control unit may further generate a copy of the data and transmit the copy to at least one of the plurality of storage spaces when the request rate increases.
The control unit may generate a message for requesting deletion of the copy when the request rate decreases, and may transmit the message to at least one of the plurality of storage spaces.
The control unit may include an encoding unit encoding the first fragments constituting the data to generate at least one second fragment, and the number of generated second fragments may be adaptively adjusted according to the request rate.
The controller may increase the number of generated second fragments when the request rate decreases.
The control unit may determine the number of generation of the second fragment based on the request rate, the average network bandwidth of the peer, the average rate of peers in the connected state, and the refresh rate of the data.
Wherein the control unit determines a peer to transmit data to the playback requesting peer when a data transmission request is received from the playback requesting peer, the first peer storing the copy, and the first peer storing the copy, The first peer may be connected to the playback request peer prior to the second peer among the second peer storing at least a part of the second peer.
According to an embodiment of the present invention, there is provided a data management method for managing data stored in a plurality of storage spaces provided by a plurality of peers on a P2P network, the data management method comprising: Measuring a request rate indicating a number of times a request is made; And determining a number of copies of the data based on the request rate.
The step of determining the number of copies may further include generating and transmitting a copy of the data to at least one of the plurality of storage spaces when the request rate increases.
The step of determining the number of copies may include generating a message requesting deletion of the copy when the request rate decreases, and transmitting the message to at least one of the plurality of storage spaces.
The data management method includes: generating at least one second fragment by encoding first fragments constituting the data; And adjusting the number of generated second fragments adaptively according to the request rate.
The step of adjusting the number of generations of the second fragment may include increasing the number of generations of the second fragment when the request rate decreases.
Wherein the step of adjusting the number of generations of the second fragment determines the number of generations of the second fragment based on the request rate, the average network bandwidth of the peer, the average rate of the peers in the connected state, and the refresh rate of the data Step < / RTI >
Wherein the data management method comprises the steps of: determining a peer to which data is to be transmitted to the playback requesting peer, when a data transmission request is received from the playback requesting peer, the first peer storing the copy, And connecting the first peer to the playback request peer prior to the second peer among the second peers storing at least a portion of the fragments.
The data management method according to an exemplary embodiment of the present invention may be implemented as a computer-executable program and recorded on a computer-readable recording medium.
According to an embodiment of the present invention, a data management apparatus and method are provided that can simultaneously secure efficiency of storage space and data streaming performance in a P2P (Peer-to-Peer) environment.
The effects of the present invention are not limited to the effects described above. Unless stated, the effects will be apparent to those skilled in the art from the description and the accompanying drawings.
1 is a diagram for explaining a data management apparatus and method according to an embodiment of the present invention.
FIG. 2 is a diagram for explaining a type of data stored in the first peer and a data streaming technique using the data.
FIG. 3 is a diagram for explaining a type of data stored in a second peer and a data streaming technique using the data.
4 is a view for explaining a data management method according to an embodiment of the present invention.
5 is an exemplary flow chart illustrating a
Other advantages and features of the present invention and methods for accomplishing the same will be apparent from the following detailed description of embodiments thereof taken in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, and the present invention is only defined by the scope of the claims. Although not defined, all terms (including technical or scientific terms) used herein have the same meaning as commonly accepted by the generic art in the prior art to which this invention belongs. A general description of known configurations may be omitted so as not to obscure the gist of the present invention. In the drawings of the present invention, the same reference numerals are used as many as possible for the same or corresponding configurations. To facilitate understanding of the present invention, some configurations in the figures may be shown somewhat exaggerated or reduced.
The terminology used in this application is used only to describe a specific embodiment and is not intended to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the terms "comprises", "having", or "having" are intended to specify the presence of stated features, integers, steps, operations, components, Steps, operations, elements, parts, or combinations thereof, whether or not explicitly described or implied by the accompanying claims.
Used throughout this specification may refer to a hardware component such as, for example, software, FPGA or ASIC, as a unit for processing at least one function or operation. However, "to" is not meant to be limited to software or hardware. &Quot; to " may be configured to reside on an addressable storage medium and may be configured to play one or more processors.
As an example, the term '~' includes components such as software components, object-oriented software components, class components and task components, and processes, functions, attributes, procedures, Routines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, and variables. The functions provided by the components and components may be performed separately by a plurality of components and components, or may be integrated with other additional components.
The data management apparatus according to an embodiment of the present invention uses a data redundancy scheme that simultaneously obtains streaming performance and storage space efficiency in a P2P network environment. The embodiment of the present invention provides a method of simultaneously enhancing the streaming performance and the efficiency of the storage space by applying different data redundancy techniques according to the change of the popularity of each data, that is, whether the number of times requested from the peers is increased or decreased. In addition, the embodiment of the present invention enables video data to be reproduced stably in a P2P network environment.
1 is a diagram for explaining a data management apparatus and method according to an embodiment of the present invention.
Referring to FIG. 1, a
Each peer can donate a portion of its storage space to the P2P cloud and access the data stored in the P2P cloud. Peers can freely connect and leave the P2P cloud system.
As shown in FIG. 1, a peer can store a replica generated by replicating transmitted data or a fragment generated by encoding transmitted data in a storage space. According to one embodiment, a copy may be stored in the storage space provided by the first peer, and a fragment may be stored in the storage space provided by the second peer.
When the peer reproduces the stored data, the data stored in the storage space of another peer belonging to the P2P cloud is received and reproduced. In this case, if the received data is a copy, it can be immediately reproduced as soon as it is received. However, in the case of a fragment generated by encoding the data, a certain number of fragments are transmitted and then the original data is restored through decoding Do.
The
According to one embodiment, the
Hereinafter, a data management method according to an embodiment of the present invention will be described in detail with reference to FIGS. 2 to 4, from the viewpoint of video streaming.
FIG. 2 is a view for explaining a type of data stored in the first peer shown in FIG. 1 and a data streaming technique using the data.
In Fig. 2, B i denotes an original block of video data. As shown in FIG. 2, the same copy as the original data may be stored in the storage space provided by each of the peers. Thus, when a particular peer requests a video playback, the peer can receive a copy from other peers accessing the P2P cloud and play it immediately without having to perform decoding.
According to the existing pull type P2P video streaming method, since the peers do not know which data is stored with each other, the buffer map is exchanged with each other and then the user requests the necessary data. However, referring to FIG. 2, since the replay requesting peer is connected to other peers storing copies necessary for reproduction through the cloud, there is no need to check again the data stored by the peer. Accordingly, the playback requesting peer transmits its buffer map to another peer, and the transmitting peer transmits the buffer map to the playback requesting peer by pushing the data, thereby reducing the time required for exchanging the buffer map and requesting data, Can be improved.
FIG. 3 is a diagram for explaining a type of data stored in a second peer and a data streaming technique using the data.
As described above, the fragment generated by encoding the original data may be stored in the second peer. Referring to FIG. 3, segments S i generated by encoding original data may be distributedly stored in a plurality of second peers.
As shown in FIG. 3, a first fragment (OF i ) generated by dividing original data into k and a second fragment (CF i ) generated by encoding the first fragments are distributed to a plurality of second peers Lt; / RTI > As shown in FIG. 3, connected peers can transmit data in a push manner to support video streaming.
As described above, at least k fragments must be transmitted in order to receive original data by receiving fragments generated by encoding original data. Therefore, there is a disadvantage in that, when video streaming is supported for a playback requesting peer, the video playback delay time becomes longer due to transmission schedule overhead and decoding complexity. However, there is an advantage in that less storage space is used than when a copy is stored.
Accordingly, an embodiment of the present invention provides a method of securing both streaming performance and storage space efficiency by using the data redundancy technique shown in FIG. 2 and FIG. 3 in combination.
Referring again to FIG. 1, the
When the request rate increases, the
On the other hand, when the request rate decreases, the
According to one embodiment, the
In one embodiment, the
The
In the
Therefore, the minimum value of N i can be determined as shown in Equation (2) below.
However, when the minimum value of N i is determined as shown in Equation (2), stable playback of video may not be achieved due to loss of data due to a departure of a peer storing data or an increase in network traffic. Therefore, in order to enhance the stability of the real-time video streaming, the minimum value of N i may be determined according to the following Equation 3 according to an embodiment.
In Equation (3), d i may be multiplied by a minimum value of N i (Equation 2) to provide minimum playback quality as a parameter for ensuring the stability of real-time playback. Therefore, N i determined according to Equation (3) can be the minimum number of total fragments that can stably support real-time video streaming. Where N i should be greater than or equal to k i for later decoding, and k i represents the number of fragments included in one copy.
4 is a view for explaining a data management method according to an embodiment of the present invention. As shown in FIG. 4, a data management apparatus and method according to an embodiment of the present invention can mix and store copies and fragments in a P2P cloud.
In the data management apparatus according to an embodiment of the present invention, when the playback requesting peer requests data transmission, the
5 is an exemplary flow chart illustrating a
Referring to FIG. 5, the
In the step S210 of measuring the data request rate, the request rate may indicate the number of times the corresponding data is requested to be reproduced from the peers on the P2P network for a predetermined time.
The step of determining the number of copies may further include generating a data copy and transmitting the data copy to at least one of the plurality of storage spaces when the request rate increases. The step of determining the number of copies may include generating a message requesting deletion of a copy when the request rate decreases, and transmitting the message to at least one of the plurality of storage spaces.
According to one embodiment, the
According to one embodiment, the
As described above, the embodiment of the present invention provides a data management apparatus and method for providing efficient streaming and acquiring efficiency of storage space by managing a storage form of data stored in a storage space provided by a peer on a P2P network . The embodiment of the present invention can simultaneously secure the storage space and the streaming performance by adjusting the number of data copies according to the popularity of each data, that is, the number of times the reproduction is requested from the peers on the P2P network.
The data management method according to an exemplary embodiment of the present invention can be realized in a general-purpose digital computer that can be created as a program that can be executed by a computer and operates the program using a computer-readable recording medium. The computer readable recording medium may be a volatile memory such as SRAM (Static RAM), DRAM (Dynamic RAM), SDRAM (Synchronous DRAM), ROM (Read Only Memory), PROM (Programmable ROM), EPROM (Electrically Programmable ROM) Non-volatile memory such as EEPROM (Electrically Erasable and Programmable ROM), flash memory device, Phase-change RAM (PRAM), Magnetic RAM (MRAM), Resistive RAM (RRAM), Ferroelectric RAM But are not limited to, optical storage media such as CD ROMs, DVDs, and the like.
It is to be understood that the above-described embodiments are provided to facilitate understanding of the present invention, and do not limit the scope of the present invention, and it is to be understood that various modifications are possible within the scope of the present invention. It is to be understood that the technical scope of the present invention should be determined by the technical idea of the claims and the technical scope of protection of the present invention is not limited to the literary description of the claims, To the invention of the invention.
100: Data management device
110: Storage space
120:
200: How to manage your data
Claims (15)
And a controller for determining a number of copies of the data based on a request rate that indicates the number of times data is requested from the peers for a predetermined time,
Wherein the control unit includes an encoding unit for encoding the first fragments constituting the data to generate at least one second fragment, wherein the request rate, the average network bandwidth of the peer, the average rate of the peers in the connected state, The number of generated second fragments is determined based on the reproduction rate of the second fragment.
Wherein,
And further generates a copy of the data and transmits the copy to at least one of the plurality of storage spaces when the request rate increases.
Wherein,
And generates a message requesting deletion of the copy when the request rate decreases, and transmits the message to at least one of the plurality of storage spaces.
And increases the number of generated second fragments when the request rate decreases.
And a controller for determining a number of copies of the data based on a request rate that indicates the number of times data is requested from the peers for a predetermined time,
The control unit includes:
And an encoding unit operable to encode the first fragments constituting the data to generate at least one second fragment, the method comprising adaptively adjusting the number of generation of the second fragment according to the request rate,
A first peer storing the copy and a second peer storing at least a portion of the first fragments and the second fragment if the data request is received from the replay requesting peer; Wherein the first peer is connected to the playback request peer prior to the second peer.
Measuring a request rate indicating the number of times data is requested from the peers for a predetermined time;
Determining a number of copies of the data based on the request rate;
Encoding the first fragments constituting the data to generate at least one second fragment; And
And adapting the number of generations of the second fragment according to the request rate,
Wherein adjusting the number of generations of the second fragment comprises:
Determining the number of generated second fragments based on the request rate, the average network bandwidth of the peer, the average rate of peers in the connected state, and the refresh rate of the data.
Wherein determining the number of copies comprises:
And if the request rate is increased, generating a copy of the data and transmitting the copy to at least one of the plurality of storage spaces.
Wherein determining the number of copies comprises:
And generating a message for requesting deletion of the copy when the request rate decreases, and transmitting the message to at least one of the plurality of storage spaces.
Wherein adjusting the number of generated second fragments comprises:
And increasing the number of occurrences of the second fragment if the request rate decreases.
Measuring a request rate indicating the number of times data is requested from the peers for a predetermined time;
Determining a number of copies of the data based on the request rate;
Encoding the first fragments constituting the data to generate at least one second fragment;
Adjusting the number of generated second fragments adaptively according to the request rate; And
A first peer storing the copy and a second peer storing at least a portion of the first fragments and the second fragment if the data request is received from the replay requesting peer; And connecting the first peer to the replay requesting peer in preference to the second peer among the second peer that is in the process of replaying.
A recording medium on which a program for executing a data management method according to any one of claims 8 to 10, 12, and 14 by a computer is recorded.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020160018514A KR101664188B1 (en) | 2016-02-17 | 2016-02-17 | Data manage device and data managing method based on peer-to-peer network |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020160018514A KR101664188B1 (en) | 2016-02-17 | 2016-02-17 | Data manage device and data managing method based on peer-to-peer network |
Publications (1)
Publication Number | Publication Date |
---|---|
KR101664188B1 true KR101664188B1 (en) | 2016-10-11 |
Family
ID=57161743
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020160018514A KR101664188B1 (en) | 2016-02-17 | 2016-02-17 | Data manage device and data managing method based on peer-to-peer network |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR101664188B1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11539789B2 (en) | 2020-04-03 | 2022-12-27 | Electronics And Telecommunications Research Institute | Method and apparatus for recovering missing data in multi-source hybrid overlay network |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101381199B1 (en) * | 2011-09-22 | 2014-04-18 | 서울대학교산학협력단 | Method and System for Content Delivery and Caching |
US20160013815A1 (en) * | 2014-07-09 | 2016-01-14 | Quantum Corporation | Data Deduplication With Adaptive Erasure Code Redundancy |
-
2016
- 2016-02-17 KR KR1020160018514A patent/KR101664188B1/en active IP Right Grant
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101381199B1 (en) * | 2011-09-22 | 2014-04-18 | 서울대학교산학협력단 | Method and System for Content Delivery and Caching |
US20160013815A1 (en) * | 2014-07-09 | 2016-01-14 | Quantum Corporation | Data Deduplication With Adaptive Erasure Code Redundancy |
Non-Patent Citations (1)
Title |
---|
논문:(2011)* * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11539789B2 (en) | 2020-04-03 | 2022-12-27 | Electronics And Telecommunications Research Institute | Method and apparatus for recovering missing data in multi-source hybrid overlay network |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8726327B2 (en) | System and method for peer-to-peer live streaming | |
EP3028467B1 (en) | Video caching | |
US8145779B2 (en) | Dynamic server-side media transcoding | |
JP4635682B2 (en) | Information processing apparatus, information processing method, and information processing program | |
US11076181B2 (en) | Systems and methods for resolving manifest file discontinuities | |
CN102685232A (en) | Streaming media server-based multimedia file acquisition method and streaming media server | |
CN107920258B (en) | Data processing method and device | |
US10277652B2 (en) | Transmission apparatus, transmission method, and program | |
KR101664188B1 (en) | Data manage device and data managing method based on peer-to-peer network | |
JP2015230731A (en) | Method for operating cache arranged along transmission path between client terminal and at least one server, and corresponding cache | |
KR101590098B1 (en) | Apparatus and method for buffering | |
CN102217278B (en) | Method and apparatus for online adapting of media content | |
KR101888982B1 (en) | Method for providing content caching service in adapted streaming service and local caching device thereof | |
KR101941583B1 (en) | Peer manage method and peer manage device based on peer-to-peer network | |
CN110795030A (en) | Small file reading method and device | |
EP3062210B1 (en) | Method and server for the storage of multimedia content and its delivery in adaptive streaming systems | |
US20220408126A1 (en) | System and method for optimizing the distribution of available media production resources | |
JP4667419B2 (en) | Distributed multimedia server system and multimedia information storage and distribution method | |
US11368505B2 (en) | Dynamic variant list modification to achieve bitrate reduction | |
US20150088943A1 (en) | Media-Aware File System and Method | |
KR101565137B1 (en) | Method for providing wireless streaming service and apparatus therefor | |
KR101971595B1 (en) | Method for providing content caching service in adapted streaming service and local caching device thereof | |
KR101883282B1 (en) | P2p vod system, server and hibrid buffering method of the same | |
KR100813003B1 (en) | Contents distribution method for session mobility support in contents distributed network system | |
WO2022263665A1 (en) | System and method for optimizing the distribution of available media production resources |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
GRNT | Written decision to grant |