NL2007502C2 - Data distribution system, method and computer device. - Google Patents

Data distribution system, method and computer device. Download PDF

Info

Publication number
NL2007502C2
NL2007502C2 NL2007502A NL2007502A NL2007502C2 NL 2007502 C2 NL2007502 C2 NL 2007502C2 NL 2007502 A NL2007502 A NL 2007502A NL 2007502 A NL2007502 A NL 2007502A NL 2007502 C2 NL2007502 C2 NL 2007502C2
Authority
NL
Netherlands
Prior art keywords
data
file
computer
server
computer devices
Prior art date
Application number
NL2007502A
Other languages
Dutch (nl)
Inventor
Hendrik Dinant Schoneveld
Original Assignee
Hlr Dev B V
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hlr Dev B V filed Critical Hlr Dev B V
Priority to NL2007502A priority Critical patent/NL2007502C2/en
Application granted granted Critical
Publication of NL2007502C2 publication Critical patent/NL2007502C2/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/56—Provisioning of proxy services
    • H04L67/567—Integrating service provisioning from a plurality of service providers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Description

P30911NLOO/HSE
Title: Data distribution system, method and computer device
FIELD OF THE INVENTION
The present invention relates to a data distribution system, a data distribution 5 method and a computer device.
BACKGROUND
Distribution of a data file through a wide area network (WAN) typically involves a server, possibly in a cloud configuration, hosting the data file and one or more 10 end-user devices downloading the data file from the server.
With an increasing use of download services and streaming services for audio and video content, which involve relatively large files and relatively high data transmission rates, server load and server-side WAN capacity requirements grow. Moreover, end-user-side WAN capacity increases over time by the introduction of faster variants of e.g. ADSL, 15 VDSL, DOCSIS, UMTS and LTE, and the number of end-user devices increases, resulting in higher server load and server-side WAN capacity requirements.
There is a need for an improved data distribution system for distributing data via a wide area network from servers to end-user devices, wherein the above identified drawbacks regarding server load and server-side WAN capacity requirements are overcome.
20
SUMMARY OF THE INVENTION
It is an object of the invention to provide an improved data distribution system for distributing data.
According to an aspect of the invention there is provided a data distribution system 25 for distributing at least one data file to a user device, the data distribution system comprising a plurality of computer devices that are arranged to be communicatively connected via a wide area network, wherein each computer device comprises a mass storage device, the data distribution system being configured to supply, using a parallel distributed file system, the data file to the user device by transmitting via the wide area network data blocks of the 30 data file from the mass storage devices of each of the computer devices, the data blocks together forming the data file.
Thus, a data file is stored in data blocks on mass storage devices of different computer devices (the computer device may also be referred to by the term “node”). Hence, instead of being faced with a bandwidth limitation for transmission of the data file from the 35 computer device, namely the bandwidth limitation of a single computer device, a larger bandwidth may be achieved, as the data blocks are supplied (e.g. turn by turn or randomly) 2 by the different computer devices. As a result, using a wide area network having a certain capacity, a larger amount of data may be transferred, allowing e.g. more user devices to receive the data and/or allow the distribution of larger file sizes or larger data rates.
In an embodiment, each computer device comprises a data server part and a client 5 part, wherein the data server part is configured to retrieve a data block as a local file from the mass storage device using a local file system, and wherein the client part is configured to retrieve the data file by retrieving the data blocks from the data server parts of each of the plurality of computer devices using the parallel distributed file system. In a computer device data blocks are accessible by a server part of the computer device as local files. The data 10 blocks are retrieved by a client part from different computer devices, i.e. from different server parts, and combined by a client part using a parallel distributed file system to form the data file. As a result, server-side resource requirements are optimized as the required server-side bandwidth for transmitting the data file is reduced by the parallel transmission of data blocks from different server-parts. Moreover, the server load is minimized as the load is shared 15 amongst the server parts where the data parts are stored.
In an embodiment, at least one of the computer devices comprises a content server part configured to, in response to a request for the data file from a user device, initialize the transfer of the data file to the user device. As a result, a conventional user device may be applied, the user device requesting the file from one (e.g. a predetermined one or an 20 arbitrary one) of the computer devices where the content server part is provided. Each of the computer devices may be provided with such data server part to enable the user devices to e.g. request the data file at an arbitrary one of the computer devices.
The content server part may be one of a streaming server, multimedia server, video server, music server, web server and file server, or a combination thereof so as to allow 25 transfer of such file types. It is noted that in this document the term data file is to be understood so as to comprise any type of data file, including but not being restricted to a streaming type.
The user device may for example be one of a set-top box, a television with build-in Internet access, a home cinema device, a music player device, a smart phone, a tablet pc, a 30 notebook and a pc, or a combination thereof.
At least one of the mass storage devices may comprise a redundant array of independent storage devices configured to store the local file on each of the independent storage devices. Thereby, reliability may be improved.
Instead, or in addition thereto, multiple sets of computer devices may be provided, 35 communicatively connected to the wide area network, whereby for each set, the redundant computer devices cooperate, using the parallel virtual file system, to distribute the file to an user device. The data blocks of the file are stored in each set of computer devices. Thereby, on the one hand, redundancy may be achieved as in case one of the computer devices would malfunction, its tasks may be taken over by one or more of the computer devices of at 3 least one other of the sets where the same data blocks are stored. Furthermore, a total capacity in terms of number of end user devices, data rate, and/or others, may be increased.
The data file may be temporarily or permanently stored in the computer devices. Furthermore, the data distribution system may comprise a data transmitter that provides a 5 data file, such as a data stream, e.g. a live data stream, to the computer devices, where the data is stored in the form of data blocks as described above. The computer devices may then distribute the data to a plurality of user devices. As a result, the data may be distributed via the wide area network from the data transmitter to a large number of user devices within a short time. The data transmitter may be arranged to: 10 - divide the data file in data blocks; - assign each of the data blocks to one of the computer devices; - transmit each data block to the computer device to which it has been assigned, thereby distributing the data blocks over the computer devices. Preferably, each computer device is assigned a substantially equal amount of data blocks, so as to substantially evenly distribute 15 the data blocks over the computer devices. A data file may hence be distributed from the transmitter to a large amount of end user devices, thereby generating a relatively low data traffic load on the wide area network: The transmitter transmits the data blocks to a plurality of computer devices, which in turn each transmit the data blocks to a plurality of end user devices. As the data blocks are distributed over the computer devices, the data traffic load 20 per computer device may be kept relatively low. As an example, the data blocks that together form the data file may be distributed over 20, 50 or 100 computer devices, lowering a maximum data traffic per computer device accordingly.
The computer devices may each comprise a data processing device and a data storage facility, such as a mass storage device. The computer device may be arranged to 25 implement a ring buffer file, for example for live streaming data applications. The computer device may, using the ring buffer structure, for example supply a live data stream to a plurality of end user devices (e.g. 20 end user devices per node). Using a large ring buffer, pausing in the live stream may be implemented also. A combination of a larger ring buffer that allows pausing in the data stream, and a smaller ring buffer that provides a live data 30 stream, may be implemented.
According to another aspect of the invention there is provided a computer device being arranged to be communicatively connected via a wide area network to a plurality of other computer devices, the computer device comprising a mass storage device and being configured to supply, using a parallel distributed file system, a data file to a user device by 35 transmitting via the wide area network data blocks of the data file from the mass storage device of the computer device and from mass storage devices of the other computer devices, the data blocks together forming the data file. The data distribution system for distributing a data file to a user device may comprise a plurality of such computer devices.
4
According to yet another aspect of the invention, there is provided a method for distributing a data file to a user device, the method comprising providing a plurality of computer devices, each computer device comprising a mass storage device, the computer devices being connected to a wide area network, and supplying, using a parallel distributed 5 file system, the data file to the user device by transmitting via the wide area network data blocks of the data file from the mass storage devices of each of the plurality of computer devices, the data blocks together forming the data file.
With the computer device and method according to the invention, the same or similar effects may be achieved as with the data distribution system according to the invention.
10 Also, the same or similar embodiments may be provided, achieving the same or similar effects as achieved by a corresponding embodiment of the data distribution system according to the invention.
Hereinafter, embodiments of the invention will be described in further detail. It should be appreciated, however, that these embodiments may not be construed as limiting 15 the scope of protection for the present invention.
BRIEF DESCRIPTION OF THE DRAWINGS
Aspects of the invention will be explained in greater detail by reference to exemplary embodiments shown in the drawings, in which: 20 Fig.1 is a schematic illustration of a data distribution system according to an exemplary embodiment of the invention;
Fig.2 is a schematic illustration of a data distribution system according to another exemplary embodiment of the invention; and
Fig.3 is a schematic illustration of a data distribution system according to 25 another exemplary embodiment of the invention.
DETAILED DESCRIPTION OF THE DRAWINGS
Fig.1 shows a data distribution system 1 of an exemplary embodiment of the invention. Three computer devices 10, 20, and 30 are communicatively connected via a wide 30 area network (WAN) 2 such as the internet. It is to be understood that the invention is not limited to three computer devices. Any number of computer devices may be part of the data distribution system. Each computer device 10,20,30 has a mass storage device 11,21,31 for storing local files using any suitable local file system, such as e.g. ext2, ext3 or ext4. Furthermore, each computer device 10,20,30 has a data server part 12,22,32 for reading 35 the local files from the mass storage device 11,21,31 and providing the files as data blocks to a client part 13,23,33 of the computer device 10,20,30.
The data blocks are accessible by the client parts 13,23,33 using a parallel distributed file system (PDFS) which combines the data blocks into data files. The PDFS
5 operates as a virtual file system enabling the client part 13,23,33 to access the data files as if through a local file system operating on a local storage device.
In case of three computer devices 10,20,30 as shown in the example of Fig. 1, a data file is typically split in a plurality of data blocks. A first subset of the data blocks is 5 stored on mass storage device 11 of first computer device 10, a second subset of the data blocks is stored on mass storage device 21 of second computer device 20 and a third subset of the data blocks is stored on mass storage device 31 of computer device 30. Using the PDFS each client part 13,23,33 is able to retrieve the data file. Typically the data file is distributed in equally sized data parts over all computer devices 10,20,30 in the distribution 10 system 1. The data blocks may be stored turn by turn in each following one of the computer devices, or the data block may at random be stored in one of the computer devices, so as to provide an arbitrary distribution of the data blocks over the computer devices.
As an example the data file is an 1800 MB movie file, containing 1 hour of video and audio. Each second of the movie file contains 25 video frames and 48000 15 samples of audio. Using linear encoding of the video and audio in the movie file, 1 second of the video and audio is equivalent with 1800 MB / 3600 = 512 KB of data. If the data block size is configured as 512 KB, then the 1st second of the movie file could be written to a storage device of a first computer device, the 2nd second of the movie file could be written to a storage device of a second computer device, and so forth. A round-robin algorithm may 20 be used to evenly distribute all data blocks to the available computer devices. As a result the 1800 MB movie file will be evenly distributed among the computer devices.
The WAN 2 is a data communications network that covers a relatively broad geographic area and that often uses transmission facilities provided by common carriers, such as telephone companies or cable television companies. WAN technologies may 25 function at the lower three layers of the OSI reference model: the physical layer, the data link layer, and the network layer.
Internet protocols can be used to communicate across the WAN 2. The Internet protocols consist of a suite of communication protocols, of which the two best known are the Transmission Control Protocol (TCP) and the Internet Protocol (IP). The 30 invention is not limited to the Internet protocols. Any other protocol suitable for transmitting data files across the WAN 2 may be used.
The PDFS is used to store and read data files on the mass storage devices 11,21,31 of the computer devices 10,20,30 that are connected via the WAN 2. The mass storage device 10,20,30 is a device for storing data in a persisting and machine-readable 35 fashion. An example of a mass storage device is a hard disk drive, a semiconductor memory, etc.
The PDFS can be based on known technology, such as for example the General Parallel File System (GPFS) or the Parallel Virtual File System (PVFS).
6 GPFS is a known high-performance shared-disk clustered file system. In common with typical cluster file systems, GPFS provides concurrent high-speed file access to applications executing on multiple nodes of clusters. It can be used with AIX 5L clusters, Linux clusters, or a heterogeneous cluster of AIX and Linux nodes. In addition to providing 5 file system storage capabilities, GPFS provides tools for management and administration of the GPFS cluster and allows for shared access to file systems from remote GPFS clusters. GPFS provides high performance by allowing data to be accessed over multiple computers at once and provides higher input/output performance by striping blocks of data from individual data files over multiple disks, and reading and writing these blocks in parallel. A 10 data file that is written to the file system is broken up into blocks (i.e. data parts) of a configured size, less than 1 Megabyte each.
Using GPFS or a derivation thereof the blocks can be distributed across the WAN 2 to multiple computer devices 10,20,30 so that a single data file is fully distributed across the array of mass storage devices 11,21,31. This results in high reading and writing 15 speeds for a single data file, as the combined bandwidth of the network connections at the computer devices 10,20,30 is high.
PVFS is a known open source parallel file system for distributing a data file across multiple servers and provides for concurrent access by multiple tasks of a parallel application. PVFS is typically used in large scale cluster computing. PVFS may be adapted 20 for application in the data distribution system of the invention. PVFS focuses on high performance access to large data sets. It consists of a server process and a client library. A Linux kernel module and PVFS-client process allow the file system, i.e. the PDFS, to be mounted and used with standard utilities. In a data distribution system using PVFS clients are designated as one or more of: client, data server and metadata server. Data servers 25 hold file data, metadata servers hold metadata include stat-info, attributes, and data file-handles as well as directory-entries. Clients run applications that utilize the file system by sending requests to the servers over the WAN. PVFS is designed so that a client can access a server for metadata once, and then can access the data servers without further interaction with the metadata servers.
30 The invention is not limited to the use of GPFS or PVFS or derivations thereof. Any other suitable parallel distributed file system may be used, such as a file system based on GFS, Lustre or the Andrew File System.
To prevent data loss caused by a mass storage device failure, the computer devices may be equipped with Redundant Array of Independent Disks (RAID) controllers.
35 Multiple copies of each data part are then written to the physical disks in the array. In case of a failure, the RAID controller obtains the data from the redundant disk.
Another possible measure against data loss caused by a mass storage device failure is to include one or more redundant computer devices in the distribution system 1. Two copies of each data part are then stored on different computer devices, i.e. on a 7 computer device and on a redundant computer device. The computer devices may be arranged in sets, each set of computer devices together containing all data blocks of a particular file, and being arranged to together supply the data blocks so as to obtain the data file. In case of a failure of a computer device or its mass storage device, the data is 5 obtainable from a redundant computer device.
In the exemplary embodiment of Fig.2, end-user devices 3,4,5 request content from a content server part 24 of computer device 20 via the WAN 2. The content server 24, which is e.g. a streaming server, multimedia server, video server, music server, web server or file server, gets the requested content by requesting the data file for the 10 content from the client part 23, which in turn will use the PDFS to retrieve the data file as described with Fig. 1.
Examples of user devices (e.g. end-user devices) 3,4,5 are set-top boxes, televisions with build-in Internet access, home cinema devices, music player devices, smart phones, tablet PCs, notebooks and PCs, or combinations thereof. The end-user devices 15 3,4,5 may request the content via de WAN 2, as shown in Fig.2.
The computer devices may be distributed over a certain area, for example the area in which the user devices are located, such as a city, a city part, a suburb, a postal code area, etc. The computer devices may be located in distribution facilities, such as cable television distribution enclosures, etc. Also, the computer devices may be located at facilities 20 of designated users, such as in meter cabinets of designated users. Thereby, it is preferred to have the computer devices connected directly to the wide area network, i.e. without the intervention of a residential gateway so as to prevent an end user from taking the computer device out of service accidentally or from disconnecting it from the wide area network accidentally. Alternatively, it is possible that one or more end-user devices 6,7 are 25 connected to the content server 24 via a local area network 8 (LAN), as shown in Fig.3. In this case the computer device 20 may be a part of the LAN 8 and is e.g. implemented on a residential gateway at the premises of the end-user.
It is possible that other or all computer devices 10,20,30 are configured with a content server part 24. In this case the end-user device 3,4,5 is typically configured to 30 request content from a preconfigured content server part.
A plurality of end-user devices may be configured to use a single computer device for retrieving content. In the following example the end-user devices 3,4,5 as shown in Fig.2 are PCs at three different households. Each household is connected to the WAN 2 via a broadband connection capable receiving a 2 Mbit/s video stream. The computer device 35 20 is connected to the WAN 2 via a DOCSIS connection of 50 Mbit/s. The WAN bandwidth at the computer device 20 is more than enough to provide the video stream to the end-user devices 3,4,5, i.e. the required bandwidth is 3x2=6 Mbit/s.
In an example wherein there are three computer devices connected to the WAN via a DOCSIS connection of 50 Mbit/s, then 75 PCs at different households can be 8 served by the three computer devices to provide the 2 Mbit/s data stream to each PC. Herein, data blocks forming the source of the 2 Mbit/s video stream are stored on the three computer devices similar to the example of Fig. 1. The three computer devices together are capable to provide 3x50=150 MBit/s of data, which equals 75 times the 2 Mbit/s video 5 stream.
The content server 24 can be a streaming server for streaming video/and or audio. The source of the stream can be stored on the mass storage devices 11,21,31 of the distribution system 1. Alternatively the source is from a system outside the distribution system, such as e.g. a live television source. With live streaming the invention 10 advantageously reduces bandwidth requirements by a factor up to the amount of computer devices 10,20,30 available to temporary store the live data stream. In the distribution system 1 shown in Fig 1,2 or 3, the source of the live stream may split the stream in three parts, which are stored in parallel on the mass storage devices 11,21,31 using the PDFS. By storing the live stream in three parallel parts, the bandwidth requirement between the source 15 and each computer device 10,20,30 is one third of the bandwidth requirements for streaming directly to a single destination. In the live streaming example the computer devices 10,20,30 operate as a buffer between the source and the end-user devices 3.4.5.6.7.
The computer devices may further be arranged to encode the data file, e.g.
20 each computer device of the data distribution system being arranged for encoding a part of the file (e.g a video file) and storing the part of the video file, when encoded, using the parallel distributed file system. In particular, in video applications, it is preferred that the data is distributed to the computer devices for encoding in groups of pictures (comprising e.g. a key frame that reflects an entire image and increment data that reflect changes in the 25 image), e.g. one or an integer number of groups of pictures per computer device, so as to allow fast and effective encoding.
The content server part 24 may be used to select a specific data file matching the decoding requirements of the requesting end-user device 3,4,5,6,7. Depending on the decoding capabilities of the end-user device 3,4,5,6,7, a request for e.g. an audio/video file 30 results in the selection of a specific data file to be transmitted to the end-user device 3.4.5.6.7.
The computer device 10,20,30 can be configured with a Linux kernel having an adapted kernel driver for the PDFS. Because of potential delays and high latency caused by the WAN 2, buffering in the PDFS may be required. In case the PDFS has inadequate 35 buffering mechanisms, buffering may be added to the PDFS. A Network File System (NFS) layer may be added to the PDFS for this purpose, as the NFS incorporates buffering mechanisms suitable for use with network storage solutions.
9
Each mass storage device 11,21,31 preferably uses an operating system file system that is optimized for storing relatively large files to avoid fragmentation of the data parts, minimize seek times and enable fast deletions of data parts.
One embodiment of the invention may be implemented as a program product 5 for use with a computer system. The program(s) of the program product define functions of the embodiments (including the methods described herein) and can be contained on a variety of non-transitory computer-readable storage media. Illustrative computer-readable storage media include, but are not limited to: (i) non-writable storage media (e.g., read-only memory devices within a computer such as CD-ROM disks readable by a CD-ROM drive, 10 ROM chips or any type of solid-state non-volatile semiconductor memory) on which information is permanently stored; and (ii) writable storage media (e.g., flash memory, floppy disks within a diskette drive or hard-disk drive or any type of solid-state random-access semiconductor memory) on which alterable information is stored.

Claims (16)

1. Datadistributiesysteem (1) voor het distribueren van ten minste een databestand naar een gebruikersinrichting (3, 4, 5), waarbij het datadistributiesysteem meerdere 5 computerinrichtingen (10, 20, 30) omvat die zijn ingericht om communicatief te zijn verbonden via een wide area netwerk (2), waarbij elke computerinrichting (10, 20, 30) een massa opslaginrichting (11, 21, 31) omvat, waarbij het datadistributiesysteem is ingericht voor het leveren, gebruikmakend van een parallel gedistribueerd bestandssysteem, van het databestand naar de gebruikersinrichting door het verzenden via het wide area netwerk van 10 datablokken van het databestand van de massa opslaginrichting van elk van de computerinrichtingen, waarbij de datablokken tezamen het databestand vormen.A data distribution system (1) for distributing at least one data file to a user device (3, 4, 5), the data distribution system comprising a plurality of computer devices (10, 20, 30) adapted to be communicatively connected via a wide area network (2), wherein each computer device (10, 20, 30) comprises a mass storage device (11, 21, 31), wherein the data distribution system is adapted to provide, using a parallel distributed file system, the data file to the user device by transmitting via the wide area network 10 data blocks of the data file of the mass storage device of each of the computer devices, the data blocks together forming the data file. 2. Datadistributiesysteem volgens conclusie 1, waarbij elk computerinrichting een dataservergedeelte (12, 22, 32) en een cliëntgedeelte (13, 23, 33) omvat, waarbij het 15 dataservergedeelte (12, 22, 32) is ingericht voor het terugvinden van een datablok als een lokaal databestand van de massa opslaginrichting (11, 21, 31) gebruik makend van een lokaal bestandsysteem, en waarbij het cliëntgedeelte (13, 23, 33) is ingericht voor het terugvinden van het databestand door het terugvinden van de datablokken van de dataservergedeelten (12, 22, 32) van elk van de meerdere computerinrichtingen (10, 20, 30) 20 gebruik makend van het parallel gedistribueerd bestandssysteem.2. Data distribution system according to claim 1, wherein each computer device comprises a data server part (12, 22, 32) and a client part (13, 23, 33), the data server part (12, 22, 32) being arranged for retrieving a data block as a local data file of the mass storage device (11, 21, 31) using a local file system, and wherein the client portion (13, 23, 33) is arranged to retrieve the data file by retrieving the data blocks from the data server portions (12, 22, 32) of each of the plurality of computer devices (10, 20, 30) using the parallel distributed file system. 3. Datadistributiesysteem volgens conclusie 1 of 2, waarbij ten minste een van de computerinrichtingen (20) een contentservergedeelte (24) omvat dat is ingericht voor, in antwoord op een verzoek naar het databestand van een gebruikersinrichting, het initialiseren 25 van de overdracht van het databestand aan de gebruikersinrichting.3. Data distribution system according to claim 1 or 2, wherein at least one of the computer devices (20) comprises a content server part (24) which is arranged for, in response to a request to the data file of a user device, initializing the transfer of the data file at the user device. 4. Datadistributiesysteem (1) volgens conclusie 3, waarbij het contentservergedeelte (24) een is van een streamingserver, een multimediaserver, een VideoServer, een muziekserver, een Webserver en een bestandsserver, of een combinatie daarvan. 30The data distribution system (1) according to claim 3, wherein the content server portion (24) is one of a streaming server, a multimedia server, a Video Server, a music server, a Web server and a file server, or a combination thereof. 30 5. Datadistributieserver volgens een van de voorgaande conclusies, waarbij de gebruikersinrichting (3, 4, 5, 6, 7) een is van een set-top box, een televisie met ingebouwde internet toegang, een thuisbioscoop inrichting, een muziekspelerinrichting, een smartphone, een tablet pc, een notebook en een pc, of een combinatie daarvan. 35A data distribution server according to any one of the preceding claims, wherein the user device (3, 4, 5, 6, 7) is one of a set-top box, a television with built-in internet access, a home theater device, a music player device, a smartphone, a tablet PC, a notebook and a PC, or a combination thereof. 35 6. Datadistributiesysteem volgens een van de voorgaande conclusies, waarbij ten minste een van de massa opslaginrichtingen (11, 21, 31) een redundante matrix met -11 - onafhankelijke opslaginrichtingen omvat die zijn ingericht voor het opslaan van het lokale bestand op elk van de onafhankelijke opslaginrichtingen.The data distribution system according to any of the preceding claims, wherein at least one of the mass storage devices (11, 21, 31) comprises a redundant matrix with -11 - independent storage devices adapted to store the local file on each of the independent storage devices. 7. Datadistributiesysteem volgens een van de voorgaande conclusies, waarbij het 5 datadistributiesysteem meerdere sets met meerdere computerinrichtingen omvat die communicatief zijn verbonden met het wide area netwerk, waarbij voor elke set, de redundante computerinrichtingen samenwerken, gebruik makend van het parallel virtuele bestandssysteem, voor het distribueren van het databestand naar een gebruikersinrichting.7. Data distribution system according to any of the preceding claims, wherein the data distribution system comprises a plurality of sets with a plurality of computer devices which are communicatively connected to the wide area network, wherein for each set, the redundant computer devices work together, using the parallel virtual file system, for the distributing the data file to a user device. 8. Datadistributiesysteem volgens een van de voorgaande conclusies, voorts omvattende een datatransmitter, die te verbinden is met het wide area netwerk, waarbij de datatransmitter is ingericht voor: - het verdelen van het databestand in datablokken - het toekennen van elk van de datablokken aan een van de computerinrichtingen; 15. het verzenden van elk datablok aan de computerinrichting aan welke deze is toegekend, waarbij de datablokken over de computerinrichtingen worden verdeeld.A data distribution system according to any one of the preceding claims, further comprising a data transmitter that can be connected to the wide area network, the data transmitter being arranged for: - dividing the data file into data blocks - assigning each of the data blocks to a of the computer devices; 15. sending each data block to the computer device to which it has been assigned, the data blocks being distributed among the computer devices. 9. Computerinrichting (10, 20, 30) die ingericht is om communicatief te worden verbonden via een wide area netwerk (2) met meerdere andere computerinrichtingen (10, 20 20, 30), waarbij de computerinrichting (10, 20, 30) een massa opslaginrichting (11,21, 31) omvat en is ingericht voor het leveren, gebruik makend van een parallel gedistribueerd bestandssysteem, van een databestand aan een gebruikersinrichting door het verzenden via het wide area netwerk van datablokken van het databestand van de massa opslaginrichting van de computerinrichting en van massa opslaginrichtingen van de andere 25 computerinrichtingen, waarbij de datablokken tezamen het databestand vormen.A computer device (10, 20, 30) adapted to be communicatively connected via a wide area network (2) to a plurality of other computer devices (10, 20, 20, 30), wherein the computer device (10, 20, 30) includes a mass storage device (11, 21, 31) and is adapted to provide, using a parallel distributed file system, a data file to a user device by transmitting over the wide area network of data blocks the data file of the mass storage device of the computer device and mass storage devices of the other computer devices, the data blocks together forming the data file. 10. Computerinrichting (10, 20, 30) volgens conclusie 9, omvattende een dataserver gedeelte (12, 22, 32) en een cliëntgedeelte (13, 23, 33), waarbij het dataservergedeelte (12, 22, 32) is ingericht voor het terugvinden van een datablok als een lokaal bestand van de 30 massa opslaginrichting (11, 21, 31) van de computerinrichting gebruik makend van een lokaal bestandssysteem, en waarbij het cliëntgedeelte (13, 23, 33) is ingericht voor het terugvinden van het databestand door het terugvinden van de datablokken van het dataservergedeelte (12, 22, 32) en van de dataservergedeelten (12, 22, 32) van de andere computerinrichtingen (10, 20, 30) gebruik makend van het parallel gedistribueerde 35 bestandssysteem. - 12-The computer device (10, 20, 30) of claim 9, comprising a data server portion (12, 22, 32) and a client portion (13, 23, 33), wherein the data server portion (12, 22, 32) is adapted to retrieving a data block as a local file from the mass storage device (11, 21, 31) of the computer device using a local file system, and wherein the client portion (13, 23, 33) is arranged to retrieve the data file by recovering the data blocks of the data server portion (12, 22, 32) and of the data server portions (12, 22, 32) of the other computer devices (10, 20, 30) using the parallel distributed file system. - 12- 11. Computerinrichting (10, 20, 30) volgens conclusie 9 of 10, omvattende een contentservergedeelte (24) dat ingericht is voor, in antwoord op een verzoek naar het databestand van een gebruikersinrichting, het initialiseren van de overdracht van het databestand naar de gebruikersinrichting. 5The computer device (10, 20, 30) according to claim 9 or 10, comprising a content server portion (24) adapted to, in response to a request to the data file of a user device, initializing the transfer of the data file to the user device . 5 12. Datadistributiesysteem voor het distribueren van een databestand naar een gebruikersinrichting, omvattende meerdere computerinrichtingen volgens een van de conclusies 9-11.A data distribution system for distributing a data file to a user device, comprising a plurality of computer devices according to any of claims 9-11. 13. Datadistributiesysteem volgens conclusie 12, voorts omvattende een datatransmitter, die te verbinden is met het wide area netwerk, waarbij de datatransmitter is ingericht voor: - het verdelen van het databestand in datablokken; - het toekennen van elk van de datablokken aan een van de computerinrichtingen; - het verzenden van elk datablok aan de computerinrichting waaraan dit is toegekend, 15 waarbij de datablokken over de computerinrichtingen worden verdeeld.The data distribution system according to claim 12, further comprising a data transmitter that can be connected to the wide area network, the data transmitter being arranged for: - dividing the data file into data blocks; - assigning each of the data blocks to one of the computer devices; - sending each data block to the computer device to which it has been assigned, the data blocks being distributed among the computer devices. 14. Werkwijze voor het distribueren van een databestand naar een gebruikersinrichting (3, 4, 5), waarbij de werkwijze omvat: - het verschaffen van meerdere computerinrichtingen (10, 20, 30), waarbij elke 20 computerinrichting (10, 20, 30) een massa opslaginrichting (11, 21, 31) omvat, waarbij de computerinrichtingen zijn verbonden met een wide area netwerk, en - het leveren, gebruik makend van een parallel gedistribueerd bestandssysteem, van het databestand aan de gebruikersinrichting door het verzenden via het wide area netwerk van datablokken van het databestand van de massa opslaginrichting van elk van de meerdere 25 computerinrichtingen, waarbij de datablokken tezamen het databestand vormen.A method for distributing a data file to a user device (3, 4, 5), the method comprising: - providing a plurality of computer devices (10, 20, 30), each computer device (10, 20, 30) comprises a mass storage device (11, 21, 31), wherein the computer devices are connected to a wide area network, and - providing, using a parallel distributed file system, the data file to the user device by transmitting via the wide area network of data blocks of the data file of the mass storage device of each of the plurality of computer devices, the data blocks together forming the data file. 15. Werkwijze volgens conclusie 14, waarbij elke computerinrichting een dataservergedeelte (12, 22, 32) en een cliëntgedeelte (13, 23, 33) omvat, waarbij de werkwijze omvat: 30. het terugvinden door het dataservergedeelte (12, 22, 32) van een datablok als een lokaal bestand van de massa opslaginrichting (11, 21, 31) gebruik makend van een lokaal bestandssysteem, en - het terugvinden door het cliëntgedeelte (13, 23, 33) van het databestand door het terugvinden van de datablokken van het dataservergedeelte (12, 22, 32) van elk van de 35 meerdere computerinrichtingen (10, 20, 30) gebruik makend van het parallel gedistribueerde bestandssysteem. - 13-The method of claim 14, wherein each computer device comprises a data server portion (12, 22, 32) and a client portion (13, 23, 33), the method comprising: 30. retrieving through the data server portion (12, 22, 32) of a data block as a local file of the mass storage device (11, 21, 31) using a local file system, and - retrieving by the client part (13, 23, 33) of the data file by retrieving the data blocks of the data server portion (12, 22, 32) of each of the plurality of computer devices (10, 20, 30) using the parallel distributed file system. - 13- 16. Werkwijze volgens conclusie 14 of 15, omvattende, in antwoord op een verzoek naar het databestand van een gebruikersinrichting, het initialiseren van de overdracht van het databestand naar de gebruikersinrichting door een contentservergedeelte (24) van ten minste een van de computerinrichtingen (20). 5A method according to claim 14 or 15, comprising, in response to a request to the data file of a user device, initializing the transfer of the data file to the user device by a content server portion (24) of at least one of the computer devices (20) . 5
NL2007502A 2011-09-29 2011-09-29 Data distribution system, method and computer device. NL2007502C2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
NL2007502A NL2007502C2 (en) 2011-09-29 2011-09-29 Data distribution system, method and computer device.

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
NL2007502 2011-09-29
NL2007502A NL2007502C2 (en) 2011-09-29 2011-09-29 Data distribution system, method and computer device.

Publications (1)

Publication Number Publication Date
NL2007502C2 true NL2007502C2 (en) 2013-04-02

Family

ID=45373804

Family Applications (1)

Application Number Title Priority Date Filing Date
NL2007502A NL2007502C2 (en) 2011-09-29 2011-09-29 Data distribution system, method and computer device.

Country Status (1)

Country Link
NL (1) NL2007502C2 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040133606A1 (en) * 2003-01-02 2004-07-08 Z-Force Communications, Inc. Directory aggregation for files distributed over a plurality of servers in a switched file system
WO2009048729A1 (en) * 2007-10-09 2009-04-16 Cleversafe, Inc. Block based access to a dispersed data storage network
EP2112788A1 (en) * 2007-03-28 2009-10-28 Huawei Technologies Co., Ltd. A method, system and nodes for p2p content sharing

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040133606A1 (en) * 2003-01-02 2004-07-08 Z-Force Communications, Inc. Directory aggregation for files distributed over a plurality of servers in a switched file system
EP2112788A1 (en) * 2007-03-28 2009-10-28 Huawei Technologies Co., Ltd. A method, system and nodes for p2p content sharing
WO2009048729A1 (en) * 2007-10-09 2009-04-16 Cleversafe, Inc. Block based access to a dispersed data storage network

Similar Documents

Publication Publication Date Title
US11178225B2 (en) Data files synchronization with cloud storage service
US11775569B2 (en) Object-backed block-based distributed storage
US20150215405A1 (en) Methods of managing and storing distributed files based on information-centric network
US10917260B1 (en) Data management across cloud storage providers
WO2015175411A9 (en) Distributed secure data storage and transmission of streaming media content
US20240048792A1 (en) System and method for storing multimedia files using an archive file format
NL2007502C2 (en) Data distribution system, method and computer device.
Al-Anzi et al. New proposed robust, scalable and secure network cloud computing storage architecture
US9229944B2 (en) Scalable networked digital video recordings via shard-based architecture
Qiang et al. A Hyper-converged video management system based on object storage
US9596183B2 (en) NAS off-loading of network traffic for shared files
JP4667419B2 (en) Distributed multimedia server system and multimedia information storage and distribution method
US20220408126A1 (en) System and method for optimizing the distribution of available media production resources
EP3062210B1 (en) Method and server for the storage of multimedia content and its delivery in adaptive streaming systems
WO2022263665A1 (en) System and method for optimizing the distribution of available media production resources
JP5183684B2 (en) Distributed multimedia server system and multimedia information storage and distribution method
CN117981326A (en) Virtual and index assembly for cloud-based video processing
KR20140060962A (en) System and method for providing multiple service using idle resource of network distributed file system
Sim Berkeley StoRage Manager (BeStMan)
Kaneko et al. Content Espresso: A global secure large file sharing system for media industries
Hu et al. A Design of Cloud Storage Gateway Based on Data Dispersal
US7644229B2 (en) Rapid search system and method in high capacity hard disk drive cluster
Shakeel et al. A Cloud Content Repository: Acquisition, Metadata, Processing and Archive

Legal Events

Date Code Title Description
MM Lapsed because of non-payment of the annual fee

Effective date: 20151001