WO2018196643A1 - 一种私有数据云存储系统及私有数据云存储方法 - Google Patents

一种私有数据云存储系统及私有数据云存储方法 Download PDF

Info

Publication number
WO2018196643A1
WO2018196643A1 PCT/CN2018/083237 CN2018083237W WO2018196643A1 WO 2018196643 A1 WO2018196643 A1 WO 2018196643A1 CN 2018083237 W CN2018083237 W CN 2018083237W WO 2018196643 A1 WO2018196643 A1 WO 2018196643A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
network
local
peer
remote server
Prior art date
Application number
PCT/CN2018/083237
Other languages
English (en)
French (fr)
Inventor
赵海林
周晖
Original Assignee
广州国储科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州国储科技有限公司 filed Critical 广州国储科技有限公司
Publication of WO2018196643A1 publication Critical patent/WO2018196643A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L61/00—Network arrangements, protocols or services for addressing or naming
    • H04L61/09—Mapping addresses
    • H04L61/25—Mapping addresses of the same type
    • H04L61/2503—Translation of Internet protocol [IP] addresses
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00—Network architectures or network communication protocols for network security
    • H04L63/04—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
    • H04L63/0428—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00—Network architectures or network communication protocols for network security
    • H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/104—Peer-to-peer [P2P] networks

Definitions

  • the present invention relates to the field of data cloud storage, and in particular to a private data cloud storage system and a private data cloud storage method that are convenient and fast, and can automatically construct a temporary transparent point-to-point data communication connection link.
  • the storage of Internet data can be completely divided into smaller units, and blocks and blocks are interconnected by Internet cloud computing technology; each block is a separate cloud storage server for serving a smaller range, which will Greatly reduce the cost and defects of the way this service is provided by a service provider.
  • the bandwidth resources owned by Internet participants are often low-cost ADSL, Cable, fiber or wireless shared bandwidth.
  • Internet private data cloud storage servers based on such low-cost resources will have great prospects and attractiveness.
  • the era of data owned and maintained by service providers has been transformed into an era in which Internet participants themselves own and keep them.
  • the security, privacy and convenience of data storage have been completely solved, and the country is benefiting the world.
  • the object of the present invention is to solve the defects of the current public cloud storage service mode and the generally idle and wasted Internet broadband resources.
  • the Internet private data cloud storage service system proposed by the present invention can perform data cloud storage by connecting an external storage medium or a data storage device unit and an internal storage medium unit, by connecting a wired or wireless communication unit. Access to the LAN and the Internet, and through the built-in specific data management system to achieve data synchronization, upload, download, share and control functions.
  • the present invention provides a private data cloud storage system, wherein the cloud storage system includes:
  • Private storage terminal data access module and server
  • the private storage terminal has a control unit, an internal storage medium unit, and a communication connection unit, and the control unit is configured to control the internal storage medium unit and the communication connection unit to perform data storage and communication, and the communication connection unit is used for The server and the data access module perform data communication;
  • the data access module is configured to generate a data access request to perform a data access operation on the private storage terminal;
  • the server is configured to establish a temporary transparent peer-to-peer direct connection between the data access module and the private storage terminal based on data sent by the data access module and the private storage terminal road.
  • the server comprises a first remote server and a second remote server, and the first remote server and the second remote server determine a network in which the two are located based on the data packets sent by the private storage terminal and the data access module.
  • Type and establishing a penetrating point-to-point direct access connection between the private storage terminal and the data access module based on the network type.
  • the private storage terminal and the data access module have an encryption module, and the encryption module is configured to encrypt the transmitted data.
  • the private storage terminal has a storage expansion interface, and the storage expansion interface is connected to an external storage medium for expanding the storage capacity of the private storage terminal.
  • the present invention provides a method for implementing private data cloud storage, comprising the following steps:
  • the implementation method of the private data cloud storage further includes:
  • step (1) If the response message is not received or the response message received is a response message sent by the local machine, the step (1) is entered.
  • the implementation method of the private data cloud storage comprises:
  • the implementation method of the private data cloud storage comprises:
  • the local address and the port are sent to the first remote server, and the first remote server requests the peer to send the protocol to the local device, and based on the opposite end
  • the protocol establishes a communication connection with the peer
  • the protocol is sent to the peer IP address and port, and the first remote server local address and port are notified, and the peer end is requested to send the protocol to the local;
  • the implementation method of the private data cloud storage comprises:
  • step (3.2) If the protocol message of the peer end is received, the contact is established with the peer end, otherwise the process returns to step (3.1);
  • the process of requesting the peer to send the protocol includes: first sending the protocol packet to the other party, and then notifying the server, and letting the server notify the other party to send a protocol packet to itself.
  • the present invention provides a dual server-based private data cloud storage transparent access method, comprising the following steps:
  • the method includes: determining the private storage terminal and the data access end by using the first server and the second server respectively to send the data packet.
  • the method further includes:
  • step (1) If the response message is not received or the response message received is a response message sent by the local machine, then the step (1) is entered.
  • the method comprises:
  • the local IP is a non-public IP
  • the private data cloud storage transparent access method further includes:
  • the local address and the port are sent to the first remote server, and the first remote server requests the peer to send the protocol to the local device, and based on the opposite end
  • the protocol establishes a communication connection directly with the peer
  • the protocol is sent to the peer IP address and port, and the first remote server local address and port are notified, and the peer end is sent to the local protocol, based on the peer end.
  • the protocol establishes a communication connection directly with the peer;
  • the NAT structure network notifies the user that the direct connection cannot be established, asks the user whether to change the network access environment or establish a transitive interconnection through the first or second remote server; otherwise, the peer is requested to send the protocol to the local, based on The end protocol establishes a communication connection directly with the peer.
  • the present invention provides a method for determining a network type in which a local machine is located by using a dual server, wherein the method includes:
  • the local address and the port are sent to the first remote server, and the first remote server requests the peer to send the protocol to the local device, and based on the opposite end
  • the protocol establishes a communication connection with the peer
  • the protocol is sent to the peer IP address and port, and the first remote server local address and port are notified, and the peer end is requested to send the protocol to the local;
  • the internal storage unit in the present invention can be used only for storing an inherent program or as a data storage. Preferably, it is only used as a storage for the native program, storing the data on an external private data storage device.
  • the internal storage unit or the external storage medium mentioned in the present invention may adopt the same or different common standard interfaces, and the interface standard may be selected from a CF interface, an SM interface, an MMC interface, an SD interface, an MS interface, PCMCIA interface, USB interface, USB OTG (USB On-The-GO) interface, IDE, SCSI interface, IEEE1394 interface, SATA interface, PATA interface, SAS interface, Fiber Channel interface, ISA interface, PCI interface, PCIE series standard interface, NAND series, ONE-NAND series interface, SPI interface, non-standard interface parallel data address interface;
  • the external storage medium includes but not limited to hard disk, mobile hard disk, SD card, Micro SD card external storage medium device and the like.
  • An internal storage medium unit of a private data cloud storage system adopting, a semiconductor storage medium, a magnetic medium, an optical medium, wherein the semiconductor storage medium is selected from the group consisting of FLASH, DRAM, SRAM, SDRAM, FRAM, MRAM, EPROM, EEPROM NAND, EMMC, eMCP, One-NAND, SSD solid state hard disk, the magnetic medium includes a floppy disk, a hard disk, a mobile hard disk, and the optical medium is selected from the group consisting of CD-R, CD-RW, DVD-R, and DVD-RW.
  • the semiconductor storage medium is selected from the group consisting of FLASH, DRAM, SRAM, SDRAM, FRAM, MRAM, EPROM, EEPROM NAND, EMMC, eMCP, One-NAND, SSD solid state hard disk
  • the magnetic medium includes a floppy disk, a hard disk, a mobile hard disk
  • the optical medium is selected from the group consisting of CD-R, CD-RW, DVD-R,
  • the private storage terminal can be connected to the internal or external storage medium unit through the USB bus, the SPI bus, the SD bus, the I2C bus, the parallel data bus, the parallel address bus, and the NAND connection bus to form a data storage space of the entire cloud storage terminal.
  • the above-mentioned private storage terminal can be designed as a portable structure that can be carried in large size and small size, or can be designed as a fixed structure.
  • the above private data cloud storage server has a corresponding external transformation mechanism.
  • the above private data cloud storage system can communicate through Ethernet, can communicate through WIFI wireless local area network, or can communicate through Bluetooth, WiMAX, 2G, 3G, 4G, 5G mobile standards; the above private data cloud storage system has corresponding Wired and wireless communication mode conversion mechanism.
  • the data access module of the present invention serves as a data access terminal, which can be substantially the same as the data access end of the usual cloud storage server, but has more temporary connection-to-peer direct-connect communication link construction function of the present invention, which can pass through the server
  • the communication algorithm establishes a remote end-to-end direct access connection technology with the corresponding private storage terminal by cooperating with the server, ensuring that all data transmission between the data access module and the private storage terminal does not transit through the intermediate server, thereby ensuring data transmission. Unmonitored and absolutely private.
  • Both the system and method of the present invention may include user authentication and encryption functions, and allow the client to perform data storage and transmission operations on the private storage terminal only when the client passes authentication.
  • the private data cloud storage service system and the corresponding method provided by the invention not only realize remote control, exchange and storage of data, but also can strictly encrypt and transmit and protect data, and ensure data security and legality of operation. Can be widely used in many industry sectors as the most basic data cloud storage service.
  • FIG. 1 is a structural block diagram of a private data cloud storage system according to an embodiment of the present invention.
  • FIG 2 is an architectural diagram and an application model of software (firmware program) according to an embodiment of the present invention
  • FIG. 3 is a flowchart of a peer-to-peer network type identification method or step used in an embodiment of the present invention.
  • FIG. 4 is a flowchart of a peer-to-peer connection method or step used in an embodiment of the present invention.
  • FIG. 5 is a structural block diagram of a trusted UDP transmission service in a data record transmission and processing process according to an embodiment of the present invention
  • FIG. 6 is a block diagram showing the structure of a proxy service in a data record transmission and processing process according to an embodiment of the present invention
  • FIG. 7 is a block diagram showing a file service structure in a data record transmission and processing process according to an embodiment of the present invention.
  • the private data cloud storage system 100 in this embodiment includes a private storage terminal 110, a data access module 120, and a server 130.
  • the private storage terminal 110 is a removable device or a fixed device, which can have its own storage or external storage or extended storage.
  • the private storage terminal 110 has a control unit 111, an internal storage medium unit 112, and a communication connection unit 113.
  • the control unit 111 of the private storage terminal 110 may be composed of one or more integrated circuit chips, and the control unit 111 in the private storage terminal 110 is used for coordinated operation of each unit in the terminal, and controls the internal storage medium unit 112 and the communication connection unit 113.
  • the communication connection unit is configured to perform data communication with the server 130 and the data access module 120.
  • the server 130 may have one or more computers for undertaking all computing of the private data cloud storage system, cloud computing, and assisting in the construction of temporary penetrating direct-connect communication links between 120 and 110, even when between 120 and 110.
  • a transmission data transfer service between 120 and 110 is provided in an environment in which a temporary transparent direct communication link cannot be established.
  • the private data cloud storage system 100 of the present invention meets the requirements of establishing a transparent point-to-point direct connection for the private data terminal 110 and the data access module 120 under various network type conditions, and the server 130 includes the first server 131 and the second.
  • the server 132 where the first server and the second server are two different computing cores of the same server with different communication addresses, may also be two independent servers located at different network addresses.
  • the internal storage medium unit 112 can provide firmware program non-volatile storage for the control unit 111, including but not limited to programmable program storage media or electrically erasable storage media, flash storage media, and magnetic storage. Medium, ferromagnetic storage media, optical storage media, etc. An electrically erasable storage medium is employed in embodiments of the present invention.
  • the private data terminal 110 includes one or more interfaces to various external storage devices for storing and exchanging data with one or more data storage devices or one or more data storage media.
  • the control unit 111 completes the deposit or retrieval operation of the data according to the request of the data access module 120.
  • the communication connection unit 113 includes, but is not limited to, any connection method that can be used with an external connection, including Ethernet, Token Ring, wired LAN, WIFI wireless LAN, optical transceiver, Bluetooth local area network, WiMAX wireless network, Zigbee wireless network and other intelligence. Home wireless networking technology, including but not limited to LAN, IP and other Internet communication protocol standards.
  • the Ethernet connection port includes but is not limited to RJ45, USB-RJ45, USB-c type Ethernet conversion port, and the like.
  • the communication connection unit 113 can further adopt the following communication rates, frequencies, and standards: 10M, 100M, 1000M, and 10 Gigabit Ethernet speed.
  • the WIFI includes 2.4G, 5G, 802.11abgn or 802.11ac.
  • the second layer is a UDP layer based on the UDP protocol, which is the lowest layer of the communication protocol of the present invention, and is responsible for the transmission of the original.
  • the second layer is based on the first layer UDP protocol to establish a peer-to-peer connection between each other, a layer of protocol for transmitting control commands and data, and the third layer is a trusted, reliable packet based on peer-to-peer communication technology.
  • the transport service layer which guarantees the integrity of the data transmitted by both parties, ensures that the control commands and data transmitted by both parties are 100% completely correct. It achieves 100% confidence through the check algorithm and retransmission mechanism.
  • the fourth layer is a proxy service protocol layer based on the trusted UDP protocol, which mainly provides a standard TCP application service to the upper application layer, so that the present invention can be applied to both the UDP protocol-based application and the transmission-based transmission.
  • Known and widely used TCP protocols including but not limited to Internet application protocols such as http, ftp, tftp, email, etc., make the present invention a basic service for a general point-to-point connection service.
  • the fifth layer is the application layer of the private data cloud storage server of the present invention, which implements the file service function of the private data cloud storage server, and provides an application interface for communication, control, transmission, and management of the data cloud storage;
  • the application architecture diagram on each platform shows the development and support SDK architecture diagram of the application and firmware program of the entire private data cloud storage server, which is the core application model of the system and method of the present invention, which is the development of all platform applications.
  • the key guiding structure as shown in the figure, is that the two sides of the communication are based on the local area network or the Internet for data control and transmission. The two sides of the communication can be directly connected to the public IP address in the same network or in the Internet of different places and countries.
  • the Internet can also be connected to an Internet access device such as, but not limited to, ADSL, or a combination of a NAT device connected to the Internet.
  • the applications running on both sides of the communication are roughly divided into four levels of peering.
  • the upper two layers implement the application layer based on the TCP protocol, and the lower two layers implement the most basic RUDP (trusted UDP) transport layer platforms.
  • the data transmission between the two communication parties is completely based on the RUDP protocol (trusted UDP protocol).
  • FIG. 3 is a block diagram showing a peer-to-peer communication network type identification method or step adopted by a private data cloud storage system and a corresponding method according to an embodiment of the present invention; the method and the steps are respectively in a private storage terminal and data Execute on the access module.
  • the algorithm starts from initializing the UDP socket, and after establishing the basic udp socket, first sends the data to the first server, requesting the first server 131 to send back the local address it sees. If not, the UDP is determined. Blocked. If it is returned, record the returned IP and compare it with the IP of the machine. If it is different, it means that the machine is behind the NAT Internet access device (network address translation device). If it is the same, the machine is a public IP. This situation is friendly to P2P and can be directly established based on public IP. If it is detected that it is behind the NAT, the first server 131 is notified to request the second server 132 to send data to the local address.
  • the returned data is received, it can be determined that the local device is in the Full Cone NAT structure network. The situation is friendly to P2P, and a point-to-point direct connection communication mode can be established. Otherwise, the requesting second server 132 sends back the local address that is seen, compares this address with the IP address recorded by the first server 131, and if it is different, detects that the network where the local machine is located is a Symmetric NAT structure. If the same, the second server 132 is notified to change the port transmission protocol data to the local address.
  • the local machine If the local machine receives the return data, it detects that the network where the local machine is located is a Restricted Cone NAT structure type, and this type can establish a P2P connection, otherwise It is detected that the network where the machine is located is the Restricted Port NAT structure type. In this way, the network type in which the local device (data access module or private storage terminal) is located can be determined for later use for establishing a temporary communication connection link.
  • FIG. 4 is a block diagram showing a peer-to-peer connection algorithm employed by the private data cloud storage system and method of the embodiment of the present invention.
  • the connection algorithm is executed on the data access module and the private storage terminal, respectively.
  • the user generates and sends a data access request through the data access module to perform a data cloud storage operation, and the private storage terminal stores the data and performs corresponding access operations according to the access request of the data access module.
  • the algorithm first initializes a UDP socket, and then sends a broadcast message through the local area network. If a response message is received within a predetermined time, and it is determined that it is not a response message sent by itself, the peer-to-peer communication parties are in the same local area network. Then, directly establish the LAN connection between the two parties. If the LAN reply message is not received, the point-to-point NAT network type identification process (the process shown in FIG. 3) is entered, and the corresponding communication connection process is performed according to the identified NAT type.
  • the network UDP network service where the user equipment is located is notified to be blocked; if the public network IP is detected, the communication can be directly communicated with the other party; if the NAT type of Full Cone is detected, the next step is started.
  • Establish a point-to-point communication connection service the data access module (also referred to as a client) or a private storage terminal notifying the first and/or second server's own address and port (usually only the first server is notified)
  • the peer address and port provided in the response message, waiting for the peer to send a message, after receiving the message, the peer-to-peer connection path of both parties is completed.
  • the user is notified that the point-to-point connection path is not Established successfully. If it is determined that the network is of the Restricted Cone NAT type, then send the protocol to the peer IP address and port, notify the server of the local address and port, and request the other party to send the protocol to the local. If the peer-to-peer connection is received, the peer-to-peer connection is successful. If the peer reply message is not received, the user is notified that the peer-to-peer connection establishment fails. If the Restricted Port NAT type is detected, it is determined whether the peer is also in the Restricted Port NAT.
  • the structure network if both are in the Restricted Port NAT structure network, reminds the user that the current network access point of the local machine cannot establish a direct connection, prompting the user to change the network access environment (change to the above can establish a direct connection) Network type) or establish a transit communication service, through the first or second server transit data transmitted by both parties, or change the network access environment; if the detected Symmetric NAT type, if the peer is in a network environment other than the public network , or both ends are in the Symmetric NAT structure network, directly reminding the user that the current network access point of the local machine cannot establish a direct connection, asking the user whether to change the network access environment or establish a relay communication service, and transmit through the server transit The data.
  • FIG. 5 is a block diagram showing a flow chart of a trusted UDP algorithm in a data record transmission processing method of a private data cloud storage system according to an embodiment of the present invention; as shown in the figure, the transmission of trusted UDP is also a permanent resident thread program, and the program
  • the UDP listening process is entered. If the UDP message is received, it is determined that the message is not a predetermined message. After the packet is discarded, it returns to the listening process and waits for the arrival of the next UDP packet.
  • the received UDP message packet is a predetermined message, after establishing the contact with the peer end, start the sending timer, send the point to the snack packet, and keep the heartbeat packet connected with the server, point to the heartbeat packet from the peer to the peer, and do relevant Processing work.
  • the window value sent by the trusted UDP is set, and a thread listening mechanism is started to dynamically adjust the window value to ensure maximum data transmission or dynamically adjust the sending rate.
  • a thread listening mechanism is started to dynamically adjust the window value to ensure maximum data transmission or dynamically adjust the sending rate.
  • the send window value if there is data to be sent, the data will be sent to the local buffer, and the window value will be judged in real time to exceed the defined window value. If it is not exceeded, the data will be sent to the peer. The window value has been exceeded and it is waiting to send new data.
  • the proxy service is mainly used for a TCP program that is completely compatible with the peer end, and the program needs to select a local port. Match the peer port. Of course, if there is no other port in the local area, you can also select the same port as the remote port.
  • the TCP Listen of this port is established in advance, and then the trusted UDP communication is established with the peer. Once successful, the Socket obtained in this TCP Listen is associated with this trusted UDP. At this time, two threads will be started, one for receiving the message of the local Socket and the other for receiving the message of the trusted UDP. After receiving the local Socket message, the data will be sent to the peer through the trusted UDP; after receiving the trusted UDP message, the message will be sent back to the TCP Listen as the received data processing.
  • FIG. 7 is a block diagram showing a file service structure in a method for transmitting and processing data records of a private data cloud storage service system according to an embodiment of the present invention.
  • the file service of the present invention is designed based on a TCP protocol, After the program starts initialization, it enters the listening process of the TCP message. After receiving the TCP-related message, it begins to enter the processing of the file service instruction, determines that it is the predetermined correct instruction, and enters the corresponding instruction processing flow.
  • the instructions of the first version of the design temporarily include: obtaining the directory below the corresponding directory and the file instruction, obtaining the file instruction under the corresponding directory, sending the file to the corresponding directory, deleting the file below the corresponding directory, and deleting the directory below the corresponding directory.
  • the instruction the instruction of adding the directory below the corresponding directory, the instruction of modifying the file name under the corresponding directory, the instruction of modifying the directory name under the corresponding directory, and the instruction for changing the file below the corresponding directory, as shown in the figure, all these instructions
  • the same method is used for the processing. After the instruction is executed, it is judged to be If it is executed correctly, if it is correct, it will return the correct message. If it fails, it will return the failed message and give the command requester. Finally, it will return to the listening state and wait for the next instruction to arrive, and go directly to the device to shut down.
  • the private cloud storage system of the invention can realize private data transmission, download, synchronization, real-time transmission and storage of files, images, audio and video data generated and owned by various Internet participants through a private local area network, a public metropolitan area network, and an Internet.
  • the Internet private data cloud storage service technology on the storage medium specified by the end user, the private storage terminal may use any type of storage medium as the data storage carrier, including but not limited to the traditional disk, USB flash drive, hard disk, mobile hard disk, solid state hard disk, light Storage disk, CD disk, DVD disk, Blu-ray disk, various memory card TF card, Micro SD card, SD card, CF card, MMC, MMS, XD, CF, SmartMedia card, etc., greatly facilitates users in the mobile Internet Times set up a private private cloud storage service center to revitalize old-fashioned storage media that were previously unsuitable for mobile devices.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Hardware Design (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer And Data Communications (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

本发明公开了一种私有数据云存储系统及私有数据云存储方法。本发明的云存储系统包括：私人存储终端、数据访问模块和服务器。本发明的私有数据云存储系统可通过各种形式的互联网络进行同步、上传、下载等数据记录的交换和存储到用户指定的外接存储单元里。本发明的私人存储终端可以内置存储单元也可以外接存储单元，为用户提供更方便的云存储方式。此外，采用本发明的私有数据云存储服务系统及相应方法，不仅实现了数据的远程交换和存储，还能够对数据进行严格的加密传输和保护，保证数据的安全性和操作的合法性，可广泛应用于众多的行业领域作为提供最基础的私有数据云存储服务。

Description

一种私有数据云存储系统及私有数据云存储方法
相关申请
本申请主张于2017年4月24日提交的、名称为“一种私有数据云存储系统及私有数据云存储方法”的中国发明专利申请:201710271251.7的优先权。
技术领域
本发明涉及数据云存储领域，具体地涉及一种方便快捷、能够自动搭建起一条临时的穿透式点对点数据通信连接链路的私有数据云存储系统及私有数据云存储方法。
背景技术
近年来是各种公有云存储技术和服务大行其道的时代，这些云存储技术给各行业的发展提供了众多的便利，得益于云存储技术而发展起来的大数据分析技术，也是当前和未来最重要的生产力工具。随着参与互联网活动的对象越来越多，从传统的人参与互联网到现时代物体也在参与互联网活动。然而这些应用和服务模式始终不能摆脱共用的模式，即由服务提供商提供数据存储的介质和设备，由众多的用户或设备提供数据信息，通过互联网集中存储在服务提供商的存储介质中，由服务提供商来统一保管，实际上这些数据最终还是被服务提供商所攫取和使用了。
随着互联技术的进一步发展与分化，新兴的物联网技术正成为当前的焦点，越来越多的设备也加入了互联网的大家庭里，这些设备往往是实时不停的产生巨大的数据量，其数据生产能力远远大于以人为主的时代，数据量的不断增长要求服务提供商付出更大的成本建设基础设施满足数据存储增长的需求，这会严重增加服务提供商的成本，最终导致免费提供存储服务的模式的终止。互联网数据的存储完全可以分割成一块块更小的单位，块与块间通过互联网云计算技术相互关联在一起；每一块是一个独立的云存储服务器，用于服务于更小的范围，这将极大的降低由一个服务商提供服务这种方式的成本和缺陷。
其次是互联网的参与者一般都有稳定而且是24小时连续的网络连接和带宽资源，例如家用的ADSL宽带接入，LAN宽带接入，Cable宽带接入，光纤宽带接入以及 移动蜂窝2G/3G/4G等无线技术接入。只是目前这些资源基本上在大部分时间里都是闲置着、而且又相互重叠但又是必不可少的。如何充分利用起这些闲置的资源，将会给全社会的进步和能源的节省带来极大的益处。采用这种私有数据的云存储技术，让数据的存储向私有化和微细化方向前行，以此来重构互联网的发展模式，完全解决了资源集中存储在服务提供商介质里的这种互联网模式的弊端，以此推动进入下一代互联网的发展时代，互联网私有化时代。
互联网的参与者所拥有的带宽资源，往往是价格低廉的ADSL，Cable，光纤或者无线共享的带宽，基于如此低廉的资源所构建的互联网私有数据云存储服务器，将具有极大的前途和吸引力，同时也把数据由服务商拥有、保管的时代转变成由互联网参与者自己拥有和保管的时代，数据存储的安全性、隐私性、便利性问题得到彻底的解决，利国利民利世界。
但是，目前尚没有一种完善的产品能够基于私人用户的移动存储介质空间构建可放置于用户家里的全球直连、即插即用、用户可通过互联网直接并行存入取出数据到双方通信对端的云存储服务技术，以便用户可以形成自己的远程控制私有数据云存储系统。
发明内容
鉴于现有的公有云存储产品和服务的缺陷以及社会普遍的带宽资源的闲置和浪费问题，本发明的目的就是为了解决目前公有云存储服务模式的缺陷和普遍闲置和浪费的互联网宽带资源而提出的一种互联网私有数据云存储服务器和私有数据云存储服务系统。
为了达到这一目的，本发明提出的这种互联网私有数据云存储服务系统，可以通过连接外部存储介质或者数据存储设备单元和内部存储介质单元来进行数据云存储，通过连接有线或无线通信单元来接入局域网和互联网，并且通过内置特定的数据管理系统来实现数据的同步、上传、下载、分享以及控制功能。
具体而言，本发明提供一种私有数据云存储系统，其特征在于，所述云存储系统包括：
私人存储终端、数据访问模块和服务器，
所述私人存储终端具有控制单元、内部存储介质单元和通信连接单元，所述控制 单元用于控制所述内部存储介质单元和通信连接单元进行数据存储和通信，所述通信连接单元用于与所述服务器和所述数据访问模块进行数据通信；
数据访问模块用于生成数据访问请求对所述私人存储终端进行数据访问操作；
所述服务器用于基于所述数据访问模块和所述私人存储终端所发送的数据建立起一条临时的穿透式点对点直连的所述数据访问模块和所述私人存储终端之间的通信连接链路。
优选地，所述服务器包括第一远程服务器和第二远程服务器，所述第一远程服务器和第二远程服务器基于所述私人存储终端和数据访问模块所发送的数据包确定二者所处的网络类型，并且基于所述网络类型建立所述私人存储终端和数据访问模块之间的穿透式点对点直接访问连接。
优选地，所述私人存储终端和数据访问模块具有加密模块，所述加密模块用于对所传输数据进行加密。
优选地，所述私人存储终端具有存储扩展接口，所述存储扩展接口与外部存储介质相连接，用以扩展所述私人存储终端的存储容量。
另一方面，本发明提供一种私有数据云存储的实现方法，包括下述步骤：
(1)通过分别从私人存储终端和数据访问端向远程服务器发送数据包的方式，判断私人存储终端和数据访问端所处的网络接入类型；
(2)、基于所判断的网络接入类型，利用改进的UDP数据封包传输方法，在私人存储终端和数据访问端之间建立一条临时、可信的穿透式UDP数据包传输直连链接通路；
(3)、利用所建立的临时穿透式直连UDP传输链接通路进行私人存储终端的数据访问。
优选地，所述私有数据云存储的实现方法还包括：
(0.1)初始化一个UDP socket；
(0.2)通过局域网广播发送该UDP socket；
(0.3)判断在预定时间内是否接收到响应消息，若接收到消息则判断所接收到的消息是否为本机发出的响应消息，若不是，则判定私人存储终端和数据访问端在相同的局域网内，建立双方局域网连接；
(0.4)若未收到响应消息或收到的响应消息为本机发出的响应消息，则进入所 述步骤(1)。
优选地，所述私有数据云存储的实现方法包括：
(1.1)发送预定数据包到第一远程服务器，并请求第一服务器返回本机地址；
(1.2)判断是否接收到第一远程服务器返回的本机地址，如果未接收到则提示用户网络不通无法通信；如果接收到则记录返回的IP记录，并且与本机的IP地址比较，如果相同，则判定本机IP为公网IP，如果不同，则判定本机连接在NAT之后，间接请求第二远程服务器发送数据到本地地址；
(1.3)判定是否收到第二远程服务器发送的数据，如果收到，则判定本机所在为Full Cone NAT结构网络；否则直接请求第二远程服务器将看见的本机地址发回，将该地址和所述第一远程服务器1记录的IP地址进行比较，如果二者地址不同，则判定本机所在网络为Symmetric NAT结构，如果二者地址相同，请求第二远程服务器改变端口发送数据到本机地址，如果本机接收到该数据，则判定本机处于Restricted Cone NAT结构网络，否则则判定本机处于Restricted Port NAT结构网络。
优选地，所述私有数据云存储的实现方法包括：
(2.1)若所述步骤(1.1)中UDP数据被阻塞，则告知用户通讯阻塞；
(2.2)若判断出本机为公网IP，则本机可以直接建立连接；
(2.3)若判断出本机处于Full Cone NAT结构网络，将本机地址和端口发送给所述第一远程服务器，经由所述第一远程服务器请求对端发送协议到本机，并基于对端协议与对端建立通信连接；
(2.4)若判断出本机处于Restricted Cone NAT结构网络，则发送协议到对端IP地址和端口，并且通知所述第一远程服务器本地地址和端口，请求对端发送协议到本地；
(2.5)若判断出本机处于Restricted Port NAT结构网络，如果对端也处于Restricted Port NAT结构网络，或者一端处在Symmetric NAT结构网络另一端处于公网以外的网络环境中，或者两端都处于Symmetric NAT结构网络，则通知用户无法建立直连连接，询问用户是否改变网络接入环境或者建立通过所述第一或第二远程服务器的中转式互联，否则，请求对端发送协议到本地，基于对端协议与对端直接建立通信连接。
优选地，所述私有数据云存储的实现方法包括：
(3.1)进行UDP监听，判断是否接收到对端发送的协议消息；
(3.2)若收到对端的协议消息，则与对端建立联系，否则返回步骤(3.1)；
(3.3)接收发送窗数据到本地缓存；
(3.4)判断数据是否超过窗口值，若超过则继续等待，否则发送数据到对端。
上述步骤(2.4)中，请求对端发送协议的过程包括：自己先发送协议包给对方，然后再通知服务器，让服务器通知对方给自己发一个协议包。
另一方面，本发明提供一种基于双服务器的私有数据云存储穿透式访问方法，包括下述步骤：
(1)通过分别在私人存储终端和数据访问端与远程服务器之间进行数据包传送方式，判断私人存储终端和数据访问端所处的网络接入类型；
(2)、基于所判断的网络接入类型，利用改进的UDP数据封包传输方法，在私人存储终端和数据访问端之间建立一条通过互联网的临时的穿透式点对点可信的UDP数据包传输直连通路；
(3)、利用所建立的UDP传输通路进行私人存储终端的数据访问，优选地，所述方法包括：通过采用第一服务器和第二服务器分别发送数据包的方式判断私人存储终端和数据访问端各自所在的网络类型。
优选地，所述方法还包括：
(0.1)初始化一个UDP socket；
(0.2)通过局域网广播发送该UDP socket；
(0.3)判断在预定时间内是否接收到响应消息，若接收到消息则判断所接收到的消息是否为本机发出的响应消息，若不是，则判定私人存储终端和数据访问端在相同的局域网内，建立双方局域网连接；
(0.4)若未收到响应消息或收到的响应消息为本机发出的响应消息，则进入所述步骤(1)，
优选地，所述方法包括：
若本机IP为非公网IP，间接请求第二远程服务器发送数据到本地地址；判定是否收到第二远程服务器发送的数据，如果收到，则判定本机所在为Full Cone NAT结构网络；否则直接请求第二远程服务器将看见的本机地址发回，将该地址和所述第一远程服务器1记录的IP地址进行比较，如果二者地址 不同，则判定本机所在网络为Symmetric NAT结构，如果二者地址相同，请求第二远程服务器改变端口发送数据到本机地址，如果本机接收到该数据，则判定本机处于Restricted Cone NAT结构网络，否则判定本机处于Restricted Port NAT结构网络。
优选地，所述的私有数据云存储穿透式访问方法，还包括：
(2.1)若所述步骤(1.1)中UDP数据被阻塞，则告知用户通讯阻塞；
(2.2)若判断出本机为公网IP，则本机可以直接建立连接；
(2.3)若判断出本机处于Full Cone NAT结构网络，将本机地址和端口发送给所述第一远程服务器，经由所述第一远程服务器请求对端发送协议到本机，并基于对端协议与对端直接建立通信连接；
(2.4)若判断出本机处于Restricted Cone NAT结构网络，则发送协议到对端IP地址和端口，并且通知所述第一远程服务器本地地址和端口，请求对端发送协议到本地，基于对端协议与对端直接建立通信连接；
(2.5)若判断出本机处于Restricted Port NAT结构网络，如果对端也处于Restricted Port NAT结构网络，或者一端处于Symmetric NAT结构网络另一端处于公网以外的网络环境中，或者两端都处于Symmetric NAT结构网络，则通知用户无法建立直连连接，询问用户是否改变网络接入环境或者建立通过所述第一或第二远程服务器的中转式互联，否则，请求对端发送协议到本地，基于对端协议与对端直接建立通信连接。
另一方面，本发明提供一种通过双服务器确定本机所处网络类型的方法，其特征在于，所述方法包括：
(2.1)判断UDP数据是否被堵塞，若被阻塞，则告知用户通讯阻塞；
(2.2)判断本机是否为公网IP，若判断出本机为公网IP，则本机可以直接建立连接；
(2.3)若判断出本机处于Full Cone NAT结构网络，将本机地址和端口发送给所述第一远程服务器，经由所述第一远程服务器请求对端发送协议到本机，并基于对端协议与对端建立通信连接；
(2.4)若判断出本机处于Restricted Cone NAT结构网络，则发送协议到对端IP地址和端口，并且通知所述第一远程服务器本地地址和端口，请求对端发送协议到本 地；
(2.5)若判断出本机处于Restricted Port NAT结构网络，如果对端也处于Restricted Port NAT结构网络，或者一端处在Symmetric NAT结构网络另一端处于公网以外的网络环境中，或者两端都处于Symmetric NAT结构网络，则通知用户无法建立直连连接，询问用户是否改变网络接入环境或者建立通过所述第一或第二远程服务器的中转式互联，否则，请求对端发送协议到本地，基于对端协议与对端直接建立通信连接。
需要说明的是本发明中的内部存储单元，既可以仅用来存储固有程序，又可以用作数据存储。优选地，其仅用作固有程序的存储，将数据存储在外接的私有数据存储设备上。
需要说明的是，本发明中提到的内部存储单元或外部存储介质可以采用相同或不同的通用标准接口，所述接口标准可选自CF接口、SM接口、MMC接口、SD接口、MS接口、PCMCIA接口，USB接口，USB OTG(USB On-The-GO)接口，IDE、SCSI接口、IEEE1394接口，SATA接口，PATA接口，SAS接口，Fiber Channel接口，ISA接口，PCI接口，PCIE系列标准接口，NAND系列，ONE-NAND系列接口，SPI接口，非标准接口并行数据地址接口；所述外部存储介质包括但不限于硬盘，移动硬盘，SD卡，Micro SD卡外部存储介质设备等。
私有数据云存储系统的内部存储介质单元，所述接口标准采用，半导体存储介质，磁介质，光介质，其中所述半导体存储介质选自FLASH、DRAM、SRAM、SDRAM、FRAM、MRAM、EPROM、EEPROM，NAND、EMMC、eMCP、One-NAND、SSD固态硬盘、所述磁介质包括，软盘，硬盘，移动硬盘，所述光介质选自CD-R、CD-RW、DVD-R、DVD-RW。
私人存储终端可以通过USB总线，SPI总线，SD总线，I2C总线，并行数据总线，并行地址总线，NAND连接总线与内部或者外部存储介质单元连接在一起构成整个云存储终端的数据存储空间。
上述私人存储终端可设计成可以大大小小方便携带的便携式结构，也可以设计成固定结构。上述私有数据云存储服务器具有相应的外型变换机制。
上述私有数据云存储系统可以通过以太网来通信，可以通过WIFI无线局域网来通信，也可以通过蓝牙、WiMAX、2G、3G、4G、5G移动标准来通信；上述私有数 据云存储系统上具有相应的有线无线通信方式变换机制。
本发明的数据访问模块作为数据访问端，其可以与通常云存储服务器的数据访问端基本相同，只是多了本发明的临时点对点穿透式直连通信链路构建功能，其可以通过与服务器的通信算法通过与服务器的配合建立起与相应私人存储终端的远程端到端直接访问连接技术，确保所述的数据访问模块和私人存储终端间的所有数据传输不经过中间服务器中转，确保数据传输的不可监控性和绝对私密特性。
本发明的系统和方法均可以包括用户认证和加密的功能，并且仅当所述客户端通过认证时，才允许客户对私人存储终端进行数据存储和传输操作。
采用本发明提供的私有数据云存储服务系统及相应方法，不仅实现了数据的远程控制、交换和存储，还能够对数据进行严格的加密传输和保护，保证数据的安全性和操作的合法性，可广泛应用于众多的行业领域作为提供最基础的数据云存储服务。
附图说明
图1是本发明实施例的私有数据云存储系统的结构框图；
图2是本发明实施例的软件(固件程序)的架构图和应用模型；
图3是本发明实施例中所采用的点对点(peer to peer)网络类型识别方法或步骤的流程图
图4是本发明实施例中所采用的点对点(peer to peer)连接方法或步骤的流程图
图5是本发明实施例中数据记录传输与处理过程中的信任UDP传输服务结构框图；
图6是本发明实施例中数据记录传输与处理过程中的代理服务结构框图；
图7是本发明实施例中数据记录传输与处理过程中的文件服务结构框图；
具体实施方式
以下结合附图及其实施例对本发明进行详细说明，以便于本领域技术人员的理解，但并不因此将本发明的保护范围限制在实施例描述的范围之中。
图1示出了本发明的实施例的私有数据云存储系统的结构框图。如图所示，该实施方案中的私有数据云存储系统100包括私人存储终端110、数据访问模块120和服务器130。
私人存储终端110是一个可移动设备也可以是固定设备，其可以自带存储也可以外接基本存储或扩展存储。私人存储终端110具有控制单元111、内部存储介质单元112和通信连接单元113。私人存储终端110的控制单元111可以由一片或多片集成电路芯片组成，私人存储终端110中的控制单元111用于终端中各个单元的协调工作，控制内部存储介质单元112和通信连接单元113进行数据存储和通信。通信连接单元用于与所述服务器130和所述数据访问模块120进行数据通信。
服务器130可以具有一台或多台计算机，用于承担私有数据云存储系统的所有计算、云计算以及协助120和110间搭建临时穿透式直连通信链路工作，甚至在当120和110间无法建立临时穿透式直连通信链路的环境下提供120和110间的传输数据中转服务。
本发明的私有数据云存储系统100为了满足在各种网络类型条件下均能够为私有数据终端110和数据访问模块120建立穿透式点对点直接连接的要求，服务器130包括第一服务器131和第二服务器132，这里的第一服务器和第二服务器可以是采用不同通信地址的同一台服务器的两个不同计算内核，也可以是位于不同网络地址的两台独立的服务器。
内部存储介质单元112可为控制单元111提供固件程序非易失性保存，此类非易失保存介质包括但不限于可编程程序存储介质或者电可擦除存储介质、快闪存储介质和磁性存储介质、铁磁存储介质、光存储介质等。在本发明的实施例中采了电可擦除存储介质。
私人数据终端110包括一个或者多个连接各种外部存储设备的接口，用于与一个或者多个数据存储设备或一种或者多种数据存储介质存储以及交换数据。控制单元111根据数据访问模块120的请求来完成数据的存入或者取出操作。
通信连接单元113包括但不限于可以与外接采用任何的连接方式，包括以太网，令牌环网，有线LAN局域网，WIFI无线局域网、光纤收发装置、蓝牙局域网，WiMAX无线网，Zigbee无线网等智能家居无线组网技术，包括但不限于TCP/IP等局域网，互联网通信协议标准。所述以太网的连接口包括但不限于RJ45，USB-RJ45，USB-c类以太网转换口等。
通信连接单元113进一步可以采用如下通信速率、频率和标准10M，100M， 1000M以及万兆以太网速，WIFI包括2.4G，5G，802.11abgn或802.11ac等。
图2示出了本发明的实施例的私有数据云存储系统的架构框图和各平台上的应用架构框图，这种架构图是在软件层面的，其是基于本发明系统的硬件而实施的；如图所示，该实施方案中的私有数据云存储服务系统架构框图一共分为5层，第一层是基于UDP协议的UDP层，是本发明的通信协议的最底层，它负责传输最原始的UDP数据包的，第二层是基于第一层UDP协议完成点对点双方相互建立连接，传输控制命令和数据的一层协议，第三层是基于点对点通信技术实现的可信任，可靠数据包的传输服务层，它保证了点对点双方传输的数据的完整性，确保点对点双方传输的控制命令和数据是100％完全正确的，它通过校验算法和重传机制来达到100％的可信度。第四层是基于可信UDP协议的之上的代理服务协议层，其主要是要给上层应用层提供标准TCP应用服务，使本发明既可以适用基于UDP协议的应用程序，也可以适用基于传输的TCP协议的已知的而且已经广泛使用的包括但不限于http,ftp,tftp,email等互联网应用协议，使本发明成为了一种通用的点对点连接服务的基础服务。第五层就是本发明私有数据云存储服务器的应用层，它实现了本私有数据云存储服务器的文件服务功能，为数据的云存储提供通信、控制、传输和管理等应用接口；本实施方案中的各平台上的应用架构框图示出了整个私有数据云存储服务器的应用程序、固件程序的开发支持SDK架构图，它是本发明系统及方法的核心应用模型，它是所有平台应用程序开发的关键指导架构，如图所示的通信双方是基于局域网或者互联网进行数据控制和传输，通信的双方可以在同一个网络内或者在不同地方、不同国家的互联网内，可以直接连接在公有ip地址上，也可以连接在家用包括但不限于ADSL这类的互联网接入设备上，也可以连接在有互联网连接的NAT设备后面等方式的组合。运行在通信双方上的应用程序大致分成对等的4个层次，上面两层实现的是基于TCP协议的应用层，下面两层是实现的是最基础的RUDP(可信UDP)传输层各平台上的应用架构框图，通信双方间数据的传输是完全基于RUDP协议(可信UDP协议)来完成。
图3示出了本发明的实施例的私有数据云存储系统及相应方法所采用的点对点(Peer to Peer)通信网络类型识别方法或步骤的流程框图；该方法和步骤分别在私人存储终端和数据访问模块上执行。
如图所示，算法从初始化UDP socket开始，建立了基本的udp socket后，首先发送数据到第一服务器，请求第一服务器131将其看见的本机地址发回，如果没有返回，判定UDP被阻塞了。如果返回了，将这个返回的IP记录下来，并且和本机的IP比较，如果不同，说明本机在NAT互联网接入设备(网络地址转换设备)后面，如果相同，说明本机是公网IP，这个情况对于P2P是友好的，可基于公网IP直接建立连接。如果检测出是在NAT的后面，就通知第一服务器131请求第二服务器132发送数据到本地地址，如果有收到返回数据，就可以判断出是本机处在Full Cone NAT结构网络，这种情况对于P2P是有友好的，可以建立点对点直接连接通信模式。否则的话，请求第二服务器132将看见的本机地址发回，将这个地址和上述第一服务器131记录的IP地址进行比较，如果不同的话，检测出本机所处网络为Symmetric NAT结构。如果相同的话，通知第二服务器132改变端口发送协议数据到本地地址，如果本机接收到了返回数据，就检测出本机所处网络是Restricted Cone NAT结构类型，这个类型可以建立P2P连接，否则的话就检测出本机所处网络是Restricted Port NAT结构类型。这样通过上述方式就可以判断出本机(数据访问模块或私人存储终端)所处的网络类型，以供后续建立临时通信连接链路使用。
图4示出了本发明的实施例的私有数据云存储系统及方法所采用的点对点(Peer to Peer)连接算法流程框图。该连接算法分别在数据访问模块和私人存储终端上执行。用户通过数据访问模块进行数据访问请求的生成和发送，以便进行数据云存储操作，私人存储终端存储数据并根据数据访问模块的访问请求进行相应的存取操作。
如图所示，算法首先初始化一个UDP socket，然后通过局域网发送广播消息，在预定的时间里，如果收到响应消息，并且判断出不是自己发出的响应消息，说明点对点通信双方在同一个局域网里面，接下来直接建立双方的局域网连接即可。如果未收到局域网回复消息，进入点对点NAT网络类型识别过程(图3中所示过程)，根据识别出的NAT类型分别进行相应的通信连接过程。如果检测出UDP包被阻塞，就通知用户设备所在的网络UDP网络服务被阻塞；如果检测出是公网IP，可以直接与对方进行通信；如果检测出是Full Cone的NAT类型，下一步就开始建立点对点通信连接服务，数据访问模块(也可以称之为客户端)或私人存储终端通知第一和/或第二服务器自己的地址和端口(通常情况下仅通知第一服务器即可)，收到响应后， 根据响应消息里面提供的对端地址和端口，等待对端发送消息过来，收到消息后，双方的点对点连接通路即建成，如果收不到消息，通知用户双方的点对点连接通路未建立成功。如果判断出所处网络是Restricted Cone NAT类型，接着发送协议到对端IP地址和端口，再通知服务器本地地址和端口，并请求对方发送协议到本地。如果收到对端的协议，表明点对点连接已经成功，如果收不到对端回复的消息，通知用户点对点连接建立失败；如果检测到的是Restricted Port NAT类型，则判断对端是否也处于Restricted Port NAT结构网络，若二者均处于Restricted Port NAT结构网络，则提醒用户，当前本机所处网络接入点无法建立直连连接，提示用户是否改变网络接入环境(改变至上述可以建立直接连接的网络类型)或者建立中转通信服务，通过第一或第二服务器中转双方传输的数据，或者改变网络接入环境；如果检测到的是Symmetric NAT类型，如果对端是处于公网以外的网络环境中，或者两端都处于Symmetric NAT结构网络，则直接提醒用户，当前本机所处网络接入点无法建立直连连接，询问用户是否改变网络接入环境或者建立中转通信服务，通过服务器中转双方传输的数据。
图5示出了本发明的实施例的私有数据云存储系统的数据记录传输处理方法中的可信任UDP算法流程框图；如图所示，可信UDP的发送也是一永久驻留线程程序，程序从初始化开始，初始化建立UDP Socket后，即进入UDP侦听过程，如果收到UDP消息判断出不是预定的消息，丢弃后回到侦听过程等待下一个UDP数据包的到来。如果收到的UDP消息包是预定的消息，在建立与对端的联系后，启动发送定时器，发送点对点心跳包，以及保持与服务器连接的心跳包，点对点对端过来的心跳包，并做相关的处理工作。
在建立了与点对点对端的联系后，接下来设置可信UDP发送的窗口值，并启动一个线程监听机制来动态调整窗口值来确保最大限度的发送数据或者动态调整发送的速率。设置完发送窗口值后，接下来如果有数据要发送的话就把数据发送到本地缓冲区，通过实时判断窗口值是否超过定义的窗口值，如果没有超过，就执行发送数据到对端的工作，如果窗口值已经超过就返回等待发送新的数据。
图6示出了本发明的实施例的私有数据云存储服务系统的数据记录传输与处理方法中的代理服务结构框图，代理服务主要用于完全兼容对端的TCP程序，程序 需要选定一个本地端口和对端端口匹配，当然如果在本地没有其他端口占有的情况下，也可以选择和远端端口一样的端口。如图所示，先期建立这个端口的TCP Listen，然后与对端建立起来可信的UDP通信。一旦成功后，会将这个TCP Listen中得到的Socket与这个可信UDP进行关联。这时候会启动两个线程，一个用于接收本地Socket的消息，另外一个用于接收可信UDP的消息。接收到本地Socket消息后，会将这个数据通过可信UDP发送给对端；接收到可信UDP的消息后会将这个消息通过Socket发送回去给TCP Listen作为收到的数据处理。
图7示出了本发明的实施例的私有数据云存储服务系统的数据记录的传输与处理方法中的文件服务结构框图；如图所示，本发明的文件服务是基于TCP协议而设计的，程序开始初始化完毕后即进入TCP消息的侦听过程，收到TCP相关的消息后，就开始进入文件服务指令的处理，确定是预定的正确的指令后，进入相应的指令处理流程，本发明的第一版设计的指令暂时包括：获取对应目录下面的目录以及文件指令、获取对应目录下面的文件指令、发送文件到对应目录的指令、删除对应目录下面的文件的指令、删除对应目录下面的目录的指令、新增对应目录下面的目录的指令、修改对应目录下面的文件名称指令、修改对应目录下面的目录名称的指令、获取对应目录下面的文件变化的指令，如图所示，所有这些指令的处理都采取同样的方法，指令执行完后，判断是否正确执行，正确的话就返回正确的消息，失败就返回失败的消息给出命令请求方，最后回到侦听状态等待下一条指令的到来，直接到设备关机。
本发明的私有云存储系统能够实现私有数据通过私有局域网，公共城域网、互联网远程上传，下载，同步，实时传输存储各种互联网参与者所产生和已经拥有的文件，图像，音视频数据到终端用户指定的存储介质上的互联网私有数据云存储服务技术，私人存储终端可以采用任意类型的存储介质作为数据存储载体，包括但不限于传统的磁盘，优盘，硬盘，移动硬盘，固态硬盘，光存储盘，CD盘，DVD盘，蓝光盘，各类存储卡TF卡，Micro SD卡，SD卡，CF卡，MMC，MMS，XD，CF，SmartMedia卡等，极大的方便了用户在移动互联网时代组建个人的私人云存储服务中心，使以往不适合移动设备使用的老式存储介质重新焕发生机。
虽然上面结合本发明的优选实施例对本发明的原理进行了详细的描述，本领域技术人员应该理解，上述实施例仅仅是对本发明的示意性实现方式的解释，并非对本发明包含范围的限定。实施例中的细节并不构成对本发明范围的限制，在不背离本发明的精神和范围的情况下，任何基于本发明技术方案的等效变换、简单替换等显而易见的改变，均落在本发明保护范围之内。

Claims (10)

  1. 一种基于双服务器的私有数据云存储穿透式访问方法，包括下述步骤：
    (1)通过分别在私人存储终端和数据访问端与远程服务器之间进行数据包传送方式，判断私人存储终端和数据访问端所处的网络接入类型；
    (2)、基于所判断的网络接入类型，利用改进的UDP数据封包传输方法，在私人存储终端和数据访问端之间建立一条通过互联网的临时的穿透式点对点可信的UDP数据包传输直连通路；
    (3)、利用所建立的UDP传输通路进行私人存储终端的数据访问，
    优选地，所述方法包括：通过采用第一服务器和第二服务器分别发送数据包的方式判断私人存储终端和数据访问端各自所在的网络类型。
  2. 根据权利要求1所述的私有数据云存储穿透式访问方法，其特征在于，所述方法还包括：
    (0.1)初始化一个UDP socket；
    (0.2)通过局域网广播发送该UDP socket；
    (0.3)判断在预定时间内是否接收到响应消息，若接收到消息则判断所接收到的消息是否为本机发出的响应消息，若不是，则判定私人存储终端和数据访问端在相同的局域网内，建立双方局域网连接；
    (0.4)若未收到响应消息或收到的响应消息为本机发出的响应消息，则进入所述步骤(1)，
    优选地，所述方法包括：
    若本机IP为非公网IP，间接请求第二远程服务器发送数据到本地地址；判定是否收到第二远程服务器发送的数据，如果收到，则判定本机所在为Full Cone NAT结构网络；否则直接请求第二远程服务器将看见的本机地址发回，将该地址和所述第一远程服务器1记录的IP地址进行比较，如果二者地址不同，则判定本机所在网络为Symmetric NAT结构，如果二者地址相同，请求第二远程服务器改变端口发送数据到本机地址，如果本机接收到该数据，则判定本机处于Restricted Cone NAT结构网络，否则判定本机处于Restricted Port NAT结构网络。
  3. 根据权利要求1所述的私有数据云存储穿透式访问方法，其特征在于，所述方法包括：
    (2.1)若所述步骤(1.1)中UDP数据被阻塞，则告知用户通讯阻塞；
    (2.2)若判断出本机为公网IP，则本机可以直接建立连接；
    (2.3)若判断出本机处于Full Cone NAT结构网络，将本机地址和端口发送给所述第一远程服务器，经由所述第一远程服务器请求对端发送协议到本机，并基于对端协议与对端直接建立通信连接；
    (2.4)若判断出本机处于Restricted Cone NAT结构网络，则发送协议到对端IP地址和端口，并且通知所述第一远程服务器本地地址和端口，请求对端发送协议到本地，基于对端协议与对端直接建立通信连接；
    (2.5)若判断出本机处于Restricted Port NAT结构网络，如果对端也处于Restricted Port NAT结构网络，或者一端处于Symmetric NAT结构网络另一端处于公网以外的网络环境中，或者两端都处于Symmetric NAT结构网络，则通知用户无法建立直连连接，询问用户是否改变网络接入环境或者建立通过所述第一或第二远程服务器的中转式互联，否则，请求对端发送协议到本地，基于对端协议与对端直接建立通信连接。
  4. 一种基于双服务器的私有数据云存储系统，其特征在于，所述云存储系统包括：
    私人存储终端、数据访问模块和服务器，
    所述私人存储终端具有控制单元、内部存储介质单元和通信连接单元，所述控制单元用于控制所述内部存储介质单元和通信连接单元进行数据存储和通信，所述通信连接单元用于与所述服务器和所述数据访问模块进行数据通信；
    数据访问模块用于生成数据访问请求对所述私人存储终端进行数据访问操作；
    所述服务器用于基于所述数据访问模块和所述私人存储终端所发送的数据建立所述数据访问模块和所述私人存储终端之间的直连通信连接，所述服务器包括第一远程服务器和第二远程服务器，所述第一远程服务器和第二远程服务器基于所述私人存储终端和数据访问模块所发送的数据包确定二者所处的网络类型，并且基于所述网络类型建立所述私人存储终端和数据访问模块之间通过互联网的临时的穿透式点对点直接访问通信连接链路。
  5. 根据权利要求4所述的私有数据云存储系统，其特征在于，确定所述私人存储终端和数据访问模块网络类型的过程包括分别从所述私人存储终端和数据访问模块向第一和第二远程服务器进行如下操作：
    (1.1)发送预定数据包到第一远程服务器，并请求第一远程服务器返回本机地址；
    (1.2)判断是否接收到第一远程服务器返回的本机地址，如果未接收到则提示用户网络不通无法通信；如果接收到则记录返回的IP记录，并且与本机的IP地址比较，如果相同，则判定本机IP为公网IP，如果不同，则判定本机连接在NAT之后，间接请求第二远程服务器发送数据到本地地址；(1.3)判定是否收到第二远程服务器发送的数据，如果收到，则判定本机所在为Full Cone NAT结构网络；否则直接请求第二远程服务器将看见的本机地址发回，将该地址和所述第一远程服务器记录的IP地址进行比较，如果二者地址不同，则判定本机所在网络为Symmetric NAT结构，如果二者地址相同，请求第二远程服务器改变端口发送数据到本机地址，如果本机接收到该数据，则判定本机处于Restricted Cone NAT结构网络，否则判定本机处于Restricted Port NAT结构网络所述私人存储终端和数据访问模块具有加密模块，所述加密模块用于对所传输数据进行加密，优选地，所述私人存储终端具有存储扩展接口，所述存储扩展接口与外部存储介质相连接，用以扩展所述私人存储终端的存储容量。
  6. 一种基于双服务器的私有数据云存储的实现方法，包括下述步骤：
    (1)通过分别从私人存储终端和数据访问端向远程服务器发送数据包的方式，判断私人存储终端和数据访问端所处的网络接入类型；
    (2)、基于所判断的网络接入类型，利用改进的UDP数据封包传输方法，在私人存储终端和数据访问端之间建立一条通过互联网的临时的穿透式点对点可信的UDP数据包传输直连通路；
    (3)、利用所建立的UDP传输通路进行私人存储终端的数据访问，
    优选地，所述步骤(1)包括：
    (1.1)发送预定数据包到第一远程服务器，并请求第一服务器返回本机地址；
    (1.2)判断是否接收到第一远程服务器返回的本机地址，如果未接收到则提示用户网络不通无法通信；如果接收到则记录返回的IP记录，并且与本机的IP地址比 较，如果相同，则判定本机IP为公网IP，如果不同，则判定本机连接在NAT之后，间接请求第二远程服务器发送数据到本地地址；
    (1.3)判定是否收到第二远程服务器发送的数据，如果收到，则判定本机所在为Full Cone NAT结构网络；否则直接请求第二远程服务器将看见的本机地址发回，将该地址和所述第一远程服务器记录的IP地址进行比较，如果二者地址不同，则判定本机所在网络为Symmetric NAT结构，如果二者地址相同，请求第二远程服务器改变端口发送数据到本机地址，如果本机接收到该数据，则判定本机处于Restricted Cone NAT结构网络，否则判定本机处于Restricted Port NAT结构网络。
  7. 根据权利要求6所述的私有数据云存储的实现方法，其特征在于，所述方法还包括：
    (0.1)初始化一个UDP socket；
    (0.2)通过局域网广播发送该UDP socket；
    (0.3)判断在预定时间内是否接收到响应消息，若接收到消息则判断所接收到的消息是否为本机发出的响应消息，若不是，则判定私人存储终端和数据访问端在相同的局域网内，建立双方局域网连接；
    (0.4)若未收到响应消息或收到的响应消息为本机发出的响应消息，则进入所述步骤(1)。
  8. 根据权利要求7所述的私有数据云存储的实现方法，其特征在于，所述方法包括：
    (2.1)若所述步骤(1.1)中UDP数据被阻塞，则告知用户通讯阻塞；
    (2.2)若判断出本机为公网IP，则本机可以直接建立连接；
    (2.3)若判断出本机处于Full Cone NAT结构网络，将本机地址和端口发送给所述第一远程服务器，经由所述第一远程服务器请求对端发送协议到本机，并基于对端协议与对端直接建立通信连接；
    (2.4)若判断出本机处于Restricted Cone NAT结构网络，则发送协议到对端IP地址和端口，并且通知所述第一远程服务器本地地址和端口，请求对端发送协议到本地，基于对端协议与对端直接建立通信连接；
    (2.5)若判断出本机处于Restricted Port NAT结构网络，如果对端也处于Restricted Port NAT结构网络，或者一端处于Symmetric NAT结构网络另一端处于公 网以外的网络环境中，或者两端都处于Symmetric NAT结构网络，则通知用户无法建立直连连接，询问用户是否改变网络接入环境或者建立通过所述第一或第二远程服务器的中转式互联，否则，请求对端发送协议到本地，基于对端协议与对端直接建立通信连接。
  9. 根据权利要求8所述的私有数据云存储的实现方法，其特征在于，所述方法还包括：
    (3.1)进行UDP监听，判断是否接收到对端发送的协议消息；
    (3.2)若收到对端的协议消息，则与对端建立联系，否则返回步骤(3.1)；
    (3.3)发送窗数据到本地缓存；
    (3.4)判断数据是否超过窗口值，若超过则继续等待，否则发送数据到对端。
  10. 一种通过双服务器确定本机所处网络类型的方法，其特征在于，所述方法包括：
    (2.1)判断UDP数据是否被堵塞，若被阻塞，则告知用户通讯阻塞；
    (2.2)判断本机是否为公网IP，若判断出本机为公网IP，则本机可以直接建立连接；
    (2.3)若判断出本机处于Full Cone NAT结构网络，将本机地址和端口发送给所述第一远程服务器，经由所述第一远程服务器请求对端发送协议到本机，并基于对端协议与对端建立通信连接；
    (2.4)若判断出本机处于Restricted Cone NAT结构网络，则发送协议到对端IP地址和端口，并且通知所述第一远程服务器本地地址和端口，请求对端发送协议到本地；
    (2.5)若判断出本机处于Restricted Port NAT结构网络，如果对端也处于Restricted Port NAT结构网络，或者一端处在Symmetric NAT结构网络另一端处于公网以外的网络环境中，或者两端都处于Symmetric NAT结构网络，则通知用户无法建立直连连接，询问用户是否改变网络接入环境或者建立通过所述第一或第二远程服务器的中转式互联，否则，请求对端发送协议到本地，基于对端协议与对端直接建立通信连接。
PCT/CN2018/083237 2017-04-24 2018-04-16 一种私有数据云存储系统及私有数据云存储方法 WO2018196643A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710271251.7 2017-04-24
CN201710271251.7A CN107071039B (zh) 2017-04-24 2017-04-24 一种私有数据云存储系统及私有数据云存储方法

Publications (1)

Publication Number Publication Date
WO2018196643A1 true WO2018196643A1 (zh) 2018-11-01

Family

ID=59603542

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/083237 WO2018196643A1 (zh) 2017-04-24 2018-04-16 一种私有数据云存储系统及私有数据云存储方法

Country Status (2)

Country Link
CN (3) CN107071039B (zh)
WO (1) WO2018196643A1 (zh)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107071039B (zh) * 2017-04-24 2017-12-12 深圳至上移动科技有限公司 一种私有数据云存储系统及私有数据云存储方法
CN107766176A (zh) * 2017-09-14 2018-03-06 北京春鸿科技有限公司 一种数据存取方法及系统
CN108521449B (zh) * 2018-03-22 2020-05-05 于洋 网络设备操作记录异地备份方法和系统
US10592363B2 (en) * 2018-06-04 2020-03-17 International Business Machines Corporation Asynchronous remote mirror cloud archival
CN110611693A (zh) * 2018-06-15 2019-12-24 上海宽翼通信科技股份有限公司 一种基于私有云的在线存储方法、系统及私有云客户端
EP3793159A1 (de) * 2019-09-10 2021-03-17 Connexcom Ag Zugangssteuerung für private nachrichten
CN112152992A (zh) * 2020-07-21 2020-12-29 北京天顶星智能信息技术有限公司 一种端到端的数据安全传输网络通信方法及装置
CN111935290B (zh) * 2020-08-14 2023-07-21 易联众信息技术股份有限公司 一种基于智联网的分布式数据管理系统
CN112115495A (zh) * 2020-09-25 2020-12-22 平安国际智慧城市科技股份有限公司 可离线云端数据存储方法、系统、计算机设备及存储介质
CN112367715A (zh) * 2020-10-27 2021-02-12 Tcl通讯（宁波）有限公司 一种数据传输方法、装置、设备及存储介质
CN112447291B (zh) * 2020-11-23 2023-03-28 四川大学华西医院 基于区块链的医联体数据之间的共享方法
CN113468553B (zh) * 2021-06-02 2022-07-19 湖北工业大学 一种面向工业大数据的隐私保护分析系统及方法
CN113542414A (zh) * 2021-07-16 2021-10-22 深圳市广联智通科技有限公司 一种网络摄像机的数据存储方法
CN115499410B (zh) * 2022-07-29 2023-06-23 天翼云科技有限公司 基于Linux的NAT穿透方法、装置、设备及存储介质

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1863157A (zh) * 2005-10-28 2006-11-15 华为技术有限公司 穿越nat实现网络通信的方法及装置
CN102196057A (zh) * 2010-03-03 2011-09-21 腾讯科技（深圳）有限公司 一种确定nat类型的方法及装置
US8041835B2 (en) * 2007-04-24 2011-10-18 Sony Computer Entertainment Inc. Network address translation type for flexible neighbor selection in overlay networks
CN102739815A (zh) * 2011-06-03 2012-10-17 北京天地互连信息技术有限公司 减小视频会议系统网络地址转换穿越的系统时延的方法
CN104378410A (zh) * 2014-09-30 2015-02-25 东莞市联讯系统科技有限公司 一种微型私有云存储、传输的系统及方法
CN106210092A (zh) * 2016-07-19 2016-12-07 天彩电子（深圳）有限公司 一种融合upnp及stun的p2p穿越方法及其系统
CN107071039A (zh) * 2017-04-24 2017-08-18 深圳至上移动科技有限公司 一种私有数据云存储系统及私有数据云存储方法

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7599370B1 (en) * 2002-05-07 2009-10-06 Cisco Technology, Inc. Methods and apparatus for optimizing NAT traversal in Mobile IP
AU2002951013A0 (en) * 2002-08-27 2002-09-12 Sunbay Software Ag System for improved network data access
CN100469022C (zh) * 2006-05-29 2009-03-11 腾讯科技（深圳）有限公司 一种检测网络类型的方法及系统
US9569771B2 (en) * 2011-04-29 2017-02-14 Stephen Lesavich Method and system for storage and retrieval of blockchain blocks using galois fields
CN105430066A (zh) * 2015-11-06 2016-03-23 浪潮软件集团有限公司 一种基于p2p技术的税控设备互联方法
CN105610999A (zh) * 2016-03-30 2016-05-25 上海斐讯数据通信技术有限公司 一种通过穿透nat实现p2p通信的方法、设备、服务器及系统

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1863157A (zh) * 2005-10-28 2006-11-15 华为技术有限公司 穿越nat实现网络通信的方法及装置
US8041835B2 (en) * 2007-04-24 2011-10-18 Sony Computer Entertainment Inc. Network address translation type for flexible neighbor selection in overlay networks
CN102196057A (zh) * 2010-03-03 2011-09-21 腾讯科技（深圳）有限公司 一种确定nat类型的方法及装置
CN102739815A (zh) * 2011-06-03 2012-10-17 北京天地互连信息技术有限公司 减小视频会议系统网络地址转换穿越的系统时延的方法
CN104378410A (zh) * 2014-09-30 2015-02-25 东莞市联讯系统科技有限公司 一种微型私有云存储、传输的系统及方法
CN106210092A (zh) * 2016-07-19 2016-12-07 天彩电子（深圳）有限公司 一种融合upnp及stun的p2p穿越方法及其系统
CN107071039A (zh) * 2017-04-24 2017-08-18 深圳至上移动科技有限公司 一种私有数据云存储系统及私有数据云存储方法

Also Published As

Publication number Publication date
CN108063817A (zh) 2018-05-22
CN108063816A (zh) 2018-05-22
CN107071039A (zh) 2017-08-18
CN108063817B (zh) 2021-05-14
CN107071039B (zh) 2017-12-12
CN108063816B (zh) 2021-05-18

Similar Documents

Publication Publication Date Title
WO2018196643A1 (zh) 一种私有数据云存储系统及私有数据云存储方法
US10484806B2 (en) Managing audio output through an intermediary
WO2021063059A1 (zh) 一种组网方法、装置、蓝牙设备及计算机可读介质
TW202014878A (zh) 區塊鏈節點服務部署方法、裝置、系統、計算設備及媒介
US8305893B2 (en) Quality of service management for home-to-home connections
US20150009862A1 (en) Wireless Network Connection Establishment Method and Terminal Device
WO2020056558A1 (zh) 一种蓝牙集群在线升级方法及装置
JP2014503141A (ja) リモートパーティ間の通信のサードパーティ開始
WO2014135050A1 (zh) 消息处理方法、装置、网关、机顶盒及网络电视系统
US20210314407A1 (en) Method And Apparatus To Implement A Home Computing Cloud
TWM462408U (zh) 具自主備份能力的無線儲存裝置與無線儲存系統
US20150349971A1 (en) Proximity-based conference session transfer
US10374946B2 (en) Centralized wireless network management system
WO2017041660A1 (zh) 一种路由器远程管理方法、系统和设备
WO2014110855A1 (zh) 一种数据传输的方法及终端
WO2012151994A1 (zh) 资源下载方法、装置及系统
WO2019184262A1 (zh) 多类型媒体数据网络地址转换穿越方法、终端及系统
US10855805B2 (en) Centralized storage-connected switch port auto-configuration system
WO2018196463A1 (zh) 网络接入方法、装置、存储介质及处理器
CN113794996B (zh) 设备通信、设备控制方法、装置、电子设备和存储介质
WO2015139401A1 (zh) 无线网络的建立方法、系统及无线路由装置
WO2024067757A1 (zh) 基于总线的跨端通信的设备管理方法、系统、装置及介质
WO2016029854A1 (zh) 一种无线网络连接方法、设备及系统
WO2011026367A1 (zh) 服务质量参数的配置方法以及远程访问服务器和系统
WO2017107650A1 (zh) 一种实现路由器之间带宽共享的方法和路由器

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18790769

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18790769

Country of ref document: EP

Kind code of ref document: A1