Big data batch sharing exchange system
Technical Field
The invention relates to the field of big data sharing, in particular to a big data batch sharing and exchanging system.
Background
The big data exists in the fields of physics, biology, environmental ecology and the like and the industries of military, finance, communication and the like for a long time, but attracts people's attention due to the development of the internet and the information industry in recent years. Big data is as a still great subversive technical revolution of IT industry after cloud computing, thing networking. Cloud computing mainly provides places and channels for data assets to be stored and accessed, and data is really valuable assets. The amount of the business transaction information in the enterprise, the commodity logistics information in the internet world, the human-to-human interaction information, the position information and the like in the internet world far surpasses the bearing capacity of the existing enterprise IT framework and infrastructure, and the real-time requirement greatly surpasses the existing computing capacity. How to keep alive the data assets is a core issue of big data and is also an inherent soul and inevitable upgrading direction of cloud computing, so that the data assets can serve national governance, enterprise decision making and personal life service.
Data islands are easy to appear when data are organized and shared in all the gates, so that the data cannot be shared, the data are scattered, and the data are not easy to manage. Therefore, the invention discloses a platform which can enable all departments to share and exchange data, and realizes batch sharing of data.
Disclosure of Invention
The technical problem to be solved by the present invention is to provide a large data batch sharing and exchanging system, which is characterized in that: the system comprises a central switching system and a central backup device; the central exchange system takes the central server as a carrier to carry out the sharing and exchange work of the big data.
The data sharing and exchanging steps of the central exchanging system are as follows:
step S10: extracting a department database directory and uploading the department database directory to a central switching system;
step S20: setting a sharing exchange mode of gate data, and distinguishing access rights through the sharing exchange mode; the sharing exchange mode is divided into: a direct shared exchange mode and an authorized shared exchange mode;
step S30A: in the direct sharing exchange mode, the departments have no hierarchical relationship, and step S40A is executed;
step S40A: when the department releases the shared data in a direct exchange mode, other departments can directly carry out data sharing exchange on the department through a data exchange bus or an API;
step S30B: in the authorized sharing exchange mode, the departments have a multi-level up-down relationship, and step S40B is executed;
step S50B: when the department issues the sharing mode as authorized sharing, the low-level department needs to request authorization from the central exchange system when accessing the data of the department;
step S50B: the department is authorized to share the exchange data with the accessed department. The department service database can initiate a request for shared exchange of data through the data exchange gateway, and the shared exchange center selects a data exchange bus or a central database as an access path through an instruction for the data exchange gateway to access;
the shared switching center provides an API service control center and provides access interfaces for internal departments and external departments of the organization by providing a database API; when an outside authority accesses data through the API, the API service gateway makes it access desensitized data.
The process of step S10 includes:
step S101: carrying out quantization processing on the text data information;
step S102: extracting features of data information vectorization using NLP-based tools;
step S103: calculating the similarity of data characteristics, and clustering the data by using an unsupervised clustering algorithm;
step S104: and extracting the data features of the weight work as a data catalogue.
Further, the central backup device, hold the box, the hard disk is loaded the device including the hard disk, the hard disk is loaded the device and is installed and hold the box lower extreme at the hard disk, insert reading device and install and hold the box front end at the hard disk, hard disk reading device installs and holds the box front end at the hard disk, its characterized in that: the hard disk filling device protects the hard disks from stably falling one by one, inserts the hard disk reaching the designated position into the hard disk inserting and reading device of the reader, and is used for reading the content of the hard disk and pulling out the hard disk to push away the hard disk after reading; the hard disk reading device comprises a rotary buckle, one end of the rotary buckle is provided with a side push plate for transversely pushing the hard disk, the rear end of the side push plate is provided with a hydraulic device, the other end of the side push plate is provided with a protection frame fixing buckle for limiting the rotation of the side hard disk protection frame, the hydraulic device pushes the side push plate during working, the side push plate pushes the hard disk and drives the rotary buckle to move, and the rotary buckle drives the protection frame fixing buckle to release the limitation of the protection frame fixing buckle on the side protection frame, so that the hard disk is pushed out.
Furthermore, the hard disk bearing box comprises a sliding bottom plate which plays a supporting role at the bottom, a sliding rail which provides sliding for the hard disk is arranged on the sliding bottom plate, the sliding bottom plate is provided with a hard disk loader used for loading the hard disk, and a hydraulic device used for pushing the hard disk is arranged at the rear end of the hard disk loader.
Furthermore, the hard disk filling device comprises a filling circumference buffer belt which is rotatably arranged on the bottom plate and used for protecting the hard disk from descending, a filling circular shaft drive for driving the filling circumference buffer belt is arranged at the lower end of the filling circumference buffer belt, a filling fixing for protecting the filling circular shaft fixing is fixedly arranged at the fixed rear end of the filling circular shaft, and a filling protection spring is arranged on the filling fixing.
Furthermore, the hard disk inserting and reading device comprises a rotating hydraulic rod, a rotating push rod is installed at the front end of the rotating hydraulic rod, a rotating push plate used for pushing a hard disk is arranged at the front end of the rotating push rod, when the rotating hydraulic rod pushes the rotating push rod to move, the push plate rotates to achieve the purpose of pushing the hard disk inserting and reading, and a rotating protection spring is installed on the side edge of the rotating push rod to protect the rotating push rod from torsion increase during rotation.
Furthermore, the rotating pushing rod is internally and rotatably provided with a rotating column, the rotating column is provided with spiral concave grains, a convex rod is fixedly arranged outside the rotating pushing rod, and one part of the convex rod is arranged inside the rotating pushing rod and is meshed with the spiral concave grains on the rotating column, so that the rotating column can rotate simultaneously when moving forwards.
Furthermore, the hard disk reading device also comprises a reading bottom plate arranged on the hard disk bearing box, a side drive used for driving a side push plate is arranged on the reading bottom plate, the reading bottom plate used for pushing out the reading hard disk is slidably arranged on a reading bent frame, the reading bent frame is arranged on the reading bottom plate, an upper end fixing plate used for providing sliding limitation for a protection frame fixing buckle is slidably arranged on the protection frame fixing buckle, and the upper end fixing plate is fixedly arranged on the sliding bottom plate.
The working principle of the central backup device of the invention is as follows: when the hard disk inserting and reading device works, a hard disk placed in a hard disk loading device is placed on a sliding rail on a sliding bottom plate in a decelerating mode, the hard disk is pushed to a proper position by the driving of a pushing hydraulic shaft, a rotating hydraulic rod pushes a rotating push rod to rotate to move forwards, a rotating push plate is made to rotate to push the hard disk to insert and read, when the inserting and reading are completed, the reading push shaft moves to push the hard disk to be extracted from a reading port, a side push plate pushes the hard disk forwards, the rotating rotary buckle is driven to rotate when the side push plate moves, a protection frame fixing buckle on the rotating rotary buckle moves backwards, a fastening buckle at the lower end of the protection frame fixing buckle is made to be opened, a side hard disk protection frame can move, and the side push plate pushes the hard disk to open the side hard disk protection frame to push the hard disk.
Compared with the prior art, the invention has the beneficial effects that: (1) the data of all the departments in the organization are shared through the central exchange system, so that the data cooperativity is improved, and a data isolated island is avoided; (2) the invention improves the flexibility of data sharing and exchanging by setting two sharing modes; (3) the hard disk filling device arranged by the central backup device has the function of slowing down the descending speed of the hard disk, so that damage caused by over-high speed in the descending process of the hard disk is protected; (4) the hard disk reading device provided by the invention has the function of automatically taking down the hard disk, and the read hard disk is automatically taken out when the reading is finished, so that the working efficiency is improved.
Drawings
FIG. 1 is a flow chart of the data sharing exchange process of the present invention.
FIG. 2 is a block diagram of inter-department data sharing in accordance with the present invention.
FIG. 3 is a flow chart of a database directory extraction process according to the present invention.
Fig. 4 is a schematic diagram of the overall structure of the central backup device of the present invention.
FIG. 5 is a schematic diagram of a hard disk cartridge according to the present invention.
FIG. 6 is a schematic view of the hard disk filing apparatus of the present invention.
FIG. 7 is a schematic structural diagram of a hard disk read-in device f according to the present invention.
FIG. 8 is a schematic structural diagram of a hard disk reading apparatus according to the present invention.
Detailed Description
In the following description of the present invention, it is to be noted that the terms "upper", "lower", "front", "rear", "left", "right", "top", "bottom", "inner", "outer", and the like indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience of description and simplicity of description, but do not indicate or imply that the device or element being referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus, should not be construed as limiting the present invention.
In the following description of the present invention, it is to be noted that, unless otherwise explicitly specified or limited, the terms "mounted," "disposed," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; the connection may be direct or indirect via an intermediate medium, and the connection may be internal to the two components. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.
Example (b): a big data batch sharing exchange system is characterized in that: the system comprises a central switching system and a central backup device; the central exchange system takes the central server as a carrier to carry out the sharing and exchange work of the big data.
The data sharing and exchanging steps of the central exchanging system are as follows:
step S10: extracting a department database directory and uploading the department database directory to a central switching system;
step S20: setting a sharing exchange mode of gate data, and distinguishing access rights through the sharing exchange mode; the sharing exchange mode is divided into: a direct shared exchange mode and an authorized shared exchange mode;
step S30A: in the direct sharing exchange mode, the departments have no hierarchical relationship, and step S40A is executed;
step S40A: when the department releases the shared data in a direct exchange mode, other departments can directly carry out data sharing exchange on the department through a data exchange bus or an API;
step S30B: in the authorized sharing exchange mode, there are multiple levels of context between departments, and step S30B is executed;
step S40B: when the department issues the sharing mode as authorized sharing, the low-level department needs to request authorization from the central exchange system when accessing the data of the department;
step S50B: the department is authorized to share the exchange data with the accessed department. Furthermore, the department service database can initiate a request for shared exchange of data through the data exchange gateway, and the shared exchange center selects a data exchange bus or a central database as an access path through an instruction for the data exchange gateway to access;
the shared switching center provides an API service control center and provides access interfaces for internal departments and external departments of the organization by providing a database API; when an outside authority accesses data through the API, the API service gateway makes it access desensitized data.
In the embodiment of the present invention, the specific implementation process of step S10 includes:
step S101: performing quantization processing on text data information, and extracting an upper-layer directory stored by digital data when the content relates to the digital data until the content is described by a text;
step S102: extracting the vectorized feature of the data information by using an NLP-based tool, enabling the text data vector to enter the NLP tool, and performing word segmentation by using a corpus so as to extract the text feature; step S103: calculating the similarity of data characteristics, clustering the data by using an unsupervised clustering algorithm, gathering the same categories according to different types stored in each department database during clustering, and distributing the weight according to the proportion;
step S104: and extracting the data features with high weight as a data directory, wherein the data directory comprises description information and indexes of the data in the department database.
In the embodiment of the invention, the central backup device is used for carrying out physical backup work on the data of the central database, and because most of current data are backed up in the hard disk, when people manually maintain the backup, the mode of manually inserting and reading the hard disk is complicated and waste manpower, so the central backup device is used for completing the backup work in the embodiment.
Further, referring to fig. 4, the central backup apparatus includes a hard disk receiving box 1, and hard disk loading devices 2 installed on both sides of the hard disk receiving box 1 for reducing the descending speed of the hard disk, a hard disk insertion and reading device 3 installed at the middle end of the hard disk receiving box 1 for inserting the hard disk into a reading port, and a hard disk reading device 4 installed at the front end of the hard disk receiving box 1 for reading and unloading the hard disk.
Referring to fig. 5, the hard disk cartridge 1 includes a sliding bottom plate 101 with a bottom as a mounting platform, a hard disk sliding track is disposed on the sliding bottom plate 101, a pushing hydraulic shaft 102 for pushing a hard disk is disposed at a rear end of the sliding bottom plate 101, a hard disk loader 104 is disposed at an upper end of the sliding bottom plate 101, and when the hard disk falls from the hard disk loader 104 to the sliding bottom plate 101, the hard disk is located in a sliding slot of the sliding bottom plate 101, the pushing hydraulic shaft 102 moves to drive the hard disk to move in the sliding slot of the sliding bottom plate 101, so that the hard disk reaches an accurate position.
Referring to fig. 6, the hard disk loading device 2 includes a loading bracket 201 installed on the sliding bottom plate 101 for fixing the hard disk loading device 2, a loading fixture 202 is installed on the loading bracket 201, a loading protection spring 203 for protecting the user from moving is installed on the loading fixture 202, a loading circular shaft fixture 204 is installed at the front end of the loading fixture 202, a loading circular buffer belt 206 for relieving the descending speed of the hard disk is installed on the loading circular shaft fixture 204, a loading circular shaft driver 205 for driving the loading circular buffer belt 206 is installed at the lower end of the loading circular buffer belt 206, when the circular buffer belt 206 is loaded by the hard disk, the loading circular shaft driver 205 drives the loading circular buffer belt 206 to slowly rotate to control the moving speed of the hard disk, so that the hard disk is loaded and descended onto the sliding bottom plate 101.
Referring to fig. 7, the hard disk plug-in reading device 3 includes a plug-in reading fixture 301 installed on the sliding bottom plate 101, a notch is provided in the middle section of the plug-in reading fixture 301, a rotation protection spring 302 is installed in the notch, a protection spring is installed on the rotation protection spring 302, a rotation pushing rod 305 is installed at the other end of the spring, the rotation pushing rod 305 slides in the notch, a rotation shaft is installed inside the rotation pushing rod 305, a spiral concave line is provided on the rotation shaft, a convex shaft is installed outside the rotation pushing rod 305, the convex shaft is engaged with the spiral concave line of the rotation column, when the rotation column is pushed to move in advance, the convex shaft is engaged to make the rotation rod move forward and rotate, a rotation hydraulic rod 304 for driving the rotation pushing rod 305 is installed at one end of the rotation pushing rod 305, a rotation pushing plate 306 for pushing the hard disk is installed at the other end of the rotation pushing rod 305 to rotate together with the rotation pushing rod 305, when the hard disk reaches a certain position, the rotary pushing rod 305 is pushed by the rotary hydraulic rod 304, the rotary column inside the rotary pushing rod 305 rotates to move forwards, the rotary pushing plate 306 is driven to rotate to push the hard disk to be inserted, and the spring on the rotary protection spring 302 protects the rotary pushing rod 305 and the rotary hydraulic rod 304 from damaging the hard disk if a fault occurs in the process of rotationally pushing the hard disk.
Referring to fig. 8, the hard disk reading apparatus 4 includes a reading base plate 401 mounted on the side of the sliding base plate 101, an upper end fixing plate 402 is mounted on the reading base plate 401, a rectangular hole is formed on the upper end fixing plate 402, a reading bent frame 403 for supporting the reading drive is mounted on the reading base plate 401, a reading pushing shaft 404 for pulling out the reading hard disk is disposed on the upper end of the reading bent frame 403, a side hard disk protection frame 405 for protecting the hard disk from falling off is rotatably mounted on the lower end of the upper end fixing plate 402, a rotating buckle bracket 408 is fixed on the reading base plate 401, a protection frame fixing buckle 406 for limiting the rotation of the side hard disk protection frame 405 is disposed on the rotating buckle bracket 408, the protection frame fixing buckle 406 is rotatably mounted on a rotating buckle 407 for driving the protection frame fixing buckle 406, the rotating buckle 407 is fixedly mounted on the rotating buckle bracket 408, one end of the protection frame fixing buckle 406 is slidably mounted in the upper end fixing plate 402, one end of a protection frame fixing buckle 406 is fixedly installed on a side push plate 410 used for pushing a hard disk to pop up, a side push plate fixing 409 is arranged behind the side push plate 410, the side push plate fixing 409 is fixedly installed on a reading bottom plate 401 and used for driving the side push plate 410 to push, when the hard disk is read completely, a reading push shaft 404 is taken to push the hard disk to be pulled out from a reading port, the side push plate 410 moves forwards to push the hard disk, meanwhile, the side push plate 410 drives a rotating rotary buckle 407 to rotate, the rotating rotary buckle 407 drives the protection frame fixing buckle 406 to move, the protection frame fixing buckle 406 slides out from an upper end fixing plate 402, the protection frame fixing buckle 406 is in limited contact with a buckle of the side hard disk protection frame 405, and the side hard disk protection frame 405 rotates on the upper end fixing plate 402 to open a notch so that the read hard disk is pushed out by the side push plate 410 to automatically take out the hard disk.
It should be understood that the above embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same, and those skilled in the art can modify the technical solutions described in the above embodiments, or make equivalent substitutions for some technical features; and all such modifications and alterations are intended to fall within the scope of the appended claims.