Big data batch sharing exchange system
Technical Field
The invention relates to the field of big data sharing, in particular to a big data batch sharing exchange system.
Background
"big data" has been a popular day in the fields of physics, biology, environmental ecology, etc. and industries such as military, finance, communication, etc., but has been attracting attention due to the development of the internet and information industries in recent years. Big data is used as a technical revolution of still another subversion of the IT industry after cloud computing and Internet of things. Cloud computing primarily provides places and channels for custody, access to data assets, which are truly valuable assets. The amount of business information in enterprises, commodity logistics information in the Internet world, human-to-human interaction information, position information and the like in the Internet world far exceeds the carrying capacity of the IT architecture and the infrastructure of the existing enterprises, and the real-time requirement also greatly exceeds the existing computing capacity. How to live these data assets makes them a national governance, enterprise decision and even personal life service, which is a core issue of big data and is also an inherent soul and necessary upgrade direction of cloud computing.
The data island easily appears when the organization shares data in each department, so that the data cannot be shared, the data is distracted, and the management is not easy. The invention discloses a platform which can enable all departments to share and exchange data so as to realize batch sharing of the data.
Disclosure of Invention
Aiming at the defects in the prior art, the technical problem to be solved by the invention is that a large data batch sharing exchange system is characterized in that: the system comprises a central switching system and a central backup device; the central exchange system takes a central server as a carrier to carry out sharing exchange work of big data.
The data sharing and exchanging steps of the central exchanging system are as follows:
step S10: extracting a department database catalog and uploading the department database catalog to a central exchange system;
step S20: setting a sharing exchange mode of department data, and distinguishing access rights through the sharing exchange mode; the shared switching mode is divided into: a direct sharing exchange mode and an authorized sharing exchange mode;
step S30A: in the direct sharing exchange mode, departments have no hierarchical relationship, and step S40A is executed;
step S40A: when the department issues shared data in a direct exchange mode, other departments can directly conduct data sharing exchange on the department through a data exchange bus or an API;
step S30B: in the authorized sharing exchange mode, the departments have a multi-level up-down relationship, and step S40B is executed;
step S50B: when the department release sharing mode is authorized sharing, the low-level department needs to request authorization from the central exchange system when accessing the department data;
step S50B: the department is authorized to share exchange data with the accessed department. The department service database can make a request for initiating data sharing exchange through the data exchange gateway, and the sharing exchange center selects a data exchange bus or a central database as an access way through an instruction to be accessed by the data exchange gateway;
the shared switching center provides an API service control center and provides access interfaces for an organization internal department and an organization external department by providing a database API; when an external department accesses data through an API, the API service gateway makes it access the desensitized data.
The process of step S10 includes:
step S101: carrying out quantization processing on the text data information;
step S102: extracting features of vectorization of data information using an NLP-based tool;
step S103: calculating the feature similarity of the data, and clustering the data by using an unsupervised clustering algorithm;
step S104: and extracting the data characteristics of the weight as a data catalog.
Further, the central backup device comprises a hard disk bearing box and a hard disk filling device, the hard disk filling device is arranged at the lower end of the hard disk bearing box, the plug-in reading device is arranged at the front end of the hard disk bearing box, and the hard disk reading device is arranged at the front end of the hard disk bearing box, and is characterized in that: the hard disk loading device protects the hard disks to stably fall down one by one, inserts the hard disks reaching the designated positions into the hard disk inserting and reading device of the reader, and is used for reading the content of the hard disks and pulling out the hard disks to push away the hard disks after the hard disks are read; the hard disk reading device comprises a rotary button, wherein one end of the rotary button is provided with a side push plate for transversely pushing the hard disk, the rear end of the side push plate is provided with a hydraulic device, the other end of the side push plate is provided with a protection frame fixing button for limiting the rotation of a side hard disk protection frame, the hydraulic device pushes the side push plate during working, the side push plate drives the rotary button to move while pushing the hard disk, and the rotary button drives the protection frame fixing button to enable the protection frame fixing button to release the limitation on the side protection frame, so that the hard disk is pushed out.
Further, the hard disk bearing box comprises a sliding bottom plate with a supporting function at the bottom, a track for providing sliding for the hard disk is arranged on the sliding bottom plate, the sliding bottom plate is provided with a hard disk loading device for loading the hard disk, and the rear end of the hard disk loading device is provided with a hydraulic device for pushing the hard disk.
Further, the hard disk filling device comprises a filling circumferential buffer belt which is rotatably arranged on the bottom plate and used for protecting the hard disk from descending, a filling circular shaft drive which drives the filling circumferential buffer belt is arranged at the lower end of the filling circumferential buffer belt, a filling fixing which is used for protecting the filling circular shaft to be fixed is fixedly arranged at the fixed rear end of the filling circular shaft, and a filling protection spring is arranged on the filling fixing.
Further, the hard disk inserting and reading device comprises a rotating hydraulic rod, a rotating pushing rod is arranged at the front end of the rotating hydraulic rod, a rotating pushing plate for pushing the hard disk is arranged at the front end of the rotating pushing rod, when the rotating hydraulic rod pushes the rotating pushing rod to move, the pushing plate rotates to realize the inserting and reading of pushing the hard disk, and a rotating protection spring is arranged on the side edge of the rotating pushing rod to protect the rotating pushing rod from rotating, so that torsion can be increased.
Further, the rotary column is rotatably arranged on the rotary pushing rod, spiral concave patterns are formed in the rotary column, a convex rod is fixedly arranged outside the rotary pushing rod, and one part of the convex rod is arranged inside the rotary pushing rod and meshed with the spiral concave patterns on the rotary column, so that the rotary column rotates simultaneously when moving forwards.
Further, the hard disk reading device further comprises a reading bottom plate arranged on the hard disk bearing box, a side driver for driving the side push plate is arranged on the reading bottom plate, the reading bottom plate for pushing out the reading hard disk is slidably arranged on the reading bending frame, the reading bending frame is arranged on the reading bottom plate, an upper end fixing plate for providing sliding limitation for the protection frame fixing buckle is slidably arranged on the protection frame fixing buckle, and the upper end fixing plate is fixedly arranged on the sliding bottom plate.
The working principle of the central backup device of the invention is as follows: when the hard disk loading device works, the hard disk placed in the hard disk loading device is slowed down and placed on the sliding rail on the sliding bottom plate, the hard disk is pushed to a proper position by the driving of the pushing hydraulic shaft, the rotating hydraulic rod pushes the rotating pushing rod to rotate and move forwards, the rotating pushing plate rotates to push the hard disk to insert and read, when the insertion and reading are completed, the reading pushing shaft moves to push the hard disk to be pulled out of the reading port, the side pushing plate pushes the hard disk forwards at the moment, the rotating rotary buckle is driven to rotate when the side pushing plate moves, the protection frame fixing buckle on the rotating rotary buckle moves backwards, the locking buckle at the lower end of the protection frame fixing buckle is opened, the side hard disk protection frame can move, and the side pushing plate pushes the hard disk to open the side hard disk protection frame to push the hard disk out.
Compared with the prior art, the invention has the beneficial effects that: (1) The invention shares the data of the databases of all departments in the organization through the central exchange system, thereby improving the data synergy and avoiding the data island; (2) The invention improves the flexibility of data sharing exchange by setting two sharing modes; (3) The hard disk filling device arranged by the central backup device has the function of slowing down the descending speed of the hard disk, and the damage caused by the excessively high speed in the descending process of the hard disk is prevented; (4) The hard disk reading device provided by the invention has the function of automatically taking down the hard disk, and the hard disk which is read out is automatically taken out when the hard disk is read out, so that the working efficiency is improved.
Drawings
FIG. 1 is a flow chart of the data sharing exchange process of the present invention.
FIG. 2 is a block diagram of data sharing among departments of the present invention.
FIG. 3 is a flowchart of a database directory extraction process according to the present invention.
Fig. 4 is a schematic overall structure of the central backup device of the present invention.
Fig. 5 is a schematic diagram of a hard disk cartridge structure according to the present invention.
FIG. 6 is a schematic diagram of a hard disk packing device according to the present invention.
Fig. 7 is a schematic structural diagram of a hard disk plug-in device f of the present invention.
Fig. 8 is a schematic structural diagram of a hard disk reading device according to the present invention.
Detailed Description
In the following description of the present invention, it should be noted that the terms "upper", "lower", "front", "rear", "left", "right", "top", "bottom", "inner", "outer", etc. indicate an azimuth or a positional relationship based on the azimuth or the positional relationship shown in the drawings, and are merely for convenience of describing the present invention and simplifying the description, and do not indicate or imply that the apparatus or elements to be referred to must have a specific azimuth, be configured and operated in a specific azimuth, and thus should not be construed as limiting the present invention.
In the following description of the present invention, it should be noted that, unless explicitly stated and limited otherwise, the terms "mounted," "disposed," and "connected" are to be construed broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected; the connection may be direct or indirect via an intermediate medium, or may be internal communication between two components. The specific meaning of the above terms in the present invention will be understood in specific cases by those of ordinary skill in the art.
Examples: a large data batch sharing exchange system is characterized in that: the system comprises a central switching system and a central backup device; the central exchange system takes a central server as a carrier to carry out sharing exchange work of big data.
The data sharing and exchanging steps of the central exchanging system are as follows:
step S10: extracting a department database catalog and uploading the department database catalog to a central exchange system;
step S20: setting a sharing exchange mode of department data, and distinguishing access rights through the sharing exchange mode; the shared switching mode is divided into: a direct sharing exchange mode and an authorized sharing exchange mode;
step S30A: in the direct sharing exchange mode, departments have no hierarchical relationship, and step S40A is executed;
step S40A: when the department issues shared data in a direct exchange mode, other departments can directly conduct data sharing exchange on the department through a data exchange bus or an API;
step S30B: in the authorized sharing exchange mode, the departments have multi-level up-down relationship, and step S30B is executed;
step S40B: when the department release sharing mode is authorized sharing, the low-level department needs to request authorization from the central exchange system when accessing the department data;
step S50B: the department is authorized to share exchange data with the accessed department. Further, the department service database can make a request for initiating data sharing exchange through the data exchange gateway, and the sharing exchange center selects a data exchange bus or a central database as an access way through an instruction to be accessed by the data exchange gateway;
the shared switching center provides an API service control center and provides access interfaces for an organization internal department and an organization external department by providing a database API; when an external department accesses data through an API, the API service gateway makes it access the desensitized data.
In the embodiment of the present invention, the specific implementation process of step S10 includes:
step S101: carrying out quantization processing on the text data information, and extracting an upper directory stored in the digital data when the content relates to the digital data until the content is a text description;
step S102: extracting data information vectorized features by using an NLP-based tool, enabling text data vectors to enter the NLP tool, and segmenting words by using a corpus, so as to extract text features; step S103: calculating the feature similarity of the data, clustering the data by using an unsupervised clustering algorithm, and during clustering, gathering the same categories together according to different types stored in the databases of all departments and distributing weights according to the duty ratio;
step S104: and extracting the data characteristics with high weight as a data catalog, wherein the data catalog contains description information and indexes of data in the department database.
In the embodiment of the invention, the central backup device is used for carrying out physical backup work on the data of the central database, and because most of current data is backed up and the hard disk, when the backup is manually maintained, the mode of manually inserting and reading the hard disk is tedious and waste manpower, so the central backup device is used for completing the backup work in the embodiment.
Further, referring to the central backup device shown in fig. 4, the central backup device comprises a hard disk carrier 1 and a hard disk loading device 2 which is arranged at two sides of the hard disk carrier 1 and is used for relieving the descending speed of the hard disk, a hard disk inserting and reading device 3 which is used for inserting the hard disk into a reading port is arranged at the middle end of the hard disk carrier 1, and a hard disk reading device 4 which is used for reading and unloading the hard disk is arranged at the front end of the hard disk carrier 1.
Referring to fig. 5, the hard disk carrier 1 includes a sliding bottom plate 101 with a bottom as a mounting platform, a hard disk sliding rail is provided on the sliding bottom plate 101, a pushing hydraulic shaft 102 for pushing a hard disk is provided at the rear end of the sliding bottom plate 101, a hard disk loading 104 is provided at the upper end of the sliding bottom plate 101, and when the hard disk falls from the hard disk loading 104 to the sliding bottom plate 101, the hard disk is located in a chute of the sliding bottom plate 101, and the pushing hydraulic shaft 102 moves to drive the hard disk to move in the chute of the sliding bottom plate 101, so that the hard disk reaches an accurate position.
Referring to fig. 6, the hard disk loading device 2 includes a loading support 201 mounted on a sliding base plate 101 for fixing the hard disk loading device 2, a loading fixing 202 is mounted on the loading support 201, a loading protection spring 203 for protecting the hard disk is arranged on the loading fixing 202, a loading circular shaft fixing 204 is mounted at the front end of the loading fixing 202, a loading circular buffer belt 206 for relieving the descending speed of the hard disk is arranged on the loading circular shaft fixing 204, a loading circular shaft driver 205 for driving the loading circular buffer belt 206 is arranged at the lower end of the loading circular buffer belt 206, and when the hard disk passes through the loading circular buffer belt 206, the loading circular shaft driver 205 drives the loading circular buffer belt 206 to slowly rotate, and the moving speed of the hard disk is controlled, so that the hard disk is mounted on a sliding groove of the sliding base plate 101.
Referring to fig. 7, the hard disk inserting and reading device 3 includes an inserting and reading fixing 301 installed on the sliding bottom plate 101, a notch is provided in the middle section of the inserting and reading fixing 301, a rotation protection spring 302 is installed in the notch, a protection spring is provided on the rotation protection spring 302, a rotation pushing rod 305 is installed at the other end of the spring, the rotation pushing rod 305 slides in the notch to move, a rotating shaft is provided in the rotation pushing rod 305, a spiral concave line is provided on the rotating shaft, a protruding shaft is provided on the outside of the rotation pushing rod 305, the protruding shaft is meshed with the spiral concave line of the rotating column, when the rotating column is pushed to move previously, the protruding shaft is meshed to enable the rotating column to move forward and rotate, a rotation hydraulic rod 304 for driving the rotation pushing rod 305 is installed at one end of the rotation pushing rod 305, a rotation pushing plate 306 for pushing the hard disk is installed at the other end of the rotation pushing rod 305 in cooperation with the rotation pushing rod 305, when the hard disk reaches a certain position, the rotation pushing rod 305 is pushed by the rotation hydraulic rod 304, the rotation pushing plate 306 is driven to rotate and push the hard disk on the rotation protection pushing rod 304 to insert and read, when the hard disk is not damaged in the process of the rotation pushing hydraulic rod.
The hard disk reading device 4 shown in reference to fig. 8 comprises a reading bottom plate 401 arranged on the side of the sliding bottom plate 101, an upper end fixing plate 402 is arranged on the reading bottom plate 401, a rectangular hole is arranged on the upper end fixing plate 402, a reading bending frame 403 for supporting a reading-out drive is arranged on the reading bottom plate 401, a reading pushing shaft 404 for pulling out the hard disk is arranged on the upper end of the reading bending frame 403, a side hard disk protection frame 405 for protecting the hard disk from falling is rotatably arranged on the lower end of the upper end fixing plate 402, a rotary buckle bracket 408 is fixed on the reading bottom plate 401, a protection frame fixing buckle 406 for limiting the rotation of the side hard disk protection frame 405 is arranged on the rotary buckle bracket 408, the protection frame fixing buckle 406 is rotatably arranged on a rotary buckle 407 for driving the protection frame fixing buckle 406, the rotary button 407 is fixedly arranged on the rotary button bracket 408, one end of the protection frame fixing button 406 is slidably arranged in the upper end fixing plate 402, one end of the protection frame fixing button 406 is fixedly arranged on the side push plate 410 for pushing the hard disk to pop out, the side push plate 410 is provided with a side push plate fixing 409 at the back, the side push plate fixing 409 is fixedly arranged on the reading bottom plate 401 for driving the side push plate 410 to push, when the hard disk is read, the reading push shaft 404 pushes the hard disk to pull out the hard disk from the reading opening, the side push plate 410 moves forwards to push the hard disk, the side push plate 410 drives the rotary button 407 to rotate, the rotary button 407 drives the protection frame fixing button 406 to move, the protection frame fixing button 406 slides out from the upper end fixing plate 402, the protection frame fixing button 406 is in limited contact with the buckle of the side hard disk protection frame 405, the side hard disk protection frame 405 rotates on the upper end fixing plate 402 to open a gap, so that the hard disk after reading is pushed out by the side push plate 410 to realize automatic hard disk taking out.
It should be understood that the foregoing embodiments are merely illustrative of the technical solutions of the present invention, and not limiting thereof, and that modifications and equivalents of some of the technical features described in the foregoing embodiments may be made by those skilled in the art; all such modifications and substitutions are intended to be included within the scope of this disclosure as defined in the following claims.