CN106648454A - Local information collection system and information classified collection method - Google Patents
Local information collection system and information classified collection method Download PDFInfo
- Publication number
- CN106648454A CN106648454A CN201610813616.XA CN201610813616A CN106648454A CN 106648454 A CN106648454 A CN 106648454A CN 201610813616 A CN201610813616 A CN 201610813616A CN 106648454 A CN106648454 A CN 106648454A
- Authority
- CN
- China
- Prior art keywords
- information
- storage server
- classification
- server
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0608—Saving storage space on storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0631—Configuration or reconfiguration of storage systems by allocating resources to storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/064—Management of blocks
- G06F3/0641—De-duplication techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a local information collection system and an information classified collection method, and relates to the technical field of multimedia information. The local information collection system comprises a main storage server, a plurality of classified information storage servers and a data obtaining end. The main storage server is connected with the data obtaining end. The main storage server is connected with the classified information storage servers. The data obtaining end is used for obtaining all information inside a region. The main storage server stores and classifies information obtained by the data obtaining end. The classified information storage servers are used for performing classified storage on the information classified by the main storage server. By adopting the technical scheme, due to the fact that the multiple storages are adopted for classified information specialized storage, information is read in order, the information storage amount is large, and maintenance is convenient.
Description
Technical field
The present invention relates to multimedia information technique field, more particularly to a kind of local information collection system and information classification are received
Diversity method.
Background technology
Classification information net is the Type of website that internet newly rises.It is related to the every aspect information of daily life.
We can obtain freely for these website the insides, easily information distribution service.
But, in prior art, because this kind of website belongs to minority colony, and this types of populations typically only rents a clothes
It is engaged in device to realize the function of all classification informations, servers go down or error can be caused when information is excessive, directly results in letter
Breath amount of storage is not enough.
The content of the invention
The technical problem to be solved in the present invention is to provide a kind of local information collection system and information of multiserver composition
Categorised collection method, solves the problems, such as that information storage is not enough.
In order to solve above-mentioned technical problem, the technical scheme is that：
A kind of local information collection system, including：Primary storage server, multiple classification information storage servers and data are obtained
End is taken, the primary storage server is connected with the data acquisition end, and the primary storage server is stored with the classification information
Server connects；Wherein, the data acquisition end is used to obtaining all information in region, and the primary storage server is by data
The information that acquisition end gets is stored and classified, and the classification information storage server is used for primary storage classification server
Information carry out classification storage.
Wherein, the classification information storage server includes second-hand article trading information storage server, used car trade
Information storage server, housing information storage server, pet information storage server, recruitment information storage server,
Part time job storage server, job hunting information storage server, make friend activity information storage server and life service information letter
Breath storage server.
Wherein, the data acquisition end includes big data server, Internet of Things server, page end data acquisition server
Server is obtained with APP end datas.
Wherein, the primary storage server includes information receiving module, information storage module, information classification module and classification
Information forwarding module, described information receiver module is used for receiving data and obtains the information that end obtains, and information storage module is used for will
The information for receiving is stored, and described information sort module is used to that the information of storage to be classified, and the classification information turns
Sending out module is used to for the information of classification to be transmitted to each classification information storage server.
Specifically, the primary storage server also includes illegal Information Filtration module, for by the data acquisition for receiving
The information that end obtains is filtered, and by illegal information block is deleted or isolated.
Specifically, the primary storage server also includes space sorting module, for forwarding the data to classification information
After storage server, the same category information that will be stored on master server is deleted.
Specifically, the mode of described information memory module storage information is compression storage.
A kind of information classification collection method, including：
Step S1：Data acquisition end obtains all information in one's respective area；
Step S2：All information are sent to primary storage server；
Step S3：Primary storage server is classified to all information；
Step S4：The information of classification is sent to into each classification information storage server；
Step S5：Identical content in primary storage server is deleted.
Wherein, perform after execution step S2：
Step S201：Illegal information filtering is carried out to all information；
Step S202：By illegal information deletion.
Wherein, perform after execution step S2：
Step S211：All information are compressed.
Using above-mentioned technical proposal, due to specially being stored using multiserver classification information so that information reads orderly, letter
Breath amount of storage is big, easy to maintenance.
Description of the drawings
Fig. 1 is the structural representation of local information collection system of the present invention；
Fig. 2 is the structural representation of primary storage server in the present invention；And
Fig. 3 is the schematic flow sheet of information classification collection method of the present invention.
In figure, 1- primary storage servers, 2- classification information storage servers, 21- information receiving modules, 22- information Stores
Module, 23- information classification modules, 24- classification information forwarding modules, the illegal Information Filtration modules of 25-, 26- spaces sorting module,
3- data acquisitions end.
Specific embodiment
The specific embodiment of the present invention is described further below in conjunction with the accompanying drawings.Here it should be noted that for
The explanation of these embodiments is used to help understand the present invention, but does not constitute limitation of the invention.Additionally, disclosed below
As long as the present invention each embodiment in involved technical characteristic do not constitute conflict each other and just can be mutually combined.
In order to solve above-mentioned technical problem, the technical scheme is that：
As the first embodiment of the present invention, a kind of local information collection system is proposed, as shown in figure 1, including：Primary storage
Server 1, multiple classification information storage servers 2 and data acquisition end 3, primary storage server 1 is connected with data acquisition end 3,
Primary storage server 1 is connected with classification information storage server 2.
Wherein, data acquisition end 3 include big data server, Internet of Things server, page end data acquisition server and
APP end datas obtain server, and all information in region are obtained by above-mentioned these servers, and the information for getting is sent out
Primary storage server 1 is given, the information that data acquisition end gets is stored and classified by primary storage server 1, Zhi Houfa
In being sent to classification information storage server 2, wherein, as shown in Fig. 2 primary storage server 2 includes information receiving module 21, information
Memory module 22, information classification module 23 and classification information forwarding module 24；The receiving data of information receiving module 21 obtains end 3 and obtains
The information for taking, first passes through illegal Information Filtration module 25 and is filtered the information that the data acquisition end for receiving obtains, and will disobey
Block is deleted or isolated to the information of method violation.Again information is stored by information storage module 22, made after storage
Information is classified with information classification module, the information that classification is completed is transmitted to into each point by classification information forwarding module
Category information storage server, the same category information that finally will be stored on master server is deleted by space sorting module 26.
As the preferred of above-described embodiment, the mode of the storage information of information storage module 22 can be compression storage.
These classification informations are carried out classification storage by classification information storage server 2, and classification information storage server 2 includes
Second-hand article trading information storage server, used car trade information storage server, housing information storage server, dote on
Thing information storage server, recruitment information storage server, part time job storage server, job hunting information storage server, friendship
Friendly action message storage server and life service information information storage server.
The present invention also proposes a kind of information classification collection method based on above-mentioned local information collection system, as shown in figure 3,
Including：
Step S1：Data acquisition end obtains all information in one's respective area；
Step S2：All information are sent to primary storage server；
Step S201：Illegal information filtering is carried out to all information；
Step S202：By illegal information deletion；
Step S3：Primary storage server is classified to all information；
Step S4：The information of classification is sent to into each classification information storage server；
Step S5：Identical content in primary storage server is deleted.
The present invention also proposes a kind of preferred information classification collection method, including：
Step S1：Data acquisition end obtains all information in one's respective area；
Step S2：All information are sent to primary storage server；
Step S211：All information are compressed.
Step S3：Primary storage server is classified to all information；
Step S4：The information of classification is sent to into each classification information storage server；
Step S5：Identical content in primary storage server is deleted.
Using above-mentioned technical proposal, due to specially being stored using multiserver classification information so that information reads orderly, letter
Breath amount of storage is big, easy to maintenance.
Embodiments of the present invention are explained in detail above in association with accompanying drawing, but the invention is not restricted to described enforcement
Mode.For a person skilled in the art, in the case of without departing from the principle of the invention and spirit, to these embodiments
Various changes, modification, replacement and modification are carried out, is still fallen within protection scope of the present invention.
Claims (10)
1. a kind of local information collection system, it is characterised in that include：Primary storage server, multiple classification information storage services
Device and data acquisition end, the primary storage server is connected with the data acquisition end, the primary storage server with described point
Category information storage server connects；Wherein, the data acquisition end is used to obtain all information in region, the primary storage clothes
The information that data acquisition end gets is stored and classified by business device, and the classification information storage server is used for primary storage
The information of classification server carries out classification storage.
2. local information collection system according to claim 1, it is characterised in that：The classification information storage server bag
Include second-hand article trading information storage server, used car trade information storage server, housing information storage server,
Pet information storage server, recruitment information storage server, part time job storage server, job hunting information storage server,
Make friend activity information storage server and life service information information storage server.
3. local information collection system according to claim 1, it is characterised in that：The data acquisition end includes big data
Server, Internet of Things server, page end data acquisition server and APP end datas obtain server.
4. local information collection system according to claim 1, it is characterised in that：The primary storage server includes information
Receiver module, information storage module, information classification module and classification information forwarding module, described information receiver module is used to receive
The information that data acquisition end obtains, information storage module is used to be stored the information for receiving, described information sort module
For the information of storage to be classified, the classification information forwarding module is used to for the information of classification to be transmitted to each classification letter
Breath storage server.
5. local information collection system according to claim 4, it is characterised in that：The primary storage server also includes disobeying
Method Information Filtration module, for the information that the data acquisition for receiving end obtains to be filtered, illegal information is entered
Block is deleted or isolated to row.
6. local information collection system according to claim 4, it is characterised in that：The primary storage server also includes sky
Between sorting module, it is similar on master server for after classification information storage server is forwarded the data to, will be stored in
Information is deleted.
7. local information collection system according to claim 4, it is characterised in that：Described information memory module storage information
Mode for compression storage.
8. a kind of information classification collection method, it is characterised in that include：
Step S1：Data acquisition end obtains all information in one's respective area；
Step S2：All information are sent to primary storage server；
Step S3：Primary storage server is classified to all information；
Step S4：The information of classification is sent to into each classification information storage server；
Step S5：Identical content in primary storage server is deleted.
9. information classification collection method according to claim 8, it is characterised in that：Perform after execution step S2：
Step S201：Illegal information filtering is carried out to all information；
Step S202：By illegal information deletion.
10. information classification collection method according to claim 8, it is characterised in that：Perform after execution step S2：
Step S211：All information are compressed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610813616.XA CN106648454A (en) | 2016-09-09 | 2016-09-09 | Local information collection system and information classified collection method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610813616.XA CN106648454A (en) | 2016-09-09 | 2016-09-09 | Local information collection system and information classified collection method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106648454A true CN106648454A (en) | 2017-05-10 |
Family
ID=58851928
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610813616.XA Pending CN106648454A (en) | 2016-09-09 | 2016-09-09 | Local information collection system and information classified collection method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106648454A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107797768A (en) * | 2017-10-11 | 2018-03-13 | 南京东方金信数据服务有限公司 | A kind of method and system for handling big data |
| CN107863141A (en) * | 2017-11-16 | 2018-03-30 | 广州高通影像技术有限公司 | A kind of Ultrasonography information management system |
| CN111541766A (en) * | 2020-04-21 | 2020-08-14 | 西安电子科技大学 | Multi-server communication connection method |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101211357A (en) * | 2006-12-31 | 2008-07-02 | 北京振戎融通通信技术有限公司 | System and method for collecting internet information by using mobile terminal two-dimension bar-code technology |
| US7693877B1 (en) * | 2007-03-23 | 2010-04-06 | Network Appliance, Inc. | Automated information lifecycle management system for network data storage |
| CN202634484U (en) * | 2012-05-04 | 2012-12-26 | 华工智云科技（武汉）有限责任公司 | Intelligent storage system based on cloud computing |
| CN104966023A (en) * | 2015-03-10 | 2015-10-07 | 深圳市腾讯计算机系统有限公司 | Data protection system, method and apparatus |
| CN105005745A (en) * | 2015-07-16 | 2015-10-28 | 柳州首光科技有限公司 | Information storage method |
| CN105912280A (en) * | 2016-06-24 | 2016-08-31 | 四川福豆科技有限公司 | Storage terminal capable of performing data classification |
-
2016
- 2016-09-09 CN CN201610813616.XA patent/CN106648454A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101211357A (en) * | 2006-12-31 | 2008-07-02 | 北京振戎融通通信技术有限公司 | System and method for collecting internet information by using mobile terminal two-dimension bar-code technology |
| US7693877B1 (en) * | 2007-03-23 | 2010-04-06 | Network Appliance, Inc. | Automated information lifecycle management system for network data storage |
| CN202634484U (en) * | 2012-05-04 | 2012-12-26 | 华工智云科技（武汉）有限责任公司 | Intelligent storage system based on cloud computing |
| CN104966023A (en) * | 2015-03-10 | 2015-10-07 | 深圳市腾讯计算机系统有限公司 | Data protection system, method and apparatus |
| CN105005745A (en) * | 2015-07-16 | 2015-10-28 | 柳州首光科技有限公司 | Information storage method |
| CN105912280A (en) * | 2016-06-24 | 2016-08-31 | 四川福豆科技有限公司 | Storage terminal capable of performing data classification |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107797768A (en) * | 2017-10-11 | 2018-03-13 | 南京东方金信数据服务有限公司 | A kind of method and system for handling big data |
| CN107863141A (en) * | 2017-11-16 | 2018-03-30 | 广州高通影像技术有限公司 | A kind of Ultrasonography information management system |
| CN111541766A (en) * | 2020-04-21 | 2020-08-14 | 西安电子科技大学 | Multi-server communication connection method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102947799B (en) | Message is sent to and subscribes to recipient from message source | |
| CN103108043B (en) | A kind of method that application data library file adaptively gathers ECU messages | |
| CN104850662B (en) | A kind of mobile terminal smart message method for pushing, server and system based on user's portrait | |
| CN102377790A (en) | Method and device for pushing data | |
| CN102375844A (en) | Information providing method and system | |
| CN107844524A (en) | Data processing method, data processing equipment, computer equipment and storage medium | |
| CN105721629B (en) | User identifier matching process and device | |
| CN106934412A (en) | A kind of user behavior sorting technique and system | |
| CN106648454A (en) | Local information collection system and information classified collection method | |
| CN106781434A (en) | Share-car method and system based on traffic route information | |
| CN103345838B (en) | A kind of vehicle information management device and information of vehicles search method | |
| CN106651312A (en) | Intellectual property (IP) service management system | |
| CN102184196A (en) | Petition integrated management information system | |
| CN104852882A (en) | Method for protecting user privacies in network social contact | |
| CN110175152A (en) | A kind of log inquiring method, transfer server cluster and log query system | |
| CN102170405B (en) | A kind of email processing method, mail server and system | |
| CN106484789A (en) | The storage management system and method for pictorial information | |
| CN108200551A (en) | A kind of recording method of oil-filling data, device, terminal device and server | |
| CN107784591A (en) | List data processing method and processing device | |
| CN106856596A (en) | A kind of electronic voting method | |
| CN108499881A (en) | Express delivery intelligent sorting algorithm based on NuPIC and system | |
| CN109542848A (en) | A kind of vehicle-mounted media file fast scanning method and system | |
| CN104077704A (en) | System and method for collecting vehicle refueling information on basis of OBD devices of vehicles | |
| CN107451746A (en) | A kind of Mobile nursing quality management control system | |
| CN106130880A (en) | The gathering method of network mail data and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170510 |
|
| RJ01 | Rejection of invention patent application after publication |