CN106095964A - A kind of method that data are carried out visualization filing and search - Google Patents
A kind of method that data are carried out visualization filing and search Download PDFInfo
- Publication number
- CN106095964A CN106095964A CN201610431847.4A CN201610431847A CN106095964A CN 106095964 A CN106095964 A CN 106095964A CN 201610431847 A CN201610431847 A CN 201610431847A CN 106095964 A CN106095964 A CN 106095964A
- Authority
- CN
- China
- Prior art keywords
- archives
- data
- search
- index
- filing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/80—Information retrieval; Database structures therefor; File system structures therefor of semi-structured data, e.g. markup language structured data such as SGML, XML or HTML
- G06F16/83—Querying
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention discloses a kind of method that data carry out visualization filing and search, relate to data filing and query analysis technology, first, by the source of interface definition archives, relation, field type, file structure, target storage class, increment or full dose, then, by the archives that data message filing is xml structure, storage is to specifying storage class；Meanwhile, the corresponding relation of the variable of configuration interface definition archives element and index server, the archives element needing inquiry is mapped to the variable of index server up, carries out quick search location by system；Finally, according to the archives unique encodings obtained, transfer archives and be shown.The method carries out participle index for the content needing inquiry, during inquiry, directly inputs inquiry content, it is not necessary to specific field；Employing participle and index server, search efficiency is high, and scope is wide, low to the performance requirement of server system, saves equipment investment.
Description
Technical field
The present invention relates to data filing and query analysis technology, specifically a kind of data are carried out visualization filing with
The method of search.
Background technology
Along with, in all kinds of departments of the development of information technology, enterprise or government, operation system, the data volume of storage is the most more come
The most, data relationship becomes increasingly complex.After the tidal data recovering of these business departments, each system is got up, if it is desired to respectively
Class data are inquired about in each dimension, cannot accomplish under traditional mode at all, to the performance requirement of server simultaneously
High.For this situation, if data can be carried out visual filing or search, the problems referred to above will be can effectively solve the problem that, because of
This is highly desirable to exploitation and data carries out visualization filing and the method for search.
Summary of the invention
The present invention is directed to demand and the weak point of current technology development, it is provided that a kind of data are carried out visualization filing with
The method of search.
A kind of method that data carry out visualization filing and search of the present invention, solves what above-mentioned technical problem used
Technical scheme is as follows: a kind of described method that data carry out visualization filing and search, first, by interface definition archives
Source, relation, field type, file structure, target storage class, increment or full dose, then, be xml by data message filing
The archives of structure, storage is to specifying storage class；Meanwhile, the variable of configuration interface definition archives element and index server is right
Should be related to, the archives element needing inquiry is mapped to the variable of index server up by system, carries out quick search location；?
After, according to the archives unique encodings obtained, transfer archives and be shown；It specifically includes following steps: 1) carry out data source
Describe；2) archive set is described；3) archives are defined；4) display mode of archives is defined；5) to archives
Index be defined；6) archives generate；7) index generates；8) archives of increment and index generate；9) document query.
Preferably, described be described data source mainly includes, is described source data in system, specifically describes
Data source, resource, resource row three category information；Wherein, data source refers to the type of database of data, and resource belongs under data source
Content, for the table of lane database；Resource column index is according to the information of the row of the table in storehouse；Data source, resource, resource row are defined
After, major key, the external key of resource is defined, meanwhile, the row of definition unique encodings, as unique mark of archives.
Preferably, described be described archive set mainly includes, will have identical services scene, same queries demand
Different classes of archives, one archive set of unified ownership；When archive set defines, the storage mode of definition archives, and define use
Which search server.
Preferably, described be defined archives mainly includes, sets up the relation between archives node and source data；Archives
Form uses xml form, and tree structure, archives catalog and content store respectively；Described archives node, is divided into three according to characteristic
Class: packet node, back end, list node；When definition back end and list node, select corresponding resource and select
Row；After Archival Definition completes, a back end is selected to be master meter as host node, the table that this host node is corresponding.
Preferably, the described display mode to archives is defined being primarily referred to as, and is determined the exhibition method of archives
Whether justice, such as title, pattern, mask, show, sort.
Preferably, the described index to archives is defined being primarily referred to as, definition file index row, is defining archives knot
On the basis of structure, the resource of archives is arranged and the corresponding relation of variable on index server is defined.
Preferably, described archives generate and mainly include, according to the nodal information of Archival Definition, data that nodal information is corresponding
Source, resource, resource column information, archives generate by master-salve table relation, the main external key of source data, and archives are put into depositing of specifying
Storage is spatially.
Preferably, described index generation is primarily referred to as, on the basis of archives have generated, according to resource row and index clothes
The corresponding relation of the variable on business device, by variable and the value of variable, submits to index server, index server carries out participle
Set up index.
Preferably, the archives of described increment and index generation are primarily referred to as, and external system is taked the mode of interface table, root
According to the data source of change of write, table, major key information, processing system, search corresponding Archival Definition, the archives portion to variation
Point carrying out additions and deletions changes operation, after archives changes, again generates on index server and indexes.
Preferably, described document query mainly includes, in the content of query interface input inquiry, by search server according to
The inquiry content provided, inquires about most suitable record in the index, the summary info of archives, unique business coding is returned, and
Encode according to unique business, look into and take archive content and archives display mode carries out the displaying of archives.
A kind of having of compared with prior art having of method data being carried out visualization filing and search for of the present invention
Benefit effect is: the method is applied to government department after multidisciplinary purpose data classifying, and data carry out filing and efficient query analysis；
Carry out participle index for the content needing inquiry, during inquiry, directly input inquiry content, it is not necessary to specific field；Further it is provided that
Visual configuration interface, can generate retrieval server and archives, the function such as index generation be customized；Employ point
Word and index server, search efficiency is high, and scope is wide, low to the performance requirement of server system, saves equipment investment.
Detailed description of the invention
For making the object, technical solutions and advantages of the present invention clearer, below in conjunction with specific embodiment, to this
Bright described a kind of method further description that data are carried out visualization filing and search.
In order to solve government department after subunit, association department, each operation system are carried out purpose data classifying, efficiently
Carrying out filing and the problem such as query analysis, disclosure of the invention is a kind of carries out visualization filing and the method for search to data, passes through
The source of interface definition archives, relation, field type, file structure, target storage class, increment/full dose, system is according to these
Definition, by the archives that data message filing is xml structure, storage is to specifying storage class；Meanwhile, configuration interface definition archives unit
The corresponding relation of the variable of element and index server, the archives element needing inquiry is mapped to the variable of index server by system
Up, it is possible to be rapidly performed by Query Location；Finally, according to the archives unique encodings obtained, it is possible to transfer archives and be shown.
Embodiment:
Described in the present embodiment, a kind of carry out data visualizes filing and the method for search, and it specifically includes following steps: 1) right
Data source is described；2) archive set is described；3) archives are defined；4) display mode to archives carries out determining
Justice；5) index of archives is defined；6) archives generate；7) index generates；8) archives of increment and index generate；9) archives
Inquiry.
Owing to data come from different data sources, form is different, and address is different, and described in the present embodiment carrying out data can
Filing with the method for search depending on changing, described be described data source mainly includes, is described source data in system,
Specifically describe data source, resource, resource row three category information.Wherein, data source refers to the type of database of data, and oracle is still
The information such as db2, ip address and port；Resource belongs to the content under data source, and the table for lane database (when archives generate, needs
The table used)；Resource column index is according to the information of the row of the table in storehouse: field name, field type, length, it is not necessary to all
Field be described, it is only necessary to the information used when generating archives is described.Data source, resource, resource row are defined
After, major key, the external key of resource is defined, in order to resource associations is got up；Meanwhile, the row of definition unique encodings, as shelves
Unique mark of case.
Described be described archive set mainly includes, will have identical services scene, the inhomogeneity of same queries demand
Other archives, one archive set of unified ownership；When archive set defines, the storage mode of definition archives, can be data base, literary composition
Part, hbase etc., and define which search server of use.Archives in same archive set, have identical archives and deposit
Storage, identical search server.
Described be defined archives mainly includes, set up archives node and source data (data source, resource, resource arrange) it
Between relation；File Format uses xml form, and tree structure, archives catalog and content store respectively.Archives catalog is mainly used in
Describe the structure of archives and have the link value of content node, archive content be mainly content node on archives catalog concrete in
Hold.Described archives node, is divided three classes according to characteristic: packet node, back end, list node.Packet node, identical
Resource is put together；Back end is single node, i.e. only a record of corresponding resource；The a plurality of note of list node correspondence resource
Record.When definition back end and list node, select corresponding resource alternative column.After Archival Definition completes, select one
Back end is master meter as host node, the table that this host node is corresponding.
The described display mode to archives is defined being primarily referred to as, and is defined the exhibition method of archives, such as mark
Topic, pattern, mask (sensitive information * is replaced), whether show, sort (sequence of resource, the sequence of resource row) etc.；Take
Individually define display mode, it is possible to reduce the unnecessary information of archives, save the memory space of archives, meanwhile, according to user's need
Ask, be defined flexibly without regenerating archives.
The described index to archives is defined being primarily referred to as, definition file index row, is defining the base of file structure
On plinth, the resource of archives is arranged and the corresponding relation of variable on index server is defined.
Described archives generate and mainly include, according to the nodal information of Archival Definition, data source that nodal information is corresponding, money
Source, resource column information, archives are generated by master-salve table relation, the main external key of source data, archives are put into the storage specified empty
On between.
Described index generation is primarily referred to as, on the basis of archives have generated, according on resource row and index server
The corresponding relation of variable, by variable and the value of variable, submit to index server, index server carry out participle and set up rope
Draw.
The archives of described increment and index generation are primarily referred to as, and external system are taked the mode of interface table, according to write
The data source of change, table, major key information, processing system, search corresponding Archival Definition, the profiles section of variation carried out
Additions and deletions change operation, after archives have changed, again generate index on index server.
Described document query mainly includes, in the content of query interface input inquiry, by search server according to offer
Inquiry content, inquires about most suitable record in the index, the summary info (i.e. index information) of archives, unique business coding is returned
Return, and encode according to unique business, look into and take archive content and archives display mode carries out the displaying of archives.When archives are shown,
By the way of interface can represent with configuration interface, as list, col width, in lines, font, color, whether show, sort, identity
Card number is covered up, the convenient displaying carrying out personalization according to customer demand.
Above-mentioned detailed description of the invention is only the concrete case of the present invention, and the scope of patent protection of the present invention includes but not limited to
Above-mentioned detailed description of the invention, any that meet claims of the present invention and any person of an ordinary skill in the technical field
The suitably change being done it or replacement, all should fall into the scope of patent protection of the present invention.
Claims (10)
1. the method that data are carried out visualization filing and search, it is characterised in that first, by interface definition archives
Source, relation, field type, file structure, target storage class, increment or full dose, then, by data message filing be
The archives of xml structure, storage is to specifying storage class；Meanwhile, configuration interface definition archives element and the variable of index server
Corresponding relation, system will need the archives element of inquiry to be mapped to the variable of index server up, carry out quick search fixed
Position；Finally, according to the archives unique encodings obtained, transfer archives and be shown；It specifically includes following steps: 1) to data source
It is described；2) archive set is described；3) archives are defined；4) display mode of archives is defined；5) right
The index of archives is defined；6) archives generate；7) index generates；8) archives of increment and index generate；9) document query.
A kind of method that data are carried out visualization filing and search, it is characterised in that described
Data source is described and mainly includes, in system, source data is described, specifically describe data source, resource, resource
Row three category information；Wherein, data source refers to the type of database of data, and resource belongs to the content under data source, for lane database
Table；Resource column index is according to the information of the row of the table in storehouse；After having defined data source, resource, resource row, to the major key of resource, outer
Key is defined, and meanwhile, the row of definition unique encodings, as unique mark of archives.
A kind of method that data are carried out visualization filing and search, it is characterised in that described
Being described archive set and mainly include, will have the different classes of archives of identical services scene, same queries demand, unification is returned
Belong to an archive set；When archive set defines, the storage mode of definition archives, and define which search server of use.
A kind of method that data are carried out visualization filing and search, it is characterised in that described
It is defined archives mainly including, sets up the relation between archives node and source data；File Format uses xml form, tree
Shape structure, archives catalog and content store respectively；Described archives node, is divided three classes according to characteristic: packet node, data section
Point, list node；When definition back end and list node, select corresponding resource alternative column；After Archival Definition completes,
A back end is selected to be master meter as host node, the table that this host node is corresponding.
A kind of method that data are carried out visualization filing and search, it is characterised in that described right
The display mode of archives is defined being primarily referred to as, and is defined the exhibition method of archives, such as title, pattern, mask, is
No display, sequence.
A kind of method that data are carried out visualization filing and search, it is characterised in that described right
The index of archives is defined being primarily referred to as, definition file index row, the money on the basis of defining file structure, to archives
The corresponding relation of the variable on source row and index server is defined.
A kind of method that data are carried out visualization filing and search, it is characterised in that described shelves
Case generates and mainly includes, according to the nodal information of Archival Definition, data source that nodal information is corresponding, resource, resource column information, main
From the main external key of table relation, source data, archives are generated, archives are put on the memory space specified.
A kind of method that data are carried out visualization filing and search, it is characterised in that described rope
Derivation becomes to be primarily referred to as, on the basis of archives have generated, according to the corresponding pass of the variable on resource row and index server
System, by variable and the value of variable, submits to index server, index server carry out participle and set up index.
A kind of method that data are carried out visualization filing and search, it is characterised in that described increasing
Archives and the index generation of amount are primarily referred to as, and external system take the mode of interface table, according to the data of the change of write
Source, table, major key information, processing system, search corresponding Archival Definition, the profiles section changed is carried out additions and deletions and changes operation, shelves
After case has changed, on index server, again generate index.
A kind of method that data are carried out visualization filing and search, it is characterised in that described
Document query mainly includes, in the content of query interface input inquiry, by search server according to the inquiry content provided, at rope
Draw the most suitable record of middle inquiry, the summary info of archives, unique business coding are returned, and encode according to unique business, looks into
Take archive content and archives display mode carries out the displaying of archives.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610431847.4A CN106095964A (en) | 2016-06-17 | 2016-06-17 | A kind of method that data are carried out visualization filing and search |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610431847.4A CN106095964A (en) | 2016-06-17 | 2016-06-17 | A kind of method that data are carried out visualization filing and search |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106095964A true CN106095964A (en) | 2016-11-09 |
Family
ID=57236834
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610431847.4A Pending CN106095964A (en) | 2016-06-17 | 2016-06-17 | A kind of method that data are carried out visualization filing and search |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106095964A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109660371A (en) * | 2017-10-10 | 2019-04-19 | 中兴通讯股份有限公司 | A kind of Automation arranging method and automatically dispose tool |
| CN110020027A (en) * | 2017-07-31 | 2019-07-16 | 北京精密机电控制设备研究所 | A kind of file retrieval based on context aware utilizes method and system |
| CN110457380A (en) * | 2019-08-07 | 2019-11-15 | 广州市百果园信息技术有限公司 | A kind of data-storage system |
| CN110597903A (en) * | 2019-08-13 | 2019-12-20 | 万达信息股份有限公司 | Health record extensible model implementation method and system based on indexes and reports |
| CN111464571A (en) * | 2019-01-18 | 2020-07-28 | 阿里巴巴集团控股有限公司 | Communication method and system, server and client |
| CN111522980A (en) * | 2020-04-26 | 2020-08-11 | 深圳惟远智能技术有限公司 | File-based quick search method under mass data |
| CN112100217A (en) * | 2020-09-18 | 2020-12-18 | 山东浪潮商用系统有限公司 | Asset management system and method based on tax big data |
| CN112269807A (en) * | 2020-11-09 | 2021-01-26 | 浪潮软件股份有限公司 | Configurable credit file retrieval method and system based on Elasticissearch technology |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1627306A (en) * | 2003-12-12 | 2005-06-15 | 王宏源 | Method for building database of books, periodicals and literature |
| CN101291337A (en) * | 2008-05-30 | 2008-10-22 | 同济大学 | Grid resource management system and method |
| CN201222257Y (en) * | 2008-07-18 | 2009-04-15 | 东莞市万维网络科技信息有限公司 | System for managing construction engineering archive |
| CN101894139A (en) * | 2010-06-25 | 2010-11-24 | 优视科技有限公司 | Mobile Internet webpage information data interaction processing method |
| CN102129519A (en) * | 2011-03-11 | 2011-07-20 | 广东巨龙信息技术有限公司 | Method for recording and transmitting electronic medical record file |
| CN102411580A (en) * | 2010-09-20 | 2012-04-11 | 腾讯科技（深圳）有限公司 | Retrieval method and device for extensible markup language (XML) files |
| CN103679594A (en) * | 2012-09-18 | 2014-03-26 | 张旭峰 | Personal health information storage system based on personal health record model |
-
2016
- 2016-06-17 CN CN201610431847.4A patent/CN106095964A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1627306A (en) * | 2003-12-12 | 2005-06-15 | 王宏源 | Method for building database of books, periodicals and literature |
| CN101291337A (en) * | 2008-05-30 | 2008-10-22 | 同济大学 | Grid resource management system and method |
| CN201222257Y (en) * | 2008-07-18 | 2009-04-15 | 东莞市万维网络科技信息有限公司 | System for managing construction engineering archive |
| CN101894139A (en) * | 2010-06-25 | 2010-11-24 | 优视科技有限公司 | Mobile Internet webpage information data interaction processing method |
| CN102411580A (en) * | 2010-09-20 | 2012-04-11 | 腾讯科技（深圳）有限公司 | Retrieval method and device for extensible markup language (XML) files |
| CN102129519A (en) * | 2011-03-11 | 2011-07-20 | 广东巨龙信息技术有限公司 | Method for recording and transmitting electronic medical record file |
| CN103679594A (en) * | 2012-09-18 | 2014-03-26 | 张旭峰 | Personal health information storage system based on personal health record model |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110020027A (en) * | 2017-07-31 | 2019-07-16 | 北京精密机电控制设备研究所 | A kind of file retrieval based on context aware utilizes method and system |
| CN109660371A (en) * | 2017-10-10 | 2019-04-19 | 中兴通讯股份有限公司 | A kind of Automation arranging method and automatically dispose tool |
| CN109660371B (en) * | 2017-10-10 | 2021-11-02 | 中兴通讯股份有限公司 | Automatic deployment method and automatic deployment device |
| CN111464571A (en) * | 2019-01-18 | 2020-07-28 | 阿里巴巴集团控股有限公司 | Communication method and system, server and client |
| CN111464571B (en) * | 2019-01-18 | 2022-04-26 | 阿里巴巴集团控股有限公司 | Communication method and system, server and client |
| CN110457380A (en) * | 2019-08-07 | 2019-11-15 | 广州市百果园信息技术有限公司 | A kind of data-storage system |
| CN110597903A (en) * | 2019-08-13 | 2019-12-20 | 万达信息股份有限公司 | Health record extensible model implementation method and system based on indexes and reports |
| CN111522980A (en) * | 2020-04-26 | 2020-08-11 | 深圳惟远智能技术有限公司 | File-based quick search method under mass data |
| CN112100217A (en) * | 2020-09-18 | 2020-12-18 | 山东浪潮商用系统有限公司 | Asset management system and method based on tax big data |
| CN112269807A (en) * | 2020-11-09 | 2021-01-26 | 浪潮软件股份有限公司 | Configurable credit file retrieval method and system based on Elasticissearch technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106095964A (en) | A kind of method that data are carried out visualization filing and search | |
| CN102521416B (en) | Data correlation query method and data correlation query device | |
| Sharma et al. | Sql and nosql databases | |
| US10067954B2 (en) | Use of dynamic dictionary encoding with an associated hash table to support many-to-many joins and aggregations | |
| CN100468402C (en) | Sort data storage and split catalog inquiry method based on catalog tree | |
| CN108228817A (en) | Data processing method, device and system | |
| CN101036141B (en) | A database management system with persistent, user- accessible bitmap values | |
| CN109952568B (en) | System and method for high speed searching or filtering large data sets | |
| CN104881466B (en) | The processing of data fragmentation and the delet method of garbage files and device | |
| CN104462421B (en) | Multi-tenant extended method based on key-value database | |
| US20110004638A1 (en) | Attributed key-value-store database system | |
| CN105488048A (en) | Data query method and device | |
| CN102893281A (en) | Information retrieval device, information retrieval method, computer program, and data structure | |
| CN104573022A (en) | Data query method and device for HBase | |
| CN105117442B (en) | A kind of big data querying method based on probability | |
| CN103455335A (en) | Multilevel classification Web implementation method | |
| CN104408171A (en) | Receipt sub-table row-correlated query device and method | |
| CN106599153A (en) | Multi-data-source-based waste industry search system and method | |
| CN106155769A (en) | A kind of workflow processing method, device and workflow engine | |
| CN109271449A (en) | A kind of distributed storage inquiry system file-based and querying method | |
| CN104331491A (en) | Method and device for displaying organization | |
| CN102999637B (en) | According to the method and system that file eigenvalue is file automatic powder adding add file label | |
| CN103020753A (en) | Document state display system and document state display method | |
| CN108153776A (en) | Data query method and device | |
| CN101963993B (en) | Method for fast searching database sheet table record |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20161109 |
|
| RJ01 | Rejection of invention patent application after publication |