CN101702159A - Index file synchronized method, index server and search system - Google Patents
Index file synchronized method, index server and search system Download PDFInfo
- Publication number
- CN101702159A CN101702159A CN200910110348A CN200910110348A CN101702159A CN 101702159 A CN101702159 A CN 101702159A CN 200910110348 A CN200910110348 A CN 200910110348A CN 200910110348 A CN200910110348 A CN 200910110348A CN 101702159 A CN101702159 A CN 101702159A
- Authority
- CN
- China
- Prior art keywords
- index file
- server
- index
- sshfs
- search server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to the index technology, and aiming at the disadvantage that the operation process of the synchronization scheme of the existing index file based on FTP transferring mode, the invention provides an index file synchronized method, an index server and a search system; the index file synchronized method comprises the following steps: the index server leads the index file to be copied to a local virtual directory which is attached to an index file storage directory by SSHFS progress, so as to transfer the index file to the index file storage directory of the search server by SSHFS progress. The invention further provides the index server and the search system; the local virtual directory is attached to the index file storage directory on the search server by transferring the SSHFS progress, and the index server leads the index file to be copied to the local virtual directory, and the SSHFS progress is used to transfer the index file to the search server, the operation process is simple and easy and the transferring efficiency is high.
Description
Technical field
The present invention relates to index technology, more particularly, relate to a kind of index file method for synchronous, index server and search system.
Background technology
Along with the maturation day by day of digital information memory technology, the full-text search of information has obtained using widely.From internet search engine, to the library book search, the application of information global search technology is seen everywhere.
In the face of huge information bank,, often need the information architecture index for improving the efficient of full-text search.With the internet search engine is example, and search engine companies must be to a large amount of web data index buildings that excavate every day, could ensure that every day, number was responded fast in necessarily Webpage search request.Index construct task computation amount is big, needs the special hardware device of configuration to finish.Therefore, in the prior art, often dispose special index server and come execution index to make up task.In this case, concrete search mission (be about to the key word of input and the index of structure and mate, with the output Search Results) will be finished by special search server.
Because index file often upgrades, therefore need be between index server and search server index file synchronously.Prior art adopts the FTP load mode to come synchronous index file usually.Although can finish the transmission task of index file, there are many defectives in the FTP load mode.For example, at first, the FTP load mode need be carried out comparatively complicated FTP configuration.Secondly, in concrete use, the FTP load mode need be carried out the application layer operation of series of interactive.Once more, the FTP load mode all needs to carry out password authentification before each transport process begins, and can begin to transmit being proved to be successful the rear, if the FTP authentication password for example changes through revising, then transmit leg can't re-use original password and carries out file and transmit.This shows that the operating process of FTP load mode is very complicated.
Therefore, need a kind of index file synchronization scenario, can effectively overcome the above-mentioned defective that exists among the prior art.
Summary of the invention
The technical problem to be solved in the present invention is that the defective at having now based on the index file synchronization scenario operating process relative complex of FTP load mode provides a kind of index file method for synchronous, index server and search system.
The technical solution adopted for the present invention to solve the technical problems is:
Construct a kind of index file method for synchronous, be used for synchronous index file between index server and search server, wherein, described index file is stored in the described index server, described search server is provided with the index file storage directory, described method comprises, index server is carried out described index file copied to by the SSHFS process and is articulated to operation under the local virtual catalogue of described index file storage directory, by the SSHFS process described index file is sent under the index file storage directory of described search server.
In index file method for synchronous provided by the invention, described method specifically comprises, described index server stabbed based on the rise time of described index file, execution copies under the described local virtual catalogue described index file by the operation under the sub-directory of this rise time stamp sign, to be stabbed under the sub-directory of sign by this rise time under the index file storage directory that described index file is sent to described search server by described SSHFS process.
In index file method for synchronous provided by the invention, described index file duplicate finish after, described method comprises that also described index server sends to described search server and finishes notice.
The present invention also provides a kind of index server, communicates to connect with search server, and wherein, this search server is provided with the index file storage directory, stores index file in this index server, and described index server comprises:
The SSHFS module is used to carry out the SSHFS process, the local virtual catalogue is articulated to the index file storage directory on the described search server;
Synchronization module is used to carry out described index file is copied to operation under the described local virtual catalogue, by described SSHFS module described index file is sent under the index file storage directory of described search server.
In index server provided by the invention, described synchronization module is used for stabbing based on the rise time of described index file, execution copies under the described local virtual catalogue described index file by the operation under the sub-directory of this rise time stamp sign, to be stabbed under the sub-directory of sign by this rise time under the index file storage directory that described index file is sent to described search server by described SSHFS module.
In index server provided by the invention, also comprise:
Notification module, be used for described index file duplicate finish after, send to described search server and to finish notice.
The present invention also provides a kind of search system, comprising:
Search server, it is provided with the index file storage directory;
Index server communicates to connect with search server, is used for:
The storage index file; And,
Execution copies to described index file by the SSHFS process and is articulated to operation under the local virtual catalogue of described index file storage directory, by the SSHFS process described index file is sent under the index file storage directory of described search server.
In search system provided by the invention,
Described index server comprises:
The SSHFS module is used to carry out the SSHFS process, described local virtual catalogue is articulated to the index file storage directory on the described search server;
Synchronization module is used to carry out described index file is copied to operation under the described local virtual catalogue, by described SSHFS module described index file is sent under the index file storage directory of described search server.
In search system provided by the invention, described synchronization module is used for stabbing based on the rise time of described index file, execution copies under the described local virtual catalogue described index file by the operation under the sub-directory of this rise time stamp sign, to be stabbed under the sub-directory of sign by this rise time under the index file storage directory that described index file is sent to described search server by described SSHFS module.
In search system provided by the invention,
Described index server also comprises:
Notification module, be used for described index file duplicate finish after, send to described search server and to finish notice.
Implement technical scheme of the present invention, has following beneficial effect: in index file method for synchronous provided by the invention, index server and search system, index server is by calling the SSHFS process, and the local virtual catalogue is articulated to index file storage directory on the search server.Thus, index server just can come by the SSHFS process index file to be sent to search server by index file being copied to the mode of local virtual catalogue.SSHFS only need carry out simple command operation can finish articulating of catalogue, and synchronizing process only need be carried out simple file copy; Because the SSHFS load mode is to be based upon on the basis of SSH, therefore in case a machine to an other machine mandate, finish catalogue and articulate, the influence that then follow-up file transfers is not modified by the SSH account password.This shows that the index file synchronization scenario operating process based on the SSHFS mode provided by the invention is simple, is easy to left-hand seat, and the transmission efficiency height.
Description of drawings
The invention will be further described below in conjunction with drawings and Examples, in the accompanying drawing:
Fig. 1 is the logical organization synoptic diagram according to the search system applied environment of a preferred embodiment of the present invention;
Fig. 2 is the logical organization synoptic diagram according to the index server of a preferred embodiment of the present invention.
Embodiment
In order to make purpose of the present invention, technical scheme and advantage clearer,, the present invention is further elaborated below in conjunction with drawings and Examples.Should be appreciated that specific embodiment described herein only in order to explanation the present invention, and be not used in qualification the present invention.
The invention provides a kind of index file method for synchronous, index server and search system, wherein, index server is by calling the SSHFS process, and the local virtual catalogue is articulated to index file storage directory on the search server.Thus, index server just can come by the SSHFS process index file to be sent to search server by index file being copied to the mode of local virtual catalogue.SSHFS only need carry out simple command operation can finish articulating of catalogue, and synchronizing process only need be carried out simple file copy; Because the SSHFS load mode is to be based upon on the basis of SSH, therefore in case a machine to an other machine mandate, finish catalogue and articulate, the influence that then follow-up file transfers is not modified by the SSH account password.This shows that the index file synchronization scenario operating process based on the SSHFS mode provided by the invention is simple, is easy to left-hand seat, and the transmission efficiency height.Below just come technical scheme provided by the invention is described in detail with specific embodiment in conjunction with the accompanying drawings.
Fig. 1 is the logical organization synoptic diagram according to the search system applied environment 100 of a preferred embodiment of the present invention.As shown in Figure 1, wherein show communication terminal 102,104 and 106, and search system 110.Wherein, communication terminal 102,104 and 106 communicates to connect by internet 108 and search system 110, and search system 110 further comprises search server 112 and index server 114, and wherein, search server 112 and index server 114 communicate to connect.
It should be noted that in the specific implementation process communication terminal 102,104 and 106 also can adopt other modes to link to each other with search system 110.
Below in conjunction with Fig. 2 the concrete structure of index server 114 is described.
Fig. 2 is the logical organization synoptic diagram according to the index server 200 of a preferred embodiment of the present invention.As indicated above, index server 200 communicates to connect with search server, and wherein, this search server is provided with the index file storage directory, stores index file in this index server.As shown in Figure 2, index server 200 further comprises SSHFS module 202 and the synchronization module 204 that communicates with one another and connect.
SSHFS module 202 is used to carry out the SSHFS process, the local virtual catalogue is articulated to the index file storage directory on the search server.
In the specific implementation process, rise time when synchronization module 204 also can generate based on index file stabs, execution copies under the local virtual catalogue index file by the operation under the sub-directory of this rise time stamp sign, to be stabbed under the sub-directory of sign by this rise time under the index file storage directory that index file is sent to search server by SSHFS module 202.
As optionally, index server 200 also can further comprise notification module 206, be used for indexed file duplicate finish after, send to search server and to finish notice.
Can be seen from the foregoing, the invention provides a kind of index file method for synchronous, be used for synchronous index file between index server and search server, wherein, index file is stored in the index server, and search server is provided with the index file storage directory.This method comprises, index server is carried out index file copied to by the SSHFS process and is articulated to operation under the local virtual catalogue of index file storage directory, by the SSHFS process index file is sent under the index file storage directory of search server.
In the specific implementation process, index file method for synchronous provided by the invention specifically comprises, index server stabbed based on the rise time of index file, execution copies under the local virtual catalogue index file by the operation under the sub-directory of this rise time stamp sign, to be stabbed under the sub-directory of sign by this rise time under the index file storage directory that index file is sent to search server by the SSHFS process.
In addition, after indexed file duplicated and finishes, index file method for synchronous provided by the invention comprised that also index server sends to search server and finishes notice.
The above only is preferred embodiment of the present invention, not in order to restriction the present invention, all any modifications of being done within the spirit and principles in the present invention, is equal to and replaces and improvement etc., all should be included within protection scope of the present invention.
Claims (10)
1. index file method for synchronous, be used for synchronous index file between index server and search server, wherein, described index file is stored in the described index server, described search server is provided with the index file storage directory, it is characterized in that, described method comprises, index server is carried out described index file copied to by the SSHFS process and is articulated to operation under the local virtual catalogue of described index file storage directory, by the SSHFS process described index file is sent under the index file storage directory of described search server.
2. index file method for synchronous according to claim 1, it is characterized in that, described method specifically comprises, described index server stabbed based on the rise time of described index file, execution copies under the described local virtual catalogue described index file by the operation under the sub-directory of this rise time stamp sign, to be stabbed under the sub-directory of sign by this rise time under the index file storage directory that described index file is sent to described search server by described SSHFS process.
3. index file method for synchronous according to claim 1 and 2 is characterized in that, described index file duplicate finish after, described method comprises that also described index server sends to described search server and finishes notice.
4. an index server communicates to connect with search server, and wherein, this search server is provided with the index file storage directory, stores index file in this index server, it is characterized in that, described index server comprises:
The SSHFS module is used to carry out the SSHFS process, the local virtual catalogue is articulated to the index file storage directory on the described search server;
Synchronization module is used to carry out described index file is copied to operation under the described local virtual catalogue, by described SSHFS module described index file is sent under the index file storage directory of described search server.
5. index server according to claim 4, it is characterized in that, described synchronization module is used for stabbing based on the rise time of described index file, execution copies under the described local virtual catalogue described index file by the operation under the sub-directory of this rise time stamp sign, to be stabbed under the sub-directory of sign by this rise time under the index file storage directory that described index file is sent to described search server by described SSHFS module.
6. according to claim 4 or 5 described index servers, it is characterized in that, also comprise:
Notification module, be used for described index file duplicate finish after, send to described search server and to finish notice.
7. a search system is characterized in that, comprising:
Search server, it is provided with the index file storage directory;
Index server communicates to connect with search server, is used for:
The storage index file; And,
Execution copies to described index file by the SSHFS process and is articulated to operation under the local virtual catalogue of described index file storage directory, by the SSHFS process described index file is sent under the index file storage directory of described search server.
8. search system according to claim 7 is characterized in that,
Described index server comprises:
The SSHFS module is used to carry out the SSHFS process, described local virtual catalogue is articulated to the index file storage directory on the described search server;
Synchronization module is used to carry out described index file is copied to operation under the described local virtual catalogue, by described SSHFS module described index file is sent under the index file storage directory of described search server.
9. search system according to claim 7, it is characterized in that, described synchronization module is used for stabbing based on the rise time of described index file, execution copies under the described local virtual catalogue described index file by the operation under the sub-directory of this rise time stamp sign, to be stabbed under the sub-directory of sign by this rise time under the index file storage directory that described index file is sent to described search server by described SSHFS module.
10. according to each described search system in the claim 7 to 9, it is characterized in that,
Described index server also comprises:
Notification module, be used for described index file duplicate finish after, send to described search server and to finish notice.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN200910110348A CN101702159A (en) | 2009-10-28 | 2009-10-28 | Index file synchronized method, index server and search system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN200910110348A CN101702159A (en) | 2009-10-28 | 2009-10-28 | Index file synchronized method, index server and search system |
Publications (1)
Publication Number | Publication Date |
---|---|
CN101702159A true CN101702159A (en) | 2010-05-05 |
Family
ID=42157074
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN200910110348A Pending CN101702159A (en) | 2009-10-28 | 2009-10-28 | Index file synchronized method, index server and search system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN101702159A (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102789625A (en) * | 2011-05-17 | 2012-11-21 | 腾讯科技(北京)有限公司 | National college and university information local acquisition method and system |
CN103177082A (en) * | 2013-02-21 | 2013-06-26 | 用友软件股份有限公司 | Main server, slave server, index synchronizing system and index synchronizing method |
CN106294860A (en) * | 2016-08-23 | 2017-01-04 | 浪潮电子信息产业股份有限公司 | System for synchronizing real-time index data and implementation method thereof |
CN107103075A (en) * | 2017-04-24 | 2017-08-29 | 广东浪潮大数据研究有限公司 | The text searching method and device of a kind of ftp file |
-
2009
- 2009-10-28 CN CN200910110348A patent/CN101702159A/en active Pending
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102789625A (en) * | 2011-05-17 | 2012-11-21 | 腾讯科技(北京)有限公司 | National college and university information local acquisition method and system |
CN103177082A (en) * | 2013-02-21 | 2013-06-26 | 用友软件股份有限公司 | Main server, slave server, index synchronizing system and index synchronizing method |
CN103177082B (en) * | 2013-02-21 | 2016-07-06 | 用友网络科技股份有限公司 | Master server, from server, index synchro system and index synchronous method |
CN106294860A (en) * | 2016-08-23 | 2017-01-04 | 浪潮电子信息产业股份有限公司 | System for synchronizing real-time index data and implementation method thereof |
CN107103075A (en) * | 2017-04-24 | 2017-08-29 | 广东浪潮大数据研究有限公司 | The text searching method and device of a kind of ftp file |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107526626B (en) | Docker container thermal migration method and system based on CRIU | |
CN106250270B (en) | A kind of data back up method under cloud computing platform | |
CN103595730B (en) | A kind of ciphertext cloud storage method and system | |
CN106156359B (en) | A kind of data synchronization updating method under cloud computing platform | |
Dunham et al. | A mobile transaction model that captures both the data and movement behavior | |
CN103379159B (en) | A kind of method that distributed Web station data synchronizes | |
CN103473277B (en) | The Snapshot Method and device of file system | |
US9235594B2 (en) | Synchronizing updates across cluster filesystems | |
CN101160903B (en) | Method, system, client terminal and server for implementing data synchronization | |
CN101702158A (en) | Index file creation synchronized method and search system | |
CN103220358B (en) | The online file synchronisation method in a kind of multiple terminals, system, server and terminal unit | |
CN103731489B (en) | A kind of date storage method, system and equipment | |
CN103002027B (en) | Data-storage system and the method for tree directory structure is realized based on key-value pair system | |
CN103180842A (en) | Cloud computing system and data synchronization method therefor | |
CN111078667B (en) | Data migration method and related device | |
CN104050276A (en) | Cache processing method and system of distributed database | |
WO2016011825A1 (en) | Cloud-service-based data backup and operation method | |
CN105630571A (en) | Virtual machine creating method and device | |
CN102495774A (en) | Method and system for realizing system recovery of computer | |
CN102486785A (en) | Data synchronization method, device and system | |
CN102937955A (en) | Main memory database achieving method based on My structured query language (SQL) double storage engines | |
CN103902405A (en) | Quasi-continuity data replication method and device | |
CN108920489A (en) | Dispositions method, device and the equipment of database | |
CN102238223A (en) | Networked personal data management method for mobile device | |
CN102137167B (en) | Uninterruptedly running virtual machine migrating method and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C12 | Rejection of a patent application after its publication | ||
RJ01 | Rejection of invention patent application after publication |
Open date: 20100505 |