RU2557473C2 - Data preparation system for information analysis system - Google Patents

Abstract

FIELD: physics, computer engineering.

SUBSTANCE: invention relates to searching and preparing documents for publication on an information portal. A data preparation system for an information analysis system, comprising an authorisation module, a search module unit and document database, connected to each other to allow data communication, is characterised by that it is provided with a keyword module consisting of a keyword preparation module and a keyword database connected to each other, and a document export module; the document database is configured to form a list of found documents, a list of selected documents, a list of working documents and a list of documents to be exported, wherein the keyword database is built into the link between the authorisation module and the search module unit, and the document export module is linked to the document database and is configured to send documents to be exported to the information analysis system for further publishing of selected documents on the portal of the information analysis system, wherein the keyword database is provided with a submodule having a function for selecting keywords linked with previously selected keywords.

EFFECT: faster selection of relevant documents and preparation and publication thereof on the portal of the information analysis system.

9 dwg

Description

The invention relates to the field of automated search and can be used to search and prepare documents for publication on the information portal, which is accessed by a wide range of users.

Various information retrieval systems are known that provide automated search for documents, for example, the well-known search engines Yandex, Google, etc. These systems provide a search for relevant documents by keywords.

At the same time, there is no data preparation complex in these systems that provides the possibility of forming and setting up a database of specialized keywords, processing and preparing selected documents for their further publication.

A known complex of data preparation of the information retrieval system, including the authorization module, search modules connected to the Internet, and a database of documents found (RF patent No. 110847, publ. 11/27/2011).

A disadvantage of the known technical solution is the impossibility of conducting thematic searches for keywords selected from a previously prepared keyword database. In addition, there is no possibility of expanding the search area due to automatically offered to the operator keywords and / or phrases from the keyword database, which increases the time for searching for relevant documents and further preparation (processing) of documents for publication on the information-analytical portal.

The objective of the invention is to create a complex of data preparation for an information-analytical system that allows collecting and preparing for publication (placement) on the portal of an information-analytical system of necessary documents, including scientific ones.

The technical result consists in reducing the time for the selection of relevant documents, their preparation and placement on the portal of the information-analytical system.

The technical result achieved is achieved by the fact that the data preparation complex for the information-analytical system, comprising an authorization module, a search module block and a document database, interconnected with the possibility of information exchange, according to the invention is equipped with a keyword module consisting of interconnected key preparation module words and a keyword database, and a document export module, a document database is configured to generate a list of documents found, sleep ska selected documents, a list of working documents and a list of documents for export, and the keyword database is embedded in the connection of the authorization module with the search module block, and the document export module is connected to the document database and is configured to transfer documents for export to the information-analytical system .

The combination of features of the claimed complex provides the claimed technical result, because:

- supplying a data preparation complex with a keyword module, consisting of interconnected keyword preparation module and a keyword database, provides the ability to generate and configure a database of specialized relevant keywords, which reduces the time for selecting relevant documents in the process of conducting an information search;

- supplying the data preparation complex with the document export module, ensuring the connection of the document export module with the document database and its implementation with the possibility of transferring the documents for export to the information-analytical system ensures the accelerated placement of the prepared documents on the information-analytical system portal using a simple interface through simple manipulations , which helps to reduce the time of work with the document by reducing the time required to place the document on portal of information and analytical system;

- execution of a database of documents with the possibility of forming a list of found documents, a list of selected documents, a list of working documents and a list of documents for export provides a clear sequence of working with documents, allows you to return documents processed by one user for processing by other operators, which reduces the time for preparing documents for information and analytical system;

- embedding the keywords database in the connection of the authorization module with the block of search modules, in addition to providing a clear relationship between the work of the complex elements and the ability to search for the necessary information simultaneously in several search engines, it reduces the search time and time for working with documents. In addition, it provides an additional technical result, namely, the safety of the keywords module.

Thus, the task has been completely solved: a data preparation complex has been created for the information-analytical system, which allows collecting and preparing for publication (placement) on the portal of the information-analytical system the necessary documents with the stated technical result, which consists in reducing the time for selecting relevant documents, their preparation and posting on the portal of the information-analytical system.

In the particular case of the invention, the keyword database may be provided with a submodule configured to select keywords that are associated with previously selected keywords.

Providing a keyword database with a sub-module that is configured to select keywords that are associated with previously selected keywords also works to achieve the stated technical result, because “Tells” what other keywords could be used for search, which also helps reduce the time for selecting relevant documents.

The invention is illustrated below by a detailed description of an example of a specific implementation with reference to illustrations, where

figure 1 shows a structural diagram of a complex of data preparation;

figure 2 is a view of a form window for introducing new keywords and a list of keywords of the keyword preparation module;

figure 3 is a window view of a sub-module for selecting keywords from the generated database of keywords;

4 is a view of a menu for selecting search modules;

5 is a view of the window "Search Statistics using various search modules";

6 is a view of the window "List of sites discovered using various search modules";

Fig.7 is a view of a document placed in the section "For consideration";

Fig. 8 is a window view of an editable working document selected for placement in an information-analytical system (IAS);

Fig.9 is a view of an edited document, ready for export to IAS.

The workplace 1 of the expert operator performing a thematic search in the databases presented on the Internet is connected through the authorization module 2 to the database of 3 keywords (see figure 1). The latter is connected with the Internet keyword preparation module 4 and the Internet connection block 5, the database of 3 keywords and the module 4 of keyword preparation are included in the module 6 of keywords. Information from block 5 of search modules is sent to the database of 7 documents, which contains a list of 8 (files) of the documents found, list 9 (files) of the selected documents, list 10 (files) of the working documents, and also a list of 11 (files) of documents for export. The information contained in the latter is transmitted to the document export module 12, which is associated with the information-analytical system 13 located on the portal.

Authorization module 2 allows you to control access to the data preparation complex. A database of 7 documents is connected to block 5 of search modules and module 12 of exporting documents. In addition, the database of 3 keywords can be equipped with a submodule (pos. Not indicated, see figure 3), performed with the function of selecting keywords that are associated with previously selected keywords. To conduct a search, you can use the search modules Yandex, Google, Wiki.

The functioning of the data preparation complex is as follows.

First of all, it should be noted that the main goal of the expert operator is to search and select a large amount of information, its prompt placement on the portal. As part of the functioning of the complex, several different actions are carried out simultaneously.

The first step of the expert operator’s actions is to create a database of 3 keywords, on the basis of which a subsequent information search is carried out. Since the Internet is an ever-changing environment, once arranged a database of 3 keywords is not constant and requires adjustment (introduction of new words, removal of irrelevant, and sometimes spelling specifications).

After the operator-expert from workstation 1, having logged in to module 2, has formed the initial version of database 3, he enters module 4 for preparing keywords. The security of module 4 is ensured by its protection using a login and password, and the password is set by the system administrator in the configuration file. Next, work begins on forming a list of keywords. To do this, go to the "Keywords" section and add a list of words that can participate in the search for material - for this operation, the "New Keyword" form is provided (see figure 2).

The operator-expert is obliged to approach this operation with great responsibility, since he must be very clear on which keywords (key phrases) can correspond to the subject matter of the material for the information portal. The number of keywords is unlimited (the stability of the system does not depend on this).

The generated list of keywords is in the table "active keywords".

Searching for all keywords in individual cases can take quite a while. To resolve this problem, it is possible to temporarily disable or even delete keywords that, according to the operator-expert, are irrelevant. However, it should be borne in mind that it is better to disable keywords than delete, since in this case statistics on the participation of this keyword in the search will be saved - in this case, the user (expert operator) can search the truncated list of words for which information He is most interested.

If the user has a desire to expand the search area, he can connect keywords that have already been disabled or use a special submodule that “tells” what other keywords could be used for the search. A special context menu has been added to the "Keywords" section. In addition to the list of keywords already available in the system, there is a function for selecting other keywords that are associated with previously selected ones. If the proposed keyword is suitable, then it is added to the list of words of the system and a search for documents is performed according to this word in the usual way (see figure 3).

The next step (after creating a list of keywords) is the selection of search modules of block 5. For this, in the “Modules” section (see Fig. 4), those search modules are activated by which documents will be searched on the Internet. If no module is activated, the system will not be able to search. At the same time, work with keywords found by documents, export of documents remains available. The most popular search modules Yandex, Google, Wiki can be used for searching. You can also search the Yandex blogs service.

After completion of the preparatory work (a list of keywords has been created, the mode of working with this list has been selected, search modules are connected), they begin an information search. To do this, in the "Keywords" section, select the word for which the search for documents is supposed. By pressing the “start” button, the operation of the search modules of block 5 is activated. The modules search for materials on the Internet taking into account the selected keyword. After the search, the found documents are placed in the database 7 in the subsection "list of 8 found documents" (see figure 5).

Next, the expert operator proceeds to assess the content of the material found. The material found is located in the form of a list of site names (see Fig.6).

The process of evaluating information occurs at several levels. The very first level of evaluation is the name. The expert operator inspects the list of documents and, based on the title of the document, can shorten the list by deleting unnecessary ones.

The operator-expert can make a decision by reviewing the document in full, and not just by title. The second level of assessment is the content analysis itself. You can exit to the source site of the document from the "For Review" subsection by clicking the "Review" button. The documents in the subsection “For Consideration” (see Fig. 7) are presented without any processing - in the form in which they are posted on the sites (this allows you to evaluate the site on which the found document is located and draw preliminary conclusions about its scientific and information value). Having read the entire document, the operator can also delete it or change the status to “for processing”. After changing the status of a document, it falls into the list of 9 selected documents.

Documents that have passed the preliminary selection and received the status “for processing” are available in the “for processing” subsection of the list of 9 selected documents in the “Documents” section. In this section, the documents should be edited and get the kind and content with which they will be presented in the IAS 13 portal.

To edit a document, select the document and click on the "edit" link. You can change the name of the document with which it will continue to appear in the information system, while the name of the document with which it was found will also be stored.

Using a visual editor, an expert operator prepares an information document. Editable document is placed in the list of 10 working documents and saved. An example of a window for processing (editing) a document selected for placement in IAS 13 is shown in Fig. 8.

The document can simply be saved and subsequently reverted to editing it again (this way you can prepare a whole list of selected but not edited documents). Upon completion of the final editing of the document, the expert operator can change its status to “ready” and thereby indicate that the document has been finalized and can be exported through module 12 to the IAS 13 portal. The view of the edited document ready for export to the IAS is shown in FIG. 9.

The analyzed and edited document is placed in the "Ready" section of the "Documents" section. If the document has the status of “ready”, this means that it can be exported to the information portal. If the operator-expert made some mistake while editing the material or at the last moment wanted to make a correction, then he can edit the material already ready for export directly in the "Ready" section. If necessary, you can change the status of the document and return the document to the "to processing" section. To do this, on the document editing screen, click the "return to processing" button.

The proposed complex provides the most complete editorial and analytical processing of the material, without resorting to duplication of various editorial versions.

Documents found and edited (taking into account copyright and indicating the source of information) are ready for export to the information portal.

To implement this action, the expert operator goes to the "Export" section of the main menu. This section presents documents that have the status of "finished". By ticking off those documents that need to be transferred to the portal and clicking the “export to website” button, the operator-expert passes the documents to the input of IAS 13 located on the portal.

Thus, the proposed set of data preparation allows you to:

- search for the necessary information for research simultaneously in several search engines;

- using a simple interface adapted for a confident user, accumulate in one place information material obtained as a result of a search;

- carry out processing of received documents, return documents processed by one user for further processing by other operators;

- allow prepared documents to be exported to the information portal, post it on the portal after checking the completeness of the information found (using a simple interface) by simple manipulations.

The proposed complex can be used to create specialized search engines for the humanities.

Claims (1)

A data preparation complex for an information-analytical system containing an authorization module, a search module block and a document database interconnected with the possibility of information exchange, characterized in that it is equipped with a keyword module consisting of interconnected keyword preparation module and a database keywords, and the document export module, the document database is configured to generate a list of found documents, a list of selected documents, a list of working documents a list of documents for export, and the keyword database is embedded in the connection of the authorization module with the search module block, and the document export module is connected with the document database and is configured to transfer documents for export to the information-analytical system for further placement of selected documents on the information portal -analytical system, moreover, the database of keywords is equipped with a submodule made with the function of selecting keywords that are associated with previously selected keywords.

Images