RU61442U1 - SYSTEM OF AUTOMATED ORDERING OF UNSTRUCTURED INFORMATION FLOW OF INPUT DATA - Google Patents

Abstract

The utility model relates to technical means of computer science and computer technology and can be used to solve problems of automated comparison and analysis based on converting an unstructured input data stream into an object form, storing and maintaining an information data array in an active state directly during preparation and use, including number and decentralized. Technical results: simultaneous translation of incoming data from foreign languages into the native language of the system user; protection against unauthorized use by the system of interested persons who do not have user access; user identification; control and analysis during the user's work; creating your own identifying user certificate and level of access to the system; the ability to streamline unstructured or weakly structured data, including decentralized; automatic or semi-automatic rejection of information not of interest to the user. The system includes a user device connected to a centralized control device, which includes a system user registration device, a decoding unit, an encoding unit, an operation process control device, a device for storing, classifying and searching ordered data, a device for generating and storing data by users of the system, registration of ordered data and a device for monitoring and analyzing operations, a device for storing, classifying and searching for ordered data it contains a control unit, an automated data ordering device, an ordered data memory unit and a data object search generation unit, an automated data ordering device, comprises a control unit, an encoding recognition unit, an encoding and recognition rule unit, a correlation dependency unit for language or dialect constructions, a borrowed library storage unit , a block of information and logical processing of an object into an object form, a block of settings and scripts for classifying object recognition.

Description

Technical field

The utility model relates to technical means of computer science and computer technology and can be used to solve problems of automated comparison and analysis based on converting an unstructured input data stream into an object form, storing and maintaining an information data array in an active state directly during preparation and use, including number and decentralized.

State of the art

It is known "Information processing device for information retrieval", RF patent No. 2096825, op. 11/20/1997, IPC G 06 F 17/00, which contains a memory interface unit, an input-output unit, an input-output buffer memory, a control unit, a buffer memory, a display unit, the inputs and outputs of which are connected to each other via a bus another, the memory of the original array, the output of which is connected to the input of the memory interface unit, a typesetting field, the output of which is connected to the input of the input-output block, the block for synthesizing text fragments, the block for structural analysis of the text fragment, the symbol processing unit for the text fragment, the correction unit collocations dictionary, primary dictionary synthesis block, primary dictionary filtering block, secondary dictionary synthesis block, secondary dictionary analysis block, archive card synthesis block, text fragment archiving block, system dictionary correction block, archive card memory, inputs - the outputs of which are connected through the main bus with each other, the input of the display unit is connected to the output of the input / output unit.

The disadvantages of the device include the fact that it does not allow the direct conversion of incoming information flows into a single unified format so that in the future information flows can be subjected to automated analysis, regardless of the original

presentation forms, using a limited set of standard procedures, including decentralized; it does not provide for the possibility of simultaneous translation of incoming data from foreign languages into the user's native language, which becomes especially relevant in the context of expanding access to Internet resources; It does not provide protection against unauthorized use by the system of interested persons who do not have user access; does not allow for monitoring and analysis during the user’s work due to the lack of appropriate functional devices; does not provide for the possibility of user identification; It does not provide for the creation of a user’s own identifying certificate and the level of access to the system; does not allow the possibility of organizing unstructured (weakly structured) data, such as a table, interview, reference book, graphic image, sound information, video information, etc.); does not provide for automatic or semi-automatic culling of information not of interest to the user from the contour of further processing.

A known system that allows you to implement the "Method of organizing data presented in text information data blocks", patent of the Russian Federation No. 2210809, op. 08/20/2003, according to IPC G 06 F 17/28, focused on the analysis of source texts, which contains a block for converting the source text into a set of interconnected objects based on a settings table containing knowledge about the structure of the system under study in the form of a set of classes forming it, including a certain a set of attributes, including relationships and relationships between objects of specified classes, a block of rules for recognizing an attribute in a text set for each attribute, I / O buffer memory, a control unit, buffer memory, a display unit, the inputs and outputs of which are connected via a bus to each other, the memory of the original array, the output of which is connected to the input of the memory interface unit, a text fragment structural analysis unit, a text fragment symbol processing unit, an archive card synthesis unit,

a block for archiving text fragments, a memory for an archive card, the inputs and outputs of which are connected via a bus to each other, the input of the display unit is connected to the output of the input-output block.

The disadvantages of the system include the fact that it does not allow direct conversions of the information flows coming into it into a single unified format so that in the future information flows can be subjected to automated analysis, regardless of the initial presentation forms, using a limited set of standard procedures, including decentralized; it does not provide for the possibility of simultaneous translation of incoming data from foreign languages into the user's native language, which becomes especially relevant in the context of expanding access to Internet resources; It does not provide protection against unauthorized use by the system of interested persons who do not have user access; does not allow for monitoring and analysis during the user’s work due to the lack of appropriate functional devices; does not provide for the possibility of user identification; It does not provide for the creation of a user’s own identifying certificate and the level of access to the system; does not allow the possibility of organizing unstructured (weakly structured) data, such as a table, interview, reference book, graphic image, sound information, video information, etc.); does not provide for automatic or semi-automatic culling of information not of interest to the user from the contour of further processing.

The closest analogue to the claimed utility model is the "System for managing transactions with the results of intellectual activity (RID)", RF patent for utility model No. 34773, op. 12/10/2003, according to IPC G 06 F 17/60.

A system for managing transactions with intellectual property (RIA) results, including a bank control device, a customer control device,

seller’s device connected via a communication channel with a centralized management device and a certificate storage and verification device connected to a centralized management device, which includes a system participants registration unit, a database formation and storage unit for operations performed between system participants, a formation unit and storage of a database on agreements concluded between participants in the system, a data management unit related to financial transactions, a control unit and analysis of the transaction process between system participants, a transaction process control unit, a database formation and storage unit for system participants, a service database formation and storage unit, a financial and economic activity analysis unit for system participants connected to the process control and analysis unit the transaction between the participants in the system, the unit for analysis of the financial and economic activities of the participants in the system, connected to the unit for monitoring and analyzing the process of the transaction between to the participants of the system, a document management control unit, while the registration unit of the system participants is connected to the database generation and storage unit for the system participants and to the input and output of the centralized control device, to which the transaction process control unit is also connected, which, in turn, connected to a document management unit, with a data management unit for conducting financial transactions, with a unit for generating and storing a database of services, with a unit for monitoring and analyzing the transaction process between participants in the system connected to the output of the centralized control device, with a unit for generating and storing a database for participants in the system and with a unit for creating and storing a database for transactions between participants in the system, which, in turn, is connected to the unit for generating and storing the database according to the agreements concluded between the participants in the system, the system comprising, an expert control device, an observer control device, an administrator control device Ator, each of which is connected

through a communication channel with a centralized control device and a certificate storage and verification device connected to a centralized control device, which includes a system administration process control unit, a penalty control unit, a classification process control unit, and a RID generation, storage, classification and search unit, as well as the formation, storage and search for services in the field of turnover of RID, the aforementioned system administration process control unit is connected to a participant registration window, with a unit for generating and storing data on system participants that is connected to a transaction process control unit, said system administration process control unit, a penalty sanction control unit, a classification process control unit are connected to a decoding unit and an encoding unit, and also with a control unit for the transaction process, a unit for generating and storing a database of operations, a unit for generating and storing data on system participants, th control and analysis of the process of the transaction, carrying out financial operations control unit, a document management unit, formation and storage base unit of data on concluded contracts and block the analysis of financial and economic activity.

The disadvantages of the system include the fact that it does not allow direct conversions of the information flows coming into it into a single unified format so that in the future information flows can be subjected to automated analysis, regardless of the initial presentation forms, using a limited set of standard procedures, including decentralized; it does not provide for the possibility of simultaneous translation of incoming data from foreign languages into the user's native language, which becomes especially relevant in the context of expanding access to Internet resources; It does not provide protection against unauthorized use by the system of interested persons who do not have user access; does not allow monitoring and analysis in the process

user work due to lack of appropriate functional devices; does not provide for the possibility of user identification; It does not provide for the creation of a user’s own identifying certificate and the level of access to the system; does not allow the possibility of organizing unstructured (weakly structured) data, such as a table, interview, reference book, graphic image, sound information, video information, etc.); does not provide for automatic or semi-automatic culling of information not of interest to the user from the contour of further processing.

Utility Model Essence

The current level of development of instrumental support for information and analytical units, for example, groups, companies, etc., has revealed a number of problems arising in their activities, the main of which are the following.

1) Collection, generalization and systematization of large volumes of data coming from various information sources of different types of representations.

2) Keeping up to date the available information arrays (databases, information and information retrieval systems).

3) Archiving and data exchange during the preparation and implementation of information and analytical work in the absence of standard (or unified) cataloging systems.

The use of a large number of information sources leads to the need for formatted data conversion, which is a necessary source material for the implementation of information and analytical work. This requires the introduction of an additional stage of converting the input information stream to the required form, which provides the possibility of updating information arrays and performing information-analytical work.

Updating information arrays is currently the most resource-intensive issue requiring a comprehensive solution

issues of reducing temporary losses during registration of incoming data, search and selection of necessary data, technical organization of information storages, ensuring the safety of data and a number of other interrelated information and analytical activities in the overall technological sequence.

The relevance of the problems discussed above increases significantly for small teams, when it is not possible to satisfactorily solve a set of problems.

Existing systems for automated analysis of informal texts are based on:

- methods of searching for data on user-specified search contexts using logical connectives between contexts;

- methods of frequency analysis of word repeatability;

- methods of grammar analysis of texts based on syntactic and semantic analysis of sentences.

However, grammar analysis of texts is effective when the source text is composed according to the rules of context-free grammars (KS-grammars) or grammars of certain rules (OK-grammars). In texts based on the rules of context-sensitive grammars, which are the vast majority of documents actually used by a person, these methods are ineffective. Frequency analysis methods make it possible to make an integral assessment of the text (to give an idea of what is at stake), but they do not allow to give a detailed picture of the structure and relationships of objects. Context search methods are more versatile, however, they are usually narrowly specialized and each time they require tuning to a specific search image (or you need to store a group of settings).

The problem the utility model aims to solve is to create an efficient, effective and reliable system for the automated ordering of the unstructured input data stream, which allows standardizing and unifying the input data stream for subsequent automated comparison and analysis based on the conversion of the unstructured input data stream to an object form

storing and maintaining the information data array in an active state directly during the preparation and use thereof, including decentralized.

Technical results of the utility model:

- simultaneous translation of incoming data from foreign languages into the native language of the user or users of the system;

- protection against unauthorized use by the system of interested persons who do not have user access;

- user identification;

- control and analysis during the user's work;

- creating your own identifying user certificate and access level to the system;

- the ability to streamline unstructured (loosely structured) data, such as a table, interview, reference book, graphic image, sound information, video information, etc.), including decentralized;

- automatic or semi-automatic rejection of information not of interest to the user from the contour of further processing.

Technical results are achieved in that the ordering of a poorly structured information-heterogeneous input data stream is carried out by a system that includes at least one user device connected via a communication channel to a centralized control device, which includes a system user registration device, decoding unit, coding unit, operation process control device, device for storing, classifying and searching ordered data, device in generating and storing data on system users, registering ordered data and an operation monitoring and analysis device, said system user registration device being connected to an output of said decoding unit and an output of said encoding unit, said operation process control device is connected to an output of said decoding unit and input said coding unit, as well as with said device

storing, classifying and searching for ordered data, said operation process control device, data generation and storage device for system participants, ordered data recording device and operation monitoring and analysis device are interconnected, said operation monitoring and analysis device is connected to an input of said encoding unit, said device for storing, classifying and searching ordered data comprises a control unit, an automated data sequencing device , an ordered data memory unit and a data object search generating unit, wherein said ordered data memory unit is connected to an input of said automated data ordering device and said data object search generating unit, said ordered data memory unit is connected to said automated data ordering device and to said unit forming a data object search, said automated data sequencing device comprises a control unit, bl to recognition of encodings, a block of encodings and recognition rules, at least one block of correlation dependencies of language structures or dialects, at least one block for storing borrowed libraries, a block for information and logical processing of an object into an object form, a block for settings and scripts for classifying object recognition wherein said encoding recognition unit is connected to at least one said block of correlation dependencies of language structures or dialects, with said encoding block ok and recognition rules and the output of said control unit, said unit of information-logical processing of an object into an object form is connected to said unit of settings and scripts for classifying recognition of objects, with the output of said encoding recognition unit and the input of said control unit, at least one said block of correlation dependencies of language constructions or dialects and at least one said block of borrowed libraries storage are interconnected. In this case, generated during the analysis of input data

the object contains only its unique name, but in the process of analyzing the input information stream it can be supplemented with structural elements, the need for the introduction of which will be determined by the objectives of the work performed and the information contained in the input data. Moreover, the generated information objects in this case inherit one of the possible types of objects (within the framework of the accepted cataloging system), thereby ensuring the unification of the structural definition of the object, creating an information field for the system, and the inherited structure does not have to be rigid, on the contrary, it is advisable to provide more its complete polymorphism, which greatly facilitates the ordering of a poorly structured input information stream that differs in information constant heterogeneity. In addition, structural polymorphism ensures that individual characteristics of the analyzed information object are taken into account, as well as the possibility of encapsulating other objects, including those created by other artists, who introduce additional structural elements into existing objects and assign information fragments to them directly in the process of analyzing the input information stream.

Technical results can be achieved in that the certificate storage and verification device, which comprises a decoding unit, an encoding unit, a control unit, a memory unit for storing information about each user of the system, a control unit and a memory unit for storing valid and revoked certificates, moreover, said unit the control is connected to said memory unit for storing information about each user of the system, said memory unit for storing valid and revoked certificates and said Locke control, as well as with the output of said decode unit and the input of said coding unit.

Technical results can be achieved in that at least one user control device that comprises a decoding unit, an identification unit, an encoding unit, an electronic digital signature (EDS) generating unit, a unit

a control unit, a user request generating unit, a user response generating unit, said identification unit being connected to an output of said decoding unit and an input of said control unit, said digital signature generating unit is connected to an output of said control unit, with an input of said encoding unit and an output of said signal generating unit execution of the operation, said control unit is connected to said user request forming unit and said forming unit User veto.

Technical results can be achieved in that a system user registration device that comprises a decoding unit, a coding unit, a control unit, a certificate registration unit and a system user registration unit, said control unit being connected to said certificate registration unit and said system user registration unit, and also with the output of the said decoding unit and the input of the encoding unit.

Technical results can be achieved in that the operation process control device comprises interconnected control unit and a script for generating operation scenarios.

Technical results can be achieved in that the device for generating and storing data for system users comprises a control unit, a memory unit for storing system user details and a memory unit for storing a system user access level, said control unit being connected to said memory unit for storing system user details and said memory unit for storing a system user access level.

Technical results can be achieved in that the ordered data recording device comprises a control unit, a document registration unit and a memory unit for storing intermediate documents, said control unit being connected to said document registration unit and said memory unit for storing intermediate documents.

Technical results can be achieved in that the device for monitoring and analyzing the operation comprises a control unit and an alert unit for the user of the system, the outputs of the said units being interconnected, an additional output of the control unit being connected to the alert unit of the system user.

At the same time, the automation of work related to the streamlining of a poorly structured information-heterogeneous stream of input data, where the adopted information and reference organization of objects in the system combines data into information clusters and the system implements a mechanism for using previously accumulated knowledge contained in other objects. Objects in which data is modified independently refer to other objects and form data clusters or information fields, which makes available all the data of the cluster into which the selected object belongs, regardless of which cluster object is selected first by the system. The system automates the ordering of a poorly structured information-heterogeneous stream of input data, where each information object contains its own data and links to other objects. All information about the object is located in the object itself or in the objects for which the links are defined, which allows you to refuse to analyze the information-link structure inside the information field. The system also modifies the information and link organization: establishes link relationships between objects of different clusters, leading to the immediate consolidation of data belonging to these clusters. Changes become available for all objects containing a link to the modifiable object, as soon as they occur. The latter is the most effective tool for using previously accumulated knowledge.

Brief Description of the Drawings

The operation of the system is illustrated by drawings, which show possible implementations of the system.

Figure 1 presents a functional diagram of a system for automated ordering of unstructured information

input stream.

Figure 2 presents a functional diagram of a device for storage and verification of certificates.

Figure 3 presents a functional diagram of a user control device.

Figure 4 presents a functional diagram of a centralized control device.

Figure 5 presents a functional diagram of a device for registering participants in the system.

Figure 6 presents a functional diagram of a device for controlling the process of operation.

Figure 7 presents a functional diagram of a device for the formation and storage of data on the participants in the system.

On Fig presents a functional diagram of a device for registering data sequencing.

Figure 9 presents the functional block diagram of the control and analysis of operations between participants in the system.

Figure 10 presents the functional diagram of the storage device classification and search for ordered data.

Figure 11 presents a functional block diagram of a device for automated data sequencing.

Detailed description of utility model

The automated ordering system of an unstructured input data stream contains a user control device 1. A certificate storage and verification device 2, a centralized control device 3.

The system may simultaneously include several user control devices 1, each of which is connected via a communication channel to a centralized control device 3, and a certificate storage and verification device 2. (Fig. 1)

The certificate storage and verification device 2 (FIG. 2) comprises a decoding unit 4, an encoding unit 5, a control unit 6, a control unit 8, a memory unit for storing information about the user of the system 7, a memory unit for storing existing and

canceled certificates 9. In this case, the encoding unit 5 and the decoding unit 4 are connected to the control unit 6, which in turn is connected to the control unit 8, with a memory unit for storing information about users of the system 7 and with a memory unit for storing valid and canceled certificates 9 .

User control device 1 (Fig. 3) contains a decoding unit 10, an identification unit 11, an encoding unit 12, an EDS generating unit 13, a control unit 14, a user request generating unit 15, a user response generating unit 16 and a transaction execution signal generating unit 17. In this case, the control unit 14 is connected through the identification unit 11 with the decoding unit 10 and through the digital signature generation unit 13 with the encoding unit 12, as well as with the user request generation unit 15, with the user response generating unit 16. EDS 13 is connected to the signal generation block of the transaction 17.

The centralized control device 3 (Fig. 4) comprises a user registration system 21, a decoding unit 20, an encoding unit 26, a process control device 22, a device for storing, classifying and searching ordered data 27, a device for generating and storing data for users of the system 23 registering the ordered data 24 and the device for monitoring and analyzing the operation 25, the user registration device of the system 21 is connected to the output of the decoding unit 20 and the output of the encoding unit 26, about the process control of operation 22 is connected to the output of the decoding unit 20 and the input of the encoding unit 20, as well as to a device for storing, classifying and searching ordered data 27, a device for controlling the process of operation 22, a device for generating and storing data for users of the system 23, a registration device for ordered data 24 and the device for monitoring and analyzing the operation 25 are interconnected, the device for monitoring and analysis of the operation 25 is connected to the input of the encoding unit 26, the storage, classification and search device yadochennyh data 27 includes a control unit 43, the automated device

data sequencing 44, ordered data memory unit 45 and data object search generating unit 46, ordered data memory unit 45 is connected to an input of an automated data ordering device 44 and data object search generating unit 46, ordered data memory unit 45 is connected to an automated data ordering device 44 and with the data object search generating unit 46, the automated data sequencing device 44 comprises a control unit 47, an encoding recognition unit 48, an encoding unit, and a right recognition sludge 49, at least one block of correlation dependencies of language structures or dialects 50, at least one block of borrowed libraries 51, an information-logical processing unit of an object into an object form 52, settings and scripts for classifying object recognition 53, the encoding recognition unit 48 is connected to the correlation dependency unit of the language structures or dialects 50, to the encoding and recognition rule unit 49 and the output of the control unit 47, the information-logical processing unit heel object in an object form linked with the block 52 and the settings object recognition scenarios classification 53, with a yield of 48 codings recognition unit and an input control unit 47, the block correlations languages or dialects structures 50 and the storage unit is borrowed libraries 51 are interconnected.

A user registration device of system 21, comprises a decoding unit 28, an encoding unit 29, a control unit 30, a certificate registration unit 31, and a systems user registration unit 32. The control unit 30 is connected to a certificate registration unit 31 and a user registration unit of the system 32, as well as the output of the decoding unit 28 and the input of the encoding unit 29.

The process control device of operation 22 comprises interconnected control unit 33 and scripting unit for passing operation 34.

A device for generating and storing data for users of the system 23 comprises a control unit 35, a memory unit for storing

user details of the system 36 and a memory unit for storing the user level of access of the system 37. The control unit 35 is connected to a memory unit for storing the user details of the system 36 and a memory unit for storing the user level of access of the system 37.

The ordered data recording device 24 comprises a control unit 38, a document registration unit 39, and a memory unit for storing intermediate documents 40. A control unit 38 is connected to a document registration unit 39 and a memory unit for storing intermediate documents 40.

The control and analysis device for operation 25 contains a control unit 41 and an alert unit for users of the system 42. The outputs of the units are interconnected, an additional output of the control unit 41 is connected to an alert unit for participants in the system 42.

In order to activate the system, the user must register. To do this, he must electronically transfer to the central control device 3 his details (for example, the number of the workplace, etc.) and, if desired, additional information identifying his personality, for example, fingerprints, image of the retina, voice sample, etc. P. These data will be recorded respectively in the memory block for storing details of the participants of the system 36 and in the memory block for storing the access level of the participants of the system 37. Using the appropriate software, the user generates his own certificate, which contains the following information: key code, date of issue of the certificate and its expiration date actions, information about the organization that issued the appropriate software for generating the certificate, the name of the person (system user) in whose name you are forming A certificate is issued, a class corresponding to the level of access allowed for this user in the system. The user received the certificate in this way transmits in encoded electronic form to the input of the certificate storage and verification device 2, from which information through the decoding unit 4 enters the control unit 6, which is part of the certificate storage and verification device 2. (In case,

when the electronic system includes a device for generating certificates (not shown in Fig.), the certificate can be obtained as a result of the operation of this device.) The control unit 6 recognizes the type of request received as a certificate.

The system, for example, uses the following types of queries:

- certificate;

- user ID;

- a user request with an electronic digital signature for streamlining an unstructured input data stream for further use in the system in an object form for further use in the system;

- a participant’s request with an electronic digital signature for searching and using the information object (s) registered in the system;

Having identified the received data as a new certificate, the control unit 6, which is part of the certificate storage and verification device 2, sends it in encoded form to the system 21 registration device, where after decoding it enters the control unit 30, which is part of the system registration device 21, which in turn transfers them to the registration unit of the participants of the system 32, which records that the given user has received a certain certificate, and depending on the type of user (user , a highly qualified user, administrator) assigns him an access level, the certificate registration unit 31 records that this certificate has been issued and assigns a certain identifier (password) to the system participant for the certificate. As the system participant uses the system, the access level may change depending on the information and analytical operations performed by the participant. the device for registering participants in the system 21 transmits data representing a certificate and its corresponding identifier for storage to a memory unit for storing valid and revoked certificates 9, and transmits data on the initial access level assigned to the certificate holder for storage in a memory unit for storing an access level participants in the system 37. After

registration in the system, the user receives the status of a participant in the system.

The participant’s agreement on registration in the system (with the provision of an initial level of access to the system) can be concluded in electronic and / or paper form.

Connecting a user to the system.

The authorization procedure is performed as follows.

Upon the appeal of a system participant, for example, a user transferred from user control device 1 to central control device 3, the user control device 1 is connected to central control device 3. To connect user control device 1 to central control device 3, a system participant enters the user control device 1 personal identification number (password) either from the keyboard, or using a plastic card, or other storage media data that the encoding unit 5 encodes and transmits via communication channels to the input of the certificate storage and verification device 1. From the input of the certificate storage and verification device 1, the data representing an encrypted password is sent to the control unit 6, which is part of the storage and verification device certificates 2. The specified control unit 6 recognizes the type of incoming request as the password of the system participant and transmits this data to the control unit 8, which checks the availability of a valid certificate corresponding to the received pair For this reason, the control unit 10 extracts from the data forming the password the certificate number corresponding to the password, and generates a request using this number, which sends it to the memory unit for storing valid and revoked certificates 9. If in the memory unit for storing valid and revoked certificates 9 the certificate with the requested number is not found among the valid certificates, the control unit 8 generates a command to disconnect the user from the system and sends it to the control unit 6, which is part of the storage device and certificate validation 2, in the case of a positive result

search unit control 10 checks the password matches the certificate found, if the comparison result is negative, then the control unit 8 generates a command to disconnect the user from the system and sends it to the control unit 6, which is part of the storage and certificate verification device 2, otherwise the control unit 8 generates a command that allows the user to work with the system in accordance with his access level, and sends it to the control unit 6, which is part of the storage and verification certificate s 2.

Processing a user’s appeal to the system to streamline the unstructured input data stream for further use in the system in object form

After passing the authorization procedure, the user generates a request using the request generation unit 15. From the request generation unit 15, the request arrives at the user’s EDS generation unit 13, then to the encoding unit 12 and is then transmitted via communication channels to the certificate storage and verification device 2, in which it enters through the decoding unit 4 to the control unit 6, which is part of certificate storage and verification devices 2. The control unit 6, which is part of the certificate storage and verification device 2, recognizes the type of request, extracts from the data corresponding to the request data identifying the participant in the system (for example, EC P), sends the latter to the control unit 8, which checks the compliance of this data with the certificate of a registered participant in the system. In the case of a positive verification result, the control unit 8 generates a command by which the control unit 6, which is part of the storage and certificate verification device 2, sends the data corresponding to the received request through the encoding unit 5 to the input 18 of the central control device 3.

From the input 18 of the centralized control device 3, the specified data through the decoding unit 20 enters the operation process control unit 22. Depending on the type of request, the control unit 33, which is part of the operation process control unit 22, generates commands corresponding to the type of request

and sends them and the received unstructured data to the appropriate blocks and devices. As noted above, in this case, the user turned to the system to streamline the unstructured input data stream for further use in the system in an object form.

The specified control unit 33 generates a command to begin ordering the unstructured input data stream and transmits the generated command to the control unit 43, which is part of the classification and search storage device for ordered data 27. The specified control unit 43 transmits the received command and initial unformalized information to the control device 47, which is included in the device for automated data sequencing 44.

Before starting the processing of the initial informal data, the following are formed:

- source code decryption table;

- linguistic dictionaries of languages understood by the system;

- list of settings;

- a repository of information containing objects with unique generally accepted text identifiers in one or more natural languages .;

- a repository of information containing objects of borrowed libraries

The decryption table of the encoding unit and recognition rules 49 is a collection of lines, in each of which an encoding identifier, signs of its recognition and decoding rules are specified. In the block of encodings and recognition rules 49, it is possible to automatically or semi-automatically filter information that is not of interest to the user from the contour of further processing

Linguistic dictionaries of the block of correlation dependencies of language constructions or dialects 50 represent a single database organized in the form of various language worlds. The world of language within the database is a list of related

to this language of words, word bases, word forms and expressions related, including, by associative connections through correlation dependencies with the corresponding constructions of other natural languages supported by the system. Each database entry describing one language construct contains the identifier of the language or dialect to which it refers. If necessary, a procedure is associated with it that describes the rules for using the structure in the text and its relationship with other language structures.

The list of correlation dependencies of language structures or dialects 50, for example, may include SGML (Standard Generalized Markup Language (СОЯР)), which provides the basic word processing functions required by authors and editors, and it is preferably used in conjunction with the Inter Cap software package (Annapolis, Md.) For creating graphic images. The specified international standard markup language for describing the structure of documents in electronic form creates texts using tags ("tags"). SOYAR is designed to meet the requirements in a wide range of tasks of document processing and information exchange. SOYAR tags make it possible to describe documents in aspects of their content (text, images, etc.) and logical structure (chapters, paragraphs, figures, tables, etc.). In the case of larger and more complex documents in electronic form, this language also provides the ability to describe the physical organization of the document in the form of files. The SOYAR language is designed to be able to describe documents of any kind - simple or complex, long or short - in a form that does not depend on the system or on its practical application. This independence allows documents to be exchanged between different systems for different applications without distorting the meaning or loss of information.

The SOYAR language is a markup language, i.e. a language for “marking" or annotating text with encoded information added to regular text information conveyed by a particular passage of text. In most cases, this is done in

the form of sequences of characters in different places along the entire length of the electronic document. Each such sequence is distinguishable from the text surrounding it with the help of special characters that begin and end it. Software tools can verify the correctness of the markup entered in the text by examining the tags of the СОЯР upon request. This markup is generalized in the sense that it is not specific to any particular system or task. More detailed information on the tags of СОЯР can be found in the International Standard of International standards for Migration (ISO) 8879 “Information Processing - Text and Office Systems - Standard Generalized Markup Language (SMGL) N ISO 8879 - 1986 (Е).

Thanks to the use of SOYAR tags, the following tasks are possible:

a) the division of documents into passages or units available for translation. The software tools of the described system use both punctuation marks and the СОЯР labels to recognize units available for translation in the input text (so, for example, the СОЯР mark is necessary for recognizing section headings);

b) fencing (isolation) of text units that do not require ordering. Although the whole organization is based on the assumption that all words and sentences will be within a given limited language, this can never be fully expected in advance, for example, with regard to last names and addresses, or dictionary classes that are impossible (or very difficult ) classify with comprehensive accuracy (for example, part number or fault signals from equipment). At the beginning and at the end of such text elements, you can put SOYAR labels to show the system that they are excluded from verification;

c) recognition of the content of the document (for example, part numbers) as already indicated (pb);

d) providing the ability to recognize parts of the sentence (for example, selected passages);

e) assisting in the translation of tables (cell by cell) by designating the structure of the text. This task is similar to pp.;

g) assisting the process of grammatical and syntactic analysis with the help of p.p., c, d, and e;

i) assisting in the elimination of ambiguity by providing means for entering invisible labels in the source text to indicate the correct interpretation of the ambiguous sentence;

j) assisting in the translation of currencies and mathematical positions or units by designating special types of text requiring special processing;

k) the provision of means to mark part of the text as being translated. In other words, confirmation that this text has passed the described operations of the system and is an ambiguous text without final editing.

The “borrowed” libraries storage unit 51 contains “borrowed” items (separate files, graphic images, tables, sound information and video information that are stored in the “borrowing” libraries. Types of such libraries include a “borrowing” graphic library, a “borrowing” library tables, a library of "borrowing" of audio information, a library of "borrowing" of video information. "A borrowed position (for example, graphics) is the information to which the information element contains" from link. ”The content of the“ borrowed ”information is displayed on the tool used by the user, but in the information element file it is only“ indicated. ”“ Borrowed ”positions differ from information elements in that they are not“ separate ”(ie themselves by themselves, they do not carry enough information to express essential information.) Each “borrowed” position in itself is a separate file, for example, an information element. A “borrowed” position is entered into memory only once. If such a position is used in separate information elements, only “references to the original borrowed position are entered into the information element, this reduces the required amount of memory on the disk. When the starting position changes, all information elements automatically change,

containing "references" to this position.

The list of settings of the settings block and scenarios for classifying object recognition 53 contains in a formalized form:

- a list of types (classes) of data forming the subject of study by the user;

- a list of the parameters of each type of data, as well as their relationships and relationships;

- a set of algorithmic procedures related to each data type and parameter, responsible for:

- recognition in the source text of the corresponding parameter and its boundaries, and by the totality of the boundaries of all parameters and taking into account additional knowledge - the boundaries of the object in the source text;

- selection of parameter values from the source text and their transfer to the formalized object of information storage.

The information repository is a structured information array accumulated earlier on topics of interest to the user and is used to identify proper names in the source text, as well as to translate into the user's native language the values of those object parameters that use multilingual correspondence. Multilingual compliance can be implemented using:

- the parameter ambiguity attribute (in this case, the parameter value is indicated in the original language and all its translations into the languages supported by the system);

- an interconnected object of exactly the same structure, but containing information in another language, with a separate parameter "used language" for each object;

- using special delimiters in the parameter value field shared by different languages.

The source file or a set of files of an unstructured input data stream is received for processing in encoding and in the languages of the peoples of the world for which the system has been configured and with which it has been trained.

The encoding recognition unit 48 performs:

- recognition of the actual encoding of the text received at the input of the computer system;

- recognition of the language in which the text is composed (including possible options: blocks of text are made in different languages, or texts include fragments of phrases or concepts in other languages, as well as mathematical formulas, graphic images, tables, sound information, video information.

For recognition are used:

- decryption table

- linguistic dictionaries of languages understood by the system, with lists of rules for use in the text of the corresponding language structures;

- "borrowed" libraries.

The decryption table automatically determines the type of encoding. For this, the encoding recognition rules described in the table rows are used.

If the recognition rule is not explicitly expressed or cannot be unambiguously defined in any row of the table, but the decryption rules are defined (they must always be known for a particular encoding, otherwise the presence of a row in the decryption table makes no sense), then a test decryption is performed in an intermediate file, which is then subjected to statistical processing to identify special characters (spaces, periods, commas, etc.), their calculation and correlation with the volume of text. The obtained values are compared with statistical values, on the basis of which a preliminary conclusion is made about the decryption correctness. The final conclusion is made after the selection of the grammatical foundations from the text recorded in the intermediate file and their comparison with the objects of linguistic dictionaries.

For this, the intermediate file is word by word compared with the contents of dictionaries (starting from the dictionary of the user's native language) using the rules of semantic analysis in the block of correlation dependencies of language constructions or dialects 50. Conclusion about the text belonging to the language

done based on the ratio of the number of identified words and the total number of words in the text. Unidentified words and fragments of recognized text are selected and sequentially checked against other dictionaries, starting with the dictionary of English words. The conclusion that the words of unrecognized fragments belong to a particular language is made by the relative ratio of the identified words to the total number of words in the text fragment. Unidentified fragments that are identified by the encoding recognition unit 48 as a graphic image, tables, sound information or video image are distributed in the form of a “borrowed” position with a “reference” to the information element (recognized text) as a separate file in the “borrowed libraries” of the storage unit “Borrowed” libraries 51.

3. As a result of decoding and recognition of the language of the text, an internal intermediate file is formed with markers that determine the unambiguous correspondence of fragments of the text to languages or dialects. Translation of the text or its fragments is not performed.

The file thus formed is fed to the input of the information-logical processing unit in the object form 52, which formalizes the information contained in it by creating a set of interconnected objects (in the particular case it can be just one object, and if there are no data significant for the user in the text, the objects not generated at all). At the same time, in appropriate cases (for text data), property values are translated from the original language to the user's native language.

The conversion process is controlled by a control program that implements:

- recognition of types of forms of presentation of information in the source file (text, table, interview, reference book, graphic image, sound information, video information, etc.) and marking of fragments of the object corresponding to one or another of its forms;

- setting up procedures for the level of the data type to the corresponding structure of the source object by transmitting the necessary information to these procedures;

- alternately calling procedures of the data type level to form objects of the corresponding types.

4. Recognition of the forms of presentation of information in the source text is performed using the attributes inherent in these forms (for example, tabular forms are characterized by the regular alternation of certain characters, the same is true for text in the form of an interview; text in the form of directories has its own laws - the use of proper names, alternating sequences of numbers indicating telephone numbers, etc.), involving the analysis of the contents of the information store (which can be especially useful when analyzing directories). Borders corresponding to various forms of text are marked, which makes it possible in the future to invoke adequate analysis procedures for their processing.

5. The conversion of information into an object form is carried out using a list of settings (figure 1, block 6). The control program initializes the list, alternately looking at the description of data types. In this case, for each type, the procedure of the level of the data type is activated, the tasks of which include:

- the formation of the prototype of a formalized object, the structure of which is described by this type (class) of data;

- determination of the call order and activation of those parameter level procedures that provide recognition of parameters in the source file that correspond to the languages used in the text and the information structure in the file (unstructured text file, tabular file, graphic file, etc.);

- determination of the boundaries of the object in the text based on the results of the methods of the parameter level, and, if necessary, using additional procedures;

- identification of the generated object with the data accumulated in the information store (information store (figure 1, block 5) allows you to identify objects that have their own

names, as well as the conceptual apparatus of the studied subject area).

Class-level methods that form objects function in such a way that they take into account the possibility of describing several objects of the same class with different possibilities for intersecting and nesting descriptions in the source unformalized text.

6. The activated class level method makes the required classification based on the settings and classification scripts stored in the settings block and object recognition classification scripts 53 in a certain order looks at the list of parameters of its class and activates the corresponding parameter recognition method in the source text for each parameter. The choice of method depends on the languages used in the text and its structure (unformalized text, table, interviews, graphics, etc.). Classification may include, for example, searching for occurrences of keywords in an object. The result of the classification, for example, is an indication that this object belongs to a certain class of descriptions according to the classification adopted in the system.

The parameter level method called by identifying signs determines the presence and location of the parameter description in the source text, the boundaries of its description taking into account the contextual dependence, as well as the possibility of describing the parameter in the source text using several spaced fragments. The identified parameter values are transferred to the generated object with their reduction to the internal format of the system. For parameters whose values are set in languages that are foreign to the user, the parameter level method activates the procedure for translating the value into the native language by referring to the appropriate linguistic dictionary, as well as to the information store for analyzing the available values of the same parameters of the accumulated objects of this class in the original language and their comparison with the analyzed value. Upon detection of the required value, its translation is selected and transferred as the value for the considered parameter (property) of the formed object.

In the translation process, the possibility of saving the property value in the original language (as

usually this refers to technology terms and their abbreviations).

The described refers to the substantial properties of the object, i.e. to properties that have a numeric or text value or multimedia display. Properties that describe structural relationships and relationships identify a “borrowed” position, transfer control to the appropriate method of its formation, and after returning control, ensure that the corresponding links are established between objects.

As a result of the procedures described above for all classes described in the settings list, at the output of the block for converting information-logical processing into object form 52, a set of interconnected objects with a structure standardized within the information store is formed, to which typical processing methods and analysis using computer technology and a different level of access. The source data can be archived, backups created, transferred to various recording devices.

The control unit 43, which is part of the device for storing, classifying, and searching for ordered data 27 forms a command to complete the procedure for automatically organizing the unstructured information stream of input data, and transmits structured, ordered, and classified data of the information object in accordance with the thematic direction to the memory block of the ordered data 45 included in the storage device, classification and retrieval of ordered data 27.

Simultaneously with the transmission of ordered data, the control unit 43 generates a command to the control unit 33, which is part of the operation process control unit 22. The operation scenario generation unit 34 sends a command to the ordered data registration device 24. The control unit 38 generates a command and transfers to the document registration unit 39, where the ordered object is assigned the registration number of the formed object with the date of creation of the object and the author

this object (for example, the identifier of the participant, in this case, the user identifier) and reports it to the memory unit for storing intermediate documents 40. Then, the control unit 38 transmits a control command about the use of the newly formed object and the registration number assigned to it.

The control unit 33, which is part of the process control unit of operation 22, will interact with other units and devices that are part of the system and control their operation. The specified control unit 33 sends the generated registration command to the generation script for the operation 34. As a result, the generation script for the operation 34 at certain times specified by the generated script controls the operation of the central control device 3 in accordance with the type of operation.

The control unit 33, which is part of the operation process control unit 22, in accordance with the script being executed, generates in the control unit 41 the control and analysis of operations between the participants in the system 25 and transmits a command notifying that a new object has been registered in the system. The control unit 41 in response to the received command sends the command to the notification unit of the participants of the system 42, in accordance with which the notification unit of the participants of the system 42 generates a message for the user with a certain access level and sends this message to the encoding unit 26 and then to the user response generation unit 16 included in the user control device 1.

Processing an appeal to the participant’s system for searching and using the information object (s) registered in the system.

Upon the appeal of a system participant, for example, a user transferred from user control device 1 to central control device 3, the user control device 1 is connected to central control device 3. To connect the user control device

1 to the centralized control device 3 a participant in the system enters his identification number 1 (password) into the user control device 1 either from the keyboard or using a plastic card or other storage media, which the encoding unit 12 encodes and transmits via communication channels to the input of the storage device and certificate verification 2. From the input of the storage device and certificate verification 2 data representing an encrypted password is sent to the control unit 6, which is part of the storage and verification device typhicates 2. The specified control unit 6 recognizes the type of incoming request as the password of the system participant and transmits this data to the control unit 8, which checks for a valid certificate corresponding to the received password, for which the control unit 8 extracts from the data forming the password the number corresponding to the certificate password , and by this number generates a request that sends to the memory block for storing valid and revoked certificates 9. If in the memory block for storing valid and revoked certificates 9, the certificate with the requested number is not found among the valid certificates, the control unit 8 generates a command to disconnect the user from the system and sends it to the control unit 6, which is part of the certificate storage and verification device 2, if the search result is positive, the control unit 8 checks the password matches the certificate found, if the comparison result is negative, then the control unit 8 generates a command to disconnect the user from the system and sends it to the control unit 6, which is included in leaving the device for storage and verification of certificates 2, in the opposite case, the control unit 8 generates a command that allows the user to work with the system in accordance with his access level, and sends it to the control unit 6, which is part of the storage and verification of certificates 2.

After passing the authorization procedure, the user generates a request using the request generation unit 15. From the request generation unit 15, the request is sent to the user’s digital signature generation unit 13, then to the encoding unit 12 and then transmitted

through communication channels, to the certificate storage and verification device 2, in which it enters through the decoding unit 4 to the control unit 6, which is part of the certificate storage and verification device 2. The control unit 6, which is part of the certificate storage and verification device 2, recognizes type of request, selects from the data corresponding to the request, the data identifying the participant in the system (for example, EDS), sends the latter to control unit 8, which checks the compliance of this data with the certificate of the registered participant of the system we. In the case of a positive verification result, the control unit 8 generates a command by which the control unit 6, which is part of the storage and certificate verification device 2, sends the data corresponding to the received request through the encoding unit 5 to the input 18 of the central control device 3.

From the input 18 of the centralized control device 3, the specified data through the decoding unit 20 enters the operation process control unit 22. Depending on the type of request, the control unit 33, which is part of the operation process control unit 22, generates a command corresponding to the type of request and sends it to the corresponding blocks and devices. As noted above, in this case, the user turned to the system to search and use an ordered structured object (s) of information.

Having received such a request, the specified control unit 33 transmits a request for the current access level of the participant to the control unit 35, which is part of the data generation and storage unit for the participants of the system 23. The specified control unit 35 in accordance with the received command determines the user access level based on the information stored in the memory unit for storing the access level of participants 96 and transmits a response about the current level of customer access to the control unit 33.

The specified control unit 33 generates a command about connecting a database of ordered objects of information stored in the storage device, classification and search of ordered data 27, and transmits the generated command, which indicates, in particular,

user access rights to the control unit 43, which is part of the storage device classification and search for ordered data 27.

The specified control unit 43 generates a command to select the object (s) from the database, and taking into account the user access rights, extracts the desired object (s) from the ordered data memory unit 45, which is part of the classification and search data storage device 27.

The control unit 43, in cooperation with the data object search forming unit 46, selects elements from the generated list of objects indicated by the participant. The control unit 43 generates a list of objects that a participant in the system wants to use, and sends it to the control unit 33, which is part of the process control unit 22.

The specified control unit 33, having determined the type of incoming request (in this case, it is a request to search for the object (s) registered in the system, generates a command corresponding to the type of request and sends it to the block for generating the operation scenario 34, the specified block sends the command to the document registration block 39. Having received the appropriate command, the document registration unit 39, which assigns a registration number to the generated request and reports it to the formation of the script for the operation 34. After that, about the block for generating the scenario of the operation 34 transmits the request and registration number for storage to the memory unit for storing copies of intermediate documents 40. Having determined by the type of request the type of request (in this example, it is searching for an object (objects) registered in the system, the process control unit 38 generates a response to the request, presented in the form of a set of commands, in accordance with which and with the given parameters (parameters can be set either by default or directly by the participants of the system) control unit Aviation 33, which is part of the process control unit 22, will interact with other units and devices that are part of the system and manage their work. As a result, the script generation block for the operation 34 at certain points in time specified

the generated scenario, controls the operation of the centralized control device 3 in accordance with the type of request.

The control unit 33, which is part of the operation process control unit 22, in accordance with the executed scenario generates in the control unit 41 the control and analysis of operations between the participants in the system 25 and transmits a command notifying that the registered object has been removed from the system. The control unit 41 in response to the received command sends the command to the notification unit of the participants of the system 42, in accordance with which the notification unit of the participants of the system 42 generates a message for the user with a certain access level and sends this message to the encoding unit 26 and then to the user response generation unit 16 included in the user control device 1.

In the system, a memory device of a personal computer is used as a memory device, and processor units of a personal computer are used as control devices. All other operations with functional devices and blocks are carried out by personal computer software.

Industrial applicability

The claimed system can be made from industrially manufactured components by known methods. This utility model can be used in any systems associated with the processing of large, heterogeneous data streams.

Although the utility model is described through examples of its implementation, the scope of legal protection is not limited to these examples, but is determined by the formula of the utility model, taking into account possible equivalents.

Literature

1. International standard MOS (ISO) 8879 “Information processing - Text and office systems - Standard generalized markup language (SMGL) N ISO 8879 - 1986.

Claims (8)

1. A system for automated ordering of an unstructured input data stream, including at least one user device connected via a communication channel to a centralized control device, which includes a system user registration device, a decoding unit, a coding unit, a process control device operations, a device for storing, classifying and searching ordered data, a device for generating and storing data for users of systems recording ordered data and an operation monitoring and analysis device, said system user registration device being connected to an output of said decoding unit and an output of said encoding unit, said operation process control device being connected to an output of said decoding unit and an input of said encoding unit, as well as with said a device for storing, classifying and searching for ordered data, said operation process control device, a forming device data storage and storage by system participants, an ordered data recording device and an operation monitoring and analysis device are interconnected, said operation monitoring and analysis device is connected to an input of said encoding unit, said ordered data storage, classification and search device contains a control unit, an automated device data sequencing, an ordered data memory unit and a data object search generating unit, wherein said ordered data unit is connected to an input of said automated data sequencing device and said data object search generating unit, said ordered data memory unit is connected to said automated data ordering device and to said data object searching generating unit, said automated data ordering device comprises a control unit, an encoding recognition unit , a block of encodings and recognition rules, at least one block of correlation dependencies languages or dialects, at least one block for storing borrowed libraries, a block for information and logical processing of an object into an object form, a block for settings and scripts for classifying object recognition, said block for encoding recognition being connected to at least one said block of correlation dependencies constructions of languages or dialects, with said block of encodings and recognition rules and output of said control unit, said block of information and logical processing of an object in an object form, it is connected to said block of settings and scripts for classifying recognition of objects, with the output of said block of encoding recognition and the input of said control unit, said at least one said block of correlation dependencies of language structures or dialects, and at least one said block storing borrowed libraries interconnected. 2. The automated ordering system of the unstructured input data stream according to claim 1, characterized in that the certificate storage and verification device, which comprises a decoding unit, an encoding unit, a control unit, a memory unit for storing information about a system user, a control unit and a memory unit for storing valid and revoked certificates, said control unit being connected to said memory unit for storing information about a system user, said memory unit for I existing storage and certificate revocation and said control unit and with an output of said decoding unit and the input of said coding unit. 3. The system for automated sequencing of an unstructured input data stream according to claim 1, characterized in that at least one user control device that comprises a decoding unit, an identification unit, an encoding unit, an electronic digital signature generation unit, a control unit, a unit generating a user request, a user response generating unit, said identification unit being connected to an output of said decoding unit and an input of said control unit, said electronic digital signature generating unit is connected to an output of said control unit, to an input of said encoding unit and to an output of said operation execution signal generating unit, said control unit is connected to said user request generating unit and said user response generating unit. 4. The system for automated ordering of an unstructured input data stream according to claim 1, characterized in that the system user registration device, which comprises a decoding unit, an encoding unit, a control unit, a certificate registration unit and a system user registration unit, wherein said control unit is connected to said certificate registration unit and said system user registration unit, as well as the output of said decoding unit and the input of the encoding unit Niya. 5. The system for automated ordering of an unstructured input data stream according to claim 1, characterized in that the operation process control device comprises interconnected control unit and an operation scenario generation unit. 6. The system for automated ordering of the unstructured input data stream according to claim 1, characterized in that the device for generating and storing data for users of the system comprises a control unit, a memory unit for storing system user details and a memory unit for storing a system user access level, said the control unit is connected to said memory unit for storing user details of the system and said memory unit for storing user access level of the system we. 7. The automated ordering system of the unstructured input data stream according to claim 1, characterized in that the ordered data recording device comprises a control unit, a document registration unit and a memory unit for storing intermediate documents, said control unit being connected to said document registration unit and said a memory unit for storing intermediate documents. 8. The system for automated sequencing of an unstructured input data stream according to claim 1, characterized in that the operation monitoring and analysis device comprises a control unit and a system user alert unit, the outputs of said units being interconnected, the additional output of said control unit being connected to said unit system user alerts.