CN110377881B - Integration method, device and system of text processing service - Google Patents

Integration method, device and system of text processing service Download PDF

Info

Publication number
CN110377881B
CN110377881B CN201910502727.2A CN201910502727A CN110377881B CN 110377881 B CN110377881 B CN 110377881B CN 201910502727 A CN201910502727 A CN 201910502727A CN 110377881 B CN110377881 B CN 110377881B
Authority
CN
China
Prior art keywords
text processing
operator
algorithm
configuration information
text
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910502727.2A
Other languages
Chinese (zh)
Other versions
CN110377881A (en
Inventor
乔彦辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Advanced New Technologies Co Ltd
Advantageous New Technologies Co Ltd
Original Assignee
Advanced New Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Advanced New Technologies Co Ltd filed Critical Advanced New Technologies Co Ltd
Priority to CN201910502727.2A priority Critical patent/CN110377881B/en
Publication of CN110377881A publication Critical patent/CN110377881A/en
Application granted granted Critical
Publication of CN110377881B publication Critical patent/CN110377881B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/103Formatting, i.e. changing of presentation of documents
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/12Use of codes for handling textual entities
    • G06F40/151Transformation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/166Editing, e.g. inserting or deleting

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Document Processing Apparatus (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The application provides an integration method, an integration device and an integration system of text processing services, wherein the integration method of the text processing services comprises the following steps: acquiring a deployment request submitted by a user aiming at a text processing algorithm, and displaying an algorithm integration interface according to the deployment request; determining a text processing operator selected by a user at the algorithm integration interface for the text processing algorithm; acquiring configuration information for configuring the text processing operator; and calling an algorithm integration engine to integrate the text processing operator and the configuration information to obtain text processing service corresponding to the text processing algorithm. By the integration method of the text processing service, the text processing service required by a user can be quickly integrated, the development time of the text processing service is reduced, the text processing service can be online in a short time, and the online speed of the text processing service is improved.

Description

Integration method, device and system of text processing service
Technical Field
The present application relates to the field of communications technologies, and in particular, to an integration method for text processing services. The application also relates to an integrated device of the text processing service, an integrated system of the text processing service, a computing device and a computer readable storage medium.
Background
With the rapid development of the mobile internet, the dependence on the smart phone is more and more, and more information is brought to various aspects. The contents of important news and the like occurring around the world can be known more easily through the contacted information, and in the case of acquiring the information through the network, the bad information can be spread through the network, so that the acquired information becomes impure enough.
At present, the work of purifying bad information in the acquired information becomes one of the important works of a platform for providing the information, in order to avoid the propagation of the bad information, the bad information is shielded by identifying and positioning the bad information related to massive text information, so that the bad information is prevented from generating bad influence on the society, and further, the information obtained by a user is enabled to be pure enough.
In the prior art, to recognize and position a text, firstly an algorithm needs to be determined and modeling is performed according to the algorithm, secondly a user who needs to provide the algorithm during modeling speaks relevant knowledge about text processing and recognition for a user with development capability, and finally the user with development capability can develop and deploy a relevant service platform for text processing under the condition that the user learns the relevant knowledge about text processing and recognition.
Disclosure of Invention
In view of this, the present application provides an integration method of text processing services. The application also relates to an integrated device of the text processing service, an integrated system of the text processing service, a computing device and a computer readable storage medium, which are used for solving the technical defects in the prior art.
According to a first aspect of embodiments of the present application, there is provided an integration method of a text processing service, including:
acquiring a deployment request submitted by a user aiming at a text processing algorithm, and displaying an algorithm integration interface according to the deployment request;
determining a text processing operator selected by a user at the algorithm integration interface for the text processing algorithm;
acquiring configuration information for configuring the text processing operator;
and calling an algorithm integration engine to integrate the text processing operator and the configuration information to obtain text processing service corresponding to the text processing algorithm.
Optionally, the obtaining configuration information for configuring the text processing operator includes:
acquiring first configuration information configured by the user for the text processing operator, and calling an operator configuration component to configure second configuration information for the text processing operator;
and integrating the first configuration information and the second configuration information, and generating the configuration information of the text processing operator according to an integration result.
Optionally, the obtaining configuration information for configuring the text processing operator includes:
acquiring first configuration information configured by the user for the text processing operator, and taking the first configuration information as configuration information of the text processing operator;
or
And calling an operator configuration component to configure second configuration information for the text processing operator, and taking the second configuration information as the configuration information of the text processing operator.
Optionally, after the step of determining the text processing operator selected by the algorithm integration interface for the text processing algorithm is executed and before the step of obtaining the configuration information for configuring the text processing operator is executed, the method includes:
determining a processing order of each text processing operator of a plurality of text processing operators in case a plurality of text processing operators are selected for the text processing algorithm;
correspondingly, the obtaining configuration information for configuring the text processing operator includes:
and acquiring configuration information for configuring each text processing operator.
Optionally, the invoking an algorithm integration engine integrates the text processing operator and the configuration information to obtain a text processing service corresponding to the text processing algorithm, including:
and calling the algorithm integration engine to integrate each text processing operator and the configuration information corresponding to each text processing operator according to the processing sequence of each text processing operator to obtain the text processing service.
Optionally, the invoking an algorithm integration engine integrates the text processing operator and the configuration information to obtain a text processing service corresponding to the text processing algorithm, including:
determining input variable information and output variable information of each text processing operator;
standardizing the input variable information and the output variable information according to the processing sequence of each text processing operator, wherein the obtained output variable information of the previous text processing operator and the obtained input variable information of the next text processing operator have the same format;
and calling the algorithm integration engine to integrate the text processing operator subjected to standardized processing and the configuration information to obtain the text processing service.
Optionally, before the step of integrating the text processing operator and the configuration information by using the algorithm-invoking integration engine to obtain the text processing service corresponding to the text processing algorithm is executed, the method includes:
loading a loading packet of the text processing algorithm uploaded by the user;
analyzing the loading package to obtain an added text processing operator contained in the loading package and configuration information of the added text processing operator;
correspondingly, the calling algorithm integration engine integrates the text processing operator and the configuration information to obtain a text processing service corresponding to the text processing algorithm, and the method comprises the following steps:
and calling the algorithm integration engine to integrate the text processing operator, the added text processing algorithm, the configuration information and the configuration information of the added text processing operator to obtain the text processing service.
Optionally, the substep of calling the algorithm integration engine to integrate the text processing operator and the added text processing algorithm with the configuration information of the added text processing operator to obtain the text processing service includes:
standardizing the input variable information and the output variable information of the added text processing operator, wherein the input variable information and the output variable information of the added text processing operator obtained according to a standardized processing result have the same format as that of the input variable information and the output variable information of the text processing operator;
and calling the algorithm integration engine to integrate the text processing operator, the normalized added text processing algorithm, the configuration information and the configuration information of the added text processing operator to obtain the text processing service.
Optionally, the invoking an algorithm integration engine integrates the text processing operator and the configuration information to obtain a text processing service corresponding to the text processing algorithm, including:
determining input variable information and output variable information of the text processing operator;
standardizing the input variable information and the output variable information to obtain input variable information and output variable information with the same format;
and calling the algorithm integration engine to integrate the text processing operator subjected to the standardized processing and the configuration information to obtain the text processing service.
Optionally, after the step of determining that the user executes the text processing operator selected by the algorithm integration interface for the text processing algorithm, and before the step of calling the algorithm integration engine to integrate the text processing operator and the configuration information to obtain the text processing service corresponding to the text processing algorithm is executed, the method includes:
determining input variable information, output variable information and intermediate variable information of the text processing operator, and storing the input variable information, the output variable information and the intermediate variable information;
under the condition that the algorithm integration engine integrates the text processing operator and the configuration information and error reporting occurs, determining error reporting information by detecting the stored input variable information, the stored output variable information and the stored intermediate variable information, wherein the error reporting information comprises an error reporting text processing operator;
debugging input variable information, output variable information and/or intermediate variable information of the error-reporting text processing operator through a debugging component based on the error-reporting information to obtain a text processing operator without error reporting;
correspondingly, the calling algorithm integration engine integrates the text processing operator and the configuration information to obtain a text processing service corresponding to the text processing algorithm, and the method comprises the following steps:
and calling the algorithm integration engine to integrate the text processing operators which are not reported in error and the configuration information to obtain the text processing service.
Optionally, after the step of integrating the text processing operator and the configuration information by using the algorithm-calling integration engine to obtain the text processing service corresponding to the text processing algorithm is executed, the method includes:
and adding identification information to the text processing service corresponding to the text processing algorithm, and displaying the identification information to the user on the algorithm integration interface.
According to a second aspect of embodiments of the present application, there is provided an integrated apparatus of a text processing service, including:
the system comprises an acquisition deployment request module, a display module and a display module, wherein the acquisition deployment request module is configured to acquire a deployment request submitted by a user aiming at a text processing algorithm and display an algorithm integration interface according to the deployment request;
a determination operator module configured to determine a text processing operator selected by a user at the algorithm integration interface for the text processing algorithm;
the configuration information acquisition module is configured to acquire configuration information for configuring the text processing operator;
and the integration module is configured to call an algorithm integration engine to integrate the text processing operator and the configuration information to obtain text processing service corresponding to the text processing algorithm.
According to a third aspect of embodiments of the present application, there is provided an integrated system of text processing services, including:
the system comprises a service platform, an operator configuration component, a standardization component and an algorithm integration engine;
the service platform is configured to receive a deployment request submitted by a user for a text processing algorithm, and display an algorithm integration interface to the user according to the deployment request; determining a text processing operator selected by a user at the algorithm integration interface aiming at the text processing algorithm, and sending the text processing operator to the operator configuration component and the standardization component;
the operator configuration component is configured to receive the text processing operator sent by the service platform and generate configuration information of the text processing operator; sending the configuration information to the algorithm integration engine;
the standardization component is configured to receive the text processing operator sent by the service platform, and standardize input variable information and output variable information of the text processing operator to obtain input variable information and output variable information of the text processing operator in the same format; sending the text processing operator subjected to the standardization processing to the algorithm integration engine;
the algorithm integration engine is configured to receive the configuration information sent by the operator configuration component, receive a text processing operator which is sent by the standardization component and is subjected to standardization processing, integrate the configuration information with the text processing operator which is subjected to standardization processing, and obtain text processing service corresponding to the text processing algorithm.
According to a fourth aspect of embodiments herein, there is provided a computing device comprising:
a memory and a processor;
the memory is to store computer-executable instructions, and the processor is to execute the computer-executable instructions to:
acquiring a deployment request submitted by a user aiming at a text processing algorithm, and displaying an algorithm integration interface according to the deployment request;
determining a text processing operator selected by a user at the algorithm integration interface for the text processing algorithm;
acquiring configuration information for configuring the text processing operator;
and calling an algorithm integration engine to integrate the text processing operator and the configuration information to obtain text processing service corresponding to the text processing algorithm.
According to a fifth aspect of embodiments herein, there is provided a computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the steps of any one of the methods of integrating text processing services.
The integration method of the text processing service provided by the application determines that the user needs a text processing algorithm by acquiring a deployment request submitted by the user, according to the deployment request, the user displays an algorithm integration interface, aims at the text processing algorithm according to the user, the text processing operator selected by the user is determined by the algorithm integration interface, the configuration information of the text processing operator is acquired at the same time, the algorithm integration engine is called, the text processing operator is integrated with the configuration information, the text processing service corresponding to the text processing algorithm is acquired, and through the integration method of the text processing service, the development process of the text processing service is simplified, the user developing the text processing service can realize the development of the text processing service without deep knowledge in the development process of the text processing service, the development time of the text processing service is reduced, and the online speed of the text processing service is improved.
Drawings
FIG. 1 is a flow chart of an integrated method of text processing services provided by an embodiment of the present application;
FIG. 2 is a process flow diagram of an integration process of a text processing service provided by an embodiment of the present application;
FIG. 3 is a schematic structural diagram of an integrated apparatus for text processing service according to an embodiment of the present application;
FIG. 4 is a schematic structural diagram of an integrated system of text processing services according to an embodiment of the present application;
FIG. 5 is a schematic structural diagram of an integrated system of a second text processing service provided in an embodiment of the present application;
fig. 6 is a block diagram of a computing device according to an embodiment of the present application.
Detailed Description
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. This application is capable of implementation in many different ways than those herein set forth and of similar import by those skilled in the art without departing from the spirit of this application and is therefore not limited to the specific implementations disclosed below.
The terminology used in the one or more embodiments of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the one or more embodiments of the present application. As used in one or more embodiments of the present application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used in one or more embodiments of the present application refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It will be understood that, although the terms first, second, etc. may be used herein in one or more embodiments of the present application to describe various information, these information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, a first aspect may be termed a second aspect, and, similarly, a second aspect may be termed a first aspect, without departing from the scope of one or more embodiments of the present application. The word "if" as used herein may be interpreted as "at" \8230; "or" when 8230; \8230; "or" in response to a determination ", depending on the context.
First, the noun terms to which one or more embodiments of the present invention relate are explained.
NLP: natural Language Processing (Natural Language Processing) is a sub-domain of Artificial Intelligence (AI).
Text content identification: the technology of automatically identifying the text by using a computer mainly relates to identifying whether the content of the text contains abnormal information, determining the type of the content contained in the text by identifying keywords of the text, and determining whether the type of the text is a normal text by determining the type of the content contained in the text, wherein the abnormal information specifically refers to information such as unhealthy information, and the normal text specifically refers to information such as text content conforming to health information.
An algorithm model: the method mainly comprises the steps of modeling a text processing algorithm, and then generating a model and an algorithm logic of the text processing algorithm.
Deploying a platform: the method mainly comprises the step of issuing a model corresponding to a text processing algorithm and an algorithm logic into a service for a specific scene to call.
Operator: the method is a mapping from a function space to a function space, an operator can be considered when any function is subjected to a certain operation, even the power is solved, an operator can be considered when an evolution is carried out, for example, a probability P { X < X }, a probability is a mapping of a set { X < X } (belonging to a subset of a real number set) to a [0,1] interval, a real number domain and the [0,1] interval can be mapped one by one, so that a probability symbol P is taken, the operator is considered to be a mapping, a relation or a transformation.
SPI interface: service Provider Interface (SPI Interface) is a Service discovery mechanism built in JDK, and at present, SPI Interface is used in many frameworks to implement Service extension, which can be understood as a dynamic replacement mechanism.
In the present application, an integrated method of text processing services is provided. The present application also relates to an integration apparatus of a text processing service, an integration system of a text processing service, a computing device, and a computer-readable storage medium, which are described in detail one by one in the following embodiments.
Fig. 1 shows a flowchart of an integrated method of text processing services provided according to an embodiment of the present application, including steps 102 to 108.
Step 102: and acquiring a deployment request submitted by a user aiming at the text processing algorithm, and displaying an algorithm integration interface according to the deployment request.
In an embodiment of the present application, the user may be a party who deploys the text processing service, that is, a party who needs to deploy the text processing service, where the algorithm integration interface is a service interface provided for a service end of a deployment platform, and is an interface for integrating the text processing service by the user, and in the algorithm integration interface, the user may select different components according to a text processing algorithm of the user, and integrate the components into the text processing service corresponding to the text processing algorithm of the user.
Here, an integration method of the text processing service will be described by taking as an example that the text processing service has text preprocessing, text word segmentation, word vector conversion, model scoring, and score mapping. Based on this, when the user acquires information through the network, the acquired information may not be pure enough (illegal information or unhealthy information exists in the information), and the information providing platform performs text recognition on the information before providing the information to the user again, recognizes abnormal information existing in the information, and eliminates the existing abnormal information to ensure that the information provided to the user is pure enough; therefore, the text recognition service plays an important role in recognizing spam or abnormal information.
The integration method of text processing service that this application provided for can be quick for the user provides required text processing service, acquire the user and aim at the deployment request that text processing algorithm submitted, according to deployment request show algorithm integration interface, simultaneously according to the user is in algorithm integration interface is to the text processing operator that text processing algorithm selected, and acquire the configuration information of text processing operator, through transferring algorithm integration engine is right text processing operator and configuration information integrates, obtains text processing algorithm corresponds text processing service has realized quick for the user has provided text processing service that text processing algorithm corresponds, and the development of simplification text processing service's development process has reduced the development time, even the user is not enough understanding to the development process, still can pass through algorithm integration interface realizes the development text processing service, and then has realized the quick online of text processing service.
Specifically, the text processing service development platform that generates the text processing service displays an algorithm integration interface of the text processing algorithm to the user according to a deployment request for the text processing algorithm deployment, which is submitted by the user.
In specific implementation, the algorithm integration Interface is a User operation Interface for generating the text processing service, different UI (User Interface) controls are provided for a User in the Interface, each UI control corresponds to a component required to be used in an integration process in a text processing service development platform, the User can select different UI controls according to requirements, and the text processing service development platform provides corresponding services for the User according to attributes of the UI controls selected by the User to generate functions required by the User.
Based on this, the above steps may be implemented by a service platform in an integrated system of the text processing service, and the specific implementation manner may refer to the description content in the integrated system of the text processing service, which is not described herein again.
Step 104: and determining the text processing operator selected by the user at the algorithm integration interface aiming at the text processing algorithm.
Specifically, on the basis of displaying the algorithm integration interface to the user according to the deployment request of the user, a text processing operator is further selected for the text processing algorithm according to a selection instruction of the user on the algorithm integration interface.
In specific implementation, under the condition that the text processing algorithm includes text preprocessing, text word segmentation, word vector conversion, model scoring and score mapping, the user selects a text processing operator for the content included in the text processing algorithm, corresponds to the text preprocessing operator for the text preprocessing selection, selects a corresponding text word segmentation operator for the text word segmentation, selects a corresponding word vector conversion operator for the word vector conversion, selects a corresponding model scoring operator for the model scoring, and selects a corresponding score mapping operator for the score mapping, wherein each operator has a corresponding component in a service platform bearing the algorithm integration interface.
Based on this, the above steps may be implemented by a service platform in an integrated system of the text processing service, and specific implementation manners may refer to descriptions in the integrated system of the text processing service, which are not described herein again.
In addition, more processing processes exist in the text processing service, if operators corresponding to each text processing process in the text processing algorithm are displayed on the algorithm integration interface, under the condition that display space is insufficient, operators of the same type of text processing process can be integrated under one UI control, a user can select the text processing operators according to the type of the operators, and excessive text processing operators can be effectively reduced from being displayed to the user at one time.
Based on the above text processing operator selected for the text processing algorithm, further, in one or more implementations of this embodiment, when there are multiple text processing operators, the processing order of each text processing operator needs to be determined, which is specifically implemented as follows:
determining a processing order of each text processing operator of a plurality of text processing operators in case a plurality of text processing operators are selected for the text processing algorithm;
executing the following step 106 under the condition that a plurality of text processing operators are selected for the text processing algorithm, and acquiring configuration information for configuring the text processing operators; step 106 specifically refers to acquiring configuration information for configuring each text processing operator.
Specifically, under the condition that a plurality of text processing procedures exist in the text processing algorithm, a user needs to select corresponding text processing operators respectively for the plurality of text processing procedures on the algorithm integration interface, and the processing sequence of each text processing operator is determined, so that integration is performed according to the processing sequence of each text processing operator in the subsequent text processing operator integration process, and the text processing procedure provided by the text processing service is ensured to be correct.
In specific implementation, the text processing process included in the text processing algorithm may be understood as a text recognition process or a text word segmentation process included in the text processing algorithm.
Here, in the case that the text processing algorithm does not have a plurality of text processing operators, it is described that the text processing algorithm only includes one text processing procedure, and the user only needs to select a text processing operator for the one text processing procedure in the algorithm integration interface.
Based on this, the above steps may be implemented by a service platform in an integrated system of the text processing service, and the specific implementation manner may refer to the description content in the integrated system of the text processing service, which is not described herein again.
For example, a user creates a text recognition algorithm, which includes two steps of text recognition and text segmentation, wherein the text recognition is performed before and the text segmentation is performed after, the user develops the text recognition algorithm through a service platform bearing an algorithm integration interface, selects a text recognition operator corresponding to the text recognition, and selects a text segmentation operator corresponding to the text segmentation, so that the finally developed text recognition service corresponding to the text recognition algorithm includes the text recognition and the text segmentation, and the text recognition is recognized first and then the recognized text is segmented in the text recognition process.
And under the condition that the text processing algorithm has a plurality of text processing operators, determining the processing sequence of each text processing operator, so that the finally developed text processing service performs text processing according to the processing sequence of the text processing operators, and the correctness of the text processing process in the text processing service is ensured.
Step 106: and acquiring configuration information for configuring the text processing operator.
Specifically, on the basis of determining the text processing operator selected by the user for the text processing algorithm, further, configuration information configured on the text processing operator is obtained, where the configuration information may be a code or a function.
Based on this, when the service platform bearing the algorithm integration interface configures codes or functions for the text processing operators, when the configured codes or functions are incomplete, the user can actively configure the codes or functions for the missing codes or functions, and when the user actively supplements the missing codes or functions, the service platform bearing the algorithm integration interface can be integrated with the codes or functions configured by the service platform according to the codes or functions supplemented by the user, and the integrated codes or functions serve as configuration information of the text processing operators.
In the above case of obtaining the configuration information of the text processing operator, in one or more embodiments of this embodiment, there are two ways to obtain the configuration information, and the specific obtaining way is as follows:
acquiring first configuration information configured by the user for the text processing operator, and calling an operator configuration component to configure second configuration information for the text processing operator;
and integrating the first configuration information and the second configuration information, and generating the configuration information of the text processing operator according to an integration result.
Specifically, under the condition that a user selects a text processing operator for the text processing algorithm, a service platform bearing the algorithm integration interface configures second configuration information for the text processing operator by calling an operator configuration component, wherein the second configuration information specifically refers to configuration of bottom-layer basic configuration information (codes) for the text processing operator, and the configuration information provided by the second configuration information is large in size, so that configuration information actively configured by the user can be effectively reduced; at this time, the user may also actively configure the first configuration information for the text processing operator, where the first configuration information user may add the first configuration information through an SPI interface set in a service platform that carries the algorithm integration interface, and integrate the first configuration information and the second configuration information to use the integrated configuration information as the configuration information of the text processing operator.
In specific implementation, the SPI interface may be understood as an implementation that a service needs to be dynamically added through the interface when the service needs to be added.
In practical application, taking 300 lines of codes needed for developing the text processing service as an example, the configuration information of the acquired text processing operator is described, wherein 300 lines of codes are needed for developing the text processing service, the text processing service is developed through a service platform, a user selects the text processing operator contained in the text processing service and acquires a configuration code configured for the text processing operator by an operator configuration component of the service platform, 270 lines of the configuration code are provided, and the user can be determined to be still lack 30 lines of codes for developing the text processing service, the service platform prompts the user according to the lack of codes, and the user can supplement the 30 lines of codes according to prompt, so that the text processing operator can develop the text processing service in a subsequent integration process.
In specific implementation, development codes needed for developing text processing services are huge, and the development codes are configured for the text processing services through a service platform, so that the huge development codes are effectively reduced.
In the above case of obtaining the configuration information of the text processing operator, in one or more embodiments of this embodiment, there are two ways to obtain the configuration information, and the specific obtaining way is as follows:
acquiring first configuration information configured by the user for the text processing operator, and taking the first configuration information as configuration information of the text processing operator;
or
And calling an operator configuration component to configure second configuration information for the text processing operator, and taking the second configuration information as the configuration information of the text processing operator.
Specifically, under the condition that first configuration information actively configured for the text processing operator by the user is complete enough, the first configuration information can be used as configuration information of the text processing operator, and a service platform bearing the algorithm integration interface is not required to call the operator configuration component to configure information for the text processing operator; or under the condition that the second configuration information configured for the text processing operator by calling the operator configuration component is complete enough by the service platform bearing the algorithm integration interface, the second configuration information can be used as the configuration information of the text processing operator, and a user does not need to configure information for the text processing operator.
Based on this, the above steps may be implemented by an operator configuration component in an integrated system of a text processing service, and the specific implementation manner may refer to the description in the integrated system of the text processing service, which is not described herein again.
By acquiring the first configuration information actively provided by the user and the second configuration information configured by the operator configuration component, the configuration information provided by the user for developing the text processing service can be effectively reduced, the development efficiency for developing the text processing service is improved, and the online speed of the text processing service is accelerated.
Step 108: and calling an algorithm integration engine to integrate the text processing operator and the configuration information to obtain text processing service corresponding to the text processing algorithm.
Specifically, on the basis of obtaining the configuration information of the text processing operator, further, a service platform bearing the algorithm integration interface integrates the configuration information and the text processing operator by calling the algorithm integration engine, so as to obtain a text processing service corresponding to the text processing algorithm.
In general, the text processing algorithm includes a plurality of text processing procedures, and when selecting the text processing operator, the text processing operator corresponding to the plurality of text processing procedures is respectively selected, and in the process of integrating by the algorithm integration engine, the text processing service obtained by integrating the plurality of text processing operators and the configuration information corresponding to each text processing operator is integrated together, and the text processing service obtained by integrating includes services of the plurality of text processing procedures.
For example, the text processing algorithm includes a text recognition algorithm and a text word segmentation algorithm, and in the process of integration by the algorithm integration engine, an operator of the text recognition algorithm and an operator of the text word segmentation algorithm, configuration information corresponding to the operator of the text recognition algorithm and configuration information corresponding to the operator of the text word segmentation algorithm are integrated, so that the obtained text processing service includes text recognition and text word segmentation.
Based on this, the above steps may be implemented by an algorithm integration engine in an integration system of the text processing service, and the specific implementation manner may refer to the description in the integration system of the text processing service, which is not described herein again.
In one or more embodiments of this embodiment, when there are multiple text processing operators, integration needs to be performed in order, and the specific implementation is as follows:
and calling the algorithm integration engine to integrate each text processing operator and the configuration information corresponding to each text processing operator according to the processing sequence of each text processing operator to obtain the text processing service.
Specifically, under the condition that the text processing algorithm corresponds to a plurality of text processing operators, the processing order of each text processing operator needs to be determined, and the configuration information of each text processing operator needs to be determined.
In practical application, the text processing algorithm includes a text recognition algorithm and a text word segmentation algorithm as an example, and the integration is performed according to the processing sequence of each text processing operator, wherein the processing sequence is that the text recognition is performed before the text is subjected to word segmentation, and the integration is performed according to the processing sequence in the process of the integration by the algorithm integration engine to obtain a text processing service, the text can be recognized and word segmentation in the obtained text processing service, the text is recognized first in the process of processing the text, the recognition result is used as the input of word segmentation processing, and finally the text subjected to word segmentation is obtained.
Based on this, the above steps may be implemented by an algorithm integration engine in an integration system of the text processing service, and specific implementation manners may refer to descriptions in the integration system of the text processing service, which are not described herein again.
By integrating according to the processing sequence of the text processing operator, the text processing sequence provided by the text processing service obtained after integration is ensured to be correct, and a user can conveniently use the text processing in the application process.
On the basis of integrating the text processing operators and the configuration information, further, in one or more embodiments of this embodiment, in order to ensure that a connection incompatibility does not occur when a plurality of text processing operators are connected in the process of integrating the text processing operators, it is necessary to perform standardized processing on input variable information and output variable information of each text processing operator, and a specific implementation manner is as follows:
determining input variable information and output variable information of each text processing operator;
standardizing the input variable information and the output variable information according to the processing sequence of each text processing operator to obtain the output variable information of the previous text processing operator and the input variable information of the next text processing operator in the same format;
and calling the algorithm integration engine to integrate the text processing operator subjected to standardized processing and the configuration information to obtain the text processing service.
Specifically, in a case where a user selects a plurality of text processing operators for the text processing algorithm, in order to enable input variable information and output variable information of each text processing operator to be standardized, input variable information and output variable information of each text processing operator need to be determined, where the input variable information and the output variable information specifically refer to variables generated by the text processing operators in an operation process. Based on the above, the input variable information and the output variable information of each text processing operator are standardized according to the processing sequence of each text processing operator; the standardized processing specifically means that in order to ensure that each text processing operator can be integrated according to a processing sequence in the integration process, and that an output variable of a previous text processing operator can be used as an input variable of a next text processing operator, formats of output variable information corresponding to the output variable of the previous text processing operator and input variable information corresponding to the input variable of the next text processing operator need to be kept consistent, so that adjacent text processing operators can be integrated according to the processing sequence.
Here, the text processing service is obtained by integrating the normalized text processing operator and the configuration information of each text processing operator by calling the algorithm integration engine based on each text processing operator subjected to the normalization processing and determining the configuration information of each text processing operator.
For example, the integrated text processing service corresponds to two text processing operators, including a text processing operator a and a text processing operator B, wherein input variable information and output variable information of the text processing operator a are variable information in a vector format, input variable information and output variable information of the text processing operator B are variable information in a character string format, and processing sequences of the text processing operators are that the text processing operator a is firstly processed, then the text processing operator B is processed, output variable information of the text processing operator a is in a vector format, and input variable information of the text processing operator B is in a character string format, and a format of the output variable information of the text processing operator a needs to be standardized into a character string format, so that the output variable information of the text processing operator a is converted into a character string format from the vector format and serves as input variable information of the text processing operator B.
Based on this, the above steps may be implemented by standardized components in the integrated system of the text processing service, and specific implementation manners may refer to descriptions in the integrated system of the text processing service, which are not described herein again.
In addition, a variable component exists in the service platform bearing the algorithm integration interface, and the function of the variable component is the same as that of the standardized component, which is not described in detail herein.
Before the text processing service is obtained, in one or more embodiments of this embodiment, a user may enrich the text processing service through a custom component, and a specific implementation manner is as follows:
loading a loading packet of the text processing algorithm uploaded by the user;
analyzing the loading package to obtain an added text processing operator contained in the loading package and configuration information of the added text processing operator;
based on this, the execution step 108 invokes an algorithm integration engine to integrate the text processing operator and the configuration information to obtain the text processing service corresponding to the text processing algorithm, and in the process of integrating the text processing operator and the configuration information, the step 108 specifically refers to invoking the algorithm integration engine to integrate the text processing operator and the added text processing algorithm as well as the configuration information and the configuration information of the added text processing operator to obtain the text processing service.
Specifically, before integrating the text processing operator and the configuration information, a user may add an algorithm in a customized manner through a service platform bearing the algorithm integration interface according to a requirement, for example, the text processing algorithm only includes a text recognition algorithm, the user also needs a text word segmentation algorithm, and a jar (a software package file format) package integrated by the text word segmentation algorithm may be loaded through a customized component, where the jar package includes a text word segmentation operator and corresponding configuration information; based on the method, under the condition that a user uploads a loading package of a text processing algorithm on a custom component, the loading package is loaded to obtain a text processing operator added by the user and configuration information of the added text processing operator, and in the integration process, the text processing operator, the added text processing operator and the configuration information respectively corresponding to the text processing operator are integrated to obtain the text processing service, wherein the text processing service not only comprises a text processing process developed through a service platform, but also comprises a text processing process loaded by the user through the custom component.
In specific implementation, the format of the loading package for loading the text processing algorithm uploaded by the user may be a jar-formatted file package (a software package file format), a ZIP-formatted file package, or a GZIP-formatted file package, and the format of the loading package provided by the user may be set according to actual application through a custom component.
On the basis of obtaining the added text processing operator and the corresponding configuration information included in the loaded package provided by the user, further, in one or more embodiments of this embodiment, in order to enable the text processing operator in the loaded package loaded by the user to be compatible with the text processing operator selected by the user, that is, to enable output variable information of a previous text processing operator to be used as input variable information of a next text processing operator, it is necessary to perform normalization processing on variable information of the text processing operator, and a specific implementation manner is as follows:
standardizing the input variable information and the output variable information of the added text processing operator, wherein the input variable information and the output variable information of the added text processing operator obtained according to a standardized processing result have the same format as that of the input variable information and the output variable information of the text processing operator;
and calling the algorithm integration engine to integrate the text processing operator, the normalized added text processing algorithm, the configuration information and the configuration information of the added text processing operator to obtain the text processing service.
Specifically, the formats of the output variable information and the input variable information of the added text processing operator are determined according to the obtained added text processing operator and the corresponding configuration information, and under the condition that the formats of the output variable information and the input variable information of the added text processing operator are different from the formats of the output variable information and the input variable information of the text processing operator, the output variable information and the input variable information of the added text processing operator are subjected to standardization processing, so that the formats of the obtained output variable information and the obtained input variable information of the added text processing operator are the same as the formats of the output variable information and the obtained input variable information of the text processing operator, and are compatible with each other.
Based on the above, under the condition that the formats of the output variable information and the input variable information of the added text processing operator are the same as the formats of the output variable information and the input variable information of the text processing operator, the added text processing operator, the text processing operator and the corresponding configuration information are integrated by calling the algorithm integration engine, so that the text processing service is obtained.
For example, in the case that a user selects a text processing operator on an algorithm integration interface, the text processing operator is a text recognition operator, and configuration information of the text recognition operator is determined, and in order to enable a finally developed text recognition service to be more complete, the user loads a loading packet of a text word segmentation algorithm through a custom component, the loading packet contains the text word segmentation operator and corresponding configuration information, because the text recognition operator is selected by the user independently, and the text word segmentation operator is loaded by the user, formats of input/output variable information of the text recognition operator and the text word segmentation operator are different, the format of the output variable information of the text word segmentation operator and the format of the output variable information of the text word segmentation operator are enabled to be the same by standardizing the output variable information of the text word segmentation operator, after the standardization processing, the text word can be correctly integrated through an algorithm integration engine, the obtained text processing service can include text recognition and text word segmentation, and a recognition result obtained by text recognition can be used as input of the text word segmentation, and the text word segmentation obtains finally required text information by segmenting the recognition result.
By arranging the custom component on the service platform bearing the algorithm integration interface, a user can add algorithms in a custom mode in the development process according to requirements, further richer finally obtained text recognition services are achieved, and under the condition that certain algorithms cannot be developed in the service platform, the user can firstly develop the algorithms which are not supported by the service platform and compress the algorithms into a loading package, the loading package can be loaded in the service platform integration process, the algorithms which are not supported by the service platform and the development supporting algorithms are combined, and finally obtained text processing services are wider in application scene.
On the basis of obtaining the text processing service, in one or more embodiments of this embodiment, input variable information and output variable information of the same text processing operator may be normalized, that is, all the input variable information and output variable information of the text processing operator involved in the text processing operator integrating process are normalized, and a specific implementation manner is as follows:
determining input variable information and output variable information of the text processing operator;
standardizing the input variable information and the output variable information to obtain input variable information and output variable information with the same format;
and calling the algorithm integration engine to integrate the text processing operator subjected to the standardized processing and the configuration information to obtain the text processing service.
Specifically, the input variable information and the output variable information of the text processing operator are determined, the input variable information and the output variable information are standardized, the obtained input variable information and the obtained output variable information have the same format, and finally, the text processing operator subjected to the standardized processing and the configuration information are integrated by calling the algorithm integration engine to obtain the text processing service.
Here, the detailed standardization process may refer to the description of the standardization process in the above embodiments, and is not described herein again.
Based on this, the above steps can be realized together by a standardized component and an algorithm integration engine in an integrated system of the text processing service, and specific implementation manners can refer to descriptions in the integrated system of the text processing service, which is not described herein again.
Before the text processing operator and the configuration information are integrated, in one or more embodiments of this embodiment, a user may detect input variable information, output variable information, and intermediate variable information of the text processing operator, and determine whether there is an error report in a text processing service process developed by a service platform bearing the algorithm integration interface, where a specific implementation manner is as follows:
determining input variable information, output variable information and intermediate variable information of the text processing operator, and storing the input variable information, the output variable information and the intermediate variable information;
under the condition that the algorithm integration engine integrates the text processing operator and the configuration information and error reporting occurs, determining error reporting information by detecting the stored input variable information, the stored output variable information and the stored intermediate variable information, wherein the error reporting information comprises an error reporting text processing operator;
debugging input variable information, output variable information and/or intermediate variable information of the error-reporting text processing operator through a debugging component based on the error-reporting information to obtain a text processing operator without error reporting;
based on this, debugging the error-reported input variable information, output variable information and/or intermediate variable information to obtain a text processing operator without error report, and executing step 108 to invoke an algorithm integration engine to integrate the text processing operator and the configuration information to obtain a text processing service corresponding to the text processing algorithm, where step 108 specifically refers to invoking the algorithm integration engine to integrate the text processing operator without error report and the configuration information to obtain the text processing service.
Specifically, in the process of operating each text processing operator, the generated input variable information, output variable information, and intermediate variable information are stored, after the input variable information, the output variable information, and the intermediate variable information are stored, if the text processing operator and the configuration information are integrated by the algorithm integration engine and an error is reported, the stored input variable information, output variable information, and intermediate variable information may be detected, it is determined whether the input variable information, the output variable information, and the intermediate variable information are consistent with the expected input variable information, output variable information, and intermediate variable information, if not, it is determined that the variable information and the error information are inconsistent, an error text processing operator is located by the error information, the error text processing operator is debugged by a debugging interface provided by a service platform carrying the algorithm integration interface, the text processing operator without an error is obtained, and then the text processing operator is integrated, so that a text recognition service is obtained.
In order to enable a user to know whether variable information generated in the process of generating the text processing service is consistent with expected variable information, the input variable information, the output variable information and the intermediate variable information generated by the text processing operator are stored, the user can conveniently detect the variable information at any time, and a service platform bearing the algorithm integration interface can be dynamically debugged under the condition of error report, so that the developed text processing service is ensured to be perfect.
On the basis of obtaining the text processing service, further, in one or more embodiments of this embodiment, identification information may be set for the text processing service developed by the user, and a specific implementation manner is as follows:
and adding identification information to the text processing service corresponding to the text processing algorithm, and displaying the identification information to the user on the algorithm integration interface.
Specifically, when the user obtains the text processing service, adding identification information to the text processing service, where the identification information may be defined as an Identity Document (ID), and sending the identification information to the user; based on the method, the user can call the developed text processing service through the identification information.
In addition, in order to prevent the identification information from being too simple to be cracked and being called by other users, a password can be added to the identification information, and the password can be customized by the user, so that the safety of the developed text processing service is ensured.
By adding the identification information to the text processing service, the user can conveniently and quickly call the developed text recognition service, and the safety of the text recognition service is ensured.
The application provides an integrated method of text processing service, it is right in the development process of text processing service, operator configuration information through operator configuration subassembly for the user selection has improved the development efficiency of text processing service to can be integrated according to text processing operator that contains in the loading package that the user loaded and corresponding configuration information, in order to guarantee the compatibility between the text processing operator at this in-process, can carry out standardized processing to the input variable information and the output variable information of text processing operator, make the integration obtain text processing service can be smooth carries out text identification, and improve the richness of text processing service, through the integrated method of text processing service has simplified the development process of text processing service, development the user of text processing service is right the development process of text processing service need not have the understanding of degree of depth can realize the development to the text processing service, has reduced the development time of text processing service, and then has improved the speed of text processing service's online speed.
The following will further describe the integration method of the text processing service by taking an application of the integration method of the text processing service provided by the present application in the integration of the text recognition service as an example with reference to fig. 2. Fig. 2 shows a processing flow chart of an integration process of a text processing service provided in an embodiment of the present application, and specific steps include step 202 to step 214.
Step 202: and acquiring a deployment request submitted by a user aiming at the text recognition algorithm, and displaying an algorithm integration interface based on the deployment request.
Specifically, a user needs to develop a text recognition service corresponding to a text recognition algorithm through a service platform bearing the algorithm integration interface, and display the algorithm integration interface to the user by submitting a deployment request.
Step 204: and determining a text recognition operator selected by the user in the algorithm integration interface.
Specifically, a user needs to develop a text recognition algorithm, and a text recognition operator corresponding to the text recognition algorithm is selected on an algorithm integration interface.
Step 206: and acquiring configuration information of the text recognition operator.
Specifically, the configuration information configured for the text recognition operator by the service platform bearing the algorithm integration interface and the configuration information actively configured by the user are integrated to serve as the configuration information of the text recognition operator.
Based on the above, the configuration information of the text recognition operator is a function for developing the text recognition service.
Step 208: under the condition that a user loads a loading package of the text word segmentation algorithm, analyzing the loading package to obtain a text word segmentation operator and corresponding configuration information contained in the loading package.
Specifically, under the condition that a user needs to add text word segmentation service in the developed text recognition service, a loading package of the text word segmentation algorithm can be loaded through a custom component provided by a service platform of a loading algorithm integration interface;
based on the method, the loading packet of the text word segmentation algorithm is loaded and analyzed, and the text word segmentation operators and the corresponding configuration information contained in the loading packet are obtained.
Step 210: and carrying out standardization processing on the variable information of the text recognition operator and the text word segmentation operator, and determining the processing sequence of the text recognition operator and the text word segmentation operator.
Specifically, input variable information and output variable information of a text recognition operator and input variable information and output variable information of a text word segmentation operator are determined;
based on the method, under the condition that the formats of the input variable information and the output variable information of the text recognition operator and the text word segmentation operator are inconsistent, the formats of the input variable information and the output variable information of the text recognition operator and the text word segmentation operator are enabled to be the same by carrying out standardization processing on the input variable information and the output variable information of the text recognition operator and the text word segmentation operator;
here, the processing sequence of the text recognition operator and the text word segmentation operator is determined to be the text recognition operator first and the text word segmentation operator at the same time.
Step 212: and calling an algorithm integration engine to integrate the text recognition operator and the text word segmentation operator, and the configuration information of the text recognition operator and the configuration information of the text word segmentation operator to obtain a text recognition service.
Specifically, an algorithm integration engine in a service platform carrying an algorithm integration interface is called to integrate a text recognition operator and a text word segmentation operator, and the configuration information of the text recognition operator and the configuration information of the text word segmentation operator to obtain a text recognition service;
based on the method, the obtained text recognition service has the functions of text recognition and text word segmentation, in the process of text processing, firstly, a text to be processed is input into the text recognition service, secondly, the text is recognized through the text recognition function to obtain a recognition result, finally, the recognition result is used as the input of the text word segmentation function to segment the text, and finally, text information of the text after recognition and word segmentation is obtained.
Step 214: and adding identification information for the text recognition service and displaying the identification information to the user.
Specifically, in order to facilitate the user to call the text recognition service, identification information of the text recognition service can be provided for the user, and the user can call the text recognition service quickly through the identification information.
According to the integration method of the text processing service, in the development process of the text recognition service, operator configuration information selected by an operator configuration component for a user is utilized, the development efficiency of the developed text recognition service is improved, the text word segmentation operator and corresponding configuration information contained in a loading packet loaded by the user can be integrated, in order to ensure compatibility with the text recognition operator, standardized processing can be carried out on input variable information and output variable information of the text word segmentation operator in the process, the text recognition service obtained through integration can be used for smoothly carrying out text recognition, the richness of the text recognition service is improved, the development process of the developed text recognition service is simplified through the integration method of the text processing service, the user developing the text recognition service can realize development of the text recognition service without deep understanding of the development process of the text recognition service, the development time of the developed text recognition service is shortened, and the online speed of the text recognition service is further improved.
Corresponding to the above method embodiment, the present application further provides an embodiment of an integrated device for text processing services, and fig. 3 shows a schematic structural diagram of an integrated device for text processing services provided in an embodiment of the present application. As shown in fig. 3, the apparatus includes:
the acquiring and deploying request module 302 is configured to acquire a deploying request submitted by a user for a text processing algorithm, and display an algorithm integration interface according to the deploying request;
a determination operator module 304 configured to determine a text processing operator selected by a user at the algorithm integration interface for the text processing algorithm;
an obtain configuration information module 306 configured to obtain configuration information for configuring the text processing operator;
the integration module 308 is configured to invoke an algorithm integration engine to integrate the text processing operator and the configuration information, so as to obtain a text processing service corresponding to the text processing algorithm.
In an optional embodiment, the module 306 for obtaining configuration information includes:
the configuration information acquisition unit is configured to acquire first configuration information configured by the user for the text processing operator and call an operator configuration component to configure second configuration information for the text processing operator;
and the integration unit is configured to integrate the first configuration information and the second configuration information and generate the configuration information of the text processing operator according to an integration result.
In an optional embodiment, the obtain configuration information module 306 is further configured to:
acquiring first configuration information configured by the user for the text processing operator, and taking the first configuration information as configuration information of the text processing operator;
or
And calling an operator configuration component to configure second configuration information for the text processing operator, and taking the second configuration information as the configuration information of the text processing operator.
In an alternative embodiment, the integrated device for text processing service comprises
A determination processing order module configured to determine a processing order of each text processing operator of a plurality of text processing operators in a case where a plurality of text processing operators are selected for the text processing algorithm;
accordingly, the obtain configuration information module 306 is further configured to:
and acquiring configuration information for configuring each text processing operator.
In an optional embodiment, the integration module 308 is further configured to:
and calling the algorithm integration engine to integrate each text processing operator and the configuration information corresponding to each text processing operator according to the processing sequence of each text processing operator to obtain the text processing service.
In an optional embodiment, the integration module 308 includes:
a first determining variable unit configured to determine input variable information and output variable information of each text processing operator;
the first standardization processing unit is configured to standardize the input variable information and the output variable information according to the processing sequence of each text processing operator, and the obtained output variable information of the previous text processing operator and the obtained input variable information of the next text processing operator have the same format;
the first integration unit is configured to call the algorithm integration engine to integrate the text processing operator subjected to the standardized processing and the configuration information to obtain the text processing service.
In an optional embodiment, the integrated device for text processing service includes:
a loading module configured to load a loading package of a text processing algorithm uploaded by the user;
the analysis module is configured to analyze the loading package to obtain an added text processing operator contained in the loading package and configuration information of the added text processing operator;
accordingly, the integration module 308 is further configured to:
and calling the algorithm integration engine to integrate the text processing operator, the added text processing algorithm, the configuration information and the configuration information of the added text processing operator to obtain the text processing service.
In an alternative embodiment, the integration module 308 includes:
a second normalization processing unit configured to perform normalization processing on input variable information and output variable information of the added text processing operator, the input variable information and the output variable information of the added text processing operator obtained according to a normalization processing result having the same format as that of the input variable information and the output variable information of the text processing operator;
a second integration unit configured to invoke the algorithm integration engine to integrate the text processing operator and the normalized added text processing algorithm, and the configuration information of the added text processing operator, so as to obtain the text processing service.
In an alternative embodiment, the integration module 308 includes:
a second determining variable unit configured to determine input variable information and output variable information of the text processing operator;
the third standardization processing unit is configured to standardize the input variable information and the output variable information, and the obtained input variable information and the obtained output variable information have the same format;
and the third integration unit is configured to call the algorithm integration engine to integrate the text processing operator subjected to the standardized processing and the configuration information to obtain the text processing service.
In an optional embodiment, the integrated apparatus of text processing service includes:
a variable determining module configured to determine input variable information, output variable information, and intermediate variable information of the text processing operator, and store the input variable information, the output variable information, and the intermediate variable information;
the error information determining module is configured to determine error information by detecting the stored input variable information, the stored output variable information and the stored intermediate variable information when the algorithm integration engine integrates the text processing operator and the configuration information and an error occurs, wherein the error information includes an error text processing operator;
the debugging module is configured to debug input variable information, output variable information and/or intermediate variable information of the error-reporting text processing operator through a debugging component based on the error-reporting information to obtain a text processing operator without error reporting;
accordingly, the integration module 308 is further configured to:
and calling the algorithm integration engine to integrate the text processing operators which are not reported in error and the configuration information to obtain the text processing service.
In an optional embodiment, the integrated apparatus of text processing service includes:
and the adding module is configured to add identification information to the text processing service corresponding to the text processing algorithm and display the identification information to the user on the algorithm integration interface.
In the integrated device of text processing service provided by the application, through right in the development process of text processing service, operator configuration information through operator configuration subassembly for the user selection has improved the development efficiency of text processing service to can be integrated according to text processing operator that contains in the loading package of user loading and corresponding configuration information, in order to guarantee the compatibility between the text processing operator at this in-process, can carry out standardized processing to the input variable information and the output variable information of text processing operator, make the integration obtain text processing service can be smooth carries out text identification, and improves the richness of text processing service, through the integrated device of text processing service has simplified the development process of text processing service, development the user of text processing service is right the development process of text processing service need not have the understanding of degree of depth can realize the development to the text processing service, has reduced the development time of text processing service, and then has improved the speed of getting online of text processing service.
The above is a schematic scheme of an integrated apparatus of a text processing service according to the present embodiment. It should be noted that the technical solution of the text processing service integration apparatus and the technical solution of the text processing service integration method belong to the same concept, and details of the technical solution of the text processing service integration apparatus, which are not described in detail, can be referred to the description of the technical solution of the text processing service integration method.
Corresponding to the foregoing method embodiment, the present application further provides an embodiment of an integration system of text processing services, fig. 4 shows a schematic structural diagram of an integration system of text processing services provided in an embodiment of the present application, and fig. 5 shows a schematic structural diagram of an integration system of a second text processing service provided in an embodiment of the present application.
Fig. 5 shows an internal processing procedure of the integrated system of the text processing service shown in fig. 4, and fig. 5 specifically shows an integrated procedure of the integrated system of the text processing service. As shown in fig. 4, an integrated system 400 of text processing services includes:
a service platform 402, an operator configuration component 404, a normalization component 406, and an algorithm integration engine 408;
the service platform 402 is configured to receive a deployment request submitted by a user for a text processing algorithm, and present an algorithm integration interface to the user according to the deployment request; determining a text processing operator selected by a user at the algorithm integration interface aiming at the text processing algorithm, and sending the text processing operator to the operator configuration component and the standardization component;
the operator configuration component 404 is configured to receive the text processing operator sent by the service platform, and generate configuration information of the text processing operator; sending the configuration information to the algorithm integration engine;
the standardization component 406 is configured to receive the text processing operator sent by the service platform, and perform standardization processing on input variable information and output variable information of the text processing operator to obtain input variable information and output variable information of the text processing operator in the same format; sending the text processing operator subjected to the standardization processing to the algorithm integration engine;
the algorithm integration engine 408 is configured to receive the configuration information sent by the operator configuration component, receive a text processing operator subjected to normalization processing sent by the normalization component, and integrate the configuration information and the text processing operator subjected to normalization processing to obtain a text processing service corresponding to the text processing algorithm.
In an alternative embodiment, the operator configuration component 404 is further configured to:
receiving first configuration information configured by the user for the text processing operator, and configuring second configuration information for the text processing operator; and integrating the first configuration information and the second configuration information, and generating the configuration information of the text processing operator according to an integration result.
In an alternative embodiment, the operator configuration component 404 is further configured to:
receiving first configuration information configured by the user for the text processing operator, and taking the first configuration information as configuration information of the text processing operator; or configuring second configuration information for the text processing operator, and taking the second configuration information as the configuration information of the text processing operator.
In an optional embodiment, the service platform 402 is further configured to:
determining a processing order for each of a plurality of text processing operators in the event that the plurality of text processing operators are selected for the text processing algorithm;
accordingly, the operator configuration component 404 is further configured to:
configuration information for each text processing operator is generated.
In an alternative embodiment, the algorithm integration engine 408 is further configured to:
and calling the algorithm integration engine to integrate each text processing operator and the configuration information corresponding to each text processing operator according to the processing sequence of each text processing operator to obtain the text processing service.
In an optional embodiment, the normalization component 406 is further configured to:
determining input variable information and output variable information of each text processing operator; standardizing the input variable information and the output variable information according to the processing sequence of each text processing operator to obtain the output variable information of the previous text processing operator and the input variable information of the next text processing operator in the same format;
the algorithm integration engine 408 is further configured to:
and calling the algorithm integration engine to integrate the text processing operator subjected to the standardized processing and the configuration information to obtain the text processing service.
In an alternative embodiment, the integrated system 400 for text processing services comprises:
a custom component configured to load a loading package of a text processing algorithm uploaded by the user; analyzing the loading package to obtain an added text processing operator contained in the loading package and configuration information of the added text processing operator;
accordingly, the algorithm integration engine 408 is further configured to:
and calling the algorithm integration engine to integrate the text processing operator, the added text processing algorithm, the configuration information and the configuration information of the added text processing operator to obtain the text processing service.
In an optional embodiment, the normalization component 406 is further configured to:
standardizing the input variable information and the output variable information of the added text processing operator, wherein the input variable information and the output variable information of the added text processing operator obtained according to a standardized processing result have the same format as that of the input variable information and the output variable information of the text processing operator;
the algorithm integration engine 408 is further configured to:
and calling the algorithm integration engine to integrate the text processing operator, the normalized added text processing algorithm, the configuration information and the configuration information of the added text processing operator to obtain the text processing service.
In an optional embodiment, the normalization component 406 is further configured to:
determining input variable information and output variable information of the text processing operator;
standardizing the input variable information and the output variable information to obtain input variable information and output variable information with the same format;
the algorithm integration engine 408 is further configured to:
and calling the algorithm integration engine to integrate the text processing operator subjected to the standardized processing and the configuration information to obtain the text processing service.
In an alternative embodiment, the integrated system 400 for text processing services comprises:
an error reporting component configured to determine input variable information, output variable information, and intermediate variable information of the text processing operator, and store the input variable information, the output variable information, and the intermediate variable information; under the condition that the algorithm integration engine integrates the text processing operator and the configuration information and error reporting occurs, determining error reporting information by detecting the stored input variable information, the stored output variable information and the stored intermediate variable information, wherein the error reporting information comprises an error reporting text processing operator; debugging input variable information, output variable information and/or intermediate variable information of the error-reporting text processing operator through a debugging component based on the error-reporting information to obtain a text processing operator without error reporting;
the algorithm integration engine 408 is further configured to:
and calling the algorithm integration engine to integrate the text processing operators which are not reported in error and the configuration information to obtain the text processing service.
In an alternative embodiment, the integrated system 400 for text processing services comprises:
and the adding component is configured to add identification information to the text processing service corresponding to the text processing algorithm and display the identification information to the user on the algorithm integration interface.
Besides, various frameworks of machine learning are integrated at the bottom layer of the integrated system of the text processing service, and basic prediction scoring capability can be provided; in the integrated system of the text processing service, the system also comprises an algorithm component which is configured to support algorithms such as logistic regression or random forest and the like, and has an active loading model to provide scoring capability for the text; a rule edge component is included that is configured to provide conditional judgment capabilities, and that provides a rule on how to calculate for steps involved in text processing, including text processing, recognition, and scoring, for example.
Referring to fig. 5, a service platform user service user includes, in an algorithm integration interface of a service platform, publishing unit management, user management, predicted service management, text processing operator management, service flow management, and a log, where each management unit is open to the user, and the user can obtain a corresponding service through each management unit. The algorithm integration engine is used for providing corresponding services for the user through the operation of the algorithm integration engine under the condition that the user selects a corresponding management unit by using the service platform, wherein when a deployment request of the user is obtained, the algorithm integration engine enters a starting state, loads a text processing algorithm submitted by the user, is relatively in accordance with the text processing service, provides a development text processing service for the user, and determines steps contained in the text processing algorithm in an execution engine according to the text processing algorithm submitted by the user in a DAG (direct Acyclic Graph) in the Graph 5 (a visual flow chart is represented in the application);
the method comprises the steps that an algorithm integration engine enters an operation state, the algorithm integration engine predicts the online time and the offline time of text processing service, the update state of a text processing operator and the resource update of a bottom layer model, variable information generated in the process is stored in a log and monitored, dynamic debugging can be carried out under the condition that problems occur, referring to a serial peripheral interface provided by a data access SPI and a cache SPI in figure 5, model frame resources of the bottom layer can be updated in real time, a service platform is driven through a DSL (Digital Subscriber Line), dynamic compiling and loading can be achieved, and the efficiency of integrating the text processing service is high.
The integrated system of the text processing service adopts an open source model description language framework and supports models of various machine learning frameworks; the language mainly applied in the integrated system of the text processing service is JAVA, and a public library for text processing is provided for storing the developed text recognition service, and in the process of integrating the algorithm integration engine 408, JAVA thermal compilation integration capability can be used for integration, so that the text processing service can be quickly integrated, and multiple users can be supported to develop the text processing service at the same time.
The application provides an integrated system of text processing service is right in the development process of text processing service, operator configuration information through operator configuration subassembly for the user selection has improved the development efficiency of text processing service to can integrate according to text processing operator that contains in the user's loaded loading package and corresponding configuration information, in order to guarantee the compatibility between the text processing operator at this in-process, can carry out standardized processing to the input variable information and the output variable information of text processing operator, make the integration obtain text processing service can be smooth carries out text identification, and improve the richness of text processing service, through integrated system of text processing service has simplified the development process of text processing service develops the user of text processing service is right the development process of text processing service need not have the understanding of degree of depth and can realize the development to the text processing service, has reduced the development time of text processing service, and then has improved the online speed of text processing service.
The above is a schematic scheme of an integrated system of a text processing service according to the embodiment. It should be noted that the technical solution of the integrated system of the text processing service and the technical solution of the integrated method of the text processing service belong to the same concept, and details that are not described in detail in the technical solution of the integrated system of the text processing service can be referred to the description of the technical solution of the integrated method of the text processing service.
Fig. 6 illustrates a block diagram of a computing device 600 according to an embodiment of the present application. The components of the computing device 600 include, but are not limited to, a memory 610 and a processor 620. The processor 620 is coupled to the memory 610 via a bus 630 and a database 650 is used to store data.
Computing device 600 also includes access device 640, access device 640 enabling computing device 600 to communicate via one or more networks 660. Examples of such networks include the Public Switched Telephone Network (PSTN), a Local Area Network (LAN), a Wide Area Network (WAN), a Personal Area Network (PAN), or a combination of communication networks such as the internet. The access device 640 may include one or more of any type of network interface (e.g., a Network Interface Card (NIC)) whether wired or wireless, such as an IEEE802.11 Wireless Local Area Network (WLAN) wireless interface, a worldwide interoperability for microwave access (Wi-MAX) interface, an ethernet interface, a Universal Serial Bus (USB) interface, a cellular network interface, a bluetooth interface, a Near Field Communication (NFC) interface, and so forth.
In one embodiment of the present application, other components of the computing device 600 described above and not shown in FIG. 6 may also be connected to each other, such as by a bus. It should be understood that the block diagram of the computing device structure shown in FIG. 6 is for illustration purposes only and is not intended to limit the scope of the present application. Those skilled in the art may add or replace other components as desired.
Computing device 600 may be any type of stationary or mobile computing device, including a mobile computer or mobile computing device (e.g., tablet, personal digital assistant, laptop, notebook, netbook, etc.), mobile phone (e.g., smartphone), wearable computing device (e.g., smartwatch, smartglasses, etc.), or other type of mobile device, or a stationary computing device such as a desktop computer or PC. Computing device 600 may also be a mobile or stationary server.
Wherein processor 620 is configured to execute the following computer-executable instructions:
acquiring a deployment request submitted by a user aiming at a text processing algorithm, and displaying an algorithm integration interface according to the deployment request;
determining a text processing operator selected by a user at the algorithm integration interface for the text processing algorithm;
acquiring configuration information for configuring the text processing operator;
and calling an algorithm integration engine to integrate the text processing operator and the configuration information to obtain text processing service corresponding to the text processing algorithm.
Optionally, the obtaining configuration information for configuring the text processing operator includes:
acquiring first configuration information configured by the user for the text processing operator, and calling an operator configuration component to configure second configuration information for the text processing operator;
and integrating the first configuration information and the second configuration information, and generating the configuration information of the text processing operator according to an integration result.
Optionally, the obtaining configuration information for configuring the text processing operator includes:
acquiring first configuration information configured by the user for the text processing operator, and taking the first configuration information as configuration information of the text processing operator;
or
And calling an operator configuration component to configure second configuration information for the text processing operator, and taking the second configuration information as the configuration information of the text processing operator.
Optionally, after the text processing operator instruction selected by the text processing algorithm is executed by the algorithm integration interface and before the configuration information instruction for configuring the text processing operator is obtained, the processor 620 further executes the following computer-executable instructions:
determining a processing order of each text processing operator of a plurality of text processing operators in case a plurality of text processing operators are selected for the text processing algorithm;
correspondingly, the obtaining configuration information for configuring the text processing operator includes:
and acquiring configuration information for configuring each text processing operator.
Optionally, the invoking an algorithm integration engine integrates the text processing operator and the configuration information to obtain a text processing service corresponding to the text processing algorithm, including:
and calling the algorithm integration engine to integrate each text processing operator and the configuration information corresponding to each text processing operator according to the processing sequence of each text processing operator to obtain the text processing service.
Optionally, the invoking an algorithm integration engine integrates the text processing operator and the configuration information to obtain a text processing service corresponding to the text processing algorithm, including:
determining input variable information and output variable information of each text processing operator;
standardizing the input variable information and the output variable information according to the processing sequence of each text processing operator, wherein the obtained output variable information of the previous text processing operator and the obtained input variable information of the next text processing operator have the same format;
and calling the algorithm integration engine to integrate the text processing operator subjected to the standardized processing and the configuration information to obtain the text processing service.
Optionally, before the algorithm integration engine is invoked to integrate the text processing operator and the configuration information to obtain a text processing service instruction corresponding to the text processing algorithm, and execute the following computer-executable instructions:
loading a loading packet of the text processing algorithm uploaded by the user;
analyzing the loading package to obtain an added text processing operator contained in the loading package and configuration information of the added text processing operator;
correspondingly, the step of integrating the text processing operator and the configuration information by the calling algorithm integration engine to obtain the text processing service corresponding to the text processing algorithm includes:
and calling the algorithm integration engine to integrate the text processing operator, the added text processing algorithm, the configuration information and the configuration information of the added text processing operator to obtain the text processing service.
Optionally, the invoking the algorithm integration engine to integrate the text processing operator and the added text processing algorithm with the configuration information and the configuration information of the added text processing operator to obtain the text processing service includes:
standardizing the input variable information and the output variable information of the added text processing operator, wherein the input variable information and the output variable information of the added text processing operator obtained according to a standardized processing result have the same format as that of the input variable information and the output variable information of the text processing operator;
and calling the algorithm integration engine to integrate the text processing operator, the normalized added text processing algorithm, the configuration information and the configuration information of the added text processing operator to obtain the text processing service.
Optionally, the invoking an algorithm integration engine integrates the text processing operator and the configuration information to obtain a text processing service corresponding to the text processing algorithm, including:
determining input variable information and output variable information of the text processing operator;
standardizing the input variable information and the output variable information to obtain input variable information and output variable information with the same format;
and calling the algorithm integration engine to integrate the text processing operator subjected to the standardized processing and the configuration information to obtain the text processing service.
Optionally, after the determining user executes the text processing operator instruction selected by the text processing algorithm on the algorithm integration interface, and before the algorithm integration engine is invoked to integrate the text processing operator and the configuration information to obtain the text processing service instruction corresponding to the text processing algorithm, the processor 620 further executes the following computer-executable instructions:
determining input variable information, output variable information and intermediate variable information of the text processing operator, and storing the input variable information, the output variable information and the intermediate variable information;
under the condition that the algorithm integration engine integrates the text processing operator and the configuration information and error reporting occurs, determining error reporting information by detecting the stored input variable information, the stored output variable information and the stored intermediate variable information, wherein the error reporting information comprises an error reporting text processing operator;
debugging input variable information, output variable information and/or intermediate variable information of the error-reporting text processing operator through a debugging component based on the error-reporting information to obtain a text processing operator without error reporting;
correspondingly, the calling algorithm integration engine integrates the text processing operator and the configuration information to obtain a text processing service corresponding to the text processing algorithm, and the method comprises the following steps:
and calling the algorithm integration engine to integrate the text processing operators which are not reported in error and the configuration information to obtain the text processing service.
Optionally, after the algorithm integration engine is called to integrate the text processing operator and the configuration information to obtain a text processing service instruction corresponding to the text processing algorithm, and the text processing service instruction is executed, the processor 620 further executes the following computer executable instruction:
and adding identification information to the text processing service corresponding to the text processing algorithm, and displaying the identification information to the user on the algorithm integration interface.
The above is an illustrative scheme of a computing device of the present embodiment. It should be noted that the technical solution of the computing device and the technical solution of the text processing service integration method described above belong to the same concept, and details that are not described in detail in the technical solution of the computing device can be referred to the description of the technical solution of the text processing service integration method described above.
An embodiment of the present application further provides a computer-readable storage medium storing computer instructions that, when executed by a processor, are configured to:
acquiring a deployment request submitted by a user aiming at a text processing algorithm, and displaying an algorithm integration interface according to the deployment request;
determining a text processing operator selected by a user at the algorithm integration interface for the text processing algorithm;
acquiring configuration information for configuring the text processing operator;
and calling an algorithm integration engine to integrate the text processing operator and the configuration information to obtain text processing service corresponding to the text processing algorithm.
Optionally, the obtaining configuration information for configuring the text processing operator includes:
acquiring first configuration information configured by the user for the text processing operator, and calling an operator configuration component to configure second configuration information for the text processing operator;
and integrating the first configuration information and the second configuration information, and generating the configuration information of the text processing operator according to an integration result.
Optionally, the obtaining configuration information for configuring the text processing operator includes:
acquiring first configuration information configured by the user for the text processing operator, and taking the first configuration information as configuration information of the text processing operator;
or
And calling an operator configuration component to configure second configuration information for the text processing operator, and taking the second configuration information as the configuration information of the text processing operator.
Optionally, after the step of determining, by the user, the text processing operator selected by the algorithm integration interface for the text processing algorithm is executed and before the step of obtaining the configuration information for configuring the text processing operator is executed, the method includes:
determining a processing order of each text processing operator of a plurality of text processing operators in case a plurality of text processing operators are selected for the text processing algorithm;
correspondingly, the obtaining configuration information for configuring the text processing operator includes:
and acquiring configuration information for configuring each text processing operator.
Optionally, the invoking an algorithm integration engine integrates the text processing operator and the configuration information to obtain a text processing service corresponding to the text processing algorithm, including:
and calling the algorithm integration engine to integrate each text processing operator and the configuration information corresponding to each text processing operator according to the processing sequence of each text processing operator to obtain the text processing service.
Optionally, the invoking an algorithm integration engine integrates the text processing operator and the configuration information to obtain a text processing service corresponding to the text processing algorithm, including:
determining input variable information and output variable information of each text processing operator;
standardizing the input variable information and the output variable information according to the processing sequence of each text processing operator, wherein the obtained output variable information of the previous text processing operator and the obtained input variable information of the next text processing operator have the same format;
and calling the algorithm integration engine to integrate the text processing operator subjected to the standardized processing and the configuration information to obtain the text processing service.
Optionally, before the step of integrating the text processing operator and the configuration information by using the algorithm-calling integration engine to obtain the text processing service corresponding to the text processing algorithm is executed, the method includes:
loading a loading packet of the text processing algorithm uploaded by the user;
analyzing the loading package to obtain an added text processing operator contained in the loading package and configuration information of the added text processing operator;
correspondingly, the calling algorithm integration engine integrates the text processing operator and the configuration information to obtain a text processing service corresponding to the text processing algorithm, and the method comprises the following steps:
and calling the algorithm integration engine to integrate the text processing operator, the added text processing algorithm, the configuration information and the configuration information of the added text processing operator to obtain the text processing service.
Optionally, the substep of calling the algorithm integration engine to integrate the text processing operator and the added text processing algorithm with the configuration information of the added text processing operator to obtain the text processing service includes:
standardizing the input variable information and the output variable information of the added text processing operator, wherein the input variable information and the output variable information of the added text processing operator obtained according to a standardized processing result have the same format as that of the input variable information and the output variable information of the text processing operator;
and calling the algorithm integration engine to integrate the text processing operator, the normalized added text processing algorithm, the configuration information and the configuration information of the added text processing operator to obtain the text processing service.
Optionally, the invoking an algorithm integration engine integrates the text processing operator and the configuration information to obtain a text processing service corresponding to the text processing algorithm, including:
determining input variable information and output variable information of the text processing operator;
standardizing the input variable information and the output variable information to obtain input variable information and output variable information with the same format;
and calling the algorithm integration engine to integrate the text processing operator subjected to the standardized processing and the configuration information to obtain the text processing service.
Optionally, after the step of determining that the user executes the text processing operator selected by the algorithm integration interface for the text processing algorithm, and before the step of calling the algorithm integration engine to integrate the text processing operator and the configuration information and obtain the text processing service corresponding to the text processing algorithm is executed, the method includes:
determining input variable information, output variable information and intermediate variable information of the text processing operator, and storing the input variable information, the output variable information and the intermediate variable information;
under the condition that the algorithm integration engine integrates the text processing operator and the configuration information and error reporting occurs, determining error reporting information by detecting the stored input variable information, the stored output variable information and the stored intermediate variable information, wherein the error reporting information comprises an error reporting text processing operator;
debugging input variable information, output variable information and/or intermediate variable information of the error-reporting text processing operator through a debugging component based on the error-reporting information to obtain a text processing operator without error reporting;
correspondingly, the calling algorithm integration engine integrates the text processing operator and the configuration information to obtain a text processing service corresponding to the text processing algorithm, and the method comprises the following steps:
and calling the algorithm integration engine to integrate the text processing operators which are not reported in error and the configuration information to obtain the text processing service.
Optionally, after the step of integrating the text processing operator and the configuration information by using the algorithm-invoking integration engine to obtain the text processing service corresponding to the text processing algorithm is executed, the method includes:
and adding identification information to the text processing service corresponding to the text processing algorithm, and displaying the identification information to the user on the algorithm integration interface.
The above is an illustrative scheme of a computer-readable storage medium of the present embodiment. It should be noted that the technical solution of the storage medium and the technical solution of the text processing service integration method described above belong to the same concept, and details that are not described in detail in the technical solution of the storage medium can be referred to the description of the technical solution of the text processing service integration method described above.
The foregoing description of specific embodiments of the present application has been presented. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
The computer instructions comprise computer program code which may be in the form of source code, object code, an executable file or some intermediate form, or the like. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U.S. disk, removable hard disk, magnetic diskette, optical disk, computer Memory, read-Only Memory (ROM), random Access Memory (RAM), electrical carrier wave signal, telecommunications signal, and software distribution medium, etc. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
It should be noted that, for the sake of simplicity, the above-mentioned method embodiments are described as a series of acts or combinations, but those skilled in the art should understand that the present application is not limited by the described order of acts, as some steps may be performed in other orders or simultaneously according to the present application. Further, those skilled in the art will appreciate that the embodiments described in this specification are presently considered to be preferred embodiments and that acts and modules are not required in the present application.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
The preferred embodiments of the present application disclosed above are intended only to aid in the explanation of the application. Alternative embodiments are not exhaustive and do not limit the invention to the precise embodiments described. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the application and its practical application, to thereby enable others skilled in the art to best understand and utilize the application. The application is limited only by the claims and their full scope and equivalents.

Claims (15)

1. A method for integrating text processing services, comprising:
acquiring a deployment request submitted by a user aiming at a text processing algorithm, and displaying an algorithm integration interface according to the deployment request;
determining a text processing operator selected by a user at the algorithm integration interface for the text processing algorithm;
acquiring configuration information for configuring the text processing operator;
and calling an algorithm integration engine to integrate the text processing operator and the configuration information to obtain text processing service corresponding to the text processing algorithm.
2. The method of claim 1, wherein obtaining configuration information for configuring the text processing operator comprises:
acquiring first configuration information configured by the user for the text processing operator, and calling an operator configuration component to configure second configuration information for the text processing operator;
and integrating the first configuration information and the second configuration information, and generating the configuration information of the text processing operator according to an integration result.
3. The method of claim 1, wherein obtaining configuration information for configuring the text processing operator comprises:
acquiring first configuration information configured by the user for the text processing operator, and taking the first configuration information as configuration information of the text processing operator;
or
And calling an operator configuration component to configure second configuration information for the text processing operator, and taking the second configuration information as the configuration information of the text processing operator.
4. The method of claim 1, wherein determining that the user is after the step of executing the text processing operator selected by the algorithm integration interface for the text processing algorithm and before the step of obtaining configuration information for configuring the text processing operator is executed, comprises:
determining a processing order for each of a plurality of text processing operators in the event that the plurality of text processing operators are selected for the text processing algorithm;
correspondingly, the obtaining configuration information for configuring the text processing operator includes:
and acquiring configuration information for configuring each text processing operator.
5. The method of claim 4, wherein the invoking an algorithm integration engine integrates the text processing operator and the configuration information to obtain a text processing service corresponding to the text processing algorithm, and the method comprises:
and calling the algorithm integration engine to integrate each text processing operator and the configuration information corresponding to each text processing operator according to the processing sequence of each text processing operator to obtain the text processing service.
6. The method of claim 4, wherein the invoking an algorithm integration engine integrates the text processing operator and the configuration information to obtain a text processing service corresponding to the text processing algorithm, comprising:
determining input variable information and output variable information of each text processing operator;
standardizing the input variable information and the output variable information according to the processing sequence of each text processing operator, wherein the obtained output variable information of the previous text processing operator and the obtained input variable information of the next text processing operator have the same format;
and calling the algorithm integration engine to integrate the text processing operator subjected to the standardized processing and the configuration information to obtain the text processing service.
7. The method according to claim 1, wherein before the step of integrating the text processing operator and the configuration information by the algorithm integration engine to obtain the text processing service corresponding to the text processing algorithm is executed, the method comprises:
loading a loading package which is uploaded by the user and is used for increasing a text processing algorithm;
analyzing the loading package to obtain an added text processing operator contained in the loading package and configuration information of the added text processing operator;
correspondingly, the step of integrating the text processing operator and the configuration information by the calling algorithm integration engine to obtain the text processing service corresponding to the text processing algorithm includes:
and calling the algorithm integration engine to integrate the text processing operator, the added text processing algorithm, the configuration information and the configuration information of the added text processing operator to obtain the text processing service.
8. The method according to claim 7, wherein said invoking said algorithm integration engine to integrate said text processing operator with said augmented text processing algorithm and said configuration information with said augmented text processing operator configuration information to obtain said text processing service substep comprises:
standardizing the input variable information and the output variable information of the added text processing operator, wherein the input variable information and the output variable information of the added text processing operator obtained according to a standardized processing result have the same format as the input variable information and the output variable information of the text processing operator;
and calling the algorithm integration engine to integrate the text processing operator, the normalized text processing algorithm, the configuration information and the configuration information of the text processing operator to obtain the text processing service.
9. The method according to claim 1, wherein the invoking an algorithm integration engine integrates the text processing operator and the configuration information to obtain a text processing service corresponding to the text processing algorithm, and comprises:
determining input variable information and output variable information of the text processing operator;
standardizing the input variable information and the output variable information to obtain input variable information and output variable information with the same format;
and calling the algorithm integration engine to integrate the text processing operator subjected to the standardized processing and the configuration information to obtain the text processing service.
10. The method according to claim 1, wherein after the step of determining the text processing operator selected by the user for the text processing algorithm in the algorithm integration interface is executed, and before the step of calling the algorithm integration engine to integrate the text processing operator and the configuration information and obtaining the text processing service corresponding to the text processing algorithm is executed, the method comprises:
determining input variable information, output variable information and intermediate variable information of the text processing operator, and storing the input variable information, the output variable information and the intermediate variable information;
under the condition that the algorithm integration engine integrates the text processing operator and the configuration information and error reporting occurs, determining error reporting information by detecting the stored input variable information, the stored output variable information and the stored intermediate variable information, wherein the error reporting information comprises an error reporting text processing operator;
debugging input variable information, output variable information and/or intermediate variable information of the error-reporting text processing operator through a debugging component based on the error-reporting information to obtain a text processing operator without error reporting;
correspondingly, the step of integrating the text processing operator and the configuration information by the calling algorithm integration engine to obtain the text processing service corresponding to the text processing algorithm includes:
and calling the algorithm integration engine to integrate the text processing operators which are not reported in error and the configuration information to obtain the text processing service.
11. The method according to claim 1, wherein the step of calling an algorithm integration engine to integrate the text processing operator and the configuration information to obtain the text processing service corresponding to the text processing algorithm comprises:
and adding identification information to the text processing service corresponding to the text processing algorithm, and displaying the identification information to the user on the algorithm integration interface.
12. An integrated apparatus for text processing services, comprising:
the deployment request acquisition module is configured to acquire a deployment request submitted by a user aiming at a text processing algorithm and display an algorithm integration interface according to the deployment request;
a determination operator module configured to determine a text processing operator selected by a user at the algorithm integration interface for the text processing algorithm;
the acquisition configuration information module is configured to acquire configuration information for configuring the text processing operator;
and the integration module is configured to call an algorithm integration engine to integrate the text processing operator and the configuration information to obtain text processing service corresponding to the text processing algorithm.
13. An integrated system of text processing services, comprising:
the system comprises a service platform, an operator configuration component, a standardization component and an algorithm integration engine;
the service platform is configured to receive a deployment request submitted by a user for a text processing algorithm, and display an algorithm integration interface to the user according to the deployment request; determining a text processing operator selected by a user for the text processing algorithm in the algorithm integration interface, and sending the text processing operator to the operator configuration component and the standardization component;
the operator configuration component is configured to receive the text processing operator sent by the service platform and generate configuration information of the text processing operator; sending the configuration information to the algorithm integration engine;
the standardization component is configured to receive the text processing operator sent by the service platform, and standardize input variable information and output variable information of the text processing operator to obtain input variable information and output variable information of the text processing operator in the same format; sending the text processing operator subjected to the standardization processing to the algorithm integration engine; the algorithm integration engine is configured to receive the configuration information sent by the operator configuration component, receive a text processing operator which is sent by the standardization component and is subjected to standardization processing, and integrate the configuration information and the text processing operator which is subjected to standardization processing to obtain text processing services corresponding to the text processing algorithm.
14. A computing device, comprising:
a memory and a processor;
the memory is to store computer-executable instructions, and the processor is to execute the computer-executable instructions to:
acquiring a deployment request submitted by a user aiming at a text processing algorithm, and displaying an algorithm integration interface according to the deployment request;
determining a text processing operator selected by a user at the algorithm integration interface for the text processing algorithm;
acquiring configuration information for configuring the text processing operator;
and calling an algorithm integration engine to integrate the text processing operator and the configuration information to obtain text processing service corresponding to the text processing algorithm.
15. A computer-readable storage medium storing computer instructions, which when executed by a processor, implement the steps of the method for integrating text processing services according to any one of claims 1 to 11.
CN201910502727.2A 2019-06-11 2019-06-11 Integration method, device and system of text processing service Active CN110377881B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910502727.2A CN110377881B (en) 2019-06-11 2019-06-11 Integration method, device and system of text processing service

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910502727.2A CN110377881B (en) 2019-06-11 2019-06-11 Integration method, device and system of text processing service

Publications (2)

Publication Number Publication Date
CN110377881A CN110377881A (en) 2019-10-25
CN110377881B true CN110377881B (en) 2023-04-07

Family

ID=68250119

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910502727.2A Active CN110377881B (en) 2019-06-11 2019-06-11 Integration method, device and system of text processing service

Country Status (1)

Country Link
CN (1) CN110377881B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111026319B (en) * 2019-12-26 2021-12-10 腾讯科技(深圳)有限公司 Intelligent text processing method and device, electronic equipment and storage medium
CN114154461A (en) * 2020-09-08 2022-03-08 第四范式(北京)技术有限公司 Text data processing method, device and system
CN113297306B (en) * 2020-09-30 2023-02-07 阿里云计算有限公司 Data processing method and device
CN112633516B (en) * 2020-12-18 2023-06-27 上海壁仞智能科技有限公司 Performance prediction and machine learning compiling optimization method and device
CN114911553A (en) * 2022-03-28 2022-08-16 携程旅游信息技术(上海)有限公司 Text processing task construction method, device, equipment and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106815224A (en) * 2015-11-27 2017-06-09 大唐软件技术股份有限公司 Service acquisition method and apparatus
WO2018028319A1 (en) * 2016-08-12 2018-02-15 中兴通讯股份有限公司 Method and device for sorting contacts

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106815224A (en) * 2015-11-27 2017-06-09 大唐软件技术股份有限公司 Service acquisition method and apparatus
WO2018028319A1 (en) * 2016-08-12 2018-02-15 中兴通讯股份有限公司 Method and device for sorting contacts

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于云平台的软件服务流引擎技术研究;蔡茂等;《合肥工业大学学报(自然科学版)》;20120828(第08期);全文 *

Also Published As

Publication number Publication date
CN110377881A (en) 2019-10-25

Similar Documents

Publication Publication Date Title
CN110377881B (en) Integration method, device and system of text processing service
CN113034095B (en) Man-machine interaction method and device combining RPA and AI, storage medium and electronic equipment
CN109760041B (en) Chat robot-based cloud management system and operation method thereof
CN109460250B (en) Application program generation method and device
CN111144128A (en) Semantic parsing method and device
CN112433940B (en) Software development kit SDK test method and related equipment
CN111523676B (en) Method and device for assisting machine learning model to be online
US11663113B2 (en) Real time fault localization using combinatorial test design techniques and test case priority selection
CN112243016A (en) Middleware platform, terminal equipment, 5G artificial intelligence cloud processing system and processing method
CN108597499B (en) Voice processing method and voice processing device
CN111506305A (en) Tool kit generation method and device, computer equipment and readable storage medium
WO2023151397A1 (en) Application program deployment method and apparatus, device, and medium
CN116633804A (en) Modeling method, protection method and related equipment of network flow detection model
CN112308205A (en) Model improvement method and device based on pre-training model
CN116756016A (en) Multi-browser testing method, device, equipment, medium and program product
CN116257404A (en) Log analysis method and computing device
CN115858556A (en) Data processing method and device, storage medium and electronic equipment
CN115203674A (en) Automatic login method, system, device and storage medium for application program
CN115291928A (en) Task automatic integration method and device of multiple technology stacks and electronic equipment
CN114610446A (en) Method, device and system for automatically injecting probe
CN114547628A (en) Vulnerability detection method and device
CN113723800A (en) Risk identification model training method and device and risk identification method and device
CN112905457A (en) Software testing method and device
CN113297306B (en) Data processing method and device
US20240289113A1 (en) Techniques to Proactively Monitor and Initiate Communication System Updates Using Interactive Chat Machine Learning Models

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20201009

Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands

Applicant after: Innovative advanced technology Co.,Ltd.

Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands

Applicant before: Advanced innovation technology Co.,Ltd.

Effective date of registration: 20201009

Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands

Applicant after: Advanced innovation technology Co.,Ltd.

Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands

Applicant before: Alibaba Group Holding Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant