WO2022007919A1

WO2022007919A1 - Flow processing method and device, and computer system

Info

Publication number: WO2022007919A1
Application number: PCT/CN2021/105379
Authority: WO
Inventors: 张柳军; 梁治祥; 娄修俊; 于海鹏; 蔡志杰; 蒲轶梅; 王辉; 秦龙; 蔡进坤
Original assignee: 阿里巴巴集团控股有限公司
Priority date: 2020-07-09
Filing date: 2021-07-09
Publication date: 2022-01-13
Also published as: CN113918138A

Abstract

Disclosed in embodiments of the present application are a flow processing method and device, and a computer system. The method comprises: obtaining image data comprising a flowchart, and recognizing, according to the image data, constituent elements comprised in the flowchart and layout relation information among the constituent elements; mapping the constituent elements into flow element objects defined by means of a programming language, and determining attribute information of the flow element objects; and generating a flow processing code according to the attribute information of the flow element objects and the layout relation information. By means of the embodiments of the present application, the flow designing and processing achieving efficiency can be improved.

Description

Process processing method, device and computer system

This application claims the priority of the Chinese patent application with the application number 202010658408.3 filed on July 9, 2020, and the invention title is "Process Processing Method, Device and Computer System", the entire contents of which are incorporated into this application by reference.

technical field

The present application relates to the technical field of visual process design, and in particular, to a process processing method, device and computer system.

Background technique

Visual application design is a fast and efficient programming method, through the drag-and-drop selection of pre-designed page elements (input box, drop-down selection box, search box, etc.), as well as the configuration of relevant copywriting, data and other information, etc. , you can design a specific application page. The advantage is that application designers can complete the design of application pages without writing or only need to write very little program code, thus greatly improving the work efficiency and technical threshold of application designers, even non-professional personnel, etc. Applications can be designed to meet the needs. This is especially valuable in the design of enterprise management applications. For example, financial personnel within the enterprise can design applications for financial reimbursement, and account managers can design customer relationship management applications, etc. Systematization and online service.

In the visual application designer of enterprise management applications, the pages to be designed can usually be divided into basic information, work collaboration, and data display. The work collaboration part may involve a lot of process design parts. For example, for a financial reimbursement application, the basic information required includes reimbursement type, expense occurrence date, amount, description, attachments, etc. A form for entering the above information can be designed in the basic information page; in the process design part, Design the specific approval process, for example, the first-level supervisor approves, and then determines whether to submit it to the corresponding financial approval of the department according to the specific amount, and so on. After completing the basic information page and process design, specific applications can be released online. When specific enterprise employees need to make financial reimbursement, they can fill in the specific data that needs to be reimbursed through the basic information page, and then they will follow the settings. The process flow is transferred to the approvers at all levels for approval, and the status of the approval nodes at all levels can also be queried through the page, and so on.

Among them, in the process designer, one way is to provide operation options for adding elements such as approvers and approval conditions, and designers can choose to add approvers at all levels to the process according to specific needs, and set flow conditions. Or, for some more complex processes, the process may include multiple branch judgments, and a relatively advanced process design can also be adopted. Specifically, elements such as nodes and lines required in the flowchart can be provided, so that designers can compare the existing or hand-drawn flowcharts, and draw the electronic version of the flowchart structure by dragging the nodes, lines, etc. , and then configure the data on specific nodes and connections, including specific approvers, circulation conditions, and related data, to complete the process design.

However, configuring the data in the flowchart requires the user to be aware of some of the concepts defined in the designer, such as events, activities, gateways, flow directions, and so on. Users need to continuously apply the above concepts in the process of configuring a complete process in order to convert the offline process into an online process. For non-professionals, the field barriers are relatively high, and the process conversion efficiency is low, which is not conducive to ordinary personnel to quickly and accurately realize the process.

Therefore, how to design a visual process more conveniently and quickly has become a technical problem that needs to be solved by those skilled in the art.

SUMMARY OF THE INVENTION

The present application provides a process processing method, device and computer system, which can improve the efficiency of process design.

This application provides the following solutions:

A process processing method includes:

Acquiring image data containing a flow chart, and identifying the constituent elements included in the flow chart and the layout relationship information between the constituent elements according to the image data;

Mapping the constituent elements into a process element object defined by a programming language, and determining attribute information of the process element object;

The process code is generated according to the attribute information of the process element object and the layout relationship information.

A process processing method, comprising:

Obtain scanned images of paper flowcharts;

Identify the constituent elements contained in the flowchart and the layout relationship information between the constituent elements according to the scanned image;

generating process processing code according to the attribute information of the process element object and the layout relationship information;

Integrate the process processing code into the code of the associated application, so that during the running of the application, the task to be executed of the next process node is generated, and the to-be-executed task flow is transferred to the next process node.

A method of generating an application including:

Provide an operation interface for visual design of basic form data, the operation interface includes a list of candidate form elements, an editing area, and operation options for configuring the content and/or attributes of the form elements;

Generate basic form code according to the form elements selected to the editing area, the layout information between the form elements, and the configured content and/or attribute information;

According to the attribute information of the process element object and the layout relationship information, the process code is generated;

Combining the basic form code and the process processing code to generate the code of the target application;

Provide the link of the target application, so as to access the page of the target application according to the link, after receiving the basic data through the page, generate the to-be-executed task of the next process node according to the process code, and Transfer the task flow to the next process node.

A form processing method that includes:

Obtaining image data including a form diagram, and identifying the constituent elements included in the form diagram and the layout relationship information between the constituent elements according to the image data;

mapping the constituent elements to form element objects defined by a programming language, and determining data content and/or attribute information associated with the form element objects;

The form code is generated according to the data content and/or attribute information of the form element object and the layout relationship information.

A process processing device, comprising:

an image recognition unit, configured to obtain image data containing a flow chart, and identify constituent elements contained in the flow chart and layout relationship information between the constituent elements according to the image data;

a mapping unit, configured to map the constituent elements to a process element object defined by a programming language, and determine attribute information of the process element object;

A code generation unit, configured to generate a process code according to the attribute information of the process element object and the layout relationship information.

A process processing device, comprising:

an image scanning unit, used to obtain a scanned image of the paper flow chart;

A relationship identification unit, configured to identify the constituent elements contained in the flow chart and the layout relationship information between the constituent elements according to the scanned image;

an element mapping unit, configured to map the constituent elements to a process element object defined by a programming language, and determine attribute information of the process element object;

a code determination unit, configured to generate a process processing code according to the attribute information of the process element object and the layout relationship information;

A code processing unit, configured to integrate the process processing code into the code of the associated application, so that during the running process of the application, the task to be executed of the next process node is generated, and the to-be-executed task is transferred to the next process node.

An apparatus for generating an application program, comprising:

The interface providing unit is used to provide an operation interface for visual design of basic form data, the operation interface includes a list of candidate form elements, an editing area, and an operation for configuring the content and/or properties of the form elements options;

The basic code generation unit is used to generate basic form code according to the form elements selected to the editing area, the layout information between the form elements, and the configured content and/or attribute information;

a layout information identification unit, configured to acquire image data containing a flow chart, and identify the constituent elements contained in the flow chart and the layout relationship information between the constituent elements according to the image data;

an object mapping unit, configured to map the constituent elements to a process element object defined by a programming language, and determine attribute information of the process element object;

a process code generation unit, configured to generate process code according to the attribute information and layout relationship information of the process element object;

a target code generation unit, configured to combine the basic form code and the process processing code to generate the code of the target application;

A target link providing unit, configured to provide a link of the target application, so as to access the page of the target application according to the link, and after receiving the basic data through the page, generate the next flow according to the flow processing code node's task to be executed, and transfer the task flow to the next process node.

A form processing device, comprising:

a layout information determining unit, configured to acquire image data including a form diagram, and identify constituent elements included in the form diagram and layout relationship information between the constituent elements according to the image data;

an element object processing unit, configured to map the constituent elements to form element objects defined by a programming language, and determine data content and/or attribute information associated with the form element objects;

A form code generation unit, configured to generate a form code according to the data content and/or attribute information of the form element object and the layout relationship information.

According to the specific embodiments provided by the application, the application discloses the following technical effects:

Through the technical solutions provided by the embodiments of the present application, the constituent elements contained therein and the layout relationship information between them can be identified by identifying the images containing the flowcharts, and the constituent elements can be mapped to a programming language Define the process element object, and determine the attribute information of the process element object. Furthermore, the process code may be generated according to the attribute information of the process element object and the layout relationship information. Through this solution, when designing a visual process, it is no longer necessary for the user to drag and drop specific primitives one by one, or manually configure the attributes of the primitives (even if necessary, only part of the fine-tuning processing is performed), but can be directly and automatically recognized. Therefore, the efficiency of visual process design can be improved, and compared with the solutions of the prior art, the field barriers can be further reduced, so that personnel in the non-program development field can also conveniently and efficiently design application programs.

Of course, implementing any product of the present application does not necessarily need to achieve all of the advantages described above at the same time.

Description of drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the accompanying drawings required in the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some of the present application. In the embodiments, for those of ordinary skill in the art, other drawings can also be obtained according to these drawings without any creative effort.

1-1 to 1-9 are schematic diagrams of applications provided by embodiments of the present application;

2 is a schematic diagram of an application architecture provided by an embodiment of the present application;

3 is a flowchart of a first method provided by an embodiment of the present application;

FIG. 4 is a schematic diagram of process elements provided by an embodiment of the present application;

FIG. 5 is a schematic diagram of organizational structure simulation provided by an embodiment of the present application;

6 is a flowchart of a second method provided by an embodiment of the present application;

7 is a flowchart of a third method provided by an embodiment of the present application;

8 is a flowchart of a fourth method provided by an embodiment of the present application;

9 is a schematic diagram of a first device provided by an embodiment of the present application;

10 is a schematic diagram of a second device provided by an embodiment of the present application;

11 is a schematic diagram of a third device provided by an embodiment of the present application;

12 is a schematic diagram of a fourth device provided by an embodiment of the present application;

FIG. 13 is a schematic diagram of a computer system provided by an embodiment of the present application.

detailed description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art fall within the protection scope of this application.

In order to facilitate the comparison of the technical solutions provided by the embodiments of the present application with the solutions in the prior art, the relatively efficient visual process processing solution mentioned in the background technology section is first introduced below.

Suppose the financial reimbursement approval process of an enterprise is shown in Figure 1-1. When using the visual application designer for application design, the basic data can be configured first. Specifically, as shown in Figure 1-2, the designer can Provides a variety of optional form elements, including single-line input box, multi-line input box, drop-down selection, etc., according to the type of specific basic data, etc., select form elements to build basic data pages. After selecting a specific form element, you can also configure the specific form element, including title, description information, prompt text, width, and so on. The basic data page of the final configuration can be shown in Figure 1-3. It can include fields such as reimbursement type, expense occurrence date, amount, description, attachments, etc. After the subsequent application goes online, specific enterprise employees and other users can fill in the above information on the corresponding page and initiate a reimbursement request when they need reimbursement.

After completing the basic data configuration, you can enter the specific approval process configuration. For process configuration, as shown in Figure 1-4, the designer page can provide optional process elements. These process elements are usually defined in the system after abstracting the type and function of the process elements. For example, It can include manual nodes, automatic nodes, branch nodes, aggregation nodes, CC nodes, and the like. In the process of process design, users can select the corresponding nodes and drag them to the central editing area according to their needs. For example, corresponding to the flowchart in Figure 1-1, you can first select an artificial node and drag it to the editing area. After selecting a specific node in the editing area, the interface can also provide options for configuring the node, as shown in Figure 1-5, you can configure the approver rules required by the node, including selecting a specific approver, etc. After that, you can drag and drop more other nodes to the editing area, and you can also draw the connection between the nodes in the editing area, and set the line execution rules, as shown in Figure 1-6. Finally, after multiple node dragging, connection drawing, and setting of corresponding approver rules and line execution rules, the electronic flowchart shown in Figure 1-7 can be generated. The electronic flow chart corresponds to a page data in a format such as Json in the background. After the electronic flow chart is designed and saved, it can be published through the designer page. After that, a corresponding access link can be generated for a specific application page, and users such as employees in the enterprise can access the page designed by the designer through the link. For example, as shown in Figure 1-8, the page accessed by the user can display the form for filling in the basic data. After the user completes the filling and submits, it can be transferred among the approvers at all levels according to the above-mentioned set process. . As shown in Figure 1-9, the reimbursement initiator can also view the application content and the corresponding process status on its own page, and so on.

It can be seen that in the above process of visual process design, the user needs to understand what is a manual node, what is an automatic node, branch node, aggregation node, etc. In addition, it is also necessary to target the approver rules on specific nodes, and between nodes. Manual configuration of line execution rules, etc., the field barriers are relatively high, and the process is time-consuming.

In view of the above situation, a new solution is provided in the embodiments of the present application. In this solution, the flow chart on a carrier such as paper (for example, it can be a flow chart in an existing document, or manually Drawing flow chart, etc.) for identification (eg OCR identification, etc.), to identify the constituent elements contained in the flow chart, which may specifically include graphics, symbols, text, and the like. Afterwards, according to the pre-established rule base, the specific constituent elements can be mapped to the marking symbols in the process modeling, so as to determine the corresponding process modeling meaning. For example, it is recognized that the flowchart includes a rectangular box, which can be mapped as a "manual node", which means an activity that requires manual approval; a rounded rectangle is mapped as an "automatic node", which means an activity that is automatically completed and does not require manual approval ,etc. After the above mapping is completed, it can also be mapped to a process element object according to the specific process modeling meaning, and the corresponding attribute information (name, description information, etc.) can be determined. Among them, the so-called process element object may specifically refer to an object defined by an object-oriented programming language. During specific implementation, a batch of process element objects may be pre-defined, which correspond to multiple markers in the process modeling, and establish The second rule base. In this way, after identifying the process modeling meaning corresponding to a certain component element, it can be mapped to a corresponding process element object according to the second rule base. Afterwards, the attribute information of the process element object can also be determined by means of automatic identification and/or manual configuration. Finally, according to the attribute information of the process element object and the layout relationship information, process processing code, for example, Json code, etc. is generated. After the process processing code is saved and released online with the basic data, it can be used to submit the basic data, and based on the process processing code, the submitted application will be processed for subsequent circulation, including judging the circulation conditions, and circulation. To the approvers at all levels for processing, and so on.

That is to say, in this embodiment of the present application, the user only needs to prepare an existing paper flow chart, or a flow chart drawn by a drawing tool, or even a hand-drawn flow chart, and can be identified by means of OCR (if it is a paper flow chart) quality map, you can first scan it as an electronic image) for identification, and automatically convert the constituent elements contained in the flowchart into a process element object defined by a programming language, and determine the attribute information of the process element object, Further, according to the layout relationship in the flow chart, the flow processing code can be assembled into a part of the associated application code. In addition, the designer can also provide a manual configuration interface. On the basis of automatic identification, users can also make some fine-tuning, including modifying, adding, deleting some configurations, and so on. In this way, the user does not need to drag the process elements one by one, and it is no longer necessary to understand the meaning of the process element objects abstracted by the system. In addition, the attribute information of the specific process element objects can also be automatically determined. Nodes or wires can be configured manually, or only need to be fine-tuned based on automatic recognition results. Therefore, the efficiency of process design can be improved, and the field barriers can be further reduced.

From the perspective of the system architecture of the product, the embodiment of the present application can provide a visual application designer for users who have application visual design requirements. form exists. For example, for the latter, as shown in Figure 2, the user can log in to the design page, and complete the visual design of the application through the editing interface provided in the page, which can include the design of the process, which can then be saved and published. . After publishing, the designer system can generate a corresponding link, and the user can share the link so that the user of the application can access the corresponding page.

The specific technical solutions provided by the embodiments of the present application are described in detail below.

Example 1

First, Embodiment 1 of the present application provides a method for processing a process. Referring to FIG. 3 , the method may specifically include:

S310: Acquire image data including a flow chart, and identify constituent elements included in the flow chart and layout relationship information between constituent elements according to the image data;

The image data of the flowchart may be obtained by scanning a paper flowchart, or may also be an electronic version of the flowchart drawn by a drawing tool. In the embodiment of the present application, the main flow chart may include the process involved in the application program that needs to be visually designed. The flow of transactions will vary, therefore, through enterprise management application design that needs to be personalized for a specific organization. Through the visual application designer, professionals in non-program development fields such as human resources in the organization can design applications. In the application process of such enterprise management, the design of the process is usually involved, for example, including the reimbursement approval process, the leave approval process, the recruitment follow-up process, and so on. Among them, for some organizations, there may be standardized rules and regulations, and there may be existing flow charts (paper or electronic versions) for various processes. Identify based on the flow chart. Or, if there is no existing flow chart, the user can also use the drawing tool to draw the flow chart, or even hand-drawn. Since the process of drawing a flowchart only needs to be drawn in a language that humans can understand, including drawing specific nodes, using text to express specific approver roles, flow conditions, etc., this process is not easy for users. There are technical difficulties.

The constituent elements in the flowchart may include graphics, symbols, characters, etc., and the specific graphics may include node-type graphics such as rectangular boxes, and may also include connection-type graphics. The text can include the text marked in the specific node to describe the specific approver and other information, for example, "approval by the first-level supervisor", "approval by the financial interface person", etc.; or, the text marked on the connection line to describe the flow conditions , for example, "Amount greater than or equal to 10000", etc. The above-mentioned constituent elements can be identified by techniques such as OCR, and in addition, the layout information between the specific constituent elements can be identified, including the upper and lower nodes connected by the connection, and so on.

S320: Map the constituent elements to a process element object defined by a programming language, and determine attribute information of the process element object.

Since the designer usually defines the process element object through the programming language, the specific code is expressed based on this process element object. Therefore, after identifying the constituent elements in the flowchart, they can be mapped to the process element object defined by the programming language, and the attribute information of the process element object can be determined.

There may be various specific mapping methods, for example, in one of the methods, two rule bases may be established in advance. One of the rule bases can store the correspondence between the constituent elements in the flowchart and the types of the flow elements, and the other rule base stores the correspondence between the types of the flow elements and the flow element objects. The process element type may specifically be the type information that classifies and defines specific process elements in standards such as BPMN (Transaction Process Modeling and Marking), and may specifically include manual nodes, automatic nodes, connecting lines, etc.; process elements The object can be an object defined by an object-oriented programming language (here, "object" is a concept in the field of object-oriented programming), wherein each process element object can correspond to its own ID, as well as attribute information such as name and description. Determining the attribute information of the process element object can enable the computer to identify the specific constituent elements in the flowchart, and then express the specific process in the form of specific executable code.

For example, in a specific implementation manner, the definition of the process element object of the manual approval node class in the system can be expressed as follows:

{

"id":"xxxxx",

"name":"Manual approval",

"type":"User",

"description":"Manual approval",

"props":{

"position":{},

"userRule":{},

"finishRule":true,

"actions":[{

"name":"Agree"

}]

}

That is, the process element object of the human approval class node can have the following attribute fields: ID, name, type, description, props, position, user rules ( userRule), end rules (finishRule), actions (actions), etc. After identifying a manual approval node from the flowchart, attribute information on multiple attribute fields such as ID, name, and type of the corresponding process element object can be determined, thereby generating a complete process element object instance.

It should be noted that, in order to be able to perform element mapping, the specific flowchart may be drawn using standardized process modeling symbols. For example, in practical applications, the BPMN (Business Process Model and Notation) standard can be used to draw. Among them, BPMN is a modeling language standard for building service flow charts, which defines how specific graphic elements form a flow chart, including the types and meanings of process elements corresponding to specific graphic elements, and so on. For example, the specific definition can be as shown in FIG. 4 . Or, in another way, the user can also customize or specify the type and meaning of the process element corresponding to the primitive. For example, in the BPMN standard, a rectangle corresponds to a manual node, a rounded rectangle corresponds to an automatic node, and in the automatic node In the way of definition, it can also be that the rectangle corresponds to the automatic node, the rounded rectangle corresponds to the artificial node, and so on. After completing the customization or designation, the user can draw the flow chart, and then identify the constituent elements contained in it through OCR identification, and map it to the type and meaning of the flow elements.

In addition, after the specific constituent elements are mapped to the process element object, the attribute information of the process element object can also be determined. There are various methods for determining the attribute information. For example, in one method, a manual configuration entry can be directly provided on the recognition result page, and the user manually configures the attribute information of the specific process element object. Or, in another manner, since the flowchart can usually include some text information, which can express the attributes of specific constituent elements, automatic identification of the configuration information can also be realized.

The attribute information about the process element object may specifically include name, type information, description information, and the like. During specific implementation, the first mapping rule base may also store the process modeling meaning corresponding to the process element type. In this case, after determining the process element type corresponding to the constituent element according to the first mapping rule base, The name and/or category attribute of the process element object may also be determined according to the process modeling meaning.

As for the description information of the flow element object, it can be determined according to the specific text content in the flow chart. For example, in one case, if the type of the process element object is a node that requires manual processing, the role information of the corresponding process processing personnel on the node can be determined according to the text element associated with the corresponding component element in the flowchart; Then, the target role identifier corresponding to the role information is determined from the pre-established organization member organizational structure information, and the description information of the process element object of the node type is determined according to the target role identifier. For example, as shown in Figure 1-1, the text associated with a node is "approval by first-level supervisor", then you can search for information such as the role ID belonging to the first-level supervisor in the associated organizational structure information, and configure it to the associated process node, and so on. The organizational structure information may be created by a related tool such as instant messaging before the user creates a specific application through the current designer. For example, suppose that part of the organizational structure of a company can be shown in Figure 5. The various departments where specific employees are located, as well as the relationship between superiors and subordinates, can be reflected through organizational structure information. After completing the creation of organizational structure information in advance, the system can assign corresponding IDs to specific personnel, etc., and associate attributes such as departments and roles. Identify, and automatically complete the generation of relevant processing code.

In addition, if the type of the flow element object is an automatically processed node, the automatically executed action information, such as an end action, etc., can be determined according to the text element associated with the corresponding constituent element in the flow chart. The automatically executed action information can also be defined in the system in advance. After identifying an action that needs to be automatically executed, the ID and other information corresponding to the action can be determined, and the corresponding action execution code can be generated.

Furthermore, if the type of the flow element object is a connecting line, the execution rule information of the connecting line can be determined according to the text elements associated with the corresponding constituent elements in the flow chart, and the context information of the location where the connecting line is located. . Wherein, if the execution rule includes judgment on the relevant data, the target data object associated in the pre-configured basic data is determined according to the text element, so that the identification information of the connection line is determined according to the identification information of the target data object. Execution rule information. For example, in the flowchart shown in Figure 1-1, where the execution rule of a line is that the amount is greater than or equal to 10,000, the related data object is "amount". Usually, the configuration of the basic data is also performed first. In the related application of financial reimbursement, "amount" will be pre-configured as a basic data, and accordingly, the system can generate the ID and other information corresponding to the data object. Therefore, in the process of process design, when it is identified that the specific line execution rule involves the judgment of the value of a certain data, the specific data can be directly corresponding to the previously configured basic data object, Afterwards, specific line execution rule codes can be generated by using information such as the ID of the basic data object.

During specific implementation, the meaning of the text element can also be determined by identifying and understanding the text element in the flowchart; and then, according to the meaning of the text element, the attribute information of the flow element object is determined.

It should be noted that, after the identification of process element objects and their attribute information and layout relationship information is completed, operation options for manual adjustment can also be provided, so that users can make fine adjustments based on the automatic identification results, including modifying certain parameters. The attribute value of the process element, or adding a process node, deleting a process node, etc.

S330: Generate a process code according to the attribute information of the process element object and the layout relationship information.

After multiple process element objects and their corresponding attribute information and layout relationship information are determined, process code can be generated. In specific implementation, specific process node objects can correspond to their respective process engines. This process engine can be responsible for scheduling from a node to a node, who sent an event, identify event attributes, and connect lines. relationship, find the next node for approval, and so on. The final generated process processing code will become a part of the associated application code. After the application goes online, the part involving process processing can be used for specific process flow according to this part of the process processing code.

It should be noted that, since the process codes corresponding to the same category of flowcharts are usually highly similar, especially the types, positions, layout relationships, etc. of specific process elements, the differences may only lie in specific values (for example, specific executor, etc.). Therefore, during specific implementation, in order to further improve efficiency, a process code template may also be provided in advance, and a corresponding relationship between the process code template and the flowchart category identifier may be established. In this way, when a flow chart needs to be generated for a flow chart, the target category identification information to which the flow chart contained in the image data belongs can also be obtained, and then the attribute information and layout relationship information of the flow element object can be written into the process code template corresponding to the target category identification information to generate the process code. The target category identification information may be directly included in the image data, for example, the image data may include information such as a two-dimensional code or a category code to represent the category identification of the flowchart. At this time, the target category identification information can be identified from the image data.

Or, in another way, a process code template can also be provided in advance, and a corresponding relationship between the process code template and the keywords can be established; at this time, after the image data is identified, it can be determined that the identified Whether a target keyword is included in the text element of the processing code. For example, if a flowchart includes the keyword "reimbursement", you can use the reimbursement template to generate specific process codes, and so on.

In addition, operation options for step-by-step confirmation/adjustment of the generated process code may also be provided; then, according to the user's operation result, the process code template is optimized and adjusted.

In a word, through the technical solutions provided by the embodiments of the present application, the constituent elements contained therein and the layout relationship information between them can be identified by means of identifying an image containing a flowchart, and the constituent elements can be mapped to pass The process element object defined by the programming language, and the attribute information of the process element object is determined. Furthermore, the process code may be generated according to the attribute information of the process element object and the layout relationship information. Through this solution, when designing a visual process, it is no longer necessary for the user to drag and drop specific primitives one by one, or manually configure the attributes of the primitives (even if necessary, only part of the fine-tuning processing is performed), but can be directly and automatically recognized. Therefore, the efficiency of visual process design can be improved, and compared with the solution of the prior art, the field barrier can be further reduced, so that the personnel in the non-program development field can also conveniently design the application program.

Embodiment 2

The second embodiment provides another process processing method for a specific implementation scheme of the first embodiment in practical applications. Referring to FIG. 6 , the method may specifically include:

S610: Obtain a scanned image of the paper flow chart;

S620: Identify the constituent elements included in the flowchart and the layout relationship information between the constituent elements according to the scanned image;

S630: Map the constituent elements to a process element object defined by a programming language, and determine attribute information of the process element object;

S640: Generate a process processing code according to the attribute information of the process element object and the layout relationship information;

S650: Integrate the process processing code into the code of the associated application, so that during the running of the application, a task to be executed of the next process node is generated, and the to-be-executed task flow is transferred to the next a process node.

Embodiment 3

The third embodiment provides a method for generating an application program for a specific application scenario. Referring to FIG. 7 , the method may specifically include:

S710: Provide an operation interface for visually designing basic form data, where the operation interface includes a list of candidate form elements, an editing area, and operation options for configuring the content and/or attributes of the form elements;

S720: Generate a basic form code according to the form element selected to the editing area, the layout information between the form elements, and the configured content and/or attribute information;

S730: Acquire image data containing a flow chart, and identify constituent elements included in the flow chart and layout relationship information between the constituent elements according to the image data;

S740: Map the constituent elements to a process element object defined by a programming language, and determine attribute information of the process element object;

S750: Generate a process processing code according to the attribute information and layout relationship information of the process element object;

S760: Combine the basic form code and the process processing code to generate the code of the target application;

S770: Provide a link of the target application, so as to access the page of the target application according to the link, and after receiving basic data through the page, generate a task to be executed for the next process node according to the process code , and transfer the task flow to the next process node.

Wherein, the application program includes an enterprise management application program.

During specific implementation, flow processing status information may also be provided on the page of the target application according to the flow processing code.

Embodiment 4

The foregoing embodiments mainly provide corresponding solutions for the process processing method, and during specific implementation, similar solutions can also be applied to the form processing process. Therefore, the fourth embodiment also provides a form processing method. Referring to FIG. 8 , the method may specifically include:

S810: Acquire image data including a form diagram, and identify constituent elements included in the form diagram and layout relationship information between the constituent elements according to the image data;

S820: Map the constituent elements to form element objects defined by a programming language, and determine the data content and/or attribute information associated with the form element objects;

S830: Generate a form code according to the data content and/or attribute information of the form element object and the layout relationship information.

Corresponding to the foregoing method embodiment 1, an embodiment of the present application further provides a process processing apparatus, referring to FIG. 9 , the apparatus may specifically include:

The image recognition unit 910 is configured to acquire image data containing a flow chart, and identify the constituent elements contained in the flow chart and the layout relationship information between the constituent elements according to the image data;

a mapping unit 920, configured to map the constituent elements to a process element object defined by a programming language, and determine attribute information of the process element object;

The code generation unit 930 is configured to generate a process code according to the attribute information of the process element object and the layout relationship information.

Wherein, the mapping unit may specifically include:

a first mapping subunit, used for mapping the constituent elements to process element types in process modeling according to a pre-established first mapping rule base;

The second mapping subunit is configured to map the constituent elements to the flow element objects according to the pre-established second mapping rule base and the flow element types corresponding to the constituent elements.

Wherein, the first mapping rule base also stores the process modeling meaning corresponding to the process element type;

The mapping unit can also be used to:

According to the process modeling meaning, the name and/or category attribute of the process element object is determined.

The constituent elements contained in the flow chart include graphic elements;

The first mapping rule base may specifically store the correspondence between the graphic elements and the types of process elements in the process modeling.

In addition, the constituent elements included in the flow chart include text elements;

The attribute information of the process element object includes: description information of the process element object;

Specifically, the mapping unit can also be used for:

The description information of the flow element object is determined by identifying the text elements in the flow chart.

Specifically, the mapping unit can be specifically used for:

If the type of the process element object is a node that needs manual processing, then determine the role information of the corresponding process processing personnel on the node according to the text element associated with the corresponding component element in the flowchart;

The target role identifier corresponding to the role information is determined from the pre-established organizational structure information of institutional members, and the description information of the process element object of the node type is determined according to the target role identifier.

Alternatively, the mapping unit can be specifically used for:

If the type of the flow element object is an automatically processed node, the automatically executed action information is determined according to the text element associated with the corresponding constituent element in the flow chart.

Alternatively, the mapping unit can be specifically used for:

If the type of the flow element object is a connecting line, the execution rule information of the connecting line is determined according to the text element associated with the corresponding constituent element in the flowchart and the context information of the position of the connecting line.

In addition, the mapping unit can also be used for:

If the execution rule includes judgment on related data, determine the target data object associated in the preconfigured basic data according to the text element, so as to determine the execution rule of the connection line according to the identification information of the target data object information.

Corresponding to the second embodiment of the present application, the embodiment of the present application further provides a process processing device, see FIG. 10 , the device may specifically include:

an image scanning unit 1010, configured to obtain a scanned image of a paper flow chart;

A relationship identification unit 1020, configured to identify the constituent elements contained in the flowchart and the layout relationship information between the constituent elements according to the scanned image;

an element mapping unit 1030, configured to map the constituent elements to a process element object defined by a programming language, and determine attribute information of the process element object;

a code determination unit 1040, configured to generate a process processing code according to the attribute information of the process element object and the layout relationship information;

The code processing unit 1050 is configured to integrate the process processing code into the code of the associated application, so as to generate the to-be-executed task of the next process node during the running process of the application, and to convert the to-be-executed task Flow goes to the next process node.

Corresponding to the three-phase embodiment of the present application, the embodiment of the present application further provides a device for generating an application program. Referring to FIG. 11 , the device may specifically include:

The interface providing unit 1110 is used to provide an operation interface for visual design of basic form data, the operation interface includes a list of candidate form elements, an editing area, and an interface for configuring the content and/or properties of the form elements. Action options;

a basic code generation unit 1120, configured to generate basic form codes according to the form elements selected to the editing area, the layout information between the form elements, and the configured content and/or attribute information;

The layout information identification unit 1130 is used to obtain the image data containing the flow chart, and identify the constituent elements contained in the flow chart and the layout relationship information between the constituent elements according to the image data;

an object mapping unit 1140, configured to map the constituent elements to a process element object defined by a programming language, and determine attribute information of the process element object;

a process code generation unit 1150, configured to generate process code according to the attribute information and layout relationship information of the process element object;

The target code generation unit 1160 is used to generate the code of the target application by combining the basic form code and the flow processing code;

A target link providing unit 1170 is configured to provide a link of the target application, so as to access the page of the target application according to the link, and after receiving the basic data through the page, generate the next step according to the process code. The to-be-executed task of the process node, and the task flow is transferred to the next process node.

Corresponding to the fourth embodiment of the present application, the embodiment of the present application further provides a form processing apparatus, referring to FIG. 12 , the apparatus may specifically include:

a layout information determining unit 1210, configured to acquire image data including a form diagram, and identify the constituent elements included in the form diagram and the layout relationship information between the constituent elements according to the image data;

an element object processing unit 1220, configured to map the constituent elements to form element objects defined by a programming language, and determine data content and/or attribute information associated with the form element objects;

The form code generating unit 1230 is configured to generate a form code according to the data content and/or attribute information of the form element object and the layout relationship information.

In addition, an embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, implements the steps of the method described in any one of the foregoing method embodiments.

and a computer system comprising:

one or more processors; and

a memory associated with the one or more processors, the memory is used to store program instructions that, when read and executed by the one or more processors, perform any one of the foregoing method embodiments the steps of the method.

13 exemplarily shows the architecture of the computer system 1300 , which may specifically include a processor 1310 , a video display adapter 1311 , a disk drive 1312 , an input/output interface 1313 , a network interface 1314 , and a memory 1320 . The processor 1310 , the video display adapter 1311 , the disk drive 1312 , the input/output interface 1313 , and the network interface 1314 , and the memory 1320 may be communicatively connected through the communication bus 1330 .

The processor 1310 can be implemented by a general-purpose CPU (Central Processing Unit, central processing unit), a microprocessor, an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), or one or more integrated circuits, etc. Execute relevant programs to realize the technical solutions provided by this application.

The memory 1320 may be implemented in the form of a ROM (Read Only Memory, read-only memory), a RAM (Random Access Memory, random access memory), a static storage device, a dynamic storage device, and the like. The memory 1320 may store an operating system 1321 for controlling the operation of the computer system 1300 , and a basic input output system (BIOS) 1322 for controlling the low-level operations of the computer system 1300 . In addition, a web browser 1323, a data storage management system 1324, a flow design processing system 1325, and the like can also be stored. The above-mentioned process design processing system 1325 may be an application program that specifically implements the operations of the foregoing steps in this embodiment of the present application. In a word, when the technical solutions provided by the present application are implemented through software or firmware, the relevant program codes are stored in the memory 1320 and called and executed by the processor 1310.

The input/output interface 1313 is used to connect input/output modules to realize information input and output. The input/output/module can be configured in the device as a component (not shown in the figure), or can be externally connected to the device to provide corresponding functions. The input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, and the like.

The network interface 1314 is used to connect a communication module (not shown in the figure), so as to realize the communication interaction between the device and other devices. The communication module may implement communication through wired means (eg, USB, network cable, etc.), or may implement communication through wireless means (eg, mobile network, WIFI, Bluetooth, etc.).

Bus 1330 includes a path that transfers information between the various components of the device (eg, processor 1310, video display adapter 1311, disk drive 1312, input/output interface 1313, network interface 1314, and memory 1320).

It should be noted that although the above device only shows the processor 1310, the video display adapter 1311, the disk drive 1312, the input/output interface 1313, the network interface 1314, the memory 1320, the bus 1330, etc., in the specific implementation process, the A device may also include other components necessary for proper operation. In addition, those skilled in the art can understand that, the above-mentioned device may also include only the necessary components to realize the solution of the present application, instead of all the components shown in the figures.

From the description of the above embodiments, those skilled in the art can clearly understand that the present application can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solutions of the present application can be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products can be stored in storage media, such as ROM/RAM, magnetic disks , CD-ROM, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in various embodiments or some parts of the embodiments of the present application.

Each embodiment in this specification is described in a progressive manner, and the same and similar parts between the various embodiments may be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system or the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and reference may be made to the partial description of the method embodiment for related parts. The systems and system embodiments described above are only illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, It can be located in one place, or it can be distributed over multiple network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution in this embodiment. Those of ordinary skill in the art can understand and implement it without creative effort.

The process processing method, device and computer system provided by the present application have been introduced in detail above. The principles and implementations of the present application are described with specific examples in this paper. The descriptions of the above embodiments are only used to help understand the present application. At the same time, for those skilled in the art, according to the idea of the present application, there will be changes in the specific implementation and application scope. In conclusion, the content of this specification should not be construed as a limitation on the present application.

Claims

A process processing method, comprising:

Acquiring image data containing a flow chart, and identifying the constituent elements included in the flow chart and the layout relationship information between the constituent elements according to the image data;

Mapping the constituent elements into a process element object defined by a programming language, and determining attribute information of the process element object;

The process code is generated according to the attribute information of the process element object and the layout relationship information.
The method of claim 1, wherein:

The mapping of the constituent elements to process element objects defined by a programming language includes:

mapping the constituent elements to process element types in process modeling;

According to the process element type corresponding to the component element, the component element is mapped to the process element object.
The method of claim 2, wherein:

The determining the attribute information of the process element object includes:

The name and/or category attribute information of the process element object is determined according to the pre-stored correspondence between the type of process element and the meaning of process modeling.
The method of claim 1, wherein:

The constituent elements included in the flow chart include text elements;

The attribute information of the process element object includes: description information of the process element object;

The determining the attribute information of the process element object includes:

The description information of the flow element object is determined by identifying the text elements in the flow chart.
The method of claim 4, wherein:

The determining the description information of the process element object includes:

If the process element object is a node that needs manual processing, then determine the role information of the corresponding process processing personnel on the node according to the text element associated with the corresponding component element in the flowchart;

The target member identifier corresponding to the role information is determined from the pre-established organization member organizational structure information, and the description information of the process element object of the node type is determined according to the target member identifier.
The method of claim 4, wherein:

The determining the description information of the process element object includes:

If the type of the flow element object is an automatically executed node, the automatically executed action information is determined according to the text element associated with the corresponding constituent element in the flow chart.
The method of claim 4, wherein:

The determining the description information of the process element object includes:

If the type of the flow element object is a connecting line, the execution rule information of the connecting line is determined according to the text element associated with the corresponding constituent element in the flowchart and the context information of the position of the connecting line.
The method of claim 7, further comprising:

If the execution rule information includes the judgment on the relevant data, the target data object corresponding to the relevant data in the pre-configured basic data is determined according to the text element, so as to determine the target data object according to the identification information of the target data object. The execution rule information of the connection line.
The method of claim 4, wherein:

The determining the description information of the flow element object by identifying the text elements in the flow chart includes:

Determine the meaning of the text element by identifying and understanding the text elements in the flowchart;

According to the meaning of the text element, the description information of the process element object is determined.
The method of claim 1, wherein:

The method also includes:

Provide a process code template in advance, and establish the corresponding relationship between the process code template and the flowchart category identifier;

Obtain the target category identification information to which the flowchart contained in the image data belongs;

The generation process processing code includes:

Write the attribute information and layout relationship information of the process element object into the process code template corresponding to the target category identification information, so as to generate the process code.
The method of claim 10, wherein:

The image data includes the target category identification information;

The acquiring target category identification information to which the flowchart contained in the image data belongs, includes:

The object class identification information is identified from the image data.
The method of claim 1, further comprising:

Provide process code templates in advance, and establish the correspondence between the process code templates and keywords;

After identifying the image data, determine whether the identified text element contains the target keyword;

If the target keyword is included, the generation process processing code includes:

The attribute information and layout relationship information of the process element object are written into the process code template corresponding to the target keyword, so as to generate the process code.
The method according to claim 10 or 12, further comprising:

Provides action options for step-by-step validation/adjustment of the generated process processing code;

According to the operation result of the user, the process code template is optimized and adjusted.
A process processing method, comprising:

Obtain scanned images of paper flowcharts;

Identify the constituent elements contained in the flowchart and the layout relationship information between the constituent elements according to the scanned image;

The constituent element is mapped to a process element object defined by a programming language, and the attribute information of the process element object is determined;

generating process processing code according to the attribute information of the process element object and the layout relationship information;

Integrate the process processing code into the code of the associated application, so that during the running of the application, the task to be executed of the next process node is generated, and the to-be-executed task flow is transferred to the next process node.
A method for generating an application program, comprising:

Provide an operation interface for visual design of basic form data, the operation interface includes a list of candidate form elements, an editing area, and operation options for configuring the content and/or attributes of the form elements;

Generate basic form code according to the form elements selected to the editing area, the layout information between the form elements, and the configured content and/or attribute information;

Acquiring image data containing a flow chart, and identifying the constituent elements included in the flow chart and the layout relationship information between the constituent elements according to the image data;

Mapping the constituent elements into a process element object defined by a programming language, and determining attribute information of the process element object;

According to the attribute information of the process element object and the layout relationship information, the process code is generated;

Combining the basic form code and the process processing code to generate the code of the target application;

Provide the link of the target application, so as to access the page of the target application according to the link, after receiving the basic data through the page, generate the to-be-executed task of the next process node according to the process code, and Transfer the task flow to the next process node.
The method of claim 15, wherein:

The applications include enterprise management applications.
The method of claim 15, further comprising:

According to the flow processing code, flow processing status information is provided in the page of the target application.
A form processing method, comprising:

Obtaining image data including a form diagram, and identifying the constituent elements included in the form diagram and the layout relationship information between the constituent elements according to the image data;

mapping the constituent elements to form element objects defined by a programming language, and determining data content and/or attribute information associated with the form element objects;

The form code is generated according to the data content and/or attribute information of the form element object and the layout relationship information.
A process processing device, characterized in that it includes:

an image recognition unit, configured to obtain image data containing a flow chart, and identify constituent elements contained in the flow chart and layout relationship information between the constituent elements according to the image data;

a mapping unit, configured to map the constituent elements to a process element object defined by a programming language, and determine attribute information of the process element object;

A code generation unit, configured to generate a process code according to the attribute information of the process element object and the layout relationship information.
A process processing device, characterized in that it includes:

an image scanning unit, used to obtain a scanned image of the paper flow chart;

A relationship identification unit, configured to identify the constituent elements contained in the flow chart and the layout relationship information between the constituent elements according to the scanned image;

an element mapping unit, configured to map the constituent elements to a process element object defined by a programming language, and determine attribute information of the process element object;

a code determination unit, configured to generate a process processing code according to the attribute information of the process element object and the layout relationship information;

A code processing unit, configured to integrate the process processing code into the code of the associated application, so that during the running process of the application, the task to be executed of the next process node is generated, and the to-be-executed task is transferred to the next process node.
A device for generating an application program, comprising:

The interface providing unit is used to provide an operation interface for visual design of basic form data, the operation interface includes a list of candidate form elements, an editing area, and an operation for configuring the content and/or properties of the form elements options;

The basic code generation unit is used to generate basic form code according to the form elements selected to the editing area, the layout information between the form elements, and the configured content and/or attribute information;

a layout information identification unit, configured to acquire image data containing a flow chart, and identify the constituent elements contained in the flow chart and the layout relationship information between the constituent elements according to the image data;

an object mapping unit, configured to map the constituent elements to a process element object defined by a programming language, and determine attribute information of the process element object;

a process code generation unit, configured to generate process code according to the attribute information and layout relationship information of the process element object;

a target code generation unit, configured to combine the basic form code and the process processing code to generate the code of the target application;

A target link providing unit, configured to provide a link of the target application, so as to access the page of the target application according to the link, and after receiving the basic data through the page, generate the next flow according to the flow processing code The task to be executed of the node, and the task flow is transferred to the next process node.
A form processing device, comprising:

a layout information determining unit, configured to acquire image data including a form diagram, and identify constituent elements included in the form diagram and layout relationship information between the constituent elements according to the image data;

an element object processing unit, configured to map the constituent elements to form element objects defined by a programming language, and determine data content and/or attribute information associated with the form element objects;

A form code generation unit, configured to generate a form code according to the data content and/or attribute information of the form element object and the layout relationship information.
A computer-readable storage medium on which a computer program is stored, characterized in that, when the program is executed by a processor, the steps of the method according to any one of claims 1 to 9 are implemented.
A computer system, comprising:

one or more processors; and

a memory associated with the one or more processors, the memory is used to store program instructions that, when read and executed by the one or more processors, executes any one of claims 1 to 9 the steps of the method.