CN117234392A - Art resource generation method and device and electronic equipment - Google Patents

Art resource generation method and device and electronic equipment Download PDF

Info

Publication number
CN117234392A
CN117234392A CN202311025319.5A CN202311025319A CN117234392A CN 117234392 A CN117234392 A CN 117234392A CN 202311025319 A CN202311025319 A CN 202311025319A CN 117234392 A CN117234392 A CN 117234392A
Authority
CN
China
Prior art keywords
node
target
data
nodes
sequence
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311025319.5A
Other languages
Chinese (zh)
Inventor
刘琦
李超群
劳维旻
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Netease Hangzhou Network Co Ltd
Original Assignee
Netease Hangzhou Network Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Netease Hangzhou Network Co Ltd filed Critical Netease Hangzhou Network Co Ltd
Priority to CN202311025319.5A priority Critical patent/CN117234392A/en
Publication of CN117234392A publication Critical patent/CN117234392A/en
Pending legal-status Critical Current

Links

Landscapes

  • Processing Or Creating Images (AREA)

Abstract

The invention provides an art resource generation method, an art resource generation device and electronic equipment, wherein the method comprises the following steps: the function nodes are associated with function functions for realizing preset functions; responding to node selection operation aiming at the alternative node display area, and displaying the selected target node in the node editing area; setting a node sequence connection line and a data transmission connection line for a target node; the node sequence connection is used for: indicating an order of operation between the target nodes; the data transmission connection is used for: indicating a data transmission relationship between the target nodes; and operating the target nodes according to the operation sequence, executing the associated function by the operating target nodes, and transmitting data among the target nodes according to the data transmission relation so as to output the designated art resource. The method can realize automatic production of art resources, the production process does not need manual participation, the production flow of the art resources is simplified, the reusability of the image production flow is improved, and the method is suitable for mass production of the art resources.

Description

Art resource generation method and device and electronic equipment
Technical Field
The present invention relates to the field of art resource production technology, and in particular, to a method and an apparatus for generating an art resource, and an electronic device.
Background
AI (Artificial Intelligence ) drawing technology can be applied to the production of art resources. The worker may input text or images to the AI model, which may generate images. However, the method is difficult to directly generate the image meeting the requirements, a plurality of links are required to be repeatedly and manually corrected, the manual participation degree is high, the process is complex, the reusability degree is low, and the method is difficult to be suitable for mass art resource production.
Disclosure of Invention
In view of the above, the present invention aims to provide a method, an apparatus and an electronic device for generating an art resource, so as to realize automatic production of the art resource, the production process does not need to be manually participated, the production process of the art resource is simplified, the reusability of the image production process is improved, and the method and the apparatus are suitable for mass production of the art resource.
In a first aspect, an embodiment of the present invention provides a method for generating an art resource, where the method includes: displaying an editing page; the editing page comprises the following steps: an alternative node display area and a node editing area; the alternative node display area provides a plurality of functional nodes; the function nodes are associated with function functions for realizing preset functions; responding to node selection operation aiming at the alternative node display area, and displaying the selected target node in the node editing area; responding to the connection setting operation, and setting a node sequence connection and a data transmission connection for the target node; the node sequence connection line is used for: indicating an order of operation between the target nodes; the data transmission connection is used for: indicating a data transmission relationship between the target nodes; and operating the target nodes according to the operation sequence, executing the associated function by the operating target nodes, and transmitting data among the target nodes according to the data transmission relation so as to output the designated art resource.
In a second aspect, an embodiment of the present invention provides an art resource generating apparatus, including: the page display module is used for displaying the editing page; the editing page comprises the following steps: an alternative node display area and a node editing area; the alternative node display area provides a plurality of functional nodes; the function nodes are associated with function functions for realizing preset functions; the node selection module is used for responding to the node selection operation aiming at the alternative node display area and displaying the selected target node in the node editing area; the connection setting module is used for setting a node sequence connection and a data transmission connection for the target node in response to the connection setting operation; the node sequence connection line is used for: indicating an order of operation between the target nodes; the data transmission connection is used for: indicating a data transmission relationship between the target nodes; and the resource output module is used for operating the target nodes according to the operation sequence, executing the associated function by the operating target nodes, and transmitting data among the target nodes according to the data transmission relation so as to output the appointed art resource.
In a third aspect, an embodiment of the present invention provides an electronic device, including a processor and a memory, where the memory stores computer executable instructions executable by the processor, and the processor executes the computer executable instructions to implement the above-mentioned art resource generating method.
In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium storing computer-executable instructions that, when invoked and executed by a processor, cause the processor to implement the above-described art resource generation method.
The embodiment of the invention has the following beneficial effects:
the art resource generating method, the device and the electronic equipment display an editing page; the editing page comprises the following steps: an alternative node display area and a node editing area; the alternative node display area provides a plurality of functional nodes; the function nodes are associated with function functions for realizing preset functions; responding to node selection operation aiming at the alternative node display area, and displaying the selected target node in the node editing area; responding to the connection setting operation, and setting a node sequence connection and a data transmission connection for the target node; the node sequence connection line is used for: indicating an order of operation between the target nodes; the data transmission connection is used for: indicating a data transmission relationship between the target nodes; and operating the target nodes according to the operation sequence, executing the associated function by the operating target nodes, and transmitting data among the target nodes according to the data transmission relation so as to output the designated art resource.
In the mode, each functional node is associated with a functional function for realizing a preset function, the operation sequence and the data transmission relation between the nodes are set by selecting the nodes, then the target node is operated according to the operation sequence, the target node which is operated executes the associated functional function, and data is transmitted between the target nodes according to the data transmission relation, so that the designated art resource is output, the automatic production art resource can be realized, the production process does not need to be manually participated, the production flow of the art resource is simplified, the reusability of the image production flow is improved, and the method is suitable for mass art resource production.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
In order to make the above objects, features and advantages of the present invention more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are needed in the description of the embodiments or the prior art will be briefly described, it being obvious that the drawings in the description below are some embodiments of the invention and that other drawings may be obtained from these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flowchart of an art resource generating method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of an editing page according to an embodiment of the present invention;
fig. 3 is a schematic diagram of a parameter device panel of a target node according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a node sequential connection according to an embodiment of the present invention;
fig. 5 is a schematic diagram of a data transmission connection line according to an embodiment of the present invention;
fig. 6 is a schematic diagram of a functional node according to an embodiment of the present invention;
fig. 7 is a schematic diagram of an art resource generating device according to an embodiment of the present invention;
fig. 8 is a schematic diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In the related art, the production process of 2D art resources is mainly finished by manpower, and equipment such as Photoshop, hand drawing board and the like is needed, and the processes of sketching, refining, coloring, finishing and the like are finished by manpower, so that time and labor are wasted.
After the AI drawing technology appears, the staff can use the AI drawing platform or function of the open source to generate the pictures through the modes of the venturi drawing, the photo drawing and the like. The AI model used in the platform or function determines the style, texture, details, etc. of the picture. AI models can generally be obtained by using third party AI models that are open source on the web or in self-training AI models.
The 2D art resource meeting the requirements cannot be directly generated through AI drawing, and a plurality of processing links are possibly needed, including repeatedly using an AI model to generate and correct an image, manually correcting the image and the like, and the requirements can be met after the image is processed by the links. The production flow of the same type of resources is the same, but each link must be completed manually, and the process needs to jump back and forth between different software, so that the operation is complex, and time and labor are wasted. If other people multiplex the image processing links, detailed operation documents need to be written, and the cost of writing and understanding is high.
Based on the above problems, the method, the device and the electronic equipment for generating the art resource provided by the embodiment of the invention can be applied to the production process of various art resources, such as 2D art resources, 3D art resources and the like, and specifically, the art resources can comprise two-dimensional images, three-dimensional models and the like.
The art resource herein may be a two-dimensional image, for example, an image resource in a gaming system, or an image resource in other application systems. The art resource may also be a three-dimensional model, e.g., a character model resource, a scene model resource, etc.
The art resource generating method in one embodiment of the present disclosure may be run on a local terminal device or a server. When the art resource generating method is operated on the server, the method can be realized and executed based on a cloud interaction system, wherein the cloud interaction system comprises the server and the client device.
For the sake of understanding the present embodiment, first, a detailed description will be given of an art resource generating method disclosed in the present embodiment, as shown in fig. 1, where the method may be applied to the foregoing described local terminal device or the foregoing described client device, and the method includes the following steps:
Step S102, controlling and displaying an editing page; wherein, the editing page comprises: an alternative node display area and a node editing area; the alternative node display area provides a plurality of functional nodes; the function nodes are associated with function functions for realizing preset functions;
the editing page is used for editing target nodes required by the production of art resources and the relation among the target nodes. The edit page may be displayed in a browser or application. The alternative node display area can display alternative multiple functional nodes in a list, grid or other form; the node names, the node identifications and the like of the functional nodes can be displayed; by triggering the function node, a detail page of the function node can be displayed, and information such as functions, parameters, using methods and the like of the function node can be displayed in the detail page.
In the initial state, the node editing area is a blank area and can be in the form of canvas. The node edit area is used for displaying the selected functional node. For example, if a function node is dragged from the candidate node display area to the node edit area by way of dragging, the function node is selected and the node edit area is displayed. For another example, a functional node is selected from the candidate node display area by clicking, and then the functional node is displayed in the node editing area.
Different functional nodes are used to implement different functions, such as image acquisition, image generation, image processing, text processing, etc. The function node performs the corresponding function by means of a function which can be obtained in a specific function language, e.g. python function, C language function, etc. The function functions can be loaded on the local terminal equipment, and when a certain function node is operated, the corresponding function can be directly called from the local. The function can also be run on the server, when a certain function is run on the local terminal equipment, the local terminal equipment communicates with the server to enable the server to run the corresponding function, and then the running result method is sent to the local terminal equipment.
Step S104, responding to the node selection operation aiming at the alternative node display area, and displaying the selected target node in the node editing area;
the node selection operation may be a drag operation, a click operation, a double click operation, or the like acting on the function node; the node selects the functional node selected by the operation, i.e., the target node. In the node editing area, the target node may be displayed by a specified shape; in the target node, a node name, a node symbol, various parameters in the node, an editable control, and the like of the target node may be displayed, and a port or the like for connecting other nodes may be displayed. The user can edit parameters, ports, etc. of the target node in the node edit area. In the node editing area, the target node can move the display position, and the display area of the target node can be enlarged, reduced, and the like.
Step S106, in response to the connection setting operation, setting a node sequence connection and a data transmission connection for the target node; wherein, this node order line is used for: indicating an order of operation between the target nodes; the data transmission connection is used for: indicating a data transmission relationship between the target nodes;
when the node editing area includes a plurality of target nodes, in order to identify the logic relationship between the target nodes in the operation process of the target nodes, a node sequence connection line and a data transmission connection line are also required to be set in the node editing area. For a node-sequential connection, in one manner, the node-sequential connection may have directionality to characterize the running order of the target nodes at both ends of a node-sequential connection, e.g., the node-sequential connection points from node 1 to node 2, then the running order is to run node 1 before node 2. In another manner, a sequential input port and a sequential output port may be set in the target node, and if a node is connected with the sequential input port of the node a and the sequential output port of the node B in a sequential connection manner, the operation sequence is that the node B is operated first and then the node a is operated.
For the data transmission line, in one manner, the data transmission line may also have directionality to represent a data transmission relationship of a target node at two ends of one data transmission line, for example, the data transmission line is directed from the node 3 to the node 4, and then output data of the node 3 is input to the node 4. In another manner, a data input port and a data output port may be provided in the target node, and if one data transmission line connects the data input port of the node a and the data output port of the node B, the data output by the node B is input to the node a.
The node sequential wires and the data transmission wires may have different wire formats, such as solid lines, dashed lines, and may have different wire colors, e.g., green, red, yellow. In addition, since the data may have text data, image data, parameter data, etc., the data transmission lines corresponding to different kinds of data may also have different line formats.
Step S108, the target nodes are operated according to the operation sequence, the target nodes which are being operated execute the associated function functions, and data are transmitted between the target nodes according to the data transmission relation until the appointed art resource is output.
In actual implementation, part of target nodes may need to acquire input data, and operate the target nodes after acquiring the input data, and part of target nodes may also need to directly operate without inputting the data. After the target nodes are triggered to operate, the target nodes can automatically operate according to the operation sequence, and in the operation process, data are transmitted among the target nodes according to the data transmission relation until the appointed art resource is output.
The art resource herein may be a two-dimensional image, for example, an image resource in a gaming system, or an image resource in other application systems. The art resource may also be a three-dimensional model, e.g., a character model resource, a scene model resource, etc.
The implementation manner of the art resource generating method of the embodiment can be integrated into one plug-in to be applied to other software, can be an independent application program APP, and can be integrated into specific hardware equipment. The art resource generating method can also be packaged into a function, and a function call interface is arranged, and the art resource generating method is controlled to operate through the function call interface.
The art resource generating method displays an editing page; the editing page comprises the following steps: an alternative node display area and a node editing area; the alternative node display area provides a plurality of functional nodes; the function nodes are associated with function functions for realizing preset functions; responding to node selection operation aiming at the alternative node display area, and displaying the selected target node in the node editing area; responding to the connection setting operation, and setting a node sequence connection and a data transmission connection for the target node; the node sequence connection line is used for: indicating an order of operation between the target nodes; the data transmission connection is used for: indicating a data transmission relationship between the target nodes; and operating the target nodes according to the operation sequence, executing the associated function by the operating target nodes, and transmitting data among the target nodes according to the data transmission relation so as to output the designated art resource.
In the mode, each functional node is associated with a functional function for realizing a preset function, the operation sequence and the data transmission relation between the nodes are set by selecting the nodes, then the target node is operated according to the operation sequence, the target node which is operated executes the associated functional function, and data is transmitted between the target nodes according to the data transmission relation, so that the designated art resource is output, the automatic production art resource can be realized, the production process does not need to be manually participated, the production flow of the art resource is simplified, the reusability of the image production flow is improved, and the method is suitable for mass art resource production.
Fig. 2 shows an example of an edit page. In the alternative node display area, a plurality of optional functional nodes, such as a matting node, a resizing node, and the like, are displayed. In the initial state, the node editing area is in a blank state.
When adding a target node to the node editing area, the target node is correspondingly provided with a parameter setting panel; the parameter setting panel is displayed in the node editing area; the parameter setting panel comprises at least one parameter and a parameter value setting control corresponding to the parameter; and responding to the parameter setting operation aiming at the parameter value setting control, and acquiring the operation parameters corresponding to the target node.
The parameter setting panel corresponding to the target node is shown in fig. 3. For example, when the target node is a resizing node, the parameter setting panel may include dimensions such as an image width and an image length, and the parameter value setting control may be a numerical value input control; when the target node is an image generation node, the parameters can comprise image generation template parameters, image generation quantity parameters, image quality parameters and the like, and the parameter value setting control can be a numerical value input control, a template selection control, a numerical value selection control and the like. It will be appreciated that the parameters in the parameter setting panel may be different when the corresponding functions of the nodes are different.
By triggering the parameter value setting control, the parameter values of all the parameters after the setting can be obtained, and all the parameters in the target node and the parameter values corresponding to the parameters form the operation parameters of the target node.
Further, the target node is provided with a sequential input end and/or a sequential output end; it should be noted that, when the target node is the first node to run, the target node is usually only provided with a sequential output end, and when the target node is the last node to run, the target node is usually only provided with a sequential input end; when the target node is a node in an intermediate position, the target node is typically provided with a sequential input and a sequential output.
In response to a sequence output end of a first node in the target node being connected with a sequence input end of a second node, determining that the operation sequence of the first node and the second node is as follows: and after the operation of the first node is finished, the second node is operated.
In one mode, a connection control for sequentially connecting nodes can be provided in an editing page, and after the connection control is triggered, a sequential output end and a sequential input end of the connection are determined to be required to be set, so that the connection can be set between the two ports. In another mode, a sequential output end or a sequential input end can be triggered, then a connection line is generated, taking the sequential output end as an example, one end of the connection line is connected with the triggered sequential output end, the other end of the connection line moves along with the touch point or the mouse, when the touch point or the mouse moves to the sequential input end, the touch point or the mouse is released, and the connection line is completed.
When the connection is completed, it can be understood that the order of operation of the target nodes at both ends of the connection is determined. As described above, the sequence output end of the first node in the target node is connected to the sequence input end of the second node, and the operation sequence of the first node and the second node is determined as follows: and after the operation of the first node is finished, the second node is operated.
In the example of fig. 4, out represents a sequential output terminal, and in represents a sequential input terminal; in fig. 4, there are four target nodes, and the operation sequence is that the target node 1 operates first, then the target node 2 operates, and then the target node 3 and the target node 4 operate.
For a data transmission connection, in one mode, a target node is provided with a data input end and/or a data output end; it will be appreciated that the target node is typically only provided with a data output when no data input is required by the target node, and is typically only provided with a data input when no data is output by the target node; when a target node has both data input and data output, the target node is typically provided with a data input and a data output.
Responding to the sequence input end of the third node in the target node, which is connected with the fourth node, and determining the data transmission relationship between the third node and the fourth node as follows: the data output from the third node is input to the fourth node.
In one mode, a connection control of a data transmission connection can be provided in an editing page, and after the connection control is triggered, a data output end and a data input end of the connection are determined to be required to be set, so that the connection can be set between the two ports. In another mode, a data output end or a data input end can be triggered, then a connection line is generated, taking the data output end as an example, one section of the connection line is connected with the triggered data output end, the other end of the connection line moves along with the touch point or the mouse, and when the connection line moves to the data input end, the touch point or the mouse is released, and the connection line is completed.
When the connection is completed, it can be understood that the order of operation of the target nodes at both ends of the connection is determined. As described above, the data output end of the third node in the target node is connected to the sequential input end of the fourth node, and the data transmission relationship between the third node and the fourth node is determined as follows: the data output from the third node is input to the fourth node.
In the example of fig. 5, whether a certain port is a data input or a data output may be indicated by text, and the data transmission lines are shown in the form of dotted lines to distinguish them from the aforementioned node sequential lines. In fig. 5, a target node 1 outputs text, inputs the text to a target node 2, and outputs pictures to a target node 3 and a target node 4.
Considering that data has a plurality of formats, the processing modes of data with different formats are different. In this embodiment, in response to a link setting operation, a target data input end and a target data output end to which a target link is connected are determined; and determining that the data types corresponding to the target data input end and the target data output end are the same, and determining that the target connection line is successfully set. And determining that the data types corresponding to the target data input end and the target data output end are different, determining that the setting of the target connecting line fails, and displaying prompt information of the setting failure of the target connecting line.
Typically, the data type of the data output end of the target node is generally related to the function of the target node, if the corresponding function outputs text, the data type of the data output end is text, and if the function outputs picture, the data type of the data output end is picture. The data input of the target node will normally input data into a certain parameter of the target node, if the parameter is text, the data type of the data input is text, if the parameter is picture, the data type of the data input is picture.
When the target data input end and the target data output end of the target connecting line are selected, determining the target data input end and the target data output end which are connected by the target connecting line, judging whether the target data input end and the target data output end are identical at the moment, and if so, displaying the target connecting line in a node editing area; if the target connection line is different, the target connection line is not displayed, namely the target connection line fails to be set, and an information popup window can be generated for displaying the prompt information of the target connection line failure to prompt the target connection line failure to be set.
For the successfully set target connection line, the target connection line can be controlled to be displayed based on the data type; wherein the display format of the target connection line is matched with the data type. The display format can be the color of the connection line, the virtual reality of the connection line, etc.; for example, when the data type is text, the target link is red, when the data type is an image, the target link is green, and so on.
In a specific implementation manner, the target node includes one or more of the following nodes: image data node, image processing node, image generation node, text processing node, digital processing node, variable node, external parameter node.
The image data node is used for loading images, previewing images or storing images; an image processing node for cropping an image, adjusting hue saturation, or adjusting image size; and the image generation node is used for drawing based on the text and/or the initial image and generating a target image.
The image data node is mainly used for reading and storing images; the image generation node may perform drawing based on the text, input the text to the AI model, and generate a target image matching the text using the AI model, or perform drawing based on the initial image, input the initial image to the AI model, and generate a target image improved on the basis of the initial image using the AI model.
The image processing node may be specifically an AI drawing node, where the node typically provides an AI model, such as a text generating image model, an image generating image model, and the like, and may also provide various functional plug-ins, such as a background removal algorithm plug-in, and the like. When the node is used, an API (Application Programming Interface, application program interface) corresponding to the server side is required to be called, and a picture is generated at the server side and is transmitted back to the client side through a network. The server usually operates on a server, and the client operates on a local terminal device.
The image processing node may be a GPT (generating Pre-Trained Transformer, generating a Pre-training transducer model) node: the node needs to call functions provided by a server API, can realize interaction between a user and models such as ChatGPT and the like, and can be generally used for automatically generating AI drawing, namely, inputting characters into a text generation image model.
It should be noted that, in the node editing area, a plurality of target nodes of the same type may be included, for example, two image processing nodes are included, but parameters and operation orders of the target nodes of the same type may be the same or different.
Further, the text processing node is used for inputting text, superposing text or setting a text template; the digital processing node is used for inputting the numbers and carrying out calculation processing on the numbers; the variable node is used for setting variables in the art resource production file; and the external parameter node is used for setting the input parameters and the output parameters of the art resource production file.
The text processing node can be used for processing, overlaying, replacing and the like of character strings, and the text processing node can input character string parameters to other nodes; the digital processing node can be used for inputting numbers, adding, subtracting, multiplying, dividing, comparing sizes and the like, is mainly used for operations such as digital processing, conversion and the like, and can input integer or emerging number type parameters to other nodes. The variable nodes can define global variable nodes in art resource production files and can be used for realizing functions such as timers and the like; the external parameter nodes are mainly used for defining input and output parameters when the art resource generates an API.
Fig. 6 shows various functional nodes provided in the alternative node display area, which can be target nodes after being selected. In this example, the functional nodes are divided into various classes of text, numbers, AI drawings, GPT, batch operations, and image processing.
The text class comprises text template nodes and superimposed text nodes; the text template node may be used to set a text format in which text data is saved in the text template node or retrieved from other sources. The text node is overlapped, a plurality of texts with different sources can be spliced to obtain spliced texts, and the text splicing mode, such as splicing sequence of the texts with different sources, can be included in the overlapped text node.
In the digital class, a random number node may generate a random number; the basic operation node can provide basic operation functions such as addition, subtraction, multiplication, division and the like; the maximum value node may calculate maximum value data among the plurality of data; the minimum node may calculate minimum data of the plurality of data; and the comparison operation node can compare a plurality of data and output corresponding results based on the comparison result.
In the AI drawing class, loading model nodes which can be used for loading the AI model after training; the map generation node can input an initial image, process the initial image through an AI model and output a processing result image meeting the requirements; the text generation graph node can input a text, process the text through an AI model and output a processing result image matched with the text. The AI model can be operated on other service terminals, and the local terminal equipment can communicate with the service terminal where the AI model is located, so that the AI model is called remotely, and a processing result image is output. Tiling Diffusion nodes, which may also be referred to as Tiled Diffusion nodes, may be used to improve resolution of an image, to draw details of an image, and so on. The ControlNet model node can be used to control the model structure of the AI model. The local redrawing node can locally redraw the input initial image, for example, redraw the face area of the character in the initial image to obtain the characters of other facial features; redrawing the scene ground area in the initial image to obtain scene ground with other ground characteristics, and the like. The text back-pushing node can be used for identifying an input initial image to obtain text information of the initial image, for example, if the initial image contains characters, animals, scenery and the like; the text information of the initial image includes: characters, animals, scenery.
The GPT (generated Pre-Trained Transformer) class includes GPT nodes, and can be used for automatically generating text, image, or other format files.
In the batch class of operations, a text collection node may be used to input a text collection; the value set node may be for inputting a set of digits; the traversal nodes are used for traversing the data in the preset data set according to a preset traversal sequence; the circulating node is used for controlling the follow-up target node of the circulating node to perform circulating execution; the model collection node may be used to input a model collection that includes a plurality of AI models in the model collection.
In the image processing class, the pad nodes may be used to provide a pad for processing an image, the pad being used to provide a structure, scale, content, etc. upon which the image is processed. The image matting node can be used for matting the initial image through image processing software, the image processing software can be operated on other service ends, and the image matting node accesses the service end through an access interface, so that the image matting processing is carried out on the initial image through the image processing software, and a matting result is obtained. The matting node can be specifically a PBREM matting node, and the PBREM is also called PBRemTools (Precise Background Remover tools), is a Stable Diffusion web UI expansion function, and can remove the background from a single image with high precision. The AI background matting node can perform background matting on the initial image through an AI model so as to obtain a foreground image or a background image and the like in the initial image, the AI model can operate on other service ends, and the AI background matting node accesses the service end through an access interface so as to perform matting on the initial image by using the AI model to obtain a matting result. The acquire picture size node may calculate a length, a width, a channel number, etc. for the input initial image. The resizing node may perform processing such as reduction, enlargement, cropping, etc. on the input image, thereby resizing the image. The extended edge node may add an edge region to the input initial image; hue saturation the hue saturation can be adjusted for the input initial image; the image amplifying node can amplify an input initial image; face mask nodes are automatically identified, face regions of an input initial image can be identified, and corresponding mask images are generated based on the positions of the face regions.
The various functional nodes integrate the image processing functions of a plurality of software, and a user can call the corresponding software to realize the image processing functions by selecting the functional nodes, so that the repeated operation and conversion of the input and output of the plurality of software can be avoided, and the operation convenience of art resource processing is improved. Through operating the function node, the operation code can be avoided, the corresponding function can be called through the selection and connection of the node, and each function is connected in series, so that the operation is simple and easy to use.
In a specific implementation manner, the target node further includes a traversal node; the traversal node is used for: according to a preset traversal sequence, traversing the data in the preset data set, and inputting the traversed data into the subsequent nodes connected with the traversal nodes through the data transmission lines.
For example, the traversing node may be connected to a text set node, where the preset data set is stored in the text set node, and the traversing node acquires the data in the data set one by one according to the arrangement sequence of the data in the data set; the traversing node can be connected with the text-to-graph node through a data transmission line, and traversed data are input into the text-to-graph node, so that an image matched with text content corresponding to the data is obtained. This approach eliminates the need for the user to change the text data each time, thereby automating batch generation of images.
Further, the target node further includes a circulation node; the loop node is used for: the subsequent target node of the control loop node is executed in a loop; the operation sequence of the subsequent target node is behind the circulating node, and the subsequent target node is directly or indirectly connected with the circulating node through a node sequence connecting line; outputting corresponding output data when the subsequent target node executes once; after the circulation execution is finished, the quantity of the output data is matched with the circulation times of the subsequent target nodes.
When the subsequent target node needs to execute the cycle, the control can be performed through the cycle node, and the cycle times can be set in the cycle node, so that the cycle times of the subsequent target node are controlled; the subsequent target node may be an image generation node, e.g., a graph node, a meridional graph node; image processing nodes, e.g., matting nodes, resizing nodes, are also possible. The above-mentioned follow-up target node can also include a plurality of, for example, circulation node, drawing node, the node of digging a picture is once connected through node sequence line, and at this moment, circulation node can control drawing node and the node of digging a picture to carry out circulation execution, and in each circulation process, drawing node and the node of digging a picture all carry out once, then obtain output result. The data required by the subsequent processing nodes in the execution process can be provided by the circulating node, and can also be connected with other nodes through the data transmission lines, so that the data can be provided by the nodes.
In one particular implementation, the traversal node and the loop node coexist. The subsequent target node is connected with the traversing node through a data transmission line; the traversing node is connected with the circulating node through a node sequence connecting line; the data traversed by the traversing node is input to a subsequent target node and used as input data of the subsequent target node when the cycle is executed; the traversing node traverses to one data each time, and the circulating node controls the follow-up target node to perform circulation once.
In the mode, a subsequent target node controlled by the circulating node acquires data from the traversing node; each time the traversing node obtains one data from the data set, the circulating node controls the subsequent target node to execute once, the subsequent target node obtains the data from the traversing node, and then the execution is started to obtain output data; and controlling the subsequent target nodes to stop circulation by the circulation node until the data in the data set is traversed.
The traversing node can be used for traversing a text set, a digital set, a picture set and the like, provides a basis for executing pipelines in batches, and can automatically execute pipeline flows for multiple times by traversing defined texts or numbers or pictures to obtain different results.
Through the traversing nodes and the circulating nodes, a plurality of pictures can be generated in batches, and manual time-consuming drawing is avoided; and as part of nodes can call a remote server to process images, the load of local equipment for running the nodes is small, the requirement on hardware is low, and the cloud server can be called to execute the super operation of the AI model.
In the editing page, a favorites function may be provided, and the user may add some of the candidate nodes provided in the candidate node display area to the favorites, for example, add commonly used candidate nodes to the favorites, to facilitate subsequent searching and use of the nodes.
It should be noted that different functional nodes are used for implementing different functions; the implementation of a function typically requires a expenditure of computational effort. Based on the above, the functions corresponding to the partial functional nodes with simple functions or lower calculation force requirements can be realized in the local terminal equipment based on the complexity and calculation force requirements of the functions required by the functional nodes, for example, the image size nodes, the text processing nodes and the like are obtained; the functions corresponding to the partial functional nodes with complex functions or high calculation force requirements can be realized through a remote server, for example, the mask generation node, the local drawing node, the image post-processing node and the like.
In this way, for the functional node with higher calculation power demand, the terminal device only needs to provide lower hardware conditions to realize the image generation method provided by the embodiment, so that the operation load is smaller and the requirement on hardware is lower.
In the above-described edit page, in order to determine whether a node in the node edit area can normally operate and whether data satisfying a demand can be output, a trial run may be performed on a target node in the edit page. An initiation control may be provided in the editing page, through which an initiation trigger operation is performed.
Specifically, in response to a start trigger operation, controlling a target node in the node editing area to operate according to an operation sequence; determining a running target node, and executing a function associated with the running target node; displaying the running state of the target node; wherein the operating state includes: run-out, running error or not running.
In the above process, the display state of the target node may be displayed by setting a state identifier on each target node.
And a stop control can be further arranged in the editing page, the operation stop operation is triggered by triggering the stop control, and the operation of the target node is stopped in response to the operation stop operation. Further, after stopping running the target node, a continuous running control and a rerun control can be displayed; the running target control can be continuously operated by triggering the running control when the operation stopping operation is triggered; by triggering the re-run control, each target node may be reset, starting the operation from the first target node.
Further, the operation sequence and the data transmission relationship between the target nodes can be saved. Storing the operation sequence and the data transmission relation between the target nodes to obtain an art resource production file; and responding to the calling operation of the art resource production file, operating the target node according to the operation sequence and the data transmission relation, and outputting the appointed art resource.
For example, a save control may be displayed in the editing page, and clicking on the save control, or triggering other shortcut keys, may save the resulting art asset production file.
It can be understood that the art resource production file generally includes multiple target nodes for implementing different functions, such as image generation, image scaling, image brightness adjustment, etc., where the functions of the target nodes are connected in series according to the foregoing operation sequence and data transmission relationship, so that the obtained art resource production file can be output to meet the specific art resource production requirement.
The art resource production file can be stored in the form of a file or an application program, can also be integrated in other software systems as a plug-in unit, can be packaged and provides an input interface and an output interface, so that a perfect art resource production function is provided on the premise of not exposing an internal structure.
The art resource production file can enable other users to multiplex the nodes in the file and the node connection relation, and the art resource production file is stored and obtained. The art resource production file can be called locally, for example, after triggering to start the art resource production file, the file can be displayed in the editing page, wherein the editing page comprises target nodes, the running sequence among the target nodes and the data transmission relation among the target nodes; and executing the generating operation, running the target node in the file, and outputting the appointed art resource.
In another mode, the art resource production file can be sent to other terminal equipment and called by other users. For example, after triggering to start the art resource production file, the file including the target nodes, the running sequence between the target nodes and the data transmission relation between the target nodes may be displayed in the editing page of the terminal device; and operating the target node in the file, and outputting the appointed art resource. For another example, the art resource production file may be packaged, after the art resource production file is triggered and started, the editing page is not displayed, the file includes the target nodes, the running sequence among the target nodes and the data transmission relation among the target nodes, only the data input window is provided for the user to input the data required by the file running, and the appointed art resource can be output after the running.
In the mode, the art resource production file is generated, so that the nodes and the operation sequence and the data transmission relation among the nodes can be multiplexed, and when other users use the file, the required art resource can be obtained quickly without understanding details in the file, the communication cost is reduced, and the art resource production efficiency is improved.
Furthermore, the art resource generating method of the embodiment may be implemented by integrating a plug-in into other software, or may be an independent application APP, or may be integrated into a specific hardware device. The art resource generating method can also be packaged into a function, and a function call interface is arranged, and the art resource generating method is controlled to operate through the function call interface.
The node edit area may include a canvas. The canvas is the main area of the dragged, connected node. And the user realizes the construction of the node flow by connecting different nodes on the canvas. The connection between nodes is divided into a node sequence connection and a data transmission connection.
The user can control the canvas to move through a moving operation, for example, when the canvas is relatively large, the node editing area can only display a partial area of the canvas, and the user can drag the canvas by pressing a space and moving a mouse, so that other areas of the canvas are displayed in the node editing area.
The user can also control the zooming in and out of the canvas through zooming operation, for example, zooming in and out of the canvas can be realized when Ctrl is pressed and a mouse pulley is slid; the upper, lower, left and right areas of the canvas can be viewed when the mouse wheel is slid.
Triggering a right mouse button at the blank of the canvas can generate a node shortcut list, can quickly add nodes and can quickly search node names in a search box; pressing the left button of the mouse can massively frame the nodes, and operations such as batch copying, moving, deleting and the like are realized; the canvas also has the function of adding comments, clicking right button after selecting the node by the frame, clicking to add comments, white line frames appear on the node selected by the frame, and the user can input the node comments.
And providing a menu bar on the editing page, wherein a file can be newly built through the menu bar, and the newly built file has two conditions, namely that the canvas is not edited, no target node exists on the canvas, and the canvas is edited, and the target node exists on the canvas. Clicking the new file will not pop up the prompt popup and refresh the canvas when the canvas is not edited, while clicking the new file after editing will pop up the save popup.
The file can be opened through the menu bar, and all nodes of the file can be displayed in the node editing area; the file storing operation can store the current file to the selected path; the save operation can save the current file as other files; the nodes are reloaded, hot updating can be realized after the node code parameters are modified, and the canvas and the node list are refreshed immediately after clicking the button.
The menu bar also provides an automatic connection function, after clicking, connection is automatically set for a target node sequence input end and a sequence output end in the node editing area, a directed acyclic graph is constructed according to the connected ports, if a ring exists, errors are reported, then the running sequence of the nodes is calculated by using weighted topological order, and the nodes are connected in sequence. If a certain node has no sequential output end, the method can directly skip, and if the next node of the current node has no sequential input end, the method can continuously search for the next port setting connection line meeting the condition.
The art resource generating method provides low-code type drag development software, and supports staff to freely construct a 2D art resource production flow based on AI drawing. And can be stored, and the production efficiency is greatly improved by batch starting. The method is low-code type and drag type development, and can quickly build a use flow without a code foundation. The method can solidify the production flow, can configure a complete production flow in one product, and can automatically and batchly operate by clicking an operation button; the method can save the built flow into one file, send the file to other staff, quickly complete sharing and open the file for use. The method can automatically generate the configured flow into the API which can be called remotely, can be provided for an external provider to use, and does not need to worry about exposing the details of the flow.
In one mode, after the art resource production file is packaged, an operation page is generated, an operation starting control is provided in the operation page, and the operation starting operation is executed by triggering the operation starting control. The operation page may further include a data input interface to input data required for the art resource generation file.
After the art resource production file is started to run, manual parameters are not needed in the running process, and the appointed art resource, such as a two-dimensional picture, a three-dimensional model and the like, can be directly output after the operation of the art resource production file is finished.
In a specific implementation manner, a fifth node to be operated is determined, a target function corresponding to the fifth node is obtained at a local terminal device, and the target function is operated. In this manner, when the objective function of the fifth node is relatively simple, the objective function corresponding to the objective node may be stored in the art resource production file, for example, the objective function is a matting function, an image size adjustment function, or the like. When the art resource production file runs on the local terminal equipment, determining a fifth node to be run through the running sequence, and then acquiring a target function corresponding to the fifth node on the local terminal equipment, and further running the target function.
In another mode, a fifth node to be operated is determined, input parameters of the fifth node are sent to a function operation server through an interface calling mode, so that a target function of the fifth node is operated at the function operation server, and an operation result returned by the function operation server is received. In this embodiment, when the objective function of the fifth node is complex, in order to avoid an excessive data volume of the art resource production file, the objective function corresponding to the objective node is not usually stored in the art resource production file, for example, the objective function is an AI model function of a text generated image, an AI model function of an image generated image, or the like. When the art resource production file runs on the local terminal equipment, determining a fifth node to be run according to the running sequence, wherein the target function corresponding to the fifth node is not on the local terminal equipment, sending the input parameters of the fifth node to a function running server, storing the target function of the fifth node in the function running server, and returning a running result to the local terminal equipment after the target function of the fifth node is run.
According to the art resource generation method, the pipeline flow for producing the art resource can be built by dragging the nodes, and the flow can be freely customized without understanding codes; the staff only need to drag the functional nodes of the image processing developed in advance, such as nodes of cutting, picture amplifying and the like, so that the jump operation of the user among different software is reduced; the whole process can be stored as one file in the mode, and can be used after being opened after being sent to other staff, so that the details of the process are not required to be understood, and the communication cost is reduced. The automatic batch execution pipeline flow of the art resource production file can directly generate art resources meeting requirements without manual participation in the operation process, so that the time for clicking button operations and filling parameters is reduced.
Corresponding to the above method embodiment, referring to fig. 7, there is shown a schematic diagram of an art resource generating device, which includes:
a page display module 70 for displaying an edit page; the editing page comprises the following steps: an alternative node display area and a node editing area; the alternative node display area provides a plurality of functional nodes; the function nodes are associated with function functions for realizing preset functions;
a node selection module 72 for displaying the selected target node in the node editing area in response to a node selection operation for the candidate node display area;
a connection setting module 74 for setting a node sequential connection and a data transmission connection for the target node in response to the connection setting operation; the node sequence connection line is used for: indicating an order of operation between the target nodes; the data transmission connection is used for: indicating a data transmission relationship between the target nodes;
and a resource output module 76 for operating the target nodes in the order of operation, the operating target nodes executing the associated function, and transmitting data between the target nodes in the data transmission relationship to output the designated art resource.
The art resource generating device displays an editing page; the editing page comprises the following steps: an alternative node display area and a node editing area; the alternative node display area provides a plurality of functional nodes; the function nodes are associated with function functions for realizing preset functions; responding to node selection operation aiming at the alternative node display area, and displaying the selected target node in the node editing area; responding to the connection setting operation, and setting a node sequence connection and a data transmission connection for the target node; the node sequence connection line is used for: indicating an order of operation between the target nodes; the data transmission connection is used for: indicating a data transmission relationship between the target nodes; and operating the target nodes according to the operation sequence, executing the associated function by the operating target nodes, and transmitting data among the target nodes according to the data transmission relation so as to output the designated art resource.
In the mode, each functional node is associated with a functional function for realizing a preset function, the operation sequence and the data transmission relation between the nodes are set by selecting the nodes, then the target node is operated according to the operation sequence, the target node which is operated executes the associated functional function, and data is transmitted between the target nodes according to the data transmission relation, so that the designated art resource is output, the automatic production art resource can be realized, the production process does not need to be manually participated, the production flow of the art resource is simplified, the reusability of the image production flow is improved, and the method is suitable for mass art resource production.
The target node is correspondingly provided with a parameter setting panel; the parameter setting panel is displayed in the node editing area; the parameter setting panel comprises at least one parameter and a parameter value setting control corresponding to the parameter; the device further comprises a parameter acquisition module for: and responding to the parameter setting operation aiming at the parameter value setting control, and acquiring the operation parameters corresponding to the target node.
The target node is provided with a sequence input end and/or a sequence output end; the device further comprises a first connection module for: in response to a sequence output end of a first node in the target node being connected with a sequence input end of a second node, determining that the operation sequence of the first node and the second node is as follows: and after the operation of the first node is finished, the second node is operated.
The target node is provided with a data input end and/or a data output end; the device further comprises a second connection module for: responding to the sequence input end of the third node in the target node, which is connected with the fourth node, and determining the data transmission relationship between the third node and the fourth node as follows: the data output from the third node is input to the fourth node.
The target node is provided with a data input end and/or a data output end; the connection setting module is used for: determining a target data input end and a target data output end of target wire connection in response to the wire setting operation; and determining that the data types corresponding to the target data input end and the target data output end are the same, and determining that the target connection line is successfully set.
The device further comprises a setting failure module for: and determining that the data types corresponding to the target data input end and the target data output end are different, determining that the setting of the target connecting line fails, and displaying prompt information of the setting failure of the target connecting line.
The target node includes one or more of the following nodes: image data node, image processing node, image generation node, text processing node, digital processing node, variable node, external parameter node.
The target node further comprises a traversal node; the traversal node is used for: according to a preset traversal sequence, traversing the data in the preset data set, and inputting the traversed data into the subsequent nodes connected with the traversal nodes through the data transmission lines.
The target node further comprises a circulating node; the loop node is used for: the subsequent target node of the control loop node is executed in a loop; the operation sequence of the subsequent target node is behind the circulating node, and the subsequent target node is directly or indirectly connected with the circulating node through a node sequence connecting line; outputting corresponding output data when the subsequent target node executes once; after the circulation execution is finished, the quantity of the output data is matched with the circulation times of the subsequent target nodes.
The subsequent target nodes are connected with the traversing nodes through data transmission lines; the traversing node is connected with the circulating node through a node sequence connecting line; the data traversed by the traversing node is input to a subsequent target node and used as input data of the subsequent target node when the cycle is executed; the traversing node traverses to one data each time, and the circulating node controls the follow-up target node to perform circulation once.
The device also comprises a starting operation module for: responding to a starting triggering operation, and controlling a target node in the node editing area to operate according to an operation sequence; determining a running target node, and executing a function associated with the running target node; displaying the running state of the target node; wherein, the running state includes: run-out, running, run-error and not running.
The device also comprises a storage module for storing the operation sequence and the data transmission relation among the target nodes to obtain the art resource production file.
The device also comprises a calling module, which is used for responding to the calling operation of the art resource production file and operating the target node according to the operation sequence and the data transmission relation.
The resource output module is used for: and determining a fifth node to be operated, acquiring a target function corresponding to the fifth node at the local terminal equipment, and operating the target function.
The resource output module is used for: and determining a fifth node to be operated, sending input parameters of the fifth node to a function operation server through an interface calling mode, so as to operate a target function of the fifth node at the function operation server, and receiving an operation result returned by the function operation server.
The present embodiment also provides an electronic device including a processor and a memory storing computer-executable instructions executable by the processor, the processor executing the computer-executable instructions to implement the above-described art asset generation method. The electronic device may be a server or a terminal device.
Referring to fig. 8, the electronic device includes a processor 100 and a memory 101, the memory 101 storing computer-executable instructions that can be executed by the processor 100, the processor 100 executing the computer-executable instructions to implement the above-described art asset generation method.
Further, the electronic device shown in fig. 8 further includes a bus 102 and a communication interface 103, and the processor 100, the communication interface 103, and the memory 101 are connected through the bus 102.
The memory 101 may include a high-speed random access memory (RAM, random Access Memory), and may further include a non-volatile memory (non-volatile memory), such as at least one magnetic disk memory. The communication connection between the system network element and at least one other network element is implemented via at least one communication interface 103 (which may be wired or wireless), and may use the internet, a wide area network, a local network, a metropolitan area network, etc. Bus 102 may be an ISA bus, a PCI bus, an EISA bus, or the like. The buses may be classified as address buses, data buses, control buses, etc. For ease of illustration, only one bi-directional arrow is shown in FIG. 8, but not only one bus or type of bus.
The processor 100 may be an integrated circuit chip with signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware in the processor 100 or by instructions in the form of software. The processor 100 may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU for short), a network processor (Network Processor, NP for short), etc.; but also digital signal processors (Digital Signal Processor, DSP for short), application specific integrated circuits (Application Specific Integrated Circuit, ASIC for short), field-programmable gate arrays (Field-Programmable Gate Array, FPGA for short) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. The disclosed methods, steps, and logic blocks in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be embodied directly in the execution of a hardware decoding processor, or in the execution of a combination of hardware and software modules in a decoding processor. The software modules may be located in a random access memory, flash memory, read only memory, programmable read only memory, or electrically erasable programmable memory, registers, etc. as well known in the art. The storage medium is located in the memory 101, and the processor 100 reads the information in the memory 101 and, in combination with its hardware, performs the steps of the method of the previous embodiment.
The processor in the electronic device may implement the following operations in the art resource generating method by executing computer-executable instructions:
displaying an editing page; the editing page comprises the following steps: an alternative node display area and a node editing area; the alternative node display area provides a plurality of functional nodes; the function nodes are associated with function functions for realizing preset functions; responding to node selection operation aiming at the alternative node display area, and displaying the selected target node in the node editing area; responding to the connection setting operation, and setting a node sequence connection and a data transmission connection for the target node; the node sequence connection line is used for: indicating an order of operation between the target nodes; the data transmission connection is used for: indicating a data transmission relationship between the target nodes; and operating the target nodes according to the operation sequence, executing the associated function by the operating target nodes, and transmitting data among the target nodes according to the data transmission relation so as to output the designated art resource.
The target node is correspondingly provided with a parameter setting panel; the parameter setting panel is displayed in the node editing area; the parameter setting panel comprises at least one parameter and a parameter value setting control corresponding to the parameter; and responding to the parameter setting operation aiming at the parameter value setting control, and acquiring the operation parameters corresponding to the target node.
The target node is provided with a sequence input end and/or a sequence output end; in response to a sequence output end of a first node in the target node being connected with a sequence input end of a second node, determining that the operation sequence of the first node and the second node is as follows: and after the operation of the first node is finished, the second node is operated.
The target node is provided with a data input end and/or a data output end; responding to the sequence input end of the third node in the target node, which is connected with the fourth node, and determining the data transmission relationship between the third node and the fourth node as follows: the data output from the third node is input to the fourth node.
The target node is provided with a data input end and/or a data output end; determining a target data input end and a target data output end of target wire connection in response to the wire setting operation; and determining that the data types corresponding to the target data input end and the target data output end are the same, and determining that the target connection line is successfully set.
And determining that the data types corresponding to the target data input end and the target data output end are different, determining that the setting of the target connecting line fails, and displaying prompt information of the setting failure of the target connecting line.
Controlling the display target connection line based on the data type; wherein the display format of the target connection line is matched with the data type.
The target node includes one or more of the following nodes: image data node, image processing node, image generation node, text processing node, digital processing node, variable node, external parameter node.
The target node further comprises a traversal node; the traversal node is used for: according to a preset traversal sequence, traversing the data in the preset data set, and inputting the traversed data into the subsequent nodes connected with the traversal nodes through the data transmission lines.
The target node further comprises a circulation node; the loop node is used for: the subsequent target node of the control loop node is executed in a loop; the operation sequence of the subsequent target node is behind the circulating node, and the subsequent target node is directly or indirectly connected with the circulating node through a node sequence connecting line; outputting corresponding output data when the subsequent target node executes once; after the circulation execution is finished, the quantity of the output data is matched with the circulation times of the subsequent target nodes.
The subsequent target node is connected with the traversing node through a data transmission line; the traversing node is connected with the circulating node through a node sequence connecting line; the data traversed by the traversing node is input to a subsequent target node and used as input data of the subsequent target node when the cycle is executed; the traversing node traverses to one data each time, and the circulating node controls the follow-up target node to perform circulation once.
Responding to a starting triggering operation, and controlling a target node in the node editing area to operate according to an operation sequence; determining a running target node, and executing a function associated with the running target node; displaying the running state of the target node; wherein, the running state includes: run-out, running error or not running.
And stopping the operation of the target node in response to the operation stopping operation.
And (5) storing the operation sequence and the data transmission relation among the target nodes to obtain the art resource production file.
And responding to the calling operation of the art resource production file, and operating the target node according to the operation sequence and the data transmission relation.
And determining a fifth node to be operated, acquiring a target function corresponding to the fifth node at the local terminal equipment, and operating the target function.
And determining a fifth node to be operated, sending input parameters of the fifth node to a function operation server through an interface calling mode, so as to operate a target function of the fifth node at the function operation server, and receiving an operation result returned by the function operation server.
In the mode, each functional node is associated with a functional function for realizing a preset function, the nodes are selected, the operation sequence and the data transmission relation between the nodes are set, then the target nodes are operated according to the operation sequence, the target nodes which are operated execute the associated functional functions, and data are transmitted between the target nodes according to the data transmission relation, so that the appointed art resources are output, automatic production of the art resources can be realized, manual participation is not needed in the production process, the production flow of the art resources is simplified, the reusability of the image production flow is improved, and the method is suitable for mass production of the art resources.
The present embodiment also provides a computer-readable storage medium storing computer-executable instructions that, when invoked and executed by a processor, cause the processor to implement the above-described art resource generation method.
The computer-executable instructions stored in the computer-readable storage medium may implement the following operations in the art asset generation method by executing the computer-executable instructions:
displaying an editing page; the editing page comprises the following steps: an alternative node display area and a node editing area; the alternative node display area provides a plurality of functional nodes; the function nodes are associated with function functions for realizing preset functions; responding to node selection operation aiming at the alternative node display area, and displaying the selected target node in the node editing area; responding to the connection setting operation, and setting a node sequence connection and a data transmission connection for the target node; the node sequence connection line is used for: indicating an order of operation between the target nodes; the data transmission connection is used for: indicating a data transmission relationship between the target nodes; and operating the target nodes according to the operation sequence, executing the associated function by the operating target nodes, and transmitting data among the target nodes according to the data transmission relation so as to output the designated art resource.
The target node is correspondingly provided with a parameter setting panel; the parameter setting panel is displayed in the node editing area; the parameter setting panel comprises at least one parameter and a parameter value setting control corresponding to the parameter; and responding to the parameter setting operation aiming at the parameter value setting control, and acquiring the operation parameters corresponding to the target node.
The target node is provided with a sequence input end and/or a sequence output end; in response to a sequence output end of a first node in the target node being connected with a sequence input end of a second node, determining that the operation sequence of the first node and the second node is as follows: and after the operation of the first node is finished, the second node is operated.
The target node is provided with a data input end and/or a data output end; responding to the sequence input end of the third node in the target node, which is connected with the fourth node, and determining the data transmission relationship between the third node and the fourth node as follows: the data output from the third node is input to the fourth node.
The target node is provided with a data input end and/or a data output end; determining a target data input end and a target data output end of target wire connection in response to the wire setting operation; and determining that the data types corresponding to the target data input end and the target data output end are the same, and determining that the target connection line is successfully set.
And determining that the data types corresponding to the target data input end and the target data output end are different, determining that the setting of the target connecting line fails, and displaying prompt information of the setting failure of the target connecting line.
Controlling the display target connection line based on the data type; wherein the display format of the target connection line is matched with the data type.
The target node includes one or more of the following nodes: image data node, image processing node, image generation node, text processing node, digital processing node, variable node, external parameter node.
The target node further comprises a traversal node; the traversal node is used for: according to a preset traversal sequence, traversing the data in the preset data set, and inputting the traversed data into the subsequent nodes connected with the traversal nodes through the data transmission lines.
The target node further comprises a circulation node; the loop node is used for: the subsequent target node of the control loop node is executed in a loop; the operation sequence of the subsequent target node is behind the circulating node, and the subsequent target node is directly or indirectly connected with the circulating node through a node sequence connecting line; outputting corresponding output data when the subsequent target node executes once; after the circulation execution is finished, the quantity of the output data is matched with the circulation times of the subsequent target nodes.
The subsequent target node is connected with the traversing node through a data transmission line; the traversing node is connected with the circulating node through a node sequence connecting line; the data traversed by the traversing node is input to a subsequent target node and used as input data of the subsequent target node when the cycle is executed; the traversing node traverses to one data each time, and the circulating node controls the follow-up target node to perform circulation once.
Responding to a starting triggering operation, and controlling a target node in the node editing area to operate according to an operation sequence; determining a running target node, and executing a function associated with the running target node; displaying the running state of the target node; wherein, the running state includes: run-out, running error or not running.
And stopping the operation of the target node in response to the operation stopping operation.
And (5) storing the operation sequence and the data transmission relation among the target nodes to obtain the art resource production file.
And responding to the calling operation of the art resource production file, and operating the target node according to the operation sequence and the data transmission relation.
And determining a fifth node to be operated, acquiring a target function corresponding to the fifth node at the local terminal equipment, and operating the target function.
And determining a fifth node to be operated, sending input parameters of the fifth node to a function operation server through an interface calling mode, so as to operate a target function of the fifth node at the function operation server, and receiving an operation result returned by the function operation server.
In the mode, each functional node is associated with a functional function for realizing a preset function, the nodes are selected, the operation sequence and the data transmission relation between the nodes are set, then the target nodes are operated according to the operation sequence, the target nodes which are operated execute the associated functional functions, and data are transmitted between the target nodes according to the data transmission relation, so that the appointed art resources are output, automatic production of the art resources can be realized, manual participation is not needed in the production process, the production flow of the art resources is simplified, the reusability of the image production flow is improved, and the method is suitable for mass production of the art resources.
The art resource generating method, apparatus and computer program product of electronic device provided in the embodiments of the present invention include a computer readable storage medium storing program codes, where instructions included in the program codes may be used to execute the method described in the foregoing method embodiment, and specific implementation may refer to the method embodiment and will not be described herein.
It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described system and apparatus may refer to corresponding procedures in the foregoing method embodiments, which are not described herein again.
In addition, in the description of embodiments of the present invention, unless explicitly stated and limited otherwise, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the above terms in the present invention will be understood by those skilled in the art in specific cases.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
In the description of the present invention, it should be noted that the directions or positional relationships indicated by the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc. are based on the directions or positional relationships shown in the drawings, are merely for convenience of describing the present invention and simplifying the description, and do not indicate or imply that the devices or elements referred to must have a specific orientation, be configured and operated in a specific orientation, and thus should not be construed as limiting the present invention. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
Finally, it should be noted that: the above examples are only specific embodiments of the present invention for illustrating the technical solution of the present invention, but not for limiting the scope of the present invention, and although the present invention has been described in detail with reference to the foregoing examples, it will be understood by those skilled in the art that the present invention is not limited thereto: any person skilled in the art may modify or easily conceive of the technical solution described in the foregoing embodiments, or perform equivalent substitution of some of the technical features, while remaining within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention, and are intended to be included in the scope of the present invention. Therefore, the protection scope of the invention is subject to the protection scope of the claims.

Claims (20)

1. An art resource generating method, comprising:
displaying an editing page; wherein, the editing page comprises: an alternative node display area and a node editing area; the alternative node display area provides a plurality of functional nodes; the function node is associated with a function for realizing a preset function;
displaying the selected target node in the node editing area in response to a node selection operation for the candidate node display area;
responding to a connection setting operation, and setting a node sequence connection and a data transmission connection for the target node; wherein, the node sequence connection line is used for: indicating an order of operation between the target nodes; the data transmission connection is used for: indicating a data transmission relationship between the target nodes;
and operating the target nodes according to the operation sequence, executing the associated function by the operating target nodes, and transmitting data among the target nodes according to the data transmission relation so as to output the designated art resource.
2. The method of claim 1, wherein the target node corresponds to a parameter setting panel; the parameter setting panel is displayed in the node editing area; the parameter setting panel comprises at least one parameter and a parameter value setting control corresponding to the parameter;
The method further comprises the steps of: and responding to the parameter setting operation of the parameter value setting control, and acquiring the operation parameters corresponding to the target node.
3. Method according to claim 1, characterized in that the target node is provided with a sequential input and/or a sequential output;
after the step of setting the node sequence connection for the target node in response to the connection setting operation, the method further includes:
in response to a sequence output end of a first node in the target node being connected with a sequence input end of a second node, determining that the operation sequence of the first node and the second node is as follows: and after the operation of the first node is finished, the second node is operated again.
4. Method according to claim 1, characterized in that the target node is provided with a data input and/or a data output;
after the step of setting the data transmission connection for the target node in response to the connection setting operation, the method further includes:
responding to a sequence input end of a third node in the target nodes, which is connected with a fourth node, and determining the data transmission relationship between the third node and the fourth node as follows: and the data output from the third node is input into the fourth node.
5. Method according to claim 1, characterized in that the target node is provided with a data input and/or a data output;
the step of setting a data transmission connection for the target node in response to a connection setting operation includes:
determining a target data input end and a target data output end of target wire connection in response to the wire setting operation;
and determining that the data types corresponding to the target data input end and the target data output end are the same, and determining that the target connection line is successfully set.
6. The method of claim 5, wherein the method further comprises:
and determining that the data types corresponding to the target data input end and the target data output end are different, determining that the target connection line fails to be set, and displaying prompt information of the failure of the target connection line.
7. The method of claim 5, wherein the method further comprises:
controlling and displaying the target connecting line based on the data type; and the display format of the target connecting line is matched with the data type.
8. The method of claim 1, wherein the target node comprises one or more of the following nodes: image data node, image processing node, image generation node, text processing node, digital processing node, variable node, external parameter node.
9. The method of claim 1, wherein the target node further comprises a traversal node; the traversal node is configured to: according to a preset traversal sequence, traversing data in a preset data set, and inputting the traversed data into a subsequent node connected with the traversal node through the data transmission line.
10. The method of claim 1, wherein the target node further comprises a round robin node; the loop node is configured to: controlling the subsequent target nodes of the circulating nodes to perform circulating execution;
the operation sequence of the subsequent target node is behind the circulating node, and the subsequent target node is directly or indirectly connected with the circulating node through a node sequence connecting line; outputting corresponding output data when the subsequent target node executes once; after the loop execution is completed, the number of the output data is matched with the loop times of the subsequent target nodes.
11. The method of claim 10, wherein the subsequent target node connects traversing nodes through the data transmission line; the traversing node is connected with the circulating node through the node sequence connecting line;
Inputting the data traversed by the traversing node to the subsequent target node as input data of the subsequent target node when the cycle is executed;
the traversing node traverses to one data at a time, and the circulating node controls the follow-up target node to perform circulation once.
12. The method according to claim 1, wherein the method further comprises:
responding to a starting triggering operation, and controlling a target node in the node editing area to operate according to the operation sequence; determining an operating target node, and executing a function associated with the operating target node;
displaying the running state of the target node; wherein the operating state includes: run-out, running error or not running.
13. The method according to claim 12, wherein the method further comprises:
and stopping the operation of the target node in response to the operation stopping operation.
14. The method of claim 1, wherein after the step of setting a node sequence connection and a data transfer connection for the target node in response to a connection setting operation, the method further comprises:
And storing the operation sequence and the data transmission relation among the target nodes to obtain the art resource production file.
15. The method of claim 14, wherein after the step of saving the order of operation and the data transfer relationship between the target node and the target node to obtain the art asset production file, the method further comprises:
and responding to the calling operation of the art resource production file, and operating the target node according to the operation sequence and the data transmission relation.
16. The method of claim 1, wherein the step of operating the target node in the order of operation comprises:
and determining a fifth node to be operated, acquiring a target function corresponding to the fifth node at a local terminal device, and operating the target function.
17. The method of claim 1, wherein the step of operating the target node in the order of operation comprises:
determining a fifth node to be operated, sending input parameters of the fifth node to a function operation server through an interface calling mode, operating a target function of the fifth node at the function operation server, and receiving an operation result returned by the function operation server.
18. An art resource generating device, the device comprising:
the page display module is used for displaying the editing page; wherein, the editing page comprises: an alternative node display area and a node editing area; the alternative node display area provides a plurality of functional nodes; the function node is associated with a function for realizing a preset function;
a node selection module, configured to display a selected target node in the node editing area in response to a node selection operation for the candidate node display area;
the connection setting module is used for setting a node sequence connection and a data transmission connection for the target node in response to connection setting operation; wherein, the node sequence connection line is used for: indicating an order of operation between the target nodes; the data transmission connection is used for: indicating a data transmission relationship between the target nodes;
and the resource output module is used for operating the target nodes according to the operation sequence, executing the associated function by the operating target nodes, and transmitting data among the target nodes according to the data transmission relation so as to output the appointed art resource.
19. An electronic device comprising a processor and a memory, the memory storing computer-executable instructions executable by the processor, the processor executing the computer-executable instructions to implement the art asset generation method of any one of claims 1-17.
20. A computer readable storage medium storing computer executable instructions that when invoked and executed by a processor cause the processor to implement the art asset generation method of any one of claims 1-17.
CN202311025319.5A 2023-08-14 2023-08-14 Art resource generation method and device and electronic equipment Pending CN117234392A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311025319.5A CN117234392A (en) 2023-08-14 2023-08-14 Art resource generation method and device and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311025319.5A CN117234392A (en) 2023-08-14 2023-08-14 Art resource generation method and device and electronic equipment

Publications (1)

Publication Number Publication Date
CN117234392A true CN117234392A (en) 2023-12-15

Family

ID=89097516

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311025319.5A Pending CN117234392A (en) 2023-08-14 2023-08-14 Art resource generation method and device and electronic equipment

Country Status (1)

Country Link
CN (1) CN117234392A (en)

Similar Documents

Publication Publication Date Title
US11328523B2 (en) Image composites using a generative neural network
CN101536078B (en) Improving image masks
CN111273907A (en) Page processing method and related equipment
CN109117138B (en) Configuration method and device and computer readable storage medium
CN106909385A (en) The operating method of visual page editing machine and visual page editing machine
CN112733044B (en) Recommended image processing method, apparatus, device and computer-readable storage medium
CN101276275A (en) Software development visualizing editing method aiming at set top box
CN111722842A (en) Pipeline arranging method and device, electronic equipment and storage medium
CN115564642B (en) Image conversion method, image conversion device, electronic apparatus, storage medium, and program product
CN108230236B (en) Digital image automatic imposition method and digitally published picture imposition method
KR101388965B1 (en) Method for transforming drawing from digital picture
WO2019052143A1 (en) Jsx file generation method and apparatus, storage medium and computer device
CN112597023A (en) Case management method and device based on guide picture, computer equipment and storage medium
CN111985014A (en) Modeling method and system based on standard atlas
CN117234392A (en) Art resource generation method and device and electronic equipment
CN114449063B (en) Message processing method, device and equipment
CN116189009A (en) Training method of remote sensing image processing model, electronic equipment and storage medium
CN112070852A (en) Image generation method and system, and data processing method
CN115794063A (en) Three-dimensional model processing method and device and electronic equipment
CN115544311A (en) Data analysis method and device
CN114238072A (en) HIL requirement design method, HIL requirement design device, computer equipment and storage medium
CN117234391A (en) Image generation method and device and electronic equipment
KR20220121680A (en) Method for constructing deep learning network, system for auto deep learning platform service and computer program for the same
CN112802157A (en) Picture editing method and device, electronic equipment and storage medium
CN115690304A (en) Data processing method and system and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination