CN110533407B

CN110533407B - Copyright payment method, equipment and system based on image combination

Info

Publication number: CN110533407B
Application number: CN201810515104.4A
Authority: CN
Inventors: 陈建宇
Original assignee: Alibaba Group Holding Ltd
Current assignee: Alibaba Group Holding Ltd
Priority date: 2018-05-25
Filing date: 2018-05-25
Publication date: 2023-02-28
Anticipated expiration: 2038-05-25
Also published as: CN110533407A

Abstract

The application discloses a copyright payment method, equipment and system based on image combination. Wherein, the method comprises the following steps: receiving a close map, wherein the type of the close map comprises at least one of the following types: pictures without copyright grant, missing pictures with copyright grant but missing parts; matching the combined picture with copyright pictures in a copyright library, wherein the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright fees; if the matching is successful, determining that the combined picture is a picture needing to pay the copyright fee, and determining the payment amount; and sending the payment amount of the combined graph to a payment system to complete a payment process. The method and the device solve the technical problem that in the related technology, whether the combined picture is the picture needing to be paid the copyright fee or not can not be determined, and the copyright fee of the combined picture can not be paid accurately.

Description

Copyright payment method, equipment and system based on image combination

Technical Field

The application relates to the technical field of computers, in particular to a copyright payment method, equipment and system based on image combination.

Background

The traditional plane visual design is all artificial, and the copyright tracking process is clearer, namely the copyright belongs to an author and/or a processor. However, with the development of artificial intelligence AI technology, in the process of designing, combining and generating pictures by using AI, only one picture may involve the materials of dozens of creators and/or processors.

In the above scenario, it is impossible in the related art to determine whether the combined picture is a picture for which the copyright fee needs to be paid, so that the copyright fee of the combined picture cannot be paid accurately.

In view of the above problems, no effective solution has been proposed.

Disclosure of Invention

The embodiment of the application provides a copyright payment method, equipment and system based on image combination, and aims to at least solve the technical problem that whether the image combination is a picture needing to pay copyright fees or not cannot be determined in the related technology, so that the copyright fees of the image combination cannot be paid accurately.

According to an aspect of an embodiment of the present application, there is provided a copyright payment method based on combined pictures, including: receiving a close map, wherein the type of the close map comprises at least one of the following types: pictures without copyright grant, missing pictures with copyright grant but missing parts; matching the combined picture with a copyright picture in a copyright library, wherein the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright cost; if the matching is successful, determining that the combined picture is a picture needing to pay the copyright fee, and determining the payment amount; and sending the payment amount of the combined graph to a payment system to complete a payment process.

According to another aspect of the embodiments of the present application, there is also provided a copyright payment method based on matching images, including: determining a knowledge graph for designing a composite graph, wherein the knowledge graph comprises an entity needing to pay copyright fees and attributes associated with the entity, and the entity is a component and/or content needed for designing the composite graph; generating a combined graph based on the knowledge graph; matching the combined picture with a copyright picture in a copyright library, wherein the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright cost; and if the matching fails, determining the copyright fee to be paid when the map is combined based on the copyright fee to be paid in the knowledge map.

According to another aspect of the embodiments of the present application, there is also provided a copyright payment apparatus based on a combined picture, including: the display is used for displaying the composite map and the type of the composite map, wherein the type of the composite map comprises at least one of the following types: pictures without copyright grant, missing pictures with copyright grant but missing parts; the processor is used for matching the combined picture with copyright pictures in a copyright library, wherein the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright cost; and if the matching is successful, determining that the combined picture is a picture needing to pay the copyright fee, and determining the payment amount.

According to another aspect of the embodiments of the present application, there is also provided a storage medium, where the storage medium includes a stored program, and when the program runs, the apparatus where the storage medium is located is controlled to perform the following steps: receiving a close map, wherein the type of the close map comprises at least one of the following types: pictures without copyright grant, missing pictures with copyright grant but missing parts; matching the combined picture with copyright pictures in a copyright library, wherein the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright fees; if the matching is successful, determining that the combined picture is a picture needing to pay the copyright fee, and determining the payment amount; and sending the payment amount of the combined graph to a payment system to complete a payment process.

According to another aspect of the embodiments of the present application, there is also provided a mobile device, including: a processor, wherein the processor is configured to run a program, and wherein the following steps are performed when the program is run: receiving a close map, wherein the type of the close map comprises at least one of the following types: pictures without copyright grant, missing pictures with copyright grant but missing parts; matching the combined picture with copyright pictures in a copyright library, wherein the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright fees; if the matching is successful, determining that the combined picture is a picture needing to pay the copyright fee, and determining the payment amount; and sending the payment amount of the combined graph to a payment system to complete a payment process.

According to another aspect of the embodiments of the present application, there is also provided a copyright payment system based on a combined picture, including: a processor; and a memory, connected to the processor, for providing instructions to the processor for processing the following processing steps: receiving a close map, wherein the type of the close map comprises at least one of the following types: pictures without copyright grant, missing pictures with copyright grant but missing parts; matching the combined picture with copyright pictures in a copyright library, wherein the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright fees; if the matching is successful, determining that the combined picture is a picture needing to pay the copyright fee, and determining the payment amount; and sending the payment amount of the combined graph to a payment system to complete a payment process.

According to another aspect of the embodiments of the present application, there is also provided a copyright payment system based on a combined picture, including: the client device is used for sending the combined graph, wherein the type of the combined graph comprises at least one of the following types: pictures without copyright grant, missing pictures with copyright grant but missing parts; the copyright server is used for acquiring the combined picture sent by the client equipment, matching the combined picture with a copyright picture in a copyright library, if the matching is successful, determining that the combined picture is a picture needing to be paid for copyright fees, determining payment amount, and sending the payment amount of the combined picture to a payment system to finish a payment process; the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright fees.

According to another aspect of the embodiments of the present application, there is also provided a copyright payment system based on combined drawings, including: the client device is used for determining a knowledge graph for designing the combined graph and generating the combined graph based on the knowledge graph; the knowledge graph comprises an entity needing to pay copyright fees and attributes associated with the entity, and the entity is a component and/or content needed when the graph is designed; the copyright server is used for acquiring the combined picture generated by the client equipment and matching the combined picture with copyright pictures in a copyright library, wherein the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright fees; and if the matching fails, determining the copyright fee to be paid when the map is combined based on the copyright fee to be paid in the knowledge map.

According to another aspect of the embodiments of the present application, there is also provided a copyright charging method for matching images, including: under the condition that the combination picture is determined to be a picture needing to pay the copyright fee, determining at least one picture element needing to pay the copyright fee in the combination picture; determining copyright fees and fee payment main bodies corresponding to the at least one picture element; and paying the copyright fee to a payment subject through a payment system.

In the embodiment of the application, after the combined picture is received, the combined picture is matched with the copyright picture in the copyright library, and under the condition of successful matching, the combined picture is determined to be the picture needing to pay copyright fees, and payment amount is determined; and sending the payment amount of the combined picture to a payment system to complete a payment process, so that the copyright fee of the combined picture can be accurately paid.

It is easy to notice that by matching the combined picture with the copyright picture in the copyright library, because the copyright picture is the picture needing to pay the copyright fee, the combined picture can be determined to be the picture needing to pay the copyright fee and the payment amount can be determined under the condition of successful matching.

Therefore, the technical problem that whether the combined picture is a picture needing to pay the copyright fee or not cannot be determined in the related technology, and the copyright fee of the combined picture cannot be paid accurately is solved through the scheme of the embodiment provided by the application.

Drawings

The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:

fig. 1 is a block diagram of a hardware configuration of a computer terminal (or mobile device) for implementing a combined picture-based copyright payment method according to an embodiment of the present invention;

FIG. 2 is a flow chart of a method for combined-figure-based copyright payment according to an embodiment of the application;

FIG. 3 is a schematic view of an alternative structural assembly according to an embodiment of the present application;

FIG. 4 is a schematic view of an alternative vision assembly in accordance with embodiments of the present application;

FIG. 5 is a schematic diagram of an alternative composite according to an embodiment of the present application;

FIG. 6 is a schematic diagram of an alternative generated composite map according to an embodiment of the present application;

FIG. 7 is a flow chart of an alternative method of combined image based copyright payment according to embodiments of the present application;

FIG. 8 is a flow chart of another method for copyright payment based on combination of images according to an embodiment of the present invention;

FIG. 9 is a flow diagram of an alternative combined image-based copyright payment method according to an embodiment of the present invention;

FIG. 10 is a schematic diagram of an alternative combination according to an embodiment of the invention;

FIG. 11 (a) is a schematic diagram of an alternative picture knowledge-graph according to an embodiment of the invention;

FIG. 11 (b) is a schematic diagram of an alternative picture knowledge-graph according to an embodiment of the invention;

fig. 12 is a schematic structural diagram of a copyright payment device based on combined pictures according to an embodiment of the application;

fig. 13 is a schematic structural diagram of another copyright payment device based on combined pictures according to an embodiment of the application;

fig. 14 is a schematic structural diagram of a copyright payment device based on combined pictures according to an embodiment of the application;

FIG. 15 is an interaction diagram of a combined figure based copyright payment system according to an embodiment of the present application;

FIG. 16 is an interaction diagram of another synthetic image-based copyright payment system according to an embodiment of the present application;

FIG. 17 is a flow chart of a method of combined copyright charging according to an embodiment of the present invention;

fig. 18 is a schematic structural diagram of a combined copyright royalty apparatus according to an embodiment of the present application; and

fig. 19 is a block diagram of a computer terminal according to an embodiment of the present application.

Detailed Description

In order to make the technical solutions of the present application better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only some embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

It should be noted that the terms "first," "second," and the like in the description and claims of this application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

First, some terms or terms appearing in the description of the embodiments of the present application are applicable to the following explanations:

combining the drawings: also called a composite map, is a picture in which picture material and/or various components are combined.

MD5 (Message Digest Algorithm 5): namely, the message digest algorithm 5, is a hash function widely used in the field of computer security to provide integrity protection for messages, and a typical application of the hash function is to digest a piece of information to prevent the information from being tampered.

Copyright: that is, the copyright may be a legal ownership right which the creator has been legally entitled to the computer program, picture, photograph, literary work, musical composition, movie, and the like created by the creator.

Knowledge graph: the scientific knowledge map combines subject theories and methods such as applied mathematics, graphics, information visualization technology, information science and the like with methods such as metrology quotation analysis, co-occurrence analysis and the like, and utilizes the visualized map to vividly display the core structure, development history, frontier field, integral knowledge structure and the like of the subjects so as to achieve the aim of multi-subject mutual fusion.

At present, the problem to be solved in the design of pictures at present when the copyright payment and combination method is used is solved, even if authorization of pictures in all the galleries is obtained in a mode of purchasing the galleries in a big package at present, along with the development of design automation and the fact that individual merchants cannot pay high cost due to low using frequency of the galleries, a convenient charging mechanism aiming at personalized pictures is very necessary to provide.

Example 1

In accordance with an embodiment of the present application, there is provided an embodiment of a method for copyright payment based on a combined graph, it should be noted that the steps shown in the flowchart of the figure may be performed in a computer system such as a set of computer executable instructions, and that while a logical order is shown in the flowchart, in some cases the steps shown or described may be performed in an order different than here.

The method provided by the embodiment 1 of the present application can be executed in a mobile terminal, a computer terminal or a similar computing device. Fig. 1 shows a block diagram of a hardware structure of a computer terminal (or mobile device) for implementing a combined-figure-based copyright payment method. As shown in fig. 1, the computer terminal 10 (or mobile device 10) may include one or more (shown as 102a, 102b, … …,102 n) processors 102 (the processors 102 may include, but are not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA, etc.), a memory 104 for storing data, and a transmission device 106 for communication functions. In addition, the method can also comprise the following steps: a display, an input/output interface (I/O interface), a Universal Serial Bus (USB) port (which may be included as one of the ports of the I/O interface), a network interface, a power source, and/or a camera. It will be understood by those skilled in the art that the structure shown in fig. 1 is only an illustration and is not intended to limit the structure of the electronic device. For example, the computer terminal 10 may also include more or fewer components than shown in FIG. 1, or have a different configuration than shown in FIG. 1.

It should be noted that the one or more processors 102 and/or other data processing circuitry described above may be referred to generally herein as "data processing circuitry". The data processing circuitry may be embodied in whole or in part in software, hardware, firmware, or any combination thereof. Further, the data processing circuit may be a single stand-alone processing module, or incorporated in whole or in part into any of the other elements in the computer terminal 10 (or mobile device). As referred to in the embodiments of the application, the data processing circuit acts as a processor control (e.g. selection of a variable resistance termination path connected to the interface).

The memory 104 may be used to store software programs and modules of application software, such as program instructions/data storage devices corresponding to the copyright payment method based on combined images in the embodiment of the present application, and the processor 102 executes various functional applications and data processing by running the software programs and modules stored in the memory 104, so as to implement the aforementioned copyright payment method based on combined images. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory located remotely from the processor 102, which may be connected to the computer terminal 10 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The transmission device 106 is used to receive or transmit data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the computer terminal 10. In one example, the transmission device 106 includes a Network adapter (NIC) that can be connected to other Network devices through a base station to communicate with the internet. In one example, the transmission device 106 can be a Radio Frequency (RF) module, which is used to communicate with the internet in a wireless manner.

The display may be, for example, a touch screen type Liquid Crystal Display (LCD) that may enable a user to interact with the user interface of the computer terminal 10 (or mobile device).

Under the operating environment, the application provides a copyright payment method based on combined pictures as shown in fig. 2. It should be noted that the execution subject of the embodiment of the present application may be a tool for providing a design drawing, a picture processing platform (client or server), and the tool or platform may be embedded in the e-commerce platform, or may be a functional component of the e-commerce platform, and the e-commerce platform may include, but is not limited to, a business such as suning, kyoto, internet, koala, and the like.

Fig. 2 is a flowchart of a copyright payment method based on combined graph according to an embodiment of the present application, and as shown in fig. 2, the method may include the following steps:

step S202, receiving a composite graph, wherein the type of the composite graph comprises at least one of the following types: pictures that have not been granted copyright, missing pictures that have been granted copyright but have missing portions.

Optionally, the combined image is a combined image obtained through combining processing, and may include not only color features and structural features, but also picture materials such as pictures and fonts (text fonts and letter fonts), for example, promotional pictures for promoting promotional activities in an e-commerce promotional scene.

As an alternative embodiment, the type of the missing part includes at least one of the following: the merged picture without the digital watermark and the intercepted picture.

It should be noted that, the sources of the components and/or the picture materials in the drawings may include but are not limited to: the system comprises self-operated materials of the e-commerce users and third-party materials provided by third-party objects. When the electric commercial user uses the self-operated material, the copyright fee does not need to be paid, and when the electric commercial user uses the third-party material, a certain amount of copyright fee may need to be paid.

The types of the received combined graphs comprise: the picture processing platform can detect whether the combined picture is a picture which needs to pay the copyright fee, and determine the amount of the copyright fee which needs to be paid.

Step S204, matching the combined picture with a copyright picture in a copyright library, wherein the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright fee;

and step S206, if the matching is successful, determining that the combined picture is a picture needing to pay the copyright fee, and determining the payment amount.

It should be noted that, because the composite image may include a plurality of image materials and components, a plurality of third party objects that need to pay may exist in the composite image, when the e-commerce user uses the composite image and needs to pay the usage fee and/or the copyright fee to the third party objects, the composite image may be matched with the copyright images in the copyright library, because the copyright images stored in the copyright library are the images that need to pay the copyright fee, and the amount of the copyright fee that needs to be paid for each copyright image may be stored.

Furthermore, when the combined picture is successfully matched with any one of the copyright pictures in the copyright library, the combined picture is determined to be the picture needing to pay the copyright fee, and the copyright fee to be paid by the combined picture is determined to be consistent with or similar to the copyright fee of the copyright picture successfully matched, and the copyright fees to be paid by the combined picture and the copyright picture are possibly not completely consistent but not far away.

Based on the optional embodiment, whether the received combined picture is the picture needing to pay the copyright fee or not can be determined, and the purpose of accurately paying the copyright fee of the combined picture is achieved, so that the technical effect of improving the efficiency and the accuracy of paying the copyright fee of the combined picture is achieved.

And step S208, sending the payment amount of the combined graph to a payment system to complete a payment process.

In the step S208, the payment system may be, but is not limited to, a unionpay platform, a third party payment software such as a WeChat payment and a Jingdong payment.

Optionally, the e-commerce user may determine whether the copyright fee needs to be paid through the display, after the user determines that the copyright fee needs to be paid, the picture processing platform starts the payment system and sends the payment amount that needs to be paid to the payment system, and the e-commerce user may pay directly on the payment interface or pay through a scanning function provided by a third party device or application (e.g., weChat).

It should be noted that, after the payment amount is sent to the payment system to pay the copyright fees and the payment process is completed, the payment information and/or the payment result corresponding to the payment information may also be recorded based on the blockchain technology.

Based on the steps defined in the steps S202 to S206, it can be known that, after the combined picture is received, the combined picture is matched with the copyright picture in the copyright library, and in the case of successful matching, the combined picture is determined to be a picture requiring to pay copyright fees, and payment amount is determined; and sending the payment amount of the combined picture to a payment system to complete a payment process, so that the copyright fee of the combined picture can be accurately paid.

It is easy to notice that by matching the combined picture with the copyright picture in the copyright library, the combined picture is the picture needing to pay the copyright cost, and further, under the condition of successful matching, the combined picture is determined to be the picture needing to pay the copyright cost, and the payment amount is determined.

As an alternative embodiment, in the case that the combined picture is not entitled to copyright, after receiving the combined picture, the method further includes:

step S203, disassembling the combined picture, and acquiring components and/or contents forming the combined picture;

in step S204, matching the combined picture with a copyright picture in a copyright library includes: step S2041, matching the components and/or contents of the combined picture with the copyright pictures in the copyright library.

It should be noted that, since the received combined graph is a picture provided by a network or various platforms, for example, a combined graph that is not granted with copyright may be provided, a manner of splitting the combined graph and then performing matching analysis may be adopted to further determine whether a fee needs to be paid for the combined graph, that is, if a copyright fee needs to be paid for the combined graph, the combined graph may be subjected to a splitting process to obtain components and/or content that are combined to generate the combined graph. Wherein, above-mentioned subassembly can include: a structural component, a visual component; the content can be picture materials such as pictures, fonts (character fonts and letter fonts) and the like.

In an alternative embodiment of the present application, the combined picture may be matched with the copyright picture in the copyright library by, but not limited to, any one or more of the following ways: matching the picture material in the combined picture with the picture material of the copyright picture in the copyright library; matching the structural component in the combined picture with the structural component of the copyright picture in the copyright library; and matching the visual components in the combined picture with the visual components of the copyright pictures in the copyright library.

In the above-mentioned alternative embodiments of the present application, the above-mentioned structural components may be used to characterize structural features of the image, and the structural features of the image may embody the overall layout of the image, that is, deploy corresponding content at different positions of the image. The same structural component is used for the images of different products, so that the combined picture with the same structure can be obtained, and the method is particularly suitable for scenes needing to make a large number of pictures with similar structures, such as product propaganda pictures with the same propaganda information or preferential information.

The structural component may be used as a structural template of an image, and may include information such as graphics and text set at a specified position. The text in the structural component is mainly used for describing promotional information or preferential information, such as: "full xxx minus xxx", "quality specials", "international sharp", etc. In order to obtain the structural components matching with the product images, the products can be classified according to the types of activities in which the products participate or the types of promotions, and for the product images which can use the same promotion information or preference information (i.e. the content represented by the characters in the structural components), the same corresponding structural components can be used.

Fig. 3 is a schematic diagram of an alternative structural assembly according to an embodiment of the present application, and in an alternative embodiment, as shown in fig. 3, the structural assembly includes characters such as "199 full minus 100 coupons", "time limited full minus folded good", and a plurality of preset geometric figures. The structural component may be used during the production of the product declaration for products that are involved in the 199 minus 100 activity.

In the above-mentioned alternative embodiment of the present application, the visual component may be used to display color features of an image, and may be a component obtained by superimposing a plurality of layers with different sizes and colors. The plurality of layers with the same layer size and the same superposition mode can form a group of visual components, and in the group of visual components, because the colors set for the layers can be different, the group of visual components may include a plurality of visual components.

FIG. 4 is a schematic diagram of an alternative visual element according to an embodiment of the present application, and in an alternative embodiment, as shown in FIG. 4, the visual element includes seven layers that are different in size and color, and the seven layers are sequentially superimposed to form the visual element. If the color of any one or more layers in the visual component is modified, more other visual components can be obtained.

Fig. 5 is a schematic diagram of an alternative composite drawing according to an embodiment of the present application, which is shown in fig. 5, and the composite drawing includes three parts of characters of "199 full minus 100 coupons", "time limited full minus folded good" and the like in the structural component, and also has color characteristics corresponding to the visual component, so as to meet the requirement of the propaganda drawing.

Fig. 6 is a schematic diagram of an alternative composite image generation according to an embodiment of the present application, in combination with fig. 6, the first type on the left side is two kinds of structural components, the second column is six kinds of visual components, and the combination of the two kinds of structural components and the six kinds of visual components can obtain twelve kinds of background images, in the example shown in fig. 6, three kinds of visual components are selected for the first structural component (full 199 minus 99 tickets) to be combined to obtain three kinds of background images, and the three kinds of background images are respectively combined with the image of the running shoe product to obtain three kinds of composite images of the running shoe. And for the second structural component (special quality), the remaining three visual components are selected to be combined to obtain three background pictures, and the three background pictures are respectively synthesized with the image of the skin care product to obtain three combined pictures of the skin care product.

As an alternative embodiment, fig. 7 is a flowchart of an alternative method for paying a copyright based on a combined picture according to an embodiment of the present application, where, as shown in fig. 7, in the case that the combined picture is a missing picture that has been granted a copyright but has a missing part, after receiving the combined picture, the method further includes:

step S302, detecting the combined graph, and determining whether the combined graph has mark data or not.

In the step S302, the tag data is used to represent that third-party materials provided by a third-party object exist in the combined image, and the tag data at least includes source information of the third-party materials provided by the third-party object, and the combined image has any one of the following modes to record the tag data: digital watermarks and visible watermarks.

Specifically, the digital watermark is an invisible digital watermark, and can realize invisible marking of the picture.

In the above alternative embodiment, whether the label data exists in the combined graph may be detected, but is not limited to, by the following means: and detecting whether the mark data exists in the picture material of the combined picture or detecting whether the mark data exists in the structural component and the visual component of the combined picture.

The marking data is not limited to be used for marking the third-party materials provided by the third-party object in the combined graph and the source information of the third-party materials, and may also be used for determining the unique MD5 value obtained by applying the message digest algorithm to the combined graph, the number of the materials, the type of the materials, the generation mode of the materials, and the like.

Step S304, in a case that it is determined that the label data exists in the combined image, performing a step of matching the combined image with a copyright picture in a copyright library and determining the payment amount, wherein the third party object for receiving the payment amount is determined based on the source information of the third party material.

As an optional embodiment, before sending the payment amount of the combined graph to the payment system to complete the payment process, the method further includes:

step S402, acquiring operation information of the third-party material;

step S404, counting the amount of money to be paid for using the third-party material based on the operation information of the third-party material.

In the above alternative embodiment, the total amount paid to the third party object includes: the amount of money to be paid by using the third-party material and the amount of money to be paid for the copyright fee, that is, the total amount of money to be paid to the third-party object is not limited to the amount of money to be paid by using the third-party material, but also includes the amount of the copyright fee to be paid for the copyright fee, so that the purpose of accurately paying the usage fee and the copyright fee for the combined image can be achieved.

As an alternative embodiment, the operation information includes at least one of the following: click operation, copy operation, download operation and forwarding operation. Specifically, the click operation may be a click amount and a click rate, the copy operation may be a copy amount, the download operation may be a copy amount, and the forward operation may be a forward amount.

It should be noted that the operation information may be information generated when the user operates the diagram closing in the display interface of the e-commerce user after the diagram closing is brought on line by the e-commerce user, as an optional embodiment, each diagram closing may correspond to one control, the control is used to access a link corresponding to a product in the diagram closing, and the control corresponding to the diagram closing is triggered when the user clicks the diagram closing, so that the operation information may embody interest and attention of the user on the diagram from various dimensions, that is, an attraction degree of the diagram closing to the user and Xuan Guan degrees, and accordingly, a propaganda effect of the diagram closing may be embodied based on the operation information of the user.

In an optional embodiment, the operation information of the third-party material and the amount of money paid for using the third-party material may be in a direct proportional relationship, that is, if the click rate, and the like in the operation information are higher or higher, the amount of money to be paid for using the third-party material is higher, and a specific corresponding relationship between the operation information and the amount of money paid for using the third-party material is obtained.

In this embodiment, the picture processing platform may determine the fee to be paid to the third party object by counting an amount of click operations performed on the map by a user (e.g., a user browsing or operating the map), an amount of browsing operations performed on the map, an amount of copy operations performed on the map, an amount of download operations performed on the map, an amount of forwarding operations performed on the map, and the like.

In addition, it should be noted that the payment fees corresponding to different operation information may be different, for example, 1 yuan is required to be paid for one-time browsing and 2 yuan is required to be paid for one-time downloading.

As an optional embodiment, after counting the amount of money required to be paid for using the third-party material based on the operation information of the third-party material, the method further includes:

and sending the source information of the third-party materials and the total amount obtained through statistics to a payment system, wherein the payment system pays the total amount to the third-party object based on the source information.

As an alternative embodiment, after obtaining the total amount to be paid to the third party object by statistics, the source information of the third party material and the obtained total amount by statistics may be sent to a payment system, for example, the total amount is paid by means of electronic money, and the payment system may include but is not limited to: the payment platform of Unionpay, weChat payment, beijing payment and other third party payment software.

Furthermore, the payment system determines a bank account, a payment platform account and the like of a third party object for receiving the resource data based on the source information of the third party material, and pays the total amount to the bank account and the payment platform account of the third party object in a transfer mode, a pre-transfer mode or an online payment mode.

As an optional embodiment, before detecting the combined image, the method further includes:

step S502a, carrying out similarity matching on the combined picture, determining whether a picture similar to the combined picture exists in a first picture base, wherein the picture contained in the first picture base is a picture with third-party materials, and recording the amount of money to be paid by each picture.

In an optional embodiment, the pictures in the first gallery are all pictures containing third-party materials, and the first gallery has recorded the cost that each picture needs to be paid to the corresponding third-party object, in this embodiment, before detecting the material source of the picture materials in the combined picture and paying the corresponding cost, similarity matching may be performed in the first gallery, and if a picture similar to the combined picture is matched, it is determined that the current combined picture not only has the third-party materials, but also the cost that needs to be paid to the third party is determined based on the picture matched with the combined picture in the first gallery.

In an alternative embodiment of the present application, but not limited to, similarity matching may be performed on any one of the pictures in the first gallery and the combined picture through any one or more of the following manners: matching the picture material of any one picture in the first picture library with the picture material in the combined picture; matching the picture of any one picture in the first picture library with the picture in the combined picture; and matching the font of any one picture in the first gallery with the font in the combined picture.

It should be noted that, in an optional embodiment, if similarity matching is performed on any one of the pictures in the first gallery and the combined graph in any one or more of the above manners, and the picture is matched with both the combined graph, it may be determined that a picture similar to the combined graph exists in the first gallery, and it may be further determined that third-party materials provided by the third-party object exist in the combined graph.

In step S504a, if the sum of the payment fees is the sum of the payments required by the pictures similar to the combination.

Based on the optional embodiment provided in step S504a, if the combined graph is subjected to similarity matching, and it is determined that a picture similar to the combined graph exists in the first gallery, it is not necessary to detect the combined graph with the third-party material, and further determine a fee to be paid to the third-party object providing the third-party material, but a payment amount corresponding to the picture similar to the combined graph is directly used for payment.

Step S506a, if not, the step of detecting the combined graph needs to be continuously executed.

Based on the optional embodiment provided in step S506a, if similarity matching is performed on the combined graph, and it is determined that there is no picture similar to the combined graph in the first gallery, it indicates that whether there is third-party material and how much fee is paid to the third-party object providing the third-party material are still not determined currently, and therefore, further detection of the combined graph is still needed, so as to determine the fee to be paid.

In the above optional embodiment, by screening whether the current combined image needs to be paid first, only determining the combined image needing to be paid (i.e. similar images cannot be matched from the first gallery), the process of paying is performed, so that the work efficiency of tracking the source of the material in the combined image and determining the fee paid to the third-party object providing the third-party material can be improved.

As another optional embodiment, before detecting the combined image, the method further includes:

step S502b, carrying out similarity matching on the combined picture, and determining whether a picture similar to the combined picture exists in a second picture library, wherein the picture contained in the second picture library is a picture with third-party materials;

step S504b, if yes, determining that the third-party material provided by the third-party object exists in the combined image.

Optionally, the first gallery and the second gallery may include, but are not limited to, galleries on the internet, where pictures included in the second gallery are pictures with third-party materials.

In an optional embodiment, the pictures in the second gallery are all pictures containing third-party materials, before detecting material sources of the picture materials in the combined picture and paying corresponding fees, similarity matching may be performed in the first gallery, and if a picture similar to the combined picture is matched, it is determined that the current combined picture also contains the third-party materials, so that the combined picture containing the third-party materials needs to be detected, and further the fees to be paid are determined.

In addition, in the above optional embodiment, if the picture similar to the composite picture is not matched, the composite picture is considered to contain no third-party material with a high probability or third-party material without payment, in this case, further detection of the composite picture is not needed, and corresponding payment is not needed.

It should be noted that, in an optional embodiment, if any one of the pictures in the second gallery is subjected to similarity matching with the combined graph in any one or more of the above manners, and the picture is matched with the combined graph, it may be determined that a picture similar to the combined graph exists in the second gallery, and it may be further determined that third-party materials provided by the third-party object exist in the combined graph.

Based on the above optional embodiment, by screening the current combined image, only the combined image meeting the requirement (i.e. similar images are matched from the second gallery) is subjected to the payment process, so that the work efficiency of tracking the source of the materials in the combined image and determining the payment for the third-party object providing the third-party materials can be improved.

As an optional embodiment, after receiving the map, the method further includes:

step S602a, determining a type of the missing part, wherein the type of the missing part includes at least one of the following: the combined image and the intercepted image of the digital watermark are lacked;

in step S604a, similarity search is performed based on the missing picture.

In an optional embodiment, in order to avoid a situation that the combination right cannot be traced due to the loss of the digital watermark caused by artificial malicious modification and editing of the combination, for example, a complete combination is artificially cut by half, or the digital watermark in the combination is covered or erased, in the embodiment of the present application, after the combination is received, similarity retrieval may be performed on a missing picture (for example, a combination where the digital watermark cannot be retrieved, a picture that is modified, edited, or intercepted). In the embodiment of the application, a picture retrieval technology can be adopted to perform similar picture retrieval on the missing picture in a gallery or a local gallery in the internet, so that whether a combined picture similar to the missing picture can be retrieved in a network or the local gallery can be determined, the missing picture can be repaired, and the problem that the copyright of the combined picture cannot be traced is solved.

Step S606a, if the synthesis graph similar to the missing picture is searched, repairing the missing picture based on the searched synthesis graph to obtain a repaired synthesis graph;

and step S608a, executing the steps of matching with the copyright pictures in the copyright library and determining the payment amount based on the repaired combination picture.

As an optional embodiment, in the case that the received combined image is a missing image which is maliciously modified, edited, and intercepted by a person, for example, a complete combined image is artificially cut by half, or a digital watermark in the combined image is covered or erased, in the embodiment of the present application, the received missing image may be repaired to obtain a repaired combined image, and then the repaired combined image may be matched with a copyright image in a copyright repository according to the repaired combined image, and in the case that the matching is successful, the combined image is determined to be an image for which copyright fees need to be paid, and payment amount is determined.

Based on the optional embodiment, the problem that whether the combined picture is a picture needing to pay copyright fees or not is difficult to determine due to the fact that the combined picture lacks digital watermarks and is intercepted or modified can be solved; the method achieves the purposes of determining whether the combined picture is a picture needing to pay the copyright fee and accurately paying the copyright fee of the combined picture.

As another optional embodiment, after the receiving of the map, the method further includes:

step S602b, determining the type of the missing part, wherein the type of the missing part includes at least one of the following: the combination picture and the intercepted picture of the digital watermark are lacked;

step S604b, performing similarity search based on the missing picture.

In an optional embodiment, in order to avoid the situation that the combination layout cannot be traced due to the loss of the digital watermark caused by malicious modification and editing of the combination drawing, similarity retrieval may be performed on the missing picture after the combination drawing is received. In the embodiment of the application, a picture retrieval technology can be adopted to perform similar picture retrieval on the missing picture in a picture library or a local picture library in the internet, so that whether a combined picture similar to the missing picture can be retrieved in a network or the local picture library can be determined, the missing picture can be repaired, and the problem that the copyright of the combined picture cannot be traced is avoided.

Step S606b, if the synthesis graph similar to the missing picture is searched, the missing picture is repaired based on the searched synthesis graph to obtain a repaired synthesis graph;

step S608b, executing the step of determining whether the merged image has the label data based on the repaired merged image.

As an optional embodiment, when the received combined image is a missing image which is maliciously modified, edited and intercepted, the received missing image may be repaired to obtain a repaired combined image, and further, according to whether the repaired combined image has the tag data or not, under the condition that the tag data is determined to be present in the combined image, the combined image is matched with the copyright image in the copyright library, and under the condition that the matching is successful, the combined image is determined to be the image which needs to pay the copyright fee, and the payment amount is determined.

Example 2

There is also provided, in accordance with an embodiment of the present invention, another embodiment of a method for copyright payment based on combined figures, wherein the steps illustrated in the flowchart of the figure may be performed in a computer system, such as a set of computer-executable instructions, and wherein, although a logical order is illustrated in the flowchart, in some cases, the steps illustrated or described may be performed in an order different than that illustrated herein.

It should be noted that the execution subject of the embodiment of the present application may be a tool for providing a design drawing, a picture processing platform (client or server), and the tool or platform may be embedded in the e-commerce platform, or may be a functional component of the e-commerce platform, and the e-commerce platform may include, but is not limited to, a platform available from suning, a city of commerce in kyoto, a platform available from conala in internet, and the like.

Fig. 8 is a flowchart of another copyright payment method based on combined drawings according to an embodiment of the present invention, and as shown in fig. 8, the method may include the following steps:

step S802, determining a knowledge graph for designing a composite graph, wherein the knowledge graph comprises an entity needing to pay copyright fees and attributes associated with the entity, and the entity is a component and/or content needed for designing the composite graph.

Optionally, the combined image is a combined image obtained through combining processing, and may include not only color features and structural features, but also picture materials such as pictures and fonts (text fonts and letter fonts), for example, promotional pictures used for promoting promotional activities in e-commerce promotional scenes.

In an alternative embodiment, the knowledge graph may include, but is not limited to, a knowledge graph owned by the original copyright owner, such as a knowledge graph of Freebase, baidu encyclopedia, interactive encyclopedia, kiwiki, and the like.

Alternatively, the knowledge-graph may include, but is not limited to: an entity, an attribute and an attribute value, wherein the entity is something which has distinctiveness and exists independently, the attribute refers to the property of the entity and the relationship between different entities, the attribute value is the concrete content of the entity attribute, for example, in a map, "china" is the entity, "area", "population", "capital" is the attribute of the entity, and "960 ten thousand square kilometers", "14 hundred million population" and "beijing" are the attribute values corresponding to the three attributes.

In the embodiment of the application, the entities in the knowledge graph are components and/or contents required in designing the combined graph, wherein the components can represent structural features of the characters or the graphs in the combined graph, such as color, size, form and the like, and can embody the overall layout of the characters or the graphs, including the graphs, the characters and the like arranged at the designated positions. Wherein, the words and/or figures in the assembly can be used for describing the propaganda information or the preferential information.

It should be noted that the knowledge graph in the embodiment of the present application may be stored in a preset storage area of the client or the server, where the storage form of the knowledge graph is not limited in the present application.

In addition, since a plurality of third party objects which need to be paid are possibly contained in the combined picture used by the e-commerce user, the e-commerce user needs to pay corresponding use amount and copyright fee when using the combined picture. And because the knowledge graph contains the elements of the e-commerce user needing to pay the copyright fee, the e-commerce user can intuitively determine that the copyright fee and the payment fee are needed to be paid when the e-commerce user closes the graph, and the experience of the e-commerce user is further improved.

And step S804, generating a combined graph based on the knowledge graph.

In an optional scheme, the e-commerce user may send demand information for designing a plan to the client or the server by means of text, voice, and the like, where the demand information includes key information of the e-commerce user when designing the plan, for example, the e-commerce user needs to obtain a picture of "twenty-one bustling" and at this time, the e-commerce user may input keywords such as "twenty-one bustling" and "bustling" to the client or the server, and the client or the server may determine multiple design models from the knowledge graph for the text or voice keywords input by the e-commerce user, for example, a first design model with a "twenty-one" entity at the top of the picture and a second design model with a "twenty-one" entity at the bottom of the picture.

In an alternative embodiment, design models may be determined based on the knowledge graph for designing the composite graph, and the requirement information may be analyzed to obtain design information for designing the composite graph, where the design information for designing the composite graph in each design model is different, for example, different at the same entity location. The e-commerce user can determine a design model to be used, and the picture processing platform can obtain design information based on the design model and generate a corresponding composite picture based on the design information.

Step 806, matching the combined picture with a copyright picture in a copyright library, wherein the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright fee;

Step S808, if the matching fails, determining the copyright fee to be paid when the map is combined based on the copyright fee to be paid in the knowledge map.

In the step S808, since the knowledge graph includes the element that the e-commerce user needs to pay the copyright fee, when the matching between the matching picture and the copyright picture in the copyright library fails, the copyright fee that needs to be paid for the matching picture can be determined based on the copyright fee that needs to be paid in the knowledge graph, and the e-commerce user can visually determine the element that the matching picture needs to pay the copyright fee and the payment amount that should be paid to the corresponding third party object, thereby improving the experience of the e-commerce user.

Optionally, the picture processing platform may detect each element in the knowledge-graph and determine whether the element needs to be paid for use, for example, detect whether the element in the knowledge-graph has a digital watermark, determine that the element needs to be paid for use if the element has the digital watermark, and not pay a fee if the element does not have the digital watermark.

It should be noted that the cost required to pay for different elements in the knowledge-graph may be different, and therefore, the watermark of the element requiring the cost may also set the cost information. In addition, after the e-commerce user finishes paying, the watermark of the element capable of controlling the payment disappears so as not to influence the use of the element.

Based on the embodiment of the application, after the knowledge map used for designing the combined graph is determined, the combined graph is generated based on the knowledge map, the combined graph is matched with the copyright pictures in the copyright library, and under the condition that the matching fails, the copyright fee to be paid is determined based on the copyright fee to be paid in the knowledge map, so that the copyright fee to be paid can be accurately paid.

It is easy to notice that, firstly, the knowledge map used for designing the combined picture is determined, the combined picture generated based on the knowledge map is obtained, and then the copyright fee to be paid is determined based on the copyright fee to be paid in the knowledge map under the condition that the matching of the combined picture and the copyright picture in the copyright library fails.

As an optional embodiment, if the matching is successful, determining that the combined picture is a picture for which the copyright fee needs to be paid, and determining the payment amount based on the information recorded in the copyright repository; and sending the payment amount of the combined graph to a payment system to complete a payment process.

It should be noted that, in the case that the matching of the combined image and any one of the copyright pictures in the copyright library is successful, it is determined that the combined image is the picture whose copyright fee needs to be paid, and it is determined that the copyright fee to be paid by the combined image is consistent with or similar to the copyright fee of the copyright picture successfully matched, and the copyright fees to be paid by the combined image and the copyright picture successfully matched may not be completely consistent but may not be far apart.

Optionally, the payment system may be, but is not limited to, a unionpay payment platform, third-party payment software such as WeChat payment and Jingdong payment; in an alternative embodiment, the e-commerce user may determine whether the copyright fee needs to be paid through the display, after the user determines that the copyright fee needs to be paid, the picture processing platform starts the payment system and sends the payment amount needing to be paid to the payment system, and the e-commerce user may pay directly on the payment interface or through a scanning function provided by a third-party device or application (e.g., weChat).

As an alternative embodiment, the type of the combined graph includes at least one of the following: pictures that are not copyrighted, missing pictures that have been copyrighted but have missing parts, wherein, after generating a composite picture based on the knowledge-graph, the method further comprises:

step S805, disassembling the combined graph to obtain components and/or contents forming the combined graph;

in step S806, matching the combined image with the copyright picture in the copyright library includes: and step S8061, matching the combined picture assembly and/or the content with the copyright pictures in the copyright library.

As an alternative embodiment, the type of the combined graph includes at least one of the following: a picture to which no copyright is granted, a missing picture to which a copyright is granted but a missing part exists, wherein, in the case that the composite picture is the missing picture to which a copyright is granted but a missing part exists, after generating the composite picture based on the knowledge graph, the method further comprises:

step S902, detecting the combined image, and determining whether there is label data in the combined image, where the label data is used to represent that there is third party material provided by a third party object in the combined image, and the label data at least includes source information of the third party material provided by the third party object, and the combined image has any one of the following modes to record the label data: digital watermarks and visible watermarks.

Step S904, in a case that it is determined that the label data exists in the combined image, performing a step of matching the combined image with a copyright picture in a copyright library and determining the payment amount, wherein the third party object for receiving the payment amount is determined based on the source information of the third party material.

In the above alternative embodiment, it may be detected, but is not limited to, whether the marked data exists in the combined graph or not by the following means: and detecting whether the mark data exists in the picture material of the combined picture or detecting whether the mark data exists in the structural component and the visual component of the combined picture.

step S1002, acquiring operation information of the third-party material;

step S1004, counting the amount of money to be paid for using the third-party material based on the operation information of the third-party material.

In the above alternative embodiment, the total amount paid to the third party object includes: the amount of money to be paid by using the third-party material and the amount of money to be paid for the copyright fee, that is, the total amount of money to be paid to the third-party object is not limited to the amount of money to be paid by using the third-party material, but also includes the amount of the copyright fee to be paid for the copyright fee, so that the purpose of accurately paying the copyright fee for the combined image can be achieved.

As an alternative embodiment, the operation information includes at least one of the following: click operation, copy operation, download operation and forwarding operation. Specifically, the click operation may be click amount and click rate, the copy operation may be copy amount, the download operation may be copy amount, and the forward operation may be forward amount.

step S1102a, performing similarity matching on the combined image, and determining whether a picture similar to the combined image exists in a first image library, where the picture included in the first image library is a picture with third-party materials, and the amount of money to be paid by each picture is recorded.

In an alternative embodiment of the present application, but not limited to, similarity matching may be performed on any one of the pictures in the first gallery and the combined picture by any one or more of the following manners: matching the picture material of any one picture in the first picture library with the picture material in the combined picture; matching the picture of any one picture in the first picture library with the picture in the combined picture; and matching the font of any one picture in the first gallery with the font in the combined picture.

It should be noted that, in an optional embodiment, if similarity matching is performed on any one of the pictures in the first gallery and the combined graph through any one or more of the above manners, and the picture is matched with both the combined graph, it may be determined that a picture similar to the combined graph exists in the first gallery, and it may be further determined that third-party materials provided by the third-party object exist in the combined graph.

In step S1104a, if the sum of the paid amount of the combined picture is equal to the sum of the paid amount of the picture similar to the combined picture.

In an optional embodiment, if similarity matching is performed on the combined image, and it is determined that the image similar to the combined image exists in the first gallery, there is no need to detect the combined image with the third-party material, and further, it is determined that the fee needs to be paid to the third-party object providing the third-party material, but the payment operation is performed by directly using the payment amount corresponding to the image similar to the combined image.

Step S1106a, if not, the step of detecting the combination needs to be continuously executed.

In another alternative embodiment, if the matching image is subjected to similarity matching, and it is determined that there is no image similar to the matching image in the first gallery, it indicates that it is still uncertain whether there is third-party material and how much fee is paid to the third-party object providing the third-party material, and therefore, it is still necessary to further detect the matching image, so as to determine the fee to be paid.

Based on the above optional embodiment, by screening whether the current combined image needs to be paid first, only determining the combined image needing to be paid (i.e. similar images cannot be matched from the first gallery), the process of paying is performed, so that the work efficiency of tracking the source of the materials in the combined image and determining the fee paid to the third-party object providing the third-party materials can be improved.

step S1102b, performing similarity matching on the combined picture, and determining whether a picture similar to the combined picture exists in a second picture library, wherein the picture included in the second picture library is a picture with a third-party material;

step S1104b, if yes, determining that the third party material provided by the third party object exists in the combined image.

It should be noted that, in an optional embodiment, if similarity matching is performed on any one of the pictures in the second gallery and the combined graph through any one or more of the above manners, and the picture is matched with both the combined graph, it may be determined that a picture similar to the combined graph exists in the second gallery, and it may be further determined that third-party materials provided by the third-party object exist in the combined graph.

Based on the above optional embodiment, by screening the current combined image, only the combined image that meets the requirement (i.e. similar images are matched from the second gallery) is subjected to the payment process, so that the work efficiency of tracking the source of the materials in the combined image and determining the payment for the third-party object providing the third-party materials can be improved.

As an alternative embodiment, after generating the composite graph based on the knowledge-graph, the method further comprises:

step S1202a, determining a type of the missing part, wherein the type of the missing part includes at least one of the following: the combined image and the intercepted image of the digital watermark are lacked;

in step S1204a, similarity retrieval is performed based on the missing picture.

Step S1206a, if a combined picture similar to the missing picture is searched, repairing the missing picture based on the searched combined picture to obtain a repaired combined picture;

and step S1208a, executing the steps of matching with the copyright pictures in the copyright library and determining the payment amount based on the repaired combined picture.

As another alternative, after generating the composite map based on the knowledge-graph, the method further comprises:

step S1202b, determining a type of the missing part, wherein the type of the missing part includes at least one of the following: the combined image and the intercepted image of the digital watermark are lacked;

step S1204b, a similarity search is performed based on the missing picture.

In an optional embodiment, in order to avoid the situation that the combination layout cannot be traced due to the loss of the digital watermark caused by malicious modification and editing of the combination drawing, similarity retrieval may be performed on the missing picture after the combination drawing is received. In the embodiment of the application, a picture retrieval technology can be adopted to perform similar picture retrieval on the missing picture in a gallery or a local gallery in the internet, so that whether a combined picture similar to the missing picture can be retrieved in a network or the local gallery can be determined, the missing picture can be repaired, and the problem that the copyright of the combined picture cannot be traced is solved.

Step S1206b, if the matching image similar to the missing image is searched, repairing the missing image based on the searched matching image to obtain a repaired matching image;

step S1208b, executing a step of determining whether the merged image contains the marker data based on the repaired merged image.

Based on the optional embodiment, the problem that whether the combined image is a picture needing to pay copyright fees or not is difficult to determine due to the fact that the combined image lacks the digital watermark and is intercepted or modified can be avoided; the method achieves the purposes of determining whether the combined picture is a picture needing to pay the copyright fee and accurately paying the copyright fee of the combined picture.

As an alternative embodiment, fig. 9 is a flowchart of another alternative copyright payment method based on combined graph according to an embodiment of the present invention, as shown in fig. 9, the step S802, which is described above, of determining a knowledge graph for designing a combined graph may be implemented by the following steps:

step S1302, at least one entity and entity-associated attribute are obtained from at least one existing knowledge graph.

The existing knowledge graph may be, but is not limited to, a knowledge graph owned by a source copyright holder, such as a knowledge graph of Freebase, encyclopedia, interactive encyclopedia, and Kiwiencyclopedia. The knowledge graph mainly includes entities, attributes and attribute values, wherein an entity is something which has distinctiveness and exists independently, an attribute refers to the property of the entity and the relationship between different entities, an attribute value is the specific content of an entity attribute, for example, in a map, "china" is an entity, "area", "population", "capital" is the attribute of the entity, and "960 ten thousand square kilometers", "14 hundred million population" and "beijing" are the attribute values corresponding to the three attributes.

In this embodiment, the entities in the knowledge graph are components and/or contents required for designing a composition, where the components may represent structural features of a color, a size, a form, and the like of a character or a graphic in a picture, and may embody an overall layout of the character or the graphic, including information of the graphic, the character, and the like arranged at a designated position. Wherein, the text and/or graphics in the components can be used to describe the promotion information or the preferential information, fig. 10 is a schematic diagram of an optional combination according to an embodiment of the present invention, as shown in fig. 10, the first component includes "especial for you", "New", "winter New release", and "Time:10/31 10; the second component includes "this 11.11", "clothing and red pack", "all ready for you", "SHERRY small jade sauce" and "TIME:11-11-00 ″.

In addition, it should be further noted that the knowledge graph in this embodiment may be stored in a preset storage area of the client or the server, where a storage form of the knowledge graph is not limited in this application.

Step S1304, generating an initial picture knowledge graph based on the at least one entity and the attribute associated with the entity, where the initial picture knowledge graph includes an association relationship between each entity.

Specifically, after at least one entity and entity-associated attribute are obtained, the entity and the entity-associated attribute are subjected to technologies such as machine translation and multi-library fusion to fuse at least one knowledge graph, so that an initial picture knowledge graph library is obtained.

For example, an initial picture knowledge graph as shown in fig. 11 (a) is generated according to the components shown in fig. 10, wherein the entities in fig. 11 (a) include the content, the vision, and the structure of the picture, wherein the content mainly includes elements such as words/text groups, main bodies, and logos, the vision mainly includes elements such as decorations, backgrounds, color matching, and the structure mainly includes elements such as main body arrangement, picture-text arrangement, and decoration arrangement; the attributes include type, style, complexity, color, texture, shape, and position, and each attribute of the entity has a corresponding attribute value, for example, the attribute value of the "type" attribute of the "background" of the entity in fig. 11 (a) is "vector background", and the attribute value corresponding to the "color" attribute is "red". The correspondence between the components shown in fig. 10 and the initial picture knowledge base shown in fig. 11 (a) is shown in fig. 11 (b), for example, the type of the background in the components shown in fig. 10 is "vector background", and the color is "red".

Step 1306, updating and iterating the initial picture knowledge graph based on historical design data resources, and generating the knowledge graph for designing the composite graph.

It should be noted that, in order to ensure the integrity of the data resources of the picture knowledge graph, after the initial picture knowledge graph is obtained, the initial picture knowledge graph needs to be updated and iterated based on the historical design data resources. The historical design data resources can be obtained through a web crawler, can also be obtained by storing a knowledge graph after the knowledge graph of the picture is generated, and can also be formed by summarizing and summarizing design knowledge for a picture design expert.

In addition, in order to ensure the accuracy of the mapping knowledge domain and further improve the quality of mapping using mapping knowledge domain design, in the process of generating the mapping knowledge domain, the acquired entity, the attribute associated with the entity and the historical design data resource need to be processed in any one of the following manners: redundancy removal, noise removal, and collision data removal. For example, for the entity "graph-text arrangement", the initial graph-text arrangement in the knowledge graph is a "left-right structure", and the "graph-text arrangement" in the historical design data resource is an "upper-lower structure", so that the professional designer needs to determine the specific type of the "graph-text arrangement" according to factors such as the practical application scene of the composite graph and remove the unselected type.

In addition, since the combination graph used by the e-commerce user may include a plurality of third party objects which need to be paid, the e-commerce user needs to pay when using the combination graph. And because the knowledge graph contains the elements of the e-commerce user needing to pay the copyright fee, the e-commerce user can intuitively determine that the copyright fee and the payment fee are needed to be paid when the e-commerce user closes the graph, and the experience of the e-commerce user is further improved.

In the implementation process of the embodiment, the knowledge graph spectrum of the picture contains the association relationship between the entity and the attribute of the combined picture, so that the e-commerce user can intuitively acquire the information of the combined picture through the knowledge graph of the picture. In addition, after the initial picture knowledge graph is obtained, the initial picture knowledge graph is updated based on historical design data resources, and therefore the integrity of the combined graph information is guaranteed.

As an alternative embodiment, in step S1302, obtaining at least one entity and attribute associated with the entity from at least one existing knowledge graph may be implemented by the following steps:

step S1402, a semantic extraction model is adopted to automatically extract information from the at least one knowledge graph, and entities contained in the knowledge graph and the association between the entities are obtained;

optionally, the semantic extraction model mainly includes three modules, namely a calculation module, an extraction module, and a generation module. The calculation module is used for calculating similarity information between two entities, wherein if the two entities have a parallel relationship and have a larger association degree, the two entities can be determined to have a higher parallel similarity degree. For example, the literal entity a "this 11.11" and the literal entity B "TIME in fig. 10: 11-11-00 ", both belong to the parallel relationship, and simultaneously, both the two literal entities are related to" twenty one ", so that the calculation module can calculate the parallel similarity of the two entities by the distributed similarity sending and pattern matching method, and further determine that the literal entity a and the literal entity B are the two entities with higher parallel similarity.

In addition, the above extraction module may determine the upper and lower relationship between two entities, for example, if the "content" entity in fig. 11 (a) includes the "identification" entity, the "content" entity is the upper entity, and the "identification" entity is the lower entity. And finally, the generating module further comprises a clustering module and a semantic calibration module, wherein the clustering module can classify the semantic classes, and the semantic calibration module is used for adding one or more superior entities to the semantic classes as common superior entities of the members of the semantic classes, for example, the visual entities are used as common superior entities of the decoration entities, the background entities and the color matching entities.

In step S1404, attributes and/or attribute information associated with the entity are acquired, where the attribute information is data described in one dimension independent of the entity in the structure of the knowledge graph.

As an alternative embodiment, after determining the entities and the association between the entities, the extraction of the attributes and/or attribute information associated with the entities may be further completed.

Specifically, the extraction of the attribute and/or the attribute information associated with the entity may be completed by any one of the following methods: extracted from an encyclopedia site (e.g., encyclopedia, kiwikipedia, etc.); performing wrapper induction from vertical websites (e.g., electronic product websites, book websites, movie websites, etc.); extracting from a webpage table; the pattern is extracted from the picture using a manually defined or automatically generated pattern.

As an alternative embodiment, in step S1304, generating an initial picture knowledge graph based on the at least one entity and the attribute associated with the entity may be implemented by:

step S1402, an entity and an attribute associated with the entity of each of the aforementioned knowledge-graphs are acquired.

Step S1404, performing fusion processing on the entities of each of the knowledge maps and the attributes associated with the entities to generate the initial picture knowledge map;

wherein, the entity and the attribute associated with the entity are obtained in any one or more of the following manners: and (4) machine learning.

In an optional scheme, machine learning is a self-learning process completed by equipment, wherein in the process of acquiring an entity and attributes associated with the entity in a machine learning manner in this embodiment, first, training is performed according to data recorded under each node in a knowledge graph, so as to complete automatic identification of the entity, and further obtain information such as types of the entity and the attributes of the entity, and then, the obtained information such as types of the entity and the attributes is disassembled and analyzed, so as to obtain an analysis result, and the analysis result is recorded under a corresponding node in the knowledge graph, so that subsequent entities and attributes having the same analysis result are also located in the node.

Optionally, after the entities and the attributes associated with the entities of each knowledge graph are obtained, since the data sources are wide, problems of good and uneven data quality, data duplication from different data sources, missing hierarchical structures, and the like may exist, and therefore, before the initial picture knowledge graph is generated, fusion processing needs to be performed on the entities and the attributes associated with the entities of each knowledge graph. Specifically, the entity of each knowledge graph and the attribute associated with the entity may be processed in a multi-library fusion manner, where the multi-library fusion may be a result obtained by processing each knowledge graph by the semantic extraction model, and the result is superimposed on the image model to complete the fusion work, so as to obtain the initial image knowledge graph.

It should be noted that, besides processing the entities of each knowledge graph and the attributes associated with the entities in a multi-library fusion manner, the fusion of the knowledge graphs can be completed in a machine translation manner.

In addition, it should be noted that, in order to ensure the integrity and accuracy of the knowledge graph library, after the initial picture knowledge graph is generated, the initial picture knowledge graph needs to be updated and iterated based on historical design data resources, and the specific process is as follows:

step S1502, obtaining design data resources stored in a predetermined time period and/or design data resources shared on a network, where the data design resources include at least one of: popularization pictures, design materials and document contents.

In step S1502, after the design data resource is obtained, the design data resource may be saved in a preset storage area (e.g., a database) of the client or the server, and when the design data resource is used subsequently, the design data resource may be directly obtained from the preset storage area.

And step S1504, mining design information for designing a drawing from the design data resources based on a data mining technology.

In the above step S1504, the design information for designing the composite drawing may include, but is not limited to, a position of each entity in the picture, a number of entities, a positional relationship between a plurality of entities, and the like. For example, in fig. 10, the entity "Especially for you" is located at the top of the picture, and the entity "New" is located below the entity "Especially for you" and left-aligned with the entity "Especially for you".

In an alternative, words or icons such as "dieleven", "11.11", "double 11" may be present on the picture during the "dieleven" activity. Therefore, the design data resource stores preset design information, for example, the "dueley" entity is located in the center of the picture, and the background color of the "dueley" entity is red. At this time, the client or the server may mine from the design data resource that the "twenty-one" entity is located in the center of the picture, and the background color of the "twenty-one" entity is red.

And step S1506, performing incremental iterative processing on the initial picture knowledge graph based on the design information, and generating the knowledge graph for designing a composite graph.

In step S1506, after obtaining the design information, the client or the server detects the initial picture knowledge-graph, and if it is detected that the initial picture knowledge-graph does not match the design information, for example, there is no "twenty-one" entity in the initial picture knowledge-graph, the client or the server will add the "twenty-one" entity and its corresponding attribute and attribute information to the initial picture knowledge-graph.

It should be noted that, in order to enable the e-commerce user to visually view the knowledge-graph, after updating the iteratively initial picture knowledge-graph based on the historical design data resources to generate the knowledge-graph for designing the composite graph, the knowledge-graph may also be displayed, wherein the modification of the entities and/or attributes in the knowledge-graph is allowed based on the received update instructions. Alternatively, the knowledge graph may be displayed on a display screen of the client or server, or on an external display in communication with the client or server.

In addition, the generated knowledge-graph may not conform to the existing picture design scheme, for example, the entity or attribute information of the entity in the knowledge-graph is outdated, and the e-commerce user may modify the entity and/or attribute in the knowledge-graph through an external input device in the process of viewing the knowledge-graph through a display, for example, the e-commerce user modifies the position of the 'twenty-one' entity in the picture from 'picture center' to 'picture top'.

In addition, in order to ensure the accuracy of the mapping knowledge graph and further improve the quality of the mapping knowledge graph designed by using the mapping knowledge graph, in the process of generating the mapping knowledge graph, any one of the following methods needs to be performed on the obtained entities, the attributes associated with the entities and the historical design data resources: redundancy removal, noise removal, and collision data removal. For example, for the entity "graph-text arrangement", the initial graph-text arrangement in the knowledge graph is a "left-right structure", and the "graph-text arrangement" in the historical design data resource is an "upper-lower structure", so that the professional designer needs to determine the specific type of the "graph-text arrangement" according to factors such as the practical application scene of the composite graph and remove the unselected type.

It should be noted that, in order to enable the e-commerce user to visually view the knowledge-graph, after updating the iteratively initial picture knowledge-graph based on the historical design data resources to generate the knowledge-graph for designing the composite graph, the knowledge-graph may be further displayed, wherein the modification of the entities and/or attributes in the knowledge-graph is allowed based on the received update instructions. Alternatively, the knowledge graph may be displayed on a display screen of the client or server, or on an external display in communication with the client or server.

In addition, the generated knowledge graph may not be consistent with the existing picture design scheme, for example, the entity or attribute information of the entity in the knowledge graph is outdated, and the e-commerce user may also modify the entity and/or attribute in the knowledge graph through an external input device during the process of viewing the knowledge graph through the display, for example, the e-commerce user modifies the position of the 'double eleven' entity in the picture from 'picture center' to 'picture top'.

As an alternative embodiment, the step S804 generates a combined graph based on the knowledge graph, and may be implemented by the following steps:

step S1602, receiving requirement information for designing a composite drawing;

step S1604, analyzing the requirement information based on the design model determined by the knowledge graph for designing the synthesis graph, and acquiring the design information for designing the synthesis graph;

step S1606 generates the composite drawing based on the design information.

Wherein the design information for designing the composite drawing in each design model is different, e.g., different for the same entity location. The e-commerce user may determine a design model to be used, and the client or server may obtain design information based on the design model and generate a corresponding composite map based on the design information.

As an alternative embodiment, in step S1604, analyzing the requirement information based on the design model determined by the knowledge graph for designing the composite drawing to obtain the design information for designing the composite drawing, may be implemented by:

step 1702, under the condition that multiple types of design information are acquired, screening the multiple types of design information according to an aesthetic evaluation model, and determining a priority result of each type of design information;

step S1704 of determining at least one piece of design information for designing the composite drawing according to the priority result of each type of design information;

the method comprises the steps of learning pictures in a historical picture library based on machine learning to obtain the aesthetic evaluation model, wherein the aesthetic evaluation model is used for defining the sequencing result of the historical pictures in the historical picture library, and the sequencing result is sequenced based on a preset aesthetic standard.

It should be noted that after determining the priority result of each type of design information, the client or the server may select the type of design information with the highest priority as the design information for designing the composite drawing. In addition, in the process of determining the priority result of each type of design information, each type of design information is matched with pictures in the historical picture library. The matching method may adopt a frame matching method of the picture.

In addition, since the pictures in the historical picture library have been marked with priority orders according to aesthetic criteria, in the case where each type of design information is matched to a picture, the priority order of the design information can be known according to the matching result, and then the type of design information with the highest priority is used as the design information for designing the closed figure according to the priority order of the design information.

It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.

Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present application or portions thereof that contribute to the prior art may be embodied in the form of a software product, where the computer software product is stored in a storage medium (such as a ROM/RAM, a magnetic disk, and an optical disk), and includes several instructions for enabling a terminal device (which may be a mobile phone, a computer, a server, or a network device) to execute the methods described in the embodiments of the present application.

Example 3

According to an embodiment of the present application, there is further provided an apparatus embodiment for implementing the aforementioned copyright payment method based on matching, and fig. 12 is a schematic structural diagram of a copyright payment apparatus based on matching according to an embodiment of the present application, as shown in fig. 12, the apparatus 1200 includes: a receiving module 121, a matching module 123, a determining module 125, and a first sending module 127, wherein:

the receiving module 121 is configured to receive a closed drawing, where the type of the closed drawing includes at least one of the following: pictures without copyright grant, missing pictures with copyright grant but missing parts; a matching module 123, configured to match the combined image with a copyright picture in a copyright library, where the copyright library is configured to store at least one copyright picture, and the copyright picture is a picture that needs to pay copyright fees; a determining module 125, configured to determine, if the matching is successful, that the combined picture is a picture that needs to pay the copyright fee, and determine a payment amount; and the first sending module 127 is configured to send the payment amount of the combined graph to the payment system to complete the payment process.

It should be noted here that the receiving module 121, the matching module 123, the determining module 125, and the first sending module 127 correspond to steps S202 to S208 in embodiment 1, and the four modules are the same as the corresponding steps in the implementation example and application scenario, but are not limited to the disclosure in embodiment 1. It should be noted that the above modules may be operated in the computer terminal 10 provided in embodiment 1 as a part of the apparatus.

Based on the embodiment of the application, after receiving the close picture, matching the close picture with the copyright picture in the copyright library, and under the condition of successful matching, determining that the close picture is the picture needing to pay copyright fees, and determining payment amount; and sending the payment amount of the combined picture to a payment system to complete a payment process, so that the copyright fee of the combined picture can be accurately paid.

As an alternative embodiment, the apparatus further comprises: the disassembling module is used for disassembling the combined graph to obtain components and/or contents forming the combined graph; the matching module comprises: and the matching unit is used for matching the components and/or the contents of the combined pictures with the copyright pictures in the copyright library.

As an alternative embodiment, the apparatus further comprises: a detection module, configured to detect the combined image, and determine whether there is label data in the combined image, where the label data is used to characterize that there is third-party material provided by a third-party object in the combined image, and the label data at least includes source information of the third-party material provided by the third-party object, and the combined image has any one of the following modes for recording the label data: digital watermarks and visible watermarks; and the execution module is used for executing the steps of matching the combined picture with the copyright picture in the copyright library and determining the payment amount under the condition that the marked data exists in the combined picture, wherein the third party object for receiving the payment amount is determined based on the source information of the third party material.

As an alternative embodiment, the apparatus further comprises: the acquisition module is used for acquiring the operation information of the third-party material; a statistic module, configured to count an amount of money to be paid for using the third-party material based on the operation information of the third-party material, where a total amount of money paid to the third-party object includes: the amount of money to be paid for using the third-party material and the amount of money to be paid for paying the copyright fee.

As an alternative embodiment, the apparatus further comprises: and a second sending module, configured to send the source information of the third-party material and the total amount obtained through the statistics to a payment system, where the payment system pays the total amount to the third-party object based on the source information.

In an optional embodiment, the operation information includes at least one of: click operation, copy operation, download operation and forwarding operation.

As an alternative embodiment, the apparatus further comprises: the first matching module is used for carrying out similarity matching on the combined picture and determining whether a picture similar to the combined picture exists in a first picture library, wherein the picture contained in the first picture library is a picture with third-party materials, and the amount of money to be paid by each picture is recorded; the first determining module is used for determining that the payment fee of the combined picture is the amount of money required to be paid by the picture similar to the combined picture if the combined picture exists; and the second determining module is used for continuing to execute the step of detecting the combined graph if the combined graph does not exist.

As an alternative embodiment, the apparatus further comprises: the second matching module is used for carrying out similarity matching on the combined picture and determining whether a picture similar to the combined picture exists in a second picture library, wherein the picture contained in the second picture library is a picture with third-party materials; and the third determining module is used for determining that the third-party materials provided by the third-party object exist in the combined picture if the third-party materials exist.

As an alternative embodiment, the apparatus further comprises: a fourth determining module, configured to determine a type of the missing part, where the type of the missing part includes at least one of: the combined image and the intercepted image of the digital watermark are lacked; the first retrieval module is used for carrying out similarity retrieval on the basis of the missing pictures; the first repairing module is used for repairing the missing picture based on the retrieved composite picture to obtain a repaired composite picture if the composite picture similar to the missing picture is retrieved; and the first execution module is used for executing the steps of matching with the copyright pictures in the copyright library and determining the payment amount based on the repaired combined picture.

As an alternative embodiment, the apparatus further comprises: a fifth determining module, configured to determine a type of the missing part, where the type of the missing part includes at least one of the following: the combined image and the intercepted image of the digital watermark are lacked; the second retrieval module is used for carrying out similarity retrieval based on the missing picture; the second repairing module is used for repairing the missing picture based on the retrieved combined picture to obtain a repaired combined picture if the combined picture similar to the missing picture is retrieved; and the second execution module is used for executing the step of determining whether the combined graph has the mark data or not based on the repaired combined graph.

Example 4

According to an embodiment of the present application, there is provided another apparatus embodiment for implementing the aforementioned copyright payment method based on combined drawings, and fig. 13 is a schematic structural diagram of another copyright payment apparatus based on combined drawings according to an embodiment of the present application, as shown in fig. 13, the apparatus 1300 includes: an acquisition unit 131, a generation unit 133, a matching unit 135, a determination unit 137, wherein:

an obtaining unit 131, configured to determine a knowledge graph used for designing a composite graph, where the knowledge graph includes an entity that needs to pay a copyright fee and an attribute associated with the entity, and the entity is a component and/or content that is needed when designing the composite graph; a generating unit 133, configured to generate a composite map based on the knowledge graph; a matching unit 135, configured to match the combined image with a copyright picture in a copyright library, where the copyright library is configured to store at least one copyright picture, and the copyright picture is a picture that needs to pay copyright fees; and the determining unit 137 is configured to determine, if the matching fails, the copyright fee to be paid when the map is combined based on the copyright fee to be paid in the knowledge map.

It should be noted here that the acquiring unit 131, the generating unit 133, the matching unit 135, and the determining unit 137 correspond to steps S802 to SS808 in embodiment 2, and the four units are the same as the corresponding steps in the implementation example and the application scenario, but are not limited to the disclosure in embodiment 2. It should be noted that the above units may be operated in the computer terminal 10 provided in embodiment 1 as a part of the apparatus.

Example 5

According to an embodiment of the present application, there is further provided an embodiment of a copyright payment apparatus based on a combined figure, and fig. 14 is a schematic structural diagram of the copyright payment apparatus based on a combined figure according to the embodiment of the present application, and as shown in fig. 14, the copyright payment apparatus based on a combined figure includes: a display 141 and a processor 143, wherein:

the display 141 is configured to display the composite map and the type of the composite map, where the type of the composite map includes at least one of: pictures without copyright grant, missing pictures with copyright grant but missing parts; the processor 143 is configured to match the combined picture with a copyright picture in a copyright library, where the copyright library is configured to store at least one copyright picture, and the copyright picture is a picture that needs to pay copyright fees; and if the matching is successful, determining that the combined picture is a picture needing to pay the copyright fee, and determining the payment amount.

Example 6

According to an embodiment of the present application, there is also provided an embodiment of a mobile device, including: a processor, configured to run a program, wherein the following steps are performed when the program is run: receiving a closed graph, wherein the type of the closed graph comprises at least one of the following types: pictures without copyright grant, missing pictures with copyright grant but missing parts; matching the combined picture with copyright pictures in a copyright library, wherein the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright fees; if the matching is successful, determining that the combined picture is a picture needing to pay the copyright fee, and determining the payment amount; and sending the payment amount of the combined graph to a payment system to complete a payment process.

Example 7

According to an embodiment of the present application, there is also provided an embodiment of a system for paying a copyright based on a combined figure, which can perform the method for paying a copyright based on a combined figure in embodiments 1 and 2 and the method for charging a copyright based on a combined figure in embodiment 10, where the system includes: a processor and a memory, wherein:

a processor; and a memory, connected to the processor, for providing instructions to the processor for processing the following processing steps: receiving a closed graph, wherein the type of the closed graph comprises at least one of the following types: pictures without copyright grant, missing pictures with copyright grant but missing parts; matching the combined picture with copyright pictures in a copyright library, wherein the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright fees; if the matching is successful, determining that the combined picture is a picture needing to be paid for the copyright fee, and determining the payment amount; and sending the payment amount of the combined graph to a payment system to complete a payment process.

In the embodiment of the application, after the combined picture is received, the combined picture is matched with the copyright picture in the copyright library, and under the condition of successful matching, the combined picture is determined to be the picture needing to pay the copyright fee, and the payment amount is determined; and sending the payment amount of the combined picture to a payment system to complete a payment process, so that the copyright fee of the combined picture can be accurately paid.

Example 8

According to an embodiment of the present application, there is also provided an embodiment of a system for paying a copyright based on a combined figure, which can perform the method for paying a copyright based on a combined figure in embodiments 1 and 2 and the method for charging a copyright based on a combined figure in embodiment 10, where fig. 15 is an interaction diagram of a system for paying a copyright based on a combined figure according to an embodiment of the present application, as shown in fig. 15, and the system includes: client device 151 and rights server 153, wherein:

the client device 151 is configured to send the composite graph, where the type of the composite graph includes at least one of: pictures that have not been granted copyright, missing pictures that have been granted copyright but have missing portions.

The copyright server 153 is configured to obtain the combined image sent by the client device, match the combined image with a copyright picture in a copyright library, and if the matching is successful, determine that the combined image is a picture that needs to pay copyright fees, and determine payment amount.

The copyright server 153 is used for sending the payment amount of the combined picture to the payment system 155 to complete the payment process; the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright fees.

Optionally, the combined image is a combined image obtained through combining processing, and may include not only color features and structural features, but also picture materials such as pictures and fonts (text fonts and letter fonts), for example, a promotional picture for promoting a promotional activity in an e-commerce promotional scene.

As an alternative embodiment, the type of the missing part includes at least one of the following: the resultant image and the intercepted image with the missing digital watermark.

Alternatively, the client device 151 may be a computer client or a smartphone client, for example, a computer client providing a third-party object for matching images, and the copyright server 153 may be any type of server, for example, a cloud server.

The types of the received combined graphs comprise: the copyright server can detect whether the combined picture is a picture needing to pay the copyright fee or not and determine the amount of the specific copyright fee to be paid.

Furthermore, under the condition that the matching between the combined picture and any one of the copyright pictures in the copyright library is successful, the combined picture is determined to be the picture needing to pay the copyright fees, the copyright fees to be paid by the combined picture are determined to be consistent with or similar to the copyright fees of the copyright pictures successfully matched, and the copyright fees to be paid by the combined picture and the copyright pictures are possibly not completely consistent but are not far away.

Optionally, after determining that the copyright fee needs to be paid, the copyright server starts a payment system, and sends the payment amount to be paid to the payment system, and the e-commerce user can pay directly on a payment interface or pay through a scanning function provided by a third-party device or application (e.g., weChat).

It should be noted that, after the payment amount is sent to the payment system to pay the copyright fees and the payment process is completed, the payment information and/or the payment result corresponding to the payment information may be recorded based on the blockchain technology.

Based on the embodiment, after the copyright server receives the combined picture sent by the client device, the combined picture is matched with the copyright picture in the copyright library, and under the condition of successful matching, the combined picture is determined to be the picture needing to pay the copyright fee, and the payment amount is determined; and sending the payment amount of the combined picture to a payment system to complete a payment process, so that the copyright fee of the combined picture can be accurately paid.

It is easy to notice that the copyright server matches the combined picture with the copyright picture in the copyright library, and because the copyright picture is the picture needing to pay the copyright fee, the combined picture can be determined to be the picture needing to pay the copyright fee and the payment amount can be determined under the condition of successful matching.

In an optional embodiment, in a case that a plurality of copyright pictures are successfully matched in the copyright server 153 to obtain a plurality of payment amounts, the plurality of payment amounts are compared, and the payment amount with the lowest amount is sent to the payment system for payment.

It should be noted that the copyright server 153 may be, but is not limited to, a plurality of copyright libraries provided by platforms, for example, copyright libraries provided by platforms such as google and Baidu, and each copyright library may have a copyright picture matching the composite image, so in an alternative embodiment, in a case that the composite image is sequentially matched with the plurality of copyright libraries disposed in the copyright server, a plurality of copyright pictures that need to be paid for the copyright fees may be successfully matched, and the payment fees of the copyright pictures may be different from the payment fees that need to be paid for the copyright pictures under different platforms.

Therefore, in an optional embodiment of the present application, the copyright server may compare a plurality of obtained payment amounts, and send the obtained lowest payment amount as the payment amount of the copyright fee of the contract to the payment system for payment, so as to further meet the requirement of cost control of the e-commerce user, and improve the use experience of the e-commerce user.

Example 9

According to an embodiment of the present application, there is further provided an embodiment of a draft-based copyright payment system, which may execute the draft-based copyright payment methods in embodiments 1 and 2 and the draft-based copyright charging method in embodiment 10, and fig. 16 is an interaction diagram of another draft-based copyright payment system according to an embodiment of the present application, and as shown in fig. 16, the system includes: a client device 152 and a rights server 154, wherein:

a client device 152 for determining a knowledge-graph for designing the composite graph and generating the composite graph based on the knowledge-graph; the knowledge graph comprises an entity needing to pay copyright fees and attributes associated with the entity, wherein the entity is a component and/or content needed for designing the composite graph.

In addition, since the combination picture used by the e-commerce user may include a plurality of third party objects which need to be paid, when the e-commerce user uses the combination picture, the e-commerce user needs to pay corresponding use amount and copyright fee. And because the knowledge graph contains the elements of the e-commerce user needing to pay the copyright fee, the e-commerce user can intuitively determine that the copyright fee and the payment fee are needed to be paid when the e-commerce user closes the graph, and the experience of the e-commerce user is further improved.

A copyright server 154, configured to obtain the combined image generated by the client device, and match the combined image with a copyright picture in a copyright library, where the copyright library is used to store at least one copyright picture, and the copyright picture is a picture that needs to pay copyright fees; and if the matching fails, determining the copyright fee to be paid when the map is combined based on the copyright fee to be paid in the knowledge map.

In an alternative embodiment, as shown in fig. 16, the copyright server 154 may also send the copyright fees paid to the payment system 156 to complete the payment process through the payment system 156, and optionally, the options of the payment process may be, but are not limited to be, consistent with the options in embodiment 8.

Alternatively, the client device 152 may be a computer client, a smartphone client, for example, a computer client providing a third-party object for matching, and the copyright server 154 may be any type of server, for example, a cloud server.

In an alternative embodiment, a design model may be determined based on a knowledge graph for designing a composite drawing, and the requirement information is analyzed to obtain design information for designing the composite drawing, where the design information for designing the composite drawing in each design model is different, for example, different for the same entity location. The e-commerce user can determine a design model to be used, and the picture processing platform can obtain design information based on the design model and generate a corresponding composite picture based on the design information.

Because the knowledge graph contains the elements of the e-commerce user needing to pay the copyright fee, under the condition that the matching of the combined graph and the copyright picture in the copyright library fails, the copyright fee needing to be paid can be determined based on the copyright fee needing to be paid in the knowledge graph, the e-commerce user can visually determine the elements of the combined graph needing to pay the copyright fee and the payment amount which is specifically paid to the corresponding third-party object, and the experience of the e-commerce user is improved.

Based on the embodiment of the application, the client device determines the knowledge map for designing the combined picture, generates the combined picture based on the knowledge map, and the copyright server acquires the combined picture generated by the client device, matches the combined picture with the copyright picture in the copyright library, and determines the copyright fee to be paid for the combined picture based on the copyright fee to be paid in the knowledge map under the condition of failed matching, so that the copyright fee to be paid for the combined picture can be accurately paid.

It is easy to notice that, firstly, the client device determines the knowledge map for designing the combined picture, and obtains the combined picture generated based on the knowledge map, and then the copyright server can determine the copyright cost to be paid based on the copyright cost needing to be paid in the knowledge map under the condition that the matching of the combined picture and the copyright picture in the copyright library fails.

Therefore, the technical problem that whether the combined picture is a picture needing to be paid for the copyright fee cannot be determined in the related technology, and the copyright fee of the combined picture cannot be paid accurately is solved through the scheme of the embodiment provided by the application.

In an optional embodiment, when a plurality of copyright pictures are successfully matched in the copyright server to obtain a plurality of payment amounts, the plurality of payment amounts are compared, and the payment amount with the lowest amount is sent to the payment system for payment.

It should be noted that the copyright server 154 may be, but is not limited to, a plurality of copyright libraries provided by platforms, for example, copyright libraries provided by platforms such as google and Baidu, where each copyright library may have a copyright picture matching the composite image, and therefore, in an alternative embodiment, in the case that the composite image is sequentially matched with the plurality of copyright libraries disposed in the copyright server, a plurality of copyright pictures that need to be paid for may be successfully matched, and the payment fees of the copyright pictures may be different from the payment fees that need to be paid for may be set under different platforms.

Example 10

There is also provided, in accordance with an embodiment of the present invention, an embodiment of a method for combined copyright charging, including the steps illustrated in the flowchart of the figure as being executable by a computer system, such as a set of computer-executable instructions, and although a logical order is illustrated in the flowchart, in some cases the steps illustrated or described may be executed out of order from that shown.

It should be noted that the execution subject of the embodiment of the present application may be a tool for providing a design drawing, a picture processing platform (client or server), and the tool or platform may be embedded in the e-commerce platform, or may be a functional component of the e-commerce platform, and the e-commerce platform may include, but is not limited to, a business such as suning, kyoto, internet, koala, and the like.

Fig. 17 is a flowchart of a combined copyright charging method according to an embodiment of the present invention, and as shown in fig. 17, the method may include the following steps:

step S1802, in a case where it is determined that the combined picture is a picture for which the copyright fee needs to be paid, determining at least one picture element for which the copyright fee needs to be paid in the combined picture.

Optionally, the composite map is obtained through a composite process, and may be, for example, a promotional picture used for promoting a promotional activity in an e-commerce promotion scene.

It should be noted that, the sources of the picture elements in the combined picture may include, but are not limited to: the business user's self-service picture element, the third party picture element that third party object provided. When the electric commercial user uses the self-operated picture element, the copyright fee does not need to be paid, and when the electric commercial user uses the third-party picture element, the copyright fee and the fee payment subject corresponding to at least one picture element used may need to be determined, and the copyright fee is paid to the corresponding fee payment subject.

In an alternative embodiment, the picture elements may include, but are not limited to: color features, structural features, pictures, fonts (text fonts, alphabetic fonts), etc.

Step S1804, determining a copyright fee and a fee payment subject corresponding to the at least one picture element.

It should be noted that, because the composite map may include a plurality of picture elements, there may be a plurality of payment subjects needing payment in the composite map, and when the e-commerce user uses the composite map and needs to pay the payment subject for the copyright fee, any one picture element in the composite map may be matched with the copyright picture in the copyright library, and/or whether at least one picture element carries copyright information is detected, and the copyright fee and the payment subject corresponding to the picture element are determined according to the copyright information.

As an alternative embodiment, the step S1804 of determining the copyright fee and the fee payment subject corresponding to the at least one picture element may be implemented as follows:

in the first mode, the picture elements are matched with the pictures in the picture library, and a payment main body to which the pictures belong and the corresponding copyright fees are determined.

Optionally, the picture library may be, but not limited to, a copyright library on the internet, for example, the copyright pictures stored in the copyright library are pictures for which a payment of copyright fees is required, and a payment subject to which each copyright picture belongs and the copyright fees of the picture may be stored.

In an alternative embodiment, when the e-commerce user uses the combination and needs to pay the main copyright fee, any one picture element in the combination can be matched with the copyright picture in the copyright library. Furthermore, when the picture element is successfully matched with any one of the copyright pictures in the copyright library, it is determined that the copyright fee to be paid by the picture element is consistent with or similar to the copyright fee of the copyright picture successfully matched, and the payment subject to which the picture element belongs is consistent with or similar to the payment subject of the copyright picture successfully matched, and the copyright fee to be paid by the picture element and the payment subject to be paid by the picture element may not be completely consistent but may not be far apart.

In an alternative embodiment of the present application, the above-mentioned picture element may be matched with the copyright picture in the copyright library, but not limited to, by the following alternative ways: matching the picture material in the combined picture with the picture material of the copyright picture in the copyright library; matching the structural component in the combined picture with the structural component of the copyright picture in the copyright library; and matching the visual components in the combined picture with the visual components of the copyright pictures in the copyright library.

And determining the copyright fee and the payment subject corresponding to the picture element from the copyright information carried in the picture element.

In an alternative embodiment, the copyright information may be carried in any one of the following modes: digital watermarks and visible watermarks. Specifically, the digital watermark is an invisible digital watermark, and can realize invisible marking of the picture.

In the above optional embodiment, since the copyright information is recorded with the copyright fee and the payment subject corresponding to the picture element, when the e-commerce user uses the combined picture and needs to pay the payment subject for the copyright fee, the copyright fee and the payment subject corresponding to the picture element can be determined from the copyright information carried in the picture element.

Step S1806, the above copyright fee is paid to the payment subject through the payment system.

In an optional embodiment, the payment system may also pay the copyright fees to a bank account or a payment platform account of the payment subject through a transfer, a pre-transfer, or an online payment.

In addition, it should be noted that, for alternative or preferred embodiments of the present embodiment, reference may be made to the relevant description in any one of the above embodiments, and details are not described here again.

Example 11

According to an embodiment of the present application, there is further provided an embodiment of an apparatus for implementing the aforementioned combined copyright charging method, and fig. 18 is a schematic structural diagram of a combined copyright charger apparatus according to an embodiment of the present application, as shown in fig. 18, the apparatus 1800 includes: a first determining unit 181, a second determining unit 183, a payment unit 185, wherein:

a first determining unit 181, configured to determine at least one picture element in the combined picture, which requires payment of the copyright fee, if the combined picture is determined to be a picture requiring payment of the copyright fee; a second determining unit 183, configured to determine a copyright fee and a fee payment subject corresponding to the at least one picture element; a payment unit 185 for paying the above-mentioned copyright fees to the payment subject through the payment system.

It should be noted here that the first determining unit 181, the second determining unit 183, and the payment unit 185 correspond to steps S1802 to S1806 in embodiment 10, and the three units are the same as the example and the application scenario realized by the corresponding steps, but are not limited to the disclosure of embodiment 10. It should be noted that the above units may be operated in the computer terminal 10 provided in embodiment 1 as a part of the apparatus.

Example 12

According to the embodiment of the application, the embodiment of the computer terminal is also provided, and the computer terminal can be any computer terminal device in a computer terminal group. Optionally, in this embodiment, the computer terminal may also be replaced with a terminal device such as a mobile terminal.

Optionally, in this embodiment, the computer terminal may be located in at least one network device of a plurality of network devices of a computer network.

In this embodiment, the computer terminal may execute program codes of the following steps in the copyright payment method based on matching images: receiving a close map, wherein the type of the close map comprises at least one of the following types: pictures without copyright grant, missing pictures with copyright grant but missing parts; matching the combined picture with a copyright picture in a copyright library, wherein the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright cost; if the matching is successful, determining that the combined picture is a picture needing to pay the copyright fee, and determining the payment amount; and sending the payment amount of the combined graph to a payment system to complete a payment process.

Alternatively, fig. 19 is a block diagram of a computer terminal according to an embodiment of the present application. As shown in fig. 19, the computer terminal 15 may include: one or more processors 1502 (only one of which is shown), a memory 1504, and a peripheral interface 1506.

The memory may be configured to store software programs and modules, such as program instructions/modules corresponding to the copyright payment method and apparatus based on matching images in the embodiment of the present application, and the processor executes various functional applications and data processing by running the software programs and modules stored in the memory, that is, implements the aforementioned copyright payment method based on matching images. The memory may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory may further include memory remotely located from the processor, which may be connected to terminal a through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The processor can call the information and application program stored in the memory through the transmission device to execute the following steps: receiving a close map, wherein the type of the close map comprises at least one of the following types: pictures without copyright grant, missing pictures with copyright grant but missing parts; matching the combined picture with a copyright picture in a copyright library, wherein the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright cost; if the matching is successful, determining that the combined picture is a picture needing to pay the copyright fee, and determining the payment amount; and sending the payment amount of the combined graph to a payment system to complete a payment process.

Optionally, the processor may further execute the program code of the following steps: disassembling the composite graph to obtain components and/or contents forming the composite graph; wherein, match the above-mentioned picture with the copyright picture in the copyright storehouse, include: and matching the components and/or the content of the combined picture with the copyright pictures in the copyright library.

Optionally, the processor may further execute the program code of the following steps: detecting the combined image, and determining whether mark data exists in the combined image, wherein the mark data is used for representing that third party materials provided by a third party object exist in the combined image, the mark data at least comprises source information of the third party materials provided by the third party object, and the combined image has any one of the following modes to record the mark data: digital watermarks and visible watermarks; and under the condition that the marked data exist in the combined picture, executing the step of matching the combined picture with the copyright picture in a copyright library and determining the payment amount, wherein the third party object for receiving the payment amount is determined based on the source information of the third party material.

Optionally, the processor may further execute the program code of the following steps: acquiring operation information of the third-party material; counting the amount of money required to be paid for using the third-party materials based on the operation information of the third-party materials, wherein the total amount paid to the third-party object comprises: the amount of money to be paid for using the third-party material and the amount of money to be paid for paying the copyright fee.

Optionally, the processor may further execute the program code of the following steps: and sending the source information of the third-party materials and the total amount obtained by the statistics to a payment system, wherein the payment system pays the total amount to the third-party object based on the source information.

Optionally, the processor may further execute the program code of the following steps: performing similarity matching on the combined picture, and determining whether pictures similar to the combined picture exist in a first picture library, wherein the pictures contained in the first picture library are pictures with third-party materials, and the amount of money to be paid by each picture is recorded; if yes, the payment fee of the combination graph is the amount of money required to be paid by the picture similar to the combination graph; if not, the step of detecting the combination graph needs to be continuously executed.

Optionally, the processor may further execute the program code of the following steps: performing similarity matching on the combined picture, and determining whether a picture similar to the combined picture exists in a second picture library, wherein the picture contained in the second picture library is a picture with a third-party material; and if so, determining that the third-party materials provided by the third-party object exist in the combined picture.

Optionally, the processor may further execute the program code of the following steps: determining the type of the missing part, wherein the type of the missing part comprises at least one of the following: the combined image and the intercepted image of the digital watermark are lacked; carrying out similarity retrieval based on the missing picture; if a combined image similar to the missing image is searched, repairing the missing image based on the searched combined image to obtain a repaired combined image; and executing matching with the copyright pictures in the copyright library and determining the payment amount based on the repaired combination picture.

Optionally, the processor may further execute the program code of the following steps: determining the type of the missing part, wherein the type of the missing part comprises at least one of the following: the combination picture and the intercepted picture of the digital watermark are lacked; carrying out similarity retrieval based on the missing picture; if the combined picture similar to the missing picture is searched, repairing the missing picture based on the searched combined picture to obtain a repaired combined picture; and executing the step of determining whether the combined graph has the mark data or not based on the repaired combined graph.

Optionally, the processor may further execute the program code of the following steps: determining a knowledge graph for designing a composite graph, wherein the knowledge graph comprises an entity needing to pay copyright fees and attributes associated with the entity, and the entity is a component and/or content needed for designing the composite graph; generating a combined graph based on the knowledge graph; matching the combined picture with a copyright picture in a copyright library, wherein the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright cost; and if the matching fails, determining the copyright fee to be paid when the map is combined based on the copyright fee to be paid in the knowledge map.

Optionally, the processor may further execute the program code of the following steps: if the matching is successful, determining that the combined picture is a picture needing to pay the copyright fee, and determining the payment amount based on the information recorded in the copyright library; and sending the payment amount of the combined picture to a payment system to complete a payment process.

Optionally, the processor may further execute the program code of the following steps: disassembling the composite graph to obtain components and/or contents forming the composite graph; wherein, match the copyright picture in above-mentioned combination picture and the copyright storehouse, include: and matching the components and/or the content of the combined picture with the copyright pictures in the copyright library.

Optionally, the processor may further execute the program code of the following steps: performing similarity matching on the combined picture, and determining whether pictures similar to the combined picture exist in a first picture library, wherein the pictures contained in the first picture library are pictures with third-party materials, and the amount of money to be paid by each picture is recorded; if yes, the payment fee of the combination picture is the amount of money needing to be paid by the picture similar to the combination picture; if not, the step of detecting the combined graph needs to be continuously executed.

Optionally, the processor may further execute the program code of the following steps: performing similarity matching on the combined picture, and determining whether a picture similar to the combined picture exists in a second picture library, wherein the picture contained in the second picture library is a picture with third-party materials; and if so, determining that the third-party materials provided by the third-party object exist in the combined picture.

Optionally, the processor may further execute the program code of the following steps: determining the type of the missing part, wherein the type of the missing part comprises at least one of the following: the combination picture and the intercepted picture of the digital watermark are lacked; carrying out similarity retrieval based on the missing pictures; if the combined picture similar to the missing picture is searched, repairing the missing picture based on the searched combined picture to obtain a repaired combined picture; and executing matching with the copyright picture in the copyright library and determining the payment amount based on the repaired combined picture.

Optionally, the processor may further execute the program code of the following steps: determining the type of the missing part, wherein the type of the missing part comprises at least one of the following: the combination picture and the intercepted picture of the digital watermark are lacked; carrying out similarity retrieval based on the missing pictures; if the combined picture similar to the missing picture is searched, repairing the missing picture based on the searched combined picture to obtain a repaired combined picture; and executing the step of determining whether the combined graph has the mark data or not based on the repaired combined graph.

Optionally, the processor may further execute the program code of the following steps: obtaining at least one entity and entity-associated attribute from at least one existing knowledge-graph, wherein; generating an initial picture knowledge graph based on the at least one entity and the attribute of entity association, wherein the initial picture knowledge graph comprises association relations between each entity; and updating and iterating the initial picture knowledge graph based on historical design data resources to generate the knowledge graph for designing the composite graph.

Optionally, the processor may further execute the program code of the following steps: automatically extracting information from the at least one knowledge graph by adopting a semantic extraction model, and acquiring entities contained in the knowledge graph and the association between the entities; and acquiring attributes and/or attribute information associated with the entity, wherein the attribute information is data recorded in one dimension independent of the entity in the structure of the knowledge graph.

Optionally, the processor may further execute the program code of the following steps: receiving requirement information for designing a plan; analyzing the requirement information based on the design model determined by the knowledge graph for designing the composite drawing to acquire design information for designing the composite drawing; and generating the composite graph based on the design information.

Optionally, the processor may further execute the program code of the following steps: under the condition that the combination picture is determined to be a picture needing to pay the copyright fee, determining at least one picture element needing to pay the copyright fee in the combination picture; determining copyright fees and fee payment subjects corresponding to at least one picture element; the copyright fees are paid to the payment subject through the payment system.

Optionally, the processor may further execute the program code of the following steps: matching the picture elements with pictures in a picture library, and determining a payment subject to which the pictures belong and corresponding copyright fees; or, the copyright fee and the payment subject corresponding to the picture element are determined from the copyright information carried in the picture element.

By adopting the embodiment of the application, a copyright payment scheme based on combination is provided, the combination is matched with the copyright pictures in the copyright library after the combination is received, and under the condition of successful matching, the combination is determined to be the picture needing to pay copyright fees, and payment amount is determined; the payment amount of the combined picture is sent to a payment system to complete a payment process, so that the copyright fee of the combined picture can be accurately paid, the purposes of determining whether the combined picture is a picture needing to pay the copyright fee and accurately paying the copyright fee of the combined picture are achieved, and the technical effect of improving the efficiency and the accuracy of processing and paying the copyright fee of the combined picture is achieved. And the technical problem that whether the combined picture is a picture needing to pay the copyright fee or not can not be determined in the related technology, so that the copyright fee of the combined picture can not be paid accurately is solved.

It can be understood by those skilled in the art that the structure shown in fig. 19 is only an illustration, and the computer terminal may also be a terminal device such as a smart phone (e.g., an Android phone, an iOS phone, etc.), a tablet computer, a palmtop computer, a Mobile Internet Device (MID), a PAD, and the like. Fig. 19 is a diagram illustrating a structure of the electronic device. For example, the computer terminal 15 may also include more or fewer components (e.g., network interfaces, display devices, etc.) than shown in FIG. 19, or have a different configuration than shown in FIG. 19.

Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by a program instructing hardware associated with the terminal device, where the program may be stored in a computer-readable storage medium, and the storage medium may include: flash disks, read-Only memories (ROMs), random Access Memories (RAMs), magnetic or optical disks, and the like.

Example 13

According to an embodiment of the application, a storage medium embodiment is also provided. Alternatively, in this embodiment, the storage medium may be configured to store program codes executed by the copyright payment method based on matching provided in embodiments 1 and 2, and to store program codes executed by the copyright charging method based on matching provided in embodiment 10.

Optionally, in this embodiment, the storage medium may be located in any one of computer terminals in a computer terminal group in a computer network, or in any one of mobile terminals in a mobile terminal group.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: receiving a close map, wherein the type of the close map comprises at least one of the following types: pictures without copyright grant, missing pictures with copyright grant but missing parts; matching the combined picture with a copyright picture in a copyright library, wherein the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright cost; if the matching is successful, determining that the combined picture is a picture needing to pay the copyright fee, and determining the payment amount; and sending the payment amount of the combined picture to a payment system to complete a payment process.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: disassembling the composite graph to obtain components and/or contents forming the composite graph; wherein, match the above-mentioned picture with the copyright picture in the copyright storehouse, include: and matching the components and/or the content of the combined picture with the copyright pictures in the copyright library.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: detecting the combined image, and determining whether mark data exists in the combined image, wherein the mark data is used for representing that third party materials provided by a third party object exist in the combined image, the mark data at least comprises source information of the third party materials provided by the third party object, and the combined image has any one of the following modes to record the mark data: digital watermarks and visible watermarks; and under the condition that the marked data exist in the combined picture, executing the step of matching the combined picture with the copyright picture in a copyright library and determining the payment amount, wherein the third party object for receiving the payment amount is determined based on the source information of the third party material.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: acquiring operation information of the third-party material; counting the amount of money required to be paid for using the third-party materials based on the operation information of the third-party materials, wherein the total amount paid to the third-party object comprises: the amount to be paid when the third-party material is used and the payment amount for paying the copyright fee are described.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: and sending the source information of the third-party materials and the total amount obtained by the statistics to a payment system, wherein the payment system pays the total amount to the third-party object based on the source information.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: performing similarity matching on the combined picture, and determining whether pictures similar to the combined picture exist in a first picture library, wherein the pictures contained in the first picture library are pictures with third-party materials, and the amount of money to be paid by each picture is recorded; if yes, the payment fee of the combination graph is the amount of money required to be paid by the picture similar to the combination graph; if not, the step of detecting the combined graph needs to be continuously executed.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: performing similarity matching on the combined picture, and determining whether a picture similar to the combined picture exists in a second picture library, wherein the picture contained in the second picture library is a picture with a third-party material; and if so, determining that the third-party materials provided by the third-party object exist in the combined image.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: determining the type of the missing part, wherein the type of the missing part comprises at least one of the following: the combined image and the intercepted image of the digital watermark are lacked; carrying out similarity retrieval based on the missing picture; if the combined picture similar to the missing picture is searched, repairing the missing picture based on the searched combined picture to obtain a repaired combined picture; and executing matching with the copyright pictures in the copyright library and determining the payment amount based on the repaired combination picture.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: determining the type of the missing part, wherein the type of the missing part comprises at least one of the following: the combination picture and the intercepted picture of the digital watermark are lacked; carrying out similarity retrieval based on the missing picture; if the combined picture similar to the missing picture is searched, repairing the missing picture based on the searched combined picture to obtain a repaired combined picture; and executing the step of determining whether the combined graph has the mark data or not based on the repaired combined graph.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: determining a knowledge graph for designing a composite graph, wherein the knowledge graph comprises an entity needing to pay copyright fees and attributes associated with the entity, and the entity is a component and/or content needed for designing the composite graph; generating a combined graph based on the knowledge graph; matching the combined picture with copyright pictures in a copyright library, wherein the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright fees; and if the matching fails, determining the copyright fee to be paid when the map is combined based on the copyright fee to be paid in the knowledge map.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: if the matching is successful, determining that the combined picture is a picture needing to pay the copyright fee, and determining the payment amount based on the information recorded in the copyright library; and sending the payment amount of the combined graph to a payment system to complete a payment process.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: detecting the combined image, and determining whether mark data exists in the combined image, wherein the mark data is used for representing that third-party materials provided by a third-party object exist in the combined image, and the mark data at least comprises source information of the third-party materials provided by the third-party object, and the combined image has any one of the following modes to record the mark data: digital watermarks and visible watermarks; and under the condition that the marked data exist in the combined picture, executing the step of matching the combined picture with the copyright picture in a copyright library and determining the payment amount, wherein the third party object for receiving the payment amount is determined based on the source information of the third party material.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: acquiring operation information of the third-party material; counting the amount of money required to be paid for using the third-party materials based on the operation information of the third-party materials, wherein the total amount paid to the third-party object comprises: the amount of money to be paid for using the third-party material and the amount of money to be paid for paying the copyright fee.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: performing similarity matching on the combined picture, and determining whether pictures similar to the combined picture exist in a first picture library, wherein the pictures contained in the first picture library are pictures with third-party materials, and the amount of money to be paid by each picture is recorded; if yes, the payment fee of the combination picture is the amount of money needing to be paid by the picture similar to the combination picture; if not, the step of detecting the combination graph needs to be continuously executed.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: performing similarity matching on the combined picture, and determining whether a picture similar to the combined picture exists in a second picture library, wherein the picture contained in the second picture library is a picture with third-party materials; and if so, determining that the third-party materials provided by the third-party object exist in the combined image.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: determining the type of the missing part, wherein the type of the missing part comprises at least one of the following: the combined image and the intercepted image of the digital watermark are lacked; carrying out similarity retrieval based on the missing picture; if the combined picture similar to the missing picture is searched, repairing the missing picture based on the searched combined picture to obtain a repaired combined picture; and executing matching with the copyright picture in the copyright library and determining the payment amount based on the repaired combined picture.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: determining the type of the missing part, wherein the type of the missing part comprises at least one of the following: the combined image and the intercepted image of the digital watermark are lacked; carrying out similarity retrieval based on the missing pictures; if the combined picture similar to the missing picture is searched, repairing the missing picture based on the searched combined picture to obtain a repaired combined picture; and executing the step of determining whether the combined graph has the mark data or not based on the repaired combined graph.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: obtaining at least one entity and entity-associated attribute from at least one existing knowledge-graph, wherein; generating an initial picture knowledge graph based on the at least one entity and the attribute of entity association, wherein the initial picture knowledge graph comprises the association relation between each entity; and updating and iterating the initial picture knowledge graph based on historical design data resources to generate the knowledge graph for designing the composite graph.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: automatically extracting information from the at least one knowledge graph by adopting a semantic extraction model, and acquiring entities contained in the knowledge graph and associations among the entities; and acquiring attributes and/or attribute information associated with the entity, wherein the attribute information is data recorded in one dimension independent of the entity in the structure of the knowledge graph.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: receiving requirement information for designing a plan; analyzing the requirement information based on the design model determined by the knowledge graph for designing the composite drawing to acquire design information for designing the composite drawing; and generating the composite graph based on the design information.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: under the condition that the combination picture is determined to be a picture needing to pay the copyright fee, determining at least one picture element needing to pay the copyright fee in the combination picture; determining copyright cost and a cost payment main body corresponding to at least one picture element; the copyright fees are paid to the payment subject through the payment system.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: matching the picture elements with pictures in a picture library, and determining a payment main body to which the pictures belong and corresponding copyright fees; or, the copyright fee and the payment subject corresponding to the picture element are determined from the copyright information carried in the picture element.

The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.

In the embodiments of the present application, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to the related descriptions of other embodiments.

In the embodiments provided in the present application, it should be understood that the disclosed technical content can be implemented in other manners. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one type of division of logical functions, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed to by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk, and various media capable of storing program codes.

The foregoing is only a preferred embodiment of the present application and it should be noted that those skilled in the art can make several improvements and modifications without departing from the principle of the present application, and these improvements and modifications should also be considered as the protection scope of the present application.

Claims

1. A copyright payment method based on image combination is characterized by comprising the following steps:

receiving a closed graph, wherein the type of the closed graph comprises at least one of the following types: pictures without copyright grant, missing pictures with copyright grant but missing parts;

matching the combined picture with a copyright picture in a copyright library, wherein the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright cost;

if the matching is successful, determining that the combined picture is a picture needing to pay the copyright fee, and determining the payment amount;

and sending the payment amount of the combined graph to a payment system to complete a payment process.

2. The method of claim 1, wherein in the case that the composite image is not copyrighted, after receiving the composite image, the method further comprises:

disassembling the combined graph to obtain components and/or contents forming the combined graph;

wherein, match the picture with the copyright picture in the copyright library, including: and matching the components and/or the content of the combined picture with the copyright pictures in the copyright library.

3. The method according to claim 1, wherein in case that the combined picture is a missing picture which has been granted a copyright but has a missing part, after receiving the combined picture, the method further comprises:

detecting the combined image, and determining whether mark data exists in the combined image, wherein the mark data is used for representing that third-party materials provided by third-party objects exist in the combined image, the mark data at least comprises source information of the third-party materials provided by the third-party objects, and the combined image has any one of the following modes to record the mark data: digital watermarks and visible watermarks;

performing a step of matching the composite picture with a copyright picture in a copyright library and determining the payment amount in a case where it is determined that the tag data exists in the composite picture,

wherein the third party object for receiving the payment amount is determined based on source information of the third party materials.

4. The method of claim 3, wherein prior to sending the patterned payment amount to a payment system to complete a payment process, the method further comprises:

acquiring operation information of the third-party material;

counting the amount of money required to be paid for using the third-party materials based on the operation information of the third-party materials,

wherein the total amount paid to the third party object comprises: and the amount to be paid when the third-party material is used and the payment amount of the copyright payment fee are used.

5. The method of claim 4, wherein after counting an amount of money required to be paid for using the third party material based on the operational information of the third party material, the method further comprises:

and sending the source information of the third-party materials and the total amount obtained by statistics to a payment system, wherein the payment system pays the total amount to the third-party object based on the source information.

6. The method of claim 4, wherein the operational information comprises at least one of: click operation, copy operation, download operation and forwarding operation.

7. The method of claim 3, wherein prior to detecting the combined image, the method further comprises:

carrying out similarity matching on the combined picture, and determining whether pictures similar to the combined picture exist or not from a first picture library, wherein the pictures contained in the first picture library are pictures with third-party materials, and the amount of money to be paid by each picture is recorded;

if yes, the payment fee of the combined picture is the amount of money needing to be paid by the picture similar to the combined picture;

if not, the step of detecting the combination graph needs to be continuously executed.

8. The method of claim 3, wherein prior to detecting the combined image, the method further comprises:

performing similarity matching on the combined picture, and determining whether a picture similar to the combined picture exists in a second picture library, wherein the picture contained in the second picture library is a picture with third-party materials;

and if so, determining that the third-party materials provided by the third-party object exist in the combined graph.

9. The method of any of claims 3 to 8, wherein after receiving the composite map, the method further comprises:

determining the type of the missing part, wherein the type of the missing part comprises at least one of the following:

the combined image and the intercepted image of the digital watermark are lacked;

performing similarity retrieval based on the missing picture;

if the combined picture similar to the missing picture is searched, repairing the missing picture based on the searched combined picture to obtain a repaired combined picture;

and executing matching with the copyright pictures in the copyright library and determining the payment amount based on the repaired combined picture.

10. The method according to any of claims 3 to 8, wherein after receiving a composite map, the method further comprises:

determining the type of the missing part, wherein the type of the missing part comprises at least one of the following: the combined image and the intercepted image of the digital watermark are lacked;

performing similarity retrieval based on the missing picture;

and executing the step of determining whether the marked data exists in the combined graph or not based on the repaired combined graph.

11. A copyright payment method based on image combination is characterized by comprising the following steps:

determining a knowledge graph for designing a composite graph, wherein the knowledge graph comprises an entity needing to pay copyright fees and attributes associated with the entity, and the entity is a component and/or content needed for designing the composite graph;

generating a composite map based on the knowledge graph;

and if the matching fails, determining the copyright fee to be paid for the combined graph based on the copyright fee to be paid in the knowledge graph.

12. The method of claim 11,

if the matching is successful, determining that the combined picture is a picture needing to pay the copyright fee, and determining the payment amount based on the information recorded in the copyright library;

13. The method of claim 12, wherein the type of the composite graph comprises at least one of: pictures that are not copyrighted, missing pictures that have been copyrighted but have missing portions, wherein, after generating a composite picture based on the knowledge-graph, the method further comprises:

14. The method of claim 12, wherein the type of the composite graph comprises at least one of: the method comprises the following steps of obtaining a combined picture, wherein the combined picture comprises pictures without copyright, missing pictures with copyright and missing parts, and in the case that the combined picture is the missing pictures with the copyright and the missing parts, after the combined picture is generated based on the knowledge graph, the method further comprises the following steps:

in the case that it is determined that the mark data exists in the combined picture, performing a step of matching the combined picture with a copyright picture in a copyright repository and determining the payment amount,

15. The method of claim 14, wherein prior to sending the patterned payment amount to a payment system to complete a payment process, the method further comprises:

acquiring operation information of the third-party material;

wherein the total amount paid to the third party object comprises: the amount to be paid for using the third-party materials and the payment amount for paying the copyright fee.

16. The method of claim 14, wherein prior to detecting the combined image, the method further comprises:

if the image matching is available, the payment fee of the matching image is the amount of money required to be paid by the image similar to the matching image;

17. The method of claim 14, wherein prior to detecting the combined image, the method further comprises:

18. The method of any one of claims 14 to 17, wherein after generating a composite based on the knowledge-graph, the method further comprises:

determining the type of the missing part, wherein the type of the missing part comprises at least one of the following: the merged picture and the intercepted picture which lack the digital watermark;

performing similarity retrieval based on the missing picture;

19. The method of any of claims 14 to 17, wherein after generating a composite graph based on the knowledge-graph, the method further comprises:

performing similarity retrieval based on the missing picture;

20. The method of claim 11, wherein determining the knowledge-graph for designing the composite graph comprises:

obtaining at least one entity and entity-associated attribute from at least one existing knowledge-graph, wherein;

generating an initial picture knowledge graph based on the at least one entity and the attribute of entity association, wherein the initial picture knowledge graph comprises an association relation between each entity;

and updating and iterating the initial picture knowledge graph based on historical design data resources to generate the knowledge graph for designing the combined graph.

21. The method of claim 20, wherein obtaining at least one entity and entity-associated attribute from at least one existing knowledge-graph comprises:

automatically extracting information from the at least one knowledge graph by adopting a semantic extraction model, and acquiring entities contained in the knowledge graph and associations among the entities;

obtaining attributes and/or attribute information associated with the entities, wherein the attribute information is data recorded in one dimension of the structure of the knowledge graph independent of the entities.

22. The method of claim 21, wherein generating a composite graph based on the knowledge-graph comprises:

receiving requirement information for designing a plan;

analyzing the requirement information based on the design model determined by the knowledge graph for designing the combined graph to obtain design information for designing the combined graph;

and generating the composite graph based on the design information.

23. A draft-based copyright payment device, comprising:

the display is used for displaying the composite picture and the type of the composite picture, wherein the type of the composite picture comprises at least one of the following types: pictures without copyright grant, missing pictures with copyright grant but missing parts;

the processor is used for matching the combined picture with copyright pictures in a copyright library, wherein the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright cost; and if the matching is successful, determining that the combined picture is a picture needing to pay the copyright fee, and determining the payment amount.

24. A storage medium comprising a stored program, wherein the program, when executed, controls an apparatus on which the storage medium is located to perform the steps of: receiving a closed graph, wherein the type of the closed graph comprises at least one of the following types: pictures without copyright grant, missing pictures with copyright grant but missing parts; matching the combined picture with a copyright picture in a copyright library, wherein the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright cost; if the matching is successful, determining that the combined picture is a picture needing to pay the copyright fee, and determining the payment amount; and sending the payment amount of the combined graph to a payment system to complete a payment process.

25. A mobile device, comprising:

a processor for executing a program, wherein the following steps are performed when the program is executed:

receiving a closed graph, wherein the type of the closed graph comprises at least one of the following types: pictures without copyright grant, missing pictures with copyright grant but missing parts; matching the combined picture with a copyright picture in a copyright library, wherein the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright cost; if the matching is successful, determining that the combined picture is a picture needing to pay the copyright fee, and determining the payment amount; and sending the payment amount of the combined graph to a payment system to complete a payment process.

26. A system for closed figure based copyright payment, comprising:

a processor; and

a memory coupled to the processor for providing instructions to the processor for processing the following processing steps: receiving a closed graph, wherein the type of the closed graph comprises at least one of the following types: pictures without copyright grant, missing pictures with copyright grant but missing parts; matching the combined picture with a copyright picture in a copyright library, wherein the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright cost; if the matching is successful, determining that the combined picture is a picture needing to be paid for the copyright fee, and determining the payment amount; and sending the payment amount of the combined graph to a payment system to complete a payment process.

27. A system for closed figure based copyright payment, comprising:

the client device is used for sending the composite graph, wherein the type of the composite graph comprises at least one of the following types: pictures without copyright grant, missing pictures with copyright grant but missing parts;

the copyright server is used for acquiring the combined picture sent by the client equipment, matching the combined picture with a copyright picture in a copyright library, if the matching is successful, determining that the combined picture is a picture needing to pay copyright fees, determining payment amount, and sending the payment amount of the combined picture to a payment system to finish a payment process;

the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright fees.

28. The system of claim 27, wherein if a plurality of copyright pictures are successfully matched in the copyright server to obtain a plurality of payment amounts, comparing the plurality of payment amounts, and sending the payment amount with the lowest amount to the payment system for payment.

29. A system for closed figure based copyright payment, comprising:

the client device is used for determining a knowledge graph for designing the combined graph and generating the combined graph based on the knowledge graph; the knowledge graph comprises an entity needing to pay copyright fees and attributes associated with the entity, wherein the entity is a component and/or content needed for designing a combined graph;

the copyright server is used for acquiring the combined picture generated by the client equipment and matching the combined picture with copyright pictures in a copyright library, wherein the copyright library is used for storing at least one copyright picture, and the copyright picture is a picture needing to pay copyright cost; and if the matching fails, determining the copyright fee to be paid for the combined graph based on the copyright fee to be paid in the knowledge graph.

30. The system of claim 29, wherein if a plurality of copyright pictures are successfully matched in the copyright server to obtain a plurality of payment amounts, the plurality of payment amounts are compared, and the payment amount with the lowest payment amount is sent to the payment system for payment.

31. A copyright charging method for a combination of pictures, comprising:

if the matching is successful, determining that the combined picture is a picture needing to pay copyright fees;

under the condition that the combined picture is determined to be a picture needing to pay the copyright fee, determining at least one picture element needing to pay the copyright fee in the combined picture;

determining copyright cost and a cost payment subject corresponding to the at least one picture element;

and paying the copyright fee to a payment subject through a payment system.

32. The method of claim 31, wherein determining a copyright royalty and a royalty payment subject corresponding to the at least one picture element comprises:

matching the picture elements with pictures in a picture library, and determining a payment main body to which the pictures belong and corresponding copyright fees; alternatively, the first and second electrodes may be,