WO2018188352A1 - 资源平衡性的确定方法、装置、设备以及存储介质 - Google Patents

资源平衡性的确定方法、装置、设备以及存储介质 Download PDF

Info

Publication number
WO2018188352A1
WO2018188352A1 PCT/CN2017/113773 CN2017113773W WO2018188352A1 WO 2018188352 A1 WO2018188352 A1 WO 2018188352A1 CN 2017113773 W CN2017113773 W CN 2017113773W WO 2018188352 A1 WO2018188352 A1 WO 2018188352A1
Authority
WO
WIPO (PCT)
Prior art keywords
resource
library
site
distribution
amount
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2017/113773
Other languages
English (en)
French (fr)
Inventor
黄平
李升起
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Baidu Online Network Technology Beijing Co Ltd
Original Assignee
Baidu Online Network Technology Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Baidu Online Network Technology Beijing Co Ltd filed Critical Baidu Online Network Technology Beijing Co Ltd
Publication of WO2018188352A1 publication Critical patent/WO2018188352A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5061—Partitioning or combining of resources
    • G06F9/5072—Grid computing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5083—Techniques for rebalancing the load in a distributed system

Definitions

  • the embodiments of the present invention relate to the field of information processing technologies, and in particular, to a method, an apparatus, a device, and a storage medium for determining resource balance.
  • Search Engine refers to collecting information from the Internet according to certain strategies and using specific computer programs. After organizing and processing the information, it provides search services for users and presents relevant information for users to the users. The system has become an indispensable way for users to obtain network information.
  • Search resources are the cornerstone of search engine products.
  • a resource typically, a web page updated in a resource site
  • recall that is, the distribution of resources
  • sorting sorting
  • presentation and other processes.
  • the capture and storage of resources is the basis of the recall; the amount of resources requested for recall is an effective indicator for the quality of resource capture and storage, and is also the main factor affecting user experience.
  • the embodiment of the invention provides a method, a device, a device and a storage medium for determining resource balance, so as to effectively measure the balance of the collection and distribution of resources in the resource library.
  • an embodiment of the present invention provides a method for determining resource balance, including:
  • the target economic parameter is used to measure the fairness of economic allocation
  • the resource balance parameter is used to measure the balance of resource collection and distribution of the resource library.
  • the embodiment of the present invention further provides a device for determining resource balance, including:
  • a resource site information statistics module configured to: in a set time interval, a resource collection amount of the resource library for each resource site, and a resource distribution amount of the resource library for each resource site;
  • a resource balance parameter calculation module configured to apply a calculation method of the target economic parameter, and calculate a resource balance parameter of the resource library by using the resource collection amount and the resource distribution amount;
  • the target economic parameter is used to measure the fairness of economic allocation
  • the resource balance parameter is used to measure the balance of resource collection and distribution of the resource library.
  • an embodiment of the present invention further provides a computer device, including a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the processor executes the program to implement the implementation of the present invention.
  • a computer device including a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the processor executes the program to implement the implementation of the present invention.
  • the embodiment of the present invention further provides a computer readable storage medium, where the computer program is stored, and when the program is executed by the processor, the resource balance determination according to any one of the embodiments of the present invention is implemented. method.
  • Embodiments of the present invention provide a method, a device, a device, and a storage medium for determining resource balance.
  • a calculation method of a target economic parameter that measures the fairness of economic distribution a resource pool is set for each resource in a set time interval.
  • the resource collection amount of the site and the resource distribution amount, and the technical means for measuring the balance resource parameter of the resource collection and distribution of the resource library are calculated, and an effective measurement of the resource in the resource library is creatively given.
  • the new method of distributing balance enables the user to quantitatively perceive whether the collection and distribution of resources in the resource pool are balanced according to the calculated resource balance parameter, and further, according to the calculation result of the resource balance parameter, the adaptability The adjustment of the resource capture strategy for the repository.
  • FIG. 1 is a flowchart of a method for determining resource balance in the first embodiment of the present invention
  • Embodiment 2 is a flowchart of a method for determining resource balance in Embodiment 2 of the present invention
  • FIG. 3a is a flowchart of a method for determining resource balance in Embodiment 3 of the present invention.
  • FIG. 3b is a schematic diagram of a specific application scenario according to an embodiment of the present invention.
  • Embodiment 4 is a structural diagram of a device for determining resource balance in Embodiment 4 of the present invention.
  • FIG. 5 is a schematic structural diagram of a computer device according to Embodiment 5 of the present invention.
  • Embodiment 1 is a flowchart of a method for determining resource balance according to Embodiment 1 of the present invention.
  • the embodiment is applicable to a method for measuring a balance between resource collection and resource distribution of a search engine product resource pool. It can be implemented by the resource balance determining apparatus provided by the embodiment of the present invention, and the apparatus can be implemented by software and/or hardware, and can be integrated into a server of a search engine product. As shown in FIG. 1 , the method in this embodiment specifically includes:
  • the resource library specifically refers to a search engine database that is crawled by a web crawler or composed of web resources reported by the website and used for data search.
  • the resource included in the resource library may be a resource in the form of a text, a resource in the form of a picture, and a resource in a multimedia form. This embodiment does not limit this.
  • the set time interval may be divided in units of set time units (for example, hours, days, one week, or one month, etc.).
  • the resource collection amount of the resource library for each resource site specifically refers to the resource collection increment of the web resource of the different resource sites in the set time interval; the resource library is specific to each resource site.
  • the amount of resource distribution specifically refers to the number of resources corresponding to different resource sites in the recall result of the search engine product (the search result returned for the user's search formula) within the set time interval.
  • the resource library has newly added 60 resources for resource site 1 (www.baidu.com), and the search engine products recalled 30 resources of resource site 1 in the resource library, which is at 2017.4.10.
  • the resource inventory of the resource site 1 for the resource site is 60
  • the resource distribution amount of the resource library for the resource site 1 is 30.
  • the target economic parameter is used to measure the fairness of economic allocation
  • the resource balance parameter is used to measure the balance of resource collection and distribution of the resource library.
  • the inventors discovered through creative labor that the distribution of economy (or income) in the field of economics has certain similarities with the collection and distribution of resources in the resource pool. Therefore, the set economic parameters can be applied to the field of resource collection and distribution for calculating resource balance parameters.
  • the method for calculating the target economics parameter is used, using the resource collection amount and the resource distribution amount.
  • mapping relationship between the resource collection and distribution process of the resource library and the economic activity may be established as follows:
  • mapping the resource library to an overall society mapping a resource site included in the resource library to a resident; mapping a resource collection process in the resource library to revenue, and mapping a resource distribution process in the resource library to The distribution of income; according to the established mapping relationship, the Gini coefficient is selected as the target economic parameter.
  • the meaning of the classic Gini coefficient of economics refers to the proportion of the income that is used for uneven distribution among all residents' income.
  • the Gini coefficient is at most "1" and the minimum is equal to "0".
  • the former indicates that the income distribution among residents is absolutely uneven, that is, 100% of the income is occupied by all the people in one unit; while the latter indicates that the income distribution among the residents is absolutely average, that is, the income between people is completely equal, no Any differences.
  • these two situations are only theoretically absolute forms, and generally do not appear in real life. Therefore, the actual value of the Gini coefficient can only be between 0 and 1.
  • the resource library as a container of resources can be seen as the overall society in the Gini coefficient
  • the resource site as a source of resources can be seen as a resident of the Gini coefficient
  • the warehousing resources as the content source of the resource library can be regarded as the income in the Gini coefficient
  • Resource distribution as an outward export of the resource pool can be seen as an allocation in the Gini coefficient
  • the Gini coefficient mapped to the resource level can be used to check whether the collection and distribution of resources in the resource pool are equal.
  • the Gini coefficient ranges from 0 to 1. The smaller the Gini coefficient, the more balanced the resource is collected and distributed. For a resource site, the more resources are included, the more resources are distributed.
  • Embodiments of the present invention provide a method for determining resource balance, by using a calculation method of a target economic parameter for measuring the fairness of economic distribution, using a resource pool needle in a set time interval Calculating the resource collection amount and the resource distribution amount of each resource site, calculating a technical means for measuring the resource balance parameter of the resource collection and distribution of the resource library, and creatively giving an effective measurement resource pool
  • a new method for the collection and distribution of resources enables the user to quantitatively perceive whether the collection and distribution of resources in the resource pool are balanced according to the calculated resource balance parameters, and further can calculate the balance parameter according to the resource. Adapting to the resource capture strategy of the resource library.
  • FIG. 2 is a flowchart of a method for determining resource balance according to Embodiment 2 of the present invention.
  • the present embodiment is embodied based on the foregoing embodiment.
  • a method for calculating target economic parameters is applied. And calculating, by using the resource collection amount and the resource distribution amount, a resource balance parameter of the resource library, where the resource sites included in the resource library are sorted according to a resource collection amount from small to large; According to the sorting result, the distribution weights corresponding to the respective resource sites are cumulatively summed to obtain a first intermediate amount; according to the sorting result, the cumulative distribution weights corresponding to the respective resource sites are cumulatively summed to obtain a second intermediate amount; calculating the resource balance parameter according to the first intermediate amount and the second intermediate amount.
  • the method of the embodiment of the invention includes:
  • the resource collection amount of the statistical resource pool for each resource site In a set time interval, the resource collection amount of the statistical resource pool for each resource site, and the resource distribution amount of the resource library for each resource site.
  • mapping the resource library to an overall society mapping a resource site included in the resource library to a resident; mapping a resource collection process in the resource library to revenue, and distributing the resource in the resource library Map to the distribution of income.
  • a Gini coefficient is selected as the target economic parameter.
  • the Gini parameter is used in the field of economics to specifically measure the fairness of income distribution.
  • the N resource sites included in the resource library may be sorted according to the resource collection amount from small to large, and one resource site is regarded as an independent group, and is divided into N groups.
  • the value of N is consistent with the total number of resource sites included in the resource library.
  • the distribution and the proportions corresponding to the respective resource sites are cumulatively summed to obtain a first intermediate amount.
  • each group of resource sites is each resource site.
  • the distribution inclusion ratio is a product of the proportion of the resource distribution amount of one target resource site to the total resource distribution amount of all resource sites and the proportion of the resource collection number of the target resource site to the total number of resource collections of all resource sites.
  • Y i is the proportion of the resource distribution amount of the i-th resource site to the total resource distribution amount of all resource sites; P i is the proportion of the resource collection number of the i-th resource site to the total number of resource collections of all resource sites.
  • the cumulative distribution inclusion weights corresponding to the respective resource sites are cumulatively summed to obtain a second intermediate amount.
  • the cumulative distribution inclusion ratio is the product of the total number of resource collections accumulated to one target resource site in the total number of resource sites included in the total resource site and the total number of resource collections of the target resource site in the total number of resource collections of all resource sites. .
  • a second intermediate amount A2 is calculated.
  • the embodiment of the present invention only provides a calculation method for the corresponding resource balance parameter for a calculation method of the Gini coefficient.
  • a calculation method for the corresponding resource balance parameter for a calculation method of the Gini coefficient.
  • Other calculation formulas based on the Gini coefficient can also be used.
  • the method for calculating the resource balance parameter is not limited in this embodiment.
  • the technical solution of this embodiment adopts the resource sites included in the resource library according to the resource collection amount. Sorting from small to large; according to the mapping relationship between the resource collection and distribution process of the pre-established resource library and economic activities, after the variant calculation of the Gini coefficient calculation formula, based on the modified formula, Calculating the resource balance parameter of the resource library, creatively gives a new method for effectively measuring the balance of the collection and distribution of resources in the resource library, so that the user can quantitatively perceive the resource balance parameter according to the calculation. Whether the collection and distribution of the resources in the resource pool are balanced, and further, according to the calculation result of the resource balance parameter, the resource capture strategy for the resource library is adaptively adjusted.
  • FIG. 3 is a flowchart of a method for determining resource balance according to Embodiment 3 of the present invention.
  • the embodiment is embodied based on the foregoing embodiment.
  • the resource collection amount of the statistical resource pool for each resource site, and the resource distribution amount of the resource library for each resource site specifically: in the set time interval, Monitoring the resource library to obtain resource collection increments of each resource site in the resource library; and deduplicating the resource content corresponding to the resource collection increment of each resource site by using the resource site;
  • the result is used as the resource collection amount of the resource library for each resource site; in the set time interval, the online log is parsed, and the resource distribution amount of the resource library for each resource site is obtained;
  • the method further includes: according to the resource balance The calculation result of the parameter adjusts the resource capture policy for the resource library.
  • the method of this embodiment includes:
  • the resources that are repeatedly included in the same resource site may be included for various reasons, for example, crawled through a web crawler.
  • the resource 1 in the resource site 1 acquires the self-reported resource of the resource site 1 Source 1, therefore, when the statistics resource is incremented, the resource is repeatedly recorded twice. Therefore, the resource content corresponding to the resource collection increment of the resource site 1 needs to be de-duplicated first, so as to ensure subsequent calculation.
  • the de-duplicated result is used as the resource collection amount of each resource site of the resource library.
  • the online log may be a log corresponding to the search result of the search engine product based on the search result of the search by the user.
  • the target economic parameter is used to measure the fairness of economic allocation
  • the resource balance parameter is used to measure the balance of resource collection and distribution of the resource library.
  • the resource capture policy of the resource pool may be correspondingly adjusted according to the economic meaning of the corresponding target economic parameter.
  • adjusting the resource capture policy for the resource pool according to the calculation result of the resource balance parameter may include:
  • the resource capture policy of the abnormal resource site is adaptively adjusted according to the difference type between the resource collection amount and the resource distribution amount of the abnormal resource site.
  • a balance threshold condition may be set to: 0.4-0.6. If the calculated resource balance parameter satisfies the balance threshold condition, it may be determined that the current resource capture strategy is reasonable, and the resource collection and distribution process is relatively balanced; If the calculated resource balance parameter does not satisfy the balance threshold condition, it may be determined that the current resource capture strategy is not reasonable, and thus the difference between the resource collection amount and the resource distribution amount may be exceeded by a set threshold (for example, Resource collection - resource distribution is greater than An abnormal resource site of 1000, or resource distribution amount - resource collection amount greater than 1000, etc.).
  • a set threshold for example, Resource collection - resource distribution is greater than An abnormal resource site of 1000, or resource distribution amount - resource collection amount greater than 1000, etc.
  • the resource of the abnormal resource site is captured. Take a policy to make adaptive adjustments (eg, increase or decrease the frequency of crawling the anomalous resource site, and/or crawl depth, etc.).
  • the technical solution of the embodiment of the present invention acquires resource collection increments of each resource site in the resource library by monitoring the resource pool in a set time interval; and collecting resources with each resource site by using a resource site as a unit
  • the weighted corresponding resource content is subjected to deduplication processing; the deduplicated result is used as the resource collection amount of the resource library for each resource site; in the set time interval, the online log is parsed, and the resource library is obtained
  • the technical means for the resource distribution amount of each resource site can further ensure the accuracy of the calculation result of the resource collection amount and the resource distribution amount, thereby improving the calculation accuracy of the subsequent resource balance parameter; meanwhile, by balancing according to the resource
  • the calculation result of the sexual parameter, adjusting the technical means for the resource capture strategy of the resource library can achieve the technical effect of gradually optimizing the resource capture strategy of the resource library, so that the resource collection and distribution process of the resource library More and more balanced.
  • FIG. 3b is a schematic diagram of a specific application scenario of the embodiment of the present invention. As shown in 3b, the method specifically includes the following process:
  • the calculated Gini coefficient trend has a certain guiding effect on the resource capture direction. Under this influence, the performance of resource construction and resource distribution can be gradually improved.
  • FIG. 4 is a schematic structural diagram of a device for determining resource balance according to Embodiment 4 of the present invention. As shown in FIG. 4, the device includes: a resource site information statistics module 410 and a resource balance parameter calculation module 420, where:
  • the resource site information statistics module 410 is configured to: in a set time interval, count the resource collection amount of the resource library for each resource site, and the resource distribution amount of the resource library for each resource site.
  • the resource balance parameter calculation module 420 is configured to apply a calculation method of the target economic parameter, and calculate the resource balance parameter of the resource library by using the resource collection amount and the resource distribution amount;
  • the target economic parameter is used to measure the fairness of economic allocation
  • the resource balance parameter is used to measure the balance of resource collection and distribution of the resource library.
  • the embodiment of the invention provides a device for determining the balance of resources, by using a calculation method of a target economic parameter for measuring the fairness of economic distribution, using the resource collection amount of the resource library for each resource site in a set time interval. And the resource distribution amount, the technical means for calculating the balanced resource balance parameter for measuring the resource collection and distribution of the resource library, and creatively giving an effective measure of the balance of the collection and distribution of resources in the resource library.
  • the new method enables the user to quantitatively perceive whether the collection and distribution of the resources in the resource pool are balanced according to the calculated resource balance parameter, and further, according to the calculation result of the resource balance parameter, the adaptive adjustment is performed for the Resource capture strategy for the repository.
  • mapping and parameter selection module may be further included to:
  • the target economics parameter calculation method Before applying the target economics parameter calculation method, using the resource collection amount and the resource distribution amount, before calculating the resource balance parameter of the resource library, pre-establishing the resource collection and distribution process and economics of the resource library A mapping relationship between activities, and selecting the target economic parameter according to the mapping relationship.
  • mapping and parameter selection module may be specifically configured to:
  • mapping relationship is established between the resource collection and distribution process of the resource library and economic activity activities:
  • the Gini coefficient is selected as the target economic parameter.
  • the resource balance parameter calculation module may be specifically configured to:
  • the distribution weights corresponding to the respective resource sites are cumulatively summed to obtain a first intermediate amount
  • the distribution inclusion ratio is a product of the proportion of the resource distribution amount of one target resource site to the total resource distribution amount of all resource sites and the proportion of the resource collection number of the target resource site to the total number of resource collections of all resource sites.
  • the cumulative distribution inclusion weights corresponding to the respective resource sites are cumulatively summed to obtain a second intermediate amount
  • the cumulative distribution inclusion ratio is the product of the total number of resource collections accumulated to one target resource site in the total number of resource sites included in the total resource site and the total number of resource collections of the target resource site in the total number of resource collections of all resource sites. ;
  • the resource balance parameter is calculated based on the first intermediate amount and the second intermediate amount.
  • the resource site information statistics module may be specifically configured to:
  • the deduplicated result is used as the resource collection amount of the resource library for each resource site;
  • the online log is parsed, and the resource distribution amount of the resource library for each resource site is acquired.
  • the method further includes: a capture policy adjustment module, configured to:
  • the capture policy adjustment module may be specifically configured to:
  • the resource capture policy of the abnormal resource site is adaptively adjusted according to the difference type between the resource collection amount and the resource distribution amount of the abnormal resource site.
  • the foregoing resource balance determining apparatus may perform the method for determining resource balance provided by any embodiment of the present invention, and has a corresponding functional module and a beneficial effect of the method for determining resource balance performed.
  • FIG. 5 is a schematic structural diagram of a computer device according to Embodiment 5 of the present invention.
  • FIG. 5 illustrates a block diagram of an exemplary computer device 12 suitable for use in implementing embodiments of the present invention.
  • the computer device 12 shown in FIG. 5 is merely an example and should not impose any limitation on the function and scope of use of the embodiments of the present invention.
  • computer device 12 is embodied in the form of a general purpose computing device.
  • Components of computer device 12 may include, but are not limited to, one or more processors or processing units 16, system memory 28, and bus 18 that connects different system components, including system memory 28 and processing unit 16.
  • Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of a variety of bus structures.
  • these architectures include, but are not limited to, an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MAC) bus, an Enhanced ISA Bus, a Video Electronics Standards Association (VESA) local bus, and peripheral component interconnects ( PCI) bus.
  • ISA Industry Standard Architecture
  • MAC Micro Channel Architecture
  • VESA Video Electronics Standards Association
  • PCI peripheral component interconnects
  • Computer device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by computer device 12, including both volatile and nonvolatile media, removable and non-removable media.
  • System memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and/or cache memory 32.
  • Computer device 12 may further include other removable/non-removable, volatile/non-volatile computer system storage media.
  • storage system 34 may be used to read and write non-removable, non-volatile magnetic media (not shown in Figure 5, Often referred to as the "hard disk drive”).
  • a disk drive for reading and writing to a removable non-volatile disk such as a "floppy disk”
  • a removable non-volatile disk such as a CD-ROM, DVD-ROM
  • each drive can be coupled to bus 18 via one or more data medium interfaces.
  • Memory 28 can include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of various embodiments of the present invention.
  • a program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28, such program modules 42 including, but not limited to, an operating system, one or more applications, other programs Modules and program data, each of these examples or some combination may include an implementation of a network environment.
  • Program module 42 typically performs the functions and/or methods of the described embodiments of the present invention.
  • Computer device 12 may also be in communication with one or more external devices 14 (eg, a keyboard, pointing device, display 24, etc.), and may also be in communication with one or more devices that enable a user to interact with the computer device 12, and/or Any device (eg, a network card, modem, etc.) that enables the computer device 12 to communicate with one or more other computing devices. This communication can take place via an input/output (I/O) interface 22. Also, computer device 12 can communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and/or a public network, such as the Internet) via network adapter 20. As shown, network adapter 20 communicates with other modules of computer device 12 via bus 18.
  • external devices 14 eg, a keyboard, pointing device, display 24, etc.
  • Any device eg, a network card, modem, etc.
  • network adapter 20 communicates with other modules of computer device 12 via bus 18.
  • the processing unit 16 performs various function applications and data processing by running a program stored in the system memory 28, for example, a method for determining resource balance provided by the embodiments of the present invention.
  • the resource collection amount of the statistical resource library for each resource site and the resource distribution amount of the resource library for each resource site are set in the set time interval; a method for calculating a parameter, using the resource amount and the resource distribution amount, to calculate a resource balance parameter of the resource library; wherein the target economic parameter is used to measure a fairness of economic allocation, the resource The balance parameter is used to measure the resource collection of the resource pool The balance of recording and distribution.
  • the method further includes:
  • mapping relationship between the resource collection and distribution process of the resource library and the economic activity is established in advance, and the target economic parameter is selected according to the mapping relationship, which may include:
  • mapping relationship is established between the resource collection and distribution process of the resource library and economic activity activities:
  • mapping the resource library to an overall society mapping a resource site included in the resource library to a resident; mapping a resource collection process in the resource library to revenue, and mapping a resource distribution process in the resource library to Distribution of income;
  • the Gini coefficient is selected as the target economic parameter.
  • the calculating the resource balance parameter by using the resource collection amount and the resource distribution amount may include:
  • the distribution weights corresponding to the respective resource sites are cumulatively summed to obtain a first intermediate amount
  • the distribution inclusion ratio is a product of the proportion of the resource distribution amount of one target resource site to the total resource distribution amount of all resource sites and the proportion of the resource collection number of the target resource site to the total number of resource collections of all resource sites.
  • the cumulative distribution inclusion weights corresponding to the respective resource sites are cumulatively summed to obtain a second intermediate amount
  • the cumulative distribution inclusion ratio is the product of the total number of resource collections accumulated to one target resource site in the total number of resource sites included in the total resource site and the total number of resource collections of the target resource site in the total number of resource collections of all resource sites. ;
  • the resource balance parameter is calculated based on the first intermediate amount and the second intermediate amount.
  • the resource collection amount of the statistical resource pool for each resource site, and the resource distribution amount of the resource library for each resource site may include:
  • the deduplicated result is used as the resource collection amount of the resource library for each resource site;
  • the online log is parsed, and the resource distribution amount of the resource library for each resource site is acquired.
  • the method further includes:
  • adjusting the resource capture policy for the resource pool according to the calculation result of the resource balance parameter may include:
  • the resource capture policy of the abnormal resource site is adaptively adjusted according to the difference type between the resource collection amount and the resource distribution amount of the abnormal resource site.
  • the sixth embodiment of the present invention provides a computer readable storage medium, on which a computer program is stored, and when the program is executed by the processor, the method for determining resource balance according to the embodiments of the present invention is implemented:
  • the resource collection amount of the statistical resource library for each resource site, and the resource distribution amount of the resource library for each resource site in the set time interval applying the target economic parameter a method for calculating a resource balance parameter of the resource pool using the resource inventory amount and the resource distribution amount; wherein the target economic parameter is used to measure an economy
  • the target economic parameter is used to measure an economy
  • the degree of fairness of the allocation, the resource balance parameter is used to measure the balance of resource collection and distribution of the resource library.
  • the resource balance parameter of the resource library can be calculated.
  • mapping relationship between the resource collection and distribution process of the resource library and the economic activity is pre-established, and the target economic parameter is selected according to the mapping relationship, and the following:
  • mapping relationship is established between the resource collection and distribution process of the resource library and economic activity activities:
  • mapping the resource library to an overall society mapping a resource site included in the resource library to a resident; mapping a resource collection process in the resource library to revenue, and mapping a resource distribution process in the resource library to Distribution of income;
  • the Gini coefficient is selected as the target economic parameter.
  • the distribution weights corresponding to the respective resource sites are cumulatively summed to obtain a first intermediate amount
  • the distribution inclusion ratio is a product of the proportion of the resource distribution amount of one target resource site to the total resource distribution amount of all resource sites and the proportion of the resource collection number of the target resource site to the total number of resource collections of all resource sites.
  • the cumulative distribution inclusion weights corresponding to the respective resource sites are cumulatively summed to obtain a second intermediate amount
  • the cumulative distribution inclusion ratio is the total number of resource collections accumulated to one target resource site.
  • the resource balance parameter is calculated based on the first intermediate amount and the second intermediate amount.
  • the resource collection amount of the statistical resource pool for each resource site, and the resource distribution amount of the resource library for each resource site may be implemented as:
  • the deduplicated result is used as the resource collection amount of the resource library for each resource site;
  • the online log is parsed, and the resource distribution amount of the resource library for each resource site is acquired.
  • the resource balance parameter of the resource library is calculated, and then:
  • adjusting the resource capture policy for the resource library according to the calculation result of the resource balance parameter may be implemented as:
  • the resource capture policy of the abnormal resource site is adaptively adjusted according to the difference type between the resource collection amount and the resource distribution amount of the abnormal resource site.
  • the computer readable medium can be a computer readable signal medium or a computer readable storage medium.
  • the computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of computer readable storage media (non-exhaustive List) includes: electrical connections with one or more wires, portable computer disk, hard disk, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash), fiber Portable compact disk read only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the foregoing.
  • a computer readable storage medium can be any tangible medium that can contain or store a program, which can be used by or in connection with an instruction execution system, apparatus or device.
  • a computer readable signal medium may include a data signal that is propagated in the baseband or as part of a carrier, carrying computer readable program code. Such propagated data signals can take a variety of forms including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the foregoing.
  • the computer readable signal medium can also be any computer readable medium other than a computer readable storage medium, which can transmit, propagate, or transport a program for use by or in connection with the instruction execution system, apparatus, or device. .
  • Program code embodied on a computer readable medium can be transmitted by any suitable medium, including but not limited to wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
  • Computer program code for performing the operations of the present invention may be written in one or more programming languages, or a combination thereof, including an object oriented programming language - such as Java, Smalltalk, C++, and also conventional. Procedural programming language - such as the "C" language or a similar programming language.
  • the program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer, partly on the remote computer, or entirely on the remote computer or server.
  • the remote computer can be connected to the user's computer via any kind of network, including a local area network (LAN) or wide area network (WAN), or can be connected to an external computer (eg, using an Internet service provider) Internet connection).
  • LAN local area network
  • WAN wide area network
  • Internet service provider Internet service provider
  • the present invention can be implemented by software and necessary hardware, and of course can also be implemented by hardware, but in many cases, the former is a better implementation.
  • the technical solution of the present invention which is essential or contributes to the prior art, can be embodied in the form of a software product.
  • the software product may be stored in a computer readable storage medium, such as a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM), and includes a plurality of instructions for making
  • a computer device which may be a personal computer, server, or network device, etc. performs the methods described in various embodiments of the present invention.
  • the units and modules included in the foregoing are only divided according to functional logic, but are not limited to the foregoing division, as long as the corresponding functions can be implemented;
  • the specific names of the respective functional units are only for the purpose of facilitating mutual differentiation, and are not intended to limit the scope of the present invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Debugging And Monitoring (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

本发明实施例公开了一种资源平衡性的确定方法、装置、设备及存储介质。所述方法包括：在设定时间区间内，统计资源库针对各个资源站点的资源收录量，以及所述资源库针对各个资源站点的资源分发量；应用目标经济学参数的计算方法，使用所述资源收录量以及所述资源分发量，计算所述资源库的资源平衡性参数。本发明实施例的方案创造性的给出了一种有效衡量资源库中资源的收录与分发平衡性的方法，使用户可以根据资源平衡性参数，量化的感知出资源库中资源的收录与分发是否平衡，并可以根据该资源平衡性参数的计算结果，适应性的调整针对所述资源库的资源抓取策略。

Description

资源平衡性的确定方法、装置、设备以及存储介质
本专利申请要求于2017年04月13日提交的，申请号为201710240516.7，申请人为百度在线网络技术(北京)有限公司，发明名称为“资源平衡性的确定方法、装置、设备以及存储介质”的中国专利申请的优先权，该申请的全文以引用的方式并入本申请中。
技术领域
本发明实施例涉及信息处理技术领域，尤其涉及一种资源平衡性的确定方法、装置、设备以及存储介质。
背景技术
搜索引擎(Search Engine)是指根据一定的策略、运用特定的计算机程序从互联网上搜集信息，在对信息进行组织和处理后，为用户提供检索服务，并将用户检索相关的信息展示给用户的系统，其已经成为广大用户获取网络信息的一项不可或缺的方式。
搜索资源是搜索引擎类产品的基石，一条资源(典型的，一个资源站点中更新的一个网页)从产生到展现给搜索用户要经历资源抓取、入库(也即将资源收录于资源库中)、召回(也即资源的分发)、排序、展现等一系列过程。其中资源的抓取、入库是召回的基础；请求召回的资源数量的多少是对资源抓取、入库质量优良的有效指标，也是影响用户体验的主要因素。在现有技术中，没有对资源库中资源的收录与分发的平衡性进行衡量的方法。
发明内容
本发明实施例提供了一种资源平衡性的确定方法、装置、设备以及存储介质，以有效衡量资源库中资源的收录与分发的平衡性。
第一方面，本发明实施例提供了一种资源平衡性的确定方法，包括：
在设定时间区间内，统计资源库针对各个资源站点的资源收录量，以及所述资源库针对各个资源站点的资源分发量；
应用目标经济学参数的计算方法，使用所述资源收录量以及所述资源分发量，计算所述资源库的资源平衡性参数；
其中，所述目标经济学参数用于衡量经济分配的公平程度，所述资源平衡性参数用于衡量所述资源库的资源收录及分发的平衡性。
第二方面，本发明实施例还提供了一种资源平衡性的确定装置，包括：
资源站点信息统计模块，用于在设定时间区间内，统计资源库针对各个资源站点的资源收录量，以及所述资源库针对各个资源站点的资源分发量；
资源平衡性参数计算模块，用于应用目标经济学参数的计算方法，使用所述资源收录量以及所述资源分发量，计算所述资源库的资源平衡性参数；
其中，所述目标经济学参数用于衡量经济分配的公平程度，所述资源平衡性参数用于衡量所述资源库的资源收录及分发的平衡性。
第三方面，本发明实施例还提供了一种计算机设备，包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序所述处理器执行所述程序时实现如本发明实施例中任一所述的资源平衡性的确定方法。
第四方面，本发明实施例还提供了一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现如本发明实施例中任一所述的资源平衡性的确定方法。
本发明实施例提供了一种资源平衡性的确定方法、装置、设备以及存储介质，通过应用衡量经济分配的公平程度的目标经济学参数的计算方法，使用设定时间区间内资源库针对各个资源站点的资源收录量以及资源分发量，计算用于衡量所述资源库的资源收录及分发的平衡性的资源平衡性参数的技术手段，创造性的给出了一种有效衡量资源库中资源的收录与分发平衡性的新方法，使得用户可以根据计算得到的资源平衡性参数，量化的感知出资源库中资源的收录与分发是否平衡，并进而可以根据该资源平衡性参数的计算结果，适应性的调整针对所述资源库的资源抓取策略。
附图说明
图1是本发明实施例一中的一种资源平衡性的确定方法的流程图；
图2是本发明实施例二中的一种资源平衡性的确定方法的流程图；
图3a是本发明实施例三中的一种资源平衡性的确定方法的流程图；
图3b是本发明实施例的一种具体应用场景的示意图；
图4是本发明实施例四中的一种资源平衡性的确定装置的结构图；
图5是本发明实施例五中的一种计算机设备的结构示意图。
具体实施方式
下面结合附图和实施例对本发明作进一步的详细说明。可以理解的是，此处所描述的具体实施例仅仅用于解释本发明，而非对本发明的限定。另外还需要说明的是，为了便于描述，附图中仅示出了与本发明相关的部分而非全部结构。
另外还需要说明的是，为了便于描述，附图中仅示出了与本发明相关的部分而非全部内容。在更加详细地讨论示例性实施例之前应当提到的是，一些示例性实施例被描述成作为流程图描绘的处理或方法。虽然流程图将各项操作(或步骤)描述成顺序的处理，但是其中的许多操作可以被并行地、并发地或者同时实施。此外，各项操作的顺序可以被重新安排。当其操作完成时所述处理可以被终止，但是还可以具有未包括在附图中的附加步骤。所述处理可以对应于方法、函数、规程、子例程、子程序等等。
实施例一
图1为本发明实施例一提供的一种资源平衡性的确定方法的流程图，本实施例可适用于对搜索引擎产品资源库的资源收录与资源分发的平衡性进行衡量的情况，该方法可以由本发明实施例提供的资源平衡性的确定装置来执行，该装置可采用软件和/或硬件的方式实现，并一般可集成在搜索引擎产品的服务器中。如图1所示，本实施例的方法具体包括：
110、在设定时间区间内，统计资源库针对各个资源站点的资源收录量，以及所述资源库针对各个资源站点的资源分发量。
在本实施例中，所述资源库具体是指由网络爬虫抓取的，或者由网站自主上报的网页资源构成的，用于进行数据搜索的搜索引擎数据库。其中，所述资源库中包括的资源可以为文本形式的资源、图片形式的资源以及多媒体形式的资源，本实施例对此并不进行限制。
所述设定时间区间可以以设定时间单元(例如，小时、天、一周或者一个月等)为单位进行划分。
所述资源库针对各个资源站点的资源收录量，具体是指所述资源库在该设定时间区间内，对不同资源站点的网页资源的资源收录增量；所述资源库针对各个资源站点的资源分发量，具体是指在该设定时间区间内，搜索引擎产品的召回结果中(针对用户的搜索式返回的搜索结果)，与不同资源站点对应的资源数量。
例如：2017.4.10，资源库针对资源站点1(www.baidu.com)共新收录了60个资源，搜索引擎产品共召回了资源库中资源站点1的30个资源，则在2017.4.10这一天，该资源库针对该资源站点1的资源收录量为60，该资源库针对该资源站点1的资源分发量为30。
120、应用目标经济学参数的计算方法，使用所述资源收录量以及所述资源分发量，计算所述资源库的资源平衡性参数。
其中，所述目标经济学参数用于衡量经济分配的公平程度，所述资源平衡性参数用于衡量所述资源库的资源收录及分发的平衡性。
在本实施例中，发明人通过创造性的劳动发现：在经济学领域中的经济(或者说收入)的分配与资源库中资源的收录及分发具有一定的相似性。因此，可以将设定经济学参数应用于资源的收录及分发领域用于计算资源平衡性参数。
相应的，在本实施例的一个可选的实施方式中，在应用目标经济学参数的计算方法，使用所述资源收录量以及所述资源分发量，计算所述资源库的资源平衡性参数之前，还可以包括：
预先建立所述资源库的资源收录及分发过程与经济学活动之间的映射关 系，并根据所述映射关系，选取所述目标经济学参数。
可选的，可以将所述资源库的资源收录及分发过程与经济学活动之间建立如下映射关系：
将所述资源库映射为整体社会，将所述资源库中包括的资源站点映射为居民；将所述资源库中的资源收录过程映射为收入，将所述资源库中的资源分发过程映射为收入的分配；根据建立的所述映射关系，选取基尼系数作为所述目标经济学参数。
其中，经济学经典指标“基尼系数”的含义是指，在全部居民收入中，用于进行不平均分配的那部分收入所占的比例。基尼系数最大为“1”，最小等于“0”。前者表示居民之间的收入分配绝对不平均，即100％的收入被一个单位的人全部占有了；而后者则表示居民之间的收入分配绝对平均，即人与人之间收入完全平等，没有任何差异。但这两种情况只是在理论上的绝对化形式，在实际生活中一般不会出现。因此，基尼系数的实际数值只能介于0～1之间，基尼系数越小收入分配越平均，基尼系数越大收入分配越不平均。
宏观上，社会全部居民的收入、分配与资源库中站点资源的抓取入库、分发具有很大程度的相似性：
1.资源库作为资源的容器，可看做基尼系数中的整体社会；
2.资源站点作为资源的来源，可看做基尼系数中的居民；
3.入库资源作为资源库的内容来源，可看做基尼系数中的收入；
4.资源分发作为资源库的向外出口，可看做基尼系数中的分配；
因此，映射到资源层面的基尼系数就可以用来检验资源库中资源的收录及分发是否平等，基尼系数的范围处于0～1之间，基尼系数越小表示资源的收录与分发越平衡，即针对一个资源站点，收录的资源越多，分发的资源越多。
当然，本领域技术人员可以理解的是，鉴于上述映射关系，还可以选取其他类型的经济学参数计算所述资源库的资源平衡性参数，例如：洛伦兹曲线，库兹涅茨曲线，以及泰尔系数等参数，本实施例对此并不进行限制。
本发明实施例提供了一种资源平衡性的确定方法，通过使用用于衡量经济分配的公平程度的目标经济学参数的计算方法，使用设定时间区间内资源库针 对各个资源站点的资源收录量以及资源分发量，计算用于衡量所述资源库的资源收录及分发的平衡性的资源平衡性参数的技术手段，创造性的给出了一种有效衡量资源库中资源的收录与分发平衡性的新方法，使得用户可以根据计算得到的资源平衡性参数，量化的感知出资源库中资源的收录与分发是否平衡，并进而可以根据该资源平衡性参数的计算结果，适应性的调整针对所述资源库的资源抓取策略。
实施例二
图2为本发明实施例二提供的一种资源平衡性的确定方法的流程图，本实施例以上述实施例为基础进行具体化，在本实施例中，将应用目标经济学参数的计算方法，使用所述资源收录量以及所述资源分发量，计算所述资源库的资源平衡性参数，具体为：将所述资源库中包括的资源站点按照资源收录量从小到大的顺序进行排序；按照排序结果，将与各组资源站点分别对应的分发收录比重进行累加求和，得到第一中间量；按照排序结果，将与各组资源站点分别对应的累积分发收录比重进行累加求和，得到第二中间量；根据所述第一中间量以及所述第二中间量，计算所述资源平衡性参数。
相应的，本发明实施例的方法包括：
210、在设定时间区间内，统计资源库针对各个资源站点的资源收录量，以及所述资源库针对各个资源站点的资源分发量。
220、将所述资源库映射为整体社会，将所述资源库中包括的资源站点映射为居民；将所述资源库中的资源收录过程映射为收入，将所述资源库中的资源分发过程映射为收入的分配。
230、根据所述映射关系，选取基尼系数作为所述目标经济学参数。
其中，所述基尼参数在经济学领域中，具体用于衡量收入分配的公平程度。
240、将所述资源库中包括的资源站点按照资源收录量从小到大的顺序进行排序。
典型的，可以将所述资源库中包括的N个资源站点按照资源收录量从小到大的顺序进行排序，并将一个资源站点作为一个独立组，共分为N组。
其中，N值与所述资源库中包括的资源站点的总数量相一致。
250、按照排序结果，将与各组资源站点分别对应的分发收录比重进行累加求和，得到第一中间量。
在本实施例中，由于将一个资源站点作为一个独立组，相应的，所述各组资源站点即为各个资源站点。
其中，所述分发收录比重为一个目标资源站点的资源分发量数占全部资源站点的资源分发总量的比重与所述目标资源站点的资源收录数占全部资源站点的资源收录总数的比重的乘积。
典型的，可以根据公式：
Figure PCTCN2017113773-appb-000001
计算得到第一中间量A1；
其中，Yi为第i个资源站点的资源分发量数占全部资源站点的资源分发总量的比重；Pi为第i个资源站点的资源收录数占全部资源站点的资源收录总数的比重。
260、按照排序结果，将与各组资源站点分别对应的累积分发收录比重进行累加求和，得到第二中间量。
其中，所述累积分发收录比重为累计到一个目标资源站点的资源收录总数占全部资源站点资源收录总数的比重与所述目标资源站点的资源收录数占全部资源站点的资源收录总数的比重的乘积。
典型的，可以根据公式
Figure PCTCN2017113773-appb-000002
计算得到第二中间量A2。
其中，
Figure PCTCN2017113773-appb-000003
为累计到第i个资源站点的资源收录总数占全部资源站点资源收录总数的比重。
270、根据所述第一中间量以及所述第二中间量，计算所述资源平衡性参数。
典型的，可以根据公式：
Figure PCTCN2017113773-appb-000004
计算所述资源库的资源平衡性参数G。
本发明实施例仅针对一种基尼系数的计算方法给出了相应的资源平衡性参数的计算方法，当然，本领域技术人员可以理解的是，还可以根据基尼系数的其他计算公式，适应性的调整该资源平衡性参数的计算方法，本实施例对此并不进行限制。
本实施例的技术方案通过将所述资源库中包括的资源站点按照资源收录量 从小到大的顺序进行排序；根据预先建立的资源库的资源收录及分发过程与经济学活动之间的映射关系，对基尼系数的计算公式进行一定的变型处理后，基于该变型后的公式，计算所述资源库的资源平衡性参数，创造性的给出了一种有效衡量资源库中资源的收录与分发平衡性的新方法，使得用户可以根据计算得到的资源平衡性参数，量化的感知出资源库中资源的收录与分发是否平衡，并进而可以根据该资源平衡性参数的计算结果，适应性的调整针对所述资源库的资源抓取策略。
实施例三
图3a为本发明实施例三提供的一种资源平衡性的确定方法的流程图，本实施例以上述实施例为基础进行具体化。在本实施例中，将在设定时间区间内，统计资源库针对各个资源站点的资源收录量，以及所述资源库针对各个资源站点的资源分发量，具体为：在设定时间区间内，监控所述资源库，获取所述资源库中各个资源站点的资源收录增量；以资源站点为单位，对与各资源站点的资源收录增量对应的资源内容进行去重处理；将去重后的结果作为所述资源库针对各个资源站点的资源收录量；在所述设定时间区间内，解析线上日志，获取所述资源库针对各个资源站点的资源分发量；
相应的，在应用所述目标经济学参数的计算方法，使用所述资源收录量以及所述资源分发量，计算所述资源库的资源平衡性参数之后，还具体包括：根据所述资源平衡性参数的计算结果，调整针对所述资源库的资源抓取策略。
相应的，本实施例的方法包括：
310、在设定时间区间内，监控所述资源库，获取所述资源库中各个资源站点的资源收录增量。
320、以资源站点为单位，对与各资源站点的资源收录增量对应的资源内容进行去重处理。
在本实施例中，考虑到最终获取的针对各个资源站点的资源收录增量中，可能由于各种原因，包括了与同一资源站点对应的，重复收录的资源，例如，通过网络爬虫抓取了资源站点1中的资源1，又获取了资源站点1自主上报的资 源1，因此，在统计资源收录增量时，重复记录了该资源1两次，因此需要首先对与该资源站点1的资源收录增量对应的资源内容进行去重处理，这样才能保证后续计算时使用的资源收录量的准确性。
330、将去重后的结果作为所述资源库针对各个资源站点的资源收录量。
340、在所述设定时间区间内，解析线上日志，获取所述资源库针对各个资源站点的资源分发量。
其中，所述线上日志，具体可以是与搜索引擎产品基于用户输入的搜索式召回的搜索结果对应的日志。通过解析记录有所述搜索结果的线上日志，可以进而统计所述设定时间区间内，各个资源站点的资源分发量。
350、应用目标经济学参数的计算方法，使用所述资源收录量以及所述资源分发量，计算所述资源库的资源平衡性参数。
其中，所述目标经济学参数用于衡量经济分配的公平程度，所述资源平衡性参数用于衡量所述资源库的资源收录及分发的平衡性。
360、根据所述资源平衡性参数的计算结果，调整针对所述资源库的资源抓取策略。
在本实施例中，在计算得到所述资源平衡性参数之后，可以根据对应的目标经济学参数的经济学含义，对应调整所述资源库的资源抓取策略。
在本实施例的一个可选的实施方式中，根据所述资源平衡性参数的计算结果，调整针对所述资源库的资源抓取策略可以包括：
如果所述资源平衡性参数的计算结果不满足平衡阈值条件，则获取资源收录量与资源分发量之间的差值超过设定门限的异常资源站点；
根据所述异常资源站点的资源收录量与资源分发量之间的差异类型，对所述异常资源站点的资源抓取策略进行适应性调整。
例如，可以设定一个平衡阈值条件为：0.4-0.6，如果计算得到的资源平衡性参数满足该平衡阈值条件，则可以确定当前的资源抓取策略比较合理，资源的收录及分发过程比较平衡；如果计算得到的资源平衡性参数不满足该平衡阈值条件，则可以确定当前的资源抓取策略不太合理，进而可以获取资源收录量与资源分发量之间的差值超过设定门限(例如，资源收录量-资源分发量大于 1000，或者资源分发量-资源收录量大于1000等)的异常资源站点。
相应的，根据所述异常资源站点的资源收录量与资源分发量之间的差异类型(资源收录量大于资源分发量，或者资源分发量大于资源收录量)，对所述异常资源站点的资源抓取策略进行适应性调整(例如：增大或者减小对所述异常资源站点的抓取频率，和/或抓取深度等)。
本发明实施例的技术方案通过在设定时间区间内，监控所述资源库，获取所述资源库中各个资源站点的资源收录增量；以资源站点为单位，对与各资源站点的资源收录增量对应的资源内容进行去重处理；将去重后的结果作为所述资源库针对各个资源站点的资源收录量；在所述设定时间区间内，解析线上日志，获取所述资源库针对各个资源站点的资源分发量的技术手段，可以进一步保证资源收录量与资源分发量的计算结果的准确性，进而提高了后续资源平衡性参数的计算准确性；同时，通过根据所述资源平衡性参数的计算结果，调整针对所述资源库的资源抓取策略的技术手段，可以达到逐步对资源库的资源抓取策略进行优化的技术效果，以使所述资源库的资源收录以及分发过程日趋平衡。
具体的，在图3b是本发明实施例的一种具体应用场景的示意图。如3b所示，所述方法具体包括下述流程：
1)监控资源库，获取天级站点(按天进行更新的站点)建库资源量(也即：资源收录量)变化详情；
2)解析线上日志，获取各站点资源天级分发详情；
3)将N个站点按建库资源数量从低到高排序，一个站点作为独立一组，分为N组；
4)采用基尼系数计算公式计算所述资源平衡性参数。
5)将4)中计算的基尼系数变化趋势与资源抓取入库、分发详情(天级)结合起来，引导资源抓取方向调整。
通过上述具体流程，使得计算得到的基尼系数趋势对资源抓取方向有一定的指导作用，在此影响下，可以逐渐改善资源的建库以及资源的分发等性能。
实施例四
图4为本发明实施例四提供的一种资源平衡性的确定装置的结构示意图，如图4所示，所述装置包括：资源站点信息统计模块410以及资源平衡性参数计算模块420，其中：
资源站点信息统计模块410，用于在设定时间区间内，统计资源库针对各个资源站点的资源收录量，以及所述资源库针对各个资源站点的资源分发量。
资源平衡性参数计算模块420，用于应用目标经济学参数的计算方法，使用所述资源收录量以及所述资源分发量，计算所述资源库的资源平衡性参数；
其中，所述目标经济学参数用于衡量经济分配的公平程度，所述资源平衡性参数用于衡量所述资源库的资源收录及分发的平衡性。
本发明实施例提供了一种资源平衡性的确定装置，通过使用用于衡量经济分配的公平程度的目标经济学参数的计算方法，使用设定时间区间内资源库针对各个资源站点的资源收录量以及资源分发量，计算用于衡量所述资源库的资源收录及分发的平衡性的资源平衡性参数的技术手段，创造性的给出了一种有效衡量资源库中资源的收录与分发平衡性的新方法，使得用户可以根据计算得到的资源平衡性参数，量化的感知出资源库中资源的收录与分发是否平衡，并进而可以根据该资源平衡性参数的计算结果，适应性的调整针对所述资源库的资源抓取策略。
在上述各实施例的基础上，还可以包括，映射及参数选取模块，用于：
在应用目标经济学参数的计算方法，使用所述资源收录量以及所述资源分发量，计算所述资源库的资源平衡性参数之前，预先建立所述资源库的资源收录及分发过程与经济学活动之间的映射关系，并根据所述映射关系，选取所述目标经济学参数。
在上述各实施例的基础上，所述映射及参数选取模块，具体可以用于：
将所述资源库的资源收录及分发过程与经济学活动之间建立如下映射关系：
将所述资源库映射为整体社会，将所述资源库中包括的资源站点映射为居民；将所述资源库中的资源收录过程映射为收入，将所述资源库中的资源分发 过程映射为收入的分配；
根据建立的所述映射关系，选取基尼系数作为所述目标经济学参数。
在上述各实施例的基础上，所述资源平衡性参数计算模块，具体可以用于：
将所述资源库中包括的资源站点按照资源收录量从小到大的顺序进行排序；
按照排序结果，将与各组资源站点分别对应的分发收录比重进行累加求和，得到第一中间量；
其中，所述分发收录比重为一个目标资源站点的资源分发量数占全部资源站点的资源分发总量的比重与所述目标资源站点的资源收录数占全部资源站点的资源收录总数的比重的乘积；
按照排序结果，将与各组资源站点分别对应的累积分发收录比重进行累加求和，得到第二中间量；
其中，所述累积分发收录比重为累计到一个目标资源站点的资源收录总数占全部资源站点资源收录总数的比重与所述目标资源站点的资源收录数占全部资源站点的资源收录总数的比重的乘积；
根据所述第一中间量以及所述第二中间量，计算所述资源平衡性参数。
在上述各实施例的基础上，所述资源站点信息统计模块，具体可以用于：
在设定时间区间内，监控所述资源库，获取所述资源库中各个资源站点的资源收录增量；
以资源站点为单位，对与各资源站点的资源收录增量对应的资源内容进行去重处理；
将去重后的结果作为所述资源库针对各个资源站点的资源收录量；
在所述设定时间区间内，解析线上日志，获取所述资源库针对各个资源站点的资源分发量。
在上述各实施例的基础上，还可以包括，抓取策略调整模块，用于：
在应用目标经济学参数的计算方法，使用所述资源收录量以及所述资源分发量，计算所述资源库的资源平衡性参数之后，根据所述资源平衡性参数的计算结果，调整针对所述资源库的资源抓取策略。
在上述各实施例的基础上，所述抓取策略调整模块，具体可以用于：
如果所述资源平衡性参数的计算结果不满足平衡阈值条件，则获取资源收录量与资源分发量之间的差值超过设定门限的异常资源站点；
根据所述异常资源站点的资源收录量与资源分发量之间的差异类型，对所述异常资源站点的资源抓取策略进行适应性调整。
上述资源平衡性的确定装置可执行本发明任意实施例所提供的资源平衡性的确定方法，具备执行的资源平衡性的确定方法相应的功能模块和有益效果。
实施例五
图5为本发明实施例五提供的一种计算机设备的结构示意图。图5示出了适于用来实现本发明实施方式的示例性计算机设备12的框图。图5显示的计算机设备12仅仅是一个示例，不应对本发明实施例的功能和使用范围带来任何限制。
如图5所示，计算机设备12以通用计算设备的形式表现。计算机设备12的组件可以包括但不限于：一个或者多个处理器或者处理单元16，系统存储器28，连接不同系统组件(包括系统存储器28和处理单元16)的总线18。
总线18表示几类总线结构中的一种或多种，包括存储器总线或者存储器控制器，外围总线，图形加速端口，处理器或者使用多种总线结构中的任意总线结构的局域总线。举例来说，这些体系结构包括但不限于工业标准体系结构(ISA)总线，微通道体系结构(MAC)总线，增强型ISA总线、视频电子标准协会(VESA)局域总线以及外围组件互连(PCI)总线。
计算机设备12典型地包括多种计算机系统可读介质。这些介质可以是任何能够被计算机设备12访问的可用介质，包括易失性和非易失性介质，可移动的和不可移动的介质。
系统存储器28可以包括易失性存储器形式的计算机系统可读介质，例如随机存取存储器(RAM)30和/或高速缓存存储器32。计算机设备12可以进一步包括其它可移动/不可移动的、易失性/非易失性计算机系统存储介质。仅作为举例，存储系统34可以用于读写不可移动的、非易失性磁介质(图5未显示， 通常称为“硬盘驱动器”)。尽管图5中未示出，可以提供用于对可移动非易失性磁盘(例如“软盘”)读写的磁盘驱动器，以及对可移动非易失性光盘(例如CD-ROM，DVD-ROM或者其它光介质)读写的光盘驱动器。在这些情况下，每个驱动器可以通过一个或者多个数据介质接口与总线18相连。存储器28可以包括至少一个程序产品，该程序产品具有一组(例如至少一个)程序模块，这些程序模块被配置以执行本发明各实施例的功能。
具有一组(至少一个)程序模块42的程序/实用工具40，可以存储在例如存储器28中，这样的程序模块42包括——但不限于——操作系统、一个或者多个应用程序、其它程序模块以及程序数据，这些示例中的每一个或某种组合中可能包括网络环境的实现。程序模块42通常执行本发明所描述的实施例中的功能和/或方法。
计算机设备12也可以与一个或多个外部设备14(例如键盘、指向设备、显示器24等)通信，还可与一个或者多个使得用户能与该计算机设备12交互的设备通信，和/或与使得该计算机设备12能与一个或多个其它计算设备进行通信的任何设备(例如网卡，调制解调器等等)通信。这种通信可以通过输入/输出(I/O)接口22进行。并且，计算机设备12还可以通过网络适配器20与一个或者多个网络(例如局域网(LAN)，广域网(WAN)和/或公共网络，例如因特网)通信。如图所示，网络适配器20通过总线18与计算机设备12的其它模块通信。应当明白，尽管图5中未示出，可以结合计算机设备12使用其它硬件和/或软件模块，包括但不限于：微代码、设备驱动器、冗余处理单元、外部磁盘驱动阵列、RAID系统、磁带驱动器以及数据备份存储系统等。
处理单元16通过运行存储在系统存储器28中的程序，从而执行各种功能应用以及数据处理，例如实现本发明实施例所提供的资源平衡性的确定方法。
也即，所述处理单元执行所述程序时实现：在设定时间区间内，统计资源库针对各个资源站点的资源收录量，以及所述资源库针对各个资源站点的资源分发量；应用目标经济学参数的计算方法，使用所述资源收录量以及所述资源分发量，计算所述资源库的资源平衡性参数；其中，所述目标经济学参数用于衡量经济分配的公平程度，所述资源平衡性参数用于衡量所述资源库的资源收 录及分发的平衡性。
进一步地，在应用目标经济学参数的计算方法，使用所述资源收录量以及所述资源分发量，计算所述资源库的资源平衡性参数之前，还可以包括：
预先建立所述资源库的资源收录及分发过程与经济学活动之间的映射关系，并根据所述映射关系，选取所述目标经济学参数。
进一步地，预先建立所述资源库的资源收录及分发过程与经济学活动之间的映射关系，并根据所述映射关系，选取所述目标经济学参数，可以包括：
将所述资源库的资源收录及分发过程与经济学活动之间建立如下映射关系：
将所述资源库映射为整体社会，将所述资源库中包括的资源站点映射为居民；将所述资源库中的资源收录过程映射为收入，将所述资源库中的资源分发过程映射为收入的分配；
根据建立的所述映射关系，选取基尼系数作为所述目标经济学参数。
进一步地，应用目标经济学参数的计算方法，使用所述资源收录量以及所述资源分发量，计算所述资源平衡性参数，可以包括：
将所述资源库中包括的资源站点按照资源收录量从小到大的顺序进行排序；
按照排序结果，将与各组资源站点分别对应的分发收录比重进行累加求和，得到第一中间量；
其中，所述分发收录比重为一个目标资源站点的资源分发量数占全部资源站点的资源分发总量的比重与所述目标资源站点的资源收录数占全部资源站点的资源收录总数的比重的乘积；
按照排序结果，将与各组资源站点分别对应的累积分发收录比重进行累加求和，得到第二中间量；
其中，所述累积分发收录比重为累计到一个目标资源站点的资源收录总数占全部资源站点资源收录总数的比重与所述目标资源站点的资源收录数占全部资源站点的资源收录总数的比重的乘积；
根据所述第一中间量以及所述第二中间量，计算所述资源平衡性参数。
进一步地，在设定时间区间内，统计资源库针对各个资源站点的资源收录量，以及所述资源库针对各个资源站点的资源分发量，可以包括：
在设定时间区间内，监控所述资源库，获取所述资源库中各个资源站点的资源收录增量；
以资源站点为单位，对与各资源站点的资源收录增量对应的资源内容进行去重处理；
将去重后的结果作为所述资源库针对各个资源站点的资源收录量；
在所述设定时间区间内，解析线上日志，获取所述资源库针对各个资源站点的资源分发量。
进一步地，在应用目标经济学参数的计算方法，使用所述资源收录量以及所述资源分发量，计算所述资源库的资源平衡性参数之后，还可以包括：
根据所述资源平衡性参数的计算结果，调整针对所述资源库的资源抓取策略。
进一步地，根据所述资源平衡性参数的计算结果，调整针对所述资源库的资源抓取策略，可以包括：
如果所述资源平衡性参数的计算结果不满足平衡阈值条件，则获取资源收录量与资源分发量之间的差值超过设定门限的异常资源站点；
根据所述异常资源站点的资源收录量与资源分发量之间的差异类型，对所述异常资源站点的资源抓取策略进行适应性调整。
实施例六
本发明实施例六提供了一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现如本发明所有发明实施例提供的资源平衡性的确定方法：
也即，该程序被处理器执行时实现：在设定时间区间内，统计资源库针对各个资源站点的资源收录量，以及所述资源库针对各个资源站点的资源分发量；应用目标经济学参数的计算方法，使用所述资源收录量以及所述资源分发量，计算所述资源库的资源平衡性参数；其中，所述目标经济学参数用于衡量经济 分配的公平程度，所述资源平衡性参数用于衡量所述资源库的资源收录及分发的平衡性。
该程序被处理器执行时，在应用目标经济学参数的计算方法，使用所述资源收录量以及所述资源分发量，计算所述资源库的资源平衡性参数之前，还可以实现：
预先建立所述资源库的资源收录及分发过程与经济学活动之间的映射关系，并根据所述映射关系，选取所述目标经济学参数。
该程序被处理器执行时，预先建立所述资源库的资源收录及分发过程与经济学活动之间的映射关系，并根据所述映射关系，选取所述目标经济学参数，还可以实现：
将所述资源库的资源收录及分发过程与经济学活动之间建立如下映射关系：
将所述资源库映射为整体社会，将所述资源库中包括的资源站点映射为居民；将所述资源库中的资源收录过程映射为收入，将所述资源库中的资源分发过程映射为收入的分配；
根据建立的所述映射关系，选取基尼系数作为所述目标经济学参数。
该程序被处理器执行时，应用目标经济学参数的计算方法，使用所述资源收录量以及所述资源分发量，计算所述资源平衡性参数，可以实现为：
将所述资源库中包括的资源站点按照资源收录量从小到大的顺序进行排序；
按照排序结果，将与各组资源站点分别对应的分发收录比重进行累加求和，得到第一中间量；
其中，所述分发收录比重为一个目标资源站点的资源分发量数占全部资源站点的资源分发总量的比重与所述目标资源站点的资源收录数占全部资源站点的资源收录总数的比重的乘积；
按照排序结果，将与各组资源站点分别对应的累积分发收录比重进行累加求和，得到第二中间量；
其中，所述累积分发收录比重为累计到一个目标资源站点的资源收录总数 占全部资源站点资源收录总数的比重与所述目标资源站点的资源收录数占全部资源站点的资源收录总数的比重的乘积；
根据所述第一中间量以及所述第二中间量，计算所述资源平衡性参数。
该程序被处理器执行时，在设定时间区间内，统计资源库针对各个资源站点的资源收录量，以及所述资源库针对各个资源站点的资源分发量，可以实现为：
在设定时间区间内，监控所述资源库，获取所述资源库中各个资源站点的资源收录增量；
以资源站点为单位，对与各资源站点的资源收录增量对应的资源内容进行去重处理；
将去重后的结果作为所述资源库针对各个资源站点的资源收录量；
在所述设定时间区间内，解析线上日志，获取所述资源库针对各个资源站点的资源分发量。
该程序被处理器执行时，在应用目标经济学参数的计算方法，使用所述资源收录量以及所述资源分发量，计算所述资源库的资源平衡性参数之后，还可以实现：
根据所述资源平衡性参数的计算结果，调整针对所述资源库的资源抓取策略。
该程序被处理器执行时，根据所述资源平衡性参数的计算结果，调整针对所述资源库的资源抓取策略，可以实现为：
如果所述资源平衡性参数的计算结果不满足平衡阈值条件，则获取资源收录量与资源分发量之间的差值超过设定门限的异常资源站点；
根据所述异常资源站点的资源收录量与资源分发量之间的差异类型，对所述异常资源站点的资源抓取策略进行适应性调整。
可以采用一个或多个计算机可读的介质的任意组合。计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件，或者任意以上的组合。计算机可读存储介质的更具体的例子(非穷举的 列表)包括：具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本文件中，计算机可读存储介质可以是任何包含或存储程序的有形介质，该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。
计算机可读的信号介质可以包括在基带中或者作为载波一部分传播的数据信号，其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式，包括——但不限于——电磁信号、光信号或上述的任意合适的组合。计算机可读的信号介质还可以是计算机可读存储介质以外的任何计算机可读介质，该计算机可读介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。
计算机可读介质上包含的程序代码可以用任何适当的介质传输，包括——但不限于——无线、电线、光缆、RF等等，或者上述的任意合适的组合。
可以以一种或多种程序设计语言或其组合来编写用于执行本发明操作的计算机程序代码，所述程序设计语言包括面向对象的程序设计语言-诸如Java、Smalltalk、C++，还包括常规的过程式程序设计语言-诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中，远程计算机可以通过任意种类的网络——包括局域网(LAN)或广域网(WAN)-连接到用户计算机，或者，可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。
通过以上关于实施方式的描述，所属领域的技术人员可以清楚地了解到，本发明可借助软件及必需的通过硬件来实现，当然也可以通过硬件实现，但很多情况下前者是更佳的实施方式，基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机 软件产品可以存储在计算机可读存储介质中，如磁盘、光盘、只读存储记忆体(Read-Only Memory，ROM)或随机存储记忆体(Random Access Memory，RAM)等，包括若干指令用以使得一台计算机设备(可以是个人计算机、服务器，或者网络设备等)执行本发明各个实施例所述的方法。
值得注意的是，上述资源平衡性的确定装置的实施例中，所包括的各个单元和模块只是按照功能逻辑进行划分的，但并不局限于上述的划分，只要能够实现相应的功能即可；另外，各功能单元的具体名称也只是为了便于相互区分，并不用于限定本发明的保护范围。
注意，上述仅为本发明的较佳实施例及所运用技术原理。本领域技术人员会理解，本发明不限于这里所述的特定实施例，对本领域技术人员来说能够进行各种明显的变化、重新调整和替代而不会脱离本发明的保护范围。因此，虽然通过以上实施例对本发明进行了较为详细的说明，但是本发明不仅仅限于以上实施例，在不脱离本发明构思的情况下，还可以包括更多其他等效实施例，而本发明的范围由所附的权利要求范围决定。

Claims (10)

  1. 一种资源平衡性的确定方法，其特征在于，包括：
    在设定时间区间内，统计资源库针对各个资源站点的资源收录量，以及所述资源库针对各个资源站点的资源分发量；
    应用目标经济学参数的计算方法，使用所述资源收录量以及所述资源分发量，计算所述资源库的资源平衡性参数；
    其中，所述目标经济学参数用于衡量经济分配的公平程度，所述资源平衡性参数用于衡量所述资源库的资源收录及分发的平衡性。
  2. 根据权利要求1所述的方法，其特征在于，在应用目标经济学参数的计算方法，使用所述资源收录量以及所述资源分发量，计算所述资源库的资源平衡性参数之前，还包括：
    预先建立所述资源库的资源收录及分发过程与经济学活动之间的映射关系，并根据所述映射关系，选取所述目标经济学参数。
  3. 根据权利要求2所述的方法，其特征在于，预先建立所述资源库的资源收录及分发过程与经济学活动之间的映射关系，并根据所述映射关系，选取所述目标经济学参数，包括：
    将所述资源库的资源收录及分发过程与经济学活动之间建立如下映射关系：
    将所述资源库映射为整体社会，将所述资源库中包括的资源站点映射为居民；将所述资源库中的资源收录过程映射为收入，将所述资源库中的资源分发过程映射为收入的分配；
    根据建立的所述映射关系，选取基尼系数作为所述目标经济学参数。
  4. 根据权利要求3所述的方法，其特征在于，应用目标经济学参数的计算方法，使用所述资源收录量以及所述资源分发量，计算所述资源平衡性参数，包括：
    将所述资源库中包括的资源站点按照资源收录量从小到大的顺序进行排序；
    按照排序结果，将与各组资源站点分别对应的分发收录比重进行累加求和，得到第一中间量；
    其中，所述分发收录比重为一个目标资源站点的资源分发量数占全部资源站点的资源分发总量的比重与所述目标资源站点的资源收录数占全部资源站点的资源收录总数的比重的乘积；
    按照排序结果，将与各组资源站点分别对应的累积分发收录比重进行累加求和，得到第二中间量；
    其中，所述累积分发收录比重为累计到一个目标资源站点的资源收录总数占全部资源站点资源收录总数的比重与所述目标资源站点的资源收录数占全部资源站点的资源收录总数的比重的乘积；
    根据所述第一中间量以及所述第二中间量，计算所述资源平衡性参数。
  5. 根据权利要求1-4任一项所述的方法，其特征在于，在设定时间区间内，统计资源库针对各个资源站点的资源收录量，以及所述资源库针对各个资源站点的资源分发量，包括：
    在设定时间区间内，监控所述资源库，获取所述资源库中各个资源站点的资源收录增量；
    以资源站点为单位，对与各资源站点的资源收录增量对应的资源内容进行去重处理；
    将去重后的结果作为所述资源库针对各个资源站点的资源收录量；
    在所述设定时间区间内，解析线上日志，获取所述资源库针对各个资源站点的资源分发量。
  6. 根据权利要求1-4任一项所述的方法，其特征在于，在应用目标经济学参数的计算方法，使用所述资源收录量以及所述资源分发量，计算所述资源库的资源平衡性参数之后，还包括：
    根据所述资源平衡性参数的计算结果，调整针对所述资源库的资源抓取策略。
  7. 根据权利要求6所述的方法，其特征在于，根据所述资源平衡性参数的计算结果，调整针对所述资源库的资源抓取策略，包括：
    如果所述资源平衡性参数的计算结果不满足平衡阈值条件，则获取资源收录量与资源分发量之间的差值超过设定门限的异常资源站点；
    根据所述异常资源站点的资源收录量与资源分发量之间的差异类型，对所述异常资源站点的资源抓取策略进行适应性调整。
  8. 一种资源平衡性的确定装置，其特征在于，包括：
    资源站点信息统计模块，用于在设定时间区间内，统计资源库针对各个资源站点的资源收录量，以及所述资源库针对各个资源站点的资源分发量；
    资源平衡性参数计算模块，用于应用目标经济学参数的计算方法，使用所述资源收录量以及所述资源分发量，计算所述资源库的资源平衡性参数；
    其中，所述目标经济学参数用于衡量经济分配的公平程度，所述资源平衡性参数用于衡量所述资源库的资源收录及分发的平衡性。
  9. 一种计算机设备，包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，其特征在于，所述处理器执行所述程序时实现如权利要求1-7中任一所述的方法。
  10. 一种计算机可读存储介质，其上存储有计算机程序，其特征在于，该程序被处理器执行时实现如权利要求1-7中任一所述的方法。
PCT/CN2017/113773 2017-04-13 2017-11-30 资源平衡性的确定方法、装置、设备以及存储介质 Ceased WO2018188352A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710240516.7A CN107066337A (zh) 2017-04-13 2017-04-13 资源平衡性的确定方法、装置、设备以及存储介质
CN201710240516.7 2017-04-13

Publications (1)

Publication Number Publication Date
WO2018188352A1 true WO2018188352A1 (zh) 2018-10-18

Family

ID=59600698

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/113773 Ceased WO2018188352A1 (zh) 2017-04-13 2017-11-30 资源平衡性的确定方法、装置、设备以及存储介质

Country Status (2)

Country Link
CN (1) CN107066337A (zh)
WO (1) WO2018188352A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107066337A (zh) * 2017-04-13 2017-08-18 百度在线网络技术（北京）有限公司 资源平衡性的确定方法、装置、设备以及存储介质
CN110119936A (zh) * 2019-04-30 2019-08-13 上海钒兆钛智能科技有限公司 一种用于确定数字资源项的平衡度的方法及系统

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090132336A1 (en) * 2007-11-20 2009-05-21 Yahoo! Inc. Online Advertiser Acquisition And Valuation
CN103646342A (zh) * 2013-12-18 2014-03-19 北京博雅立方科技有限公司 一种搜索引擎消费数据和回报数据的拼接方法和平台
CN103888976A (zh) * 2014-01-03 2014-06-25 东北大学 一种联合网络调度和路由的链路选择方法
CN105956247A (zh) * 2016-04-26 2016-09-21 大连理工大学 基于基尼系数的三公调度模型构建方法
CN107066337A (zh) * 2017-04-13 2017-08-18 百度在线网络技术（北京）有限公司 资源平衡性的确定方法、装置、设备以及存储介质

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090132336A1 (en) * 2007-11-20 2009-05-21 Yahoo! Inc. Online Advertiser Acquisition And Valuation
CN103646342A (zh) * 2013-12-18 2014-03-19 北京博雅立方科技有限公司 一种搜索引擎消费数据和回报数据的拼接方法和平台
CN103888976A (zh) * 2014-01-03 2014-06-25 东北大学 一种联合网络调度和路由的链路选择方法
CN105956247A (zh) * 2016-04-26 2016-09-21 大连理工大学 基于基尼系数的三公调度模型构建方法
CN107066337A (zh) * 2017-04-13 2017-08-18 百度在线网络技术（北京）有限公司 资源平衡性的确定方法、装置、设备以及存储介质

Also Published As

Publication number Publication date
CN107066337A (zh) 2017-08-18

Similar Documents

Publication Publication Date Title
US10552761B2 (en) Non-intrusive fine-grained power monitoring of datacenters
WO2021174944A1 (zh) 基于目标对象活跃度的消息推送方法及相关设备
CN104834731B (zh) 一种自媒体信息的推荐方法及装置
US9152691B2 (en) System and method for performing set operations with defined sketch accuracy distribution
WO2019174141A1 (zh) 调查问卷生成方法、服务器及计算机可读存储介质
AU2016328959A1 (en) Updating attribute data structures to indicate trends in attribute data provided to automated modeling systems
US10664481B2 (en) Computer system programmed to identify common subsequences in logs
WO2019062189A1 (zh) 电子装置、数据表归档处理的方法、系统及存储介质
CN108959004A (zh) 磁盘故障预测方法、装置、设备及计算机可读存储介质
CN106097043A (zh) 一种信用数据的处理方法及服务器
US11182386B2 (en) Offloading statistics collection
WO2020164272A1 (zh) 上网设备的识别方法、装置及存储介质、计算机设备
CN112163614A (zh) 一种主播分类方法、装置、电子设备及存储介质
CN114356928A (zh) 风险分析方法、装置、电子设备及存储介质
CN110599240A (zh) 应用的偏好值确定方法、装置和设备及存储介质
CN114155578B (zh) 人像聚类方法、装置、电子设备和存储介质
US20140365571A1 (en) Automatically Determining Veracity of Documents Posted in a Public Forum
CN115829371A (zh) 一种应用于政务领域的数据质量评估方法及相关装置
CN112070564B (zh) 广告拉取方法、装置、系统与电子设备
US20140344328A1 (en) Data collection and distribution management
CN108763253B (zh) 一种投资组合的大数据可视化系统与方法
CN107066337A (zh) 资源平衡性的确定方法、装置、设备以及存储介质
CN119046465A (zh) 日志分类方法、装置、设备、存储介质及计算机程序产品
US12547933B2 (en) Metrics-based on-demand anomaly detection
CN110689034B (zh) 一种分类器的优化方法及设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17905563

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 13.02.2020)

122 Ep: pct application non-entry in european phase

Ref document number: 17905563

Country of ref document: EP

Kind code of ref document: A1