CN113326418A

CN113326418A - Method and device for determining webpage information source and webpage quality

Info

Publication number: CN113326418A
Application number: CN202110736607.6A
Authority: CN
Inventors: 刘伟; 张博; 林赛群
Original assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Current assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Priority date: 2021-06-30
Filing date: 2021-06-30
Publication date: 2021-08-31

Abstract

The disclosure provides a method and a device for determining a webpage information source and webpage quality, relates to the technical field of internet, and particularly relates to intelligent search and intelligent recommendation technologies. The implementation scheme is as follows: determining a plurality of information sources corresponding to the webpage according to the address or the content of the webpage; and storing the identification of the webpage and the identification of each of the plurality of information sources in an associated manner. Based on the determined multiple information sources corresponding to the web page, the quality of the web page is further determined according to the respective qualities of the multiple information sources corresponding to the web page. By utilizing the scheme provided by the disclosure, a plurality of information sources corresponding to the webpage can be determined, so that the source of the webpage is comprehensively expressed; and the quality of the webpage can be evaluated from the perspective of an information source, and the accurate evaluation of the webpage quality is realized. And then, the webpage with higher quality can be presented to the user preferentially in the searching and recommending scenes, so that the quality of the information provided for the user is improved.

Description

Method and device for determining webpage information source and webpage quality

Technical Field

The present disclosure relates to the field of internet technologies, and in particular, to an intelligent search and intelligent recommendation technology, and in particular, to a method and an apparatus for determining a web page information source, a method and an apparatus for determining a web page quality, an electronic device, a computer-readable storage medium, and a computer program product.

Background

The internet is constantly generating large amounts of information. Information in the internet is presented to a user in the form of a web page, and accordingly, the user obtains information required by the user by browsing the web page. Generally, users desire high quality information from web pages, such as real, real-time, original information, and the like. Poor quality information, such as spurious, outdated, plagiarized information, etc., can greatly degrade the user experience.

The approaches described in this section are not necessarily approaches that have been previously conceived or pursued. Unless otherwise indicated, it should not be assumed that any of the approaches described in this section qualify as prior art merely by virtue of their inclusion in this section. Similarly, unless otherwise indicated, the problems mentioned in this section should not be considered as having been acknowledged in any prior art.

Disclosure of Invention

The present disclosure provides a method and apparatus for determining a source of web page information, a method and apparatus for determining a quality of a web page, an electronic device, a computer-readable storage medium, and a computer program product.

According to an aspect of the present disclosure, there is provided a method for determining a webpage information source, including: determining a plurality of information sources corresponding to the web page according to the address or the content of the web page; and storing the identification of the webpage and the identification of each of the plurality of information sources in an associated manner.

According to another aspect of the present disclosure, there is provided a method for determining web page quality, including: acquiring respective quality of a plurality of information sources corresponding to the webpage, wherein the plurality of information sources are determined according to the method for determining the webpage information sources; and determining the quality of the web page according to the respective qualities of the plurality of information sources.

According to another aspect of the present disclosure, there is provided an apparatus for determining a webpage information source, including: the information source determining module is configured to determine a plurality of information sources corresponding to the webpage according to the address or the content of the webpage; and the storage module is configured to store the identification of the webpage and the identification of each of the plurality of information sources in an associated manner.

According to another aspect of the present disclosure, there is provided an apparatus for determining web page quality, including: an obtaining module configured to obtain respective qualities of a plurality of information sources corresponding to a web page, the plurality of information sources being determined according to the method for determining a web page information source; and a quality determination module configured to determine a quality of the web page based on respective qualities of the plurality of information sources.

According to another aspect of the present disclosure, there is provided an electronic device including: at least one processor; and a memory communicatively coupled to the at least one processor. The memory stores instructions executable by the at least one processor to cause the at least one processor to perform the method for determining a source of web page information and/or the method for determining a quality of a web page.

According to another aspect of the present disclosure, a non-transitory computer-readable storage medium having computer instructions stored thereon is provided. The computer instructions are for causing a computer to perform the above-described method for determining an information source of a web page and/or the above-described method for determining a quality of a web page.

According to another aspect of the disclosure, a computer program product is provided, comprising a computer program. Which when executed by a processor implements the above-described method for determining an information source of a web page and/or the above-described method for determining a quality of a web page.

According to one or more embodiments of the disclosure, a plurality of information sources corresponding to the web page can be determined, and the source of the web page can be comprehensively expressed. In addition, the quality of the webpage can be evaluated from the perspective of an information source, and the accurate evaluation of the quality of the webpage is realized. And then, the webpage with higher quality can be presented to the user preferentially in the searching and recommending scene, so that the quality of the information provided for the user is improved, and intelligent searching and intelligent recommending are realized.

It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate exemplary embodiments of the embodiments and, together with the description, serve to explain the exemplary implementations of the embodiments. The illustrated embodiments are for purposes of illustration only and do not limit the scope of the claims. Throughout the drawings, identical reference numbers designate similar, but not necessarily identical, elements.

FIG. 1 illustrates a schematic diagram of an exemplary system in which various methods described herein may be implemented, according to an embodiment of the present disclosure;

FIG. 2 illustrates a flow diagram of a method for determining a source of web page information in accordance with an embodiment of the present disclosure;

FIG. 3 shows a schematic diagram of an exemplary information source in accordance with an embodiment of the present disclosure;

FIG. 4 illustrates a flow diagram of a method for determining web page quality in accordance with an embodiment of the present disclosure;

FIG. 5 is a block diagram illustrating an apparatus for determining a source of web page information according to an embodiment of the present disclosure;

FIG. 6 is a block diagram illustrating an apparatus for determining web page quality according to an embodiment of the present disclosure; and

FIG. 7 illustrates a block diagram of an exemplary electronic device that can be used to implement embodiments of the present disclosure.

Detailed Description

Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

In the present disclosure, unless otherwise specified, the use of the terms "first", "second", etc. to describe various elements is not intended to limit the positional relationship, the timing relationship, or the importance relationship of the elements, and such terms are used only to distinguish one element from another. In some examples, a first element and a second element may refer to the same instance of the element, and in some cases, based on the context, they may also refer to different instances.

The terminology used in the description of the various described examples in this disclosure is for the purpose of describing particular examples only and is not intended to be limiting. Unless the context clearly indicates otherwise, if the number of elements is not specifically limited, the elements may be one or more. Furthermore, the term "and/or" as used in this disclosure is intended to encompass any and all possible combinations of the listed items.

Embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

Fig. 1 illustrates a schematic diagram of an exemplary system 100 in which various methods and apparatus described herein may be implemented, according to an embodiment of the present disclosure. Referring to fig. 1, the system 100 includes one or

more client devices

101, 102, 103, 104, 105, and 106, a server 120, and one or more communication networks 110 coupling the one or more client devices to the server 120.

Client devices

101, 102, 103, 104, 105, and 106 may be configured to execute one or more applications.

In embodiments of the present disclosure, the server 120 may run one or more services or software applications that enable the performance of the methods for determining the source of web page information and/or the methods for determining the quality of web pages.

In some embodiments, the server 120 may also provide other services or software applications that may include non-virtual environments and virtual environments. In certain embodiments, these services may be provided as web-based services or cloud services, for example, provided to users of

client devices

101, 102, 103, 104, 105, and/or 106 under a software as a service (SaaS) model.

In the configuration shown in fig. 1, server 120 may include one or more components that implement the functions performed by server 120. These components may include software components, hardware components, or a combination thereof, which may be executed by one or more processors. A user operating a

client device

101, 102, 103, 104, 105, and/or 106 may, in turn, utilize one or more client applications to interact with the server 120 to take advantage of the services provided by these components. It should be understood that a variety of different system configurations are possible, which may differ from system 100. Accordingly, fig. 1 is one example of a system for implementing the various methods described herein and is not intended to be limiting.

A user may browse web pages using

client devices

101, 102, 103, 104, 105, and/or 106. The client device may provide an interface that enables a user of the client device to interact with the client device. The client device may also output information to the user via the interface. Although fig. 1 depicts only six client devices, those skilled in the art will appreciate that any number and type of client devices may be supported by the present disclosure.

Client devices

101, 102, 103, 104, 105, and/or 106 may include various types of computer devices, such as portable handheld devices, general purpose computers (such as personal computers and laptop computers), workstation computers, wearable devices, gaming systems, thin clients, various messaging devices, sensors or other sensing devices, and so forth. These computer devices may run various types and versions of software applications and operating systems, such as MICROSOFT Windows, APPLE iOS, UNIX-like operating systems, Linux, or Linux-like operating systems (e.g., GOOGLE Chrome OS); or include various Mobile operating systems such as MICROSOFT Windows Mobile OS, iOS, Windows Phone, Android. Portable handheld devices may include cellular telephones, smart phones, tablets, Personal Digital Assistants (PDAs), and the like. Wearable devices may include head mounted displays and other devices. The gaming system may include a variety of handheld gaming devices, internet-enabled gaming devices, and the like. The client device is capable of executing a variety of different applications, such as various Internet-related applications, communication applications (e.g., email applications), Short Message Service (SMS) applications, and may use a variety of communication protocols.

Network 110 may be any type of network known to those skilled in the art that may support data communications using any of a variety of available protocols, including but not limited to TCP/IP, SNA, IPX, etc. By way of example only, one or more networks 110 may be a Local Area Network (LAN), an ethernet-based network, a token ring, a Wide Area Network (WAN), the internet, a virtual network, a Virtual Private Network (VPN), an intranet, an extranet, a Public Switched Telephone Network (PSTN), an infrared network, a wireless network (e.g., bluetooth, Wi-Fi), and/or any combination of these and/or other networks.

The server 120 may include one or more general purpose computers, special purpose server computers (e.g., PC (personal computer) servers, UNIX servers, mid-end servers), blade servers, mainframe computers, server clusters, or any other suitable arrangement and/or combination. The server 120 may include one or more virtual machines running a virtual operating system, or other computing architecture involving virtualization (e.g., one or more flexible pools of logical storage that may be virtualized to maintain virtual storage for the server). In various embodiments, the server 120 may run one or more services or software applications that provide the functionality described below.

The computing units in server 120 may run one or more operating systems including any of the operating systems described above, as well as any commercially available server operating systems. The server 120 may also run any of a variety of additional server applications and/or middle tier applications, including HTTP servers, FTP servers, CGI servers, JAVA servers, database servers, and the like.

In some implementations, the server 120 may include one or more applications to analyze and consolidate data feeds and/or event updates received from users of the

client devices

101, 102, 103, 104, 105, and 106. Server 120 may also include one or more applications to display data feeds and/or real-time events via one or more display devices of

client devices

101, 102, 103, 104, 105, and 106.

In some embodiments, the server 120 may be a server of a distributed system, or a server incorporating a blockchain. The server 120 may also be a cloud server, or a smart cloud computing server or a smart cloud host with artificial intelligence technology. The cloud Server is a host product in a cloud computing service system, and is used for solving the defects of high management difficulty and weak service expansibility in the traditional physical host and Virtual Private Server (VPS) service.

The system 100 may also include one or more databases 130. In some embodiments, these databases may be used to store data and other information. For example, one or more of the databases 130 may be used to store information such as audio files and video files. The data store 130 may reside in various locations. For example, the data store used by the server 120 may be local to the server 120, or may be remote from the server 120 and may communicate with the server 120 via a network-based or dedicated connection. The data store 130 may be of different types. In certain embodiments, the data store used by the server 120 may be a database, such as a relational database. One or more of these databases may store, update, and retrieve data to and from the database in response to the command.

In some embodiments, one or more of the databases 130 may also be used by applications to store application data. The databases used by the application may be different types of databases, such as key-value stores, object stores, or regular stores supported by a file system.

The system 100 of fig. 1 may be configured and operated in various ways to enable application of the various methods and apparatus described in accordance with the present disclosure.

In the technical scheme of the disclosure, the acquisition, storage, application and the like of the personal information of the related user all accord with the regulations of related laws and regulations, and do not violate the good customs of the public order.

For purposes of the disclosed embodiments, in the example of fig. 1, client applications for browsing web pages, which may be, for example, browsers, or applications containing WebView web page view controls, etc., may be included in

client devices

101, 102, 103, 104, 105, and 106.

The server 120 may be a server corresponding to a client application for web browsing in a client device, corresponding to the client application. Included in server 120 may be a service program that may provide web browsing services to users based on web resources (including HTML files, pictures, audio, video, etc.) already stored in database 130. For example, a user may initiate a search request in a client application to search for web pages containing particular information (typically, the user may enter a search term in the client application to search for web pages containing the search term). Accordingly, server 120 performs a web page search in response to the search request, resulting in web pages containing specific information that the user desires to search, and returns these web pages to the client application for presentation to the user.

In some cases, a recommendation system is included in the service program, and the recommendation system can provide personalized recommendation service to the user, determine a webpage (i.e. recommended webpage) containing information that may be of interest to the user from the stored multiple webpages according to the relevant information (such as attribute information, behavior information, etc.) of the user, and present part or all of the determined multiple recommended webpages to the user. Accordingly, the user can browse the web page recommended to the user by the recommendation system through the client application.

Generally, the web pages searched for or recommended by the recommendation system are high-quality web pages, that is, the web pages contain high-quality information, such as real, real-time, original information, and the like. Poor quality web pages, such as web pages containing spurious, erroneous, outdated, plagiarized information, can greatly degrade the user experience.

The origin of different web pages is different. Hereinafter, the source of the web page is referred to as the "information source" of the web page. The quality of the information sources is uneven. Some information sources generate high-quality web pages; some information sources produce web pages of lower quality; some sources of information produce both high quality and low quality web pages. The quality of the information sources can affect the quality of the web page, and the same web page may have many different aspects of the information sources. For example, a web page may be derived from a site (site, also referred to as a website or a website), a main domain (domain), an IP address, an information platform (platform), etc. in terms of storage location, that is, the information source may be a site, a main domain, an IP address, a platform, etc.; on the aspect of the publisher or the operator of the web Content, the web Content may be sourced from a publishing account or an ICP (Internet Content Provider) filing agent, that is, the information source may be a publishing account, a filing agent, or the like. In the related art, the site where the webpage is located is usually only used as the information source, so that it is difficult to comprehensively express the source of the webpage, and it is inconvenient to accurately evaluate and flexibly control the quality of the webpage from the perspective of the information source.

In order to accurately evaluate the quality of a web page so as to provide a high-quality web page to a user in the scenes of searching, recommending and the like of the web page, the embodiment of the disclosure provides a scheme for determining an information source of the web page. The scheme can determine a plurality of information sources corresponding to the webpage and comprehensively express the source of the webpage, thereby being convenient for evaluating and controlling the quality of the webpage from the perspective of the information sources. Based on the determined multiple information sources of the web page, the embodiment of the disclosure further provides a scheme for determining the quality of the web page, which considers the multiple information sources corresponding to the web page when evaluating the quality of the web page, and determines the quality of the web page according to the quality of the multiple information sources corresponding to the web page, thereby realizing accurate evaluation of the quality of the web page.

FIG. 2 shows a flow diagram of a method 200 for determining a source of web page information in accordance with an embodiment of the present disclosure. The method 200 may be performed at a server (e.g., the server 120 shown in fig. 1), that is, the execution subject of each step of the method 200 may be the server 120 shown in fig. 1.

As shown in fig. 2, the method 200 includes:

step 210, determining a plurality of information sources corresponding to the webpage according to the address or the content of the webpage; and step 220, storing the identification of the webpage and the identification of each of the plurality of information sources in an associated manner.

According to the embodiment of the disclosure, a plurality of information sources corresponding to the webpage can be determined, and the source of the webpage can be comprehensively expressed, so that the quality of the webpage can be conveniently evaluated from the perspective of the information sources, and the flexible control of different degrees of the webpage quality can be conveniently performed based on the information sources with different granularities.

For example, the method for determining the quality of the web page according to the embodiments of the present disclosure may be further performed based on a plurality of information sources corresponding to the determined web page, so as to determine the quality of the web page according to the quality of the information sources corresponding to the web page, thereby achieving accurate evaluation of the quality of the web page. Moreover, the quality of the webpage can be controlled from the perspective of the information source, for example, the webpage with poor quality is displayed and pressed, and the webpage is prevented from being presented to the user.

The various steps of method 200 are described in detail below.

In step 210, a plurality of information sources corresponding to the web page are determined according to the address or content of the web page.

The information sources include a variety of types. According to some embodiments, the information source includes a location source for representing a source of the web page in terms of storage location. The location source includes, for example, at least one of a site, a home domain, an IP address of the site, a redirect site of the site, and a platform from which the web page can be retrieved. Accordingly, at least one location source corresponding to the web page may be determined according to the address of the web page. The address of the web page is usually the URL (Uniform Resource Locator) of the web page.

According to some embodiments, the site to which the web page corresponds may be determined from the URL of the web page. Specifically, the site corresponding to the web page is a domain name part in the URL. For example, the URL of a web page is https:// mbd.baidu.com/newpage/data/landingsupercontext [% ] 7B% ] 22 nd% ] 22% ] 3A% ] 22news _ 9901530270308438848% ] 22D & n _ type [ ] 0& p _ from [ - ] 1, where "https:" is the protocol portion; "mbd.baidu.com" is the domain name part, i.e. the site corresponding to the web page; "/newpage/data/" is a virtual directory portion; "Landing super" is a filename part; "context ═ 7B% >, 22 nid% >, 22 a% >, 22news _ 9901530270308438848% >, 22D & _ n _ type ═ 0& p _ from ═ 1" is the parameter part, with "&" between parameters as a separator.

According to some embodiments, the home domain to which the web page corresponds may be determined from the URL of the web page. Specifically, the home domain corresponding to the web page may be determined according to the domain name in the URL of the web page. Generally, when Top-Level domain names (TLDs) among domain names are general Top-Level domain names (gTLDs), such as com,. net,. org, etc., the main domain is a secondary domain name; when the Top domain name among the domain names is a national Top-Level domain name (ccTLDs), such as. cn,. us,. jp, etc., the main domain is a third-Level domain name.

For example, if the URL of the web page is https:// aaa.bbb.ccc.ddd.com/eee, the main domain is the secondary domain name, namely ddd.com; if the URL of the webpage is https:// aaa.bbb.ccc.ddd.com.cn/eee, the main domain is the third-level domain name, namely ddd.com.cn.

According to some embodiments, the IP address of the site corresponding to the web page may be determined by a DNS (Domain Name System). The DNS maps the domain name and the IP address to each other, and can determine the IP address corresponding to the domain name of the site. It will be appreciated that different sites may correspond to the same IP address. At a particular time, a site corresponds to only one IP address. As time goes by, the IP address corresponding to the station may also change.

According to some embodiments, a redirection (redirect) may occur to the site to which the web page corresponds. That is, when the first page of a certain site is accessed, a jump to another site is made. The site (site B) that jumps from one site (site a) is the redirect site for that site (site a). It will be appreciated that different sites may be redirected to the same site, i.e., have the same redirected site. Furthermore, the redirection sites of the same site may change over time, i.e. redirection sites corresponding to the same site at different times may be different.

According to some embodiments, a platform corresponding to a web page may retrieve the web page and present the web page to a user.

According to some embodiments, the information source further includes a production source, which is used to represent a source of the web page in terms of a production subject, including, for example, a docket subject of a home domain corresponding to the web page, a publishing account number of the web page content, and the like. According to some embodiments, at least one production source corresponding to the web page may be determined according to the address or content of the web page.

Specifically, in the case that the production source is a record body of a home domain corresponding to a web page, the home domain corresponding to the web page may be determined according to an address of the web page; and determining a filing subject by querying ICP filing information of the main domain. The record subject may be a company or an individual.

In the case where the production source is a publishing account of the web page content, the publishing account may be determined by parsing the source code of the web page. For example, a field corresponding to the publishing account, such as authoraname, Media, etc., may be parsed from the source code of the web page, and a value of the field may be obtained as the publishing account.

FIG. 3 shows a schematic diagram of an information source collection 300 composed of a plurality of information sources, according to an embodiment of the disclosure. As shown in fig. 3, the information source set 300 of web page a includes a site 302, a home domain 304, a site IP address 306, a redirect site 308, a platform 310, a docket principal 312, and a publishing account 314. The site 302, the home domain 304, the site IP address 306, the redirection site 308, and the platform 310 are location sources of the web page a, and may be determined according to a URL of the web page a; the docket body 312 and the publishing account 314 are production sources of site a, wherein the docket body 312 can be determined by querying ICP docket information of the main domain 304, and the publishing account 314 can be determined by parsing web page content (source code).

After determining the plurality of information sources corresponding to the web page through step 210, step 220 may be performed to store the identification of the web page in association with the identification of each of the plurality of information sources.

It will be appreciated that there are a number of embodiments for associating the identity of a web page with the identity of each of a number of information sources. According to some embodiments, the identification of the web page may be stored in association with the identification of each information source, respectively, resulting in a plurality of data records. For example, if the web page webPage1 corresponds to 4 information sources, informationSource1-4, four data records, webPage1-informationSource1, webPage1-informationSource2, webPage1-informationSource3, and webPage1-informationSource4, are available.

According to other embodiments, the identification of the web page may be stored in association with the identification of each information source to obtain a data record, for example, if the web page webPage1 corresponds to 4 information sources informationSource1-4, a data record of webPage1-informationSource1-informationSource2-informationSource3-informationSource4 may be obtained.

According to some embodiments, the identification of the web page is typically a URI (Uniform Resource Identifier) of the web page. It will be appreciated that a URL is a type of URI, and accordingly, the identity of a web page may be the URL of the web page, i.e., the address of the web page.

The identification of different information sources is different. For example, the identifier of the site may be a domain name of the site, the identifier of the main domain may be a domain name of the main domain, the identifier of the IP address of the site is the IP address itself, the identifier of the redirected site may be a domain name of the redirected site, the identifier of the platform may be a name of the platform, the identifier of the docket may be a name of the docket subject, a uniform social credit code (when the docket subject is a company), an identification number (when the docket subject is an individual), and the like, and the identifier of the publishing account may be the publishing account itself.

According to some embodiments, the method 200 further comprises: determining at least one webpage corresponding to each of the plurality of information sources according to the stored association relationship between the identifications of the plurality of groups of webpages and the respective identifications of the plurality of information sources; and for each information source in the plurality of information sources, storing the identification of the information source and the identification of at least one corresponding webpage in an associated manner. Based on the embodiment, the webpage list corresponding to each information source can be determined, so that the webpages under a certain information source can be managed uniformly.

For example, the information sources corresponding to the web pages obtained in step 210 are classified and summarized to obtain a web page list corresponding to each information source, as follows:

{site:urllist}

{domain:urllist}

{site_ip:urllist}

{site_redirect:urllist}

{platform:urllist}

{entity_info:urllist}

{account:urllist}

wherein, the site, domain, site _ IP, site _ redirect, platform, entry _ info, and account respectively represent the site, the main domain, the IP address of the site, the redirection site of the site, the platform, the record body, and the information source of the issued account. URL lists is a list of identifications (i.e., URLs) of web pages corresponding to the respective information sources.

Based on the multiple information sources corresponding to the web page determined according to the method 200, the embodiment of the present disclosure further provides a method 400 for determining the quality of the web page, which can determine the quality of the web page according to the qualities of the multiple information sources corresponding to the web page.

FIG. 4 shows a flow diagram of a method 400 for determining web page quality in accordance with an embodiment of the present disclosure. The method 400 may be performed at a server (e.g., the server 120 shown in fig. 1), that is, the execution subject of the steps of the method 400 may be the server 120 shown in fig. 1.

As shown in fig. 4, the method 400 includes:

step 410, obtaining respective qualities of a plurality of information sources corresponding to the web page, the plurality of information sources being determined according to a method for determining the web page information sources; and step 420, determining the quality of the webpage according to the respective qualities of the plurality of information sources.

According to the embodiment of the disclosure, the quality of the webpage can be determined according to the quality of the plurality of information sources corresponding to the webpage, and the accuracy of webpage quality evaluation is improved.

The various steps of method 400 are described in detail below.

According to some embodiments, in step 410, the quality of the information source is determined according to the content quality of each web page corresponding to the information source. Specifically, the quality of the information source may be an average value of the content qualities of the web pages corresponding to the information source, or a weighted sum of the content qualities of the web pages corresponding to the information source, or the like.

The content quality of the web page may be determined according to factors such as richness, layout condition, timeliness, and originality of the content of the web page, for example, and the present disclosure does not limit the specific determination method of the content quality of the web page. It will be appreciated that, to avoid loop calculations, information source considerations are not taken into account when determining the content quality of a web page.

In step 410, the quality of the web page is determined based on the respective qualities of the plurality of information sources corresponding to the web page.

There are various ways to determine the quality of a web page.

According to some embodiments, the quality of the web page is a weighted sum of respective qualities of a plurality of information sources to which the web page corresponds. That is, the quality of the web page may be calculated according to the following formula 1:

where url _ score is the quality of the web page, w_iSource as weight of ith information source_iSclore is the quality of the ith source and n is the number of sources.

According to other embodiments, the quality of the web page is a mapped value of a weighted sum of respective qualities of a plurality of information sources corresponding to the web page. Any mapping function may be employed to calculate the mapping value of the weighted sum. For example, the mapping function may be a sigmoid function, i.e., the quality of the web page may be calculated according to the following equation 2:

where url _ score is the quality of the web page, w_iAs the right of the ith information sourceGravity, source_iSclore is the quality of the ith source and n is the number of sources.

It should be appreciated that in addition to the embodiments described above, other ways of calculating the quality of a web page from the quality of an information source may be employed. The present disclosure does not limit the specific way in which the web page quality is calculated.

Based on the quality of the web page determined by the method 400, optimization of the search and recommendation may be performed. For example, a plurality of webpages obtained by user search or a plurality of webpages recommended to the user can be ranked according to the quality of the webpages, the webpages with high quality are preferentially presented to the user, and the webpages with low quality are then presented or not presented, so that the efficiency of the user for obtaining information is improved, and the user experience is improved.

Fig. 5 shows a block diagram of an apparatus 500 for determining a source of web page information according to an embodiment of the present disclosure. As shown in fig. 5, the apparatus 500 includes:

an information source determining module 510 configured to determine a plurality of information sources corresponding to the web page according to the address or content of the web page; and

a storage module 520 configured to store the identifier of the web page in association with the identifiers of the plurality of information sources.

Fig. 6 shows a block diagram of an apparatus 600 for determining web page quality according to an embodiment of the present disclosure. As shown in fig. 6, the apparatus 600 includes:

an obtaining module 610 configured to obtain respective qualities of a plurality of information sources corresponding to a web page, the plurality of information sources being determined according to the method for determining a web page information source; and

a quality determination module 620 configured to determine the quality of the web page according to the respective qualities of the plurality of information sources.

It should be understood that the various modules of the apparatus 500 shown in fig. 5 may correspond to the various steps in the method 200 described with reference to fig. 2, and the various modules of the apparatus 600 shown in fig. 6 may correspond to the various steps in the method 400 described with reference to fig. 4. Thus, the operations, features and advantages described above with respect to the method 200 are equally applicable to the apparatus 500 and its included modules, and the operations, features and advantages described above with respect to the method 400 are equally applicable to the apparatus 600 and its included modules. Certain operations, features and advantages may not be described in detail herein for the sake of brevity.

Although specific functionality is discussed above with reference to particular modules, it should be noted that the functionality of the various modules discussed herein may be divided into multiple modules and/or at least some of the functionality of multiple modules may be combined into a single module. For example, the information source determination module 510 and the storage module 520 described above may be combined into a single module in some embodiments.

It should also be appreciated that various techniques may be described herein in the general context of software, hardware elements, or program modules. The various modules described above with respect to fig. 5, 6 may be implemented in hardware or in hardware in combination with software and/or firmware. For example, the modules may be implemented as computer program code/instructions configured to be executed in one or more processors and stored in a computer-readable storage medium. Alternatively, the modules may be implemented as hardware logic/circuitry. For example, in some embodiments, one or more of the information source determination module 510, the storage module 520, the acquisition module 610, and the quality determination module 620 may be implemented together in a System on Chip (SoC). The SoC may include an integrated circuit chip (which includes one or more components of a Processor (e.g., a Central Processing Unit (CPU), microcontroller, microprocessor, Digital Signal Processor (DSP), etc.), memory, one or more communication interfaces, and/or other circuitry), and may optionally execute received program code and/or include embedded firmware to perform functions.

According to an embodiment of the present disclosure, there is also provided an electronic device, a readable storage medium, and a computer program product.

Referring to fig. 7, a block diagram of a structure of an electronic device 700, which may be a server or a client of the present disclosure, which is an example of a hardware device that may be applied to aspects of the present disclosure, will now be described. Electronic device is intended to represent various forms of digital electronic computer devices, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 6, the device 700 comprises a computing unit 701, which may perform various suitable actions and processes according to a computer program stored in a Read Only Memory (ROM)702 or a computer program loaded from a storage unit 708 into a Random Access Memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the device 700 can also be stored. The computing unit 701, the ROM 702, and the RAM 703 are connected to each other by a bus 704. An input/output (I/O) interface 705 is also connected to bus 704.

Various components in the device 700 are connected to the I/O interface 705, including: an input unit 706, an output unit 707, a storage unit 708, and a communication unit 709. The input unit 706 may be any type of device capable of inputting information to the device 700, and the input unit 706 may receive input numeric or character information and generate key signal inputs related to user settings and/or function controls of the electronic device, and may include, but is not limited to, a mouse, a keyboard, a touch screen, a track pad, a track ball, a joystick, a microphone, and/or a remote controller. The output unit 707 mayTo be any type of device capable of presenting information and may include, but is not limited to, a display, speakers, a video/audio output terminal, a vibrator, and/or a printer. Storage unit 708 may include, but is not limited to, magnetic or optical disks. The communication unit 709 allows the device 700 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks, and may include, but is not limited to, a modem, a network card, an infrared communication device, a wireless communication transceiver, and/or a chipset, such as bluetooth^TMDevices, 1302.11 devices, Wi-Fi devices, WiMax devices, cellular communication devices, and/or the like.

Computing unit 701 may be a variety of general purpose and/or special purpose processing components with processing and computing capabilities. Some examples of the computing unit 701 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. The computing unit 701 performs the various methods and processes described above, such as the method 200 and/or the method 400 described above. For example, in some embodiments, the

methods

200, 400 may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as the storage unit 708. In some embodiments, part or all of a computer program may be loaded onto and/or installed onto device 700 via ROM 702 and/or communications unit 709. When loaded into RAM 703 and executed by computing unit 701, may perform one or more steps of method 200 and/or method 400 described above. Alternatively, in other embodiments, the computing unit 701 may be configured by any other suitable means (e.g., by way of firmware) to perform the method 200 and/or the method 400.

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.

Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.

The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server with a combined blockchain.

It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be performed in parallel, sequentially or in different orders, and are not limited herein as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved.

Although embodiments or examples of the present disclosure have been described with reference to the accompanying drawings, it is to be understood that the methods, systems, and apparatus described above are merely exemplary embodiments or examples and that the scope of the present disclosure is not limited by these embodiments or examples, but only by the claims as issued and their equivalents. Various elements in the embodiments or examples may be omitted or may be replaced with equivalents thereof. Further, the steps may be performed in an order different from that described in the present disclosure. Further, various elements in the embodiments or examples may be combined in various ways. It is important that as technology evolves, many of the elements described herein may be replaced with equivalent elements that appear after the present disclosure.

Claims

1. A method for determining a source of web page information, comprising:

determining a plurality of information sources corresponding to the webpage according to the address or the content of the webpage; and

and storing the identification of the webpage and the identification of each of the plurality of information sources in an associated manner.

2. The method of claim 1, wherein the information source comprises a location source, and

determining a plurality of information sources corresponding to the web page according to the address or the content of the web page comprises the following steps: and determining at least one position source corresponding to the webpage according to the address of the webpage.

3. The method of claim 2, wherein the location source comprises at least one of a site, a home domain, an IP address of the site, a redirect site of the site, and a platform from which the web page is available.

4. The method of any of claims 1-3, wherein the information source comprises a production source, and

determining a plurality of information sources corresponding to the web page according to the address or the content of the web page comprises the following steps: and determining at least one production source corresponding to the webpage according to the address or the content of the webpage.

5. The method of claim 4, wherein the production source comprises a docket body of a home domain to which the web page corresponds, and

wherein, according to the address or the content of the web page, determining at least one production source corresponding to the web page comprises:

determining a home domain corresponding to the webpage according to the address; and

determining the docket subject by querying docket information of the primary domain.

6. The method of claim 4 or 5, wherein the production source comprises a publishing account number of the content, and

wherein, according to the address or the content of the web page, determining at least one production source corresponding to the web page comprises: determining the publishing account number by parsing a source code of the web page.

7. The method of any of claims 1-6, further comprising:

determining at least one webpage corresponding to each of a plurality of information sources according to the stored association relationship between the identifications of the plurality of groups of webpages and the respective identifications of the plurality of information sources; and

and for each information source in the plurality of information sources, storing the identification of the information source in association with the respective identification of the at least one corresponding webpage.

8. The method of any of claims 1-7, wherein the identification of the web page is an address of the web page.

9. A method for determining web page quality, comprising:

obtaining respective qualities of a plurality of information sources corresponding to a web page, the plurality of information sources being determined according to the method of any one of claims 1-8; and

and determining the quality of the webpage according to the respective qualities of the plurality of information sources.

10. The method of claim 9, wherein the quality of the web page is a weighted sum of the respective qualities of the plurality of information sources.

11. The method of claim 9, wherein the quality of the web page is a mapped value of a weighted sum of respective qualities of the plurality of information sources.

12. The method of any of claims 9-11, wherein the quality of the information source is determined based on a content quality of each web page to which the information source corresponds.

13. An apparatus for determining a source of web page information, comprising:

the information source determining module is configured to determine a plurality of information sources corresponding to the webpage according to the address or the content of the webpage; and

a storage module configured to store an identification of the web page in association with an identification of each of the plurality of information sources.

14. An apparatus for determining web page quality, comprising:

an obtaining module configured to obtain respective qualities of a plurality of information sources corresponding to a web page, the plurality of information sources being determined according to the method of any one of claims 1-8; and

a quality determination module configured to determine a quality of the web page based on respective qualities of the plurality of information sources.

15. An electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein

The memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-12.

16. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-12.

17. A computer program product comprising a computer program, wherein the computer program realizes the method of any one of claims 1-12 when executed by a processor.