WO2016086797A1

WO2016086797A1 - Method for searching for information and processing and identifying picture in browser, and browser client

Info

Publication number: WO2016086797A1
Application number: PCT/CN2015/095819
Authority: WO
Inventors: 田新超; 刘晓健; 杨晓兵
Original assignee: 北京奇虎科技有限公司; 奇智软件（北京）有限公司
Priority date: 2014-12-03
Filing date: 2015-11-27
Publication date: 2016-06-09

Abstract

Disclosed are a method for searching for information in a browser, a method for processing picture information in a browser, a method for identifying a picture, and a browser client. The method for searching for information in a browser comprises: acquiring attribute information about at least one web page element in a currently loaded web page of a browser (S102); transmitting the acquired attribute information to a server side, and receiving a key word corresponding to the attribute information returned by the server side (S104); monitoring a first trigger operation for some or all of the web page elements in the at least one web page element, and displaying the corresponding key word at a set position of the triggered web page element (S106); and monitoring a second trigger operation for the corresponding key word, and initiating a pre-set operation based on the key word at a browser side (S108). Other related information aside from links corresponding to web page elements is provided for a user.

Description

Search information, image processing, recognition methods, and browser client in the browser

Technical field

The present invention relates to the field of network technologies, and in particular, to a method for searching information in a browser, a browser client, a method for processing picture information in a browser, a browser client, and a method for recognizing a picture. Browser client.

Background technique

A web browser is a software that displays files in a web server or file system and allows users to interact with these files. It is used to display images, text, video, audio and other information on the World Wide Web or a local area network. This information is usually displayed on a web page, and the amount of information in the webpage currently displayed by the browser is huge.

In general, a plurality of types of webpage elements can be provided in a webpage, including but not limited to: one or more of text, picture, audio, and video. When a user browses a certain webpage through a web browser, for example, when a webpage containing audio is interested in an audio, the music can be heard by clicking a link corresponding to the audio. However, when the user wants to further understand the audio, the existing web browser cannot provide other related information (such as the player information corresponding to the audio) except the music link corresponding to the audio, which is difficult for the user to obtain. Other related information about audio elements. Similarly, other web page elements have the same problem.

It can be seen that the existing browser can only provide the user with information about the link corresponding to the webpage element when processing the webpage element in the webpage, but cannot provide other related information except the link.

Summary of the invention

In view of the above problems, the present invention has been made in order to provide a method for searching for information in a browser and a browser client, a method for browsing picture information in a browser, and browsing, which overcomes the above problems or at least partially solves the above problems. Client and a method of image recognition and browser client.

According to an aspect of the present invention, a method for searching for information in a browser includes: obtaining attribute information of at least one webpage element in a webpage currently loaded by a browser; and transmitting the obtained attribute information to a server side, And receiving a keyword corresponding to the attribute information returned by the server side; monitoring a first triggering operation on some or all of the webpage elements in the at least one webpage element, and setting a location of the triggered webpage element Displaying a corresponding keyword; monitoring a second triggering operation on the corresponding keyword, and initiating a preset operation based on the keyword on the browser side.

According to another aspect of the present invention, a browser client is provided, including: an obtaining module, configured to acquire attribute information of at least one webpage element in a webpage currently loaded by a browser; and a sending module, configured to acquire the The attribute information is sent to the server side, and receives a keyword corresponding to the attribute information returned by the server side; and a display module, configured to monitor a first trigger for some or all of the at least one webpage element An operation, displaying a corresponding keyword at a set position of the triggered webpage element; a preset operation initiating module, configured to monitor a second triggering operation on the corresponding keyword, initiated on the browser side Preset actions for keywords.

According to an aspect of the present invention, a method for performing picture information processing in a browser includes: acquiring picture attribute information of at least one picture element that satisfies a set condition in a currently loaded web page of a browser; The picture attribute information is sent to the server side, and receives a picture keyword corresponding to the picture attribute information returned by the server side; and detects a first triggering operation on some or all of the picture elements in the at least one picture element, Displaying the corresponding picture keyword at a set position of the triggered picture element; monitoring a second trigger operation on the corresponding picture keyword The preset operation based on the picture keyword is initiated on the browser side.

According to another aspect of the present invention, a browser client is provided, including: an obtaining module, configured to acquire image attribute information of at least one picture element that satisfies a set condition in a currently loaded webpage of a browser; And sending the acquired image attribute information to the server side, and receiving a picture keyword corresponding to the picture attribute information returned by the server side; and displaying a module, configured to monitor, in the at least one picture element a first triggering operation of the partial or all of the picture elements, displaying a corresponding picture keyword at a set position of the triggered picture element; and a preset operation initiation module, configured to monitor the second to the corresponding picture keyword Triggering an operation, and initiating a preset operation based on the picture keyword on the browser side.

According to an aspect of the present invention, a method for image recognition is provided, comprising: receiving a first triggering operation for identifying a picture, wherein the picture is a picture in a browser currently loading a webpage or the browser acquires a local picture; the attribute information of the picture and/or the picture is sent to the server side; and a keyword corresponding to the picture returned by the server side is received and displayed, wherein the keyword is used by the server The side finds according to the picture and/or the attribute information corresponding to the picture.

According to another aspect of the present invention, a browser client is provided, including: a receiving module, configured to receive a first triggering operation for identifying a picture, where the picture is a picture in a currently loaded webpage of a browser Or a local image obtained by the browser; a sending module, configured to send the attribute information of the picture and/or the image to the server side; and a display module, configured to receive and display the returned by the server side a keyword corresponding to the picture, wherein the keyword is searched by the server side according to the picture and/or attribute information corresponding to the picture.

The present invention provides a program comprising readable code, when the readable code is run on a terminal device, causing the terminal device to perform the method of searching for information in a browser, in the browser A method of performing picture information processing or the method of picture recognition described above.

The present invention provides a readable medium in which the program is stored.

With the present invention, the browser obtains the keyword corresponding to at least one webpage element in the currently loaded webpage from the server side, and when the first triggering operation of the webpage element by the user is detected, at the set position of the triggered webpage element The keyword corresponding to the webpage element is displayed, so that it is possible to solve the problem that the existing browser cannot provide the user with other related information except the link corresponding to the webpage element. In the meantime, the solution for searching for information in the browser provided by the present invention can also monitor the second triggering operation on the displayed keyword, and initiate a keyword-based preset operation on the browser side, for example, using keywords. The webpage search can provide the user with information about the keyword related webpage through the preset operation, thereby providing the user with more comprehensive information about the webpage element.

The above description is only an overview of the technical solutions of the present invention, and the above-described and other objects, features and advantages of the present invention can be more clearly understood. Specific embodiments of the invention are set forth below.

DRAWINGS

Various other advantages and benefits will become apparent to those skilled in the art from a The drawings are only for the purpose of illustrating the preferred embodiments and are not to be construed as limiting. Throughout the drawings, the same reference numerals are used to refer to the same parts. In the drawing:

1 is a flow chart showing the steps of a method for searching for information in a browser according to Embodiment 1 of the present invention;

2 is a flow chart showing the steps of a method for searching for information in a browser according to Embodiment 2 of the present invention;

3 is a flow chart showing the steps of a method for performing picture information processing in a browser according to Embodiment 3 of the present invention;

4 is a flow chart showing the steps of a method for performing picture information processing in a browser according to Embodiment 4 of the present invention;

5 is a flow chart showing the steps of a picture recognition method according to Embodiment 5 of the present invention;

6 is a flow chart showing the steps of a picture recognition method according to Embodiment 6 of the present invention;

7 is a structural block diagram of a browser client according to Embodiment 7 of the present invention;

FIG. 8 is a structural block diagram of a browser client according to Embodiment 8 of the present invention.

9 is a structural block diagram of a browser client according to Embodiment 9 of the present invention;

FIG. 10 is a structural block diagram of a browser client according to Embodiment 10 of the present invention.

11 is a block diagram showing the structure of a browser client according to Embodiment 11 of the present invention;

12 is a block diagram showing the structure of a browser client according to Embodiment 12 of the present invention;

Figure 13 shows a block diagram of a server configured to perform a method in accordance with the present invention;

Figure 14 illustrates a memory unit configured to hold or carry program code that implements the method in accordance with the present invention.

detailed description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While the embodiments of the present invention have been shown in the drawings, the embodiments Rather, these embodiments are provided so that this disclosure will be more fully understood and the scope of the disclosure will be fully disclosed.

Embodiment 1

Referring to FIG. 1, there is shown a flow chart of the steps of a method for searching for information in a browser according to Embodiment 1 of the present invention.

The method for searching for information in a browser in this embodiment includes the following steps:

Step S102: Acquire attribute information of at least one webpage element in the webpage currently loaded by the browser.

In the actual implementation process, the browser obtains the attribute information of which webpage elements in the currently loaded webpage may be set by a person skilled in the art according to actual needs, for example, may be set to obtain only a certain type of webpage element (for example, a video element). The attribute information may also be set to obtain attribute information of a plurality of types of webpage elements (for example, a video element and a picture element), and may of course be set to obtain attribute information of other types of webpage elements, which is not specifically described in this embodiment. limited. Preferably, the attribute information of the audio currently loaded in the webpage by the browser, and/or the attribute information of the video, and/or the attribute information of the picture are acquired.

The specific attribute information obtained can be set by a person skilled in the art according to requirements in actual operation. For example, it is set to obtain only the URL of the webpage element (Uniform Resource Locator), or only the title of the webpage element, and of course, it can also be set to obtain other attribute information, so as to ensure that the obtained attribute information can uniquely identify one. Web page element.

Step S104: Send the acquired attribute information to the server side, and receive a keyword corresponding to the attribute information returned by the server side.

The server side stores the corresponding relationship between the attribute information of the webpage element and the keyword. After receiving the attribute information of the webpage element, the server side obtains the keyword corresponding to the attribute information of the webpage element by searching for the corresponding relationship, and returns the keyword to the browser. .

Step S106: The first triggering operation on some or all of the webpage elements in the at least one webpage element is monitored, and the corresponding keyword is displayed at the set position of the triggered webpage element.

In this embodiment, the first triggering operation on some or all of the webpage elements in the at least one webpage element includes, but is not limited to, hovering, clicking, selecting, and the like, for example, selecting a webpage element by using a mouse or at a certain The suspension of the webpage element over a certain period of time may implement the first triggering operation on the webpage element, or may select multiple webpage elements at a time through the shortcut key to implement the first triggering operation on the plurality of webpage elements.

The display position of the keyword may be set to be displayed at any suitable position of the webpage element, for example, the upper left corner, the upper right corner, and the lower left corner of the webpage element, which is not specifically limited in this embodiment. And how to display keywords The embodiment is not limited, for example, it can be displayed directly on a webpage element, a bubble can be generated, a keyword can be displayed in a bubble, and of course, other display modes are not listed in this embodiment.

Step S108: The second triggering operation on the corresponding keyword is monitored, and the keyword-based preset operation is initiated on the browser side.

With the method for searching for information in the browser provided by the embodiment, the browser obtains, from the server side, a keyword corresponding to at least one webpage element in the currently loaded webpage, and when the first triggering operation of the webpage element by the user is detected, The keyword corresponding to the webpage element is displayed at the set position of the triggered webpage element, and therefore, the problem that the existing browser cannot provide the user with other related information except the link corresponding to the webpage element can be solved. In the meantime, the solution for searching for information in the browser provided by the present invention can also monitor the second triggering operation on the displayed keyword, and initiate a keyword-based preset operation on the browser side, for example, using keywords. The webpage search can provide the user with information about the keyword related webpage through the preset operation, thereby providing the user with more comprehensive information about the webpage element.

Example 2

Referring to FIG. 2, a flow chart of steps of a method for searching for information in a browser according to a second embodiment of the present invention is shown.

The method for searching for information in a browser in this embodiment includes the following specific steps:

Step S202: The browser determines whether the currently loaded webpage is a secure webpage; if yes, step S204 is performed, and if not, the first setting operation is performed.

The first setting operation may be any appropriate operation set by a person skilled in the art according to actual needs, such as terminating the operation of loading the webpage currently.

In the implementation process, a preferred step of determining whether the currently loaded webpage is a secure webpage is as follows:

Step S2022: The browser obtains webpage attribute information of the currently loaded webpage.

The webpage attribute information may be a URL of the webpage and/or title information of the webpage.

Step S2024: The browser sends the acquired webpage attribute information to the browser-independent application.

The browser-independent application may be a network shield, and may of course be another application that can be used for web page security determination.

Step S2026: The browser receives the security identifier corresponding to the webpage attribute information returned by the browser-independent application, where the security identifier is used to indicate whether the currently loaded webpage is a secure webpage.

The browser determines whether the browser currently loading the webpage is a secure webpage by using the security identifier obtained in the above steps S2022 to S2026. If the obtained security identifier indicates that the currently loaded webpage is a secure webpage, step S204 and subsequent steps of obtaining the attribute information of the at least one webpage element satisfying the set condition in the currently loaded webpage of the browser are performed. If the security identifier indicates that the currently loaded web page is not a secure web page, the first setting operation is performed.

Step S204: When the browser determines that the currently loaded webpage is a secure webpage, it further determines whether the currently loaded webpage has the authority to enable the server side to perform webpage element identification; if yes, step S206 is performed, and if not, the second setting operation is performed.

Preferably, the browser can determine whether the currently loaded webpage has the right to enable the server side to identify the webpage element in the following three specific manners, as follows:

The first way is to determine whether the currently loaded web page has the right to enable the server side to identify the web page element through a browser-independent application. The specific process is as follows:

The browser obtains the webpage attribute information of the currently loaded webpage; sends the obtained webpage attribute information to the browser-independent application; and receives the permission identifier corresponding to the webpage attribute information returned by the browser-independent application, wherein the permission identifier is used by the browser And indicating that the current loading webpage has the right to enable the server side to perform image recognition on the webpage element in the currently loaded webpage; if the permission identifier indicates that the current loading webpage has the right to enable the server side to perform the webpage element identification, step S206 is performed, ie, obtaining The attribute information of at least one web page element in the current loading webpage of the browser.

In this mode, since the server side can only support the identification of webpage elements in certain types of webpages, it is independent of The browser application obtains the specific type of related information, and the browser-specific application determines the type of the webpage currently loaded by the browser by using the webpage attribute information sent by the browser, and then determines whether the type of the currently loaded webpage belongs to a specific type. If the type of the currently loaded webpage is in a specific type, the browser-independent application generates a permission identifier for indicating that the currently loaded webpage has the server side identifying the webpage element in the currently loaded webpage. If the type of the currently loaded webpage is not in a specific type supported by the server side, the browser-independent application generates a permission identifier for indicating that the currently loaded webpage does not have the server side to identify the webpage element in the currently loaded webpage. . After receiving the permission identifier sent by the browser-independent application, the browser can determine whether the currently loaded webpage has the right to enable the server side to identify the webpage element according to the type of the permission identifier.

The second way is to determine whether the currently loaded webpage has the right to enable the server side to identify the webpage element through the server side. The specific process is as follows:

The browser obtains the webpage attribute information of the currently loaded webpage; the obtained webpage attribute information is sent to the server side, and receives the judgment result returned by the server side, wherein the judgment result carries the server side determining according to the webpage attribute information, determining the current loading Whether the webpage supports the information of the webpage identified by the webpage element; if the result of the judgment indicates that the currently loaded webpage supports the webpage element identification, step S206 is performed, that is, the attribute information of the at least one webpage element satisfying the set condition in the currently loaded webpage of the browser is obtained. .

The third way is to determine whether the currently loaded webpage has the right to enable the server side to identify the webpage element by whether the browser can receive the query sent by the server side. The specific process is as follows:

The browser receives a message sent by the server side to query whether the webpage element is identified by the current loading webpage; and returns a response message to the server side, where the response message carries information indicating whether to accept the webpage element identification of the current webpage by the server side.

In this manner, the server side sends an inquiry message to the browser side after determining that the browser currently loading the webpage has the authority to make the server side perform the webpage element identification. If the server side does not send an inquiry message to the browser, it proves that the webpage currently loaded by the browser does not have the authority to make the server side perform the webpage element identification. The browser can determine whether the currently loaded web page has the right to enable the server side to identify the web page element by receiving the inquiry information sent by the browser side.

At this time, after receiving the inquiry message sent by the server side, the browser may actively control whether to accept the server side to perform the currently loaded webpage by returning information indicating whether to accept the server side to identify the currently loaded webpage by the server side. Web page element identification. After the browser determines that the response message indicating that the current loading webpage accepts the webpage element identification by the server side is returned to the server side, step S206 is performed, that is, acquiring at least one webpage element in the currently loaded webpage of the browser. Attribute information.

It should be noted that, the foregoing is an implementation manner of determining whether the currently loaded webpage has the right to enable the server side to perform webpage element identification. In an actual implementation process, a person skilled in the art may select any one or more of the foregoing. The combination of methods to make relevant judgments. Moreover, the above steps S202 to S204 are optional steps. In the actual application, the security of the webpage and the recognition authority of the webpage element may not be distinguished. The default is that the security is consistent with the security of the webpage element. Certainly, the solution of the above steps S202 to S204 is adopted, which further improves the security of the scheme for searching for information in the browser in the embodiment of the present invention.

Step S206: The browser acquires attribute information of at least one webpage element in the currently loaded webpage.

Preferably, the browser acquires attribute information of at least one webpage element that satisfies the set condition in the currently loaded webpage. The set condition that is satisfied may be set by a person skilled in the art according to actual needs, for example, setting only the attribute information of the picture element, or setting only the attribute information of the video element, and of course, setting The attribute information of the picture element and the video element is acquired at the same time. Further, the attribute information of the picture element is obtained in real time, and may be set to obtain only the attribute information of the picture element that meets the set size, which is not specifically limited in this embodiment. Preferably, the setting rule is set to obtain the attribute information of the audio element, the video element, and the picture element in the webpage currently loaded by the browser.

After the step S202 to the step S204, it is determined that the browser currently loads the webpage as a secure webpage and has the right to enable the server side to identify the webpage element, the browser may be triggered to perform step S206 in any of the following three cases. details as follows:

The first type acquires attribute information of at least one webpage element in the currently loaded webpage of the browser when the current webpage is loaded.

Secondly, when receiving a mouse scroll instruction under the currently loaded webpage, acquiring attribute information of at least one webpage element in the webpage currently loaded by the browser;

Thirdly, when it is determined that there is a webpage element that satisfies the setting condition in the currently loaded webpage, the attribute information of at least one webpage element in the currently loaded webpage of the browser is obtained.

For example, when the browser sets the browser to obtain the attribute information of the video element in the currently loaded webpage, when the browser determines that the video element exists in the currently loaded webpage, the browser acquires at least one video in the currently loaded webpage. The attribute information of the element.

It should be noted that, when the browser obtains the attribute information of the at least one webpage element in the currently loaded webpage, the specific manner of obtaining the information may be set according to actual needs, for example, obtaining all the webpages satisfying the setting conditions in the currently loaded webpage at one time. The attribute information corresponding to the element, for example, first obtaining attribute information corresponding to a part of the webpage element that satisfies the setting condition, and transmitting the obtained part of the attribute information to the server side, and acquiring other remaining attributes of the webpage element satisfying the setting condition. information. This embodiment does not specifically limit the manner in which the browser obtains the attribute information of the webpage element that satisfies the set condition in the currently loaded webpage.

The attribute information may include at least one of the following URLs, a title of the webpage, webpage element description information, and a mark of the webpage where the webpage element is located. Preferably, the URL corresponding to the webpage element is obtained as the attribute information of the webpage element, because each of the webpages Web page elements all have URLs, so it is more convenient to get the URL corresponding to the page element. In this embodiment, the following steps are described by taking the URL of the webpage as an example.

Step S208: The browser sends the acquired attribute information to the server side, and receives a keyword corresponding to the attribute information returned by the server side.

Preferably, the browser encrypts the acquired picture attribute information and sends it to the server side, and receives the encrypted picture keyword corresponding to the picture attribute information returned by the server side. Encrypting the data for transmission ensures the security of the data transmission.

In this embodiment, the browser may send the attribute information of the acquired webpage element to the server side by any suitable means according to actual conditions by a person skilled in the art. Preferably, the browser may be configured to follow any one of the following three transmission modes. The obtained web page element attribute information is sent to the server side as follows:

The first type, all the acquired attribute information is packaged and uploaded to the server side.

Secondly, all the attribute information obtained is grouped according to the set criteria, and each group of attribute information is sequentially uploaded according to the first setting rule.

It should be noted that, for the setting standard, the specific limitation is not limited in this embodiment, and the attribute information may be grouped according to the set quantity, or may be set to be grouped according to the type of the webpage element, and may also be set. The attribute information of the webpage elements is grouped according to the title of the webpage element or the like.

In the specific implementation process, the first setting rule may also be set by a person skilled in the art according to actual requirements, which is not specifically limited in this embodiment. For example, the first setting rule may be set to upload each group of attribute information according to a specific time interval, and may also be set to upload the second group of attribute information after the first group of attribute information is uploaded.

Thirdly, all the attribute information obtained is grouped according to the type of the webpage element, and the attribute information of each type of webpage element is sequentially uploaded according to the second setting rule.

For example, in step S206, the attribute information of the picture element, the video element, and the audio element in the currently loaded webpage is acquired. Interest, then, when all the attribute information obtained is grouped according to the type, the attribute information of the picture element is grouped into one group, the attribute information of all the video elements is grouped, and the attribute information of all the audio elements is divided into As a group.

It should be noted that, in the actual implementation process, the second setting rule may also be set by a person skilled in the art according to actual needs, for example, the second setting rule may be set to be at a specific time interval (for example, every 5 times). Second) upload each group of attribute information, and can also be set to upload the second group of attribute information after the first group of attribute information is uploaded.

The fourth type, while uploading the currently obtained attribute information to the server side, continues to obtain the attribute information of the remaining webpage elements in the currently loaded webpage, and uploads the attribute information of the webpage element that continues to be acquired to the server according to the third setting rule. On the side, all attribute information of all webpage elements in the currently loaded webpage is uploaded to the server side.

The third setting rule may also be set by a person skilled in the art according to actual needs, for example, set to set the acquired image attribute information according to the set time interval, and the like. The setting of the third setting rule may be the same as or different from the first setting rule and the second setting rule.

Preferably, the browser can also obtain information about the current user account, wherein the information of the user account includes information of at least one other user account associated with the user account. At this time, the step of receiving the keyword corresponding to the attribute information returned by the server side includes: receiving the review information returned by the server side with the at least one other user account for the picture element and the identification information of the at least one other user account.

It should be noted that the step of the browser acquiring the information of the current account may be performed before step S208, and the execution after step S208 may also be performed in parallel with step S208.

Step S210: The browser stores the corresponding relationship between the received attribute information and the keyword in a memory corresponding to the browser.

The corresponding relationship between the received picture attribute information and the picture keyword is stored in the memory corresponding to the browser, and the browser can determine the picture keyword corresponding to the triggered picture element according to the correspondence.

When the browser currently loads the webpage to be closed, the browser deletes the correspondence between the attribute information of the webpage element and the keyword in the webpage stored in the memory corresponding to the browser.

It should be noted that, this step is an optional step, and the browser stores the corresponding relationship between the attribute information of the webpage element and the keyword in the memory corresponding to the browser, thereby improving the efficiency of the scheme execution, and on the other hand, When the webpage element that has obtained the keyword is triggered again, it is no longer necessary to send and obtain related data to the server side, and it can be directly obtained from the memory corresponding to the browser, which not only improves the keyword acquisition efficiency, but also reduces the network. Data transfer and interaction burden.

Step S212: The browser monitors a first triggering operation on some or all of the webpage elements in the at least one webpage element.

The first triggering operation may be a triggering operation generated when the user clicks on the webpage element by the mouse, or may be a triggering operation generated by the user placing the mouse on the webpage element, or the user may select all or select some webpage elements through the shortcut key. The triggering operation generated at this time is not specifically limited in this embodiment.

Step S214: The browser determines whether the keyword corresponding to all the webpage elements triggered by the server side has been received; if yes, step S216 is performed, and if no, step S218 is performed.

In this embodiment, since the correspondence between the received attribute information and the keyword is stored in the memory of the browser in the memory corresponding to the browser, it is determined whether there is any triggered webpage element in the memory corresponding to the browser. The keyword can be.

Step S216: When the browser determines that the keyword corresponding to all the triggered webpage elements returned by the server side has been received, the operation of displaying the corresponding keyword at the set position of the triggered webpage element. Then, step S220 is performed.

In this embodiment, the corresponding relationship between the attribute information returned by the server and the keyword is stored in the memory corresponding to the browser. Therefore, when acquiring the corresponding keyword of all the webpage elements that are triggered, the first determination is triggered. The attribute information of all the webpage elements, and then determining the keyword corresponding to the triggered webpage element according to the determined attribute information and the correspondence between the attribute information of the webpage element stored in the memory corresponding to the browser and the keyword, and is triggered The determined keyword is displayed at the set position of the web page element.

In addition to determining the keyword corresponding to the webpage element by using the attribute information of the webpage element, the identifier information may be set for each webpage element, and the corresponding relationship between the identifier information of the webpage element and the keyword is stored in the memory corresponding to the browser. When the keyword corresponding to the triggered webpage element is obtained, the identifier information corresponding to the triggered webpage element is determined, and the corresponding keyword is searched by the identifier information and the corresponding relationship between the identifier information and the keyword stored in the memory corresponding to the browser. .

Step S218: When the browser determines that the keyword corresponding to all the webpage elements that are triggered by the server side is not received, the keyword is displayed only at the set position of the webpage element corresponding to the received keyword, and according to the The fourth setting rule continues to send the attribute information of the webpage element that has not received the keyword to the server side.

The fourth setting rule can be set by a person skilled in the art according to actual needs, as long as the keywords corresponding to all the triggered webpage elements are obtained, which is not limited in this embodiment.

For example, the fourth setting rule is set to send the attribute information of all the webpage elements that are triggered but not received the keyword to the server side, and receive the keyword returned by the server side to determine whether all the received messages are triggered. If the keyword of the webpage element is not received, the attribute information of the webpage element sent to the server side is received, the keyword is received, and whether all the triggers are received is determined. The keyword action of the page element until the browser receives the keywords of all the triggered page elements. For another example, the attribute information of the webpage element that is triggered but does not receive the keyword is grouped, and the attribute information of each group of webpage elements is sequentially sent according to the set time interval until the key of all the triggered webpage elements is received. So far.

It should be noted that, for the display position of the keyword, the corresponding keyword may be displayed at any suitable position of each webpage element, for example, the upper left corner, the upper right corner, the lower left corner of the webpage element, etc., the implementation This example does not impose any specific restrictions. For the display manner of the keyword, the embodiment does not specifically limit, for example, it can be directly displayed on the webpage element, or a bubble can be generated, the keyword is displayed in the bubble, and of course, other display manners are no longer used in this embodiment. List one by one.

Step S220: The browser detects a second triggering operation on the corresponding keyword, and initiates a keyword-based preset operation on the browser side.

The keyword may include information such as an e-commerce webpage URL, a public number, a name of an object displayed in the webpage element, and an object type displayed in the webpage element.

The preset operation includes at least one of: an operation of performing a webpage search using a keyword, an access operation of a public number corresponding to the keyword, an access operation of the e-commerce webpage URL corresponding to the keyword, and a type indicated by the keyword. The image is searched for.

The second triggering operation may be a triggering operation generated by the user clicking a certain information in the keyword by the mouse, and may be a triggering operation generated by the user selecting a certain keyword by using the external device, and the second triggering operation is not specifically performed in this embodiment. limited.

When the preset operation is an operation of searching for a webpage by using a keyword, monitoring a second triggering operation on the corresponding keyword, and performing a keyword-based preset operation step on the browser side includes: monitoring any of the displayed The second triggering operation of the keyword generates a search request containing the keyword; invoking the browser's search engine, performing a search query according to the search request; and receiving and displaying the result of the search query. For example, the keyword corresponding to an audio element is the name of the player who sings the audio, and when the user performs the second triggering operation on the keyword, a search for the player is performed, and detailed information about the player is provided.

When the preset operation is an access operation to the public number corresponding to the keyword, the browser side initiates access to the public number, thereby implementing access to the public number.

When the preset operation is an access operation to the e-commerce webpage URL corresponding to the keyword, the browser side obtains the e-commerce webpage URL selected by the user, accesses the webpage URL, and displays the corresponding webpage.

When the preset operation is an operation of searching for a picture of a type indicated by the keyword, the browser side determines the type indicated by the picture keyword, invokes a search engine to search for a picture related to the type, and displays the searched picture. For example: image keyword refers to The picture is the appearance of the Audi A6, then the type indicated by the keyword is the Audi A6. When the browser searches for the picture of the type indicated by the picture keyword, the image related to the Audi A6 is searched and displayed. Such as Audi A6's car lights pictures, car configuration pictures, engine pictures and so on.

Of course, the preset operation may also be an operation of searching for the audio of the type indicated by the keyword corresponding to the audio element, the browser side determines the type indicated by the keyword, invokes the search engine to search for the audio related to the type, and displays the search. Audio. For example, if the keyword corresponding to the audio element indicates that the audio is pop music of a certain player, then the type indicated by the keyword is the audio of the player's popular music, and the audio of the type indicated by the keyword corresponding to the audio is browsed. When searching, the audio of the pop music played by the performer is displayed after the audio search.

The preset operation may also be an operation of searching for a video of a type indicated by a keyword corresponding to the video element, the browser side determines the type indicated by the keyword, invokes a search engine to search for the related video of the type, and displays the searched video. . For example, if the keyword corresponding to the video element indicates that the video is an action movie of a movie star, the type indicated by the keyword is the video of the action movie of the movie star, and the browsing searches for the video of the type indicated by the keyword corresponding to the video. At the time, the video of the movie star's action movie is searched for and displayed.

Preferably, the keyword may also be set to include the phone number information corresponding to the webpage element, and the user may implement the effect of dialing the e-commerce call by the mobile terminal by using the phone number information in the keyword. Specifically, the process of making a call includes: the browser detects a trigger operation of the phone number indicated by the phone number information included in the keyword, and dials the phone number through the mobile terminal.

Example 3

Referring to FIG. 3, a flow chart of steps of a method for processing picture information in a browser according to Embodiment 3 of the present invention is shown.

The method for processing picture information in the browser of this embodiment includes the following steps:

Step S302: Acquire image attribute information of at least one picture element that satisfies the set condition in the currently loaded webpage of the browser.

The setting conditions in this embodiment can be set by a person skilled in the art according to actual needs, for example, setting the setting conditions to the set size, the set size, the setting type, and the like. Preferably, the picture attribute information of the at least one picture element that satisfies the set size in the currently loaded webpage of the browser may be acquired.

The specific picture attribute information obtained may also be set by a person skilled in the art according to requirements in actual operation. For example, it is set to obtain only the uniform resource locator URL of the picture, or only the title of the picture, and of course, it can also be set to obtain other attribute information, so as to ensure that the acquired picture attribute information can uniquely identify a picture element.

Step S304: Send the acquired picture attribute information to the server side, and receive the picture keyword corresponding to the picture attribute information returned by the server side.

The server side stores the corresponding relationship between the picture attribute information and the picture keyword. After receiving the picture attribute information, the server side obtains the picture keyword corresponding to the picture attribute information by searching for the corresponding relationship, and returns the picture keyword to the browser.

Step S306: The first triggering operation on some or all of the picture elements in the at least one picture element is monitored, and the corresponding picture keyword is displayed at the set position of the triggered picture element.

In this embodiment, the first triggering operation performed on some or all of the picture elements in the at least one picture element includes, but is not limited to, suspension, clicking, selecting, and the like, for example, selecting a picture element by using a mouse or at a certain The suspension of the image element over a certain period of time may implement the first triggering operation on the image element, or may select multiple image elements at a time through the shortcut key to implement the first triggering operation on multiple image elements.

The display position of the picture keyword may be set to be displayed at any suitable position of the picture element, for example, the upper left corner, the upper right corner, and the lower left corner of the picture element, which is not specifically limited in this embodiment. The display manner of the keyword is not specifically limited in this embodiment. For example, it can be displayed directly on the picture element, or a bubble can be generated, the picture keyword is displayed in the bubble, and of course, other display modes are used in this implementation. The examples are no longer listed one by one.

Step S308: The second triggering operation on the corresponding picture keyword is monitored, and the preset operation based on the picture keyword is initiated on the browser side.

The method for processing the picture information in the browser provided in this embodiment can obtain, from the server side, a keyword corresponding to the picture element that satisfies the setting condition in the currently loaded web page, and when the user detects a certain picture element that satisfies the setting condition When the first triggering operation is performed, the keyword corresponding to the picture element is displayed at the set position of the triggered picture element, so that the existing browser client cannot provide the appearance of the object other than the image display. Other related information issues. In the meantime, the method for processing picture information in the browser provided in this embodiment can also detect the second triggering operation of the picture keyword displayed in the setting position of the picture element, and initiate the image keyword based on the browser client side. The preset operation, for example, using a picture keyword to perform a webpage search, accessing an e-commerce webpage URL corresponding to the image keyword, and the like, and providing a webpage information and a picture keyword corresponding to the image keyword through the preset operation. The e-commerce information, etc., thus providing the user with more comprehensive information about the picture element.

Example 4

Referring to FIG. 4, a flow chart showing the steps of a method for processing picture information in a browser according to Embodiment 4 of the present invention is shown.

The method for processing picture information in the browser in this embodiment specifically includes the following steps:

Step S402: The browser determines whether the currently loaded webpage is a secure webpage; if yes, step S404 is performed, and if not, the first setting operation is performed.

Step S4022: The browser acquires webpage attribute information of the currently loaded webpage.

Step S4024: The browser sends the acquired webpage attribute information to the browser-independent application.

Step S4026: The browser receives the security identifier corresponding to the webpage attribute information returned by the browser-independent application, where the security identifier is used to indicate whether the currently loaded webpage is a secure webpage.

The browser determines whether the webpage currently loaded by the browser is a secure webpage by using the security identifier obtained in the above steps S4022 to S4026. If the obtained security identifier indicates that the currently loaded webpage is a secure webpage, step S404 and subsequent steps of acquiring the image attribute information of the at least one picture element satisfying the set condition in the currently loaded webpage of the browser are performed. If the security identifier indicates that the currently loaded web page is not a secure web page, the first setting operation is performed.

Step S404: When the browser determines that the currently loaded webpage is a secure webpage, it further determines whether the currently loaded webpage has the authority to perform image recognition on the server side; if yes, step S406 is performed, and if not, the second setting operation is performed.

Preferably, the browser can determine whether the currently loaded webpage has the server side-in by the following three specific manners. The permissions for line image recognition are as follows:

The first way is to determine whether the currently loaded web page has the right to enable the server side to perform image recognition through a browser-independent application. The specific process is as follows:

The browser obtains the webpage attribute information of the currently loaded webpage; sends the obtained webpage attribute information to the browser-independent application; and receives the permission identifier corresponding to the webpage attribute information returned by the browser-independent application, wherein the permission identifier is used by the browser And indicating that the currently loaded webpage has the right to enable the server side to perform image recognition on the picture element in the currently loaded webpage; if the permission identifier indicates that the currently loaded webpage has the right to enable the server side to perform the image recognition, step S406 is performed: acquiring the browser The picture attribute identification information of at least one picture element that satisfies the set condition in the currently loaded webpage.

In this mode, the server side can only support image recognition of image elements in certain types of webpages, and the browser-independent application obtains these specific types of related information, and the webpages sent by the browser are independent of the browser application. The attribute information determines the type of the webpage currently loaded by the browser, and then determines whether the type of the currently loaded webpage is in a specific type. If the type of the currently loaded webpage is in a specific type, the application independent of the browser generates an indication. The current loading webpage is a permission identifier that causes the server side to perform image recognition on the picture elements in the currently loaded webpage. If the type of the currently loaded webpage is not in a specific type supported by the server side, the browser-independent application generates a permission to indicate that the currently loaded webpage does not have the right to enable the server side to perform image recognition permission on the picture element in the currently loaded webpage. Logo. After the browser receives the permission identifier sent by the browser-independent application, it can determine whether the currently loaded webpage has the right to enable the server side to perform image recognition according to the type of the permission identifier.

The second way is to determine whether the currently loaded web page has the right to enable the server side to perform image recognition through the server side. The specific process is as follows:

The browser obtains the webpage attribute information of the currently loaded webpage; the obtained webpage attribute information is sent to the server side, and receives the judgment result returned by the server side, wherein the judgment result carries the server side determining according to the webpage attribute information, determining the current loading Whether the webpage supports the information of the webpage recognized by the image; if the result of the judgment indicates that the currently loaded webpage supports the image recognition, step S406 is performed: acquiring the image attribute information of the at least one picture element that satisfies the set condition in the currently loaded webpage of the browser.

The third way is to determine whether the currently loaded web page has the right to enable the server side to perform image recognition by whether the browser can receive the query sent by the server side. The specific process is as follows:

The browser receives a message sent by the server side to query whether the picture is currently uploaded, and returns a response message to the server side. The response message carries information indicating whether to accept the picture recognition of the current web page by the server side.

In this manner, the server side sends an inquiry message to the browser side after determining that the browser currently loading the webpage has the authority to perform the image recognition on the server side. If the server side does not send an inquiry message to the browser, it proves that the webpage currently loaded by the browser does not have the authority to make the image recognition on the server side. The browser can determine whether the currently loaded web page has the right to enable the server side to perform picture recognition by receiving the inquiry information sent by the browser side.

At this time, after receiving the inquiry message sent by the server side, the browser may actively control whether to accept the server side to perform the picture on the currently loaded webpage by returning information indicating whether to accept the image recognition of the currently loaded webpage by the server side. Identification. After the browser determines to return to the server side a response message indicating that the currently loaded webpage accepts the information of the server side for performing picture recognition, step S406 is performed: acquiring at least one of the currently loaded webpages of the browser that satisfies the set condition. The picture attribute information of the picture element.

It should be noted that, in the foregoing, three different methods for determining whether the currently loaded webpage has the right to perform image recognition on the server side may be selected by a person skilled in the art in the actual implementation process. Combine to make relevant judgments. Moreover, the above steps S402 to S404 are optional steps. In actual applications, the security of the webpage and the identity of the image recognition may not be distinguished. The default is that both the security and the image recognition permission are met. Certainly, the solution of the above steps S402 to S404 is adopted, which further improves the security of the picture information processing scheme of the embodiment of the present invention. Sex.

Step S406: The browser acquires the image attribute information corresponding to the at least one picture element that satisfies the setting condition in the currently loaded webpage.

After determining that the browser currently loads the webpage as a secure webpage and has the authority to perform the image recognition on the server side, the browser may be triggered to perform step S406 in any of the following three situations, specifically, in step S402 to step S404. as follows:

The first type acquires the image attribute information of the at least one picture element that satisfies the set condition in the currently loaded webpage of the browser when the loading of the currently loaded webpage is completed.

Secondly, when the mouse scrolling instruction is received under the currently loaded webpage, the image attribute information of the at least one picture element that satisfies the set condition in the currently loaded webpage of the browser is obtained.

Thirdly, when it is determined that there is a picture element that satisfies the setting condition in the currently loaded webpage, the image attribute information of the at least one picture element that satisfies the setting condition in the currently loaded webpage of the browser is obtained.

It should be noted that the set condition that is satisfied in this embodiment can be set by a person skilled in the art according to actual needs, for example, setting the setting condition to the set size, the setting type, setting the picture resolution, and the like. . A preferred setting manner is to selectively obtain the picture attribute information corresponding to the picture element in the currently loaded webpage by using the size of the picture element as a setting condition. That is, the browser acquires image attribute information corresponding to at least one picture element that satisfies the set size in the currently loaded web page.

In this embodiment, the following steps are taken as an example to obtain image attribute information corresponding to at least one picture element that meets the set size in the currently loaded web page. It should be noted that the setting of the size of the picture element may be set by a person skilled in the art according to actual needs, which is not specifically limited in this embodiment.

It should be noted that, when the browser obtains the image attribute information corresponding to the at least one picture element of the set size in the currently loaded webpage, the browser may set the specific manner of obtaining according to actual requirements, for example, obtaining all the currently loaded webpages at one time. The image attribute information corresponding to the picture element of the set size is satisfied, for example, the image attribute information corresponding to the image element that meets the set size is obtained first, and the acquired image attribute information is sent to the server side to obtain other remaining Picture element. This embodiment does not specifically limit the manner in which the browser obtains the picture attribute information of the picture element in the currently loaded web page.

The image attribute information may include at least one of a URL, a title of the picture, a picture description information, a mark of the webpage where the picture is located, and a picture resolution. Preferably, the URL corresponding to the picture element is obtained as the picture attribute information, because each page in the webpage Each image element has a URL, so it is more convenient to get the URL corresponding to the image element. In this embodiment, the following steps are described by taking the URL of the acquired image as an example.

Step S408: The browser sends the acquired picture attribute information to the server side, and receives the picture keyword corresponding to the picture attribute information returned by the server side.

Preferably, the browser encrypts the acquired picture attribute information and sends it to the server side, and receives the encrypted picture keyword corresponding to the picture attribute information returned by the server side.

In this embodiment, the browser sends the acquired image attribute information to the server side, which may be adopted by any person skilled in the art according to actual conditions, and may be set to be acquired according to any one of the following three transmission modes. The picture attribute information is sent to the server side as follows:

The first type, all the acquired image attribute information is packaged and uploaded to the server side.

Secondly, all the acquired image attribute information are grouped according to the set criteria, and each set of picture attribute information is sequentially uploaded according to the first setting rule.

It should be noted that, for the setting standard, this is not specifically limited in this embodiment, and may be set to group the picture attribute information according to the set quantity, or may be set to group according to the size of the picture element size, and may also be configured. Set to follow The picture attribute information, the picture title, and the like may be grouped into image attribute information, or may be set to be grouped according to the amount of uploaded picture data.

In the specific implementation process, the first setting rule may also be set by a person skilled in the art according to actual requirements, which is not specifically limited in this embodiment. For example, the first setting rule may be set to upload each group of image attribute information according to a specific time interval, and may also be configured to upload a second group of picture attribute information after the first group of picture attribute information is uploaded.

The third type, after uploading the currently acquired picture attribute information to the server side, continues to obtain the picture attribute information of the picture element that satisfies the set condition remaining in the currently loaded webpage, and uploads and continues to acquire according to the second setting rule. The picture attribute information of the picture element is sent to the server side until all the picture attribute information of the picture element satisfying the setting condition in the currently loaded web page is uploaded to the server side.

The second setting rule may also be set by a person skilled in the art according to actual needs, for example, set to set the acquired image attribute information in groups according to the set time interval, and the like. The setting of the second setting rule may be the same as or different from the first setting rule.

Preferably, the browser can also obtain information about the current user account, wherein the information of the user account includes information of at least one other user account associated with the user account. At this time, the step of receiving the picture keyword corresponding to the picture attribute information returned by the server side comprises: receiving the review information returned by the server side with the at least one other user account for the picture element and the identification information of the at least one other user account.

It should be noted that the step of the browser acquiring the information of the current account may be performed before step S408, and the execution after step S408 may also be performed in parallel with step S408.

Step S410: The browser stores the corresponding relationship between the received image attribute information and the picture keyword in a memory corresponding to the browser.

When the browser currently loads the webpage, the browser deletes the correspondence between the image attribute information of the picture element and the picture keyword in the webpage stored in the memory corresponding to the browser.

It should be noted that, this step is an optional step, and the browser stores the corresponding relationship between the received image attribute information and the picture keyword in the memory corresponding to the browser, thereby improving the efficiency of the scheme execution, and on the other hand, When the image that has obtained the image keyword is triggered again, it is no longer necessary to send and obtain related data to the server side, and it can be directly obtained from the memory corresponding to the browser, which improves the efficiency of obtaining the image keyword and reduces the efficiency. Network data transmission and interaction burden.

Step S412: The browser monitors a first triggering operation on some or all of the picture elements in the at least one picture element.

The first triggering operation may be a triggering operation generated when the user clicks on the image by the mouse, or may be a triggering operation generated by the user placing the mouse on the image, or may be when the user selects or selects some of the images through the shortcut keys. The generated triggering operation is not specifically limited in this embodiment.

Step S414: The browser determines whether the picture keyword corresponding to all the picture elements that are triggered by the server side has been received; if yes, step S416 is performed, and if no, step S418 is performed.

In this embodiment, since the correspondence between the received picture attribute information and the picture keyword is stored in the memory of the browser in the memory corresponding to the browser, it is determined whether the memory corresponding to the browser exists. The image keyword corresponding to all the image elements triggered can be used.

Step S416: When the browser determines that the picture keyword corresponding to all the picture elements triggered by the server side has been received, the operation of displaying the corresponding picture keyword at the set position of the triggered picture element is performed. Then, step S420 is performed.

In this embodiment, the corresponding relationship between the image attribute information returned by the server side and the picture keyword is stored in the memory corresponding to the browser. Therefore, when acquiring the corresponding picture keyword of all the picture elements that are triggered, Determining the picture attribute information of all the picture elements that are triggered, and then according to the determined picture attribute information and the in-memory storage corresponding to the browser The corresponding relationship between the picture attribute information and the picture keyword determines the picture keyword corresponding to the triggered picture element, and displays the determined picture keyword at the set position of the triggered picture element.

In addition to determining the picture keyword corresponding to the picture element by using the picture attribute information, the identifier information may be set for each picture element, and the corresponding relationship between the identification information of the picture element and the picture keyword is stored in the memory corresponding to the browser. When the picture keyword corresponding to the triggered picture is obtained, the identifier information corresponding to the triggered picture element is determined, and the corresponding picture is found by using the identification information and the correspondence between the identification information stored in the memory corresponding to the browser and the picture keyword. Keyword.

Step S418: When the browser determines that the picture keyword corresponding to all the picture elements that are triggered by the server side is not received, the picture keyword is displayed only at the set position of the picture element corresponding to the received picture keyword. And continuing to send the picture attribute information of the picture element that has not received the picture keyword to the server side according to the third setting rule.

The third setting rule can be set by a person skilled in the art according to actual needs, as long as the keywords corresponding to all the triggered picture elements are obtained, which is not limited in this embodiment. For example, the third setting rule is set to send the picture attribute information of all the picture elements that are triggered but not received the picture keyword to the server side, and receive the picture keyword returned by the server side to determine whether all the messages are received. If the picture key of the triggered picture element is still not received, the image attribute information is sent to the server side, the picture keyword is received, and whether all the received pictures are received is cyclically executed. The picture key action of the triggered picture element until the browser receives the picture key of all the triggered picture elements. For example, the picture attribute information of the picture element that is triggered but does not receive the picture keyword is grouped, and each group of picture attribute information is sequentially sent according to the set time interval until the picture key of all the triggered picture elements is received. So far.

It should be noted that, for the display position of the picture keyword, it may be set to display the corresponding picture keyword at any suitable position of each picture element, for example, the upper left corner, the upper right corner, the lower left corner and the like of the picture element, This embodiment does not specifically limit this. The display mode of the picture keyword is not limited in this embodiment. For example, the image element may be directly displayed on the picture element, or a bubble may be generated, and the picture keyword may be displayed in the bubble, and of course, other display modes are also used in this embodiment. No longer list them one by one.

Step S420: The browser detects a second triggering operation on the corresponding picture keyword, and initiates a preset operation based on the picture keyword on the browser side.

The image keyword may include information such as an e-commerce webpage URL, a public number, a name of an object displayed in the image element, and an object type displayed in the image element.

The preset operation includes at least one of: an operation of performing a webpage search using an image keyword, an access operation of a public number corresponding to the image keyword, an access operation of an e-commerce webpage URL corresponding to the image keyword, and an image keyword The operation of the indicated type of picture to perform a search.

When the preset operation is an operation of performing webpage search using the image keyword, the second triggering operation for the corresponding image keyword is monitored, and the step of initializing the image keyword based on the browser side includes: monitoring the display The second triggering operation of any of the image keywords generates a search request including the image keyword; invokes a browser search engine to perform a search query according to the search request; and receives and displays the result of the search query.

When the preset operation is an access operation to the public number corresponding to the picture keyword, the browser side initiates access to the public number, thereby implementing access to the public number.

When the preset operation is an access operation to the e-commerce webpage URL corresponding to the image keyword, the browser side obtains the e-commerce webpage URL selected by the user, accesses the webpage URL, and displays the corresponding webpage.

When the preset operation is an operation of searching for a picture of the type indicated by the picture keyword, the browser side determines the picture key The type indicated by the word, the search engine is called to search for related images of the type, and the searched image is displayed. For example, the picture keyword indicates that the picture is an appearance picture of the Audi A6, and the type indicated by the keyword is the Audi A6. When the browser searches for the picture of the type indicated by the picture keyword, it will be related to the Audi A6. After the image search, such as the Audi A6's car lights, car configuration pictures, engine pictures and so on.

Preferably, the picture keyword may also be set to include the phone number information corresponding to the picture element, and the user may implement the effect of dialing the e-commerce phone through the mobile terminal by using the phone number information in the picture keyword. Preferably, the phone number information is an e-commerce in the picture or a phone number information of an e-commerce corresponding to the item in the sales picture. Specifically, the process of making a call includes: the browser detects a trigger operation of the phone number indicated by the phone number information included in the keyword, and dials the phone number through the mobile terminal.

The browser performs the picture information processing method in the browser provided by the embodiment, and the browser can obtain, from the server side, a keyword corresponding to the picture element that meets the set condition in the currently loaded web page, and when the user is satisfied to meet the set condition When the first triggering operation of the picture element is performed, the keyword corresponding to the picture element is displayed at the set position of the triggered picture element, so that the existing browser cannot provide the user with other related information except the appearance of the picture. problem. In the meantime, the method for processing picture information in the browser provided in this embodiment can also detect the second triggering operation of the picture keyword displayed in the setting position of the picture element, and initiate the preset based on the picture keyword on the browser side. The operation, for example, using a picture keyword to perform a webpage search, accessing an e-commerce webpage URL corresponding to the image keyword, and the like, and providing a webpage information related to the image keyword and a photo keyword corresponding to the user through a preset operation The information of the quotient, etc., thus providing the user with more comprehensive information about the picture element.

Example 5

Referring to FIG. 5, a flow chart of the steps of a method for picture recognition according to Embodiment 5 of the present invention is shown.

The picture recognition method of this embodiment includes the following steps:

Step S502: Receive a first triggering operation for identifying the picture.

The picture is the picture in the browser's currently loaded web page or the local picture obtained by the browser.

The first triggering operation for recognizing the picture includes, but is not limited to, uploading the picture to a set area of the browser, dragging the picture to the browser setting area, and the like. For example, in the address bar of the browser, select uploading a browser local image, or dragging a picture in the browser's currently loaded webpage to the set location of the browser address bar, and directly loading the currently loaded webpage. When the picture is operated, such as clicking or hovering for a certain time, the first triggering operation for recognizing the picture can be realized.

Step S504: Send attribute information of the picture and/or picture to the server side.

It should be noted that a person skilled in the art can set specific information sent to the server side according to actual needs. It can be set to directly send the picture to the server side, or can be set to send the attribute information corresponding to the picture to the server side when the picture is the picture currently loaded by the browser, and can also be set to simultaneously display the picture and the picture attribute information. Send to the server side.

A preferred setting manner is: when the picture is a local picture of the terminal where the browser is located, uploading the picture to the server side through the browser, and when the picture is the picture currently loaded by the browser, the attribute information of the picture, such as a URL (Uniform Resource Locator) is sent to the server side, and directly transmitting the attribute information of the picture to the server side can reduce the amount of data transmitted.

Step S506: Receive and display the keyword corresponding to the picture returned by the server side.

The keyword is searched by the server side according to the attribute information corresponding to the picture and/or the picture.

The specific implementation manner of the keyword searching by the server side according to the attribute information corresponding to the picture and/or the picture is not specifically limited in this embodiment, and any suitable manner may be selected by a person skilled in the art according to actual needs to implement the keyword search.

With the picture recognition method provided by the embodiment, the browser receives the first trigger operation for identifying the picture, and sends the attribute information of the picture and/or the picture to the server side, and receives and displays the keyword corresponding to the picture returned by the server side. . Therefore, with the picture recognition method provided by the embodiment, the user can identify the picture of interest through the browser, and obtain the keyword corresponding to the picture, so as to obtain other related information except the appearance of the picture.

Example 6

Referring to FIG. 6, a flow chart of steps of a method for picture recognition according to Embodiment 6 of the present invention is shown.

The picture recognition method in this embodiment specifically includes the following steps:

Step S602: The browser receives a first triggering operation for identifying the picture.

The browser may be triggered to perform step S602 in any of the following cases, including:

First, the browser receives the uploading of the local image to be uploaded to the browser's setting area according to the instruction to upload the picture.

Secondly, the browser receives the operation of uploading the local image to be uploaded according to the instruction of uploading the image to the set position of the currently loaded webpage of the browser.

Third, the browser receives an operation of dragging and dropping a picture in the currently loaded web page to a set area of the browser.

Fourth, the browser receives an operation of dragging and dropping a picture in the currently loaded web page to a set location of the currently loaded web page.

The setting area may be any suitable area set by a person skilled in the art according to actual needs, for example, a setting area in the address bar, a setting area in the menu bar, a setting area in the search bar, and the like. The setting position may also be any suitable position set by a person skilled in the art according to actual needs, for example, an appropriately sized area in the lower right corner of the web page, an appropriately sized area in the upper left corner of the web page, and the like.

When the picture to be identified is the picture currently loaded in the webpage, a preferred manner is to determine the security of the currently loaded webpage before performing the first triggering operation step of identifying the image, if the currently loaded webpage is The secure webpage receives the first triggering operation step of identifying the image. If the currently loaded webpage is not a secure webpage, the first setting operation is performed.

The first setting operation may be any suitable operation set by a person skilled in the art according to actual needs, such as refusing to perform image recognition on the currently loaded picture in the webpage.

A preferred way for a browser to determine whether a currently loaded web page is a secure web page is as follows:

The browser obtains the webpage attribute information of the webpage; sends the obtained webpage attribute information to the browser-independent application; and receives the security identifier corresponding to the webpage attribute information returned by the browser-independent application, wherein the security identifier is used for Indicates if the page is a secure web page. The browser determines whether the browser currently loads the webpage as a secure webpage by obtaining the security identifier.

It should be noted that, in an actual application, the step is an optional step, and the security of the currently loaded webpage may not be distinguished. The default is that the currently loaded webpage meets the security. Of course, the scheme of this step is adopted to further improve the security of the picture recognition scheme of the embodiment of the present invention.

Step S604: The browser encrypts the attribute information of the picture and/or picture to be identified and sends it to the server side.

As described in the first embodiment, the browser may select to send the picture or picture attribute information to the server side, or send the picture and picture attribute information to the server side. The browser may also select the sent information according to the type of the image. When the image is a locally uploaded image, the image is directly sent to the server side. When the image is the currently loaded image in the webpage, the attribute information of the image is sent to Server side.

The attribute information of the picture includes at least one of a URL of the picture, a title of the picture, a description information of the picture, and a mark of the webpage where the picture is located. Preferably, the URL corresponding to the picture is obtained as the attribute information of the picture currently loaded in the webpage, Each picture element in the web page has a URL, so it is more convenient to get the URL corresponding to the picture.

In this embodiment, the following steps are described by taking the local picture of the terminal where the browser is located as an example. After receiving the first triggering operation for identifying the acquired local image, the browser sends the acquired image to the server side, and the server searches for the keyword corresponding to the image according to the received image.

Step S606: The browser receives and displays the encrypted keyword corresponding to the picture returned by the server side.

There are two systems on the server side, an online query system and an offline processing system. The online query system searches for the corresponding keyword according to the attribute information of the picture and/or the picture, for example, the URL of the picture, and if the server side searches for the keyword corresponding to the attribute information of the picture or the picture from the cache, the system directly returns to the browsing. Device.

If the server side does not find the keyword corresponding to the attribute information of the picture or the picture, the server side may obtain the keyword corresponding to the attribute information of the picture and/or the picture through the offline processing system, if the server receives the picture The attribute information can be downloaded according to the attribute information, and the server receives the picture without performing the operation of downloading the corresponding picture. The server side classifies and clusters the pictures through image analysis technology, so that the same picture label texts can be aggregated, and the text analysis technology is used to comprehensively analyze and calculate the aggregated text and picture classification information to obtain the keywords corresponding to the pictures, and the key will be obtained. The correspondence between the word and the picture and/or the picture attribute information is cached on the server side, so that the server side searches for a keyword corresponding to the attribute information of the picture and/or the picture. After the server side finds the keyword corresponding to the picture according to the attribute information of the picture and/or picture sent by the browser, the keyword returns the keyword to the browser. Preferably, the server side encrypts the keyword and returns to the browser, and encrypts the keyword and returns to ensure the security of the transmitted data.

In this embodiment, since the server receives the picture information of the picture to be identified, the server directly searches for the corresponding keyword according to the picture in the above manner.

For the browser to display the encrypted keywords corresponding to the image returned by the server side, there are the following preferred display modes:

First, when the picture is a local picture acquired by the browser, the browser receives the keyword corresponding to the picture returned by the server side, and displays the received keyword at the set position of the picture acquired by the browser.

The setting position may be any suitable position of the picture, for example, the upper left corner, the upper right corner, the lower left corner, and the like of the image, which is not specifically limited in this embodiment.

Secondly, when the picture is a local picture acquired by the browser, the browser receives the keyword corresponding to the picture returned by the server side, and displays the locality at the set position of the currently loaded web page or the set position of the newly generated web page. Images and/or received keywords.

Thirdly, when the picture is a picture in the current loading webpage of the browser, the browser receives the keyword corresponding to the picture returned by the server side, and the picture in the setting area of the browser or the setting position of the currently loaded webpage. The received keyword is displayed at the set position.

Fourthly, when the picture is a picture in the browser currently loading the webpage, the browser receives the keyword corresponding to the picture returned by the server side, and displays the received keyword at the set position of the picture in the currently loaded webpage. .

Step S608: The browser stores the correspondence between the received picture and the keyword, and/or the correspondence between the attribute information of the picture and the keyword in the memory corresponding to the browser.

The corresponding relationship between the received picture and the keyword and/or the correspondence between the attribute information of the picture and the keyword is stored in the memory corresponding to the browser, and the second trigger for identifying the picture that has completed the picture recognition operation is received again. During operation, the browser can search for the keyword corresponding to the image from the memory corresponding to the browser through the attribute information of the image and/or the image.

It should be noted that, this step is an optional step, and the browser stores the corresponding relationship between the received picture and the keyword, and/or the corresponding relationship between the attribute information of the picture and the keyword in the memory corresponding to the browser. The aspect improves the efficiency of the scheme execution. On the other hand, when the image that has obtained the image keyword is triggered again, it is no longer necessary to send and obtain to the server side. The relevant data can be obtained directly from the memory corresponding to the browser, which not only improves the efficiency of image keyword acquisition, but also reduces the network data transmission and interaction burden.

Step S610: The browser receives a second triggering operation on the displayed keyword, and generates a search request including the keyword.

The second triggering operation may be a triggering operation generated by the user clicking a certain information in the keyword by using a mouse, and may be a triggering operation generated by the user selecting a certain keyword by using an external device, and the second triggering operation is generated in this embodiment. No specific limitation.

Step S612: The browser invokes the browser's search engine to perform a search query according to the search request.

Step S614: The browser receives and displays the result of the search query.

For example, the user identifies a picture with green radish by step S602 to step S606, and the browser receives and displays the keyword "green radish" corresponding to the picture returned by the server side, when the user performs the first keyword on the keyword "green radish" In the second triggering operation, the browser generates a search request containing "green radish" and displays the result of the search. The search result may include more detailed information about the growing habits and effects of the green radish.

With the picture recognition method provided by the embodiment, the browser receives the first trigger operation for identifying the picture, and sends the attribute information of the picture and/or the picture to the server side, and receives and displays the keyword corresponding to the picture returned by the server side. . Therefore, with the picture recognition method provided by the embodiment, the user can identify the picture of interest through the browser, and obtain the keyword corresponding to the picture, so as to obtain other related information except the appearance of the picture. In the meantime, the image recognition method provided in this embodiment can also receive a second triggering operation on the displayed keyword, generate a search request including the keyword, and display the webpage information that is searched by the user through the keyword, because the webpage information includes A large amount of information related to the picture, therefore, can provide the user with more comprehensive information about the picture.

Example 7

Referring to FIG. 7, a block diagram of a browser client of Embodiment 7 of the present invention is shown.

The browser client of the embodiment includes: an obtaining module 702, configured to acquire attribute information of at least one webpage element in a webpage currently loaded by the browser; and a sending module 704, configured to send the acquired attribute information to the server side, and receive a keyword corresponding to the attribute information returned by the server side; the display module 706 is configured to monitor a first triggering operation on some or all of the webpage elements in the at least one webpage element, and display at the set position of the triggered webpage element a corresponding keyword; a preset operation initiating module 708, configured to monitor a second triggering operation on the corresponding keyword, and initiate a preset operation based on the keyword on the browser side.

The browser client provided in this embodiment can obtain, from the server side, a keyword corresponding to at least one webpage element in the currently loaded webpage, and when the first triggering operation of the webpage element by the user is detected, the triggered webpage is triggered. The keyword corresponding to the webpage element is displayed at the set position of the element, and therefore, the problem that the existing browser cannot provide the user with other related information except the link corresponding to the webpage element can be solved. In the meantime, the browser client provided in this embodiment can also detect the second triggering operation on the displayed keyword, and initiate a keyword-based preset operation on the browser side, for example, using a keyword to perform a webpage search, The preset operation can provide the user with information about the keyword related webpage, thereby providing the user with more comprehensive information about the webpage element.

Example 8

Referring to FIG. 8, a block diagram of a browser client of Embodiment 8 of the present invention is shown.

In this embodiment, the browser client in the third embodiment is further optimized. The optimized browser client includes: an obtaining module 802, configured to acquire attribute information of at least one webpage element in the currently loaded webpage of the browser; The module 804 is configured to send the acquired attribute information to the server side, and receive a keyword corresponding to the attribute information returned by the server side. The display module 806 is configured to monitor some or all of the webpage elements in the at least one webpage element. First triggering operation, Displaying a corresponding keyword at a set position of the triggered webpage element; a preset operation initiation module 808, configured to monitor a second triggering operation on the corresponding keyword, and initiate a keyword-based preset on the browser side operating.

Preferably, the obtaining module 802 is configured to acquire attribute information of audio in the webpage currently loaded by the browser, and/or attribute information of the video, and/or attribute information of the picture.

Preferably, the preset operation includes at least one of: an operation of performing a webpage search using a keyword, an access operation of a public number corresponding to the keyword, an access operation of the e-commerce webpage URL corresponding to the keyword, and a keyword An operation that indicates the type of picture to search.

Preferably, the browser client of the embodiment further includes: a storage module 810, configured to store, after the sending module receives the keyword corresponding to the attribute information returned by the server side, the corresponding relationship between the received attribute information and the keyword In the memory corresponding to the browser; the display module 806 is configured to monitor a first triggering operation on some or all of the webpage elements in the at least one webpage element, determine attribute information of the triggered webpage element; and according to the determined attribute information and The corresponding relationship between the attribute information and the keyword stored in the memory corresponding to the browser determines the keyword corresponding to the triggered webpage element, and displays the determined keyword at the set position of the triggered webpage element.

Preferably, when the sending module 804 sends the acquired attribute information to the server side, all the attribute information obtained is packaged and uploaded to the server side at one time; or all the attribute information obtained is grouped according to the setting standard, and according to the first The setting rule uploads each group of attribute information in turn; or, all the attribute information obtained is grouped according to the type of the webpage element, and the attribute information of each type of webpage element is sequentially uploaded according to the second setting rule; or, the current After the obtained attribute information is uploaded to the server side, the attribute information of the remaining webpage elements in the currently loaded webpage is continuously obtained, and the attribute information of the webpage element that continues to be acquired is uploaded to the server side according to the third setting rule until the currently loaded webpage is loaded. All attribute information of all webpage elements is uploaded to the server side.

Preferably, the obtaining module 802 includes: a first obtaining module 8022, configured to acquire, when the current webpage loading is completed, the attribute information of the at least one webpage element in the current loading webpage of the browser; or the second obtaining module 8024, Obtaining the attribute information of the at least one webpage element in the webpage currently loaded by the browser when the mouse scrolling instruction is received in the current loading webpage; or the third obtaining module 8026 is configured to determine that the setting condition is met in the currently loaded webpage When the webpage element is obtained, the attribute information of at least one webpage element in the currently loaded webpage of the browser is obtained.

Preferably, the browser client of the embodiment further includes: a first webpage attribute information obtaining module 812, configured to acquire the browser before the obtaining module 802 obtains the attribute information of the at least one webpage element in the currently loaded webpage of the browser The webpage attribute information of the current webpage is loaded; the first webpage attribute information sending module 814 is configured to send the obtained webpage attribute information to the browser-independent application; the security identifier receiving module 816 is configured to receive the browser-independent application return. The security identifier corresponding to the webpage attribute information, wherein the security identifier is used to indicate whether the currently loaded webpage is a secure webpage; the first invoking module 818 is configured to invoke the obtaining module if the security identifier indicates that the currently loaded webpage is a secure webpage.

Preferably, the browser client of the embodiment further includes: a second webpage attribute information obtaining module 820, configured to acquire the browser before the obtaining module 802 obtains the attribute information of the at least one webpage element in the webpage currently loaded by the browser Currently, the webpage attribute information of the webpage is loaded; the second webpage attribute information sending module 822 is configured to send the obtained webpage attribute information to the browser-independent application; the permission identifier receiving module 824 is configured to receive the browser-independent application return. The permission identifier corresponding to the webpage attribute information, wherein the permission identifier is used to indicate whether the currently loaded webpage has the right to enable the server to identify the webpage element in the currently loaded webpage; the second invoking module 826 is configured to: The current loading web page has the right to enable the server to identify the web page element, and the acquisition module 802 is invoked.

Preferably, the browser client of the embodiment further includes: a third webpage attribute information obtaining module 828, configured to acquire a current browser before the obtaining module acquires attribute information of at least one webpage element in the currently loaded webpage of the browser Loading the webpage attribute information of the webpage; the third webpage attribute information sending module 830 is configured to send the obtained attribute information to the server side, and receive the judgment result returned by the server side, wherein the judgment result carries the server side according to the webpage attribute information Indeed And determining, by the third calling module 832, the acquiring module 802, if the determining result indicates that the currently loaded webpage supports the webpage element identification.

Preferably, the browser client of the embodiment further includes: an inquiry receiving module 834, configured to: before the obtaining module 802 acquires the attribute information of the at least one webpage element in the webpage currently loaded by the browser, whether the inquiry sent by the server side is The message is currently loaded by the webpage to identify the webpage element. The response message returning module 836 is configured to return a response message to the server side, and the response message carries information indicating whether to accept the webpage element identification of the currently loaded webpage by the server side.

Preferably, the obtaining module 802 is configured to obtain, after returning the response message indicating that the current webpage accepts the information of the webpage element identification by the server side, to the server side, acquiring the attribute information of the at least one webpage element in the current loading webpage of the browser.

Preferably, the attribute information of the webpage element includes the URL of the webpage element.

Preferably, the attribute information of the webpage element further includes at least one of the following: a title of the webpage element, description information of the webpage element, and a mark of the webpage where the webpage element is located.

Preferably, the sending module 804 is configured to encrypt the acquired attribute information and send it to the server side, and receive the encrypted keyword corresponding to the attribute information returned by the server side.

Preferably, the display module 806 includes: a receiving determining module 8062, configured to monitor a first triggering operation on some or all of the webpage elements in the at least one webpage element; and determine whether all of the triggered webpage elements returned by the server side have been received a corresponding keyword; a first execution module 8064, configured to: if the determination result of the receiving determination module is yes, perform an operation of displaying a corresponding keyword at a set position of the triggered webpage element; the second execution module 8066, If the result of the determination by the receiving judging module is no, the keyword is displayed only at the set position of the webpage element corresponding to the received keyword, and the sending of the key is not received to the server side according to the fourth setting rule. The attribute information of the page element of the word.

Preferably, the preset operation initiating module 808 includes: a search request receiving module 8082, configured to monitor a second triggering operation on any keyword displayed when the preset operation is an operation of searching for a webpage using a keyword, and generate A search request including a keyword; a search engine invoking module 8084, which is used to invoke a search engine of the browser, performs a search query according to the search request; and a search result display module 8086 is configured to receive and display the result of the search query.

Preferably, the keyword includes the phone number information corresponding to the webpage element, and the preset operation initiating module 808 is configured to monitor the triggering operation of the phone number indicated by the phone number information included in the webpage element, and dial the phone number through the mobile terminal.

Preferably, the browser client of the embodiment further includes: an account information obtaining module 838, configured to acquire information about a current user account of the browser, wherein the information of the user account includes at least one other associated with the user account. The information of the user account; the sending module 804, when receiving the keyword corresponding to the attribute information returned by the server side, receiving the review information returned by the server side with at least one other user account and the identification information of the at least one other user account .

Preferably, the browser client in this embodiment further includes an interface drawing module 840, configured to draw an interactive interface for the browser client, receive input and output information for interacting with the user, and a kernel processing module 842 for parsing and rendering. After the webpage display window is formed, the displayed webpage data can be loaded, and the webpage data is displayed through the interface drawing module.

For example, when the browser client is started, the interface drawing module 840 draws an interactive interface for the browser client. When the user clicks to load a webpage, the kernel processing module 842 parses the rendering data corresponding to the currently loaded webpage, and invokes the interface rendering module 840. The parsed rendered data is drawn into a corresponding web page, that is, a web page currently loaded by the browser. After the interface drawing module 840 draws the webpage, the obtaining module 802 acquires the attribute information of the at least one webpage element in the webpage currently loaded by the browser, and sends the attribute information to the sending module 804, and the sending module 804 sends the acquired attribute information to the server side, and The keyword corresponding to the attribute information returned by the server side is received. The storage module 810 stores the corresponding relationship between the attribute information and the keyword received by the sending module in a memory corresponding to the browser, so that the corresponding keyword is searched from the memory corresponding to the browser when the webpage element is triggered by the first operation. When receiving user input of interaction information for at least one webpage element, the kernel processing module 842 may receive the received interactive letter. The information is converted into a first triggering operation and sent to the display module 806. The display module 806 monitors the first triggering operation on some or all of the webpage elements in the at least one webpage element, and stores the attribute information and the keyword from the memory corresponding to the browser. In the corresponding relationship, the keyword corresponding to the webpage element triggered by the first triggering operation is obtained, and the corresponding keyword is displayed and displayed by the interface drawing module 840 at the set position of the triggered webpage element. When receiving the interaction information of the keyword input by the user, the kernel processing module 842 converts the interaction information into a second trigger operation instruction and sends the message to the preset operation initiation module 808, and the preset operation initiation module 808 monitors the corresponding key. The second triggering operation of the word initiates a keyword-based preset operation on the browser side.

The browser client of the embodiment is used to implement the method for searching for information in the browser in the corresponding browsers in the foregoing Embodiment 1 and Embodiment 2, and has the beneficial effects of the corresponding method embodiments, and details are not described herein again. .

Example 9

Referring to Figure 9, a block diagram of a browser client of Embodiment 9 of the present invention is shown.

The browser client of the embodiment includes: an obtaining module 902, configured to acquire image attribute information of at least one picture element that satisfies a set condition in a currently loaded webpage of the browser; and a sending module 904, configured to: acquire the obtained image The attribute information is sent to the server side, and receives the picture keyword corresponding to the picture attribute information returned by the server side; the display module 906 is configured to monitor some or all of the picture elements in the at least one picture element. a first triggering operation, displaying a corresponding picture keyword at a set position of the triggered picture element; a preset operation initiating module 908, configured to monitor a second triggering operation on the corresponding picture keyword, in browsing The device side initiates a preset operation based on the picture keyword.

The browser client provided in this embodiment can obtain, from the server side, a keyword corresponding to the picture element that satisfies the set condition in the currently loaded webpage, and when the user triggers the first trigger on a certain picture element that satisfies the set condition During operation, the keyword corresponding to the picture element is displayed at the set position of the triggered picture element, and therefore, the problem that the existing browser client cannot provide the user with other related information except the appearance of the picture can be solved. In the meantime, the browser client provided in this embodiment can also detect the second triggering operation of the picture keyword displayed in the setting position of the picture element, and initiate a preset operation based on the picture keyword on the browser client side. For example, using a picture keyword to perform a webpage search, and accessing a preset operation such as an e-commerce webpage URL corresponding to an image keyword, the preset operation can provide the user with information about the webpage related to the image keyword and the e-commerce corresponding to the image keyword. Information, etc., to provide users with more comprehensive information about the picture elements.

Example 10

Referring to FIG. 10, a block diagram showing the structure of a browser client according to Embodiment 10 of the present invention is shown.

In this embodiment, the browser client in the third embodiment is further optimized. The optimized browser client includes: an obtaining module 1002, configured to acquire at least one picture element that meets the set condition in the currently loaded webpage of the browser. a picture attribute information; a sending module 1004, configured to send the acquired picture attribute information to the server side, and receive a picture keyword corresponding to the picture attribute information returned by the server side; the display module 1006 is configured to: Monitoring a first triggering operation on some or all of the at least one picture element, displaying a corresponding picture keyword at a set position of the triggered picture element; and a preset operation initiation module 1008 for monitoring To a second triggering operation on the corresponding picture keyword, a preset operation based on the picture keyword is initiated on the browser side.

Preferably, the obtaining module 1002 is configured to obtain image attribute information corresponding to the at least one picture element that meets the set size in the currently loaded webpage of the browser.

Preferably, the preset operation includes at least one of: an operation of performing webpage search using a picture keyword, an access operation of a public number corresponding to the image keyword, an access operation of an e-commerce webpage URL corresponding to the image keyword, and An operation in which a picture of the type indicated by the picture keyword is searched.

Preferably, the browser client in this embodiment further includes: a storage module 1010, configured to: after the sending module 1004 receives the picture keyword corresponding to the picture attribute information returned by the server side, the received picture attribute information and the picture Keyword The corresponding relationship is stored in a memory corresponding to the browser; the display module 1006 is configured to monitor a first triggering operation on some or all of the picture elements in the at least one picture element, and determine picture attribute information of the triggered picture element; The picture attribute information and the corresponding relationship between the picture attribute information and the picture keyword stored in the memory corresponding to the browser, determining the picture keyword corresponding to the triggered picture element, and displaying the determined position at the set position of the triggered picture element Image keyword.

Preferably, the sending module 1004 sends the acquired image attribute information to the server side: all the acquired image attribute information is all uploaded to the server side at one time; or all the acquired image attribute information is grouped according to the setting criteria. And uploading each group of image attribute information in sequence according to the first setting rule; or, while uploading the currently acquired picture attribute information to the server side, continuing to obtain the picture attribute of the picture element that satisfies the setting condition remaining in the currently loaded webpage The information is uploaded to the server side according to the second setting rule, and all the picture attribute information of the picture element that satisfies the setting condition in the currently loaded web page is uploaded to the server side.

Preferably, the obtaining module 1002 includes: a first obtaining module 10022, configured to acquire image attribute information of at least one picture element that satisfies the setting condition in the currently loaded webpage of the browser when the currently loaded webpage loading is completed; or The obtaining module 10024 is configured to: when the mouse scrolling instruction is received under the current loading webpage, acquire the image attribute information of the at least one picture element that satisfies the setting condition in the currently loaded webpage of the browser; or the third obtaining module 10026 is configured to: When it is determined that there is a picture element that satisfies the setting condition in the currently loaded webpage, the image attribute information of the at least one picture element that satisfies the setting condition in the currently loaded webpage of the browser is obtained.

Preferably, the browser client in this embodiment further includes: a first webpage attribute information obtaining module 1012, configured to acquire, in the acquiring module 1002, a picture attribute of the at least one picture element that satisfies the set condition in the currently loaded webpage of the browser. Before the information, the webpage attribute information of the currently loaded webpage of the browser is obtained; the first webpage attribute information sending module 1014 is configured to send the obtained webpage attribute information to the browser-independent application; the security identifier receiving module 1016 is configured to receive The security identifier corresponding to the webpage attribute information returned by the browser-independent application, wherein the security identifier is used to indicate whether the current webpage is a secure webpage, and the first calling module 1018 is configured to indicate that the currently loaded webpage is in the security identifier. The secure web page invokes the acquisition module 1002.

Preferably, the browser client in this embodiment further includes: a second webpage attribute information obtaining module 1020, configured to acquire, in the obtaining module 1002, a picture attribute of the at least one picture element that satisfies the set condition in the currently loaded webpage of the browser. Before the information, the webpage attribute information of the currently loaded webpage of the browser is obtained; the second webpage attribute information sending module 1022 is configured to send the obtained webpage attribute information to the browser-independent application; the permission identifier receiving module 1024 is configured to receive The permission identifier corresponding to the webpage attribute information returned by the browser-independent application, wherein the permission identifier is used to indicate whether the currently loaded webpage has permission for the server side to perform image recognition on the picture element in the currently loaded webpage; The module 1026 is configured to invoke the obtaining module 1002 when the permission identifier indicates that the currently loaded webpage has the authority to perform image recognition on the server side.

Preferably, the browser client in this embodiment further includes: a third webpage attribute information obtaining module 1028, configured to acquire, in the acquiring module, the image attribute information of the at least one picture element that satisfies the set condition in the currently loaded webpage of the browser. Previously, the webpage attribute information of the currently loaded webpage of the browser is obtained; the third webpage attribute information sending module 1030 is configured to send the obtained webpage attribute information to the server side, and receive the judgment result returned by the server side, wherein the judgment result is And carrying the information that is determined by the server side according to the webpage attribute information to determine whether the currently loaded webpage supports the webpage of the image recognition. The third invoking module 1032 is configured to invoke the obtaining module 1002 if the judgment result indicates that the currently loaded webpage supports the image recognition. .

Preferably, the browser client in this embodiment further includes: an inquiry receiving module 1034, configured to receive before the obtaining module 1002 obtains the picture attribute information of the at least one picture element that satisfies the set condition in the currently loaded webpage of the browser. The message sent by the server side is a message for identifying the currently loaded webpage. The response message returning module 1036 is configured to return a response message to the server side, where the response message carries a message indicating whether to accept the server side to perform image recognition on the currently loaded webpage. Information.

Preferably, the obtaining module 1002 is configured to: after determining that the response message returning module returns to the server side, indicating that the current loading is performed After receiving the response message of the information for identifying the image on the server side, the webpage obtains the image attribute information of the at least one picture element that satisfies the set condition in the currently loaded webpage of the browser.

Preferably, the picture attribute information includes a URL of the picture.

Preferably, the picture attribute information further includes: at least one of a title of the picture, a picture description information, a mark of the web page where the picture is located, and a picture resolution.

Preferably, the sending module 1004 is configured to encrypt the acquired picture attribute information and send it to the server side, and receive the encrypted picture keyword corresponding to the picture attribute information returned by the server side.

Preferably, the display module 1006 includes: a receiving determining module 10062, configured to monitor a first triggering operation on some or all of the at least one picture element; and determine whether all the picture elements that are triggered by the server side are received. Corresponding picture keyword; the first execution module 10064 is configured to: if the determination result of the receiving determination module 10062 is YES, perform an operation of displaying a corresponding picture keyword at a set position of the triggered picture element; The module 10066 is configured to: if the determination result of the receiving determining module 10062 is negative, display the picture keyword only at the setting position of the picture element corresponding to the received picture keyword, and continue to the server according to the third setting rule. The side sends the picture attribute information of the picture element that has not received the picture keyword.

Preferably, the preset operation initiating module 1008 includes: a search request receiving module 10082, configured to monitor a second triggering operation on any of the displayed picture keywords when the preset operation is an operation of performing a webpage search using the picture keyword a search request including a picture keyword is generated; a search engine calling module 10084 is configured to invoke a browser search engine to perform a search query according to the search request; and a search result display module 10086 is configured to receive and display the result of the search query.

Preferably, the picture keyword includes the phone number information corresponding to the picture element, and the preset operation initiation module 1008 is configured to monitor the trigger operation of the phone number indicated by the phone number information included in the picture element, and dial the phone number through the mobile terminal.

Preferably, the browser client in this embodiment further includes: an account information obtaining module 1038, configured to acquire information about a current user account of the browser, where the information of the user account includes at least one other user associated with the user account. The information of the account; the sending module 1004 receives the picture keyword corresponding to the picture attribute information returned by the server side, and receives the review information of the picture element and the at least one other user account returned by the server side with at least one other user account. Identification information.

The browser client of this embodiment is used to implement the method for performing picture information processing in the corresponding browsers in the foregoing Embodiment 3 and Embodiment 4, and has the beneficial effects of the corresponding method embodiments, and details are not described herein again.

Example 11

Referring to Figure 11, a browser client of embodiment 11 of the present invention is shown.

The browser client of the embodiment includes: a receiving module 1102, configured to receive a first triggering operation for identifying a picture, where the picture is a picture in a currently loaded webpage of the browser or a local picture acquired by the browser; 1104, for sending the attribute information of the picture and/or the picture to the server side; the display module 1106 is configured to receive and display a keyword corresponding to the picture returned by the server side, where the keyword is determined by the server side according to the picture and/or Or the attribute information corresponding to the picture is found.

The browser client provided by the embodiment can receive the first triggering operation for identifying the picture, and send the attribute information of the picture and/or the picture to the server side, and receive and display the keyword corresponding to the picture returned by the server side. . It can be seen that the browser client provided by the embodiment can perform image recognition on the image that is of interest to the user, and obtain a keyword corresponding to the image, so as to provide the user with other related information except the appearance of the image.

Example 12

Referring to Figure 12, a browser client of embodiment 12 of the present invention is shown.

In this embodiment, the browser client in the third embodiment is further optimized. The optimized browser client includes: a receiving module 1202, configured to receive a first triggering operation for identifying a picture, where the image is a browser. The current image of the webpage or the local image acquired by the browser; the sending module 1204 is configured to send the attribute information of the image and/or the image to the server side; the display module 1206 is configured to receive and display the return of the server side, and The keyword corresponding to the picture, wherein the keyword is searched by the server side according to the attribute information corresponding to the picture and/or the picture.

Preferably, the receiving module 1202 includes: a first instruction receiving module 12022, configured to receive an operation of uploading a local image to be uploaded to a setting area of the browser or a setting position of the currently loaded webpage according to an instruction for uploading a picture; or The second instruction receiving module 12024 is configured to receive an operation of dragging a picture in the currently loaded webpage to a setting area of the browser or a setting position of the current webpage.

Preferably, the display module 1206 includes: a first display module 12062, configured to: when the picture is a local picture acquired by the browser, receive a keyword corresponding to the picture returned by the server side, where the position of the picture acquired by the browser is Displaying the received keyword; or, the second display module 12064 is configured to: when the image is a local image acquired by the browser, receive a keyword corresponding to the image returned by the server, and set the location of the currently loaded webpage or new The local image and/or the received keyword are displayed at the set location of the generated web page.

Preferably, the display module 1206 includes: a third display module 1206, configured to: when the picture is a picture in the browser currently loading the webpage, receive a keyword corresponding to the picture returned by the server side, in the browser setting The received keyword is displayed at the setting position of the image in the setting position of the current or loaded webpage; or the fourth display module 12068 is configured to receive the server when the image is a picture in the browser currently loading the webpage The keyword corresponding to the picture returned by the side displays the received keyword at the set position of the picture in the currently loaded web page.

Preferably, the browser client of the embodiment further includes: a search request receiving module 1208, configured to receive a second keyword for the displayed keyword after the display module 1206 receives and displays the keyword corresponding to the image returned by the server side. The triggering operation generates a search request including a keyword; the search engine calling module 1210 is configured to invoke a browser search engine to perform a search query according to the search request; and the display module 1212 is configured to receive and display the result of the search query.

Preferably, the browser client of the embodiment further includes: a storage module 1214, configured to: after the display module 1206 receives the keyword corresponding to the image returned by the server, the correspondence between the received image and the keyword, and / or, the correspondence between the attribute information of the picture and the keyword is stored in the memory corresponding to the browser.

Preferably, the browser client of the embodiment further includes: a second receiving module 1216, configured to, in the storage module 1214, the correspondence between the received picture and the keyword, and/or the attribute information of the picture and the keyword After the corresponding relationship is stored in the memory corresponding to the browser, the second triggering operation for identifying the image is received again. The searching module 1218 is configured to search for the corresponding image from the memory corresponding to the browser through the attribute information of the image and/or the image. Keyword.

Preferably, the browser client of the embodiment further includes: a webpage attribute information obtaining module 1220, configured to receive, during the current loading of the webpage of the browser, the first triggering operation for identifying the image in the receiving module. The webpage attribute information sending module 1222 is configured to send the obtained webpage attribute information to an application independent of the browser, and the security identifier receiving module 1224 is configured to receive the browsing independent of the browsing. The security identifier corresponding to the webpage attribute information returned by the application, wherein the security identifier is used to indicate whether the webpage is a secure webpage; the first execution module 1226 is configured to invoke the receiving module 1202 if the security identifier indicates that the webpage is a secure webpage. .

Preferably, the attribute information of the picture includes the URL of the picture.

Preferably, the attribute information of the picture further includes at least one of the following: a title of the picture, description information of the picture, and a mark of the webpage where the picture is located.

Preferably, the sending module 1204 is configured to encrypt the attribute information of the picture and/or the picture and send it to the server side; the display module 1206 is configured to receive and display the encrypted keyword corresponding to the picture returned by the server side.

The browser client of this embodiment is used to implement the method for performing picture recognition in the corresponding browsers in the foregoing Embodiment 5 and Embodiment 6, and has the beneficial effects of the corresponding method embodiments, and details are not described herein again.

The schemes provided herein for searching for information in a browser are not inherently related to any particular computer, virtual system, or other device. Various general purpose systems can also be used with the teaching based on the teachings herein. According to the above description, it is obvious that the structure required to construct the system having the solution of the present invention is obvious. Moreover, the invention is not directed to any particular programming language. It is to be understood that the invention may be embodied in a variety of programming language, and the description of the specific language has been described above in order to disclose the preferred embodiments of the invention.

In the description provided herein, numerous specific details are set forth. However, it is understood that the embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures, and techniques are not shown in detail so as not to obscure the understanding of the description.

Similarly, the various features of the invention are sometimes grouped together into a single embodiment, in the above description of the exemplary embodiments of the invention, Figure, or a description of it. However, the method disclosed is not to be interpreted as reflecting the intention that the claimed invention requires more features than those recited in the claims. Rather, as the following claims reflect, inventive aspects lie in less than all features of the single embodiments disclosed herein. Therefore, the claims following the specific embodiments are hereby explicitly incorporated into the embodiments, and each of the claims as a separate embodiment of the invention.

Those skilled in the art will appreciate that the modules in the devices of the embodiments can be adaptively changed and placed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and further they may be divided into a plurality of sub-modules or sub-units or sub-components. In addition to such features and/or at least some of the processes or units being mutually exclusive, any combination of the features disclosed in the specification, including the accompanying claims, the abstract and the drawings, and any methods so disclosed, or All processes or units of the device are combined. Each feature disclosed in this specification (including the accompanying claims, the abstract and the drawings) may be replaced by alternative features that provide the same, equivalent or similar purpose.

In addition, those skilled in the art will appreciate that, although some embodiments described herein include certain features that are included in other embodiments and not in other features, combinations of features of different embodiments are intended to be within the scope of the present invention. Different embodiments are formed and formed. For example, in the claims, any one of the claimed embodiments can be used in any combination.

The various component embodiments of the present invention may be implemented in hardware, or in a software module running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or digital signal processor (DSP) may be used in practice to implement some or all of some or all of the components of the search for information in a browser in accordance with an embodiment of the present invention. Features. The invention can also be implemented as a device or device program (e.g., a computer program and a computer program product) for performing some or all of the methods described herein. Such a program implementing the invention may be stored on a computer readable medium or may be in the form of one or more signals. Such signals may be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.

For example, FIG. 13 shows a terminal device that can implement a method of searching for information in a browser, a method of performing picture information processing in a browser, or a method of picture recognition according to the present invention. The terminal device conventionally includes a processor 1310 and a program product or readable medium in the form of a memory 1320. The memory 1320 may be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), an EPROM, or a ROM. Memory 1320 has a storage space 1330 of program code 1331 configured to perform any of the method steps described above. For example, the storage space 1330 configured as program code may include respective program codes 1331 that are respectively configured to implement various steps in the above method. These program codes can be read from or written to one or more program products. These program products include such as memory cards A program code carrier such as that. Such a program product is typically a portable or fixed storage unit as described with reference to FIG. The storage unit may have a storage section, a storage space, and the like arranged similarly to the storage 1320 in the terminal device of FIG. The program code can be compressed, for example, in an appropriate form. Typically, the storage unit includes readable code 1331', ie, code that can be read by a processor, such as, for example, 1310, which when executed by the terminal device causes the terminal device to perform various steps in the methods described above .

"an embodiment," or "an embodiment," or "an embodiment," In addition, it is noted that the phrase "in one embodiment" is not necessarily referring to the same embodiment.

It is to be noted that the above-described embodiments are illustrative of the invention and are not intended to be limiting, and that the invention may be devised without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as a limitation. The word "comprising" does not exclude the presence of the elements or steps that are not recited in the claims. The word "a" or "an" The invention can be implemented by means of hardware comprising several distinct elements and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means can be embodied by the same hardware item. The use of the words first, second, and third does not indicate any order. These words can be interpreted as names.

Claims

A method of searching for information in a browser, including:

Obtaining attribute information of at least one webpage element in the webpage currently loaded by the browser;

Sending the obtained attribute information to the server side, and receiving a keyword corresponding to the attribute information returned by the server side;

Monitoring a first triggering operation on some or all of the at least one webpage element, displaying a corresponding keyword at a set location of the triggered webpage element;

A second triggering operation on the corresponding keyword is detected, and a preset operation based on the keyword is initiated on the browser side.
The method of claim 1, wherein the step of acquiring the attribute information of the at least one webpage element in the webpage currently loaded by the browser comprises:

Obtaining attribute information of the audio currently loaded in the webpage of the browser, and/or attribute information of the video, and/or attribute information of the picture.
The method according to claim 1 or 2, wherein the preset operation comprises at least one of: an operation of performing a webpage search using the keyword, an access operation of a public number corresponding to the keyword, and a The access operation of the e-commerce webpage URL corresponding to the keyword, and the operation of searching for the image of the type indicated by the keyword.
The method according to claim 1 or 2, wherein after the step of receiving the keyword corresponding to the attribute information returned by the server side, the method further comprises:

Storing the received correspondence between the attribute information and the keyword in a memory corresponding to the browser;

The step of monitoring the first triggering operation on some or all of the at least one webpage element, and displaying the corresponding keyword at the set location of the triggered webpage element includes:

Detecting a first triggering operation on some or all of the at least one webpage element, determining attribute information of the triggered webpage element;

Determining, according to the determined attribute information and the correspondence between the attribute information and the keyword stored in the memory corresponding to the browser, the keyword corresponding to the triggered webpage element, and in the triggered webpage element The determined keyword is displayed at the set position.
The method according to claim 1 or 2, wherein the step of transmitting the acquired attribute information to the server side comprises:

All the attribute information obtained is packaged and uploaded to the server side at one time;

or,

All the attribute information obtained is grouped according to a set standard, and each group of attribute information is sequentially uploaded according to the first setting rule;

or,

All the attribute information obtained is grouped according to the type of the webpage element, and the attribute information of each type of webpage element is sequentially uploaded according to the second setting rule;

or,

And uploading the currently acquired attribute information to the server side, and continuing to acquire the attribute information of the remaining webpage elements in the currently loaded webpage, and uploading the attribute information of the webpage element that is continuously acquired to the server according to the third setting rule. On the side, all the attribute information of all the webpage elements in the currently loaded webpage is uploaded to the server side.
The method according to claim 1 or 2, wherein the step of acquiring the attribute information of the at least one webpage element in the webpage currently loaded by the browser comprises:

Obtaining attribute information of at least one webpage element in the webpage currently loaded by the browser when the current webpage loading is completed;

Or,

Obtaining attribute information of at least one webpage element in the currently loaded webpage of the browser when the mouse scrolling instruction is received under the currently loaded webpage;

or,

When it is determined that there is a webpage element that satisfies the setting condition in the currently loaded webpage, the attribute information of at least one webpage element in the webpage currently loaded by the browser is obtained.
The method according to claim 1 or 2, wherein before the step of acquiring the attribute information of the at least one webpage element in the webpage currently loaded by the browser, the method further comprises:

Obtaining webpage attribute information of a currently loaded webpage of the browser;

Sending the acquired webpage attribute information to an application independent of the browser;

Receiving, by the browser-independent application, a security identifier corresponding to the webpage attribute information, where the security identifier is used to indicate whether the currently loaded webpage is a secure webpage;

And if the security identifier indicates that the currently loaded webpage is a secure webpage, performing the step of acquiring attribute information of at least one webpage element in the currently loaded webpage of the browser.
The method according to claim 1 or 2, wherein before the step of acquiring the attribute information of the at least one webpage element in the webpage currently loaded by the browser, the method further comprises:

Obtaining webpage attribute information of a currently loaded webpage of the browser;

Sending the acquired webpage attribute information to an application independent of the browser;

Receiving, by the browser-independent application, a permission identifier corresponding to the webpage attribute information, where the permission identifier is used to indicate whether the currently loaded webpage has the server to be in the currently loaded webpage The right to identify the web page element;

And if the permission identifier indicates that the currently loaded webpage has the right to enable the server to identify the webpage element, performing the step of acquiring the attribute information of the at least one webpage element in the webpage currently loaded by the browser.
The method according to claim 1 or 2, wherein before the step of acquiring the attribute information of the at least one webpage element in the webpage currently loaded by the browser, the method further comprises:

Obtaining webpage attribute information of a currently loaded webpage of the browser;

Sending the obtained attribute information to the server side, and receiving a determination result returned by the server side, where the determination result carries the determination by the server side according to the webpage attribute information Whether the currently loaded web page supports information recognized by the web page element;

And if the determining result indicates that the currently loaded webpage supports webpage element identification, performing the step of acquiring attribute information of at least one webpage element in the currently loaded webpage of the browser.
The method according to claim 1 or 2, wherein before the step of acquiring the attribute information of the at least one webpage element in the webpage currently loaded by the browser, the method further comprises:

Receiving a message sent by the server side whether the query for the webpage element is currently performed on the currently loaded webpage;

Returning a response message to the server side, where the response message carries information indicating whether to accept the webpage element identification of the currently loaded webpage by the server side.
The method according to claim 1 or 2, wherein the step of acquiring the attribute information of the at least one webpage element in the webpage currently loaded by the browser comprises:

After determining that the response message indicating that the current webpage accepts the information of the webpage element identification by the server side is returned to the server side, the attribute information of the at least one webpage element in the webpage currently loaded by the browser is obtained.
The method of claim 1, wherein the attribute information of the web page element comprises a uniform resource locator URL of a web page element.
The method of claim 12, wherein the attribute information of the webpage element further comprises at least one of the following: The title of the page element, the description of the page element, and the tag of the page where the page element is located.
The method according to claim 1 or 2, wherein

The step of transmitting the obtained attribute information to the server side, and receiving the keyword corresponding to the attribute information returned by the server side includes:

The obtained attribute information is encrypted and sent to the server side, and the encrypted keyword corresponding to the attribute information returned by the server side is received.
The method according to claim 1 or 2, wherein the monitoring of a first triggering operation on some or all of the webpage elements of the at least one webpage element displays a corresponding correspondence at a set position of the triggered webpage element The keyword steps include:

Monitoring a first triggering operation on some or all of the at least one webpage element;

Determining whether a keyword corresponding to all triggered webpage elements returned by the server side has been received;

If yes, performing the operation of displaying the corresponding keyword at the set position of the triggered webpage element;

If not, the keyword is displayed only at the set position of the webpage element corresponding to the received keyword, and the webpage element that does not receive the keyword is continuously sent to the server side according to the fourth setting rule. Attribute information.
The method according to claim 3, wherein when the preset operation is an operation of performing webpage search using the keyword, the monitoring of the second triggering operation on the corresponding keyword is performed in a browser The preset operation steps initiated by the side based on the keyword include:

Monitoring a second triggering operation on any of the keywords displayed, generating a search request including the keyword;

Calling a search engine of the browser to perform a search query according to the search request;

Receive and present the results of the search query.
The method according to claim 1, wherein the keyword includes phone number information corresponding to the webpage element, and the monitoring of the second triggering operation on the corresponding keyword is initiated on the browser side. The preset steps for keywords include:

The triggering operation of the telephone number indicated by the telephone number information contained in the webpage element is monitored, and the telephone number is dialed through the mobile terminal.
The method of claim 1 wherein the method further comprises:

Obtaining information about a current user account of the browser, where the information of the user account includes information of at least one other user account associated with the user account;

Receiving, by the server side, a keyword corresponding to the attribute information returned by the server side, comprising: receiving, by the server side, the review information and the at least one of the webpage element and the at least one other user account Identification information of other user accounts.
A method for processing picture information in a browser, comprising:

Obtaining image attribute information of at least one picture element that satisfies the set condition in the currently loaded webpage of the browser;

Sending the acquired image attribute information to the server side, and receiving a picture keyword corresponding to the picture attribute information returned by the server side;

Detecting a first triggering operation on some or all of the at least one picture element, displaying the corresponding picture keyword at a set position of the triggered picture element;

A second triggering operation on the corresponding picture keyword is detected, and a preset operation based on the picture keyword is initiated on the browser side.
The method according to claim 19, wherein the step of acquiring picture attribute information of the at least one picture element that satisfies the set condition in the currently loaded webpage of the browser comprises:

Obtaining image attribute information corresponding to at least one picture element that meets the set size in the currently loaded webpage of the browser.
The method according to claim 19, wherein the preset operation comprises at least one of: an operation of performing a webpage search using the image keyword, an access operation of a public number corresponding to the image keyword, and a location An access operation of the e-commerce webpage URL corresponding to the image keyword, and an operation of searching for the image of the type indicated by the image keyword.
The method according to claim 19 or 20, wherein after the step of receiving the picture keyword corresponding to the picture attribute information returned by the server side, the method further comprises:

Storing the received correspondence between the picture attribute information and the picture keyword in a memory corresponding to the browser;

The step of monitoring the first triggering operation on some or all of the at least one picture element, and displaying the corresponding picture keyword at the set position of the triggered picture element includes:

Detecting a first triggering operation on some or all of the at least one picture element, determining picture attribute information of the triggered picture element;

Determining, according to the determined relationship between the picture attribute information and the picture attribute information stored in the memory corresponding to the browser and the picture keyword, the picture keyword corresponding to the triggered picture element, and being triggered in the The determined picture keyword is displayed at the set position of the picture element.
The method according to claim 19, wherein the step of transmitting the acquired picture attribute information to the server side comprises:

All the obtained image attribute information is packaged and uploaded to the server side at one time;

or,

All the obtained image attribute information are grouped according to a set standard, and each set of picture attribute information is sequentially uploaded according to the first setting rule;

or,

And uploading the currently acquired picture attribute information to the server side, and continuing to acquire the picture attribute information of the picture element that satisfies the setting condition remaining in the currently loaded webpage, and uploading the continued acquisition according to the second setting rule. The picture attribute information of the picture element is sent to the server side until all the picture attribute information of the picture element satisfying the setting condition in the currently loaded web page is uploaded to the server side.
The method according to claim 19, wherein the step of obtaining the picture attribute information of the at least one picture element that satisfies the set condition in the currently loaded webpage of the browser comprises:

Obtaining, in the currently loaded webpage loading, the image attribute information of the at least one picture element that satisfies the set condition in the currently loaded webpage of the browser;

or,

Obtaining the image attribute information of the at least one picture element that satisfies the set condition in the currently loaded webpage of the browser when the mouse scrolling instruction is received under the currently loaded webpage;

or,

When it is determined that there is a picture element that satisfies the setting condition in the currently loaded webpage, the image attribute information of the at least one picture element that satisfies the setting condition in the currently loaded webpage of the browser is obtained.
The method according to claim 19, wherein before the step of acquiring the picture attribute information of the at least one picture element of the setting condition in the currently loaded webpage of the browser, the method further comprises:

Obtaining webpage attribute information of a currently loaded webpage of the browser;

Sending the acquired webpage attribute information to an application independent of the browser;

Receiving, by the browser-independent application, a security identifier corresponding to the webpage attribute information, where the security identifier is used to indicate whether the currently loaded webpage is a secure webpage;

If the security identifier indicates that the currently loaded webpage is a secure webpage, executing the pre-zero loading webpage of the acquiring browser The step of satisfying picture attribute information of at least one picture element of the set condition.
The method according to claim 19, wherein before the step of acquiring the picture attribute information of the at least one picture element that satisfies the set condition in the web page before the acquiring the zero of the browser, the method further comprises:

Obtaining webpage attribute information of a currently loaded webpage of the browser;

Sending the acquired webpage attribute information to an application independent of the browser;

Receiving, by the browser-independent application, a permission identifier corresponding to the webpage attribute information, where the permission identifier is used to indicate whether the currently loaded webpage has the server side to the currently loaded webpage The picture element in the picture is used for image recognition;

If the permission identifier indicates that the currently loaded webpage has the right to enable the server side to perform the image recognition, the obtaining the image attribute identification information of the at least one picture element that satisfies the setting condition in the currently loaded webpage of the browser is performed. step.
The method according to claim 19, wherein before the step of acquiring the picture attribute information of the at least one picture element of the setting condition in the currently loaded webpage of the browser, the method further comprises:

Obtaining webpage attribute information of a currently loaded webpage of the browser;

Sending the acquired webpage attribute information to the server side, and receiving the judgment result returned by the server side, where the judgment result carries the judgment center determined by the server side according to the webpage attribute information Describe whether the currently loaded webpage supports the information of the webpage for image recognition;

And if the determining result indicates that the currently loaded webpage supports the image recognition, the step of acquiring the image attribute information of the at least one picture element that satisfies the setting condition in the currently loaded webpage of the browser is performed.
The method according to claim 19, wherein before the step of acquiring the picture attribute information of the at least one picture element of the setting condition in the currently loaded webpage of the browser, the method further comprises:

Receiving a message sent by the server side whether the inquiry is performed on the currently loaded webpage;

Returning a response message to the server side, where the response message carries information indicating whether to accept the image recognition of the currently loaded webpage by the server side.
The method according to claim 19, wherein the step of obtaining the picture attribute information of the at least one picture element that satisfies the set condition in the currently loaded webpage of the browser comprises:

After determining, by returning to the server side, a response message indicating that the currently loaded webpage accepts the information of the server side for performing picture recognition, acquiring at least one picture element that satisfies the setting condition in the currently loaded webpage of the browser. Image attribute information.
The method of claim 19, wherein the picture attribute information comprises a uniform resource locator URL of the picture.
The method according to claim 30, wherein the picture attribute information further comprises: at least one of a title of the picture, picture description information, a mark of the web page where the picture is located, and a picture resolution.
The method according to claim 19, wherein the step of transmitting the acquired picture attribute information to the server side, and receiving the picture keyword corresponding to the picture attribute information returned by the server side comprises:

The obtained picture attribute information is encrypted and sent to the server side, and the encrypted picture key corresponding to the picture attribute information returned by the server side is received.
The method according to claim 19, wherein said monitoring a first triggering operation on some or all of said at least one picture element, displaying a corresponding picture at a set position of the triggered picture element Keyword steps include:

Detecting a first triggering operation on some or all of the at least one picture element;

Determining whether the picture keyword corresponding to all the picture elements that are triggered by the server side has been received;

If yes, performing the operation of displaying the corresponding picture keyword at the set position of the triggered picture element;

If not, the picture keyword is displayed only at the setting position of the picture element corresponding to the received picture keyword, and continues to send the picture keyword not received to the server side according to the third setting rule. The picture attribute information of the picture element.
The method according to claim 21, wherein when the preset operation is an operation of performing a webpage search using the picture keyword, the monitoring of the second triggering operation on the corresponding picture keyword is The preset operation steps initiated by the browser side based on the picture keyword include:

Monitoring a second triggering operation on any of the displayed picture keywords to generate a search request including the picture keyword;

Calling a search engine of the browser to perform a search query according to the search request;

Receive and present the results of the search query.
The method according to claim 19, wherein the picture keyword includes phone number information corresponding to the picture element, and the monitoring of the second triggering operation on the corresponding picture keyword is initiated on the browser side. The preset operation steps of the picture keyword include:

The triggering operation of the telephone number indicated by the telephone number information contained in the picture element is monitored, and the telephone number is dialed through the mobile terminal.
The method of claim 19, wherein

The method further includes: acquiring information about a current user account of the browser, where the information of the user account includes information of at least one other user account associated with the user account;

The step of receiving the picture keyword corresponding to the picture attribute information returned by the server side includes: receiving, by the server side, the review information of the picture element with the at least one other user account and the Identification information of at least one other user account.
A method of image recognition, comprising:

Receiving a first triggering operation for identifying a picture, where the picture is a picture in a currently loaded webpage of the browser or a local picture acquired by the browser;

Sending the attribute information of the picture and/or the picture to the server side;

Receiving and displaying a keyword corresponding to the picture returned by the server side, where the keyword is searched by the server side according to the picture and/or attribute information corresponding to the picture.
The method of claim 37, wherein the step of receiving a first triggering operation to identify a picture comprises:

Receiving an operation of uploading a local image to be uploaded according to an instruction for uploading a picture to a setting area of the browser or a setting position of the currently loaded web page;

or,

Receiving an operation of dragging a picture in the currently loaded web page to a set area of the browser or a set position of the currently loaded web page.
The method of claim 38, wherein the step of receiving and displaying the keyword corresponding to the picture returned by the server side when the picture is a local picture acquired by the browser comprises:

Receiving a keyword corresponding to the picture returned by the server side, and displaying the received keyword at a set position of the picture acquired by the browser;

or,

Receiving a keyword corresponding to the picture returned by the server side, at a set location of the currently loaded webpage or a new student The local picture and/or the received keyword are displayed at a set location of the web page.
The method of claim 38, wherein the step of receiving and displaying the keyword corresponding to the picture returned by the server side when the picture is a picture in a browser currently loading a webpage comprises:

Receiving a keyword corresponding to the picture returned by the server side, and displaying the received key at a setting position of the picture in a setting area of the browser or a setting position of a currently loaded web page word;

or,

Receiving a keyword corresponding to the picture returned by the server side, and displaying the received keyword at a set position of the picture in the currently loaded web page.
The method according to claim 39 or 40, wherein after the step of receiving and displaying the keyword corresponding to the picture returned by the server side, the method further comprises:

Receiving a second triggering operation on the displayed keyword, generating a search request including the keyword;

Calling a search engine of the browser to perform a search query according to the search request;

Receive and present the results of the search query.
The method according to claim 39 or 40, wherein after the step of receiving the keyword corresponding to the picture returned by the server side, the method further comprises:

The corresponding relationship between the received picture and the keyword, and/or the correspondence between the attribute information of the picture and the keyword is stored in a memory corresponding to the browser.
The method according to claim 42, wherein the correspondence between the received picture and the keyword, and/or the correspondence between the attribute information of the picture and the keyword is stored in After the in-memory step corresponding to the browser, the method further includes:

Receiving a second triggering operation for identifying the picture again;

Searching, by the attribute information of the picture and/or the picture, a keyword corresponding to the picture from a memory corresponding to the browser.
The method according to claim 37, wherein, when the picture is a picture in the current loading webpage of the browser, before the step of receiving the first triggering operation for identifying the picture, the method further includes:

Obtaining the attribute information of the webpage where the picture is located;

Sending the acquired webpage attribute information to an application independent of the browser;

Receiving, by the browser-independent application, a security identifier corresponding to the webpage attribute information, where the security identifier is used to indicate whether the webpage is a secure webpage;

And if the security identifier indicates that the webpage is a secure webpage, performing the step of receiving a first triggering operation for identifying a picture.
The method of claim 37, wherein the attribute information of the picture comprises a uniform resource locator URL of the picture.
The method according to claim 45, wherein the attribute information of the picture further comprises at least one of the following: a title of the picture, description information of the picture, and a mark of the web page where the picture is located.
The method of claim 37, wherein

The step of transmitting the attribute information of the picture and/or the picture to the server side, and receiving and displaying the keyword corresponding to the picture returned by the server side includes:

Encrypting the attribute information of the picture and/or the picture to the server side, and receiving and displaying the encrypted keyword corresponding to the picture returned by the server side.
A browser client that includes:

An obtaining module, configured to obtain attribute information of at least one webpage element in a webpage currently loaded by the browser;

a sending module, configured to send the acquired attribute information to the server side, and receive a keyword that is returned by the server side and corresponding to the attribute information;

a display module, configured to monitor a first triggering operation on some or all of the at least one webpage element, and display a corresponding keyword at a set location of the triggered webpage element;

The preset operation initiating module is configured to monitor a second triggering operation on the corresponding keyword, and initiate a preset operation based on the keyword on the browser side.
The browser client according to claim 48, wherein the obtaining module is configured to acquire attribute information of audio in a webpage currently loaded by the browser, and/or attribute information of the video, and/or attributes of the image. information.
The browser client according to claim 48 or 49, wherein the preset operation comprises at least one of: an operation of performing a webpage search using the keyword, and an access operation of a public number corresponding to the keyword And an operation of accessing the e-commerce webpage URL corresponding to the keyword and searching for a photo of the type indicated by the keyword.
The browser client according to claim 48 or 49, wherein the browser client further comprises:

a storage module, configured to: after the sending module receives the keyword corresponding to the attribute information returned by the server side, store the received correspondence between the attribute information and the keyword in the browser Corresponding memory;

The display module is configured to monitor a first triggering operation on a part or all of the at least one webpage element, and determine attribute information of the triggered webpage element; and according to the determined attribute information and the browsing Corresponding to the corresponding relationship between the attribute information and the keyword stored in the memory, determining a keyword corresponding to the triggered webpage element, and displaying the determined keyword at the set position of the triggered webpage element .
The browser client according to claim 48 or 49, wherein the sending module sends the acquired attribute information to the server side:

All the attribute information obtained is packaged and uploaded to the server side at one time;

or,

All the attribute information obtained is grouped according to a set standard, and each group of attribute information is sequentially uploaded according to the first setting rule;

or,

All the attribute information obtained is grouped according to the type of the webpage element, and the attribute information of each type of webpage element is sequentially uploaded according to the second setting rule;

or,

And uploading the currently acquired attribute information to the server side, and continuing to acquire the attribute information of the remaining webpage elements in the currently loaded webpage, and uploading the attribute information of the webpage element that is continuously acquired to the server according to the third setting rule. On the side, all the attribute information of all the webpage elements in the currently loaded webpage is uploaded to the server side.
The browser client according to claim 48 or 49, wherein the obtaining module comprises:

a first obtaining module, configured to acquire, when the current webpage is loaded, the attribute information of the at least one webpage element in the current loading webpage of the browser;

or,

a second obtaining module, configured to acquire attribute information of at least one webpage element in a currently loaded webpage of the browser when the mouse scrolling instruction is received under the currently loaded webpage;

or,

The third obtaining module is configured to: when it is determined that the webpage element that satisfies the setting condition exists in the currently loaded webpage, obtain the attribute information of the at least one webpage element in the current loading webpage of the browser.
The browser client according to claim 48 or 49, wherein the browser client further comprises:

a first webpage attribute information obtaining module, configured to acquire webpage attribute information of a currently loaded webpage of the browser before the obtaining module acquires attribute information of at least one webpage element in the webpage currently loaded by the browser;

a first webpage attribute information sending module, configured to send the obtained webpage attribute information to an application independent of the browser;

a security identifier receiving module, configured to receive the security identifier corresponding to the webpage attribute information returned by the browser-independent application, where the security identifier is used to indicate whether the currently loaded webpage is a secure webpage;

The first calling module is configured to invoke the obtaining module if the security identifier indicates that the currently loaded webpage is a secure webpage.
The browser client according to claim 48 or 49, wherein the browser client further comprises:

a second webpage attribute information obtaining module, configured to acquire webpage attribute information of a currently loaded webpage of the browser before the obtaining module acquires attribute information of at least one webpage element in the currently loaded webpage of the browser;

a second webpage attribute information sending module, configured to send the obtained webpage attribute information to an application independent of the browser;

The privilege identifier receiving module is configured to receive the privilege identifier corresponding to the webpage attribute information returned by the browser-independent application, where the privilege identifier is used to indicate whether the currently loaded webpage has the server Permission to identify the webpage elements in the currently loaded webpage;

And a second calling module, configured to invoke the acquiring module if the permission identifier indicates that the currently loaded webpage has permission to enable the server to perform webpage element identification.
The browser client according to claim 48 or 49, wherein the browser client further comprises:

a third webpage attribute information obtaining module, configured to acquire webpage attribute information of a currently loaded webpage of the browser before the obtaining module acquires attribute information of at least one webpage element in the currently loaded webpage of the browser;

a third webpage attribute information sending module, configured to send the obtained attribute information to the server side, and receive a judgment result returned by the server side, where the judgment result carries the server side according to the Determining, by the webpage attribute information, information indicating whether the currently loaded webpage supports webpage element identification;

And a third calling module, configured to invoke the acquiring module if the determining result indicates that the currently loaded webpage supports webpage element identification.
The browser client according to claim 48 or 49, wherein the browser client further comprises:

The query receiving module is configured to receive, before the obtaining module acquires the attribute information of the at least one webpage element in the currently loaded webpage of the browser, the message sent by the server side whether the webpage element is identified by the currently loaded webpage;

The response message returning module is configured to return a response message to the server side, where the response message carries information indicating whether to accept the webpage element identification of the currently loaded webpage by the server side.
The browser client according to claim 48 or 49, wherein the obtaining module is configured to, after determining to return to the server side, information indicating that the current web page accepts the server side to perform webpage element identification. After the response message, the attribute information of at least one webpage element in the webpage currently loaded by the browser is obtained.
The browser client of claim 48, wherein the attribute information of the web page element comprises a uniform resource locator URL of a web page element.
The browser client according to claim 59, wherein the attribute information of the webpage element further comprises at least one of: a title of the webpage element, description information of the webpage element, and a mark of the webpage where the webpage element is located.
The browser client according to claim 48 or 49, wherein the sending module is configured to encrypt the acquired attribute information and send it to the server side, and receive the encrypted back returned by the server side. a keyword corresponding to the attribute information.
The browser client according to claim 48 or 49, wherein the display module comprises:

a receiving determining module, configured to monitor a first trigger on some or all of the at least one webpage element An operation of determining whether a keyword corresponding to all triggered webpage elements returned by the server side has been received;

a first execution module, configured to: if the determination result of the receiving determination module is yes, perform an operation of displaying a corresponding keyword at a set position of the triggered webpage element;

a second execution module, configured to: if the determination result of the receiving determination module is negative, display the keyword only at a set position of a webpage element corresponding to the received keyword, and follow the fourth setting rule The attribute information of the webpage element that has not received the keyword is continuously sent to the server side.
The browser client according to claim 50, wherein the preset operation initiation module comprises:

a search request receiving module, configured to: when the preset operation is an operation of performing a webpage search using the keyword, monitor a second triggering operation on any of the displayed keywords, and generate a keyword including the keyword Search request

a search engine calling module, configured to invoke a search engine of the browser, and perform a search query according to the search request;

A search result display module for receiving and presenting results of the search query.
The browser client according to claim 48, wherein the keyword includes phone number information corresponding to the webpage element, and the preset operation initiating module is configured to monitor the phone number information indication included in the webpage element. The triggering operation of the phone number is made by the mobile terminal to dial the phone number.
The browser client of claim 48, wherein the browser client further comprises:

An account information obtaining module, configured to obtain information about a current user account of the browser, where the information of the user account includes information of at least one other user account associated with the user account;

Receiving, by the server side, the keyword corresponding to the attribute information returned by the server side, receiving, by the server side, the review information and the at least one of the webpage element returned by the server side and the at least one other user account Identification information of other user accounts.
A browser client that includes:

An obtaining module, configured to acquire image attribute information of at least one picture element that satisfies a set condition in a currently loaded webpage of the browser;

a sending module, configured to send the acquired image attribute information to the server side, and receive a picture keyword corresponding to the picture attribute information returned by the server side;

a display module, configured to monitor a first triggering operation on some or all of the at least one picture element, and display a corresponding picture keyword at a set position of the triggered picture element;

The preset operation initiating module is configured to monitor a second triggering operation on the corresponding picture keyword, and initiate a preset operation based on the picture keyword on the browser side.
The browser client according to claim 66, wherein the obtaining module is configured to acquire image attribute information corresponding to at least one picture element that meets a set size in a currently loaded webpage of the browser.
The browser client according to claim 66 or 67, wherein the preset operation comprises at least one of: an operation of performing a webpage search using the image keyword, and a public number corresponding to the image keyword. An access operation, an access operation to an e-commerce webpage URL corresponding to the picture keyword, and an operation of searching for a picture of a type indicated by the picture keyword.
The browser client according to claim 66 or 67, wherein the browser client further comprises:

a storage module, configured to: after the sending module receives the picture keyword corresponding to the picture attribute information returned by the server side, store the corresponding relationship between the received picture attribute information and the picture keyword The browser corresponds to the memory;

The display module is configured to monitor a first triggering operation on a part or all of the at least one picture element, and determine picture attribute information of the triggered picture element; according to the determined picture attribute information and the Inside the browser Corresponding relationship between the picture attribute information stored in the file and the picture keyword, determining a picture keyword corresponding to the triggered picture element, and displaying the determined picture key at the set position of the triggered picture element word.
The browser client according to claim 66, wherein said transmitting module transmits the acquired picture attribute information to the server side:

All the obtained image attribute information is packaged and uploaded to the server side at one time;

or,

All the obtained image attribute information are grouped according to a set standard, and each set of picture attribute information is sequentially uploaded according to the first setting rule;

or,

And uploading the currently acquired picture attribute information to the server side, and continuing to acquire the picture attribute information of the picture element that satisfies the setting condition remaining in the currently loaded webpage, and uploading the continued acquisition according to the second setting rule. The picture attribute information of the picture element is sent to the server side until all the picture attribute information of the picture element satisfying the setting condition in the currently loaded web page is uploaded to the server side.
The browser client of claim 66, wherein the obtaining module comprises:

a first obtaining module, configured to acquire image attribute information of at least one picture element that satisfies the set condition in the currently loaded webpage of the browser when the currently loaded webpage loading is completed;

or,

a second acquiring module, configured to acquire image attribute information of at least one picture element that satisfies the set condition in the currently loaded webpage of the browser when the mouse scrolling instruction is received under the currently loaded webpage;

or,

And a third acquiring module, configured to: when it is determined that the picture element that meets the setting condition exists in the currently loaded webpage, obtain image attribute information of the at least one picture element that satisfies the setting condition in the currently loaded webpage of the browser.
The browser client of claim 66, wherein the browser client further comprises:

a first webpage attribute information obtaining module, configured to acquire webpage attribute information of a currently loaded webpage of the browser before the obtaining module obtains the image attribute information of the at least one picture element that satisfies the set condition in the currently loaded webpage of the browser;

a first webpage attribute information sending module, configured to send the obtained webpage attribute information to an application independent of the browser;

a security identifier receiving module, configured to receive the security identifier corresponding to the webpage attribute information returned by the browser-independent application, where the security identifier is used to indicate whether the current webpage is a secure webpage;

The first calling module is configured to invoke the acquiring module when the security identifier indicates that the currently loaded webpage is a secure webpage.
The browser client of claim 66, wherein the browser client further comprises:

a second webpage attribute information obtaining module, configured to acquire webpage attribute information of a currently loaded webpage of the browser before the obtaining module obtains the image attribute information of the at least one picture element that meets the set condition in the currently loaded webpage of the browser;

a second webpage attribute information sending module, configured to send the obtained webpage attribute information to an application independent of the browser;

The privilege identifier receiving module is configured to receive the privilege identifier corresponding to the webpage attribute information returned by the browser-independent application, where the privilege identifier is used to indicate whether the currently loaded webpage has the server The right to perform picture recognition on the picture element in the currently loaded webpage;

And a second calling module, configured to invoke the acquiring module when the permission identifier indicates that the currently loaded webpage has permission to perform image recognition on the server side.
The browser client of claim 66, wherein the browser client further comprises:

a third webpage attribute information obtaining module, configured to satisfy a setting in the current loading webpage of the acquiring module acquiring the browser Obtaining webpage attribute information of a currently loaded webpage of the browser before the image attribute information of the at least one picture element of the condition;

a third webpage attribute information sending module, configured to send the obtained webpage attribute information to the server side, and receive a judgment result returned by the server side, where the judgment result carries the server side according to the Determining, by the webpage attribute information, information of a webpage that determines whether the currently loaded webpage supports image recognition;

And a third calling module, configured to invoke the acquiring module if the determining result indicates that the currently loaded webpage supports image recognition.
The browser client of claim 66, wherein the browser client further comprises:

The query receiving module is configured to: before the obtaining module acquires the image attribute information of the at least one picture element that meets the set condition in the currently loaded webpage of the browser, receive the query sent by the server side to perform image recognition on the currently loaded webpage News

The response message returning module is configured to return a response message to the server side, where the response message carries information indicating whether to accept the image recognition of the currently loaded webpage by the server side.
The browser client according to claim 66, wherein the obtaining module is configured to: after determining that the response message returning module returns to the server side, indicating that the currently loaded webpage accepts the server side to perform a picture After the response message of the identified information, the image attribute information of the at least one picture element that satisfies the set condition in the currently loaded webpage of the browser is obtained.
The browser client of claim 66, wherein the picture attribute information comprises a URL of a picture.
The browser client according to B30, wherein the picture attribute information further includes: at least one of a title of the picture, a picture description information, a mark of the web page where the picture is located, and a picture resolution.
The browser client according to claim 66, wherein the sending module is configured to encrypt the acquired image attribute information and send the image attribute information to the server side, and receive the encrypted A picture keyword corresponding to the picture attribute information.
The browser client of claim 66, wherein the display module comprises:

a receiving determining module, configured to detect a first triggering operation on a part or all of the picture elements in the at least one picture element; determining whether the picture keyword corresponding to all the picture elements that are triggered by the server side has been received ;

a first execution module, configured to: if the determination result of the receiving determination module is yes, perform an operation of displaying a corresponding picture keyword at a set position of the triggered picture element;

a second execution module, configured to: if the determination result of the receiving determination module is negative, display the picture keyword only at a setting position of a picture element corresponding to the received picture keyword, and according to the third setting The rule continues to send the picture attribute information of the picture element that has not received the picture keyword to the server side.
The browser client according to claim 68, wherein the preset operation initiation module comprises:

a search request receiving module, configured to: when the preset operation is an operation of performing a webpage search using the image keyword, monitor a second triggering operation on any of the displayed image keywords, and generate the image including the image Search request for keywords;

a search engine calling module, configured to invoke a search engine of the browser, and perform a search query according to the search request;

A search result display module for receiving and presenting results of the search query.
The browser client according to claim 66, wherein the picture keyword includes phone number information corresponding to the picture element, and the preset operation initiation module is configured to monitor the phone number information indication included in the picture element. The triggering operation of the phone number is made by the mobile terminal to dial the phone number.
The browser client of claim 66, wherein the browser client further comprises:

An account information obtaining module, configured to obtain information about a current user account of the browser, where the information of the user account includes information of at least one other user account associated with the user account;

Receiving, when the sending module receives the picture keyword corresponding to the picture attribute information returned by the server side, the receiving station The comment information returned by the server side and the at least one other user account for the picture element and the identification information of the at least one other user account.
A browser client that includes:

a receiving module, configured to receive a first triggering operation for identifying a picture, where the picture is a picture in a currently loaded webpage of the browser or a local picture acquired by the browser;

a sending module, configured to send the attribute information of the picture and/or the picture to a server side;

a display module, configured to receive and display a keyword that is returned by the server side and corresponding to the picture, where the keyword is searched by the server side according to the picture and/or attribute information corresponding to the picture get.
The client of claim 84, wherein the receiving module comprises:

a first instruction receiving module, configured to receive an operation of uploading a local image to be uploaded according to an instruction for uploading a picture to a setting area of the browser or a setting position of the currently loaded webpage;

or,

The second instruction receiving module is configured to receive an operation of dragging a picture in the currently loaded webpage to a setting area of the browser or a setting position of the current webpage.
The client of claim 85, wherein the display module comprises:

a first display module, configured to: when the picture is a local picture acquired by the browser, receive a keyword corresponding to the picture returned by the server side, and set the picture acquired by the browser Displaying the received keyword at a fixed position;

or,

a second display module, configured to: when the picture is a local picture acquired by the browser, receive a keyword corresponding to the picture returned by the server side, where the currently loaded web page is set or newly generated The local picture and/or the received keyword are displayed at a set location of the web page.
The client of claim 85, wherein the display module comprises:

a third display module, configured to: when the picture is a picture in a browser currently loading a webpage, receive a keyword corresponding to the picture returned by the server side, in a setting area or current of the browser Displaying the received keyword at a set position of the picture in a set location of the loaded webpage;

or,

The fourth display module is configured to: when the picture is a picture in the currently loaded webpage of the browser, receive a keyword corresponding to the picture returned by the server side, and set the picture in the currently loaded webpage The received keyword is displayed at a fixed position.
The client of claim 84, wherein the browser client further comprises:

a search request receiving module, configured to receive, after the display module receives and displays a keyword corresponding to the picture returned by the server side, receive a second triggering operation on the displayed keyword, and generate the key including the key Word search request;

a search engine calling module, configured to invoke a search engine of the browser, and perform a search query according to the search request;

a presentation module for receiving and presenting results of the search query.
The client of claim 84, wherein the browser client further comprises:

a storage module, configured to: after the display module receives the keyword that is returned by the server and corresponding to the picture, the corresponding relationship between the received picture and the keyword, and/or the picture The correspondence between the attribute information and the keyword is stored in a memory corresponding to the browser.
The client of claim 89, wherein the browser client further comprises:

a second receiving module, configured to, in the storage module, a correspondence between the received picture and the keyword, and/ Or after the corresponding relationship between the attribute information of the picture and the keyword is stored in the memory corresponding to the browser, receiving a second triggering operation for identifying the picture again;

And a search module, configured to search for a keyword corresponding to the picture from a memory corresponding to the browser by using the image and/or attribute information of the picture.
The client of claim 84, wherein the browser client further comprises:

The webpage attribute information obtaining module is configured to: when the image is a currently loaded webpage of the browser, obtain the webpage attribute information of the webpage before the receiving module receives the first triggering operation for identifying the image ;

a webpage attribute information sending module, configured to send the obtained webpage attribute information to an application independent of the browser;

a security identifier receiving module, configured to receive the security identifier corresponding to the webpage attribute information returned by the browser-independent application, where the security identifier is used to indicate whether the webpage is a secure webpage;

The first execution module is configured to invoke the receiving module if the security identifier indicates that the webpage is a secure webpage.
The client of claim 84, wherein the attribute information of the picture comprises a uniform resource locator URL of the picture.
The client according to claim 92, wherein the attribute information of the picture further comprises at least one of the following: a title of the picture, description information of the picture, and a mark of the web page where the picture is located.
A client according to claim 84, wherein

The sending module is configured to encrypt the attribute information of the picture and/or the picture and send it to the server side;

The display module is configured to receive and display the encrypted keyword corresponding to the picture returned by the server side.
A program comprising readable code, when the readable code is run on a terminal device, causing the terminal device to perform a method of searching for information in a browser according to any one of claims 1-18, 19- A method of performing picture information processing in any of the browsers described in any one of 36 or 47 or a method of picture recognition according to any one of 37 to 47.
A readable medium storing the program of claim 95.