WO2016086797A1 - Procédé de recherche d'informations et de traitement et d'identification d'image dans un navigateur, et client de navigateur - Google Patents

Procédé de recherche d'informations et de traitement et d'identification d'image dans un navigateur, et client de navigateur Download PDF

Info

Publication number
WO2016086797A1
WO2016086797A1 PCT/CN2015/095819 CN2015095819W WO2016086797A1 WO 2016086797 A1 WO2016086797 A1 WO 2016086797A1 CN 2015095819 W CN2015095819 W CN 2015095819W WO 2016086797 A1 WO2016086797 A1 WO 2016086797A1
Authority
WO
WIPO (PCT)
Prior art keywords
webpage
picture
attribute information
browser
keyword
Prior art date
Application number
PCT/CN2015/095819
Other languages
English (en)
Chinese (zh)
Inventor
田新超
刘晓健
杨晓兵
Original Assignee
北京奇虎科技有限公司
奇智软件（北京）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201410727981.XA external-priority patent/CN104536973B/zh
Priority claimed from CN201410728494.5A external-priority patent/CN104536975B/zh
Priority claimed from CN201410728492.6A external-priority patent/CN104536974B/zh
Application filed by 北京奇虎科技有限公司, 奇智软件（北京）有限公司 filed Critical 北京奇虎科技有限公司
Publication of WO2016086797A1 publication Critical patent/WO2016086797A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor

Definitions

  • the present invention relates to the field of network technologies, and in particular, to a method for searching information in a browser, a browser client, a method for processing picture information in a browser, a browser client, and a method for recognizing a picture.
  • Browser client a method for searching information in a browser, a browser client, a method for processing picture information in a browser, a browser client, and a method for recognizing a picture. Browser client.
  • a web browser is a software that displays files in a web server or file system and allows users to interact with these files. It is used to display images, text, video, audio and other information on the World Wide Web or a local area network. This information is usually displayed on a web page, and the amount of information in the webpage currently displayed by the browser is huge.
  • a plurality of types of webpage elements can be provided in a webpage, including but not limited to: one or more of text, picture, audio, and video.
  • a user browses a certain webpage through a web browser, for example, when a webpage containing audio is interested in an audio, the music can be heard by clicking a link corresponding to the audio.
  • the existing web browser cannot provide other related information (such as the player information corresponding to the audio) except the music link corresponding to the audio, which is difficult for the user to obtain.
  • Other related information about audio elements can be provided in a webpage, including but not limited to: one or more of text, picture, audio, and video.
  • the existing browser can only provide the user with information about the link corresponding to the webpage element when processing the webpage element in the webpage, but cannot provide other related information except the link.
  • the present invention has been made in order to provide a method for searching for information in a browser and a browser client, a method for browsing picture information in a browser, and browsing, which overcomes the above problems or at least partially solves the above problems.
  • a method for searching for information in a browser includes: obtaining attribute information of at least one webpage element in a webpage currently loaded by a browser; and transmitting the obtained attribute information to a server side, And receiving a keyword corresponding to the attribute information returned by the server side; monitoring a first triggering operation on some or all of the webpage elements in the at least one webpage element, and setting a location of the triggered webpage element Displaying a corresponding keyword; monitoring a second triggering operation on the corresponding keyword, and initiating a preset operation based on the keyword on the browser side.
  • a browser client including: an obtaining module, configured to acquire attribute information of at least one webpage element in a webpage currently loaded by a browser; and a sending module, configured to acquire the The attribute information is sent to the server side, and receives a keyword corresponding to the attribute information returned by the server side; and a display module, configured to monitor a first trigger for some or all of the at least one webpage element An operation, displaying a corresponding keyword at a set position of the triggered webpage element; a preset operation initiating module, configured to monitor a second triggering operation on the corresponding keyword, initiated on the browser side Preset actions for keywords.
  • a method for performing picture information processing in a browser includes: acquiring picture attribute information of at least one picture element that satisfies a set condition in a currently loaded web page of a browser; The picture attribute information is sent to the server side, and receives a picture keyword corresponding to the picture attribute information returned by the server side; and detects a first triggering operation on some or all of the picture elements in the at least one picture element, Displaying the corresponding picture keyword at a set position of the triggered picture element; monitoring a second trigger operation on the corresponding picture keyword The preset operation based on the picture keyword is initiated on the browser side.
  • a browser client including: an obtaining module, configured to acquire image attribute information of at least one picture element that satisfies a set condition in a currently loaded webpage of a browser; And sending the acquired image attribute information to the server side, and receiving a picture keyword corresponding to the picture attribute information returned by the server side; and displaying a module, configured to monitor, in the at least one picture element a first triggering operation of the partial or all of the picture elements, displaying a corresponding picture keyword at a set position of the triggered picture element; and a preset operation initiation module, configured to monitor the second to the corresponding picture keyword Triggering an operation, and initiating a preset operation based on the picture keyword on the browser side.
  • a method for image recognition comprising: receiving a first triggering operation for identifying a picture, wherein the picture is a picture in a browser currently loading a webpage or the browser acquires a local picture; the attribute information of the picture and/or the picture is sent to the server side; and a keyword corresponding to the picture returned by the server side is received and displayed, wherein the keyword is used by the server
  • the side finds according to the picture and/or the attribute information corresponding to the picture.
  • a browser client including: a receiving module, configured to receive a first triggering operation for identifying a picture, where the picture is a picture in a currently loaded webpage of a browser Or a local image obtained by the browser; a sending module, configured to send the attribute information of the picture and/or the image to the server side; and a display module, configured to receive and display the returned by the server side a keyword corresponding to the picture, wherein the keyword is searched by the server side according to the picture and/or attribute information corresponding to the picture.
  • the present invention provides a program comprising readable code, when the readable code is run on a terminal device, causing the terminal device to perform the method of searching for information in a browser, in the browser A method of performing picture information processing or the method of picture recognition described above.
  • the present invention provides a readable medium in which the program is stored.
  • the browser obtains the keyword corresponding to at least one webpage element in the currently loaded webpage from the server side, and when the first triggering operation of the webpage element by the user is detected, at the set position of the triggered webpage element
  • the keyword corresponding to the webpage element is displayed, so that it is possible to solve the problem that the existing browser cannot provide the user with other related information except the link corresponding to the webpage element.
  • the solution for searching for information in the browser provided by the present invention can also monitor the second triggering operation on the displayed keyword, and initiate a keyword-based preset operation on the browser side, for example, using keywords.
  • the webpage search can provide the user with information about the keyword related webpage through the preset operation, thereby providing the user with more comprehensive information about the webpage element.
  • FIG. 1 is a flow chart showing the steps of a method for searching for information in a browser according to Embodiment 1 of the present invention
  • FIG. 2 is a flow chart showing the steps of a method for searching for information in a browser according to Embodiment 2 of the present invention
  • FIG. 3 is a flow chart showing the steps of a method for performing picture information processing in a browser according to Embodiment 3 of the present invention
  • FIG. 4 is a flow chart showing the steps of a method for performing picture information processing in a browser according to Embodiment 4 of the present invention.
  • FIG. 5 is a flow chart showing the steps of a picture recognition method according to Embodiment 5 of the present invention.
  • FIG. 6 is a flow chart showing the steps of a picture recognition method according to Embodiment 6 of the present invention.
  • FIG. 7 is a structural block diagram of a browser client according to Embodiment 7 of the present invention.
  • FIG. 8 is a structural block diagram of a browser client according to Embodiment 8 of the present invention.
  • FIG. 9 is a structural block diagram of a browser client according to Embodiment 9 of the present invention.
  • FIG. 10 is a structural block diagram of a browser client according to Embodiment 10 of the present invention.
  • FIG. 11 is a block diagram showing the structure of a browser client according to Embodiment 11 of the present invention.
  • FIG. 12 is a block diagram showing the structure of a browser client according to Embodiment 12 of the present invention.
  • Figure 13 shows a block diagram of a server configured to perform a method in accordance with the present invention
  • Figure 14 illustrates a memory unit configured to hold or carry program code that implements the method in accordance with the present invention.
  • FIG. 1 there is shown a flow chart of the steps of a method for searching for information in a browser according to Embodiment 1 of the present invention.
  • Step S102 Acquire attribute information of at least one webpage element in the webpage currently loaded by the browser.
  • the browser obtains the attribute information of which webpage elements in the currently loaded webpage may be set by a person skilled in the art according to actual needs, for example, may be set to obtain only a certain type of webpage element (for example, a video element).
  • the attribute information may also be set to obtain attribute information of a plurality of types of webpage elements (for example, a video element and a picture element), and may of course be set to obtain attribute information of other types of webpage elements, which is not specifically described in this embodiment. limited.
  • the attribute information of the audio currently loaded in the webpage by the browser, and/or the attribute information of the video, and/or the attribute information of the picture are acquired.
  • the specific attribute information obtained can be set by a person skilled in the art according to requirements in actual operation. For example, it is set to obtain only the URL of the webpage element (Uniform Resource Locator), or only the title of the webpage element, and of course, it can also be set to obtain other attribute information, so as to ensure that the obtained attribute information can uniquely identify one. Web page element.
  • Uniform Resource Locator Uniform Resource Locator
  • Step S104 Send the acquired attribute information to the server side, and receive a keyword corresponding to the attribute information returned by the server side.
  • the server side stores the corresponding relationship between the attribute information of the webpage element and the keyword. After receiving the attribute information of the webpage element, the server side obtains the keyword corresponding to the attribute information of the webpage element by searching for the corresponding relationship, and returns the keyword to the browser. .
  • Step S106 The first triggering operation on some or all of the webpage elements in the at least one webpage element is monitored, and the corresponding keyword is displayed at the set position of the triggered webpage element.
  • the first triggering operation on some or all of the webpage elements in the at least one webpage element includes, but is not limited to, hovering, clicking, selecting, and the like, for example, selecting a webpage element by using a mouse or at a certain
  • the suspension of the webpage element over a certain period of time may implement the first triggering operation on the webpage element, or may select multiple webpage elements at a time through the shortcut key to implement the first triggering operation on the plurality of webpage elements.
  • the display position of the keyword may be set to be displayed at any suitable position of the webpage element, for example, the upper left corner, the upper right corner, and the lower left corner of the webpage element, which is not specifically limited in this embodiment.
  • the embodiment is not limited, for example, it can be displayed directly on a webpage element, a bubble can be generated, a keyword can be displayed in a bubble, and of course, other display modes are not listed in this embodiment.
  • Step S108 The second triggering operation on the corresponding keyword is monitored, and the keyword-based preset operation is initiated on the browser side.
  • the browser obtains, from the server side, a keyword corresponding to at least one webpage element in the currently loaded webpage, and when the first triggering operation of the webpage element by the user is detected, The keyword corresponding to the webpage element is displayed at the set position of the triggered webpage element, and therefore, the problem that the existing browser cannot provide the user with other related information except the link corresponding to the webpage element can be solved.
  • the solution for searching for information in the browser provided by the present invention can also monitor the second triggering operation on the displayed keyword, and initiate a keyword-based preset operation on the browser side, for example, using keywords.
  • the webpage search can provide the user with information about the keyword related webpage through the preset operation, thereby providing the user with more comprehensive information about the webpage element.
  • FIG. 2 a flow chart of steps of a method for searching for information in a browser according to a second embodiment of the present invention is shown.
  • Step S202 The browser determines whether the currently loaded webpage is a secure webpage; if yes, step S204 is performed, and if not, the first setting operation is performed.
  • the first setting operation may be any appropriate operation set by a person skilled in the art according to actual needs, such as terminating the operation of loading the webpage currently.
  • a preferred step of determining whether the currently loaded webpage is a secure webpage is as follows:
  • Step S2022 The browser obtains webpage attribute information of the currently loaded webpage.
  • the webpage attribute information may be a URL of the webpage and/or title information of the webpage.
  • Step S2024 The browser sends the acquired webpage attribute information to the browser-independent application.
  • the browser-independent application may be a network shield, and may of course be another application that can be used for web page security determination.
  • Step S2026 The browser receives the security identifier corresponding to the webpage attribute information returned by the browser-independent application, where the security identifier is used to indicate whether the currently loaded webpage is a secure webpage.
  • the browser determines whether the browser currently loading the webpage is a secure webpage by using the security identifier obtained in the above steps S2022 to S2026. If the obtained security identifier indicates that the currently loaded webpage is a secure webpage, step S204 and subsequent steps of obtaining the attribute information of the at least one webpage element satisfying the set condition in the currently loaded webpage of the browser are performed. If the security identifier indicates that the currently loaded web page is not a secure web page, the first setting operation is performed.
  • Step S204 When the browser determines that the currently loaded webpage is a secure webpage, it further determines whether the currently loaded webpage has the authority to enable the server side to perform webpage element identification; if yes, step S206 is performed, and if not, the second setting operation is performed.
  • the browser can determine whether the currently loaded webpage has the right to enable the server side to identify the webpage element in the following three specific manners, as follows:
  • the first way is to determine whether the currently loaded web page has the right to enable the server side to identify the web page element through a browser-independent application.
  • the specific process is as follows:
  • the browser obtains the webpage attribute information of the currently loaded webpage; sends the obtained webpage attribute information to the browser-independent application; and receives the permission identifier corresponding to the webpage attribute information returned by the browser-independent application, wherein the permission identifier is used by the browser And indicating that the current loading webpage has the right to enable the server side to perform image recognition on the webpage element in the currently loaded webpage; if the permission identifier indicates that the current loading webpage has the right to enable the server side to perform the webpage element identification, step S206 is performed, ie, obtaining The attribute information of at least one web page element in the current loading webpage of the browser.
  • the server side can only support the identification of webpage elements in certain types of webpages, it is independent of
  • the browser application obtains the specific type of related information, and the browser-specific application determines the type of the webpage currently loaded by the browser by using the webpage attribute information sent by the browser, and then determines whether the type of the currently loaded webpage belongs to a specific type. If the type of the currently loaded webpage is in a specific type, the browser-independent application generates a permission identifier for indicating that the currently loaded webpage has the server side identifying the webpage element in the currently loaded webpage.
  • the browser-independent application If the type of the currently loaded webpage is not in a specific type supported by the server side, the browser-independent application generates a permission identifier for indicating that the currently loaded webpage does not have the server side to identify the webpage element in the currently loaded webpage. . After receiving the permission identifier sent by the browser-independent application, the browser can determine whether the currently loaded webpage has the right to enable the server side to identify the webpage element according to the type of the permission identifier.
  • the second way is to determine whether the currently loaded webpage has the right to enable the server side to identify the webpage element through the server side.
  • the specific process is as follows:
  • the browser obtains the webpage attribute information of the currently loaded webpage; the obtained webpage attribute information is sent to the server side, and receives the judgment result returned by the server side, wherein the judgment result carries the server side determining according to the webpage attribute information, determining the current loading Whether the webpage supports the information of the webpage identified by the webpage element; if the result of the judgment indicates that the currently loaded webpage supports the webpage element identification, step S206 is performed, that is, the attribute information of the at least one webpage element satisfying the set condition in the currently loaded webpage of the browser is obtained. .
  • the third way is to determine whether the currently loaded webpage has the right to enable the server side to identify the webpage element by whether the browser can receive the query sent by the server side.
  • the specific process is as follows:
  • the browser receives a message sent by the server side to query whether the webpage element is identified by the current loading webpage; and returns a response message to the server side, where the response message carries information indicating whether to accept the webpage element identification of the current webpage by the server side.
  • the server side sends an inquiry message to the browser side after determining that the browser currently loading the webpage has the authority to make the server side perform the webpage element identification. If the server side does not send an inquiry message to the browser, it proves that the webpage currently loaded by the browser does not have the authority to make the server side perform the webpage element identification.
  • the browser can determine whether the currently loaded web page has the right to enable the server side to identify the web page element by receiving the inquiry information sent by the browser side.
  • the browser may actively control whether to accept the server side to perform the currently loaded webpage by returning information indicating whether to accept the server side to identify the currently loaded webpage by the server side.
  • Web page element identification After the browser determines that the response message indicating that the current loading webpage accepts the webpage element identification by the server side is returned to the server side, step S206 is performed, that is, acquiring at least one webpage element in the currently loaded webpage of the browser. Attribute information.
  • the foregoing is an implementation manner of determining whether the currently loaded webpage has the right to enable the server side to perform webpage element identification.
  • a person skilled in the art may select any one or more of the foregoing.
  • the above steps S202 to S204 are optional steps.
  • the security of the webpage and the recognition authority of the webpage element may not be distinguished. The default is that the security is consistent with the security of the webpage element.
  • the solution of the above steps S202 to S204 is adopted, which further improves the security of the scheme for searching for information in the browser in the embodiment of the present invention.
  • Step S206 The browser acquires attribute information of at least one webpage element in the currently loaded webpage.
  • the browser acquires attribute information of at least one webpage element that satisfies the set condition in the currently loaded webpage.
  • the set condition that is satisfied may be set by a person skilled in the art according to actual needs, for example, setting only the attribute information of the picture element, or setting only the attribute information of the video element, and of course, setting The attribute information of the picture element and the video element is acquired at the same time.
  • the attribute information of the picture element is obtained in real time, and may be set to obtain only the attribute information of the picture element that meets the set size, which is not specifically limited in this embodiment.
  • the setting rule is set to obtain the attribute information of the audio element, the video element, and the picture element in the webpage currently loaded by the browser.
  • step S202 After the step S202 to the step S204, it is determined that the browser currently loads the webpage as a secure webpage and has the right to enable the server side to identify the webpage element, the browser may be triggered to perform step S206 in any of the following three cases. details as follows:
  • the first type acquires attribute information of at least one webpage element in the currently loaded webpage of the browser when the current webpage is loaded.
  • the attribute information of at least one webpage element in the currently loaded webpage of the browser is obtained.
  • the browser sets the browser to obtain the attribute information of the video element in the currently loaded webpage
  • the browser determines that the video element exists in the currently loaded webpage
  • the browser acquires at least one video in the currently loaded webpage. The attribute information of the element.
  • the specific manner of obtaining the information may be set according to actual needs, for example, obtaining all the webpages satisfying the setting conditions in the currently loaded webpage at one time.
  • the attribute information corresponding to the element for example, first obtaining attribute information corresponding to a part of the webpage element that satisfies the setting condition, and transmitting the obtained part of the attribute information to the server side, and acquiring other remaining attributes of the webpage element satisfying the setting condition. information.
  • This embodiment does not specifically limit the manner in which the browser obtains the attribute information of the webpage element that satisfies the set condition in the currently loaded webpage.
  • the attribute information may include at least one of the following URLs, a title of the webpage, webpage element description information, and a mark of the webpage where the webpage element is located.
  • the URL corresponding to the webpage element is obtained as the attribute information of the webpage element, because each of the webpages Web page elements all have URLs, so it is more convenient to get the URL corresponding to the page element.
  • the following steps are described by taking the URL of the webpage as an example.
  • Step S208 The browser sends the acquired attribute information to the server side, and receives a keyword corresponding to the attribute information returned by the server side.
  • the browser encrypts the acquired picture attribute information and sends it to the server side, and receives the encrypted picture keyword corresponding to the picture attribute information returned by the server side. Encrypting the data for transmission ensures the security of the data transmission.
  • the browser may send the attribute information of the acquired webpage element to the server side by any suitable means according to actual conditions by a person skilled in the art.
  • the browser may be configured to follow any one of the following three transmission modes.
  • the obtained web page element attribute information is sent to the server side as follows:
  • the first type all the acquired attribute information is packaged and uploaded to the server side.
  • all the attribute information obtained is grouped according to the set criteria, and each group of attribute information is sequentially uploaded according to the first setting rule.
  • the attribute information may be grouped according to the set quantity, or may be set to be grouped according to the type of the webpage element, and may also be set.
  • the attribute information of the webpage elements is grouped according to the title of the webpage element or the like.
  • the first setting rule may also be set by a person skilled in the art according to actual requirements, which is not specifically limited in this embodiment.
  • the first setting rule may be set to upload each group of attribute information according to a specific time interval, and may also be set to upload the second group of attribute information after the first group of attribute information is uploaded.
  • step S206 the attribute information of the picture element, the video element, and the audio element in the currently loaded webpage is acquired. Interest, then, when all the attribute information obtained is grouped according to the type, the attribute information of the picture element is grouped into one group, the attribute information of all the video elements is grouped, and the attribute information of all the audio elements is divided into As a group.
  • the second setting rule may also be set by a person skilled in the art according to actual needs, for example, the second setting rule may be set to be at a specific time interval (for example, every 5 times). Second) upload each group of attribute information, and can also be set to upload the second group of attribute information after the first group of attribute information is uploaded.
  • the fourth type while uploading the currently obtained attribute information to the server side, continues to obtain the attribute information of the remaining webpage elements in the currently loaded webpage, and uploads the attribute information of the webpage element that continues to be acquired to the server according to the third setting rule. On the side, all attribute information of all webpage elements in the currently loaded webpage is uploaded to the server side.
  • the third setting rule may also be set by a person skilled in the art according to actual needs, for example, set to set the acquired image attribute information according to the set time interval, and the like.
  • the setting of the third setting rule may be the same as or different from the first setting rule and the second setting rule.
  • the browser can also obtain information about the current user account, wherein the information of the user account includes information of at least one other user account associated with the user account.
  • the step of receiving the keyword corresponding to the attribute information returned by the server side includes: receiving the review information returned by the server side with the at least one other user account for the picture element and the identification information of the at least one other user account.
  • step of the browser acquiring the information of the current account may be performed before step S208, and the execution after step S208 may also be performed in parallel with step S208.
  • Step S210 The browser stores the corresponding relationship between the received attribute information and the keyword in a memory corresponding to the browser.
  • the corresponding relationship between the received picture attribute information and the picture keyword is stored in the memory corresponding to the browser, and the browser can determine the picture keyword corresponding to the triggered picture element according to the correspondence.
  • the browser When the browser currently loads the webpage to be closed, the browser deletes the correspondence between the attribute information of the webpage element and the keyword in the webpage stored in the memory corresponding to the browser.
  • this step is an optional step, and the browser stores the corresponding relationship between the attribute information of the webpage element and the keyword in the memory corresponding to the browser, thereby improving the efficiency of the scheme execution, and on the other hand,
  • the webpage element that has obtained the keyword is triggered again, it is no longer necessary to send and obtain related data to the server side, and it can be directly obtained from the memory corresponding to the browser, which not only improves the keyword acquisition efficiency, but also reduces the network. Data transfer and interaction burden.
  • Step S212 The browser monitors a first triggering operation on some or all of the webpage elements in the at least one webpage element.
  • the first triggering operation may be a triggering operation generated when the user clicks on the webpage element by the mouse, or may be a triggering operation generated by the user placing the mouse on the webpage element, or the user may select all or select some webpage elements through the shortcut key.
  • the triggering operation generated at this time is not specifically limited in this embodiment.
  • Step S214 The browser determines whether the keyword corresponding to all the webpage elements triggered by the server side has been received; if yes, step S216 is performed, and if no, step S218 is performed.
  • the correspondence between the received attribute information and the keyword is stored in the memory of the browser in the memory corresponding to the browser, it is determined whether there is any triggered webpage element in the memory corresponding to the browser.
  • the keyword can be.
  • Step S216 When the browser determines that the keyword corresponding to all the triggered webpage elements returned by the server side has been received, the operation of displaying the corresponding keyword at the set position of the triggered webpage element. Then, step S220 is performed.
  • the corresponding relationship between the attribute information returned by the server and the keyword is stored in the memory corresponding to the browser. Therefore, when acquiring the corresponding keyword of all the webpage elements that are triggered, the first determination is triggered. The attribute information of all the webpage elements, and then determining the keyword corresponding to the triggered webpage element according to the determined attribute information and the correspondence between the attribute information of the webpage element stored in the memory corresponding to the browser and the keyword, and is triggered The determined keyword is displayed at the set position of the web page element.
  • the identifier information may be set for each webpage element, and the corresponding relationship between the identifier information of the webpage element and the keyword is stored in the memory corresponding to the browser.
  • the identifier information corresponding to the triggered webpage element is determined, and the corresponding keyword is searched by the identifier information and the corresponding relationship between the identifier information and the keyword stored in the memory corresponding to the browser. .
  • Step S218 When the browser determines that the keyword corresponding to all the webpage elements that are triggered by the server side is not received, the keyword is displayed only at the set position of the webpage element corresponding to the received keyword, and according to the The fourth setting rule continues to send the attribute information of the webpage element that has not received the keyword to the server side.
  • the fourth setting rule can be set by a person skilled in the art according to actual needs, as long as the keywords corresponding to all the triggered webpage elements are obtained, which is not limited in this embodiment.
  • the fourth setting rule is set to send the attribute information of all the webpage elements that are triggered but not received the keyword to the server side, and receive the keyword returned by the server side to determine whether all the received messages are triggered. If the keyword of the webpage element is not received, the attribute information of the webpage element sent to the server side is received, the keyword is received, and whether all the triggers are received is determined. The keyword action of the page element until the browser receives the keywords of all the triggered page elements. For another example, the attribute information of the webpage element that is triggered but does not receive the keyword is grouped, and the attribute information of each group of webpage elements is sequentially sent according to the set time interval until the key of all the triggered webpage elements is received. So far.
  • the corresponding keyword may be displayed at any suitable position of each webpage element, for example, the upper left corner, the upper right corner, the lower left corner of the webpage element, etc., the implementation This example does not impose any specific restrictions.
  • the embodiment does not specifically limit, for example, it can be directly displayed on the webpage element, or a bubble can be generated, the keyword is displayed in the bubble, and of course, other display manners are no longer used in this embodiment. List one by one.
  • Step S220 The browser detects a second triggering operation on the corresponding keyword, and initiates a keyword-based preset operation on the browser side.
  • the keyword may include information such as an e-commerce webpage URL, a public number, a name of an object displayed in the webpage element, and an object type displayed in the webpage element.
  • the preset operation includes at least one of: an operation of performing a webpage search using a keyword, an access operation of a public number corresponding to the keyword, an access operation of the e-commerce webpage URL corresponding to the keyword, and a type indicated by the keyword.
  • the image is searched for.
  • the second triggering operation may be a triggering operation generated by the user clicking a certain information in the keyword by the mouse, and may be a triggering operation generated by the user selecting a certain keyword by using the external device, and the second triggering operation is not specifically performed in this embodiment. limited.
  • monitoring a second triggering operation on the corresponding keyword, and performing a keyword-based preset operation step on the browser side includes: monitoring any of the displayed
  • the second triggering operation of the keyword generates a search request containing the keyword; invoking the browser's search engine, performing a search query according to the search request; and receiving and displaying the result of the search query.
  • the keyword corresponding to an audio element is the name of the player who sings the audio, and when the user performs the second triggering operation on the keyword, a search for the player is performed, and detailed information about the player is provided.
  • the browser side When the preset operation is an access operation to the public number corresponding to the keyword, the browser side initiates access to the public number, thereby implementing access to the public number.
  • the browser side obtains the e-commerce webpage URL selected by the user, accesses the webpage URL, and displays the corresponding webpage.
  • the browser side determines the type indicated by the picture keyword, invokes a search engine to search for a picture related to the type, and displays the searched picture.
  • image keyword refers to The picture is the appearance of the Audi A6, then the type indicated by the keyword is the Audi A6.
  • the browser searches for the picture of the type indicated by the picture keyword, the image related to the Audi A6 is searched and displayed.
  • the preset operation may also be an operation of searching for the audio of the type indicated by the keyword corresponding to the audio element
  • the browser side determines the type indicated by the keyword
  • invokes the search engine to search for the audio related to the type and displays the search.
  • Audio For example, if the keyword corresponding to the audio element indicates that the audio is pop music of a certain player, then the type indicated by the keyword is the audio of the player's popular music, and the audio of the type indicated by the keyword corresponding to the audio is browsed.
  • searching the audio of the pop music played by the performer is displayed after the audio search.
  • the preset operation may also be an operation of searching for a video of a type indicated by a keyword corresponding to the video element, the browser side determines the type indicated by the keyword, invokes a search engine to search for the related video of the type, and displays the searched video.
  • the keyword corresponding to the video element indicates that the video is an action movie of a movie star
  • the type indicated by the keyword is the video of the action movie of the movie star
  • the browsing searches for the video of the type indicated by the keyword corresponding to the video.
  • the video of the movie star's action movie is searched for and displayed.
  • the keyword may also be set to include the phone number information corresponding to the webpage element, and the user may implement the effect of dialing the e-commerce call by the mobile terminal by using the phone number information in the keyword.
  • the process of making a call includes: the browser detects a trigger operation of the phone number indicated by the phone number information included in the keyword, and dials the phone number through the mobile terminal.
  • the browser obtains, from the server side, a keyword corresponding to at least one webpage element in the currently loaded webpage, and when the first triggering operation of the webpage element by the user is detected, The keyword corresponding to the webpage element is displayed at the set position of the triggered webpage element, and therefore, the problem that the existing browser cannot provide the user with other related information except the link corresponding to the webpage element can be solved.
  • the solution for searching for information in the browser provided by the present invention can also monitor the second triggering operation on the displayed keyword, and initiate a keyword-based preset operation on the browser side, for example, using keywords.
  • the webpage search can provide the user with information about the keyword related webpage through the preset operation, thereby providing the user with more comprehensive information about the webpage element.
  • FIG. 3 a flow chart of steps of a method for processing picture information in a browser according to Embodiment 3 of the present invention is shown.
  • Step S302 Acquire image attribute information of at least one picture element that satisfies the set condition in the currently loaded webpage of the browser.
  • the setting conditions in this embodiment can be set by a person skilled in the art according to actual needs, for example, setting the setting conditions to the set size, the set size, the setting type, and the like.
  • the picture attribute information of the at least one picture element that satisfies the set size in the currently loaded webpage of the browser may be acquired.
  • the specific picture attribute information obtained may also be set by a person skilled in the art according to requirements in actual operation. For example, it is set to obtain only the uniform resource locator URL of the picture, or only the title of the picture, and of course, it can also be set to obtain other attribute information, so as to ensure that the acquired picture attribute information can uniquely identify a picture element.
  • Step S304 Send the acquired picture attribute information to the server side, and receive the picture keyword corresponding to the picture attribute information returned by the server side.
  • the server side stores the corresponding relationship between the picture attribute information and the picture keyword. After receiving the picture attribute information, the server side obtains the picture keyword corresponding to the picture attribute information by searching for the corresponding relationship, and returns the picture keyword to the browser.
  • Step S306 The first triggering operation on some or all of the picture elements in the at least one picture element is monitored, and the corresponding picture keyword is displayed at the set position of the triggered picture element.
  • the first triggering operation performed on some or all of the picture elements in the at least one picture element includes, but is not limited to, suspension, clicking, selecting, and the like, for example, selecting a picture element by using a mouse or at a certain
  • the suspension of the image element over a certain period of time may implement the first triggering operation on the image element, or may select multiple image elements at a time through the shortcut key to implement the first triggering operation on multiple image elements.
  • the display position of the picture keyword may be set to be displayed at any suitable position of the picture element, for example, the upper left corner, the upper right corner, and the lower left corner of the picture element, which is not specifically limited in this embodiment.
  • the display manner of the keyword is not specifically limited in this embodiment. For example, it can be displayed directly on the picture element, or a bubble can be generated, the picture keyword is displayed in the bubble, and of course, other display modes are used in this implementation. The examples are no longer listed one by one.
  • Step S308 The second triggering operation on the corresponding picture keyword is monitored, and the preset operation based on the picture keyword is initiated on the browser side.
  • the method for processing the picture information in the browser provided in this embodiment can obtain, from the server side, a keyword corresponding to the picture element that satisfies the setting condition in the currently loaded web page, and when the user detects a certain picture element that satisfies the setting condition When the first triggering operation is performed, the keyword corresponding to the picture element is displayed at the set position of the triggered picture element, so that the existing browser client cannot provide the appearance of the object other than the image display. Other related information issues.
  • the method for processing picture information in the browser provided in this embodiment can also detect the second triggering operation of the picture keyword displayed in the setting position of the picture element, and initiate the image keyword based on the browser client side.
  • the preset operation for example, using a picture keyword to perform a webpage search, accessing an e-commerce webpage URL corresponding to the image keyword, and the like, and providing a webpage information and a picture keyword corresponding to the image keyword through the preset operation.
  • the e-commerce information, etc. thus providing the user with more comprehensive information about the picture element.
  • FIG. 4 a flow chart showing the steps of a method for processing picture information in a browser according to Embodiment 4 of the present invention is shown.
  • Step S402 The browser determines whether the currently loaded webpage is a secure webpage; if yes, step S404 is performed, and if not, the first setting operation is performed.
  • the first setting operation may be any appropriate operation set by a person skilled in the art according to actual needs, such as terminating the operation of loading the webpage currently.
  • a preferred step of determining whether the currently loaded webpage is a secure webpage is as follows:
  • Step S4022 The browser acquires webpage attribute information of the currently loaded webpage.
  • the webpage attribute information may be a URL of the webpage and/or title information of the webpage.
  • Step S4024 The browser sends the acquired webpage attribute information to the browser-independent application.
  • the browser-independent application may be a network shield, and may of course be another application that can be used for web page security determination.
  • Step S4026 The browser receives the security identifier corresponding to the webpage attribute information returned by the browser-independent application, where the security identifier is used to indicate whether the currently loaded webpage is a secure webpage.
  • the browser determines whether the webpage currently loaded by the browser is a secure webpage by using the security identifier obtained in the above steps S4022 to S4026. If the obtained security identifier indicates that the currently loaded webpage is a secure webpage, step S404 and subsequent steps of acquiring the image attribute information of the at least one picture element satisfying the set condition in the currently loaded webpage of the browser are performed. If the security identifier indicates that the currently loaded web page is not a secure web page, the first setting operation is performed.
  • Step S404 When the browser determines that the currently loaded webpage is a secure webpage, it further determines whether the currently loaded webpage has the authority to perform image recognition on the server side; if yes, step S406 is performed, and if not, the second setting operation is performed.
  • the browser can determine whether the currently loaded webpage has the server side-in by the following three specific manners.
  • the permissions for line image recognition are as follows:
  • the first way is to determine whether the currently loaded web page has the right to enable the server side to perform image recognition through a browser-independent application.
  • the specific process is as follows:
  • the browser obtains the webpage attribute information of the currently loaded webpage; sends the obtained webpage attribute information to the browser-independent application; and receives the permission identifier corresponding to the webpage attribute information returned by the browser-independent application, wherein the permission identifier is used by the browser And indicating that the currently loaded webpage has the right to enable the server side to perform image recognition on the picture element in the currently loaded webpage; if the permission identifier indicates that the currently loaded webpage has the right to enable the server side to perform the image recognition, step S406 is performed: acquiring the browser The picture attribute identification information of at least one picture element that satisfies the set condition in the currently loaded webpage.
  • the server side can only support image recognition of image elements in certain types of webpages, and the browser-independent application obtains these specific types of related information, and the webpages sent by the browser are independent of the browser application.
  • the attribute information determines the type of the webpage currently loaded by the browser, and then determines whether the type of the currently loaded webpage is in a specific type. If the type of the currently loaded webpage is in a specific type, the application independent of the browser generates an indication.
  • the current loading webpage is a permission identifier that causes the server side to perform image recognition on the picture elements in the currently loaded webpage.
  • the browser-independent application If the type of the currently loaded webpage is not in a specific type supported by the server side, the browser-independent application generates a permission to indicate that the currently loaded webpage does not have the right to enable the server side to perform image recognition permission on the picture element in the currently loaded webpage. logo. After the browser receives the permission identifier sent by the browser-independent application, it can determine whether the currently loaded webpage has the right to enable the server side to perform image recognition according to the type of the permission identifier.
  • the second way is to determine whether the currently loaded web page has the right to enable the server side to perform image recognition through the server side.
  • the specific process is as follows:
  • the browser obtains the webpage attribute information of the currently loaded webpage; the obtained webpage attribute information is sent to the server side, and receives the judgment result returned by the server side, wherein the judgment result carries the server side determining according to the webpage attribute information, determining the current loading Whether the webpage supports the information of the webpage recognized by the image; if the result of the judgment indicates that the currently loaded webpage supports the image recognition, step S406 is performed: acquiring the image attribute information of the at least one picture element that satisfies the set condition in the currently loaded webpage of the browser.
  • the third way is to determine whether the currently loaded web page has the right to enable the server side to perform image recognition by whether the browser can receive the query sent by the server side.
  • the specific process is as follows:
  • the browser receives a message sent by the server side to query whether the picture is currently uploaded, and returns a response message to the server side.
  • the response message carries information indicating whether to accept the picture recognition of the current web page by the server side.
  • the server side sends an inquiry message to the browser side after determining that the browser currently loading the webpage has the authority to perform the image recognition on the server side. If the server side does not send an inquiry message to the browser, it proves that the webpage currently loaded by the browser does not have the authority to make the image recognition on the server side.
  • the browser can determine whether the currently loaded web page has the right to enable the server side to perform picture recognition by receiving the inquiry information sent by the browser side.
  • the browser may actively control whether to accept the server side to perform the picture on the currently loaded webpage by returning information indicating whether to accept the image recognition of the currently loaded webpage by the server side. Identification.
  • step S406 is performed: acquiring at least one of the currently loaded webpages of the browser that satisfies the set condition. The picture attribute information of the picture element.
  • steps S402 to S404 are optional steps.
  • the security of the webpage and the identity of the image recognition may not be distinguished. The default is that both the security and the image recognition permission are met.
  • the solution of the above steps S402 to S404 is adopted, which further improves the security of the picture information processing scheme of the embodiment of the present invention. Sex.
  • Step S406 The browser acquires the image attribute information corresponding to the at least one picture element that satisfies the setting condition in the currently loaded webpage.
  • step S406 After determining that the browser currently loads the webpage as a secure webpage and has the authority to perform the image recognition on the server side, the browser may be triggered to perform step S406 in any of the following three situations, specifically, in step S402 to step S404. as follows:
  • the first type acquires the image attribute information of the at least one picture element that satisfies the set condition in the currently loaded webpage of the browser when the loading of the currently loaded webpage is completed.
  • the image attribute information of the at least one picture element that satisfies the set condition in the currently loaded webpage of the browser is obtained.
  • the image attribute information of the at least one picture element that satisfies the setting condition in the currently loaded webpage of the browser is obtained.
  • the set condition that is satisfied in this embodiment can be set by a person skilled in the art according to actual needs, for example, setting the setting condition to the set size, the setting type, setting the picture resolution, and the like.
  • a preferred setting manner is to selectively obtain the picture attribute information corresponding to the picture element in the currently loaded webpage by using the size of the picture element as a setting condition. That is, the browser acquires image attribute information corresponding to at least one picture element that satisfies the set size in the currently loaded web page.
  • the following steps are taken as an example to obtain image attribute information corresponding to at least one picture element that meets the set size in the currently loaded web page. It should be noted that the setting of the size of the picture element may be set by a person skilled in the art according to actual needs, which is not specifically limited in this embodiment.
  • the browser when the browser obtains the image attribute information corresponding to the at least one picture element of the set size in the currently loaded webpage, the browser may set the specific manner of obtaining according to actual requirements, for example, obtaining all the currently loaded webpages at one time.
  • the image attribute information corresponding to the picture element of the set size is satisfied, for example, the image attribute information corresponding to the image element that meets the set size is obtained first, and the acquired image attribute information is sent to the server side to obtain other remaining Picture element.
  • This embodiment does not specifically limit the manner in which the browser obtains the picture attribute information of the picture element in the currently loaded web page.
  • the image attribute information may include at least one of a URL, a title of the picture, a picture description information, a mark of the webpage where the picture is located, and a picture resolution.
  • the URL corresponding to the picture element is obtained as the picture attribute information, because each page in the webpage Each image element has a URL, so it is more convenient to get the URL corresponding to the image element.
  • the following steps are described by taking the URL of the acquired image as an example.
  • Step S408 The browser sends the acquired picture attribute information to the server side, and receives the picture keyword corresponding to the picture attribute information returned by the server side.
  • the browser encrypts the acquired picture attribute information and sends it to the server side, and receives the encrypted picture keyword corresponding to the picture attribute information returned by the server side.
  • the browser sends the acquired image attribute information to the server side, which may be adopted by any person skilled in the art according to actual conditions, and may be set to be acquired according to any one of the following three transmission modes.
  • the picture attribute information is sent to the server side as follows:
  • the first type all the acquired image attribute information is packaged and uploaded to the server side.
  • all the acquired image attribute information are grouped according to the set criteria, and each set of picture attribute information is sequentially uploaded according to the first setting rule.
  • this is not specifically limited in this embodiment, and may be set to group the picture attribute information according to the set quantity, or may be set to group according to the size of the picture element size, and may also be configured.
  • the picture attribute information, the picture title, and the like may be grouped into image attribute information, or may be set to be grouped according to the amount of uploaded picture data.
  • the first setting rule may also be set by a person skilled in the art according to actual requirements, which is not specifically limited in this embodiment.
  • the first setting rule may be set to upload each group of image attribute information according to a specific time interval, and may also be configured to upload a second group of picture attribute information after the first group of picture attribute information is uploaded.
  • the third type after uploading the currently acquired picture attribute information to the server side, continues to obtain the picture attribute information of the picture element that satisfies the set condition remaining in the currently loaded webpage, and uploads and continues to acquire according to the second setting rule.
  • the picture attribute information of the picture element is sent to the server side until all the picture attribute information of the picture element satisfying the setting condition in the currently loaded web page is uploaded to the server side.
  • the second setting rule may also be set by a person skilled in the art according to actual needs, for example, set to set the acquired image attribute information in groups according to the set time interval, and the like.
  • the setting of the second setting rule may be the same as or different from the first setting rule.
  • the browser can also obtain information about the current user account, wherein the information of the user account includes information of at least one other user account associated with the user account.
  • the step of receiving the picture keyword corresponding to the picture attribute information returned by the server side comprises: receiving the review information returned by the server side with the at least one other user account for the picture element and the identification information of the at least one other user account.
  • step of the browser acquiring the information of the current account may be performed before step S408, and the execution after step S408 may also be performed in parallel with step S408.
  • Step S410 The browser stores the corresponding relationship between the received image attribute information and the picture keyword in a memory corresponding to the browser.
  • the corresponding relationship between the received picture attribute information and the picture keyword is stored in the memory corresponding to the browser, and the browser can determine the picture keyword corresponding to the triggered picture element according to the correspondence.
  • the browser When the browser currently loads the webpage, the browser deletes the correspondence between the image attribute information of the picture element and the picture keyword in the webpage stored in the memory corresponding to the browser.
  • this step is an optional step, and the browser stores the corresponding relationship between the received image attribute information and the picture keyword in the memory corresponding to the browser, thereby improving the efficiency of the scheme execution, and on the other hand,
  • the browser stores the corresponding relationship between the received image attribute information and the picture keyword in the memory corresponding to the browser, thereby improving the efficiency of the scheme execution, and on the other hand,
  • the image that has obtained the image keyword is triggered again, it is no longer necessary to send and obtain related data to the server side, and it can be directly obtained from the memory corresponding to the browser, which improves the efficiency of obtaining the image keyword and reduces the efficiency. Network data transmission and interaction burden.
  • Step S412 The browser monitors a first triggering operation on some or all of the picture elements in the at least one picture element.
  • the first triggering operation may be a triggering operation generated when the user clicks on the image by the mouse, or may be a triggering operation generated by the user placing the mouse on the image, or may be when the user selects or selects some of the images through the shortcut keys.
  • the generated triggering operation is not specifically limited in this embodiment.
  • Step S414 The browser determines whether the picture keyword corresponding to all the picture elements that are triggered by the server side has been received; if yes, step S416 is performed, and if no, step S418 is performed.
  • the correspondence between the received picture attribute information and the picture keyword is stored in the memory of the browser in the memory corresponding to the browser, it is determined whether the memory corresponding to the browser exists.
  • the image keyword corresponding to all the image elements triggered can be used.
  • Step S416 When the browser determines that the picture keyword corresponding to all the picture elements triggered by the server side has been received, the operation of displaying the corresponding picture keyword at the set position of the triggered picture element is performed. Then, step S420 is performed.
  • the corresponding relationship between the image attribute information returned by the server side and the picture keyword is stored in the memory corresponding to the browser. Therefore, when acquiring the corresponding picture keyword of all the picture elements that are triggered, Determining the picture attribute information of all the picture elements that are triggered, and then according to the determined picture attribute information and the in-memory storage corresponding to the browser The corresponding relationship between the picture attribute information and the picture keyword determines the picture keyword corresponding to the triggered picture element, and displays the determined picture keyword at the set position of the triggered picture element.
  • the identifier information may be set for each picture element, and the corresponding relationship between the identification information of the picture element and the picture keyword is stored in the memory corresponding to the browser.
  • the identifier information corresponding to the triggered picture element is determined, and the corresponding picture is found by using the identification information and the correspondence between the identification information stored in the memory corresponding to the browser and the picture keyword. Keyword.
  • Step S418 When the browser determines that the picture keyword corresponding to all the picture elements that are triggered by the server side is not received, the picture keyword is displayed only at the set position of the picture element corresponding to the received picture keyword. And continuing to send the picture attribute information of the picture element that has not received the picture keyword to the server side according to the third setting rule.
  • the third setting rule can be set by a person skilled in the art according to actual needs, as long as the keywords corresponding to all the triggered picture elements are obtained, which is not limited in this embodiment.
  • the third setting rule is set to send the picture attribute information of all the picture elements that are triggered but not received the picture keyword to the server side, and receive the picture keyword returned by the server side to determine whether all the messages are received. If the picture key of the triggered picture element is still not received, the image attribute information is sent to the server side, the picture keyword is received, and whether all the received pictures are received is cyclically executed.
  • the picture attribute information of the picture element that is triggered but does not receive the picture keyword is grouped, and each group of picture attribute information is sequentially sent according to the set time interval until the picture key of all the triggered picture elements is received. So far.
  • the display position of the picture keyword it may be set to display the corresponding picture keyword at any suitable position of each picture element, for example, the upper left corner, the upper right corner, the lower left corner and the like of the picture element, This embodiment does not specifically limit this.
  • the display mode of the picture keyword is not limited in this embodiment.
  • the image element may be directly displayed on the picture element, or a bubble may be generated, and the picture keyword may be displayed in the bubble, and of course, other display modes are also used in this embodiment. No longer list them one by one.
  • Step S420 The browser detects a second triggering operation on the corresponding picture keyword, and initiates a preset operation based on the picture keyword on the browser side.
  • the image keyword may include information such as an e-commerce webpage URL, a public number, a name of an object displayed in the image element, and an object type displayed in the image element.
  • the second triggering operation may be a triggering operation generated by the user clicking a certain information in the keyword by the mouse, and may be a triggering operation generated by the user selecting a certain keyword by using the external device, and the second triggering operation is not specifically performed in this embodiment. limited.
  • the preset operation includes at least one of: an operation of performing a webpage search using an image keyword, an access operation of a public number corresponding to the image keyword, an access operation of an e-commerce webpage URL corresponding to the image keyword, and an image keyword The operation of the indicated type of picture to perform a search.
  • the second triggering operation for the corresponding image keyword is monitored, and the step of initializing the image keyword based on the browser side includes: monitoring the display
  • the second triggering operation of any of the image keywords generates a search request including the image keyword; invokes a browser search engine to perform a search query according to the search request; and receives and displays the result of the search query.
  • the browser side When the preset operation is an access operation to the public number corresponding to the picture keyword, the browser side initiates access to the public number, thereby implementing access to the public number.
  • the browser side obtains the e-commerce webpage URL selected by the user, accesses the webpage URL, and displays the corresponding webpage.
  • the browser side determines the picture key The type indicated by the word, the search engine is called to search for related images of the type, and the searched image is displayed.
  • the picture keyword indicates that the picture is an appearance picture of the Audi A6, and the type indicated by the keyword is the Audi A6.
  • the browser searches for the picture of the type indicated by the picture keyword, it will be related to the Audi A6.
  • the image search such as the Audi A6's car lights, car configuration pictures, engine pictures and so on.
  • the picture keyword may also be set to include the phone number information corresponding to the picture element, and the user may implement the effect of dialing the e-commerce phone through the mobile terminal by using the phone number information in the picture keyword.
  • the phone number information is an e-commerce in the picture or a phone number information of an e-commerce corresponding to the item in the sales picture.
  • the process of making a call includes: the browser detects a trigger operation of the phone number indicated by the phone number information included in the keyword, and dials the phone number through the mobile terminal.
  • the browser performs the picture information processing method in the browser provided by the embodiment, and the browser can obtain, from the server side, a keyword corresponding to the picture element that meets the set condition in the currently loaded web page, and when the user is satisfied to meet the set condition
  • the keyword corresponding to the picture element is displayed at the set position of the triggered picture element, so that the existing browser cannot provide the user with other related information except the appearance of the picture. problem.
  • the method for processing picture information in the browser provided in this embodiment can also detect the second triggering operation of the picture keyword displayed in the setting position of the picture element, and initiate the preset based on the picture keyword on the browser side.
  • the operation for example, using a picture keyword to perform a webpage search, accessing an e-commerce webpage URL corresponding to the image keyword, and the like, and providing a webpage information related to the image keyword and a photo keyword corresponding to the user through a preset operation The information of the quotient, etc., thus providing the user with more comprehensive information about the picture element.
  • FIG. 5 a flow chart of the steps of a method for picture recognition according to Embodiment 5 of the present invention is shown.
  • Step S502 Receive a first triggering operation for identifying the picture.
  • the picture is the picture in the browser's currently loaded web page or the local picture obtained by the browser.
  • the first triggering operation for recognizing the picture includes, but is not limited to, uploading the picture to a set area of the browser, dragging the picture to the browser setting area, and the like. For example, in the address bar of the browser, select uploading a browser local image, or dragging a picture in the browser's currently loaded webpage to the set location of the browser address bar, and directly loading the currently loaded webpage.
  • the picture is operated, such as clicking or hovering for a certain time, the first triggering operation for recognizing the picture can be realized.
  • Step S504 Send attribute information of the picture and/or picture to the server side.
  • a person skilled in the art can set specific information sent to the server side according to actual needs. It can be set to directly send the picture to the server side, or can be set to send the attribute information corresponding to the picture to the server side when the picture is the picture currently loaded by the browser, and can also be set to simultaneously display the picture and the picture attribute information. Send to the server side.
  • a preferred setting manner is: when the picture is a local picture of the terminal where the browser is located, uploading the picture to the server side through the browser, and when the picture is the picture currently loaded by the browser, the attribute information of the picture, such as a URL (Uniform Resource Locator) is sent to the server side, and directly transmitting the attribute information of the picture to the server side can reduce the amount of data transmitted.
  • a URL Uniform Resource Locator
  • Step S506 Receive and display the keyword corresponding to the picture returned by the server side.
  • the keyword is searched by the server side according to the attribute information corresponding to the picture and/or the picture.
  • the specific implementation manner of the keyword searching by the server side according to the attribute information corresponding to the picture and/or the picture is not specifically limited in this embodiment, and any suitable manner may be selected by a person skilled in the art according to actual needs to implement the keyword search.
  • the browser receives the first trigger operation for identifying the picture, and sends the attribute information of the picture and/or the picture to the server side, and receives and displays the keyword corresponding to the picture returned by the server side. . Therefore, with the picture recognition method provided by the embodiment, the user can identify the picture of interest through the browser, and obtain the keyword corresponding to the picture, so as to obtain other related information except the appearance of the picture.
  • FIG. 6 a flow chart of steps of a method for picture recognition according to Embodiment 6 of the present invention is shown.
  • Step S602 The browser receives a first triggering operation for identifying the picture.
  • the picture is the picture in the browser's currently loaded web page or the local picture obtained by the browser.
  • the browser may be triggered to perform step S602 in any of the following cases, including:
  • the browser receives the uploading of the local image to be uploaded to the browser's setting area according to the instruction to upload the picture.
  • the browser receives the operation of uploading the local image to be uploaded according to the instruction of uploading the image to the set position of the currently loaded webpage of the browser.
  • the browser receives an operation of dragging and dropping a picture in the currently loaded web page to a set area of the browser.
  • the browser receives an operation of dragging and dropping a picture in the currently loaded web page to a set location of the currently loaded web page.
  • the setting area may be any suitable area set by a person skilled in the art according to actual needs, for example, a setting area in the address bar, a setting area in the menu bar, a setting area in the search bar, and the like.
  • the setting position may also be any suitable position set by a person skilled in the art according to actual needs, for example, an appropriately sized area in the lower right corner of the web page, an appropriately sized area in the upper left corner of the web page, and the like.
  • a preferred manner is to determine the security of the currently loaded webpage before performing the first triggering operation step of identifying the image, if the currently loaded webpage is The secure webpage receives the first triggering operation step of identifying the image. If the currently loaded webpage is not a secure webpage, the first setting operation is performed.
  • the first setting operation may be any suitable operation set by a person skilled in the art according to actual needs, such as refusing to perform image recognition on the currently loaded picture in the webpage.
  • a preferred way for a browser to determine whether a currently loaded web page is a secure web page is as follows:
  • the browser obtains the webpage attribute information of the webpage; sends the obtained webpage attribute information to the browser-independent application; and receives the security identifier corresponding to the webpage attribute information returned by the browser-independent application, wherein the security identifier is used for Indicates if the page is a secure web page.
  • the browser determines whether the browser currently loads the webpage as a secure webpage by obtaining the security identifier.
  • the step is an optional step, and the security of the currently loaded webpage may not be distinguished.
  • the default is that the currently loaded webpage meets the security.
  • the scheme of this step is adopted to further improve the security of the picture recognition scheme of the embodiment of the present invention.
  • Step S604 The browser encrypts the attribute information of the picture and/or picture to be identified and sends it to the server side.
  • the browser may select to send the picture or picture attribute information to the server side, or send the picture and picture attribute information to the server side.
  • the browser may also select the sent information according to the type of the image.
  • the image is a locally uploaded image
  • the image is directly sent to the server side.
  • the attribute information of the image is sent to Server side.
  • the attribute information of the picture includes at least one of a URL of the picture, a title of the picture, a description information of the picture, and a mark of the webpage where the picture is located.
  • the URL corresponding to the picture is obtained as the attribute information of the picture currently loaded in the webpage,
  • Each picture element in the web page has a URL, so it is more convenient to get the URL corresponding to the picture.
  • the following steps are described by taking the local picture of the terminal where the browser is located as an example.
  • the browser After receiving the first triggering operation for identifying the acquired local image, the browser sends the acquired image to the server side, and the server searches for the keyword corresponding to the image according to the received image.
  • Step S606 The browser receives and displays the encrypted keyword corresponding to the picture returned by the server side.
  • the keyword is searched by the server side according to the attribute information corresponding to the picture and/or the picture.
  • the online query system searches for the corresponding keyword according to the attribute information of the picture and/or the picture, for example, the URL of the picture, and if the server side searches for the keyword corresponding to the attribute information of the picture or the picture from the cache, the system directly returns to the browsing. Device.
  • the server side may obtain the keyword corresponding to the attribute information of the picture and/or the picture through the offline processing system, if the server receives the picture
  • the attribute information can be downloaded according to the attribute information, and the server receives the picture without performing the operation of downloading the corresponding picture.
  • the server side classifies and clusters the pictures through image analysis technology, so that the same picture label texts can be aggregated, and the text analysis technology is used to comprehensively analyze and calculate the aggregated text and picture classification information to obtain the keywords corresponding to the pictures, and the key will be obtained.
  • the correspondence between the word and the picture and/or the picture attribute information is cached on the server side, so that the server side searches for a keyword corresponding to the attribute information of the picture and/or the picture. After the server side finds the keyword corresponding to the picture according to the attribute information of the picture and/or picture sent by the browser, the keyword returns the keyword to the browser.
  • the server side encrypts the keyword and returns to the browser, and encrypts the keyword and returns to ensure the security of the transmitted data.
  • the server since the server receives the picture information of the picture to be identified, the server directly searches for the corresponding keyword according to the picture in the above manner.
  • the browser receives the keyword corresponding to the picture returned by the server side, and displays the received keyword at the set position of the picture acquired by the browser.
  • the setting position may be any suitable position of the picture, for example, the upper left corner, the upper right corner, the lower left corner, and the like of the image, which is not specifically limited in this embodiment.
  • the browser receives the keyword corresponding to the picture returned by the server side, and displays the locality at the set position of the currently loaded web page or the set position of the newly generated web page. Images and/or received keywords.
  • the browser receives the keyword corresponding to the picture returned by the server side, and the picture in the setting area of the browser or the setting position of the currently loaded webpage.
  • the received keyword is displayed at the set position.
  • the browser receives the keyword corresponding to the picture returned by the server side, and displays the received keyword at the set position of the picture in the currently loaded webpage. .
  • Step S608 The browser stores the correspondence between the received picture and the keyword, and/or the correspondence between the attribute information of the picture and the keyword in the memory corresponding to the browser.
  • the corresponding relationship between the received picture and the keyword and/or the correspondence between the attribute information of the picture and the keyword is stored in the memory corresponding to the browser, and the second trigger for identifying the picture that has completed the picture recognition operation is received again.
  • the browser can search for the keyword corresponding to the image from the memory corresponding to the browser through the attribute information of the image and/or the image.
  • this step is an optional step, and the browser stores the corresponding relationship between the received picture and the keyword, and/or the corresponding relationship between the attribute information of the picture and the keyword in the memory corresponding to the browser.
  • the aspect improves the efficiency of the scheme execution.
  • the relevant data can be obtained directly from the memory corresponding to the browser, which not only improves the efficiency of image keyword acquisition, but also reduces the network data transmission and interaction burden.
  • Step S610 The browser receives a second triggering operation on the displayed keyword, and generates a search request including the keyword.
  • the second triggering operation may be a triggering operation generated by the user clicking a certain information in the keyword by using a mouse, and may be a triggering operation generated by the user selecting a certain keyword by using an external device, and the second triggering operation is generated in this embodiment. No specific limitation.
  • Step S612 The browser invokes the browser's search engine to perform a search query according to the search request.
  • Step S614 The browser receives and displays the result of the search query.
  • the user identifies a picture with green radish by step S602 to step S606, and the browser receives and displays the keyword "green radish” corresponding to the picture returned by the server side, when the user performs the first keyword on the keyword "green radish”
  • the browser In the second triggering operation, the browser generates a search request containing "green radish” and displays the result of the search.
  • the search result may include more detailed information about the growing habits and effects of the green radish.
  • the browser receives the first trigger operation for identifying the picture, and sends the attribute information of the picture and/or the picture to the server side, and receives and displays the keyword corresponding to the picture returned by the server side. . Therefore, with the picture recognition method provided by the embodiment, the user can identify the picture of interest through the browser, and obtain the keyword corresponding to the picture, so as to obtain other related information except the appearance of the picture. In the meantime, the image recognition method provided in this embodiment can also receive a second triggering operation on the displayed keyword, generate a search request including the keyword, and display the webpage information that is searched by the user through the keyword, because the webpage information includes A large amount of information related to the picture, therefore, can provide the user with more comprehensive information about the picture.
  • FIG. 7 a block diagram of a browser client of Embodiment 7 of the present invention is shown.
  • the browser client of the embodiment includes: an obtaining module 702, configured to acquire attribute information of at least one webpage element in a webpage currently loaded by the browser; and a sending module 704, configured to send the acquired attribute information to the server side, and receive a keyword corresponding to the attribute information returned by the server side; the display module 706 is configured to monitor a first triggering operation on some or all of the webpage elements in the at least one webpage element, and display at the set position of the triggered webpage element a corresponding keyword; a preset operation initiating module 708, configured to monitor a second triggering operation on the corresponding keyword, and initiate a preset operation based on the keyword on the browser side.
  • the browser client provided in this embodiment can obtain, from the server side, a keyword corresponding to at least one webpage element in the currently loaded webpage, and when the first triggering operation of the webpage element by the user is detected, the triggered webpage is triggered.
  • the keyword corresponding to the webpage element is displayed at the set position of the element, and therefore, the problem that the existing browser cannot provide the user with other related information except the link corresponding to the webpage element can be solved.
  • the browser client provided in this embodiment can also detect the second triggering operation on the displayed keyword, and initiate a keyword-based preset operation on the browser side, for example, using a keyword to perform a webpage search, The preset operation can provide the user with information about the keyword related webpage, thereby providing the user with more comprehensive information about the webpage element.
  • FIG. 8 a block diagram of a browser client of Embodiment 8 of the present invention is shown.
  • the browser client in the third embodiment is further optimized.
  • the optimized browser client includes: an obtaining module 802, configured to acquire attribute information of at least one webpage element in the currently loaded webpage of the browser;
  • the module 804 is configured to send the acquired attribute information to the server side, and receive a keyword corresponding to the attribute information returned by the server side.
  • the display module 806 is configured to monitor some or all of the webpage elements in the at least one webpage element. First triggering operation, Displaying a corresponding keyword at a set position of the triggered webpage element; a preset operation initiation module 808, configured to monitor a second triggering operation on the corresponding keyword, and initiate a keyword-based preset on the browser side operating.
  • the obtaining module 802 is configured to acquire attribute information of audio in the webpage currently loaded by the browser, and/or attribute information of the video, and/or attribute information of the picture.
  • the preset operation includes at least one of: an operation of performing a webpage search using a keyword, an access operation of a public number corresponding to the keyword, an access operation of the e-commerce webpage URL corresponding to the keyword, and a keyword An operation that indicates the type of picture to search.
  • the browser client of the embodiment further includes: a storage module 810, configured to store, after the sending module receives the keyword corresponding to the attribute information returned by the server side, the corresponding relationship between the received attribute information and the keyword In the memory corresponding to the browser; the display module 806 is configured to monitor a first triggering operation on some or all of the webpage elements in the at least one webpage element, determine attribute information of the triggered webpage element; and according to the determined attribute information and The corresponding relationship between the attribute information and the keyword stored in the memory corresponding to the browser determines the keyword corresponding to the triggered webpage element, and displays the determined keyword at the set position of the triggered webpage element.
  • a storage module 810 configured to store, after the sending module receives the keyword corresponding to the attribute information returned by the server side, the corresponding relationship between the received attribute information and the keyword
  • the display module 806 is configured to monitor a first triggering operation on some or all of the webpage elements in the at least one webpage element, determine attribute information of the triggered webpage element; and according to the determined attribute information and
  • the sending module 804 sends the acquired attribute information to the server side
  • all the attribute information obtained is packaged and uploaded to the server side at one time; or all the attribute information obtained is grouped according to the setting standard, and according to the first
  • the setting rule uploads each group of attribute information in turn; or, all the attribute information obtained is grouped according to the type of the webpage element, and the attribute information of each type of webpage element is sequentially uploaded according to the second setting rule; or, the current
  • the attribute information of the remaining webpage elements in the currently loaded webpage is continuously obtained, and the attribute information of the webpage element that continues to be acquired is uploaded to the server side according to the third setting rule until the currently loaded webpage is loaded. All attribute information of all webpage elements is uploaded to the server side.
  • the obtaining module 802 includes: a first obtaining module 8022, configured to acquire, when the current webpage loading is completed, the attribute information of the at least one webpage element in the current loading webpage of the browser; or the second obtaining module 8024, Obtaining the attribute information of the at least one webpage element in the webpage currently loaded by the browser when the mouse scrolling instruction is received in the current loading webpage; or the third obtaining module 8026 is configured to determine that the setting condition is met in the currently loaded webpage When the webpage element is obtained, the attribute information of at least one webpage element in the currently loaded webpage of the browser is obtained.
  • the browser client of the embodiment further includes: a first webpage attribute information obtaining module 812, configured to acquire the browser before the obtaining module 802 obtains the attribute information of the at least one webpage element in the currently loaded webpage of the browser The webpage attribute information of the current webpage is loaded; the first webpage attribute information sending module 814 is configured to send the obtained webpage attribute information to the browser-independent application; the security identifier receiving module 816 is configured to receive the browser-independent application return.
  • the browser client of the embodiment further includes: a second webpage attribute information obtaining module 820, configured to acquire the browser before the obtaining module 802 obtains the attribute information of the at least one webpage element in the webpage currently loaded by the browser Currently, the webpage attribute information of the webpage is loaded; the second webpage attribute information sending module 822 is configured to send the obtained webpage attribute information to the browser-independent application; the permission identifier receiving module 824 is configured to receive the browser-independent application return.
  • a second webpage attribute information obtaining module 820 configured to acquire the browser before the obtaining module 802 obtains the attribute information of the at least one webpage element in the webpage currently loaded by the browser Currently, the webpage attribute information of the webpage is loaded
  • the second webpage attribute information sending module 822 is configured to send the obtained webpage attribute information to the browser-independent application
  • the permission identifier receiving module 824 is configured to receive the browser-independent application return.
  • the permission identifier corresponding to the webpage attribute information wherein the permission identifier is used to indicate whether the currently loaded webpage has the right to enable the server to identify the webpage element in the currently loaded webpage;
  • the second invoking module 826 is configured to: The current loading web page has the right to enable the server to identify the web page element, and the acquisition module 802 is invoked.
  • the browser client of the embodiment further includes: a third webpage attribute information obtaining module 828, configured to acquire a current browser before the obtaining module acquires attribute information of at least one webpage element in the currently loaded webpage of the browser Loading the webpage attribute information of the webpage; the third webpage attribute information sending module 830 is configured to send the obtained attribute information to the server side, and receive the judgment result returned by the server side, wherein the judgment result carries the server side according to the webpage attribute information Indeed And determining, by the third calling module 832, the acquiring module 802, if the determining result indicates that the currently loaded webpage supports the webpage element identification.
  • a third webpage attribute information obtaining module 828 configured to acquire a current browser before the obtaining module acquires attribute information of at least one webpage element in the currently loaded webpage of the browser Loading the webpage attribute information of the webpage
  • the third webpage attribute information sending module 830 is configured to send the obtained attribute information to the server side, and receive the judgment result returned by the server side, wherein the judgment result carries the server side according to the webpage attribute information
  • the browser client of the embodiment further includes: an inquiry receiving module 834, configured to: before the obtaining module 802 acquires the attribute information of the at least one webpage element in the webpage currently loaded by the browser, whether the inquiry sent by the server side is The message is currently loaded by the webpage to identify the webpage element.
  • the response message returning module 836 is configured to return a response message to the server side, and the response message carries information indicating whether to accept the webpage element identification of the currently loaded webpage by the server side.
  • the obtaining module 802 is configured to obtain, after returning the response message indicating that the current webpage accepts the information of the webpage element identification by the server side, to the server side, acquiring the attribute information of the at least one webpage element in the current loading webpage of the browser.
  • the attribute information of the webpage element includes the URL of the webpage element.
  • the attribute information of the webpage element further includes at least one of the following: a title of the webpage element, description information of the webpage element, and a mark of the webpage where the webpage element is located.
  • the sending module 804 is configured to encrypt the acquired attribute information and send it to the server side, and receive the encrypted keyword corresponding to the attribute information returned by the server side.
  • the display module 806 includes: a receiving determining module 8062, configured to monitor a first triggering operation on some or all of the webpage elements in the at least one webpage element; and determine whether all of the triggered webpage elements returned by the server side have been received a corresponding keyword; a first execution module 8064, configured to: if the determination result of the receiving determination module is yes, perform an operation of displaying a corresponding keyword at a set position of the triggered webpage element; the second execution module 8066, If the result of the determination by the receiving judging module is no, the keyword is displayed only at the set position of the webpage element corresponding to the received keyword, and the sending of the key is not received to the server side according to the fourth setting rule.
  • the attribute information of the page element of the word is configured to monitor a first triggering operation on some or all of the webpage elements in the at least one webpage element; and determine whether all of the triggered webpage elements returned by the server side have been received a corresponding keyword
  • a first execution module 8064 configured to: if the determination result of the
  • the preset operation initiating module 808 includes: a search request receiving module 8082, configured to monitor a second triggering operation on any keyword displayed when the preset operation is an operation of searching for a webpage using a keyword, and generate A search request including a keyword; a search engine invoking module 8084, which is used to invoke a search engine of the browser, performs a search query according to the search request; and a search result display module 8086 is configured to receive and display the result of the search query.
  • a search request receiving module 8082 configured to monitor a second triggering operation on any keyword displayed when the preset operation is an operation of searching for a webpage using a keyword, and generate A search request including a keyword
  • a search engine invoking module 8084 which is used to invoke a search engine of the browser, performs a search query according to the search request
  • a search result display module 8086 is configured to receive and display the result of the search query.
  • the keyword includes the phone number information corresponding to the webpage element
  • the preset operation initiating module 808 is configured to monitor the triggering operation of the phone number indicated by the phone number information included in the webpage element, and dial the phone number through the mobile terminal.
  • the browser client of the embodiment further includes: an account information obtaining module 838, configured to acquire information about a current user account of the browser, wherein the information of the user account includes at least one other associated with the user account.
  • the information of the user account the sending module 804, when receiving the keyword corresponding to the attribute information returned by the server side, receiving the review information returned by the server side with at least one other user account and the identification information of the at least one other user account .
  • the browser client in this embodiment further includes an interface drawing module 840, configured to draw an interactive interface for the browser client, receive input and output information for interacting with the user, and a kernel processing module 842 for parsing and rendering.
  • an interface drawing module 840 configured to draw an interactive interface for the browser client, receive input and output information for interacting with the user
  • a kernel processing module 842 for parsing and rendering.
  • the displayed webpage data can be loaded, and the webpage data is displayed through the interface drawing module.
  • the interface drawing module 840 draws an interactive interface for the browser client.
  • the kernel processing module 842 parses the rendering data corresponding to the currently loaded webpage, and invokes the interface rendering module 840.
  • the parsed rendered data is drawn into a corresponding web page, that is, a web page currently loaded by the browser.
  • the obtaining module 802 acquires the attribute information of the at least one webpage element in the webpage currently loaded by the browser, and sends the attribute information to the sending module 804, and the sending module 804 sends the acquired attribute information to the server side, and The keyword corresponding to the attribute information returned by the server side is received.
  • the storage module 810 stores the corresponding relationship between the attribute information and the keyword received by the sending module in a memory corresponding to the browser, so that the corresponding keyword is searched from the memory corresponding to the browser when the webpage element is triggered by the first operation.
  • the kernel processing module 842 may receive the received interactive letter.
  • the information is converted into a first triggering operation and sent to the display module 806.
  • the display module 806 monitors the first triggering operation on some or all of the webpage elements in the at least one webpage element, and stores the attribute information and the keyword from the memory corresponding to the browser.
  • the keyword corresponding to the webpage element triggered by the first triggering operation is obtained, and the corresponding keyword is displayed and displayed by the interface drawing module 840 at the set position of the triggered webpage element.
  • the kernel processing module 842 converts the interaction information into a second trigger operation instruction and sends the message to the preset operation initiation module 808, and the preset operation initiation module 808 monitors the corresponding key.
  • the second triggering operation of the word initiates a keyword-based preset operation on the browser side.
  • the browser client of the embodiment is used to implement the method for searching for information in the browser in the corresponding browsers in the foregoing Embodiment 1 and Embodiment 2, and has the beneficial effects of the corresponding method embodiments, and details are not described herein again. .
  • FIG. 9 a block diagram of a browser client of Embodiment 9 of the present invention is shown.
  • the browser client of the embodiment includes: an obtaining module 902, configured to acquire image attribute information of at least one picture element that satisfies a set condition in a currently loaded webpage of the browser; and a sending module 904, configured to: acquire the obtained image
  • the attribute information is sent to the server side, and receives the picture keyword corresponding to the picture attribute information returned by the server side;
  • the display module 906 is configured to monitor some or all of the picture elements in the at least one picture element.
  • a first triggering operation displaying a corresponding picture keyword at a set position of the triggered picture element;
  • a preset operation initiating module 908 configured to monitor a second triggering operation on the corresponding picture keyword, in browsing
  • the device side initiates a preset operation based on the picture keyword.
  • the browser client provided in this embodiment can obtain, from the server side, a keyword corresponding to the picture element that satisfies the set condition in the currently loaded webpage, and when the user triggers the first trigger on a certain picture element that satisfies the set condition During operation, the keyword corresponding to the picture element is displayed at the set position of the triggered picture element, and therefore, the problem that the existing browser client cannot provide the user with other related information except the appearance of the picture can be solved.
  • the browser client provided in this embodiment can also detect the second triggering operation of the picture keyword displayed in the setting position of the picture element, and initiate a preset operation based on the picture keyword on the browser client side.
  • the preset operation can provide the user with information about the webpage related to the image keyword and the e-commerce corresponding to the image keyword. Information, etc., to provide users with more comprehensive information about the picture elements.
  • FIG. 10 a block diagram showing the structure of a browser client according to Embodiment 10 of the present invention is shown.
  • the browser client in the third embodiment is further optimized.
  • the optimized browser client includes: an obtaining module 1002, configured to acquire at least one picture element that meets the set condition in the currently loaded webpage of the browser. a picture attribute information; a sending module 1004, configured to send the acquired picture attribute information to the server side, and receive a picture keyword corresponding to the picture attribute information returned by the server side; the display module 1006 is configured to: Monitoring a first triggering operation on some or all of the at least one picture element, displaying a corresponding picture keyword at a set position of the triggered picture element; and a preset operation initiation module 1008 for monitoring To a second triggering operation on the corresponding picture keyword, a preset operation based on the picture keyword is initiated on the browser side.
  • the obtaining module 1002 is configured to obtain image attribute information corresponding to the at least one picture element that meets the set size in the currently loaded webpage of the browser.
  • the preset operation includes at least one of: an operation of performing webpage search using a picture keyword, an access operation of a public number corresponding to the image keyword, an access operation of an e-commerce webpage URL corresponding to the image keyword, and An operation in which a picture of the type indicated by the picture keyword is searched.
  • the browser client in this embodiment further includes: a storage module 1010, configured to: after the sending module 1004 receives the picture keyword corresponding to the picture attribute information returned by the server side, the received picture attribute information and the picture Keyword The corresponding relationship is stored in a memory corresponding to the browser; the display module 1006 is configured to monitor a first triggering operation on some or all of the picture elements in the at least one picture element, and determine picture attribute information of the triggered picture element; The picture attribute information and the corresponding relationship between the picture attribute information and the picture keyword stored in the memory corresponding to the browser, determining the picture keyword corresponding to the triggered picture element, and displaying the determined position at the set position of the triggered picture element Image keyword.
  • a storage module 1010 configured to: after the sending module 1004 receives the picture keyword corresponding to the picture attribute information returned by the server side, the received picture attribute information and the picture Keyword The corresponding relationship is stored in a memory corresponding to the browser; the display module 1006 is configured to monitor a first triggering operation on some or all of the picture
  • the sending module 1004 sends the acquired image attribute information to the server side: all the acquired image attribute information is all uploaded to the server side at one time; or all the acquired image attribute information is grouped according to the setting criteria. And uploading each group of image attribute information in sequence according to the first setting rule; or, while uploading the currently acquired picture attribute information to the server side, continuing to obtain the picture attribute of the picture element that satisfies the setting condition remaining in the currently loaded webpage The information is uploaded to the server side according to the second setting rule, and all the picture attribute information of the picture element that satisfies the setting condition in the currently loaded web page is uploaded to the server side.
  • the obtaining module 1002 includes: a first obtaining module 10022, configured to acquire image attribute information of at least one picture element that satisfies the setting condition in the currently loaded webpage of the browser when the currently loaded webpage loading is completed; or
  • the obtaining module 10024 is configured to: when the mouse scrolling instruction is received under the current loading webpage, acquire the image attribute information of the at least one picture element that satisfies the setting condition in the currently loaded webpage of the browser; or the third obtaining module 10026 is configured to: When it is determined that there is a picture element that satisfies the setting condition in the currently loaded webpage, the image attribute information of the at least one picture element that satisfies the setting condition in the currently loaded webpage of the browser is obtained.
  • the browser client in this embodiment further includes: a first webpage attribute information obtaining module 1012, configured to acquire, in the acquiring module 1002, a picture attribute of the at least one picture element that satisfies the set condition in the currently loaded webpage of the browser.
  • the webpage attribute information of the currently loaded webpage of the browser is obtained;
  • the first webpage attribute information sending module 1014 is configured to send the obtained webpage attribute information to the browser-independent application;
  • the security identifier receiving module 1016 is configured to receive The security identifier corresponding to the webpage attribute information returned by the browser-independent application, wherein the security identifier is used to indicate whether the current webpage is a secure webpage, and the first calling module 1018 is configured to indicate that the currently loaded webpage is in the security identifier.
  • the secure web page invokes the acquisition module 1002.
  • the browser client in this embodiment further includes: a second webpage attribute information obtaining module 1020, configured to acquire, in the obtaining module 1002, a picture attribute of the at least one picture element that satisfies the set condition in the currently loaded webpage of the browser.
  • a second webpage attribute information obtaining module 1020 configured to acquire, in the obtaining module 1002, a picture attribute of the at least one picture element that satisfies the set condition in the currently loaded webpage of the browser.
  • the webpage attribute information of the currently loaded webpage of the browser is obtained;
  • the second webpage attribute information sending module 1022 is configured to send the obtained webpage attribute information to the browser-independent application;
  • the permission identifier receiving module 1024 is configured to receive The permission identifier corresponding to the webpage attribute information returned by the browser-independent application, wherein the permission identifier is used to indicate whether the currently loaded webpage has permission for the server side to perform image recognition on the picture element in the currently loaded webpage;
  • the module 1026 is configured to invoke the obtaining module 1002 when the permission identifier indicates that the currently loaded webpage has the authority to perform image recognition on the server side.
  • the browser client in this embodiment further includes: a third webpage attribute information obtaining module 1028, configured to acquire, in the acquiring module, the image attribute information of the at least one picture element that satisfies the set condition in the currently loaded webpage of the browser.
  • the webpage attribute information of the currently loaded webpage of the browser is obtained;
  • the third webpage attribute information sending module 1030 is configured to send the obtained webpage attribute information to the server side, and receive the judgment result returned by the server side, wherein the judgment result is And carrying the information that is determined by the server side according to the webpage attribute information to determine whether the currently loaded webpage supports the webpage of the image recognition.
  • the third invoking module 1032 is configured to invoke the obtaining module 1002 if the judgment result indicates that the currently loaded webpage supports the image recognition. .
  • the browser client in this embodiment further includes: an inquiry receiving module 1034, configured to receive before the obtaining module 1002 obtains the picture attribute information of the at least one picture element that satisfies the set condition in the currently loaded webpage of the browser.
  • the message sent by the server side is a message for identifying the currently loaded webpage.
  • the response message returning module 1036 is configured to return a response message to the server side, where the response message carries a message indicating whether to accept the server side to perform image recognition on the currently loaded webpage. Information.
  • the obtaining module 1002 is configured to: after determining that the response message returning module returns to the server side, indicating that the current loading is performed After receiving the response message of the information for identifying the image on the server side, the webpage obtains the image attribute information of the at least one picture element that satisfies the set condition in the currently loaded webpage of the browser.
  • the picture attribute information includes a URL of the picture.
  • the picture attribute information further includes: at least one of a title of the picture, a picture description information, a mark of the web page where the picture is located, and a picture resolution.
  • the sending module 1004 is configured to encrypt the acquired picture attribute information and send it to the server side, and receive the encrypted picture keyword corresponding to the picture attribute information returned by the server side.
  • the display module 1006 includes: a receiving determining module 10062, configured to monitor a first triggering operation on some or all of the at least one picture element; and determine whether all the picture elements that are triggered by the server side are received.
  • the first execution module 10064 is configured to: if the determination result of the receiving determination module 10062 is YES, perform an operation of displaying a corresponding picture keyword at a set position of the triggered picture element;
  • the module 10066 is configured to: if the determination result of the receiving determining module 10062 is negative, display the picture keyword only at the setting position of the picture element corresponding to the received picture keyword, and continue to the server according to the third setting rule.
  • the side sends the picture attribute information of the picture element that has not received the picture keyword.
  • the preset operation initiating module 1008 includes: a search request receiving module 10082, configured to monitor a second triggering operation on any of the displayed picture keywords when the preset operation is an operation of performing a webpage search using the picture keyword a search request including a picture keyword is generated; a search engine calling module 10084 is configured to invoke a browser search engine to perform a search query according to the search request; and a search result display module 10086 is configured to receive and display the result of the search query.
  • a search request receiving module 10082 configured to monitor a second triggering operation on any of the displayed picture keywords when the preset operation is an operation of performing a webpage search using the picture keyword a search request including a picture keyword is generated
  • a search engine calling module 10084 is configured to invoke a browser search engine to perform a search query according to the search request
  • a search result display module 10086 is configured to receive and display the result of the search query.
  • the picture keyword includes the phone number information corresponding to the picture element
  • the preset operation initiation module 1008 is configured to monitor the trigger operation of the phone number indicated by the phone number information included in the picture element, and dial the phone number through the mobile terminal.
  • the browser client in this embodiment further includes: an account information obtaining module 1038, configured to acquire information about a current user account of the browser, where the information of the user account includes at least one other user associated with the user account.
  • the information of the account; the sending module 1004 receives the picture keyword corresponding to the picture attribute information returned by the server side, and receives the review information of the picture element and the at least one other user account returned by the server side with at least one other user account. Identification information.
  • the browser client of this embodiment is used to implement the method for performing picture information processing in the corresponding browsers in the foregoing Embodiment 3 and Embodiment 4, and has the beneficial effects of the corresponding method embodiments, and details are not described herein again.
  • FIG. 11 a browser client of embodiment 11 of the present invention is shown.
  • the browser client of the embodiment includes: a receiving module 1102, configured to receive a first triggering operation for identifying a picture, where the picture is a picture in a currently loaded webpage of the browser or a local picture acquired by the browser; 1104, for sending the attribute information of the picture and/or the picture to the server side; the display module 1106 is configured to receive and display a keyword corresponding to the picture returned by the server side, where the keyword is determined by the server side according to the picture and/or Or the attribute information corresponding to the picture is found.
  • the browser client provided by the embodiment can receive the first triggering operation for identifying the picture, and send the attribute information of the picture and/or the picture to the server side, and receive and display the keyword corresponding to the picture returned by the server side.
  • the browser client provided by the embodiment can perform image recognition on the image that is of interest to the user, and obtain a keyword corresponding to the image, so as to provide the user with other related information except the appearance of the image.
  • FIG. 12 a browser client of embodiment 12 of the present invention is shown.
  • the browser client in the third embodiment is further optimized.
  • the optimized browser client includes: a receiving module 1202, configured to receive a first triggering operation for identifying a picture, where the image is a browser. The current image of the webpage or the local image acquired by the browser; the sending module 1204 is configured to send the attribute information of the image and/or the image to the server side; the display module 1206 is configured to receive and display the return of the server side, and The keyword corresponding to the picture, wherein the keyword is searched by the server side according to the attribute information corresponding to the picture and/or the picture.
  • the receiving module 1202 includes: a first instruction receiving module 12022, configured to receive an operation of uploading a local image to be uploaded to a setting area of the browser or a setting position of the currently loaded webpage according to an instruction for uploading a picture; or
  • the second instruction receiving module 12024 is configured to receive an operation of dragging a picture in the currently loaded webpage to a setting area of the browser or a setting position of the current webpage.
  • the display module 1206 includes: a first display module 12062, configured to: when the picture is a local picture acquired by the browser, receive a keyword corresponding to the picture returned by the server side, where the position of the picture acquired by the browser is Displaying the received keyword; or, the second display module 12064 is configured to: when the image is a local image acquired by the browser, receive a keyword corresponding to the image returned by the server, and set the location of the currently loaded webpage or new The local image and/or the received keyword are displayed at the set location of the generated web page.
  • a first display module 12062 configured to: when the picture is a local picture acquired by the browser, receive a keyword corresponding to the picture returned by the server side, where the position of the picture acquired by the browser is Displaying the received keyword
  • the second display module 12064 is configured to: when the image is a local image acquired by the browser, receive a keyword corresponding to the image returned by the server, and set the location of the currently loaded webpage or new The local image and/or the received keyword are displayed at the set
  • the display module 1206 includes: a third display module 1206, configured to: when the picture is a picture in the browser currently loading the webpage, receive a keyword corresponding to the picture returned by the server side, in the browser setting The received keyword is displayed at the setting position of the image in the setting position of the current or loaded webpage; or the fourth display module 12068 is configured to receive the server when the image is a picture in the browser currently loading the webpage The keyword corresponding to the picture returned by the side displays the received keyword at the set position of the picture in the currently loaded web page.
  • the browser client of the embodiment further includes: a search request receiving module 1208, configured to receive a second keyword for the displayed keyword after the display module 1206 receives and displays the keyword corresponding to the image returned by the server side.
  • the triggering operation generates a search request including a keyword;
  • the search engine calling module 1210 is configured to invoke a browser search engine to perform a search query according to the search request; and the display module 1212 is configured to receive and display the result of the search query.
  • the browser client of the embodiment further includes: a storage module 1214, configured to: after the display module 1206 receives the keyword corresponding to the image returned by the server, the correspondence between the received image and the keyword, and / or, the correspondence between the attribute information of the picture and the keyword is stored in the memory corresponding to the browser.
  • a storage module 1214 configured to: after the display module 1206 receives the keyword corresponding to the image returned by the server, the correspondence between the received image and the keyword, and / or, the correspondence between the attribute information of the picture and the keyword is stored in the memory corresponding to the browser.
  • the browser client of the embodiment further includes: a second receiving module 1216, configured to, in the storage module 1214, the correspondence between the received picture and the keyword, and/or the attribute information of the picture and the keyword After the corresponding relationship is stored in the memory corresponding to the browser, the second triggering operation for identifying the image is received again.
  • the searching module 1218 is configured to search for the corresponding image from the memory corresponding to the browser through the attribute information of the image and/or the image. Keyword.
  • the browser client of the embodiment further includes: a webpage attribute information obtaining module 1220, configured to receive, during the current loading of the webpage of the browser, the first triggering operation for identifying the image in the receiving module.
  • the webpage attribute information sending module 1222 is configured to send the obtained webpage attribute information to an application independent of the browser
  • the security identifier receiving module 1224 is configured to receive the browsing independent of the browsing.
  • the security identifier corresponding to the webpage attribute information returned by the application wherein the security identifier is used to indicate whether the webpage is a secure webpage
  • the first execution module 1226 is configured to invoke the receiving module 1202 if the security identifier indicates that the webpage is a secure webpage.
  • the attribute information of the picture includes the URL of the picture.
  • the attribute information of the picture further includes at least one of the following: a title of the picture, description information of the picture, and a mark of the webpage where the picture is located.
  • the sending module 1204 is configured to encrypt the attribute information of the picture and/or the picture and send it to the server side;
  • the display module 1206 is configured to receive and display the encrypted keyword corresponding to the picture returned by the server side.
  • the browser client of this embodiment is used to implement the method for performing picture recognition in the corresponding browsers in the foregoing Embodiment 5 and Embodiment 6, and has the beneficial effects of the corresponding method embodiments, and details are not described herein again.
  • modules in the devices of the embodiments can be adaptively changed and placed in one or more devices different from the embodiment.
  • the modules or units or components of the embodiments may be combined into one module or unit or component, and further they may be divided into a plurality of sub-modules or sub-units or sub-components.
  • any combination of the features disclosed in the specification, including the accompanying claims, the abstract and the drawings, and any methods so disclosed, or All processes or units of the device are combined.
  • Each feature disclosed in this specification (including the accompanying claims, the abstract and the drawings) may be replaced by alternative features that provide the same, equivalent or similar purpose.
  • the various component embodiments of the present invention may be implemented in hardware, or in a software module running on one or more processors, or in a combination thereof.
  • a microprocessor or digital signal processor may be used in practice to implement some or all of some or all of the components of the search for information in a browser in accordance with an embodiment of the present invention.
  • the invention can also be implemented as a device or device program (e.g., a computer program and a computer program product) for performing some or all of the methods described herein.
  • Such a program implementing the invention may be stored on a computer readable medium or may be in the form of one or more signals. Such signals may be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.
  • FIG. 13 shows a terminal device that can implement a method of searching for information in a browser, a method of performing picture information processing in a browser, or a method of picture recognition according to the present invention.
  • the terminal device conventionally includes a processor 1310 and a program product or readable medium in the form of a memory 1320.
  • the memory 1320 may be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), an EPROM, or a ROM.
  • Memory 1320 has a storage space 1330 of program code 1331 configured to perform any of the method steps described above.
  • the storage space 1330 configured as program code may include respective program codes 1331 that are respectively configured to implement various steps in the above method.
  • program codes can be read from or written to one or more program products.
  • program products include such as memory cards
  • a program code carrier such as that.
  • Such a program product is typically a portable or fixed storage unit as described with reference to FIG.
  • the storage unit may have a storage section, a storage space, and the like arranged similarly to the storage 1320 in the terminal device of FIG.
  • the program code can be compressed, for example, in an appropriate form.
  • the storage unit includes readable code 1331', ie, code that can be read by a processor, such as, for example, 1310, which when executed by the terminal device causes the terminal device to perform various steps in the methods described above .

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

L'invention concerne un procédé pour rechercher des informations dans un navigateur, un procédé pour traiter des informations d'image dans un navigateur, un procédé pour identifier une image, et un client de navigateur. Le procédé de recherche d'informations dans un navigateur comprend les étapes consistant à: acquérir des informations d'attribut concernant au moins un élément de page web dans une page web actuellement chargée d'un navigateur (S102); transmettre les informations d'attributs acquises à un côté serveur, et recevoir un mot clé correspondant aux informations d'attribut renvoyées par le côté serveur (S104); surveiller une première opération de déclenchement pour une partie ou la totalité des éléments de la page web dans ledit au moins un élément de page web, et afficher le mot clé correspondant au niveau d'une position définie de l'élément de page web déclenché (S106); et surveiller une seconde opération de déclenchement pour le mot clé correspondant, et lancer une opération pré-définie en se basant sur le mot-clé au niveau d'un côté navigateur (S108). D'autres informations pertinentes outre les liens correspondant à des éléments de page web sont fournies à un utilisateur.
PCT/CN2015/095819 2014-12-03 2015-11-27 Procédé de recherche d'informations et de traitement et d'identification d'image dans un navigateur, et client de navigateur WO2016086797A1 (fr)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
CN201410727981.XA CN104536973B (zh) 2014-12-03 2014-12-03 图片识别的方法和浏览器客户端
CN201410728494.5A CN104536975B (zh) 2014-12-03 2014-12-03 浏览器中进行图片信息处理的方法和浏览器客户端
CN201410728494.5 2014-12-03
CN201410728492.6 2014-12-03
CN201410727981.X 2014-12-03
CN201410728492.6A CN104536974B (zh) 2014-12-03 2014-12-03 在浏览器中搜索信息的方法和浏览器客户端

Publications (1)

Publication Number Publication Date
WO2016086797A1 true WO2016086797A1 (fr) 2016-06-09

Family

ID=56091004

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/095819 WO2016086797A1 (fr) 2014-12-03 2015-11-27 Procédé de recherche d'informations et de traitement et d'identification d'image dans un navigateur, et client de navigateur

Country Status (1)

Country Link
WO (1) WO2016086797A1 (fr)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7620622B1 (en) * 2001-03-08 2009-11-17 Yahoo! Inc. Method and system for indexing information and providing results for a search including objects having predetermined attributes
CN102855273A (zh) * 2012-07-16 2013-01-02 宇龙计算机通信科技(深圳)有限公司 终端和信息获取方法
CN103136206A (zh) * 2011-11-23 2013-06-05 阿里巴巴集团控股有限公司 信息展示方法和设备
CN103455587A (zh) * 2013-08-29 2013-12-18 百度在线网络技术（北京）有限公司 获取推送内容的方法及装置、接收推送内容的方法及装置
CN103703483A (zh) * 2011-06-24 2014-04-02 乐天株式会社 信息提供装置、信息提供方法、信息提供程序、信息显示程序以及存储信息提供程序的计算机可读取的记录介质
CN103984727A (zh) * 2014-05-16 2014-08-13 北京奇虎科技有限公司 基于浏览器的网页互动的方法及装置
CN104536973A (zh) * 2014-12-03 2015-04-22 北京奇虎科技有限公司 图片识别的方法和浏览器客户端
CN104536975A (zh) * 2014-12-03 2015-04-22 北京奇虎科技有限公司 浏览器中进行图片信息处理的方法和浏览器客户端
CN104536974A (zh) * 2014-12-03 2015-04-22 北京奇虎科技有限公司 在浏览器中搜索信息的方法和浏览器客户端

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7620622B1 (en) * 2001-03-08 2009-11-17 Yahoo! Inc. Method and system for indexing information and providing results for a search including objects having predetermined attributes
CN103703483A (zh) * 2011-06-24 2014-04-02 乐天株式会社 信息提供装置、信息提供方法、信息提供程序、信息显示程序以及存储信息提供程序的计算机可读取的记录介质
CN103136206A (zh) * 2011-11-23 2013-06-05 阿里巴巴集团控股有限公司 信息展示方法和设备
CN102855273A (zh) * 2012-07-16 2013-01-02 宇龙计算机通信科技(深圳)有限公司 终端和信息获取方法
CN103455587A (zh) * 2013-08-29 2013-12-18 百度在线网络技术（北京）有限公司 获取推送内容的方法及装置、接收推送内容的方法及装置
CN103984727A (zh) * 2014-05-16 2014-08-13 北京奇虎科技有限公司 基于浏览器的网页互动的方法及装置
CN104536973A (zh) * 2014-12-03 2015-04-22 北京奇虎科技有限公司 图片识别的方法和浏览器客户端
CN104536975A (zh) * 2014-12-03 2015-04-22 北京奇虎科技有限公司 浏览器中进行图片信息处理的方法和浏览器客户端
CN104536974A (zh) * 2014-12-03 2015-04-22 北京奇虎科技有限公司 在浏览器中搜索信息的方法和浏览器客户端

Similar Documents

Publication Publication Date Title
US11750683B2 (en) Computer application promotion
JP6814298B2 (ja) 警告するための方法と装置
KR101667344B1 (ko) 검색 결과들을 제공하는 방법 및 시스템
JP5656204B2 (ja) 他のユーザのユーザ嗜好に基づいて、ユーザに表示されるコンテンツをカスタマイズする方法
US20160259818A1 (en) Searching for Software Applications Based on Application Attributes
US11244352B2 (en) Selecting content associated with a collection of entities
US8725849B1 (en) Browser cache pre-population
US9679309B2 (en) Placement attribute targeting
US20120265607A1 (en) Click-to-reveal content
CN103577595B (zh) 基于当前浏览页面的关键词推送方法及装置
US10445753B1 (en) Determining popular and trending content characteristics
CN106528657A (zh) 浏览器跳转至应用程序的控制方法及装置
JP2015191655A (ja) 推奨ページを生成するための方法及び装置
WO2015103938A1 (fr) Procédé de chargement d'informations de commentaire d'un site web et client navigateur
CN103577544B (zh) 一种用于提供待发送信息的方法及装置
WO2020044096A1 (fr) Procédé et appareil de recherche d'informations, et dispositif/terminal/serveur
US8515931B1 (en) Techniques for search optimization
CN110929183A (zh) 一种数据处理方法、装置和机器可读介质
CN102760157B (zh) 一种用于生成与移动终端相对应的发布信息的方法、装置与设备
CN104536974A (zh) 在浏览器中搜索信息的方法和浏览器客户端
US20080033918A1 (en) Systems, methods and computer program products for supplemental data communication and utilization
WO2022199494A1 (fr) Procédé de recommandation de contenu à base d'intérêt d'utilisateur, et dispositif terminal
WO2024019753A1 (fr) Recommandation de catégorie avec rétroaction d'élément implicite
JP5094953B2 (ja) 情報配信装置、方法、及びプログラム
WO2016086797A1 (fr) Procédé de recherche d'informations et de traitement et d'identification d'image dans un navigateur, et client de navigateur

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15865270

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15865270

Country of ref document: EP

Kind code of ref document: A1