JP6419969B2 - Method and apparatus for providing image presentation information - Google Patents

Description

[Priority claim]
This application has priority to Chinese patent application whose filing date is November 28, 2014, application number is 20141414344.0, and invention name is “method and apparatus for providing presentation information of image” As submitted.

[Field of the Invention]
The present invention relates to the Internet technical field, and more particularly to a technique for providing presentation information of an image.

  With the widespread use of photographing devices such as mobile phones and cameras, and improvement in network speed, images are gradually becoming carriers for users to acquire information. Since the image-related information currently obtained is generally only the image itself and the image title, the image itself is simple and clear. However, due to the lack of image-related information, only the image itself and the image title are used. Certain misunderstandings are likely to occur, which reduces the efficiency with which the user obtains information.

  In addition, each image is provided to the user independently, and the number of images on the Internet is huge, but a plurality of images cannot be related, and the efficiency of acquiring information by the user is further reduced. .

  It is an object of the present invention to provide a method and apparatus for providing image presentation information.

According to one aspect of the present invention, a method for providing presentation information of an image is provided, the method comprising:
Obtaining one or more images to be viewed;
Obtaining one or more image feature information corresponding to the image based on the image to be browsed;
Obtaining presentation information corresponding to the image feature information based on the image feature information;
Providing one or more presentation information of the image that is presented at a specific location in the image.

According to another aspect of the present invention, there is further provided a presentation device for providing presentation information of an image, the device comprising:
A device for acquiring one or more images to be viewed;
An apparatus for obtaining one or more image feature information corresponding to the image based on the image to be browsed;
An apparatus for obtaining presentation information corresponding to the image feature information based on the image feature information;
An apparatus for providing one or more presentation information of the image presented at a specific position in the image.

  Compared to the prior art, the present invention acquires one or more pieces of image feature information corresponding to an image to be viewed, and acquires presentation information corresponding to the image feature information based on the image feature information. Providing and presenting a plurality of presentation information associated with the image for the user by providing one or more presentation information of the image, wherein the presentation information is presented at a specific location in the image The information is displayed at a specific position of the image, and the user can acquire the image information more easily, deepen the understanding of the image, improve the efficiency of acquiring the user information, and enhance the user experience.

  Further, the present invention obtains presentation information corresponding to the image feature information first, combines the image feature information based on the presentation information, and determines a specific position of the presentation information in the image. When the presentation information does not have a specific position, one specific position in the image is determined for the presentation information, the presentation information presentation method and the presentation effect are improved, and the user can easily acquire the image information. Deepen understanding of images, improve the efficiency of acquiring user information, and enhance user experience.

  The present invention can also acquire a related image of the image and determine presentation information of the current image based on the related presentation information of the related image. Alternatively, the present invention can be based on the candidate presentation information of the image. A presentation keyword can be determined, and then one or more presentation information corresponding to the image feature information can be acquired based on the presentation keyword. Thereby, the acquisition range of the image presentation information is expanded, the presentation information is enriched, the user can acquire the image information more easily, the understanding of the image is deepened, and the efficiency of acquiring the user information is improved. , Enhance user experience.

  In addition, the image feature information of the present invention may further include user-related information of the user, and further, based on the user-related information, combines related user information corresponding to the presentation information to correspond to the image feature information. The first preferred presentation information is determined, whereby the present invention allows the provided presentation information to further match the user's demand, allowing the user to more easily obtain image information and understand the image. Deepen, improve the efficiency of acquiring user information and enhance user experience.

  In addition, the present invention can determine second preferable presentation information corresponding to each position region of the image based on the presentation information and a specific position of the presentation information in the image, or the presentation information Based on a specific position of the presentation information in the image, the presentation range of the presentation information in the image can be combined to determine third preferable presentation information corresponding to the image. Thereby, this invention adapts the display of presentation information with an image, makes a user easy to read, improves a user's reading efficiency, and improves a user experience.

  Other features, objects, and advantages of the present invention will become more apparent from the following detailed description of non-limiting embodiments with reference to the drawings.

It is a schematic diagram which shows the presentation apparatus for providing the presentation information of the image which concerns on 1 aspect of this invention. It is a schematic diagram which shows the presentation apparatus for providing the presentation information of the image which concerns on the preferable Example of this invention. It is a flowchart which shows the method for providing the presentation information of the image which concerns on the other aspect of this invention. FIG. 5 is a flowchart illustrating a method for providing presentation information of an image according to a preferred embodiment of the present invention. FIG. 6 is an exemplary diagram for providing image presentation information to an image according to a preferred embodiment of the present invention. FIG. 6 is an exemplary diagram for providing presentation information of an image to an image according to another preferred embodiment of the present invention.

  In the drawings, the same or similar reference numerals represent the same or similar members.

  Hereinafter, the present invention will be described in more detail with reference to the drawings.

  FIG. 1 is a schematic diagram illustrating a presentation device for providing presentation information of an image according to an aspect of the present invention. The presentation device corresponds to the image based on an image for acquiring one or more images to be viewed (hereinafter abbreviated as “image acquisition device 1”) and the image to be viewed. An apparatus for acquiring one or more image feature information (hereinafter abbreviated as “feature acquisition apparatus 2”), and an apparatus for acquiring presentation information corresponding to the image feature information based on the image feature information ( And a device for providing one or more pieces of presentation information of the image (hereinafter abbreviated as “presentation device 4”). The presentation information is presented at a specific position in the image.

  Here, the presentation device includes a network device, a user device, or a device in which the network device and the user device are integrated by a network, but is not limited thereto. The network device includes an electronic device capable of automatically performing numerical calculation and information processing according to a command set or stored in advance, and hardware thereof is a microprocessor, a specific integrated circuit (ASIC), a programmable Including, but not limited to, a gate array (FPGA), a digital processor (DSP), and an embedded device. The network device includes, but is not limited to, a computer, a network host, a single network server, a plurality of network server clusters, or a cloud composed of a plurality of servers. Here, the cloud is composed of a large number of computers or network servers based on cloud computing, and cloud computing is a type of distributed computing, which is a virtual supercomputer configured by a group of loosely coupled computer clusters. It is. The user equipment includes, but is not limited to, any portable electronic product capable of human computer interaction with the user, such as a smartphone, a PDA, etc., via a keyboard, touchpad, or voice control device. As the portable electronic product, an arbitrary operation system such as an Android operation system or an iOS operation system can be adopted. Such networks include, but are not limited to, the Internet, wide area networks, metropolitan area networks, local area networks, VPN networks, wireless ad hoc networks (Ad Hoc networks) and the like. Those skilled in the art should understand that other presentation devices are equally applicable to the present invention and should fall within the protection scope of the present invention and are included as cited herein.

  Those skilled in the art can execute the present invention on an independent user device or an independent service device, and acquire an image to be browsed by the above-described independent device, acquire image feature information, acquire and present presentation information. The display of information may be performed and the provision of image presentation information may be realized by a combination of a user device and a service device. For example, the user device provides an image to be viewed by the service device, and the service device It should be understood that image feature information is acquired, presentation information is acquired, and finally the presentation information is displayed by the user device. The above combination method is merely an example, and any method for realizing display of presentation information by combining other user equipment and service equipment is applicable to the present invention and is included in the protection scope of the present invention. .

  The devices operate continuously between the devices. Here, “persistent” means that each device is in real time, or the presenting device is set to 1 according to the operation mode request set or adjusted in real time. This refers to acquiring images to be viewed, acquiring image feature information, acquiring presentation information, providing presentation information, etc. until acquisition of more than one image to be viewed is stopped. The merchant should understand.

  The image acquisition device 1 acquires one or more images to be viewed.

  Specifically, the image acquisition device 1 directly interacts with a user based on various transmission interfaces according to various communication protocols, and one or more viewings that the user has submitted by a method such as upload or search. Acquire the image to be acquired, or acquire one or more images to be viewed selected by the user in various ways such as click, touch, text input, voice input, etc., or provide on other devices In order to acquire one or more images to be browsed, the image acquisition device 1 includes other devices that can provide images to be browsed based on various transmission interfaces according to various communication protocols. Interact.

  The feature acquisition device 2 acquires one or more pieces of image feature information corresponding to the image based on the image to be browsed.

  Specifically, the feature acquisition device 2 can directly acquire image information related to the image to be browsed based on the image to be browsed, and thereby the image based on the image information. One or more pieces of image feature information corresponding to, or the feature acquisition device 2 corresponds to the image by analyzing the image to be browsed based on image processing or image recognition technology, for example. One or more image feature information is acquired.

  For example, in order to acquire image information of the image, the feature acquisition device 2 queries a database corresponding to the image or a device that can provide image information of the image based on the image to be browsed. Can do. Among them, the image information includes, but is not limited to, an image address file, image description information / character annotation, comment information on the image of one or more users, and preferably, the image information includes: User information of a user who is currently browsing the image, for example, a user ID, can be further included. More preferably, comment information on the image of the user can be acquired. Here, the image information may be information directly issued by the user or the system in the image, and may be acquired by capturing a web page related to the image in the background.

  Next, the feature acquisition device 2 statistically analyzes the image information based on the one or more pieces of image information, and obtains one or more pieces of image feature information based on a system pre-setting method or a user setting method. Determine. For example, the image information may be directly used as the image feature information, and one or more pieces of image information may be selected as the image feature information based on a demand for an application or a user demand for browsing an image at present. For example, in the case of an application related to a place (for example, a travel application), image information including a place keyword is extracted as image feature information, and in the case of an application related to a search, it is used for further search or the like. The image address file is used as image feature information.

  Alternatively, for example, the feature acquisition device 2 acquires the image features of the image to be viewed in order to acquire the image content of the image, the position of each image content in the image, and the like based on image processing or image recognition technology. Analyze and extract. The image content includes, but is not limited to, one or more of letters, numbers, objects and components within the image, preferably after extracting image features in the image Is converted into specific character information. For example, an imaged component is recognized and stored as the name of the component. The position of the image content in the image is a specific position (for example, a coordinate position) or a relative distribution position in the image of the character, number, object, and component in the object. Thereby, the feature acquisition apparatus 2 sets the image content and the position of the image content as the image feature information.

  Thereby, the acquired image feature information includes, but is not limited to, one or a combination of two or more of the image information of the image, the image content of the image, and the position of each image content in the image. .

  Here, those skilled in the art will recognize that the above-described image feature information acquisition method is merely an example, and does not limit the present invention. When other image feature information acquisition methods are applied to the present invention, the present invention is similarly applied. It should be understood that it falls within the protection scope of the invention.

  Preferably, the feature acquisition device 2 combines users browsing the image based on the image to be browsed, acquires one or more image feature information corresponding to the image, and the image feature information is Contains user related information for the user.

  Specifically, when the user who is currently browsing the image is in a login state based on the image to be browsed, the feature acquisition device 2 further includes the user related information of the user as the image feature information. Can be acquired. The user related information includes, but is not limited to, a user ID, user hobby interest information, a user position, a user comment, and the like.

  The presentation acquisition device 3 acquires presentation information corresponding to the image feature information based on the image feature information.

  Specifically, the presentation acquisition device 3 responds to the image feature information by searching based on the image feature information or by interacting with a device or database that stores a mapping relationship between the image feature information and the presentation information. Get presentation information. Among them, the presentation information includes arbitrary information that can be presented in the image, for example, comment information, description information, recommendation information, etc. of the image, but is not limited thereto.

  Here, a person skilled in the art is not limited to the present invention, and the presenting information acquisition method is merely an example. When other presenting information acquisition methods are applied to the present invention, the present invention similarly applies. It should be understood that it falls within the scope of protection.

  Preferably, the presentation acquisition device 3 acquires presentation information corresponding to the image feature information based on the image feature information, and corresponds to a specific position in the image of the presentation information.

  Here, when acquiring, the specific position information in the image of the presentation information may be directly acquired, or the specific position in the image of the presentation information may be determined by analyzing the presentation information and the image. .

  More preferably, the presentation acquisition device 3 is used for acquiring presentation information corresponding to the image feature information, and based on the presentation information, the image feature information is combined, and the specific position of the presentation information in the image Confirm.

  Specifically, the presentation acquisition device 3 responds to the image feature information by searching based on the image feature information or by interacting with a device or database that stores a mapping relationship between the image feature information and the presentation information. The presentation acquisition device 3 then analyzes the image feature information to obtain the presentation information and the image feature information of the current image based on a keyword, a specific link, etc. in the presentation information. Based on the matching relationship, a specific position in the image of the presentation information is determined.

  For example, the presentation acquisition device 3 extracts a keyword in the comment information based on the comment information for the image included in the image feature information, searches based on the keyword, and searches for one keyword related to the keyword. The above information, for example, other comments and images are acquired, and the presentation information corresponding to the image feature information is determined based on the position information in the image to be browsed included in the comments or images. . Specifically, for example, in the case where the image feature information is image explanation information “taken when eating together with the daughter of Wang Yi and the son of Naying”, the presentation acquisition device 3 reads “Daughter of Wang Yi” Was taken when eating together with the son of Naei, or after processing the content in a manner such as word splitting to obtain one or more comments related to the description, For example, an acquired comment is “good for dimples”. When this comment already includes position information in the image, the position information is directly set as a specific position in the image of the presentation information, or the original image corresponding to the comment is identified with the image to be viewed at present. Otherwise, if the version is an equal-amplification amplification or reduction version of the image that is currently viewed, the position of the comment in the original image and the position in the image that is currently viewed based on the corresponding proportional relationship. The mapping is obtained by calculating, and the mapped position is set as a specific position in the image of the presentation information, or the position information in the image is not included, or the original image corresponding to the comment is about to be browsed now If the image is not identified with the image, the image to be viewed is recognized based on the analysis of “Good for dimples” After recognizing the position of the face Te, and the specific position in the image of the presentation information the position (e.g., shown in FIG. 6).

  Alternatively, more preferably, the presentation acquisition device 3 can acquire one or more related images corresponding to the image feature information based on the image feature information, and one corresponding to the related image. The related presentation information is acquired and corresponds to the specific position of the related presentation information in the related image, and the specific position of the related presentation information and the related presentation information in the related image is determined based on the image feature information. The presentation information corresponding to the combination and the image feature information is determined, and the presentation information corresponds to a specific position in the image.

  Specifically, the presentation acquisition device 3 acquires one or more images that are similar to or correspond to the image feature information, based on a method of searching or querying the image feature information. For example, an image that completely matches the image feature information of the image to be browsed and a part of the image (completely matches the image to be browsed stored on other websites). A matching image, an image whose pixel sizes are completely matched or adjusted in the same proportion), or belong to the same type or similar type as the image feature information of the image to be viewed, or related It is the image which has. As a continuation of the previous example, when the location information of the image whose explanatory information is “taken when eating together with Wang Yi's daughter and Naying's son” is “Guangzhou”, the type of the image is “Star's” Images that belong to “gossip”, whose location is “Guangzhou”, and whose type is “star gossip” can be searched for as related images.

  Thereafter, the presentation acquisition device 3 queries a database corresponding to the related image, performs web crawling or web capture on the presentation information of the related image, or performs image analysis of the related image. , One or more related presentation information corresponding to the related image is acquired. Here, the related presentation information includes arbitrary information presented on the image, for example, comment information, explanation information, recommendation information, etc. of the image, but is not limited thereto. The related presentation information corresponds to a specific position in the related image, and the specific position can directly acquire a specific position in the related image of the related presentation information when acquiring the related presentation information, Further, by analyzing the information and the related image, the specific position of the related presentation information in the related image can be determined. Here, the acquisition of the specific position of the related presentation information is the same as or similar to the method of acquiring the specific position in the image of the presentation information in the presentation acquisition device 3 in FIG. And incorporated herein by reference.

  Thereafter, the presentation acquisition device 3 combines specific positions of the related presentation information and the related presentation information in the related image based on the image feature information of the image to be browsed. One or more are selected as the presentation information, and then a specific position in the image to be browsed is determined based on the specific position of the related presentation information.

  For example, the related image and the image to be viewed belong to an image that completely matches, and one related presentation information of the related image is in the position of the eye in the related image. If it is explanatory information such as “eye”, the explanatory information and the position are displayed as the presentation information of the image to be browsed at the position of the eye of the current image, and annotated “the eye is a suspended eye”. .

  Or, for example, if the related image and the image to be browsed do not belong to the completely matching image, the degree of similarity between the related image and the image to be browsed (for example, is it adjusted in proportion or completely different? Whether or not the related presentation information is to be the presentation information and its position can be determined. If the related image and the image to be viewed belong to two images adjusted in equal proportion, the position of the related presentation information is mapped to the position of the image to be viewed at present by the proportional adjustment relationship, If the image to be browsed is completely different, the position in the image to be browsed at present is determined based on the content of the related presentation information.

  The presentation device 4 provides one or more presentation information of the image, and the presentation information is presented at a specific position in the image.

  Specifically, when the presentation information does not include a specific position corresponding to the image, the presentation device 4 is based on a default setting (for example, displaying randomly or displaying sequentially from the upper left of the image). Or based on one or more types of information such as the issue time and content length of the presentation information, the presentation information is presented at a specific position in the image according to a predetermined presentation rule.

  Preferably, when the presentation information already includes a specific position corresponding to the image, the presentation device 4 determines one or more of the images based on the presentation information and the specific position of the presentation information in the image. Presentation information is provided, and the presentation information is presented at a specific position in the image.

  Specifically, the presentation device 4 presents the presentation information at a specific position of the image based on the presentation information and the specific position of the presentation information in the image, and includes one or more presentation information And when the presentation device is a user device or other device that needs to display the image directly, the presentation device 4 directly displays the image including the presentation information. When the presentation device is a device that does not directly display the image, such as a service device, the presentation device 4 provides one or more presentation information-containing images to a device that displays the image.

  For example, when three pieces of presentation information are included in a certain image, the presentation device 4 performs the presentation according to position information (for example, the middle of the image, the lower right corner of the image, and the lower left corner of the image) of each piece of presentation information. When the information is presented at the corresponding position of the image and the certain presentation information does not include the position information, the presentation information is displayed sequentially from the upper left corner of the image, for example, according to the preset position (for example, FIG. 5). Preferably, one or more pieces of presentation information can be presented in the sidebar of the image when the presentation information included in the image is too much, or by other installations.

  Here, the presentation information may not be edited and may be directly inserted into the image, or may be displayed on the image as editable presentation information so as to be used for user deletion, content correction, position adjustment, and the like. Good.

  Preferably, the feature acquisition device 2 acquires one or more pieces of image feature information corresponding to the image based on the image to be browsed, and includes candidate presentation information corresponding to the image in the image feature information. .

  Specifically, the image feature information obtained by the feature acquisition device 2 may include one or more candidate presentation information corresponding to the image. Here, the method by which the feature acquisition device 2 acquires image feature information is the same as or similar to the acquisition method of the feature acquisition device 2 in FIG. 1, and therefore will not be described here again and will be cited. Incorporated here.

  For example, when one or more pieces of presentation information are included in the image to be browsed, these pieces of presentation information can be used as candidate presentation information to be browsed at this time, or certain image feature information can be used as the candidate presentation information. Information such as comments and explanations included in the image to be browsed can also be used.

  More preferably, the presentation acquisition device 3 determines one or more presentation keywords based on the candidate presentation information, and also obtains one or more presentation information corresponding to the image feature information based on the presentation keywords. get.

  Specifically, the presentation acquisition device 3 is based on one or more candidate presentation information, the word having the highest appearance frequency in the candidate presentation information, or a specific code (for example, a double quotation mark (“”) / single code). A word set in brackets (“”) / double brackets (“”) or double pound sign (##)) is used as a presentation keyword. The specific code may be based on a system preliminary setting or a user setting. For example, when a word quoted with a double sharp sign (##) is used as a presentation keyword and the candidate presentation information of an image to be viewed is “# Myojo 匯 #Stars are finally together,” “Myosei Kaoru” is the keyword for presentation.

  Next, the presentation acquisition apparatus 3 searches the corresponding database for the presentation keyword based on the presentation keyword, and sets the presentation information that matches the image feature information in the search result.

  For example, as a continuation of the previous example, in the case where “Meisei Aoi” is the presentation keyword, the presentation acquisition device 3 provides the presentation information, candidate presentation information, and image features including all “Akira Aoi #” or “# Meisei Aoi #”. Search one or more of the information, and then use the obtained search results directly as the presentation information, or further search the obtained search results with other presentation keywords, and The search result is the presentation information, or further, the related image, image address, type, etc. of the obtained search result are analyzed, and the search is the same or similar to the corresponding information of the image to be browsed in the above information The result is used as the presentation information.

  Preferably, the presentation device 4 determines second preferred presentation information corresponding to each position area of the image based on the presentation information and a specific position of the presentation information in the image, and the second preferred One or more second preferred presentation information of the image is provided based on the presentation information and the specific position of the second preferred presentation information in the image, and the second preferred presentation information is at a specific position in the image. Presented.

  Specifically, when a plurality of pieces of presentation information are included in the image, each piece of presentation information corresponds to a specific position in the image, and when the amount of the presentation information is large, a plurality of pieces of presentation information are included in one position area. For this reason, when the presentation device 4 acquires the one or more presentation information, the presentation device 4 is configured based on a specific position in an image included in the presentation information, or a preliminary setting of the system. Based on a specific position determined for the presentation information through a method such as user setting, the presentation device 4 combines a position area of preliminary setting or user setting, and one or more for each position area The second preferred presentation information is determined, and, for example, the image is divided into nine regions (for example, by the Kinomiya case method, divided based on the chromaticity change of the image, Each region defines one range by a coordinate point method, and then optimizes a plurality of presentation information included in each range, for example, randomly selected, the user of the presentation information And selecting based on the number of characters corresponding to each presentation information (for example, selecting the character with the least number of characters or the appropriate number of characters) In this manner, one or more second preferable presentation information is selected for each range.

  Here, based on the coordinates in the image corresponding to the presentation information, the content corresponding to the presentation information, and the like, it is possible to determine which position region the presentation information belongs to.

  Here, the image dividing method and the second preferable method of selecting the presentation information from each range are merely examples, and the present invention is not limited thereto, and other methods can be applied to the present invention. As well as within the protection scope of the present invention.

  Next, the presentation device 4 provides one or more second preferred presentation information of the image based on the second preferred presentation information and a specific position in the image of the second preferred presentation information. The second preferred presentation information is presented at a specific position in the image. Thereby, only the finite second preferred presentation information is included in each position area of the image, and the presentation information in the entire image can be further adapted to the user's reading.

  Here, since the providing method is the same as or similar to the providing method of the presentation device 4 in FIG. 1, it will not be repeatedly described here and is incorporated herein by reference.

  Preferably, the presentation device 4 combines the presentation range of the presentation information in the image based on the presentation information and the specific position of the presentation information in the image, and obtains third preferred presentation information corresponding to the image. Determining and providing one or more third preferred presentation information of the image based on the third preferred presentation information and a specific position in the image of the third preferred presentation information, wherein The 3 preferred presentation information is presented at a specific position in the image.

  Specifically, because each presentation information has various causes such as different number of characters, different glyph sizes, different contents, etc., the presentation range occupied when different presentation information is presented on the image For example, when the number of characters in the comment included in the first presentation information is 50 and the number of characters in the comment included in the second presentation information is 10, the first presentation information includes The occupied presentation range becomes larger.

  For this reason, when the presentation device 4 acquires the one or more presentation information, the presentation device 4 is configured based on a specific position in an image included in the presentation information, or a system preliminary setting, a user setting, etc. Based on a specific position established for the presentation information through a scheme, the presentation range is combined to optimize the presentation information, for example, selecting the smallest or most appropriate one or more of the presentation ranges As the third preferred presentation information or when the presentation device 4 is not suitable for combining the presentation ranges based on the specific position and presenting the presentation information that is too short or too long at the specific position, Appropriate presentation information or other presentation information is selected as the third preferred presentation information. For example, a color tone or chromaticity analysis is performed on the image, the same or similar ones are defined in one area, and when the presentation information is presented, the area where the position is located is not exceeded. It is set as 3rd preferable presentation information.

  Here, a person skilled in the art can adjust the presentation information by the presentation device 4 of the present invention, for example, adjustment of font, font size, line spacing, etc., and matching the presentation range corresponding to each presentation information. Should be understood. Preferably, the presentation device 4 selects and removes presentation information with poor presentation effect (for example, the font is not clear, the font size is too small, the line spacing is too small, etc.), and the presentation effect is good. May be the third preferred presentation information.

  Thereby, the presentation device 4 can display only less but better presentation information (for example, a short comment) on the image and other display information (for example, a long comment) on the sidebar of the image.

  FIG. 2 is a schematic diagram of a presentation device for providing image presentation information according to a preferred embodiment of the present invention. The presentation device corresponds to the image on the basis of an apparatus for acquiring one or more images to be browsed (hereinafter abbreviated as “image acquisition apparatus 1 ′”) and the image to be browsed. An apparatus for acquiring one or more image feature information (hereinafter abbreviated as “feature acquisition apparatus 2 ′”), and for acquiring presentation information corresponding to the image feature information based on the image feature information; Based on the user related information, the apparatus (hereinafter referred to as “presentation acquisition apparatus 3 ′”) and related user information corresponding to the presentation information are combined, and first preferable presentation information corresponding to the image feature information is obtained. A device for confirmation (hereinafter abbreviated as “first preferred device 5 ′”) and a device for providing one or more first preferred presentation information of the image (hereinafter “presentation device 4 ′”). For short) Comprising a, in which, the first preferred presentation information is presented in a specific position in the image.

  Since the image acquisition device 1 ′, the feature acquisition device 2 ′, and the presentation acquisition device 3 ′ are the same as or substantially the same as the corresponding devices as shown in FIG. 1, they will not be described again and are cited here. Is incorporated herein by reference.

  The devices operate continuously between the devices. Here, “persistent” means that the presenting device is set to 1 in accordance with the operation mode request set by each device in real time, or set or adjusted in real time. Acquisition of images to be browsed, acquisition of image feature information, acquisition of presentation information, confirmation of first preferred presentation information, first preferred presentation until acquisition of one or more images to be browsed is stopped It should be understood by those skilled in the art that it refers to providing information or the like.

  Based on the user related information, the first preferable device 5 'combines related user information corresponding to the presentation information, and determines first preferable presentation information corresponding to the image feature information.

  Specifically, when the image feature information includes user-related information of the user, the first preferred device 5 ′ compares or matches the user-related information with related user information corresponding to the presentation information. By doing so, the user related information and the related user information are in a certain condition, for example, the user and the related user are friends, the user and the related user are in the same place, and the user and the related user When the conditions satisfying the same or similar interest are satisfied, the presentation information corresponding to the related user information is set as the first preferable presentation information.

  For example, when a user who presents a searched comment and a user who currently browses an image are friends, the comment is set as the first preferable presentation information.

  Among them, the user related information includes, but is not limited to, a user ID, user hobby interest information, a user position, a user comment, and the like.

  Here, the method for acquiring the related user information is the same as or similar to the method for acquiring the user information in FIG. 1, and is not repeated here and is incorporated herein by reference.

  Here, since the providing method is the same as or similar to the providing method of the presentation device 4 in FIG. 1, it will not be repeatedly described here and is incorporated herein by reference.

  In another preferred embodiment, the presenting device for providing the image presentation information can be combined with a conventional browser to form a new browser, which is, for example, a Microsoft IE browser, Netscape. Netscape browser from Mozilla, Firefox browser from Mozilla, Chrome browser from Google, Maxon browser from Osha, Opera browser from Opera, 360 browser from 360, Sogo browser from Soju, Tencent TT browser from Tencent It's okay.

  In another preferred embodiment, a presentation device for providing the above image presentation information can be combined with a conventional browser plug-in to form a new browser plug-in. It may be a plug-in, RealPlayer plug-in, MMS plug-in, MIDI stave plug-in, ActiveX plug-in, or the like.

  In another preferred embodiment, a presentation device for providing the image presentation information described above can be combined with a conventional search engine to form a new search engine, which is, for example, Google's Google Google. The search engine may be a Baidu search engine from Baidu.

  In another preferred embodiment, a presentation device for providing the image presentation information can be combined with a conventional search engine plug-in to form a new search engine plug-in. For example, Google ToolBar from Google, Baidu soba from Baido, MSN ToolBar from Microsoft, etc. may be used.

  FIG. 3 is a flowchart illustrating a method for providing presentation information of an image according to another aspect of the present invention. In step S1, the presentation device acquires one or more images to be browsed. In step S2, the presentation device is configured to display one or more images corresponding to the images based on the images to be browsed. In step S3, the presentation device acquires presentation information corresponding to the image feature information based on the image feature information. In step S4, the presentation device One or more presentation information of an image is provided, in which the presentation information is presented at a specific location in the image.

  Each of the above steps is continuously operated. Here, “continuous” means that each of the above steps is performed in real time, or according to the operation mode request set or adjusted in real time. Refers to performing acquisition of an image to be browsed, acquisition of image feature information, acquisition of presentation information, provision of presentation information, etc. until acquisition of one or more images to be browsed is stopped. Those skilled in the art should understand.

  In step S1, the presentation device acquires one or more images to be viewed.

  Specifically, in step S1, the presenting device directly interacts with the user based on various transmission interfaces according to various communication protocols, and the user submits one or more submitted by a method such as upload or search. Acquire an image to be browsed, or acquire one or more images to be browsed selected by various methods such as click, touch, text input, voice input, etc., or various in step S1 Based on various transmission interfaces, the communication protocol interacts with another device that can provide an image to be viewed, and acquires one or more images to be viewed provided by the other device.

  In step S2, the presenting device acquires one or more pieces of image feature information corresponding to the image based on the image to be browsed.

  Specifically, in step S2, the presenting device can directly acquire image information related to the image to be browsed based on the image to be browsed, and thereby based on the image information. One or more pieces of image feature information corresponding to the image is acquired, or in step S2, the presentation device analyzes the image to be browsed based on, for example, image processing or image recognition technology, One or more image feature information corresponding to the image is acquired.

  For example, in step S2, in order to obtain image information of the image, the presentation device queries a database corresponding to the image or a device that can provide image information of the image based on the image to be browsed. can do. Among them, the image information includes, but is not limited to, an image address file, image description information / character annotation, one or more users' comment information on the image, and preferably, the image information includes: User information of a user who is currently browsing the image, for example, a user ID, can be further included. More preferably, comment information on the image of the user can be acquired. Here, the image information may be information directly issued by the user or the system in the image, and may be obtained by capturing a web page related to the image in the background.

  Next, in step S2, the presenting device statistically analyzes the image information based on the one or more image information, and determines one or more image features based on a system pre-setting method or a user setting method. Confirm the information. For example, the image information can be directly used as the image feature information, and one or more pieces of image information are selected as the image feature information based on a demand for an application for browsing an image or a user's demand at present. In the case of an application related to a place (for example, a travel application), image information including a place keyword is extracted as image feature information, and in the case of an application related to a search, the image is used for further search etc. The address file is used as image feature information.

  Alternatively, for example, in step S <b> 2, based on image processing or image recognition technology, the presentation device is configured to acquire the image content of the image, the position of each image content in the image, and the like. Analyze and extract features. The image content includes, but is not limited to, one or more of letters, numbers, objects and components within the image, preferably after extracting image features in the image Is converted into specific character information. For example, an imaged component is recognized and stored as the name of the component. The position of the image content in the image is a specific position (for example, a coordinate position) or a relative distribution position in the image of the character, number, object, and component in the object. Thereby, in step S2, the presenting device sets the image content and the position of the image content as the image feature information.

  Thereby, the acquired image feature information includes, but is not limited to, one or a combination of two or more of the image information of the image, the image content of the image, and the position of each image content in the image. .

  Here, those skilled in the art will recognize that the above-described image feature information acquisition method is merely an example, and does not limit the present invention. When other image feature information acquisition methods are applied to the present invention, the present invention is similarly applied. It should be understood that it falls within the protection scope of the invention.

  Preferably, in step S2, the presentation device combines users browsing the image based on the image to be browsed, acquires one or more pieces of image feature information corresponding to the image, and the image feature information Includes user-related information of the user.

  Specifically, in step S2, if the user who is currently browsing the image is in a login state based on the image to be browsed, the presentation device displays the user related information of the user as the image feature information. You can get further as. Among them, the user related information includes, but is not limited to, a user ID, user hobby interest information, a user position, a user comment, and the like.

  In step S3, the presentation device acquires presentation information corresponding to the image feature information based on the image feature information.

  Specifically, in step S3, the presentation device searches based on the image feature information, or interacts with a device or database that stores a mapping relationship between the image feature information and the presentation information. Get presentation information corresponding to the information. Among them, the presentation information includes arbitrary information that can be presented in the image, for example, comment information, description information, recommendation information, etc. of the image, but is not limited thereto.

  Here, a person skilled in the art is not limited to the present invention, and the presenting information acquisition method is merely an example. When other presenting information acquisition methods are applied to the present invention, the present invention similarly applies. It should be understood that it falls within the scope of protection.

  Preferably, the presentation acquisition device 3 acquires presentation information corresponding to the image feature information based on the image feature information, and corresponds to a specific position in the image of the presentation information.

  Here, when acquiring, the specific position information in the image of the presentation information may be directly acquired, or the specific position in the image of the presentation information may be determined by analyzing the presentation information and the image. .

  More preferably, the presentation device is used for acquiring presentation information corresponding to the image feature information, and based on the presentation information, the image feature information is combined to determine a specific position of the presentation information in the image. To do.

  Specifically, in step S3, the presentation device searches based on the image feature information, or interacts with a device or database that stores a mapping relationship between the image feature information and the presentation information. In step S3, the presentation device analyzes the image feature information to analyze the presentation information and the current image based on a keyword, a specific link, and the like. The image feature information is matched, and the specific position of the presentation information in the image is determined based on the matching relationship.

  For example, in step S3, the presenting device extracts a keyword in the comment information based on the comment information of the image included in the image feature information, searches based on the keyword, and relates to the keyword 1 Acquire more than one information, for example, other comments, images, etc., and confirm presentation information corresponding to the image feature information based on the position information in the image to be browsed included in the comments or images. To do. Specifically, for example, in the case where the image feature information is image description information “taken when the king's daughter and Naying's son took a meal together”, in step S3, the presenting device reads “ Search for "taken when my daughter and Naying's son took a meal together", or search after processing the content in a manner such as word splitting to obtain one or more comments related to the description For example, an acquired comment is “Emboss is good”. When this comment already includes position information in the image, the position information is directly set as a specific position in the image of the presentation information, or the original image corresponding to the comment is identified with the image to be viewed at present. Otherwise, if the version is an equal-amplification amplification or reduction version of the image that is currently viewed, the position of the comment in the original image and the position in the image that is currently viewed based on the corresponding proportional relationship. The mapping is obtained by calculating, and the mapped position is set as a specific position in the image of the presentation information, or the position information in the image is not included, or the original image corresponding to the comment is about to be browsed now If the image is not identified with the image, the image to be viewed is recognized based on the analysis of “Good for dimples” After recognizing the position of the face Te, and the specific position in the image of the presentation information the position (e.g., shown in FIG. 6).

  Alternatively, more preferably, in step S3, the presentation device can acquire one or more related images corresponding to the image feature information based on the image feature information, and corresponds to the related image. One or more related presentation information is acquired, the related presentation information corresponds to a specific position in the related image, and based on the image feature information, the specific position of the related presentation information and the related presentation information in the related image is determined. The presentation information corresponding to the combination and the image feature information is determined, and the presentation information corresponds to a specific position in the image.

  Specifically, in step S3, the presenting device selects one or more images that are similar or corresponding to the image feature information based on a method of searching or querying the image feature information. For example, an image that completely matches and partially matches the image feature information of the image to be browsed (an image to be browsed stored on another website) A completely matched image, the image whose pixel size is completely matched or adjusted in proportion to each other), or belonging to the same type or similar to the image feature information of the image to be viewed, or related It is an image having sex. As a continuation of the previous example, when the location information of the image whose explanatory information is “taken when eating together with Wang Yi's daughter and Naying's son” is “Guangzhou”, the type of the image is “Star's” Images that belong to “gossip”, whose location is “Guangzhou”, and whose type is “star gossip” can be searched for as related images.

  Thereafter, in step S3, the presentation device queries a database corresponding to the related image, performs web crawling or web capture on the presentation information of the related image, or performs image analysis of the related image, etc. According to the method, one or more related presentation information corresponding to the related image is acquired. Here, the related presentation information includes arbitrary information presented on the image, for example, comment information, explanation information, recommendation information, etc. of the image, but is not limited thereto. The related presentation information corresponds to a specific position in the related image, and the specific position can directly acquire a specific position in the related image of the related presentation information when acquiring the related presentation information, By analyzing the information and the related image, a specific position of the related presentation information in the related image can be determined. Here, the acquisition of the specific position of the related presentation information is the same as or similar to the method of acquiring the specific position in the image of the presentation information in step S3 in FIG. Incorporated herein by reference.

  After that, in step S3, the presenting device combines specific positions of the related presentation information and the related presentation information in the related image based on the image feature information of the image to be browsed. One or more of them are selected as the presentation information, and then a specific position in the image to be browsed is determined based on the specific position of the related presentation information.

  For example, the description information that “the eye is a suspended eye” in which the related image belongs to an image that completely matches the image to be browsed and one related presentation information of the related image is located in the eye of the related image If it is, the explanation information and the position are displayed as the presentation information of the image to be browsed at the position of the eye of the current image, and an annotation is made that “the eye is a suspended eye”.

  Or, for example, if the related image and the image to be browsed do not belong to the completely matching image, the degree of similarity between the related image and the image to be browsed (for example, is it adjusted in proportion or completely different? Whether or not the related presentation information is to be the presentation information and its position can be determined. If the related image and the image to be viewed belong to two images adjusted in equal proportion, the position of the related presentation information is mapped to the position of the image to be viewed at present by the proportional adjustment relationship, If the image to be browsed is completely different, the position in the image to be browsed at present is determined based on the content of the related presentation information.

  In step S4, the presentation device provides one or more pieces of presentation information of the image, and the presentation information is presented at a specific position in the image.

  Specifically, when the presentation information does not include a specific position corresponding to the image, the presentation device 4 is based on a default setting (for example, displaying randomly or displaying sequentially from the upper left of the image). Or based on one or more types of information such as the issue time and content length of the presentation information, the presentation information is presented at a specific position in the image according to a predetermined presentation rule.

  Preferably, when the presentation information already includes a specific position corresponding to the image, the presentation device 4 determines one or more of the images based on the presentation information and the specific position of the presentation information in the image. Presentation information is provided, and the presentation information is presented at a specific position in the image.

  Specifically, in step S4, the presentation device presents the presentation information at a specific position of the image based on the presentation information and the specific position of the presentation information in the image, and one or more pieces of presentation information If the presentation device is a user device or other device that needs to display the image directly, in step S4, the presentation device displays the image including the presentation information. If the presentation device is a device that does not directly display the image such as a service device, in step S4, the presentation device displays one or more presentation information-containing images as the images. Provide to display equipment.

  For example, when three presentation information items are included in an image, in step S4, the presentation device adds the position information (for example, the middle of the image, the lower right corner of the image, and the lower left corner of the image) of each presentation information in the image. Therefore, the presentation information is presented at a corresponding position of the image, and when certain presentation information does not include the position information, the presentation information is displayed sequentially from the upper left corner of the image, for example, according to a preset position. (For example, as shown in FIG. 5) Preferably, one or more pieces of presentation information can be presented in the sidebar of the image when the image contains too much presentation information or by other installations.

  Here, the presentation information may not be edited and may be directly inserted into the image, or may be displayed on the image as editable presentation information so as to be used for user deletion, content correction, position adjustment, and the like. Good.

  Preferably, in step S2, the presentation device acquires one or more pieces of image feature information corresponding to the image based on the image to be browsed, and candidate presentation information corresponding to the image in the image feature information. including.

  Specifically, in step S2, the image feature information obtained by the presentation device may include one or more candidate presentation information corresponding to the image. Here, the method in which the image characteristic information is acquired in step S2 is the same as or similar to the acquisition method in step S2 in FIG. 3. Therefore, the description is not repeated here and is incorporated herein by reference. .

  For example, when one or more pieces of presentation information are included in the image to be browsed, these pieces of presentation information can be used as candidate presentation information to be browsed at this time, or certain image feature information can be used as the candidate presentation information. Information such as comments and explanations included in the image to be browsed can also be used.

  More preferably, in step S3, the presentation device determines one or more presentation keywords based on the candidate presentation information, and one or more presentations corresponding to the image feature information based on the presentation keywords. Get information.

  Specifically, in step S3, the presentation device is based on one or more candidate presentation information, the word having the highest appearance frequency in the candidate presentation information, or a specific code (for example, a double quotation mark (“”) A word set with / single key bracket (“”) / double key bracket (“”) or double sharp symbol (##)) is used as a presentation keyword. The specific code may be based on a system preliminary setting or a user setting. For example, when a word quoted with a double sharp sign (##) is used as a presentation keyword and the candidate presentation information of an image to be viewed is “# Myojo 匯 #Stars are finally together,” “Myosei Kaoru” is the keyword for presentation.

  Next, in step S3, the presentation device searches the database corresponding to the presentation keyword based on the presentation keyword, and sets the presentation information that matches the image feature information in the search result.

  For example, as a continuation of the previous example, in the case where “Meisei Aoi” is the presentation keyword, the presentation device includes all of the presentation information, candidate presentation information, and image feature information including “Akira Aoi #”. Search one or more of them, and then use the obtained search results directly as the presentation information, or further search the obtained search results with other presentation keywords, and further search obtained The result is used as the presentation information, or the related image, the image address, the type, and the like of the obtained search result are analyzed, and a search result that is the same as or similar to the corresponding information of the image to be browsed in the information is obtained. Let it be the presentation information.

  Preferably, in step S4, the presentation device determines second preferred presentation information corresponding to each position region of the image based on the presentation information and a specific position of the presentation information in the image, and Providing one or more second preferred presentation information of the image based on a specific position in the image of the two preferred presentation information and the second preferred presentation information, wherein the second preferred presentation information is in the image Presented at a specific location.

  Specifically, when a plurality of pieces of presentation information are included in the image, each piece of presentation information corresponds to a specific position in the image, and when the amount of the presentation information is large, a plurality of pieces of presentation information are included in one position area. For this reason, when the presentation device 4 acquires the one or more presentation information, the presentation device 4 is configured based on a specific position in an image included in the presentation information, or a preliminary setting of the system. One or more second preferred presentations for each location region, combining a pre-set or user-set location region based on a specific location established for the presentation information via a method such as user settings Confirm the information, for example, divide the image into nine regions (for example, divide by the Kinomiya case method, divide based on the chromaticity change of the image, divide based on the content displayed in the image), each region Constellation A range is defined by a point method, and then a plurality of presentation information included in each range is optimized, for example, randomly selected, based on the friendship between the user of the presentation information and the user who currently browses One or more second preferred for each range, such as by selecting and selecting based on the number of characters corresponding to each presentation information (e.g., selecting the least number of characters or an appropriate number of characters) Select presentation information.

  Here, based on the coordinates in the image corresponding to the presentation information, the content corresponding to the presentation information, and the like, it is possible to determine which position region the presentation information belongs to.

  Here, the image dividing method and the second preferable method of selecting the presentation information from each range are merely examples, and the present invention is not limited thereto, and other methods can be applied to the present invention. As well as within the protection scope of the present invention.

  Next, in step S4, the presenting device, based on the second preferred presentation information and a specific position in the image of the second preferred presentation information, one or more second preferred presentation information of the image. And the second preferred presentation information is presented at a specific position in the image. Thereby, only the finite second preferred presentation information is included in each position area of the image, and the presentation information in the entire image can be further adapted to the user's reading.

  Here, since the providing method is the same as or similar to the providing method of step S4 in FIG. 3, it will not be repeated here and is incorporated herein by reference.

  Preferably, in step S4, the presentation device combines a presentation range of the presentation information in the image based on the presentation information and a specific position of the presentation information in the image, and corresponds to the image. Determining presentation information, and providing one or more third preferred presentation information of the image based on the third preferred presentation information and a specific location of the third preferred presentation information in the image, wherein The third preferred presentation information is presented at a specific position in the image.

  Specifically, because each presentation information has various causes such as different number of characters, different glyph sizes, different contents, etc., the presentation range occupied when different presentation information is presented on the image For example, when the number of characters in the comment included in the first presentation information is 50 and the number of characters in the comment included in the second presentation information is 10, the first presentation information includes The occupied presentation range becomes larger.

  For this reason, when the presentation device 4 acquires the one or more presentation information, the presentation device 4 is configured based on a specific position in an image included in the presentation information, or a system preliminary setting, a user setting, etc. Based on the specific position determined for the presentation information via the method, in step S4, the presentation device optimizes the presentation information by combining the presentation ranges, for example, the smallest or most appropriate presentation range One or more selected as the third preferred presentation information, or in step S4, the presentation device combines the presentation ranges based on the specific position, and the presentation information or the length is too short at the specific position. If it is not suitable for presenting too much presentation information, appropriate presentation information or other presentation information is selected as the third preferred presentation information. For example, a color tone or chromaticity analysis is performed on the image, the same or similar ones are defined in one area, and when the presentation information is presented, the area where the position is located is not exceeded. It is set as 3rd preferable presentation information.

  Here, the person skilled in the art can adjust the presentation information by the presentation device of the present invention, for example, adjustment of font, font size, line spacing, etc., and matching the presentation range corresponding to each presentation information. Should be understood. Preferably, in step S4, the presentation device selects and removes presentation information having a poor presentation effect (for example, the font is not clear, the font size is too small, the line spacing is too small, etc.), and the presentation effect is removed. Good information can also be used as the third preferred presentation information.

  Thereby, in step S4, the presentation device displays only less but better presentation information (for example, short comments) on the image, and displays other presentation information (for example, long comments) on the sidebar of the image. Can do.

  FIG. 4 is a flowchart illustrating a method for providing presentation information of an image according to a preferred embodiment of the present invention. In step S1 ′, the presentation device acquires one or more images to be browsed, and in step S2 ′, the presentation device selects one corresponding to the image based on the images to be browsed. In step S3 ′, the presentation device acquires presentation information corresponding to the image feature information based on the image feature information, and in step S5 ′, the presentation feature is acquired. The device combines the related user information corresponding to the presentation information based on the user related information to determine first preferable presentation information corresponding to the image feature information, and in step S4 ′, the presentation device Providing one or more first preferred presentation information of the image, wherein the first preferred presentation information is at a specific position in the image; It is shown.

  Steps S1 ′, S2 ′, and S3 ′ are the same as or substantially the same as the corresponding steps as shown in FIG. 3, and are not described here repeatedly and are incorporated herein by reference. .

  The above-mentioned steps are continuously operated during each of the above steps. Here, “continuous” means that each of the above-mentioned steps is performed in real time, or according to the operation mode request set or adjusted in real time. Until acquisition of one or more images to be browsed is stopped, acquisition of images to be browsed, acquisition of image feature information, acquisition of presentation information, confirmation of first preferred presentation information, first preference It should be understood by those skilled in the art that it refers to providing presentation information and the like.

  In step S <b> 5 ′, based on the user related information, the presentation device combines related user information corresponding to the presentation information to determine first preferable presentation information corresponding to the image feature information.

  Specifically, when the image feature information includes user-related information of the user, in step S5 ′, the presentation device compares or matches the user-related information and related user information corresponding to the presentation information. By doing so, the user related information and the related user information are in a certain condition, for example, the user and the related user are friends, the user and the related user are in the same place, and the user and the related user When the conditions satisfying the same or similar interest are satisfied, the presentation information corresponding to the related user information is set as the first preferable presentation information.

  For example, when a user who presents a searched comment and a user who currently browses an image are friends, the comment is set as the first preferable presentation information.

  Among them, the user related information includes, but is not limited to, a user ID, user hobby interest information, a user position, a user comment, and the like.

  Here, the method for acquiring the related user information is the same as or similar to the method for acquiring the user information in FIG. 1, and is not repeated here and is incorporated herein by reference.

  Here, since the providing method is the same as or similar to the providing method of step S4 in FIG. 3, it will not be repeated here and is incorporated herein by reference.

  It should be noted that the present invention can be implemented in software and / or a combination of software and hardware, such as an application specific integrated circuit (ASIC), a general purpose computer, or any other type of hardware. It can be realized using wear. The software program of the present invention can realize the above steps or functions by being executed by a processor. Similarly, the software program (including associated data structures) of the present invention may be recorded on a computer readable recording medium, such as a RAM memory, magnetic drive or optical drive or floppy disk and similar devices. Further, some steps or functions of the present invention can be realized by hardware, for example, an electric circuit that executes each function or step in cooperation with a processor.

  Further, a part of the present invention may be used as a computer program product, for example, a computer program instruction. When executed on a computer, the method and / or technical solution according to the present invention is called by operation of the computer or Can be provided. Program instructions for invoking the method of the invention are recorded on a fixed recording medium or a removable recording medium and / or transmitted via a data stream in a broadcast or other signal bearing medium and / or in response to the program instructions Is recorded in the working memory of the computer device that operates. Here, according to an embodiment of the present invention, when the computer program instruction is executed by the processor, the apparatus includes a memory that stores the computer program instruction and a processor that executes the program instruction. The apparatus is caused to execute the methods and / or technical solutions of a plurality of embodiments according to the present invention.

  It will be apparent to those skilled in the art that the present invention is not limited to the details of the exemplary embodiments described above, and that the present invention can be implemented in other forms without departing from the spirit or basic characteristics of the invention. It is a thing. Accordingly, in any event, the examples are illustrative only and are non-limiting, and the scope of the present invention is limited not by the above description but by the appended claims, and thus the equivalent requirements of the claims All changes having meanings and ranges that fall within the scope of this invention are included in the present invention. Any reference sign in a claim should not be construed as limiting the claim. Further, the word “comprising” does not exclude other units or steps, and includes the plural when using the singular. A plurality of units or devices described in the claims may be realized by software or hardware by one unit or device. The first and second words are used to indicate names, and do not specify the order.

Claims (19)

The image acquisition device of the presentation device acquires one or more images to be viewed;
The feature acquisition device of the presentation device acquires one or more image feature information corresponding to the image based on the image to be browsed;
A step of acquiring the presentation information corresponding to the image feature information based on the image feature information , by the presentation acquisition device of the presentation device ;
Presentation device of the presentation device to provide one or more presentation information of the image, met method for providing presentation information of an image; and wherein the presentation information is presented in a specific position in the image And
The step of obtaining presentation information corresponding to the image feature information includes:
The presentation acquisition device includes a step of acquiring presentation information corresponding to the image feature information based on the image feature information, the presentation information corresponding to a specific position in the image,
Providing one or more presentation information of the image comprises:
Providing the presentation information and one or more presentation information of the image based on the presentation information and a specific position of the presentation information in the image;
The step of obtaining presentation information corresponding to the image feature information includes:
The presentation acquisition device acquiring one or more related images corresponding to the image feature information based on the image feature information;
The presentation acquisition device acquiring one or more related presentation information corresponding to the related image, wherein the related presentation information corresponds to a specific position in the related image;
The presentation acquisition device determines presentation information corresponding to the image feature information based on the image feature information and the related presentation information and a specific position of the related presentation information in the related image. A method for providing presentation information of an image including the step of determining a specific position in the image. The step of obtaining presentation information corresponding to the image feature information includes:
The presentation acquisition device acquiring presentation information corresponding to the image feature information;
The method of claim 1 including the step the presentation acquiring device, based on the presentation information and the image feature information, to determine the specific position in the image before Symbol presentation information. Obtaining one or more pieces of image feature information corresponding to the image,
The characteristic acquisition device, based on the image to be the viewing, comprising the steps of: obtaining one or more image characteristic information corresponding to the image, including the candidate presentation information by the image feature information corresponding to the image the method according to claim 1 or 2 including the step. The step of obtaining presentation information corresponding to the image feature information includes:
The presentation acquisition device determining one or more presentation keywords based on the candidate presentation information;
The method according to claim 3 , wherein the presentation acquisition device includes a step of acquiring one or more presentation information corresponding to the image feature information based on the presentation keyword. Obtaining one or more pieces of image feature information corresponding to the image,
The characteristic acquisition device, the image to be the viewing, based on the user browsing the image, comprising the steps of: obtaining one or more image characteristic information corresponding to the image, the image feature information the the method according to claim 1 or 2 comprising the step of having a user-related information of the user. It said user-related information, based on the relevant user information corresponding to the presentation information further comprises the step of determining the first preferred presentation information corresponding to the image feature information,
Providing one or more presentation information of the image comprises:
The presentation device, comprising the steps of: providing one or more first preferred presentation information of the image, in claim 5 including the step of the first preferred presentation information is presented in a specific position in the image The method described. Providing one or more presentation information of the image comprises:
The presenting device determining second preferred presentation information corresponding to each position area of the image based on the presentation information and a specific position of the presentation information in the image;
The presentation device provides one or more second preferred presentation information of the image based on the second preferred presentation information and a specific position in the image of the second preferred presentation information, and the second preferred presentation information The method according to any one of claims 1 to 6 , further comprising a step of presenting preferable presentation information at a specific position in the image. Providing one or more presentation information of the image comprises:
Step wherein presentation device, for determining said presentation information, the specific position in the image before Symbol presentation information, based on the presented range in the image of the presentation information, a third preferred presentation information corresponding to the image When,
The presentation device, based on the specific position in the third preferred presentation information and the image of the third preferred presentation information, comprising: providing one or more third preferred presentation information of the image, The method according to any one of claims 1 to 6 , further comprising a step of presenting the third preferred presentation information at a specific position in the image. A device for acquiring one or more images to be viewed;
An apparatus for obtaining one or more image feature information corresponding to the image based on the image to be browsed;
An apparatus for obtaining presentation information corresponding to the image feature information based on the image feature information;
A presentation device for providing presentation information of an image, comprising: a device that provides one or more presentation information of the image presented at a specific position in the image ;
An apparatus for acquiring presentation information corresponding to the image feature information is
Based on the image feature information, to obtain presentation information corresponding to the image feature information, the presentation information is used to correspond to a specific position in the image,
An apparatus for providing one or more presentation information of the image comprises:
Used to provide one or more presentation information of the image based on the presentation information and a specific position of the presentation information in the image;
An apparatus for acquiring presentation information corresponding to the image feature information is
Obtaining one or more related images corresponding to the image feature information based on the image feature information;
Obtaining one or more related presentation information corresponding to the related image, the related presentation information corresponding to a specific position in the related image;
Based on the image feature information and the related presentation information and the specific position of the related presentation information in the related image, the presentation information corresponding to the image feature information is determined, and the presentation information corresponds to the specific position in the image. Used to
A presentation device for providing image presentation information . An apparatus for acquiring presentation information corresponding to the image feature information is
Obtaining presentation information corresponding to the image feature information;
Presentation device according to claim 9 used to on the basis of said presentation information and the image feature information, to determine the specific position in the image before Symbol presentation information. An apparatus for obtaining one or more image feature information corresponding to the image comprises:
Based on the image to be the viewing, the acquired one or more image characteristic information corresponding to the image, the image feature information claim 9 or 10 is used to contain candidate presentation information corresponding to the image The presentation device described. An apparatus for acquiring presentation information corresponding to the image feature information is
Based on the candidate presentation information, determine one or more presentation keywords,
The presentation device according to claim 11 , which is used to acquire one or more pieces of presentation information corresponding to the image feature information based on the presentation keyword. An apparatus for obtaining one or more image feature information corresponding to the image comprises:
An image to be the viewing, based on the user browsing the image, to obtain one or more image characteristic information corresponding to the image, according to claim 9 wherein the image feature information includes user-related information of the user Or the presentation apparatus of 10 . Said user-related information, based on the relevant user information corresponding to the presentation information, further comprising a device for determining the first preferred presentation information corresponding to the image feature information,
An apparatus for providing one or more presentation information of the image comprises:
The presentation apparatus according to claim 13 , wherein one or more first preferred presentation information of the image is provided, and the first preferred presentation information is used to be presented at a specific position in the image. An apparatus for providing one or more presentation information of the image comprises:
Based on the presentation information and a specific position of the presentation information in the image, the second preferred presentation information corresponding to each position region of the image is determined,
One or more second preferred presentation information of the image is provided based on the second preferred presentation information and a specific position in the image of the second preferred presentation information, and the second preferred presentation information is the presentation device according to any one of claims 9 to 14 used to be presented to a particular position in the image. An apparatus for providing one or more presentation information of the image comprises:
And the presentation information, and the specific position in the image before Symbol presentation information, based on the presented range in the image of the presentation information, to confirm the third preferred presentation information corresponding to the image,
One or more third preferred presentation information of the image is provided based on the third preferred presentation information and a specific position in the image of the third preferred presentation information, and the third preferred presentation information is presentation device according to any one of claims 9 to 14 used to be presented to a particular position in the image. Including computer instructions,
A computer readable storage medium in which the method of any one of claims 1 to 8 is executed when the computer instructions are executed. A computer program,
When said computer program is executed, a computer program in which the method according to any one of claims 1 to 8 is executed. A memory and a processor;
Computer instructions are stored in the memory;
9. A computer apparatus arranged to perform the method according to any one of claims 1 to 8 , wherein the processor executes the computer instructions.