CN107169135B - Image processing method and device and electronic equipment - Google Patents
Image processing method and device and electronic equipment Download PDFInfo
- Publication number
- CN107169135B CN107169135B CN201710436833.6A CN201710436833A CN107169135B CN 107169135 B CN107169135 B CN 107169135B CN 201710436833 A CN201710436833 A CN 201710436833A CN 107169135 B CN107169135 B CN 107169135B
- Authority
- CN
- China
- Prior art keywords
- image
- information
- target object
- webpage
- layer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/957—Browsing optimisation, e.g. caching or content distillation
- G06F16/9577—Optimising the visualization of content, e.g. distillation of HTML documents
Abstract
The embodiment of the invention provides an image processing method, an image processing device and electronic equipment, wherein the image processing method comprises the following steps: determining information of a target object in an image currently displayed by a browser webpage, wherein the information of the target object comprises position information of the target object; determining a business object to be displayed, and determining the display position of the business object according to the position information of the target object; and displaying the business object in the determined display position on the basis of the image in the webpage. By the embodiment of the invention, the interactivity of the implanted business object and the user is improved, and the interestingness of the user in browsing the webpage image is also improved.
Description
Technical Field
The embodiment of the invention relates to the technical field of artificial intelligence, in particular to an image processing method and device and electronic equipment.
Background
With the development of internet technology, people increasingly use the internet for activities such as watching videos and browsing images, and thus, internet videos and images provide business opportunities for many new services. Internet video and images are considered a premium source for placement of corresponding services, such as promotions or advertisements, because they can become important traffic portals.
The existing service implantation is mostly realized by setting corresponding information such as activity information or advertisement information on the periphery of an image, or inserting advertisements with fixed time duration at a certain time of video playing, and the like.
However, this service implantation method cannot be well combined with image or video resources, and cannot achieve the effect of interacting with users to improve service interactivity and interestingness.
Disclosure of Invention
The embodiment of the invention provides a technical scheme for image processing, which aims to solve the problems that the conventional service implantation mode cannot be well combined with image or video resources, and cannot interact with a user to improve service interactivity and interestingness.
According to an aspect of an embodiment of the present invention, there is provided an image processing method including: determining information of a target object in an image currently displayed by a browser webpage, wherein the information of the target object comprises position information of the target object; determining a business object to be displayed, and determining the display position of the business object according to the position information of the target object; and displaying the business object in the determined display position on the basis of the image in the webpage.
According to another aspect of the embodiments of the present invention, there is also provided an image processing apparatus including: the system comprises a first determination module, a second determination module and a third determination module, wherein the first determination module is used for determining information of a target object in an image currently displayed by a browser webpage, and the information of the target object comprises position information of the target object; the second determining module is used for determining a business object to be displayed and determining the display position of the business object according to the position information of the target object; and the display module is used for displaying the business object at the determined display position in the webpage based on the image.
According to still another aspect of the embodiments of the present invention, there is also provided an electronic apparatus including: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus; the memory is used for storing at least one executable instruction, and the executable instruction enables the processor to execute the operation corresponding to the image processing method.
According to the technical scheme provided by the embodiment of the invention, the business object to be displayed and the display position thereof are determined based on the information of the corresponding target object in the image displayed in the current webpage, and then the business object is displayed together with the image in the current webpage. The business object may be a mark for identifying the target object, or may be a sticker (e.g., an advertisement sticker), etc. By adopting the technical scheme provided by the embodiment of the invention, the business object can be tightly combined with the target object in the image, so that the normal watching of audiences is not influenced, the effective interaction between the image and the user can be realized, the interactivity between the implanted business object and the user is improved, and the interestingness of the user in browsing the webpage image is also improved.
Drawings
FIG. 1 is a flowchart illustrating steps of an image processing method according to a first embodiment of the present invention;
FIG. 2 is a flowchart illustrating steps of an image processing method according to a second embodiment of the present invention;
FIG. 3 is a schematic diagram of a logical hierarchy of web page windows in the embodiment of FIG. 2;
FIG. 4 is a diagram of a business object presentation effect in the embodiment shown in FIG. 2;
fig. 5 is a block diagram of an image processing apparatus according to a third embodiment of the present invention;
fig. 6 is a block diagram of an image processing apparatus according to a fourth embodiment of the present invention;
fig. 7 is a block diagram of an electronic device according to a fifth embodiment of the present invention.
Detailed Description
The following detailed description of embodiments of the invention is provided in conjunction with the accompanying drawings (like numerals indicate like elements throughout the several views) and examples. The following examples are intended to illustrate the invention but are not intended to limit the scope of the invention.
It will be understood by those of skill in the art that the terms "first," "second," and the like in the embodiments of the present invention are used merely to distinguish one element, step, device, module, or the like from another element, and do not denote any particular technical or logical order therebetween.
Example one
Referring to fig. 1, a flowchart illustrating steps of an image processing method according to a first embodiment of the present invention is shown.
The image processing method of the embodiment includes the steps of:
step S102: and determining the information of the target object in the image currently displayed by the browser webpage.
Wherein the information of the target object includes position information of the target object.
The target object is an object existing in the image that is easily viewed by the viewer. In this embodiment, the detection and the identification of the target object and the acquisition of the information of the target object may be implemented by those skilled in the art in any suitable manner, including but not limited to using a neural network model (such as a convolutional neural network model) or a feature extraction algorithm, or other suitable manners, which is not limited in this embodiment.
The target object may be any suitable object to be treated, such as a human whole, a human part, an animal, an article, a merchandise marker, a logo, and the like. The information of the target object includes, but is not limited to, position information of the target object, which may indicate a relative position of the target object in the image,
step S104: and determining a business object to be displayed, and determining the display position of the business object according to the position information of the target object.
In the embodiment of the present invention, the business object means a setting for indicating or transmitting information, including but not limited to an icon, a sticker, a text, and the like.
In this step, the business object to be displayed may be determined by a person skilled in the art in any appropriate manner according to an actual situation, for example, a set default business object, or the business object to be displayed may be determined according to a type of the image (for example, the image of the landscape type may correspond to a business object such as a cartoon smiley face sticker, a cartoon sunshine, a cloud sticker, etc.), or the business object to be displayed may be determined according to a type of a target object in the image (for example, a cartoon smiley face icon of a food type may correspond to a running water target object, etc.). The present embodiment does not limit the specific determination manner of the business object.
After the business object to be displayed is determined, the display position of the business object can be determined according to the position information of the target object. For example, in the periphery of the business object, or as the foreground of the business object, or as the background of the business object, etc.
Step S106: and displaying the business object at the determined display position of the business object in the current webpage of the browser based on the currently displayed image.
The displaying of the business object includes, but is not limited to, using a computer to draw, rendering by a browser, and the like to realize the displaying.
By the image processing method of the embodiment, the business object to be displayed and the display position thereof are determined based on the information of the corresponding target object in the image displayed in the current webpage, and then the business object is displayed together with the image in the current webpage. By adopting the image processing method of the embodiment, the business object can be tightly combined with the target object in the image, so that the normal watching of audiences is not influenced, the effective interaction between the image and the user can be realized, the interactivity between the implanted business object and the user is improved, and the interestingness of the user in browsing the webpage image is also improved.
The image processing method of the present embodiment may be performed by any suitable device having image or data processing capabilities, including but not limited to: various terminal devices (including PCs, tablet computers, mobile terminals, etc.) and servers, etc.
Example two
Referring to fig. 2, a flowchart illustrating steps of an image processing method according to a second embodiment of the present invention is shown.
The image processing method of the embodiment includes the steps of:
step S202: and acquiring the image currently displayed in the current webpage of the browser.
In this embodiment, there may be only one image or a plurality of images (in the embodiment of the present invention, the number of "a plurality" means two or more). If there are multiple images currently displayed, the image processing described in the embodiment of the present invention may be performed on each image, or only on a partial image thereof.
Step S204: and detecting the acquired image to acquire the information of the target object in the image.
If the image to be processed comprises a plurality of images, detecting each image to be processed, and respectively acquiring the information of the target object in each image.
In one possible approach, image detection may be performed by a trained convolutional neural network with image detection functionality to obtain information of the target object in the image. Convolutional Neural Network (CNN) is a deep learning Network architecture, which is inspired by biological natural visual cognition mechanism. The trained CNN can effectively identify the visual regularity of the image, and can be widely applied to the fields of image classification, object detection, object tracking, attitude estimation and the like. The embodiment may employ a trained convolutional neural network with an image detection function, through which a variety of information of the image may be obtained, including but not limited to information of a target object in the image, such as position information, shape information, size information, feature information, identification information, and the like of the target object. Of course, the identification information of the target object may also be obtained in other manners, such as manual or machine labeling, and the like. Wherein the position information is used for indicating the position of the target object in the image; the shape information is used for indicating the shape of the target object; the size information is used for indicating the size and the size of the target object; the characteristic information is used for indicating the characteristics of the target object, and whether the object in the image is the target object can be effectively identified through the characteristics of the target object; the identification information is used for identifying the target object, for example, a plurality of objects in the image are respectively identified as LOGO-1, LOGO-2, OBJ-1, OBJ-2 and the like, each identification corresponds to the information of one object, for example, LOGO-1 is a certain brand identification, LOGO-2 is another brand identification, OBJ-1 is a cup, OBJ-2 is a soda bottle and the like, and whether the identified object is the target object can be determined through the identifications and the corresponding relations between the identifications and the objects.
In this embodiment, the obtained information of the target object at least includes position information of the target object, and optionally, may further include at least one of shape information, size information, feature information, and identification information of the target object.
In each image, one or more target objects are included. When the target object includes a plurality of target objects, the plurality of target objects may be the same or different, such as including the same LOGO on a plurality of cups, or including a plurality of cups having different shapes, etc. Whether the target objects are the same or not, information of each target object needs to be acquired separately.
Step S206: and determining a business object to be displayed, and determining the display position of the business object according to the position information of the target object.
In this embodiment, the service object is a set flag for identifying a target object in an image to be processed; or, the special effect contains semantic information. Optionally, the effect may include a two-dimensional sticker effect or a three-dimensional effect.
The setting flag may be set by a person skilled in the art according to an actual situation, and the target object may be marked, for example, a wire frame, a red heart, a star, and the like for marking the position of the target object. The special effect may be a three-dimensional form of the special effect, such as a three-dimensional form of an advertising special effect (an advertisement displayed using a 3D special effect form), or a two-dimensional form of a sticker, such as a two-dimensional form of an advertising sticker special effect (an advertisement displayed using a sticker form). Without limitation, other forms of business objects may also be suitable for the image processing scheme provided by the embodiments of the present invention, such as text descriptions or presentations of APP or other applications, or some form of object (e.g., an electronic pet) that interacts with a video audience.
Based on the information of the target object, when the business object to be displayed is determined, the business object to be displayed may be determined according to at least one of shape information, size information, feature information, and identification information of the target object. For example, when the characteristic information of the target object indicates that the target object is a book, the target object may be determined as a thick-line box, the size of which may be adjusted to indicate the position of the book in the image when displayed, or may be determined as a cartoon picture in the shape of a doctor's hat, which may be displayed at a corner of the book when displayed, or the like.
When the display position of the business object is determined according to the position information of the target object, the determination can be performed according to a set rule. For example, the business object is shown at a position within a set range over the top of the target object, or the business object is shown at a peripheral position of the target object, or the business object is shown at a corner or a boundary of an image, or the business object may be shown within a position range of the target object if the business object does not affect the display of the target object, or the like.
Step S208: and displaying the business object at the determined display position of the business object in the current webpage of the browser based on the currently displayed image.
For example, any suitable drawing or rendering manner may be used to draw or render the business object at the corresponding display location.
Optionally, the webpage setting corresponding to the target object may be determined first; and displaying the business object at the display position determined in the webpage based on the image of the target object, and displaying the webpage setting in the webpage. Wherein the web page settings include at least one of: the prompt information corresponding to the target object (for example, prompt the preferential information or the activity information related to the target object, etc.), the interaction information corresponding to the target object (for example, an interaction key through which interaction with a web page or a back-end server is possible), and the link information corresponding to the target object (for example, purchase link information or activity link information of the target object, etc.).
In a specific presentation, in an alternative mode, an image may be first drawn on a first layer of a web page window of a browser; then drawing the business object on a second layer of the webpage window based on the drawn image and the determined display position; then, drawing the rest webpage contents except the image in the current webpage on the third layer of the webpage window; the first layer, the second layer, and the third layer are then combined such that the second layer is positioned over the first layer and the third layer is positioned over the second layer.
Wherein, the drawing can be performed by adopting a computer drawing mode. The computer drawing mode can be realized by any appropriate computer graphic image drawing or rendering mode and the like, including but not limited to: drawing based on an OpenGL graphics drawing engine, and the like. OpenGL defines a specialized graphical program interface with a cross-programming language, cross-platform programming interface specification, which is hardware-independent and can conveniently render 2D or 3D graphical images. Through OpenGL, not only can 2D effects such as drawing of 2D stickers be realized, but also drawing of 3D effects and the like can be realized. But not limited to OpenGL, other approaches such as Unity or OpenCL, etc. are equally applicable.
The above-described three-layer drawing of the present embodiment is described below by taking an example as an example.
As shown in fig. 3, a schematic diagram of a logical hierarchy of web page windows is shown. The left side of the cup is a first layer, a currently displayed image is drawn on the first layer, and in the image, a LOGO icon on the left side of the cup is a target object; the middle layer is a second layer, and a business object is drawn at the display position of the business object, wherein the business object is a circle corresponding to the target object in the example; the right side is the third layer on which the web page content other than the image is drawn, in this example mainly the activity cue (i.e. the "more active" option in the image) and the associated web address of the target object. The second layer is placed on the first layer, the third layer is placed on the second layer, layer merging is performed, and the display effect of the merged layer is shown in fig. 4. As can be seen from fig. 4, the circular business object just identifies the position of the LOGO icon, and when the user clicks "more activities", the browser will jump to the corresponding activity description web page.
Optionally, the service object may be further set, so that the user may interact with the browser when clicking the service object, and jump to a corresponding page, such as an activity description web page.
Through the process, AR (Augmented Reality) processing of the image displayed in the current page of the browser is achieved, and the image is more interesting and interactive.
It should be noted that, in this embodiment, only a static image is taken as an example to describe the image processing of the present invention, but not limited thereto, the scheme of the embodiment of the present invention is also applicable to a video frame image in a video frame sequence, and the specific implementation thereof is similar to the static image, and is not described herein again.
By the image processing method of the embodiment, the business object to be displayed and the display position thereof are determined based on the information of the corresponding target object in the image displayed in the current webpage, and then the business object is displayed together with the image in the current webpage. By adopting the image processing method of the embodiment, the business object can be tightly combined with the target object in the image, so that the normal watching of audiences is not influenced, the effective interaction between the image and the user can be realized, the interactivity between the implanted business object and the user is improved, and the interestingness of the user in browsing the webpage image is also improved.
The image processing method of the present embodiment may be performed by any suitable device having image or data processing capabilities, including but not limited to: various terminal devices (including PCs, tablet computers, mobile terminals, etc.) and servers, etc.
EXAMPLE III
Referring to fig. 5, a block diagram of an image processing apparatus according to a third embodiment of the present invention is shown.
The image processing apparatus of the present embodiment includes: a first determining module 302, configured to determine information of a target object in an image currently displayed on a browser webpage, where the information of the target object includes location information of the target object; a second determining module 304, configured to determine a service object to be displayed, and determine a display position of the service object according to the position information of the target object; a presentation module 306, configured to present, in the web page, the business object at the determined presentation position based on the image.
By the image processing device of the embodiment, the business object to be displayed and the display position thereof are determined based on the information of the corresponding target object in the image displayed in the current webpage, and then the business object is displayed together with the image in the current webpage. By adopting the image processing device of the embodiment, the business object can be tightly combined with the target object in the image, so that the normal watching of audiences is not influenced, the effective interaction between the image and the user can be realized, the interactivity between the implanted business object and the user is improved, and the interestingness of the user in browsing the webpage image is also improved.
Example four
Referring to fig. 6, there is shown a block diagram of an image processing apparatus according to a fourth embodiment of the present invention.
The image processing apparatus of the present embodiment includes: a first determining module 402, configured to determine information of a target object in an image currently displayed on a browser webpage, where the information of the target object includes location information of the target object; a second determining module 404, configured to determine a service object to be displayed, and determine a display position of the service object according to the position information of the target object; a presentation module 406, configured to present, in the web page, the business object at the determined presentation position based on the image.
Optionally, the information of the target object further includes at least one of: shape information, size information, feature information, identification information of the target object; a second determining module 404, configured to determine a service object to be displayed according to at least one of shape information, size information, feature information, and identification information of the target object; and determining the display position of the business object according to the position information of the target object.
Optionally, the presentation module 406 is configured to determine a webpage setting corresponding to the target object; and displaying the business object at the display position determined in the webpage based on the image, and displaying the webpage setting.
Optionally, the web page settings include at least one of: the prompt information corresponding to the target object, the interaction information corresponding to the target object and the link information corresponding to the target object.
Optionally, the image processing apparatus of this embodiment further includes: an obtaining module 408, configured to detect, by using a convolutional neural network, the image currently displayed on the browser webpage before the first determining module 402 determines the information of the target object in the image, so as to obtain the information of the target object.
Optionally, the display module 406 comprises: a drawing module 4062, configured to draw the image on a first layer of a web page window of a browser; drawing the business object on a second layer of the webpage window based on the drawn image and the determined display position; drawing the rest webpage contents except the image in the webpage on a third layer of a webpage window; the merging module 4064 is configured to merge a first layer, a second layer, and a third layer, wherein the second layer is located above the first layer, and the third layer is located above the second layer.
Optionally, the image comprises a still image or a video frame image.
Optionally, the service object is a setting flag for identifying a target object in the image; or, the special effect contains semantic information.
Optionally, the effect comprises a two-dimensional sticker effect or a three-dimensional effect.
Optionally, the image comprises at least one image; each image includes at least one target object therein.
The image processing apparatus of this embodiment is configured to implement the corresponding image processing method in the foregoing method embodiments, and has the beneficial effects of the corresponding method embodiments, which are not described herein again.
EXAMPLE five
Referring to fig. 7, a schematic structural diagram of an electronic device according to a fifth embodiment of the present invention is shown, and the specific embodiment of the present invention does not limit the specific implementation of the electronic device.
As shown in fig. 7, the electronic device may include: a processor (processor)502, a Communications Interface 504, a memory 506, and a communication bus 508.
Wherein:
the processor 502, communication interface 504, and memory 506 communicate with one another via a communication bus 508.
A communication interface 504 for communicating with network elements of other devices, such as clients or other servers.
The processor 502 is configured to execute the program 510, and may specifically execute relevant steps in the above-described embodiment of the image processing method.
In particular, program 510 may include program code that includes computer operating instructions.
The processor 502 may be a central processing unit CPU, or an Application Specific Integrated Circuit (ASIC), or one or more Integrated circuits configured to implement an embodiment of the present invention. The server comprises one or more processors, which can be the same type of processor, such as one or more CPUs; or may be different types of processors such as one or more CPUs and one or more ASICs.
And a memory 506 for storing a program 510. The memory 506 may comprise high-speed RAM memory, and may also include non-volatile memory (non-volatile memory), such as at least one disk memory.
The program 510 may specifically be used to cause the processor 502 to perform the following operations: determining information of a target object in an image currently displayed by a browser webpage, wherein the information of the target object comprises position information of the target object; determining a business object to be displayed, and determining the display position of the business object according to the position information of the target object; and displaying the business object in the determined display position on the basis of the image in the webpage.
In an alternative embodiment, the information of the target object further comprises at least one of: shape information, size information, feature information, identification information of the target object; the program 510 is further configured to enable the processor 502 to determine the business object to be presented according to at least one of shape information, size information, feature information, and identification information of the target object when determining the business object to be presented.
In an alternative embodiment, program 510 is further configured to cause processor 502 to determine, in the web page, a web page setting corresponding to the target object when the business object is displayed at the determined display position based on the image; and displaying the business object at the display position determined in the webpage based on the image, and displaying the webpage setting.
In an alternative embodiment, the web page settings include at least one of: the prompt information corresponding to the target object, the interaction information corresponding to the target object and the link information corresponding to the target object.
In an alternative embodiment, the program 510 is further configured to enable the processor 502 to detect the image currently presented in the browser webpage through a convolutional neural network to obtain information of the target object before determining the information of the target object in the image.
In an alternative embodiment, program 510 is further configured to cause processor 502 to render the image in a first layer of a web page window of a browser when the business object is presented in the determined presentation position based on the image in the web page; drawing the business object on a second layer of the webpage window based on the drawn image and the determined display position; drawing the rest webpage contents except the image in the webpage on a third layer of a webpage window; the first layer, the second layer and the third layer are combined, wherein the second layer is positioned on the first layer, and the third layer is positioned on the second layer.
In an alternative embodiment, the image comprises a still image or a video frame image.
In an optional embodiment, the service object is a set flag for identifying a target object in the image; or, the special effect contains semantic information.
In an alternative embodiment, the effect comprises a two-dimensional sticker effect or a three-dimensional effect.
In an alternative embodiment, the image comprises at least one image; each image includes at least one target object therein.
For specific implementation of each step in the program 510, reference may be made to corresponding steps and corresponding descriptions in units in the foregoing embodiments of the image processing method, which are not described herein again. It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described devices and modules may refer to the corresponding process descriptions in the foregoing method embodiments, and are not described herein again.
Through the electronic equipment of the embodiment, the business object to be displayed and the display position of the business object are determined based on the information of the corresponding target object in the image displayed in the current webpage, and then the business object is displayed together with the image in the current webpage. By adopting the electronic equipment of the embodiment, the business object can be tightly combined with the target object in the image, so that the normal watching of audiences is not influenced, the effective interaction between the image and the user can be realized, the interactivity between the implanted business object and the user is improved, and the interestingness of the user in browsing the webpage image is also improved.
It should be noted that, according to the implementation requirement, each component/step described in the embodiment of the present invention may be divided into more components/steps, and two or more components/steps or partial operations of the components/steps may also be combined into a new component/step to achieve the purpose of the embodiment of the present invention.
The above-described method according to an embodiment of the present invention may be implemented in hardware, firmware, or as software or computer code storable in a recording medium such as a CD ROM, a RAM, a floppy disk, a hard disk, or a magneto-optical disk, or as computer code originally stored in a remote recording medium or a non-transitory machine-readable medium downloaded through a network and to be stored in a local recording medium, so that the method described herein may be stored in such software processing on a recording medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware such as an ASIC or FPGA. It will be appreciated that the computer, processor, microprocessor controller or programmable hardware includes memory components (e.g., RAM, ROM, flash memory, etc.) that can store or receive software or computer code that, when accessed and executed by the computer, processor or hardware, implements the image processing methods described herein. Further, when a general-purpose computer accesses code for implementing the image processing method shown herein, execution of the code converts the general-purpose computer into a special-purpose computer for executing the image processing method shown herein.
Those of ordinary skill in the art will appreciate that the various illustrative elements and method steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present embodiments.
The above embodiments are only for illustrating the embodiments of the present invention and not for limiting the embodiments of the present invention, and those skilled in the art can make various changes and modifications without departing from the spirit and scope of the embodiments of the present invention, so that all equivalent technical solutions also belong to the scope of the embodiments of the present invention, and the scope of patent protection of the embodiments of the present invention should be defined by the claims.
Claims (15)
1. An image processing method comprising:
determining information of a target object in an image currently displayed by a browser webpage, wherein the information of the target object comprises position information of the target object;
determining a business object to be displayed, and determining the display position of the business object according to the position information of the target object;
displaying, in the web page, the business object at the determined display position based on the image,
wherein, in the webpage, displaying the business object at the determined display position based on the image comprises:
drawing the image on a first layer of a webpage window of the browser;
drawing the business object on a second layer of the webpage window based on the drawn image and the determined display position;
drawing the rest webpage contents except the image in the webpage on a third layer of the webpage window;
merging the first layer, the second layer, and the third layer, wherein the second layer is located above the first layer and the third layer is located above the second layer,
the business object is a special effect containing semantic information, and the special effect comprises a two-dimensional sticker special effect or a three-dimensional special effect.
2. The method of claim 1, wherein the information of the target object further comprises at least one of: shape information, size information, feature information, and identification information of the target object;
the determining the business object to be displayed comprises the following steps:
and determining the business object to be displayed according to at least one of the shape information, the size information, the characteristic information and the identification information of the target object.
3. The method according to claim 1 or 2, wherein presenting the business object in the webpage at the determined presentation position based on the image comprises:
determining webpage settings corresponding to the target object;
and displaying the business object at the display position determined in the webpage based on the image, and displaying the webpage setting.
4. The method of claim 3, wherein the web page settings comprise at least one of: the prompt information corresponding to the target object, the interaction information corresponding to the target object and the link information corresponding to the target object.
5. The method of claim 1 or 2, wherein prior to the determining information of the target object in the image currently presented by the browser webpage, the method further comprises:
and detecting the image through a convolutional neural network to acquire the information of the target object.
6. The method of claim 1 or 2, wherein the image comprises a still image or a video frame image.
7. The method of claim 1 or 2, wherein the image comprises at least one image; each image includes at least one of the target objects.
8. An image processing apparatus comprising:
the system comprises a first determination module, a second determination module and a third determination module, wherein the first determination module is used for determining information of a target object in an image currently displayed by a browser webpage, and the information of the target object comprises position information of the target object;
the second determining module is used for determining a business object to be displayed and determining the display position of the business object according to the position information of the target object;
a presentation module for presenting the business object in the determined presentation position based on the image in the web page,
wherein the display module comprises:
the drawing module is used for drawing the image on a first layer of a webpage window of the browser; drawing the business object on a second layer of the webpage window based on the drawn image and the determined display position; drawing the rest webpage contents except the image in the webpage on a third layer of the webpage window;
a merging module for merging the first layer, the second layer and the third layer, wherein the second layer is located above the first layer and the third layer is located above the second layer,
the business object is a special effect containing semantic information, and the special effect comprises a two-dimensional sticker special effect or a three-dimensional special effect.
9. The apparatus of claim 8, wherein the information of the target object further comprises at least one of: shape information, size information, feature information, and identification information of the target object;
the second determining module is used for determining the business object to be displayed according to at least one of shape information, size information, characteristic information and identification information of the target object; and determining the display position of the business object according to the position information of the target object.
10. The apparatus of claim 8 or 9, wherein the presentation module is configured to determine a web page setting corresponding to the target object; and displaying the business object at the display position determined in the webpage based on the image, and displaying the webpage setting.
11. The apparatus of claim 10, wherein the web page settings comprise at least one of: the prompt information corresponding to the target object, the interaction information corresponding to the target object and the link information corresponding to the target object.
12. The apparatus of claim 8 or 9, wherein the apparatus further comprises:
and the acquisition module is used for detecting the image through a convolutional neural network to acquire the information of the target object before the first determination module determines the information of the target object in the image currently displayed by the browser webpage.
13. The apparatus of claim 8 or 9, wherein the image comprises a still image or a video frame image.
14. The apparatus of claim 8 or 9, wherein the image comprises at least one image; each image includes at least one of the target objects.
15. An electronic device, comprising: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;
the memory is used for storing at least one executable instruction, and the executable instruction causes the processor to execute the operation corresponding to the image processing method according to any one of claims 1-7.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710436833.6A CN107169135B (en) | 2017-06-12 | 2017-06-12 | Image processing method and device and electronic equipment |
| PCT/CN2018/090859 WO2018228384A1 (en) | 2017-06-12 | 2018-06-12 | Image processing method and apparatus, electronic device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710436833.6A CN107169135B (en) | 2017-06-12 | 2017-06-12 | Image processing method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107169135A CN107169135A (en) | 2017-09-15 |
| CN107169135B true CN107169135B (en) | 2021-03-19 |
Family
ID=59825132
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710436833.6A Active CN107169135B (en) | 2017-06-12 | 2017-06-12 | Image processing method and device and electronic equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107169135B (en) |
| WO (1) | WO2018228384A1 (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107169135B (en) * | 2017-06-12 | 2021-03-19 | 阿里巴巴（中国）有限公司 | Image processing method and device and electronic equipment |
| CN107948327B (en) * | 2018-01-02 | 2021-08-06 | 中国银行股份有限公司 | Data processing method, device and system based on business training |
| CN109147007B (en) * | 2018-08-01 | 2023-09-01 | Oppo（重庆）智能科技有限公司 | Label loading method, label loading device, terminal and computer readable storage medium |
| CN111986127B (en) * | 2019-05-22 | 2022-03-08 | 腾讯科技（深圳）有限公司 | Image processing method and device, computer equipment and storage medium |
| CN110213629B (en) | 2019-06-27 | 2022-02-11 | 腾讯科技（深圳）有限公司 | Information implantation method, device, server and storage medium |
| CN112464691A (en) * | 2019-09-06 | 2021-03-09 | 北京字节跳动网络技术有限公司 | Image processing method and device |
| CN110796664B (en) * | 2019-10-14 | 2023-05-23 | 北京字节跳动网络技术有限公司 | Image processing method, device, electronic equipment and computer readable storage medium |
| CN113742630B (en) * | 2021-09-16 | 2023-12-15 | 阿里巴巴新加坡控股有限公司 | Image processing method, electronic device, and computer storage medium |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001218008A (en) * | 2000-01-31 | 2001-08-10 | Canon Inc | Picture processor, picture processing method and storage medium |
| US8156248B2 (en) * | 2003-10-09 | 2012-04-10 | International Business Machines Corporation | Image distribution for dynamic server pages |
| US8429190B2 (en) * | 2004-08-11 | 2013-04-23 | Adknowledge, Inc. | Method and system for generating and distributing electronic communications |
| CN105117463B (en) * | 2015-08-24 | 2019-08-06 | 北京旷视科技有限公司 | Information processing method and information processing unit |
| CN105095498A (en) * | 2015-08-24 | 2015-11-25 | 北京旷视科技有限公司 | Information processing method and device |
| WO2017088340A1 (en) * | 2015-11-25 | 2017-06-01 | 腾讯科技（深圳）有限公司 | Method and apparatus for processing image information, and computer storage medium |
| CN106293393A (en) * | 2016-08-01 | 2017-01-04 | 北京奇虎科技有限公司 | Synthesis display packing based on electronics paster, device and terminal unit |
| CN106339201A (en) * | 2016-09-14 | 2017-01-18 | 北京金山安全软件有限公司 | Map processing method and device and electronic equipment |
| CN108076359B (en) * | 2017-01-24 | 2020-11-17 | 北京市商汤科技开发有限公司 | Business object display method and device and electronic equipment |
| CN107169135B (en) * | 2017-06-12 | 2021-03-19 | 阿里巴巴（中国）有限公司 | Image processing method and device and electronic equipment |
-
2017
- 2017-06-12 CN CN201710436833.6A patent/CN107169135B/en active Active
-
2018
- 2018-06-12 WO PCT/CN2018/090859 patent/WO2018228384A1/en active Application Filing
Also Published As
| Publication number | Publication date |
|---|---|
| WO2018228384A1 (en) | 2018-12-20 |
| CN107169135A (en) | 2017-09-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107169135B (en) | Image processing method and device and electronic equipment | |
| US10776970B2 (en) | Method and apparatus for processing video image and computer readable medium | |
| US11037348B2 (en) | Method and apparatus for displaying business object in video image and electronic device | |
| US10643264B2 (en) | Method and computer readable medium for presentation of content items synchronized with media display | |
| US10325372B2 (en) | Intelligent auto-cropping of images | |
| US10176636B1 (en) | Augmented reality fashion | |
| US10210423B2 (en) | Image match for featureless objects | |
| WO2018033154A1 (en) | Gesture control method, device, and electronic apparatus | |
| WO2017088340A1 (en) | Method and apparatus for processing image information, and computer storage medium | |
| US10186084B2 (en) | Image processing to enhance variety of displayable augmented reality objects | |
| US20140210857A1 (en) | Realization method and device for two-dimensional code augmented reality | |
| EP3425483B1 (en) | Intelligent object recognizer | |
| CN107770602B (en) | Video image processing method and device and terminal equipment | |
| US20230091549A1 (en) | Image processing method and apparatus, computer device, and storage medium | |
| US20220207875A1 (en) | Machine learning-based selection of a representative video frame within a messaging application | |
| CN108595651A (en) | Customized information display methods, device and user terminal based on recognition of face | |
| CN108985421B (en) | Method for generating and identifying coded information | |
| CN107770603B (en) | Video image processing method and device and terminal equipment | |
| US20200089952A1 (en) | Mitigation of augmented reality markup blindness | |
| CN108076359B (en) | Business object display method and device and electronic equipment | |
| US10225585B2 (en) | Dynamic content placement in media | |
| CN111405371A (en) | Data processing method and related device | |
| US10674184B2 (en) | Dynamic content rendering in media | |
| CN111862248A (en) | Method and apparatus for outputting information | |
| CN114863469A (en) | Image desensitization processing method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20200522 Address after: 310051 room 508, floor 5, building 4, No. 699, Wangshang Road, Changhe street, Binjiang District, Hangzhou City, Zhejiang Province Applicant after: Alibaba (China) Co.,Ltd. Address before: 510627 Guangdong city of Guangzhou province Whampoa Tianhe District Road No. 163 Xiping Yun Lu Yun Ping B radio square 14 storey tower Applicant before: GUANGZHOU UCWEB COMPUTER TECHNOLOGY Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |