WO2018228384A1 - 图像处理方法、装置、电子设备及存储介质 - Google Patents

图像处理方法、装置、电子设备及存储介质 Download PDF

Info

Publication number
WO2018228384A1
WO2018228384A1 PCT/CN2018/090859 CN2018090859W WO2018228384A1 WO 2018228384 A1 WO2018228384 A1 WO 2018228384A1 CN 2018090859 W CN2018090859 W CN 2018090859W WO 2018228384 A1 WO2018228384 A1 WO 2018228384A1
Authority
WO
WIPO (PCT)
Prior art keywords
target object
information
image
webpage
layer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2018/090859
Other languages
English (en)
French (fr)
Inventor
江卫忠
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou UCWeb Computer Technology Co Ltd
Original Assignee
Guangzhou UCWeb Computer Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou UCWeb Computer Technology Co Ltd filed Critical Guangzhou UCWeb Computer Technology Co Ltd
Publication of WO2018228384A1 publication Critical patent/WO2018228384A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/957Browsing optimisation, e.g. caching or content distillation
    • G06F16/9577Optimising the visualization of content, e.g. distillation of HTML documents

Definitions

  • Embodiments of the present invention relate to the field of artificial intelligence technologies, and in particular, to an image processing method, apparatus, electronic device, and storage medium.
  • Internet video and images provide opportunities for many new businesses. Because Internet video and images can be important business traffic portals, they are considered to be high-quality resources for embedding corresponding businesses such as promotions or advertising.
  • Existing business implants are implemented by setting corresponding information such as activity information or advertisement information on the periphery of the image, or inserting a fixed-time advertisement at a certain time of video playback.
  • the embodiments of the present invention provide a technical solution for image processing, so as to solve the problem that the current service implantation mode cannot be well combined with image or video resources, and cannot interact with the user to improve business interaction and interest.
  • an image processing method includes: determining information of a target object in an image currently displayed by a browser webpage, wherein the information of the target object includes location information of the target object Determining a business object to be displayed corresponding to the target object, and determining a display location of the business object according to location information of the target object; displaying the business object in the display location in the webpage.
  • an image processing apparatus including: a first determining module, configured to determine information of a target object in an image currently displayed by a browser webpage, wherein the target object The information includes the location information of the target object; the second determining module is configured to determine a business object to be displayed corresponding to the target object, and determine a display location of the business object according to location information of the target object; And for displaying the business object at the placement location in the webpage.
  • an electronic device includes: a processor, a memory, a communication interface, and a communication bus, wherein the processor, the memory, and the communication interface are completed by the communication bus Communication with each other; the memory is for storing at least one executable instruction that causes the processor to perform an operation corresponding to the image processing method as described above.
  • a computer readable storage medium storing computer executable instructions for performing operations corresponding to the image processing method as described above.
  • the business object to be displayed corresponding to the target object and the display position thereof are determined, and then the service is displayed together with the image in the current webpage.
  • the business object may be a logo for identifying the target object, or may be a sticker (such as an advertisement sticker) or the like.
  • the business object can be closely combined with the target object in the image, which does not affect the normal viewing of the viewer, and can also realize effective interaction between the image and the user, and enhance the embedded business object and the user. Interactivity also enhances the user's interest in browsing web images.
  • FIG. 1 is a flow chart showing the steps of an image processing method according to Embodiment 1 of the present invention.
  • FIG. 2 is a flow chart showing the steps of an image processing method according to Embodiment 2 of the present invention.
  • FIG. 3 is a schematic diagram of a logical layering of a webpage window in the embodiment shown in FIG. 2;
  • FIG. 4 is a diagram showing an effect of displaying a business object in the embodiment shown in FIG. 2;
  • FIG. 5 is a block diagram showing the structure of an image processing apparatus according to Embodiment 3 of the present invention.
  • FIG. 6 is a block diagram showing the structure of an image processing apparatus according to Embodiment 4 of the present invention.
  • FIG. 7 is a structural block diagram of an electronic device according to Embodiment 5 of the present invention.
  • FIG. 1 there is shown a flow chart of the steps of an image processing method according to a first embodiment of the present invention.
  • Step S102 Determine information of the target object in the image currently displayed by the browser webpage.
  • the information of the target object includes location information of the target object.
  • the target object is an object that exists in the image and is easily viewed by the viewer.
  • the detection and identification of the target object and the acquisition of the information of the target object may be implemented by any suitable means by those skilled in the art, including but not limited to using a neural network model (such as a convolutional neural network model).
  • the feature extraction algorithm or other suitable manner is not limited in this embodiment.
  • the target object may be any suitable object to be processed, such as a person's entirety, a human body part, an animal, an item, a product identification, a logo, and the like.
  • the information of the target object includes but is not limited to the location information of the target object, and the location information of the target object may indicate the relative position of the target object in the image.
  • Step S104 Determine a business object to be displayed corresponding to the target object, and determine a display position of the business object according to the location information of the target object.
  • a business object means a setting for indicating or transmitting information, including but not limited to an icon, a sticker, a text, and the like.
  • the business object to be displayed may be determined by any person in the art according to actual conditions, such as setting a default business object, or determining a business object to be displayed according to the type of the image (such as an image of a landscape type). It can correspond to a business object such as a cartoon smiley sticker, a cartoon sun, a cloud sticker, or the like, or a business object to be displayed according to the type of the target object in the image (for example, a cartoon smiley icon for a gourmet type target object can correspond to a drooling).
  • This embodiment does not limit the manner in which a specific business object is determined.
  • the location of the business object may be determined according to the location information of the target object. For example, it is displayed around the target object, or displayed as the foreground of the target object, or displayed as the background of the target object, and so on.
  • Step S106 Display the business object in the determined display position of the business object based on the currently displayed image in the current webpage of the browser.
  • the display of business objects includes, but is not limited to, the way of displaying using computer drawing, browser rendering, and the like.
  • the business object to be displayed and the display position thereof are determined based on the information of the corresponding target object in the image displayed in the current webpage, and then the business object is displayed together with the image in the current webpage.
  • the business object can be closely combined with the target object in the image, which does not affect the normal viewing of the viewer, and can also realize effective interaction between the image and the user, and enhance the interaction between the embedded business object and the user. Sexuality also enhances the user's interest in browsing web images.
  • the image processing method of this embodiment may be performed by any suitable device having image or data processing capabilities, including but not limited to: various terminal devices (including PCs, tablets, mobile terminals, etc.), servers, and the like.
  • various terminal devices including PCs, tablets, mobile terminals, etc.
  • servers and the like.
  • FIG. 2 a flow chart of steps of an image processing method according to a second embodiment of the present invention is shown.
  • Step S202 Acquire an image currently displayed in the current webpage of the browser.
  • the number of images currently displayed may be one or more. (In the embodiment of the present invention, the number of "multiple”, “multiple”, etc. having “multiple” means two or more). If there are multiple images currently displayed, the image processing as described in the embodiment of the present invention may be performed for each image, or only the partial image may be subjected to image processing as described in the embodiment of the present invention.
  • Step S204 detecting the acquired image, and acquiring information of the target object in the image.
  • each image to be processed includes a plurality of images, each image to be processed is detected, and information of the target object in each image is acquired.
  • image detection may be performed by a trained convolutional neural network with image detection function to acquire information of a target object in the image.
  • the Convolutional Neural Network is a deep learning network architecture inspired by the biological natural visual cognition mechanism. Trained CNN can effectively identify image visual laws and can be widely used in such fields as image classification, object detection, object tracking, and attitude estimation.
  • a convolutional neural network with image detection function can be used, and the convolutional neural network can obtain various information of the image, including but not limited to information of the target object in the image, such as the location of the target object. Information, shape information, size information, feature information, identification information, and the like.
  • the identification information of the target object can also be obtained in other ways, such as manual or machine annotation.
  • the location information is used to indicate the location of the target object in the image
  • the shape information is used to indicate the shape of the target object
  • the size information is used to indicate the size and size of the target object
  • the feature information is used to indicate the feature of the target object, through the target object
  • the feature can effectively identify whether the object in the image is the target object;
  • the identification information is used to identify the target object, such as identifying multiple objects in the image as LOGO-1, LOGO-2, OBJ-1, OBJ-2 Etc.
  • each logo corresponds to an object information, for example, LOGO-1 is a brand logo, LOGO-2 is another brand logo, OBJ-1 is a cup, OBJ-2 is a soda bottle, etc.
  • the acquired information of the target object includes at least the location information of the target object, and optionally, at least one of shape information, size information, feature information, and identification information of the target object.
  • each image one or more target objects are included.
  • the target object includes a plurality of objects
  • the plurality of target objects may be the same or different, such as including the same LOGO on a plurality of cups, or including a plurality of cups having different shapes and the like. Regardless of whether the target objects are the same, you need to obtain information about each target object separately.
  • Step S206 Determine a business object to be displayed corresponding to the target object, and determine a display position of the business object according to the location information of the target object.
  • the service object is a setting flag for identifying a target object in the image to be processed; or, is a special effect including semantic information.
  • the special effects may include two-dimensional sticker effects or three-dimensional effects.
  • the setting flag can be appropriately set by a person skilled in the art according to actual conditions, and can mark the target object, such as a wire frame, a red heart, a star, and the like indicating the position of the target object.
  • Special effects can be three-dimensional effects, such as three-dimensional advertising effects (advertising using 3D special effects), or two-dimensional stickers, such as two-dimensional advertising stickers (using ads in the form of stickers).
  • the present invention is not limited thereto, and other forms of business objects are also applicable to the image processing solutions provided by the embodiments of the present invention, such as text descriptions or introductions of APPs or other applications, or certain forms of objects (such as electronic pets) that interact with video viewers. .
  • the business object to be displayed may be determined according to at least one of shape information, size information, feature information, and identification information of the target object.
  • shape information For example, when the feature information of the target object indicates that the target object is a book, the target object may be determined as a thick line box, and the size of the box may be adjusted to indicate the position of the book in the image during display, or It is also possible to identify the target object as a cartoon picture in the shape of a doctor hat, display it on a corner of the book, etc.
  • the determination may be made according to the setting rule. For example, a business object is displayed at a position within a set range above the top of the target object, or a business object is displayed at a peripheral location of the target object, or a business object is displayed at a corner or boundary of the image, or if the business object is not Affecting the display of the target object, you can display the business object and so on within the target object's location.
  • Step S208 Display the business object in the determined display position of the business object based on the currently displayed image in the current webpage of the browser.
  • a business object can be drawn or rendered at a corresponding placement using any suitable rendering or rendering method.
  • the webpage setting corresponding to the target object may be determined first; the business object is displayed at the determined location in the webpage based on the image of the target object, and the webpage setting is displayed in the webpage.
  • the webpage setting includes at least one of the following: the prompt information corresponding to the target object (eg, the offer information related to the target object or the activity information, etc.), and the interaction information corresponding to the target object (eg, an interactive button, through which the interactive button can be The interaction with the web page or the backend server), the link information corresponding to the target object (eg, the purchase link information or the activity link information of the target object, etc.).
  • the image may be first drawn on the first layer of the webpage window of the browser; and then the business object is drawn on the second layer of the webpage window based on the drawn image and the determined placement position. Then, the remaining webpage content in the current webpage except the image is drawn on the third layer of the webpage window; then, the first layer, the second layer and the third layer are merged, so that the second layer is above the first layer The third layer is above the second layer.
  • the above drawing can be performed by computer drawing.
  • the computer drawing method can be implemented by any suitable computer graphics image drawing or rendering, including but not limited to: drawing based on the OpenGL graphics drawing engine.
  • OpenGL defines a professional graphical program interface for cross-programming language and cross-platform programming interface specifications. It is hardware-independent and can easily draw 2D or 3D graphics images. With OpenGL, you can not only achieve 2D effects such as 2D stickers, but also 3D effects. But not limited to OpenGL, other methods, such as Unity or OpenCL, are also applicable.
  • FIG. 3 shows a schematic diagram of a logical layering of a web page window.
  • the left side is the first layer, and the currently displayed image is drawn on the image, in which the LOGO icon on the left cup is the target object; the middle is the second layer, where the business object is displayed on the display position.
  • the second layer is placed on the first layer, and the third layer is placed on the second layer, and the layers are merged.
  • the combined effect of the layer is shown in FIG. 4 .
  • the circular business object just identifies the location of the LOGO icon. When the user clicks on "More Activities", the browser will jump to the corresponding event description page.
  • the business object may be further set, so that when the user clicks on the business object, the user may also interact with the browser, and jump to a corresponding page, such as an activity description page.
  • AR Augmented Reality processing of the image displayed in the current page of the browser is realized, which makes the image more interesting and interactive.
  • the business object to be displayed and the display position thereof are determined based on the information of the corresponding target object in the image displayed in the current webpage, and then the business object is displayed together with the image in the current webpage.
  • the business object can be closely combined with the target object in the image, which does not affect the normal viewing of the viewer, and can also realize effective interaction between the image and the user, and enhance the interaction between the embedded business object and the user. Sexuality also enhances the user's interest in browsing web images.
  • the image processing method of this embodiment may be performed by any suitable device having image or data processing capabilities, including but not limited to: various terminal devices (including PCs, tablets, mobile terminals, etc.), servers, and the like.
  • various terminal devices including PCs, tablets, mobile terminals, etc.
  • servers and the like.
  • FIG. 5 a block diagram showing the structure of an image processing apparatus according to a third embodiment of the present invention is shown.
  • the image processing apparatus of the present embodiment includes: a first determining module 302, configured to determine information of a target object in an image currently displayed by the browser webpage, wherein the information of the target object includes location information of the target object; and the second determining module 304 And determining, by the target object, the business object to be displayed, and determining the display position of the business object according to the location information of the target object; the displaying module 306, configured to display the business object in the display position in the webpage.
  • the image processing apparatus of the embodiment determines the business object to be displayed corresponding to the target object and the display position thereof based on the information of the corresponding target object in the image displayed in the current webpage, and then displays the business object together with the image in the current webpage.
  • the business object can be closely combined with the target object in the image, which does not affect the normal viewing of the viewer, and can also realize effective interaction between the image and the user, and enhance the interaction between the embedded business object and the user. Sexuality also enhances the user's interest in browsing web images.
  • FIG. 6 there is shown a block diagram showing the structure of an image processing apparatus according to a fourth embodiment of the present invention.
  • the image processing apparatus of this embodiment includes: a first determining module 402, configured to determine information of a target object in an image currently displayed by a browser webpage, where the information of the target object includes location information of the target object;
  • the module 404 is configured to determine a business object to be displayed corresponding to the target object, and determine a display position of the business object according to the location information of the target object.
  • the display module 406 is configured to display the business object in the display position in the webpage.
  • the information of the target object further includes at least one of the following: shape information, size information, feature information, and identification information of the target object; the second determining module 404 is configured to use shape information, size information, and feature information of the target object. And identifying at least one of the information, determining a business object to be displayed; and determining a display position of the business object according to the location information of the target object.
  • the display module 406 is further configured to determine a webpage setting corresponding to the target object; and display the webpage setting.
  • the webpage setting includes at least one of the following: the prompt information corresponding to the target object, the interaction information corresponding to the target object, and the link information corresponding to the target object.
  • the image processing apparatus of this embodiment further includes: an obtaining module 408, configured to: before the first determining module 402 determines information of the target object in the image currently displayed by the browser webpage, by using a convolutional neural network The image is detected to obtain information of the target object.
  • an obtaining module 408 configured to: before the first determining module 402 determines information of the target object in the image currently displayed by the browser webpage, by using a convolutional neural network The image is detected to obtain information of the target object.
  • the presentation module 406 includes: a drawing module 4062, configured to draw the image on a first layer of a webpage window of the browser; and drawing the business object in the webpage window based on the drawn image and the determined placement position a second layer; the remaining webpage content of the webpage except the image is drawn on a third layer of the webpage window; the merging module 4064 is configured to merge the first layer, the second layer, and the third layer, wherein, the second The layer is above the first layer and the third layer is above the second layer.
  • a drawing module 4062 configured to draw the image on a first layer of a webpage window of the browser
  • drawing the business object in the webpage window based on the drawn image and the determined placement position a second layer
  • the remaining webpage content of the webpage except the image is drawn on a third layer of the webpage window
  • the merging module 4064 is configured to merge the first layer, the second layer, and the third layer, wherein, the second The layer is above the first layer and the third layer is above the second layer.
  • the image comprises a still image or a video frame image.
  • the business object is a setting flag for identifying a target object in the image; or, is a special effect including semantic information.
  • the special effects include a two-dimensional sticker effect or a three-dimensional special effect.
  • the image currently displayed by the browser webpage includes at least one image; and each image includes at least one target object.
  • the image processing apparatus of the present embodiment is used to implement the corresponding image processing method in the foregoing multiple method embodiments, and has the beneficial effects of the corresponding method embodiments, and details are not described herein again.
  • FIG. 7 a schematic structural diagram of an electronic device according to Embodiment 5 of the present invention is shown.
  • the specific embodiment of the present invention does not limit the specific implementation of the electronic device.
  • the electronic device can include a processor 502, a communications interface 504, a memory 506, and a communications bus 508.
  • Processor 502, communication interface 504, and memory 506 complete communication with one another via communication bus 508.
  • the communication interface 504 is configured to communicate with network elements of other devices, such as clients or other servers.
  • the processor 502 is configured to execute the program 510. Specifically, the related steps in the foregoing image processing method embodiments may be performed.
  • program 510 can include program code, the program code including computer operating instructions.
  • the processor 502 may be a central processing unit CPU, or an Application Specific Integrated Circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present invention.
  • the server includes one or more processors, which may be the same type of processor, such as one or more CPUs; or may be different types of processors, such as one or more CPUs and one or more ASICs.
  • the memory 506 is configured to store the program 510.
  • Memory 506 may include high speed RAM memory and may also include non-volatile memory, such as at least one disk memory.
  • the program 510 may be specifically configured to cause the processor 502 to: determine information of a target object in an image currently displayed by the browser webpage, where the information of the target object includes location information of the target object; and determine that the target object corresponds to The displayed business object, and determining the display position of the business object according to the location information of the target object; displaying the business object at the display position in the webpage.
  • the information of the target object further includes at least one of the following: shape information, size information, feature information, and identification information of the target object; the program 510 is further configured to cause the processor 502 to determine the to-be-displayed When the business object is obtained, the business object to be displayed is determined according to at least one of shape information, size information, feature information, and identification information of the target object.
  • the program 510 is further configured to: when the processor 502 displays the business object at the display location in the webpage, determine a webpage setting corresponding to the target object; Web page settings.
  • the webpage setting includes at least one of the following: the prompt information corresponding to the target object, the interaction information corresponding to the target object, and the link information corresponding to the target object.
  • the program 510 is further configured to cause the processor 502 to detect the image by using a convolutional neural network to obtain the target before determining the information of the target object in the image currently displayed by the browser webpage. The information of the object.
  • the program 510 is further configured to cause the processor 502 to render the image in a webpage window of the browser when the business object is displayed at the determined placement location based on the image in the webpage. a layer; drawing the business object on the second layer of the webpage window based on the image and the determined display position; and drawing the remaining webpage content of the webpage except the image on the third layer of the webpage window Combining the first layer, the second layer, and the third layer, wherein the second layer is above the first layer and the third layer is above the second layer.
  • the image comprises a still image or a video frame image.
  • the business object is a setting flag for identifying a target object in the image; or, is a special effect containing semantic information.
  • the special effects include two-dimensional sticker effects or three-dimensional effects.
  • the image currently displayed by the browser webpage includes at least one image; and each image includes at least one target object.
  • the business object to be displayed and the display position thereof are determined based on the information of the corresponding target object in the image displayed in the current webpage, and then the business object is displayed together with the image in the current webpage.
  • the business object can be closely integrated with the target object in the image, which does not affect the normal viewing of the viewer, and can realize effective interaction between the image and the user, thereby improving the interaction between the embedded business object and the user. It also enhances the user's interest in browsing web images.
  • the embodiment of the present application provides a computer readable storage medium storing computer executable instructions for performing operations corresponding to the image processing method described above.
  • the computer-readable storage medium of the embodiment determines the business object to be displayed corresponding to the target object and the display position thereof according to the information of the corresponding target object in the image displayed in the current webpage, and then displays the image together with the image in the current webpage.
  • Business object With the electronic device of the embodiment, the business object can be closely integrated with the target object in the image, which does not affect the normal viewing of the viewer, and can realize effective interaction between the image and the user, thereby improving the interaction between the embedded business object and the user. It also enhances the user's interest in browsing web images.
  • the above method according to an embodiment of the present invention may be implemented in hardware, firmware, or implemented as software or computer code that may be stored in a recording medium such as a CD ROM, a RAM, a floppy disk, a hard disk, or a magneto-optical disk, or implemented by
  • the network downloads computer code originally stored in a remote recording medium or non-transitory machine readable medium and stored in a local recording medium so that the methods described herein can be stored using a general purpose computer, a dedicated processor or programmable
  • Such software processing on a recording medium of dedicated hardware such as an ASIC or an FPGA.
  • a computer, processor, microprocessor controller or programmable hardware includes storage components (eg, RAM, ROM, flash memory, etc.) that can store or receive software or computer code, when the software or computer code is The image processing methods described herein are implemented when the processor or hardware is accessed and executed. Moreover, when a general purpose computer accesses code for implementing the image processing methods illustrated herein, execution of the code converts the general purpose computer into a special purpose computer for performing the image processing methods illustrated herein.

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本发明实施例提供了一种图像处理方法、装置、电子设备及存储介质,其中,图像处理方法包括:确定浏览器网页当前展示的图像中的目标对象的信息,其中,所述目标对象的信息包括所述目标对象的位置信息;确定所述目标对象对应的待展示的业务对象,并根据所述目标对象的位置信息确定所述业务对象的展示位置;在所述网页中的所述展示位置展示所述业务对象。通过本发明实施例,提升了植入的业务对象与用户的交互性,也提升了用户浏览网页图像的趣味性。

Description

图像处理方法、装置、电子设备及存储介质
交互参考
本申请要求以下优先权:2017年06月12日提出的申请号:201710436833.6,名称:“图像处理方法、装置和电子设备”的中国专利,本申请参考引用了如上所述申请的全部内容。
技术领域
本发明实施例涉及人工智能技术领域,尤其涉及一种图像处理方法、装置、电子设备及存储介质。
背景技术
随着互联网技术的发展,人们越来越多地使用互联网进行诸如观看视频和浏览图像等等活动,由此,互联网视频和图像为许多新的业务提供了商机。因为互联网视频和图像可以成为重要的业务流量入口,因而被认为是植入相应业务如宣传活动或广告的优质资源。
现有业务植入多通过在图像外围设置相应信息如活动信息或广告信息,或者,在视频播放的某个时间插入固定时长的广告等方式实现。
但是,这种业务植入方式不能与图像或视频资源很好地结合,也无法达到与用户交互,以提高业务交互性和趣味性的效果。
发明内容
本发明实施例提供了一种图像处理的技术方案,以解决目前的业务植入方式不能与图像或视频资源很好地结合,无法达到与用户交互以提高业务交互性和趣味性的问题。
根据本发明实施例的一个方面,提供了一种图像处理方法,包括:确定浏览器网页当前展示的图像中的目标对象的信息,其中,所述目标对象的信息包括所述目标对象的位置信息;确定所述目标对象对应的待展示的业务对象,并根据所述目标对象的位置信息确定所述业务对象的展示位 置;在所述网页中的所述展示位置展示所述业务对象。
根据本发明实施例的另一个方面,还提供了一种图像处理装置,包括:第一确定模块,用于确定浏览器网页当前展示的图像中的目标对象的信息,其中,所述目标对象的信息包括所述目标对象的位置信息;第二确定模块,用于确定所述目标对象对应的待展示的业务对象,并根据所述目标对象的位置信息确定所述业务对象的展示位置;展示模块,用于在所述网页中的所述展示位置展示所述业务对象。
根据本发明实施例的又一个方面,还提供了一种电子设备,包括:处理器、存储器、通信接口和通信总线,所述处理器、所述存储器和所述通信接口通过所述通信总线完成相互间的通信;所述存储器用于存放至少一可执行指令,所述可执行指令使所述处理器执行如上所述的图像处理方法对应的操作。
根据本发明实施例的又一个方面,还提供了一种计算机可读存储介质,其存储有计算机可执行指令,所述计算机可执行指令用于执行如上所述的图像处理方法对应的操作。
根据本发明实施例提供的技术方案,基于当前网页中展示的图像中相应的目标对象的信息,确定目标对象对应的待展示的业务对象及其展示位置,进而在当前网页中与图像一起展示业务对象。其中,业务对象可以是用于标识目标对象的标志,也可以是贴纸(如广告贴纸)等等。采用本发明实施例提供的技术方案,业务对象可以与图像中的目标对象紧密结合,既不影响观众的正常观看,也可以实现图像与用户的有效交互,提升了植入的业务对象与用户的交互性,也提升了用户浏览网页图像的趣味性。
附图说明
图1是根据本发明实施例一的一种图像处理方法的步骤流程图;
图2是根据本发明实施例二的一种图像处理方法的步骤流程图;
图3是图2所示实施例中的一种网页窗口逻辑分层的示意图;
图4是图2所示实施例中的一种业务对象展示效果图;
图5是根据本发明实施例三的一种图像处理装置的结构框图;
图6是根据本发明实施例四的一种图像处理装置的结构框图;
图7是根据本发明实施例五的一种电子设备的结构框图。
具体实施方式
下面结合附图(若干附图中相同的标号表示相同的元素)和实施例,对本发明实施例的具体实施方式作进一步详细说明。以下实施例用于说明本发明,但不用来限制本发明的范围。
本领域技术人员可以理解,本发明实施例中的“第一”、“第二”等术语仅用于区别不同步骤、设备或模块等,既不代表任何特定技术含义,也不表示它们之间的必然逻辑顺序。
实施例一
参照图1,示出了根据本发明实施例一的一种图像处理方法的步骤流程图。
本实施例的图像处理方法包括以下步骤:
步骤S102:确定浏览器网页当前展示的图像中的目标对象的信息。
其中,目标对象的信息包括目标对象的位置信息。
目标对象是存在于图像中的、易被观众查看的对象。本实施例中,对目标对象的检测和识别,以及对目标对象的信息的获取均可以由本领域技术人员采用任意适当的方式实现,包括但不限于使用神经网络模型(如卷积神经网络模型)或者特征提取算法或者其它适当方式,本实施例对此不作限制。
目标对象可以是任意适当的待处理对象,如,人整体、人体部位、动物、物品、商品标识、标志等等。目标对象的信息包括但不限于目标对象的位置信息,目标对象的位置信息可以指示目标对象在图像中的相对位置,
步骤S104:确定目标对象对应的待展示的业务对象,并根据目标对象的位置信息确定业务对象的展示位置。
本发明实施例中,业务对象意指用于指示或者传递信息的设置,包括 但不限于图标、贴纸、文字等等。
本步骤中,待展示的业务对象可以由本领域技术人员根据实际情况采用任意适当的方式确定,如,设置的默认业务对象,或者,根据图像的类型确定待展示的业务对象(如风景类型的图像可以对应卡通笑脸贴纸、卡通阳光、云朵贴纸等业务对象),或者,根据图像中目标对象的类型确定待展示的业务对象(如对于美食类型的目标对象可以对应流口水的卡通笑脸图标等)。本实施例对具体的业务对象的确定方式不作限制。
在待展示的业务对象确定后,可以根据目标对象的位置信息确定业务对象的展示位置。例如,在目标对象的周边展示,或者,展示为目标对象的前景,或者,展示为目标对象的背景等等。
步骤S106:在浏览器当前网页中,基于当前展示的图像,在确定的业务对象的展示位置展示业务对象。
其中,对业务对象的展示包括但不限于使用计算机绘制、浏览器渲染等实现展示的方式。
通过本实施例的图像处理方法,基于当前网页中展示的图像中相应的目标对象的信息,确定待展示的业务对象及其展示位置,进而在当前网页中与图像一起展示业务对象。采用本实施例的图像处理方法,业务对象可以与图像中的目标对象紧密结合,既不影响观众的正常观看,也可以实现图像与用户的有效交互,提升了植入的业务对象与用户的交互性,也提升了用户浏览网页图像的趣味性。
本实施例的图像处理方法可以由任意适当的具有图像或数据处理能力的设备执行,包括但不限于:各种终端设备(包括PC机、平板电脑、移动终端等)和服务器等。
实施例二
参照图2,示出了根据本发明实施例二的一种图像处理方法的步骤流程图。
本实施例的图像处理方法包括以下步骤:
步骤S202:获取浏览器当前网页中当前展示的图像。
其中,当前展示的图像可以仅有一张,也可以有多张(本发明实施例中,“多张”、“多个”等有“多”有关的数量意指两个及两个以上)。若当前展示的图像有多张,可以针对每一张图像都进行如本发明实施例中所述的图像处理,也可以只对其中的部分图像进行如本发明实施例中所述的图像处理。
步骤S204:对获取的图像进行检测,获取图像中的目标对象的信息。
若待处理的图像包括多张,则对每张待处理的图像都进行检测,分别获取各图像中的目标对象的信息。
在一种可行方式中,可以通过经过训练的、具有图像检测功能的卷积神经网络进行图像检测,以获取图像中的目标对象的信息。卷积神经网络(Convolutional Neural Network,CNN)是一种深度学习网络架构,其受生物自然视觉认知机制启发而来。经过训练的CNN能够有效识别图像视觉规律,可广泛应用于诸如图像分类、物体检测、物体追踪、姿态估计等领域。本实施例可采用训练完成的、具有图像检测功能的卷积神经网络,通过该卷积神经网络可以获得图像的多种信息,包括但不限于图像中的目标对象的信息,如目标对象的位置信息、形状信息、尺寸信息、特征信息、标识信息等等。当然,目标对象的标识信息也可以采用其它方式得到,如人工或机器标注等等。其中,位置信息用于指示目标对象在图像中的位置;形状信息用于指示目标对象的形状;尺寸信息用于指示目标对象的大小尺寸;特征信息用于指示目标对象的特征,通过目标对象的特征可以有效地对图像中的对象是否为目标对象进行识别;标识信息用于标识目标对象,如将图像中的多个对象分别标识为LOGO-1、LOGO-2、OBJ-1、OBJ-2等,每一个标识都对应有一个对象的信息,如,LOGO-1为某个品牌标识、LOGO-2为另一个品牌标识、OBJ-1为一个杯子、OBJ-2为一个汽水瓶等等,通过这些标识及其与对象的对应关系,可以确定所被标识的对象是否为目标对象。
本实施例中,获取的目标对象的信息至少包括目标对象的位置信息,可选地,还可以包括目标对象的形状信息、尺寸信息、特征信息、标识信息中的至少一个。
在每一个图像中,都包括一个或多个目标对象。当目标对象包括多个时,该多个目标对象可以相同也可以不同,如包括多个杯子上相同的LOGO,或者,包括多个形状不同的杯子等等。不论目标对象是否相同,需要分别获取各个目标对象的信息。
步骤S206:确定目标对象对应的待展示的业务对象,并根据目标对象的位置信息确定业务对象的展示位置。
本实施例中,业务对象为用于标识待处理的图像中的目标对象的设定标志;或者,为包含有语义信息的特效。可选地,所述特效可以包括二维贴纸特效或者三维特效。
其中,设定标志可以由本领域技术人员根据实际情况适当设置,能够实现对目标对象进行标志即可,如标示目标对象位置的线框、红心、星星等等。特效可以是三维形式的特效,如三维形式的广告特效(使用3D特效形式展示的广告),也可以是二维形式的贴纸,如二维形式的广告贴纸特效(使用贴纸形式展示的广告)。但不限于此,其它形式的业务对象也同样适用本发明实施例提供的图像处理方案,如APP或其它应用的文字说明或介绍,或者一定形式的与视频观众交互的对象(如电子宠物)等。
基于目标对象的信息,在确定待展示的业务对象时,可以根据目标对象的形状信息、尺寸信息、特征信息、标识信息中的至少一个,确定待展示的业务对象。例如,当目标对象的特征信息指示目标对象为一本书时,可以将目标对象确定为一个粗线方框,在展示时可以调整该方框大小以指明该书在图像中的位置,或者,也可以将目标对象确定为一个博士帽形状的卡通图片,在展示时将其展示于该书某个边角等等。
在根据目标对象的位置信息确定业务对象的展示位置时,可以按照设定规则进行确定。例如,在目标对象顶部之上设定范围内的位置展示业务对象,或者,在目标对象的周边位置展示业务对象,或者,在图像的边角或边界处展示业务对象,或者,如果业务对象不影响目标对象的显示,则可以在目标对象的位置范围内展示业务对象等等。
步骤S208:在浏览器当前网页中,基于当前展示的图像,在确定的业务对象的展示位置展示业务对象。
例如,可以采用任意适当的绘制或渲染方式,将业务对象绘制或渲染在相应的展示位置。
可选地,可以先确定与目标对象对应的网页设置;基于目标对象所在的图像,在网页中确定的展示位置展示业务对象,以及,在网页中展示网页设置。其中,网页设置包括以下至少之一:目标对象对应的提示信息(如,提示与目标对象有关的优惠信息或活动信息等)、目标对象对应的交互信息(如,交互按键,通过该交互按键可以与网页或后端服务器进行交互)、目标对象对应的链接信息(如,目标对象的购买链接信息或活动链接信息等等)。
在具体展示时,一种可选方式中,可以首先将图像绘制于浏览器的网页窗口的第一层;再基于绘制的图像和确定的展示位置,将业务对象绘制于网页窗口的第二层;接着将当前网页中除所述图像之外的其余网页内容绘制于网页窗口的第三层;然后,合并第一层、第二层和第三层,使第二层位于第一层之上,第三层位于第二层之上。
其中,可以采用计算机绘图方式进行上述绘制。计算机绘图方式可以通过任意适当的计算机图形图像绘制或渲染等方式实现,包括但不限于:基于OpenGL图形绘制引擎进行绘制等。OpenGL定义了一个跨编程语言、跨平台的编程接口规格的专业的图形程序接口,其与硬件无关,可以方便地进行2D或3D图形图像的绘制。通过OpenGL,不仅可以实现2D效果如2D贴纸的绘制,还可以实现3D特效的绘制等等。但不限于OpenGL,其它方式,如Unity或OpenCL等也同样适用。
以下,以一个实例为例,对本实施例的上述采用三层绘制的方式进行说明。
如图3所示,其示出了一种网页窗口逻辑分层的示意图。其中,左侧的为第一层,其上绘制有当前展示的图像,该图像中,左侧杯子上的LOGO图标为目标对象;中间的为第二层,其上在业务对象的展示位置绘制有业务对象,本实例中为与目标对象相对应的圆形;右侧的为第三层,其上绘制有除图像之外的其它网页内容,本实例中主要为目标对象的活动提示(即图像中的“更多活动”选项)及相关网址。将第二层置于第一层之上, 第三层置于第二层之上,进行图层合并,合并后的图层的展示效果如图4所示。从图4中可见,圆形的业务对象正好标识出LOGO图标的位置,当用户点击“更多活动”时,浏览器将会跳转到相应的活动说明网页。
可选地,还可以进一步对业务对象进行设置,使用户点击业务对象时也可以与浏览器进行交互,跳转至相应的页面,如活动说明网页等。
通过上述过程,实现了对浏览器当前页面中展示的图像的AR(Augmented Reality,增强现实)处理,使得图像更有趣味也更具交互性。
需要说明的是,本实施例中仅以静态图像为例,对本发明的图像处理进行说明,但不限于此,本发明实施例的方案同样适用于视频帧序列中的视频帧图像,其具体实现与静态图像类似,在此不再赘述。
通过本实施例的图像处理方法,基于当前网页中展示的图像中相应的目标对象的信息,确定待展示的业务对象及其展示位置,进而在当前网页中与图像一起展示业务对象。采用本实施例的图像处理方法,业务对象可以与图像中的目标对象紧密结合,既不影响观众的正常观看,也可以实现图像与用户的有效交互,提升了植入的业务对象与用户的交互性,也提升了用户浏览网页图像的趣味性。
本实施例的图像处理方法可以由任意适当的具有图像或数据处理能力的设备执行,包括但不限于:各种终端设备(包括PC机、平板电脑、移动终端等)和服务器等。
实施例三
参照图5,示出了根据本发明实施例三的一种图像处理装置的结构框图。
本实施例的图像处理装置包括:第一确定模块302,用于确定浏览器网页当前展示的图像中的目标对象的信息,其中,目标对象的信息包括目标对象的位置信息;第二确定模块304,用于确定所述目标对象对应的待展示的业务对象,并根据目标对象的位置信息确定业务对象的展示位置;展示模块306,用于在所述网页中的展示位置展示业务对象。
通过本实施例的图像处理装置,基于当前网页中展示的图像中相应的 目标对象的信息,确定目标对象对应的待展示的业务对象及其展示位置,进而在当前网页中与图像一起展示业务对象。采用本实施例的图像处理装置,业务对象可以与图像中的目标对象紧密结合,既不影响观众的正常观看,也可以实现图像与用户的有效交互,提升了植入的业务对象与用户的交互性,也提升了用户浏览网页图像的趣味性。
实施例四
参照图6,示出了根据本发明实施例四的一种图像处理装置的结构框图。
本实施例的图像处理装置包括:第一确定模块402,用于确定浏览器网页当前展示的图像中的目标对象的信息,其中,目标对象的信息包括所述目标对象的位置信息;第二确定模块404,用于确定目标对象对应的待展示的业务对象,并根据目标对象的位置信息确定业务对象的展示位置;展示模块406,用于在所述网页中的展示位置展示业务对象。
可选地,目标对象的信息还包括以下至少之一:目标对象的形状信息、尺寸信息、特征信息、标识信息;第二确定模块404,用于根据目标对象的形状信息、尺寸信息、特征信息、标识信息中的至少一个,确定待展示的业务对象;并根据目标对象的位置信息确定业务对象的展示位置。
可选地,展示模块406还用于确定与目标对象对应的网页设置;展示所述网页设置。
可选地,所述网页设置包括以下至少之一:目标对象对应的提示信息、目标对象对应的交互信息、目标对象对应的链接信息。
可选地,本实施例的图像处理装置还包括:获取模块408,用于在第一确定模块402确定浏览器网页当前展示的图像中的目标对象的信息之前,通过卷积神经网络对所述图像进行检测,获取目标对象的信息。
可选地,展示模块406包括:绘制模块4062,用于将所述图像绘制于浏览器的网页窗口的第一层;基于绘制的图像和确定的展示位置,将业务对象绘制于网页窗口的第二层;将所述网页中除所述图像之外的其余网页内容绘制于网页窗口的第三层;合并模块4064,用于合并第一层、第 二层和第三层,其中,第二层位于第一层之上,第三层位于第二层之上。
可选地,所述图像包括静态图像或者视频帧图像。
可选地,业务对象为用于标识所述图像中的目标对象的设定标志;或者,为包含有语义信息的特效。
可选地,所述特效包括二维贴纸特效或者三维特效。
可选地,所述浏览器网页当前展示的图像包括至少一个图像;每个图像中包括至少一个目标对象。
本实施例的图像处理装置用于实现前述多个方法实施例中相应的图像处理方法,并具有相应的方法实施例的有益效果,在此不再赘述。
实施例五
参照图7,示出了根据本发明实施例五的一种电子设备的结构示意图,本发明具体实施例并不对电子设备的具体实现做限定。
如图7所示,该电子设备可以包括:处理器(processor)502、通信接口(Communications Interface)504、存储器(memory)506、以及通信总线508。
其中:
处理器502、通信接口504、以及存储器506通过通信总线508完成相互间的通信。
通信接口504,用于与其它设备比如客户端或其它服务器等的网元通信。
处理器502,用于执行程序510,具体可以执行上述图像处理方法实施例中的相关步骤。
具体地,程序510可以包括程序代码,该程序代码包括计算机操作指令。
处理器502可能是中央处理器CPU,或者是特定集成电路ASIC(Application Specific Integrated Circuit),或者是被配置成实施本发明实施例的一个或多个集成电路。服务器包括的一个或多个处理器,可以是同一类型的处理器,如一个或多个CPU;也可以是不同类型的处理器,如一个或多个CPU以及一个或多个ASIC。
存储器506,用于存放程序510。存储器506可能包含高速RAM存储器,也可能还包括非易失性存储器(non-volatile memory),例如至少一个磁盘存储器。
程序510具体可以用于使得处理器502执行以下操作:确定浏览器网页当前展示的图像中的目标对象的信息,其中,目标对象的信息包括目标对象的位置信息;确定所述目标对象对应的待展示的业务对象,并根据目标对象的位置信息确定业务对象的展示位置;在所述网页中的展示位置展示业务对象。
在一种可选的实施方式中,目标对象的信息还包括以下至少之一:目标对象的形状信息、尺寸信息、特征信息、标识信息;程序510还用于使得处理器502在确定待展示的业务对象时,根据目标对象的形状信息、尺寸信息、特征信息、标识信息中的至少一个,确定待展示的业务对象。
在一种可选的实施方式中,程序510还用于使得处理器502在所述网页中的所述展示位置展示所述业务对象时,确定与所述目标对象对应的网页设置;展示所述网页设置。
在一种可选的实施方式中,所述网页设置包括以下至少之一:所述目标对象对应的提示信息、所述目标对象对应的交互信息、所述目标对象对应的链接信息。
在一种可选的实施方式中,程序510还用于使得处理器502在确定浏览器网页当前展示的图像中的目标对象的信息之前,通过卷积神经网络对所述图像进行检测,获取目标对象的信息。
在一种可选的实施方式中,程序510还用于使得处理器502在网页中,基于所述图像在确定的展示位置展示业务对象时,将所述图像绘制于浏览器的网页窗口的第一层;基于绘制的所述图像和确定的展示位置,将业务对象绘制于网页窗口的第二层;将所述网页中除所述图像之外的其余网页内容绘制于网页窗口的第三层;合并第一层、第二层和第三层,其中,第二层位于第一层之上,所第三层位于第二层之上。
在一种可选的实施方式中,所述图像包括静态图像或者视频帧图像。
在一种可选的实施方式中,业务对象为用于标识所述图像中的目标对 象的设定标志;或者,为包含有语义信息的特效。
在一种可选的实施方式中,所述特效包括二维贴纸特效或者三维特效。
在一种可选的实施方式中,所述浏览器网页当前展示的图像包括至少一个图像;每个图像中包括至少一个目标对象。
程序510中各步骤的具体实现可以参见上述图像处理方法实施例中的相应步骤和单元中对应的描述,在此不赘述。所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的设备和模块的具体工作过程,可以参考前述方法实施例中的对应过程描述,在此不再赘述。
通过本实施例的电子设备,基于当前网页中展示的图像中相应的目标对象的信息,确定待展示的业务对象及其展示位置,进而在当前网页中与图像一起展示业务对象。采用本实施例的电子设备,业务对象可以与图像中的目标对象紧密结合,既不影响观众的正常观看,也可以实现图像与用户的有效交互,提升了植入的业务对象与用户的交互性,也提升了用户浏览网页图像的趣味性。
实施例六
本申请实施例提供一种计算机可读存储介质,其存储有计算机可执行指令,所述计算机可执行指令用于执行上述的图像处理方法对应的操作。
通过本实施例的计算机可读存储介质,基于当前网页中展示的图像中相应的目标对象的信息,确定目标对象对应的待展示的业务对象及其展示位置,进而在当前网页中与图像一起展示业务对象。采用本实施例的电子设备,业务对象可以与图像中的目标对象紧密结合,既不影响观众的正常观看,也可以实现图像与用户的有效交互,提升了植入的业务对象与用户的交互性,也提升了用户浏览网页图像的趣味性。
需要指出,根据实施的需要,可将本发明实施例中描述的各个部件/步骤拆分为更多部件/步骤,也可将两个或多个部件/步骤或者部件/步骤的部分操作组合成新的部件/步骤,以实现本发明实施例的目的。
上述根据本发明实施例的方法可在硬件、固件中实现,或者被实现为可存储在记录介质(诸如CD ROM、RAM、软盘、硬盘或磁光盘)中的软件或计算机代码,或者被实现通过网络下载的原始存储在远程记录介质或非暂时机器可读介质中并将被存储在本地记录介质中的计算机代码,从而在此描述的方法可被存储在使用通用计算机、专用处理器或者可编程或专用硬件(诸如ASIC或FPGA)的记录介质上的这样的软件处理。可以理解,计算机、处理器、微处理器控制器或可编程硬件包括可存储或接收软件或计算机代码的存储组件(例如,RAM、ROM、闪存等),当所述软件或计算机代码被计算机、处理器或硬件访问且执行时,实现在此描述的图像处理方法。此外,当通用计算机访问用于实现在此示出的图像处理方法的代码时,代码的执行将通用计算机转换为用于执行在此示出的图像处理方法的专用计算机。
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及方法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本发明实施例的范围。
以上实施方式仅用于说明本发明实施例,而并非对本发明实施例的限制,有关技术领域的普通技术人员,在不脱离本发明实施例的精神和范围的情况下,还可以做出各种变化和变型,因此所有等同的技术方案也属于本发明实施例的范畴,本发明实施例的专利保护范围应由权利要求限定。

Claims (22)

  1. 一种图像处理方法,包括:
    确定浏览器网页当前展示的图像中的目标对象的信息,其中,所述目标对象的信息包括所述目标对象的位置信息;
    确定所述目标对象对应的待展示的业务对象,并根据所述目标对象的位置信息确定所述业务对象的展示位置;
    在所述网页中的所述展示位置展示所述业务对象。
  2. 根据权利要求1所述的方法,其中,所述目标对象的信息还包括以下至少之一:所述目标对象的形状信息、尺寸信息、特征信息、标识信息;
    所述确定待展示的业务对象,包括:
    根据所述目标对象的形状信息、尺寸信息、特征信息、标识信息中的至少一个,确定待展示的业务对象。
  3. 根据权利要求1或2所述的方法,其中,所述方法还包括:
    确定与所述目标对象对应的网页设置;
    展示所述网页设置。
  4. 根据权利要求3所述的方法,其中,所述网页设置包括以下至少之一:所述目标对象对应的提示信息、所述目标对象对应的交互信息、所述目标对象对应的链接信息。
  5. 根据权利要求1或2所述的方法,其中,在所述确定浏览器网页当前展示的图像中的目标对象的信息之前,所述方法还包括:
    通过卷积神经网络对所述图像进行检测,获取所述目标对象的信息。
  6. 根据权利要求1或2所述的方法,其中,在所述网页中,基于所述图像在确定的所述展示位置展示所述业务对象,包括:
    将所述图像绘制于所述浏览器的网页窗口的第一层;
    基于绘制的所述图像和确定的所述展示位置,将所述业务对象绘制于所述网页窗口的第二层;
    将所述网页中除所述图像之外的其余网页内容绘制于所述网页窗口 的第三层;
    合并所述第一层、所述第二层和所述第三层,其中,所述第二层位于所述第一层之上,所述第三层位于所述第二层之上。
  7. 根据权利要求1或2所述的方法,其中,所述图像包括静态图像或者视频帧图像。
  8. 根据权利要求1或2所述的方法,其中,所述业务对象为用于标识所述图像中的目标对象的设定标志;或者,为包含有语义信息的特效。
  9. 根据权利要求8所述的方法,其中,所述特效包括二维贴纸特效或者三维特效。
  10. 根据权利要求1或2所述的方法,其中,所述浏览器网页当前展示的图像包括至少一个图像;每个图像中包括至少一个所述目标对象。
  11. 一种图像处理装置,包括:
    第一确定模块,用于确定浏览器网页当前展示的图像中的目标对象的信息,其中,所述目标对象的信息包括所述目标对象的位置信息;
    第二确定模块,用于确定所述目标对象对应的待展示的业务对象,并根据所述目标对象的位置信息确定所述业务对象的展示位置;
    展示模块,用于在所述网页中的所述展示位置展示所述业务对象。
  12. 根据权利要求11所述的装置,其中,所述目标对象的信息还包括以下至少之一:所述目标对象的形状信息、尺寸信息、特征信息、标识信息;
    所述第二确定模块,用于根据所述目标对象的形状信息、尺寸信息、特征信息、标识信息中的至少一个,确定待展示的业务对象;并根据所述目标对象的位置信息确定所述业务对象的展示位置。
  13. 根据权利要求11或12所述的装置,其中,所述展示模块,还用于确定与所述目标对象对应的网页设置;展示所述网页设置。
  14. 根据权利要求13所述的装置,其中,所述网页设置包括以下至少之一:所述目标对象对应的提示信息、所述目标对象对应的交互信息、所述目标对象对应的链接信息。
  15. 根据权利要求11或12所述的装置,其中,所述装置还包括:
    获取模块,用于在所述第一确定模块确定浏览器网页当前展示的图像中的目标对象的信息之前,通过卷积神经网络对所述图像进行检测,获取所述目标对象的信息。
  16. 根据权利要求11或12所述的装置,其中,所述展示模块包括:
    绘制模块,用于将所述图像绘制于所述浏览器的网页窗口的第一层;基于绘制的所述图像和确定的所述展示位置,将所述业务对象绘制于所述网页窗口的第二层;将所述网页中除所述图像之外的其余网页内容绘制于所述网页窗口的第三层;
    合并模块,用于合并所述第一层、所述第二层和所述第三层,其中,所述第二层位于所述第一层之上,所述第三层位于所述第二层之上。
  17. 根据权利要求11或12所述的装置,其中,所述图像包括静态图像或者视频帧图像。
  18. 根据权利要求11或12所述的装置,其中,所述业务对象为用于标识所述图像中的目标对象的设定标志;或者,为包含有语义信息的特效。
  19. 根据权利要求18所述的装置,其中,所述特效包括二维贴纸特效或者三维特效。
  20. 根据权利要求11或12所述的装置,其中,所述浏览器网页当前展示的图像包括至少一个图像;每个图像中包括至少一个所述目标对象。
  21. 一种电子设备,包括:处理器、存储器、通信接口和通信总线,所述处理器、所述存储器和所述通信接口通过所述通信总线完成相互间的通信;
    所述存储器用于存放至少一可执行指令,所述可执行指令使所述处理器执行如权利要求1-10任一项所述的图像处理方法对应的操作。
  22. 一种计算机可读存储介质,其存储有计算机可执行指令,所述计算机可执行指令用于执行权利要求1至10中任一项所述的图像处理方法对应的操作。
PCT/CN2018/090859 2017-06-12 2018-06-12 图像处理方法、装置、电子设备及存储介质 Ceased WO2018228384A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710436833.6A CN107169135B (zh) 2017-06-12 2017-06-12 图像处理方法、装置和电子设备
CN201710436833.6 2017-06-12

Publications (1)

Publication Number Publication Date
WO2018228384A1 true WO2018228384A1 (zh) 2018-12-20

Family

ID=59825132

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/090859 Ceased WO2018228384A1 (zh) 2017-06-12 2018-06-12 图像处理方法、装置、电子设备及存储介质

Country Status (2)

Country Link
CN (1) CN107169135B (zh)
WO (1) WO2018228384A1 (zh)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107169135B (zh) * 2017-06-12 2021-03-19 阿里巴巴(中国)有限公司 图像处理方法、装置和电子设备
CN107948327B (zh) * 2018-01-02 2021-08-06 中国银行股份有限公司 一种基于业务培训的数据处理方法、装置及系统
CN109147007B (zh) * 2018-08-01 2023-09-01 Oppo(重庆)智能科技有限公司 贴纸加载方法、装置、终端及计算机可读存储介质
CN111986127B (zh) 2019-05-22 2022-03-08 腾讯科技(深圳)有限公司 一种图像处理方法、装置、计算机设备和存储介质
CN110213629B (zh) 2019-06-27 2022-02-11 腾讯科技(深圳)有限公司 一种信息植入方法、装置、服务器及存储介质
CN112464691B (zh) * 2019-09-06 2024-12-20 北京字节跳动网络技术有限公司 图像处理方法及装置
CN110796664B (zh) * 2019-10-14 2023-05-23 北京字节跳动网络技术有限公司 图像处理方法、装置、电子设备及计算机可读存储介质
CN113742630B (zh) * 2021-09-16 2023-12-15 阿里巴巴新加坡控股有限公司 图像处理方法、电子设备及计算机存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001218008A (ja) * 2000-01-31 2001-08-10 Canon Inc 画像処理装置、画像処理方法および記憶媒体
CN106293393A (zh) * 2016-08-01 2017-01-04 北京奇虎科技有限公司 基于电子贴纸的合成显示方法、装置及终端设备
CN106339201A (zh) * 2016-09-14 2017-01-18 北京金山安全软件有限公司 贴图处理方法、装置和电子设备
CN106803057A (zh) * 2015-11-25 2017-06-06 腾讯科技(深圳)有限公司 图像信息处理方法及装置
CN107169135A (zh) * 2017-06-12 2017-09-15 广州市动景计算机科技有限公司 图像处理方法、装置和电子设备
CN108076359A (zh) * 2017-01-24 2018-05-25 北京市商汤科技开发有限公司 业务对象的展示方法、装置和电子设备

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8156248B2 (en) * 2003-10-09 2012-04-10 International Business Machines Corporation Image distribution for dynamic server pages
US8429190B2 (en) * 2004-08-11 2013-04-23 Adknowledge, Inc. Method and system for generating and distributing electronic communications
CN105117463B (zh) * 2015-08-24 2019-08-06 北京旷视科技有限公司 信息处理方法和信息处理装置
CN105095498A (zh) * 2015-08-24 2015-11-25 北京旷视科技有限公司 信息处理方法和信息处理装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001218008A (ja) * 2000-01-31 2001-08-10 Canon Inc 画像処理装置、画像処理方法および記憶媒体
CN106803057A (zh) * 2015-11-25 2017-06-06 腾讯科技(深圳)有限公司 图像信息处理方法及装置
CN106293393A (zh) * 2016-08-01 2017-01-04 北京奇虎科技有限公司 基于电子贴纸的合成显示方法、装置及终端设备
CN106339201A (zh) * 2016-09-14 2017-01-18 北京金山安全软件有限公司 贴图处理方法、装置和电子设备
CN108076359A (zh) * 2017-01-24 2018-05-25 北京市商汤科技开发有限公司 业务对象的展示方法、装置和电子设备
CN107169135A (zh) * 2017-06-12 2017-09-15 广州市动景计算机科技有限公司 图像处理方法、装置和电子设备

Also Published As

Publication number Publication date
CN107169135A (zh) 2017-09-15
CN107169135B (zh) 2021-03-19

Similar Documents

Publication Publication Date Title
WO2018228384A1 (zh) 图像处理方法、装置、电子设备及存储介质
US11151606B2 (en) Adaptively embedding visual advertising content into media content
US10776970B2 (en) Method and apparatus for processing video image and computer readable medium
US12008811B2 (en) Machine learning-based selection of a representative video frame within a messaging application
US10325372B2 (en) Intelligent auto-cropping of images
US10573039B2 (en) Techniques for incorporating a text-containing image into a digital image
WO2018033137A1 (zh) 在视频图像中展示业务对象的方法、装置和电子设备
US11468675B1 (en) Techniques for identifying objects from video content
WO2017088340A1 (zh) 图像信息处理方法、装置和计算机存储介质
WO2018033154A1 (zh) 手势控制方法、装置和电子设备
WO2017190638A1 (zh) 信息展示方法和终端设备
US10191624B2 (en) System and method for authoring interactive media assets
CN107770602B (zh) 视频图像处理方法、装置和终端设备
US20200089952A1 (en) Mitigation of augmented reality markup blindness
CN119013684A (zh) 借助于增强现实内容生成器的产品卡
CN108076359B (zh) 业务对象的展示方法、装置和电子设备
US12401857B2 (en) Page display method and apparatus, computer device, storage medium and program product
CN119137619A (zh) 动态地呈现增强现实内容生成器
CN107770603B (zh) 视频图像处理方法、装置和终端设备
US10237585B2 (en) Dynamic content rendering in media
US12530748B2 (en) Automated radial blurring based on saliency and co-saliency
US10225585B2 (en) Dynamic content placement in media
US20150379168A1 (en) Techniques for simulating kinesthetic interactions
CN110636322B (zh) 多媒体数据的处理方法、装置、智能终端及存储介质
US12573154B1 (en) Augmented video based on user activity

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18818492

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18818492

Country of ref document: EP

Kind code of ref document: A1