CN116419007A - Multimedia resource pushing method, multimedia resource rendering method and device - Google Patents

Multimedia resource pushing method, multimedia resource rendering method and device Download PDF

Info

Publication number
CN116419007A
CN116419007A CN202111672689.9A CN202111672689A CN116419007A CN 116419007 A CN116419007 A CN 116419007A CN 202111672689 A CN202111672689 A CN 202111672689A CN 116419007 A CN116419007 A CN 116419007A
Authority
CN
China
Prior art keywords
rendering
product
product image
display frame
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111672689.9A
Other languages
Chinese (zh)
Inventor
王靖淞
涂威威
徐昀
王蔚
梁赵军
张辉
宾峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
4Paradigm Beijing Technology Co Ltd
Original Assignee
4Paradigm Beijing Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 4Paradigm Beijing Technology Co Ltd filed Critical 4Paradigm Beijing Technology Co Ltd
Priority to CN202111672689.9A priority Critical patent/CN116419007A/en
Publication of CN116419007A publication Critical patent/CN116419007A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23412Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23424Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/812Monomedia components thereof involving advertisement data

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Processing Or Creating Images (AREA)

Abstract

A pushing method of multimedia resources, a rendering method and a rendering device of multimedia resources are provided. The pushing method of the multimedia resource comprises the following steps: acquiring a plurality of product images; determining initial position information and combined position information for each of the plurality of product images; generating a rendering profile based on the initial position information and the combined position information of each product image, wherein the rendering profile is used for limiting a rendering mode that each product image moves along a respective moving path in a display frame along with the movement of the display frame in a screen; transmitting the plurality of product images and the rendering profile to a client; wherein, the respective moving path of each product image is the path between the initial position and the combined position of the product image; wherein the plurality of product images are combined together when the plurality of product images are each in a respective combined position in the display frame.

Description

Multimedia resource pushing method, multimedia resource rendering method and device
Technical Field
The present disclosure relates generally to the field of electronic technology, and more particularly, to a method for pushing a multimedia resource, a method and an apparatus for rendering the multimedia resource.
Background
The personalized recommendation can recommend information and commodities of interest to the user according to the interests and characteristics of the user. As personalized recommendation scenes increase, personalized advertisement generation schemes increase. However, the personalized advertisement generation at present stage is mainly static and single images, has poor attraction to users, and influences the user experience and the final conversion rate.
Disclosure of Invention
The exemplary embodiments of the present disclosure provide a pushing method of a multimedia resource, a rendering method and a device of a multimedia resource, which can improve user experience.
According to a first embodiment of the present disclosure, there is provided a pushing method of a multimedia resource, including: acquiring a plurality of product images; determining initial position information and combined position information for each of the plurality of product images; generating a rendering profile based on the initial position information and the combined position information of each product image, wherein the rendering profile is used for limiting a rendering mode that each product image moves along a respective moving path in a display frame along with the movement of the display frame in a screen; transmitting the plurality of product images and the rendering profile to a client; wherein, the respective moving path of each product image is the path between the initial position and the combined position of the product image; wherein the plurality of product images are combined together when the plurality of product images are each in a respective combined position in the display frame.
Optionally, the step of determining the initial position information and the combined position information of each of the plurality of product images includes: determining initial position information of each product image and first size information of each product image when the initial position information is positioned at the initial position, and combining position information and second size information of each product image when the combination position information is positioned at the combining position; wherein the step of generating a rendering profile based on the initial position information and the combined position information of each product image includes: generating a rendering profile based on the initial position information and the first size information of each product image, and the combined position information and the second size information; the rendering configuration file is used for limiting a rendering mode that each product image moves along a respective moving path in the display frame and changes the size as the display frame moves in the screen.
Optionally, the rendering profile includes one of: initial position information and combined position information of each product image; a moving path of each product image; and displaying the mapping relation between the position of the frame relative to the screen and the rendered position of each product image.
Optionally, the rendering profile includes one of: initial position information and combined position information of each product image; a moving path of each product image; displaying the mapping relation between the position of the frame relative to the screen and the rendered position of each product image; the rendering profile further includes one of: first size information and second size information of each product image; displaying the mapping relation between the position of the frame relative to the screen and the size of each product image; mapping of the location where each product image is rendered to the size of the product image.
Optionally, the rendering configuration file further includes: occlusion relationship between product images.
Optionally, the initial positions of the plurality of product images are such that the plurality of product images are equally spaced in the display frame.
Optionally, the pushing method further includes: acquiring a background image for displaying in the same display frame with the plurality of product images and rendering information of the background image; wherein generating a rendering profile based on the initial position information and the first size information, the combined position information and the second size information of each product image includes: generating a rendering configuration file based on the initial position information and the first size information of each product image, the combined position information and the second size information, and the rendering information of the background image; wherein the step of sending the plurality of product images and the rendering profile to the client comprises: and sending the plurality of product images, the background image and the rendering configuration file to a client.
Optionally, the step of determining the combined position information and the second size information for each product image comprises: generating a plurality of candidate combined images according to canvas with a set size, wherein each candidate combined image is an image formed by combining a plurality of product images together on the canvas, and the positions of the product images in different candidate combined images are different; and screening the optimal combined image from the candidate combined images, and determining the combined position information and the second size information of each product image based on the positions and the sizes of the product images corresponding to the optimal combined image relative to the canvas.
Optionally, the step of determining the combined position information and the second size information of each product image based on the positions and sizes of the plurality of product images corresponding to the optimal combined image with respect to the canvas includes: determining the position and the size of the canvas relative to the background image, and taking the position and the size of the canvas relative to the background image and the position and the size of each product image relative to the canvas as combined position information and second size information of each product image;
or determining the position and size of the canvas relative to the background image; determining a combined position of each product image relative to the background image and a size when in the combined position based on a position and a size of the canvas relative to the background image and a position and a size of each product image relative to the canvas; and taking the combination position of each product image relative to the background image and the size of each product image when the product image is positioned at the combination position as combination position information and second size information of each product image.
Optionally, the step of generating the plurality of candidate combined images according to a canvas of a set size comprises: generating a random starting position of the plurality of product images scaled according to a first scaling ratio in the canvas, wherein the random starting position meets a first preset condition, and the first scaling ratio is determined based on a ratio between the area of the canvas and the sum of the areas of the plurality of product images; controlling each zoomed product image to move a first preset proportion of the size of each time to the center point of the canvas until the second preset proportion of the size of each product image is retracted and the movement is stopped when at least one second preset condition is met after the product image is moved; when all the product images stop moving, scaling the whole area surrounded by the outer contours of the multiple product images after rollback according to a second scaling, and determining the whole image formed by the multiple product images at the current position after scaling according to the second scaling as a candidate combined image; wherein the second scale is determined based on a ratio between an area of the canvas and an area of the entire region.
Optionally, the step of screening the optimal combined image from the plurality of candidate combined images includes: screening out the optimal combined image based on the ratio of the blank area to the central area of each candidate combined image and the distance between the height-width ratio and the fixed height-width ratio; wherein the lower the ratio of the blank area to the center area of the center area, the closer the distance between the aspect ratio and the fixed aspect ratio, the higher the likelihood that the candidate combined image is selected.
Optionally, the first preset condition includes at least one of: the random initial position of the product image with larger height-width ratio is far from the center point of the canvas; and/or the second preset condition comprises at least one of the following: the portion that must be revealed is occluded above the first proportional threshold, the occluded portion is above the second proportional threshold, overlapping the bottom of the other product image.
Alternatively, the product image is obtained by: the region where only the target product is located is cut out from the sample image as a product image, and the bottom of the product image and the part which must be displayed are marked.
Optionally, the pushing method further includes: acquiring auxiliary multimedia resources and rendering information thereof; wherein the step of generating a rendering profile based on the initial position information and the combined position information of each product image includes: generating a rendering configuration file based on the initial position information and the combined position information of each product image and the rendering information of the auxiliary multimedia resource; wherein the step of sending the plurality of product images and the rendering profile to the client comprises: transmitting the plurality of product images, the auxiliary multimedia resource, and the rendering profile to a client; wherein the auxiliary multimedia resource comprises at least one of: and (5) decorating images and characters.
According to a second embodiment of the present disclosure, there is provided a rendering method of a multimedia asset, including: receiving a plurality of product images and a rendering configuration file for rendering the plurality of product images in the same display frame; determining a mapping relation between the position of the display frame relative to the screen and the position where each of the plurality of product images is rendered according to the rendering configuration file; rendering the plurality of product images in a display frame according to the mapping relationship, so that each product image moves along a respective movement path in the display frame as the display frame moves in a screen; wherein, the respective moving path of each product image is the path between the initial position and the combined position of the product image; wherein the plurality of product images are combined together when the plurality of product images are each in a respective combined position in the display frame.
Optionally, the rendering method further includes: according to the rendering configuration file, determining a mapping relation between the rendered position of each product image and the size of the product image, or determining a mapping relation between the position of the display frame relative to the screen and the size of each product image; wherein, according to the mapping relation, the step of rendering the plurality of product images in the display frame comprises the following steps: and rendering the plurality of product images in a display frame according to the mapping relation, so that each product image moves along a respective moving path in the display frame and changes the size as the display frame moves in a screen.
Optionally, the step of rendering the plurality of product images in the display frame according to the mapping relationship includes: rendering each product image in the display frame as the display frame moves up in the screen, moving along the respective path of movement to a combined position and reducing each product image; as the display frame moves downward in the screen, each product image is rendered in the display frame moving along a respective path of movement to an initial position and enlarged.
Optionally, the rendering profile includes one of: initial position information and combined position information of each product image; a moving path of each product image; and displaying the mapping relation between the position of the frame relative to the screen and the rendered position of each product image.
Optionally, the rendering profile includes one of: initial position information and combined position information of each product image; a moving path of each product image; displaying the mapping relation between the position of the frame relative to the screen and the rendered position of each product image; the rendering profile further includes one of: first size information and second size information of each product image; displaying the mapping relation between the position of the frame relative to the screen and the size of each product image; mapping of the location where each product image is rendered to the size of the product image.
Optionally, the rendering configuration file further includes: occlusion relationship between product images.
Optionally, the rendering method further includes: receiving a background image and/or an auxiliary multimedia resource, wherein the rendering profile further comprises: rendering information of the background image and/or the auxiliary multimedia resource; wherein, the rendering method further comprises: rendering the background image and/or the auxiliary multimedia resource in the display frame according to the rendering information of the background image and/or the auxiliary multimedia resource; wherein the auxiliary multimedia resource comprises at least one of: and (5) decorating images and characters.
According to a third embodiment of the present disclosure, there is provided a pushing device for multimedia resources, including: a product image acquisition unit configured to acquire a plurality of product images; a rendering information determining unit configured to determine initial position information and combined position information of each of the plurality of product images; a profile generation unit configured to generate a rendering profile based on the initial position information and the combined position information of each product image, wherein the rendering profile is used for defining a rendering manner in which each product image moves along a respective movement path in a display frame as the display frame moves in a screen; a transmitting unit configured to transmit the plurality of product images and the rendering profile to a client; wherein, the respective moving path of each product image is the path between the initial position and the combined position of the product image; wherein the plurality of product images are combined together when the plurality of product images are each in a respective combined position in the display frame.
Optionally, the rendering information determining unit is configured to: determining initial position information of each product image and first size information of each product image when the initial position information is positioned at the initial position, and combining position information and second size information of each product image when the combination position information is positioned at the combining position; wherein the profile generation unit is configured to: generating a rendering profile based on the initial position information and the first size information of each product image, and the combined position information and the second size information; the rendering configuration file is used for limiting a rendering mode that each product image moves along a respective moving path in the display frame and changes the size as the display frame moves in the screen.
Optionally, the rendering profile includes one of: initial position information and combined position information of each product image; a moving path of each product image; and displaying the mapping relation between the position of the frame relative to the screen and the rendered position of each product image.
Optionally, the rendering profile includes one of: initial position information and combined position information of each product image; a moving path of each product image; displaying the mapping relation between the position of the frame relative to the screen and the rendered position of each product image; the rendering profile further includes one of: first size information and second size information of each product image; displaying the mapping relation between the position of the frame relative to the screen and the size of each product image; mapping of the location where each product image is rendered to the size of the product image.
Optionally, the rendering configuration file further includes: occlusion relationship between product images.
Optionally, the initial positions of the plurality of product images are such that the plurality of product images are equally spaced in the display frame.
Optionally, the pushing device further includes: a background acquisition unit configured to acquire a background image for display in the same display frame as the plurality of product images and rendering information thereof; wherein the profile generation unit is configured to: generating a rendering configuration file based on the initial position information and the first size information of each product image, the combined position information and the second size information, and the rendering information of the background image; wherein the transmitting unit is configured to: and sending the plurality of product images, the background image and the rendering configuration file to a client.
Optionally, the rendering information determining unit is configured to: generating a plurality of candidate combined images according to canvas with a set size, wherein each candidate combined image is an image formed by combining a plurality of product images together on the canvas, and the positions of the product images in different candidate combined images are different; and screening the optimal combined image from the candidate combined images, and determining the combined position information and the second size information of each product image based on the positions and the sizes of the product images corresponding to the optimal combined image relative to the canvas.
Optionally, the rendering information determining unit is configured to: determining the position and the size of the canvas relative to the background image, and taking the position and the size of the canvas relative to the background image and the position and the size of each product image relative to the canvas as combined position information and second size information of each product image;
or determining the position and size of the canvas relative to the background image; determining a combined position of each product image relative to the background image and a size when in the combined position based on a position and a size of the canvas relative to the background image and a position and a size of each product image relative to the canvas; and taking the combination position of each product image relative to the background image and the size of each product image when the product image is positioned at the combination position as combination position information and second size information of each product image.
Optionally, the rendering information determining unit is configured to: generating a random starting position of the plurality of product images scaled according to a first scaling ratio in the canvas, wherein the random starting position meets a first preset condition, and the first scaling ratio is determined based on a ratio between the area of the canvas and the sum of the areas of the plurality of product images; controlling each zoomed product image to move a first preset proportion of the size of each time to the center point of the canvas until the second preset proportion of the size of each product image is retracted and the movement is stopped when at least one second preset condition is met after the product image is moved; when all the product images stop moving, scaling the whole area surrounded by the outer contours of the multiple product images after rollback according to a second scaling, and determining the whole image formed by the multiple product images at the current position after scaling according to the second scaling as a candidate combined image; wherein the second scale is determined based on a ratio between an area of the canvas and an area of the entire region.
Optionally, the rendering information determining unit is configured to: screening out the optimal combined image based on the ratio of the blank area to the central area of each candidate combined image and the distance between the height-width ratio and the fixed height-width ratio; wherein the lower the ratio of the blank area to the center area of the center area, the closer the distance between the aspect ratio and the fixed aspect ratio, the higher the likelihood that the candidate combined image is selected.
Optionally, the first preset condition includes at least one of: the random initial position of the product image with larger height-width ratio is far from the center point of the canvas; and/or the second preset condition comprises at least one of the following: the portion that must be revealed is occluded above the first proportional threshold, the occluded portion is above the second proportional threshold, overlapping the bottom of the other product image.
Alternatively, the product image is obtained by: the region where only the target product is located is cut out from the sample image as a product image, and the bottom of the product image and the part which must be displayed are marked.
Optionally, the pushing device further includes: an auxiliary information acquisition unit configured to acquire auxiliary multimedia resources and rendering information thereof; wherein the profile generation unit is configured to: generating a rendering configuration file based on the initial position information and the combined position information of each product image and the rendering information of the auxiliary multimedia resource; wherein the transmitting unit is configured to: transmitting the plurality of product images, the auxiliary multimedia resource, and the rendering profile to a client; wherein the auxiliary multimedia resource comprises at least one of: and (5) decorating images and characters.
According to a fourth embodiment of the present disclosure, there is provided a rendering apparatus of a multimedia asset, including: a receiving unit configured to receive a plurality of product images and a rendering profile for rendering the plurality of product images in the same presentation frame; a relationship determination unit configured to determine a mapping relationship between a position of the display frame with respect to the screen and a position at which each of the plurality of product images is rendered, according to the rendering profile; a rendering unit configured to render the plurality of product images in a display frame in accordance with the mapping relationship to move each product image along a respective movement path in the display frame as the display frame moves in a screen; wherein, the respective moving path of each product image is the path between the initial position and the combined position of the product image; wherein the plurality of product images are combined together when the plurality of product images are each in a respective combined position in the display frame.
Optionally, the relationship determination unit is further configured to: according to the rendering configuration file, determining a mapping relation between the rendered position of each product image and the size of the product image, or determining a mapping relation between the position of the display frame relative to the screen and the size of each product image; wherein the rendering unit is configured to: and rendering the plurality of product images in a display frame according to the mapping relation, so that each product image moves along a respective moving path in the display frame and changes the size as the display frame moves in a screen.
Optionally, the rendering unit is configured to: rendering each product image in the display frame as the display frame moves up in the screen, moving along the respective path of movement to a combined position and reducing each product image; as the display frame moves downward in the screen, each product image is rendered in the display frame moving along a respective path of movement to an initial position and enlarged.
Optionally, the rendering profile includes one of: initial position information and combined position information of each product image; a moving path of each product image; and displaying the mapping relation between the position of the frame relative to the screen and the rendered position of each product image.
Optionally, the rendering profile includes one of: initial position information and combined position information of each product image; a moving path of each product image; displaying the mapping relation between the position of the frame relative to the screen and the rendered position of each product image; the rendering profile further includes one of: first size information and second size information of each product image; displaying the mapping relation between the position of the frame relative to the screen and the size of each product image; mapping of the location where each product image is rendered to the size of the product image.
Optionally, the rendering configuration file further includes: occlusion relationship between product images.
Optionally, the receiving unit is further configured to: receiving a background image and/or an auxiliary multimedia resource, wherein the rendering profile further comprises: rendering information of the background image and/or the auxiliary multimedia resource; wherein the rendering unit is further configured to: rendering the background image and/or the auxiliary multimedia resource in the display frame according to the rendering information of the background image and/or the auxiliary multimedia resource; wherein the auxiliary multimedia resource comprises at least one of: and (5) decorating images and characters.
According to a fifth embodiment of the present disclosure, there is provided a system comprising at least one computing device and at least one storage device storing instructions, wherein the instructions, when executed by the at least one computing device, cause the at least one computing device to perform a push method of a multimedia resource as described above or a rendering method of a multimedia resource as described above.
According to a sixth embodiment of the present disclosure, there is provided a computer-readable storage medium storing instructions that, when executed by at least one computing device, cause the at least one computing device to perform a push method of a multimedia resource as described above or a rendering method of a multimedia resource as described above.
According to the pushing method of the multimedia resource and the rendering method and device of the multimedia resource, each product image can be moved and combined together along the respective moving path in the display frame (e.g. the advertisement frame) along with the movement of the display frame in the screen, so that the user experience and the final conversion rate are improved.
Additional aspects and/or advantages of the present general inventive concept will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the general inventive concept.
Drawings
The foregoing and other objects and features of exemplary embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings which illustrate the embodiments by way of example, in which:
fig. 1 illustrates a flowchart of a push method of multimedia resources according to an exemplary embodiment of the present disclosure;
FIG. 2 illustrates an example of a method of obtaining a product image according to an exemplary embodiment of the present disclosure;
fig. 3 illustrates an example of a pushing method of multimedia resources according to an exemplary embodiment of the present disclosure;
FIG. 4 illustrates a flowchart of a method of determining combined location information and second size information for each product image according to an exemplary embodiment of the present disclosure;
Fig. 5 and 6 illustrate examples of determining combined position information and second size information of each product image according to an exemplary embodiment of the present disclosure;
FIG. 7 illustrates a flowchart of a method of generating a plurality of candidate combined images according to an exemplary embodiment of the present disclosure;
fig. 8 illustrates a flowchart of a method of rendering a multimedia asset according to an exemplary embodiment of the present disclosure;
fig. 9 illustrates a rendering example of a multimedia asset according to an exemplary embodiment of the present disclosure;
fig. 10 illustrates a block diagram of a push device for multimedia resources according to an exemplary embodiment of the present disclosure;
fig. 11 illustrates a block diagram of a structure of a rendering device of a multimedia asset according to an exemplary embodiment of the present disclosure.
Detailed Description
Reference will now be made in detail to embodiments of the present disclosure, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout. The embodiments will be described below in order to explain the present disclosure by referring to the figures.
Fig. 1 illustrates a flowchart of a push method of multimedia resources according to an exemplary embodiment of the present disclosure. By way of example only, the push method may be performed by a server (e.g., a server-side of an application).
Referring to fig. 1, in step S101, a plurality of product images are acquired.
As an example, at least one product may be included in each product image, and when only one product is included in the product image, the product image is a single product image.
As an example, one or more products may be included in each product image, e.g., multiple identical products may be included.
As an example, the plurality of product images may include different products.
As an example, the plurality of product images that need to be recommended to the user may be screened from a product image library according to the characteristics of the user. For example, after a refresh request of a user is received, an initial material set is obtained by using each recall strategy corresponding to the current scene, a product image set to be pushed is obtained after coarse arrangement or coarse arrangement and fine arrangement, and then a product image in the product image set to be pushed is combined and recommended by using the pushing method in the disclosure.
As an example, the pushing method according to the exemplary embodiment of the present disclosure may further include: a background image is obtained from a background library for presentation with the plurality of product images in the same presentation frame (e.g., advertising frame).
As an example, the pushing method according to the exemplary embodiment of the present disclosure may further include: other auxiliary multimedia assets are acquired for display with the plurality of product images in the same display frame (e.g., advertising frame).
As an example, the other auxiliary multimedia resources may include, but are not limited to, at least one of: and (5) decorating images and characters.
As an example, the product image may be obtained by: the region where only the target product is located is cut out from the sample image as a product image, and the bottom of the product image and the part which must be displayed are marked. For example, the lower specific scale portion (e.g., the lower 1/3 portion) of the entire product image may be considered the bottom.
Fig. 2 illustrates an example of a method of obtaining a product image according to an exemplary embodiment of the present disclosure.
As shown in fig. 2, the sample image may be subjected to data preprocessing to obtain a product image and its marking information. For example, each sample image may be background-removed (e.g., jpeg is converted to png to transparentize the background) and then the excess background is cropped to form the product image. The background is removed so as to be combined with other product images without being blocked by the background of each other; the extra background is cut to compress the image boundary to the outer contour (bounding_box) of the product for subsequent computation. In addition, the method can further comprise the operations of generating a bottom_mask and generating a show_mask, wherein the bottom_mask and the show_mask are two-dimensional marks, and the bottom_mask is on a product image and marks the bottom of the product; the show mask marks the part of the product which is needed to be displayed on the product image, so as to prevent the short product from being completely shielded by the tall product. The bottom_mask and the show_mask may be used for step S102, and the usage method will be described later in detail.
In step S102, initial position information and combined position information of each of the plurality of product images are determined.
As an example, the initial position information and the combined position information of each product image may be: the information (e.g., coordinate description) for directly describing the specific initial position and specific combined position of each product image in the display frame may also be information for indirectly describing the initial position and combined position of each product image in the display frame, for example, the initial position and combined position of each product image with respect to the background image displayed together.
In step S103, a rendering profile is generated based on the initial position information and the combined position information of each product image, wherein the rendering profile is used to define a rendering manner in which each product image moves along a respective movement path in a display frame as the display frame moves in a screen.
The respective movement path of each product image is the path between the initial position and the combined position of the product image. The plurality of product images are combined together when the plurality of product images are each in a respective combined position in the display frame.
It should be appreciated that the initial positions of the different product images are different and the combined positions of the different product images are different.
As an example, the initial positions of the plurality of product images may be such that the plurality of product images are equally spaced in the display frame. For example, the initial positions of the plurality of product images may be such that the plurality of product images are equally spaced from top to bottom starting from the top of the display frame. It should be understood that other arrangements are possible, and the present disclosure is not limited in this regard.
As an example, various suitable combining logic may be used to determine the respective combining locations of the plurality of product images such that the combined images are aesthetically pleasing, aggregate, and see-through when the plurality of product images are in the respective combining locations in the same display frame.
In one embodiment, 3D modeling may be performed for each product image, and conflicts between product images are determined in three-dimensional space as the plurality of product images are brought together.
Considering that the 3D modeling calculation is large for each product image, in another embodiment, two-dimensional labels of the bottom_mask and the show_mask of each product image may be used to approximate the conflicts in the 3D scene in cooperation with the two-dimensional product images. This will be illustrated in connection with fig. 3.
As an example, the step of determining initial position information and combined position information for each of the plurality of product images may include: initial position information of each product image and first size information thereof in an initial position, combined position information and second size information thereof in a combined position are determined. As an example, a rendering profile may be generated based on the initial position information and the first size information, and the combined position information and the second size information of each product image; wherein the rendering profile is used to define a rendering manner in which each product image is moved and resized (e.g., enlarged or reduced) along a respective path of movement in the display frame as the display frame is moved in the screen. For example, the second dimension may be smaller than the first dimension.
As an example, the pushing method according to the exemplary embodiment of the present disclosure may further include: occlusion relationships (also understood as rendering order) between the product images are determined. For example, the post-rendered product image allows occlusion of the pre-rendered product image. As an example, a rendering profile may be generated based on the initial position information and the combined position information of each product image, the occlusion relationship between the product images, to satisfy the defined occlusion relationship when rendering the product images.
As an example, the rendering profile may be a json file.
As an example, the rendering profile may include one of: initial position information and combined position information of each product image; a moving path of each product image; and displaying the mapping relation between the position of the frame relative to the screen and the rendered position of each product image.
As an example, the rendering profile may further include: occlusion relationship between product images.
As an example, the rendering profile may further include: first size information and second size information of each product image; displaying the mapping relation between the position of the frame relative to the screen and the size of each product image; mapping of the location where each product image is rendered to the size of the product image.
Further, as an example, the rendering profile may further include: rendering information of the background image and/or rendering information of other auxiliary multimedia resources. For example, the rendering information may include, but is not limited to: rendering location and/or rendering style. Accordingly, the pushing method according to the exemplary embodiment of the present disclosure may further include: rendering information of the background image and/or rendering information of other auxiliary multimedia resources is determined.
It should be appreciated that the rendering configuration file may also include other content for defining a rendering manner of the display object, which is not limited by the present disclosure.
As an example, the pushing method according to the exemplary embodiment of the present disclosure may further include: a respective path of movement for each product image is determined. For example, the shape (e.g., straight line or arc) of the moving path of each product image may be set, or the moving path of each product image may be determined based on a principle of avoiding mutual occlusion between product images during movement as much as possible.
In step S104, the plurality of product images and the rendering profile are sent to a client. So that the client renders each product image to move along the respective movement path as the presentation frame moves in the screen of the client according to the rendering profile.
As an example, the background image and/or other auxiliary multimedia resources may also be sent to the client.
As shown in fig. 3, the background image selection, the product image selection, the auxiliary information selection may be performed first, then the rendering positions of various materials are determined, and particularly for the product image, the initial position information and the combined position information need to be determined, and a rendering configuration file is generated based on the rendering positions required by the various materials and provided to the client.
Fig. 4 illustrates a flowchart of a method of determining combined location information and second size information of each product image according to an exemplary embodiment of the present disclosure.
Referring to fig. 4 in combination with fig. 5 and 6, in step S201, a plurality of candidate combined images are generated according to a canvas of a set size, wherein each candidate combined image is an image formed by combining the plurality of product images together on the canvas, and positions of the plurality of product images in different candidate combined images are different.
As an example, the set size may relate to the size of the background image.
Fig. 7 shows an exemplary embodiment of step S201.
Referring to fig. 7, at step S301, a random starting position is generated in the canvas at which the plurality of product images scaled at a first scaling ratio determined based on a ratio between an area of the canvas and a sum of areas of the plurality of product images satisfies a first preset condition. So that all product images can be "laid out" onto the canvas.
As an example, the set size may relate to an overall desired size of the plurality of product images combined together when each is in a combined position. For example, all product images are uniformly scaled according to the canvas area A and the sum of areas B of the plurality of product images, the scaling is A/B×0.8, it should be understood that the coefficient 0.8 can be adjusted according to practical situations.
As an example, the first preset condition may include at least one of: the random starting position of the product images which are not overlapped with each other and have larger height-to-width ratio is farther from the center point of the canvas.
As an example, all product images may be randomly placed on the canvas, and the rules for random placement may include, but are not limited to, that the individual product images do not overlap each other and that product images with high aspect ratios are more prone to be placed behind.
For example, the further a random starting location of a product image is from the center point of the canvas may refer to the further a lower boundary of the product image (e.g., a lower boundary of a non-product shadow portion in the product image) is from the center point.
In step S302, each scaled product image is controlled to move a first preset proportion of its own size to the center point of the canvas each time until the product image after being moved meets at least one second preset condition, and the movement is stopped after the second preset proportion of its own size is retracted.
It should be appreciated that the starting point of the first movement of each product image is its corresponding random initial position.
As an example, the self-size here may be a small value in the width and height of the scaled product image.
In addition, it should be noted that: the movement of each product image in the canvas may not be the same proportion at the same time, for example, some product images have reached the vicinity of the center point of the canvas, and the rollback trimming is performed because the second preset condition is satisfied, but there may be cases where some product images are rollback or stopped moving and some product images are advancing because the individual product images have not reached the vicinity of the center point yet because of the small moving step.
It should be understood that rollback herein refers to returning along the path of the moving track.
As an example, the second preset condition may include, but is not limited to, at least one of: the portion that must be revealed is occluded above a first scale threshold, the occluded proportion exceeds a second scale threshold, or overlaps with the bottom of other product images.
As an example, the occlusion relationship between product images may be: the higher the lower boundary nadir, the lower the priority that the overlapping portion of the product image and other product images is not blocked.
In practice, step S302 is to move the scaled product image to the canvas center point according to the first preset proportion (e.g. 10%) of its own size, if it is judged that there is a conflict, then the second preset proportion (e.g. 5%) of its own size is retracted and stopped, otherwise, the movement to the canvas center point according to the first preset proportion of its own size is continued. For example, the first preset ratio may be greater than the second preset ratio.
The conflict judgment mode comprises the following steps: the bottom_mask of all the product images cannot be overlapped; the show mask area of each product image cannot be occluded beyond a first scale threshold (e.g., 5%), and the total area of each product image cannot be occluded beyond a second scale threshold (e.g., 90%).
In other words, in connection with fig. 6, according to step S302, by moving aggregation and collision judgment, each product image is gradually made more compact, and when collision judgment confirmation is no longer more compact, the movement is rolled back and stopped.
In step S303, when all the product images have stopped moving, the entire area surrounded by the outer contours of the plurality of product images after the rollback is scaled according to the second scaling, and the entire image (i.e., the portion surrounded by the outer contours) formed by the plurality of product images after the scaling according to the second scaling together at the current position is determined as one candidate combined image. A second scale is determined based on a ratio between an area of the canvas and an area of the entire region.
The whole area surrounded by the outer contours of the multiple product images after the back-off is subjected to zoom fine adjustment, so that the canvas size can be more adapted. For example, the scaling may be performed according to the canvas area a and the whole area C surrounded by the outer contours of the retracted product images, and the second scaling may be a/c×0.8, and it should be understood that the coefficient 0.8 may be adjusted according to practical situations.
Returning to fig. 4, in step S202, an optimal combined image is selected from the plurality of candidate combined images, and based on the positions and sizes of the plurality of product images corresponding to the optimal combined image with respect to the canvas, the combined position information and the second size information of each product image are determined.
In one embodiment, the position and size of the canvas relative to the background image may be determined and the position and size of the canvas relative to the background image, and the position and size of each product image relative to the canvas, may be used as the combined position information and second size information for each product image. When the product images are rendered, the combined position and the second size of each product image in the display frame can be correspondingly determined according to the actual display position and the actual display size of the background image in the display frame.
For example, the position and size of the canvas relative to the background image, i.e., the overall position and overall size that ultimately requires the multiple product images to be combined together.
In another embodiment, the position and size of the canvas relative to the background image may be determined; determining a combined position of each product image relative to the background image and a size when in the combined position based on a position and a size of the canvas relative to the background image and a position and a size of each product image relative to the canvas; then, a combination position of each product image with respect to the background image and a size at the combination position are taken as combination position information and second size information of each product image.
As an example, the step of screening the optimal combined image from the plurality of candidate combined images may include: screening out the optimal combined image based on the ratio of the blank area to the central area of each candidate combined image and the distance between the height-width ratio and the fixed height-width ratio; wherein the lower the ratio of the blank area to the center area of the center area, the closer the distance between the aspect ratio and the fixed aspect ratio, the higher the likelihood that the candidate combined image is selected. The goal is to have the final screened combined image have less intermediate space and as much as possible match the target aspect ratio.
For example, a first score for each candidate combined image may be obtained from a ratio of a blank area to a center area of each candidate combined image; obtaining a second score of each candidate combined image according to the distance between the height-width ratio of each candidate combined image and the fixed height-width ratio; and then obtaining the total score of each candidate combined image according to the first score and the second score (for example, weighted summation) of each candidate combined image, and taking the candidate combined image with the highest total score as the optimal combined image.
As an example, the center region and the non-center region of the image may be divided according to a preset standard, which is not limited by the present disclosure.
Fig. 8 illustrates a flowchart of a method of rendering a multimedia asset according to an exemplary embodiment of the present disclosure. For example only, the rendering method may be performed by a client (e.g., a client of an application).
Referring to fig. 8, in step S401, a plurality of product images and a rendering profile for rendering the plurality of product images in the same presentation frame are received.
In step S402, a mapping relationship between a position of the display frame relative to the screen and a position where each of the plurality of product images is rendered is determined according to the rendering configuration file.
In step S403, the plurality of product images are rendered in the display frame according to the mapping relationship, so that each product image moves along a respective movement path in the display frame as the display frame moves in the screen.
Wherein, the respective moving path of each product image is the path between the initial position and the combined position of the product image; wherein the plurality of product images are combined together when the plurality of product images are each in a respective combined position in the display frame.
As an example, the rendering method may further include: and according to the rendering configuration file, determining a mapping relation between the rendered position of each product image and the size of the product image, or determining a mapping relation between the position of the display frame relative to the screen and the size of each product image. Accordingly, as an example, step S403 may include: and rendering the plurality of product images in a display frame according to the mapping relation, so that each product image moves along a respective moving path in the display frame and changes the size as the display frame moves in a screen.
As an example, step S403 may include: rendering each product image in the display frame as the display frame moves up in the screen, moving along the respective path of movement to a combined position and reducing each product image; as the display frame moves downward in the screen, each product image is rendered in the display frame moving along a respective path of movement to an initial position and enlarged.
As an example, the rendering profile may include one of: initial position information and combined position information of each product image; a moving path of each product image; and displaying the mapping relation between the position of the frame relative to the screen and the rendered position of each product image.
As an example, the rendering profile may include one of: initial position information and combined position information of each product image; a moving path of each product image; displaying the mapping relation between the position of the frame relative to the screen and the rendered position of each product image; the rendering profile may also include one of: first size information and second size information of each product image; displaying the mapping relation between the position of the frame relative to the screen and the size of each product image; mapping of the location where each product image is rendered to the size of the product image.
As an example, the rendering profile may further include: occlusion relationship between product images.
As an example, the rendering method may further include: a background image and/or an auxiliary multimedia asset, wherein the rendering profile may further comprise: the background image and/or rendering information of the auxiliary multimedia asset. The rendering method may further include: and rendering the background image and/or the auxiliary multimedia resource in the display frame according to the rendering information of the background image and/or the auxiliary multimedia resource. For example, the auxiliary multimedia resource may include at least one of: and (5) decorating images and characters.
As an example, when the initial position information and the first size information, the combined position information and the second size information of each product image include: the position and size of the canvas for the combined image with respect to the background image, and the position and size of each product image with respect to the canvas, the initial position of each product image with respect to the background image, and the size at the initial position, or when the initial position information and the first size information, the combined position information, and the second size information of each product image include: when the combination position and the size at the combination position of each product image with respect to the background image, the initial position and the size at the initial position of each product image with respect to the background image, step S402 may include: determining the actual display position and the actual display size of the background image in the display frame according to the rendering information of the background image, and determining the initial position and the first size, the combined position and the second size of each product image in the display frame according to the actual display position and the actual display size of the background image and the initial position information and the first size information, the combined position information and the second size information of each product image; then, based on the initial position and the first size of each product image in the display frame, the combined position and the second size, the mapping relation between the position of the display frame relative to the screen and the rendered position and size of each product image is determined, and each product image is rendered according to the mapping relation corresponding to each product image so as to move along the respective moving path and change the size in the display frame along with the movement of the display frame in the screen.
Fig. 9 illustrates a rendering example of a multimedia asset according to an exemplary embodiment of the present disclosure. As shown in fig. 9, as the screen is slid upward such that the position of the display frame relative to the screen changes, accordingly, food in the display frame reaches the combined position from the initial position to generate a package, and the slid-back food moves in a reverse direction, in accordance with an embodiment of the present disclosure. For example, the product image starts to move relative to the display frame position when the top of the display frame appears at the bottom of the screen, and reaches the combined position until the bottom of the display frame appears completely in the screen, displaying the final package effect.
Fig. 10 shows a block diagram of a push device for multimedia resources according to an exemplary embodiment of the present disclosure.
As shown in fig. 10, a pushing device for multimedia resources according to an exemplary embodiment of the present disclosure includes: a product image acquisition unit 101, a rendering information determination unit 102, a profile generation unit 103, and a transmission unit 104.
Specifically, the product image acquisition unit 101 is configured to acquire a plurality of product images.
The rendering information determining unit 102 is configured to determine initial position information and combined position information of each of the plurality of product images.
The profile generation unit 103 is configured to generate a rendering profile for defining a rendering manner in which each product image is moved along a respective movement path in a display frame as the display frame is moved in a screen, based on the initial position information and the combined position information of each product image.
The sending unit 104 is configured to send the plurality of product images and the rendering profile to a client.
The respective moving path of each product image is a path between the initial position and the combined position of the product image; wherein the plurality of product images are combined together when the plurality of product images are each in a respective combined position in the display frame.
As an example, the rendering information determination unit 102 may be configured to: determining initial position information of each product image and first size information of each product image when the initial position information is positioned at the initial position, and combining position information and second size information of each product image when the combination position information is positioned at the combining position; wherein the profile generation unit is configured to: generating a rendering profile based on the initial position information and the first size information of each product image, and the combined position information and the second size information; the rendering configuration file is used for limiting a rendering mode that each product image moves along a respective moving path in the display frame and changes the size as the display frame moves in the screen.
As an example, the rendering profile may include one of: initial position information and combined position information of each product image; a moving path of each product image; and displaying the mapping relation between the position of the frame relative to the screen and the rendered position of each product image.
As an example, the rendering profile may include one of: initial position information and combined position information of each product image; a moving path of each product image; displaying the mapping relation between the position of the frame relative to the screen and the rendered position of each product image; the rendering profile further includes one of: first size information and second size information of each product image; displaying the mapping relation between the position of the frame relative to the screen and the size of each product image; mapping of the location where each product image is rendered to the size of the product image.
As an example, the rendering profile may further include: occlusion relationship between product images.
As an example, the initial positions of the plurality of product images may be such that the plurality of product images are equally spaced in the display frame.
As an example, the pushing device may further include: a background acquisition unit (not shown) configured to acquire a background image for presentation in the same presentation frame as the plurality of product images and rendering information thereof; wherein the profile generation unit 103 may be configured to: generating a rendering configuration file based on the initial position information and the first size information of each product image, the combined position information and the second size information, and the rendering information of the background image; wherein the sending unit 104 may be configured to: and sending the plurality of product images, the background image and the rendering configuration file to a client.
As an example, the rendering information determination unit 102 may be configured to: generating a plurality of candidate combined images according to canvas with a set size, wherein each candidate combined image is an image formed by combining a plurality of product images together on the canvas, and the positions of the product images in different candidate combined images are different; and screening the optimal combined image from the candidate combined images, and determining the combined position information and the second size information of each product image based on the positions and the sizes of the product images corresponding to the optimal combined image relative to the canvas.
As an example, the rendering information determination unit 102 may be configured to: determining the position and the size of the canvas relative to the background image, and taking the position and the size of the canvas relative to the background image and the position and the size of each product image relative to the canvas as combined position information and second size information of each product image;
or determining the position and size of the canvas relative to the background image; determining a combined position of each product image relative to the background image and a size when in the combined position based on a position and a size of the canvas relative to the background image and a position and a size of each product image relative to the canvas; and taking the combination position of each product image relative to the background image and the size of each product image when the product image is positioned at the combination position as combination position information and second size information of each product image.
As an example, the rendering information determination unit 102 may be configured to: generating a random starting position of the plurality of product images scaled according to a first scaling ratio in the canvas, wherein the random starting position meets a first preset condition, and the first scaling ratio is determined based on a ratio between the area of the canvas and the sum of the areas of the plurality of product images; controlling each zoomed product image to move a first preset proportion of the size of each time to the center point of the canvas until the second preset proportion of the size of each product image is retracted and the movement is stopped when at least one second preset condition is met after the product image is moved; when all the product images stop moving, scaling the whole area surrounded by the outer contours of the multiple product images after rollback according to a second scaling, and determining the whole image formed by the multiple product images at the current position after scaling according to the second scaling as a candidate combined image; wherein the second scale is determined based on a ratio between an area of the canvas and an area of the entire region.
As an example, the rendering information determination unit 102 may be configured to: screening out the optimal combined image based on the ratio of the blank area to the central area of each candidate combined image and the distance between the height-width ratio and the fixed height-width ratio; wherein the lower the ratio of the blank area to the center area of the center area, the closer the distance between the aspect ratio and the fixed aspect ratio, the higher the likelihood that the candidate combined image is selected.
As an example, the first preset condition may include at least one of: the random initial position of the product image with larger height-width ratio is far from the center point of the canvas; and/or the second preset condition may include at least one of: the portion that must be revealed is occluded above the first proportional threshold, the occluded portion is above the second proportional threshold, overlapping the bottom of the other product image.
As an example, the product image may be obtained by: the region where only the target product is located is cut out from the sample image as a product image, and the bottom of the product image and the part which must be displayed are marked.
As an example, the pushing device may further include: an auxiliary information acquisition unit (not shown) configured to acquire auxiliary multimedia resources and rendering information thereof; wherein the profile generation unit 103 may be configured to: generating a rendering configuration file based on the initial position information and the combined position information of each product image and the rendering information of the auxiliary multimedia resource; wherein the sending unit 104 may be configured to: transmitting the plurality of product images, the auxiliary multimedia resource, and the rendering profile to a client; wherein the auxiliary multimedia resource comprises at least one of: and (5) decorating images and characters.
Fig. 11 illustrates a block diagram of a structure of a rendering device of a multimedia asset according to an exemplary embodiment of the present disclosure.
As shown in fig. 11, a rendering apparatus of a multimedia asset according to an exemplary embodiment of the present disclosure includes: a receiving unit 201, a relation determining unit 202, a rendering unit 203.
Specifically, the receiving unit 201 is configured to receive a plurality of product images and a rendering profile for rendering the plurality of product images in the same presentation frame.
The relation determination unit 202 is configured to determine a mapping relation of a position of the presentation frame relative to the screen and a position where each of the plurality of product images is rendered, according to the rendering profile.
The rendering unit 203 is configured to render the plurality of product images in the display frame in accordance with the mapping relationship to move each product image along a respective movement path in the display frame as the display frame moves in the screen.
The respective moving path of each product image is a path between the initial position and the combined position of the product image; wherein the plurality of product images are combined together when the plurality of product images are each in a respective combined position in the display frame.
As an example, the relationship determination unit 202 may be further configured to: according to the rendering configuration file, determining a mapping relation between the rendered position of each product image and the size of the product image, or determining a mapping relation between the position of the display frame relative to the screen and the size of each product image; wherein the rendering unit 203 may be configured to: and rendering the plurality of product images in a display frame according to the mapping relation, so that each product image moves along a respective moving path in the display frame and changes the size as the display frame moves in a screen.
As an example, the rendering unit 203 may be configured to: rendering each product image in the display frame as the display frame moves up in the screen, moving along the respective path of movement to a combined position and reducing each product image; as the display frame moves downward in the screen, each product image is rendered in the display frame moving along a respective path of movement to an initial position and enlarged.
As an example, the rendering profile may include one of: initial position information and combined position information of each product image; a moving path of each product image; and displaying the mapping relation between the position of the frame relative to the screen and the rendered position of each product image.
As an example, the rendering profile may include one of: initial position information and combined position information of each product image; a moving path of each product image; displaying the mapping relation between the position of the frame relative to the screen and the rendered position of each product image; the rendering profile further includes one of: first size information and second size information of each product image; displaying the mapping relation between the position of the frame relative to the screen and the size of each product image; mapping of the location where each product image is rendered to the size of the product image.
As an example, the rendering profile may further include: occlusion relationship between product images.
As an example, the receiving unit 201 may be further configured to: receiving a background image and/or an auxiliary multimedia asset, wherein the rendering profile may further comprise: rendering information of the background image and/or the auxiliary multimedia resource; wherein the rendering unit 203 may be further configured to: rendering the background image and/or the auxiliary multimedia resource in the display frame according to the rendering information of the background image and/or the auxiliary multimedia resource; wherein the auxiliary multimedia resource comprises at least one of: and (5) decorating images and characters.
It should be understood that the specific implementation manner of the pushing device for multimedia resources and the rendering device for multimedia resources according to the exemplary embodiments of the present disclosure may be implemented with reference to the related specific implementation manner described in connection with fig. 1 to 9, and will not be described herein.
The units included in the pushing device of the multimedia resource and the rendering device of the multimedia resource according to the exemplary embodiments of the present disclosure may be configured as software, hardware, firmware, or any combination thereof, respectively, that perform specific functions. For example, these units may correspond to application specific integrated circuits, to pure software code, or to modules of software in combination with hardware. Furthermore, one or more functions implemented by these units may also be performed uniformly by components in a physical entity device (e.g., a processor, a client, a server, or the like).
It should be understood that the pushing method of the multimedia asset according to the exemplary embodiment of the present disclosure may be implemented by a program recorded on a computer readable medium, for example, according to the exemplary embodiment of the present disclosure, a computer readable medium for pushing the multimedia asset may be provided, wherein a computer program for executing the pushing method of the multimedia asset as described in the above exemplary embodiment is recorded on the computer readable medium.
It should be understood that the method of rendering a multimedia asset according to an exemplary embodiment of the present disclosure may be implemented by a program recorded on a computer readable medium, for example, according to an exemplary embodiment of the present disclosure, a computer readable medium for rendering a multimedia asset may be provided, in which a computer program for executing the method of rendering a multimedia asset as described in the above exemplary embodiment is recorded on the computer readable medium.
The computer program in the above-described computer readable medium may be run in an environment deployed in a computer device such as a client, a host, a proxy device, a server, etc., and it should be noted that the computer program may also be used to perform additional steps other than the above-described steps or to perform more specific processes when the above-described steps are performed, and the contents of these additional steps and further processes have been described with reference to fig. 1 to 9, and will not be repeated here.
It should be noted that the pushing device of the multimedia resource and the rendering device of the multimedia resource according to the exemplary embodiments of the present disclosure may completely rely on the execution of the computer program to implement the corresponding functions, i.e., each unit corresponds to each step in the functional architecture of the computer program, so that the entire system is called through a special software package (e.g., lib library) to implement the corresponding functions.
On the other hand, each unit included in the pushing device of the multimedia resource and the rendering device of the multimedia resource according to the exemplary embodiments of the present disclosure may also be implemented by hardware, software, firmware, middleware, microcode, or any combination thereof. When implemented in software, firmware, middleware or microcode, the program code or code segments to perform the corresponding operations may be stored in a computer-readable medium, such as a storage medium, so that the processor can perform the corresponding operations by reading and executing the corresponding program code or code segments.
For example, exemplary embodiments of the present disclosure may also be implemented as a computing device including a storage unit and a processor, the storage unit having stored therein a set of computer-executable instructions that, when executed by the processor, perform the pushing method of multimedia resources or the rendering method of multimedia resources as described in the above exemplary embodiments.
In particular, the computing devices may be deployed in servers or clients, as well as on node devices in a distributed network environment. Further, the computing device may be a PC computer, tablet device, personal digital assistant, smart phone, web application, or other device capable of executing the above-described set of instructions.
Here, the computing device need not be a single computing device, but may be any device or collection of circuits capable of executing the above-described instructions (or instruction set) alone or in combination. The computing device may also be part of an integrated control system or system manager, or may be configured as a portable electronic device that interfaces with locally or remotely (e.g., via wireless transmission).
In the computing device, the processor may include a Central Processing Unit (CPU), a Graphics Processor (GPU), a programmable logic device, a special purpose processor system, a microcontroller, or a microprocessor. By way of example, and not limitation, processors may also include analog processors, digital processors, microprocessors, multi-core processors, processor arrays, network processors, and the like.
Some operations described in the pushing method of the multimedia resource and the rendering method of the multimedia resource according to the exemplary embodiments of the present disclosure may be implemented in a software manner, some operations may be implemented in a hardware manner, and furthermore, the operations may be implemented in a combination of software and hardware.
The processor may execute instructions or code stored in one of the storage components, wherein the storage component may also store data. Instructions and data may also be transmitted and received over a network via a network interface device, which may employ any known transmission protocol.
The memory component may be integrated with the processor, for example, RAM or flash memory disposed within an integrated circuit microprocessor or the like. Further, the storage component may comprise a stand-alone device, such as an external disk drive, a storage array, or any other storage device usable by a database system. The storage component and the processor may be operatively coupled or may communicate with each other, such as through an I/O port, network connection, etc., such that the processor is able to read files stored in the storage component.
In addition, the computing device may also include a video display (such as a liquid crystal display) and a user interaction interface (such as a keyboard, mouse, touch input device, etc.). All components of the computing device may be connected to each other via buses and/or networks.
Operations involved in a pushing method of a multimedia asset and a rendering method of a multimedia asset according to exemplary embodiments of the present disclosure may be described as various interconnected or coupled functional blocks or functional diagrams. However, these functional blocks or functional diagrams may be equally integrated into a single logic device or operate at non-exact boundaries.
For example, as described above, a computing device for pushing a multimedia resource according to an exemplary embodiment of the present disclosure may include a storage unit and a processor, wherein the storage unit stores a set of computer-executable instructions that, when executed by the processor, perform the method of pushing a multimedia resource as described in the above exemplary embodiment.
For example, as described above, a computing device for rendering of multimedia assets according to an exemplary embodiment of the present disclosure may include a storage unit and a processor, wherein the storage unit stores a set of computer-executable instructions that, when executed by the processor, perform the method of rendering multimedia assets as described in the above exemplary embodiment.
The foregoing description of exemplary embodiments of the present disclosure has been presented only to be understood as illustrative and not exhaustive, and the present disclosure is not limited to the exemplary embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the disclosure. Accordingly, the scope of the present disclosure should be determined by the scope of the claims.

Claims (10)

1. A pushing method of multimedia resources comprises the following steps:
acquiring a plurality of product images;
determining initial position information and combined position information for each of the plurality of product images;
generating a rendering profile based on the initial position information and the combined position information of each product image, wherein the rendering profile is used for limiting a rendering mode that each product image moves along a respective moving path in a display frame along with the movement of the display frame in a screen;
Transmitting the plurality of product images and the rendering profile to a client;
wherein, the respective moving path of each product image is the path between the initial position and the combined position of the product image;
wherein the plurality of product images are combined together when the plurality of product images are each in a respective combined position in the display frame.
2. The pushing method of claim 1, wherein determining initial position information and combining position information for each of the plurality of product images comprises: determining initial position information of each product image and first size information of each product image when the initial position information is positioned at the initial position, and combining position information and second size information of each product image when the combination position information is positioned at the combining position;
wherein the step of generating a rendering profile based on the initial position information and the combined position information of each product image includes: generating a rendering profile based on the initial position information and the first size information of each product image, and the combined position information and the second size information;
the rendering configuration file is used for limiting a rendering mode that each product image moves along a respective moving path in the display frame and changes the size as the display frame moves in the screen.
3. The push method of claim 1, wherein the rendering profile comprises one of: initial position information and combined position information of each product image; a moving path of each product image; and displaying the mapping relation between the position of the frame relative to the screen and the rendered position of each product image.
4. A method of rendering a multimedia asset, comprising:
receiving a plurality of product images and a rendering configuration file for rendering the plurality of product images in the same display frame;
determining a mapping relation between the position of the display frame relative to the screen and the position where each of the plurality of product images is rendered according to the rendering configuration file;
rendering the plurality of product images in a display frame according to the mapping relationship, so that each product image moves along a respective movement path in the display frame as the display frame moves in a screen;
wherein, the respective moving path of each product image is the path between the initial position and the combined position of the product image;
wherein the plurality of product images are combined together when the plurality of product images are each in a respective combined position in the display frame.
5. The rendering method of claim 4, wherein the rendering method further comprises: according to the rendering configuration file, determining a mapping relation between the rendered position of each product image and the size of the product image, or determining a mapping relation between the position of the display frame relative to the screen and the size of each product image;
wherein, according to the mapping relation, the step of rendering the plurality of product images in the display frame comprises the following steps: and rendering the plurality of product images in a display frame according to the mapping relation, so that each product image moves along a respective moving path in the display frame and changes the size as the display frame moves in a screen.
6. The rendering method of claim 5, wherein the step of rendering the plurality of product images in the presentation frame according to the mapping relationship comprises:
rendering each product image in the display frame as the display frame moves up in the screen, moving along the respective path of movement to a combined position and reducing each product image;
as the display frame moves downward in the screen, each product image is rendered in the display frame moving along a respective path of movement to an initial position and enlarged.
7. A push device for multimedia resources, comprising:
a product image acquisition unit configured to acquire a plurality of product images;
a rendering information determining unit configured to determine initial position information and combined position information of each of the plurality of product images;
a profile generation unit configured to generate a rendering profile based on the initial position information and the combined position information of each product image, wherein the rendering profile is used for defining a rendering manner in which each product image moves along a respective movement path in a display frame as the display frame moves in a screen;
a transmitting unit configured to transmit the plurality of product images and the rendering profile to a client;
wherein, the respective moving path of each product image is the path between the initial position and the combined position of the product image;
wherein the plurality of product images are combined together when the plurality of product images are each in a respective combined position in the display frame.
8. A rendering device for multimedia resources, comprising:
a receiving unit configured to receive a plurality of product images and a rendering profile for rendering the plurality of product images in the same presentation frame;
A relationship determination unit configured to determine a mapping relationship between a position of the display frame with respect to the screen and a position at which each of the plurality of product images is rendered, according to the rendering profile;
a rendering unit configured to render the plurality of product images in a display frame in accordance with the mapping relationship to move each product image along a respective movement path in the display frame as the display frame moves in a screen;
wherein, the respective moving path of each product image is the path between the initial position and the combined position of the product image;
wherein the plurality of product images are combined together when the plurality of product images are each in a respective combined position in the display frame.
9. A system comprising at least one computing device and at least one storage device storing instructions that, when executed by the at least one computing device, cause the at least one computing device to perform the push method of a multimedia asset as claimed in any one of claims 1 to 3 or the rendering method of a multimedia asset as claimed in any one of claims 4 to 6.
10. A computer readable storage medium storing instructions which, when executed by at least one computing device, cause the at least one computing device to perform the push method of a multimedia resource as claimed in any one of claims 1 to 3 or the rendering method of a multimedia resource as claimed in any one of claims 4 to 6.
CN202111672689.9A 2021-12-31 2021-12-31 Multimedia resource pushing method, multimedia resource rendering method and device Pending CN116419007A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111672689.9A CN116419007A (en) 2021-12-31 2021-12-31 Multimedia resource pushing method, multimedia resource rendering method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111672689.9A CN116419007A (en) 2021-12-31 2021-12-31 Multimedia resource pushing method, multimedia resource rendering method and device

Publications (1)

Publication Number Publication Date
CN116419007A true CN116419007A (en) 2023-07-11

Family

ID=87056866

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111672689.9A Pending CN116419007A (en) 2021-12-31 2021-12-31 Multimedia resource pushing method, multimedia resource rendering method and device

Country Status (1)

Country Link
CN (1) CN116419007A (en)

Similar Documents

Publication Publication Date Title
US9852544B2 (en) Methods and systems for providing a preloader animation for image viewers
US20170372526A1 (en) Determining space to display content in augmented reality
US9240070B2 (en) Methods and systems for viewing dynamic high-resolution 3D imagery over a network
CN110555795A (en) High resolution style migration
CN106575158B (en) Environment mapping virtualization mechanism
EP2787487A1 (en) Method of object customization by high-speed and realistic 3D rendering through web pages
US11120197B2 (en) Optimized rendering of shared documents on client devices with document raster representations
US9224238B2 (en) Seamless texturing of 3D meshes of objects from multiple views
US20170329502A1 (en) Method and device for processing image
US11651556B2 (en) Virtual exhibition space providing method for efficient data management
US11314400B2 (en) Unified digital content selection system for vector and raster graphics
US11250643B2 (en) Method of providing virtual exhibition space using 2.5-dimensionalization
CN110262763B (en) Augmented reality-based display method and apparatus, storage medium, and electronic device
WO2019055096A2 (en) Three-dimensional graphics image processing
US10403040B2 (en) Vector graphics rendering techniques
WO2019088865A1 (en) Method and system for removing hidden surfaces from a three-dimensional scene
US20210150000A1 (en) Dual mode post processing
CN116419007A (en) Multimedia resource pushing method, multimedia resource rendering method and device
CN114913277A (en) Method, device, equipment and medium for three-dimensional interactive display of object
CN113992679A (en) Automobile image display method, system and equipment
CN111047666B (en) Unified digital content selection system for vector graphics and grid graphics
AU2019213404B2 (en) Unified selection model for vector and raster graphics
CN107742314B (en) Image generation method, device and equipment
US20140237403A1 (en) User terminal and method of displaying image thereof
CN117808948A (en) End cloud hybrid rendering method, system, device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination