JPWO2022125127A5

JPWO2022125127A5 -

Info

Publication number: JPWO2022125127A5
Application number: JP2023535081A
Authority: JP
Publication date: 2024-02-07

Claims

A computer-implemented method for detecting a suitable space for overlaying media content on top of an image, the method comprising:
receiving candidate images for media content overlay by a media content insertion system;
inputting the candidate images into a neural network, the neural network using training data including a plurality of images and one or more corresponding bounding boxes for each image of the plurality of images; The steps being trained,
receiving from the neural network coordinates and one or more dimensions representing one or more bounding boxes for inserting media content into the candidate image;
transmitting a request for a media content item to be displayed within a bounding box of the one or more bounding boxes, the request including the one or more dimensions of the one or more bounding boxes; steps, including;
receiving the media content item in response to the request;
displaying the candidate image and the media content item overlaid on the candidate image within the bounding box;
including methods.

receiving the plurality of images;
receiving one or more vectors for each of the plurality of images, each vector including a set of coordinates and a set of dimensions, each vector of the one or more vectors defining a particular boundary; a step representing a box;
training the neural network using each of the plurality of images and the corresponding one or more vectors;
2. The method of claim 1, further comprising:

receiving the coordinates and the one or more dimensions representing the one or more bounding boxes for inserting the media content into the candidate image, comprising: for each bounding box;
a first coordinate representing a first offset along a horizontal axis of the candidate image and a second coordinate representing a second offset along a vertical axis of the candidate image;
a first dimension extending from the first coordinate along the horizontal axis;
a second dimension extending from the second coordinate along the vertical axis;
a probability that a corresponding bounding box is placed over the candidate image within a suitable area for inserting the media content into the candidate image;
2. The method of claim 1, comprising the step of receiving.

for each bounding box, determining whether the corresponding probability satisfies a threshold probability;
excluding the particular bounding box from the request in response to determining that the probability of the particular bounding box does not meet the threshold probability;
4. The method of claim 3, further comprising:

receiving a plurality of media content items corresponding to the one or more bounding boxes in response to the request;
identifying from the plurality of media content items a particular media content item that corresponds to a bounding box with the highest probability;
selecting the particular media content item as the media content item;
4. The method of claim 3 , further comprising:

determining that the candidate image is a video frame associated with a video content item;
obtaining a set of video frames of the video content item, the set of video frames including a video frame to be played subsequent to the candidate image;
inputting each video frame of the set of video frames into the neural network;
For each video frame in the set of video frames, receiving from the neural network corresponding coordinates representing one or more bounding boxes and corresponding one or more dimensions;
identifying, in each video frame of the set of video frames, a bounding box that matches a bounding box in each other video frame in the set;
including in the request the bounding box that matches the bounding box of each other video frame;
2. The method of claim 1, further comprising:

A system for detecting a suitable space for overlaying media content on top of an image, the system comprising:
memory in which instructions are encoded;
one or more processors whose execution of the instructions causes the operations of the method of any one of claims 1 to 6 to be carried out;
A system equipped with.

7. A non-transitory computer-readable medium storing instructions, the instructions, when executed by one or more processors, transmitting information to the one or more processors as claimed in any one of claims 1 to 6. A non-transitory computer-readable medium for performing the operations of the method .

A computer-implemented method for detecting a suitable space for overlaying media content on top of an image, the method comprising:
receiving an image for a media content item overlay;
processing the received image using a set of one or more image processing techniques to automatically generate one or more suggested spaces within the image for media content item overlay;
applying one or more heuristic rules to automatically select one or more bounding boxes from the one or more suggested spaces within the image for media content item overlay;
selecting one or more media content items for overlay at one or more selected corresponding bounding boxes in the image;
displaying the image and the selected one or more media content items overlaid within the corresponding one or more bounding boxes within the image;
including methods.

processing the received image using a set of one or more image processing techniques to automatically generate one or more suggested spaces within the image for media content item overlay;
generating a binary matrix representation of the received image;
determining one or more rectangular spaces in the generated binary matrix that satisfy a predetermined minimum threshold parameter;
blocking out text and faces within the determined one or more rectangular spaces in the generated binary matrix;
generating a sorted list of rectangular spaces, the sorting being performed based on predetermined parameters;
providing a rectangular space in the generated sorted list as the one or more suggested spaces for overlaying media content items in the received image;
10. The method of claim 9 , further comprising:

applying one or more heuristic rules to automatically select one or more bounding boxes from the one or more suggested spaces in the image for media content item overlay;
generating a bounding box based on modifying one or more proposal spaces to be located on a grid overlaid on the image;
a plurality of groups of adjacent columns superimposed on said image such that a determined group of adjacent columns satisfies a predetermined minimum threshold of overlap with a certain proposal space of said one or more proposal spaces; generating a bounding box based on determining groups of adjacent columns from
generating a bounding box that is a weighted combination of the one or more proposal spaces;
generating a bounding box based on predetermined target properties using the one or more proposal spaces;
10. The method of claim 9 , comprising one or more of:

the selected one or more bounding boxes are described by parameters describing the position of the bounding box within the received image and parameters describing the layout of the bounding box within the received image;
The method according to claim 9 .

determining that the received image is a video frame associated with a video content item;
obtaining a set of video frames of the video content item, the set of video frames including video frames to be displayed after displaying the received image;
processing each video frame in said acquired set of video frames using a set of one or more image processing techniques to create one or more suggested spaces within each video frame for media content item overlay; a step of automatically generating
applying one or more heuristic rules to automatically select one or more bounding boxes from the one or more suggested spaces within each video frame for media content item overlay;
displaying each video frame image and the selected one or more media content items overlaid within a corresponding one or more bounding boxes within each video frame;
10. The method of claim 9 , further comprising:

A non-transitory computer-readable medium for storing instructions that, when executed by a computer processor, cause the computer processor to perform the steps of the method according to any one of claims 9 to 13 .

A computer system,
a computer processor;
a non-transitory computer-readable medium for storing instructions that, when executed by a computer processor, cause the computer processor to perform the steps of the method according to any one of claims 9 to 13 ; computer system.