CN114971663B

CN114971663B - A multimedia information processing method, apparatus, electronic device, and storage medium

Info

Publication number: CN114971663B
Application number: CN202110219929.3A
Authority: CN
Inventors: 李成龙; 任宇堃; 朱志华; 林晓健; 蔡政; 李池洋; 蔡越; 邓颖
Original assignee: Tencent Technology (Shenzhen) Co Ltd
Current assignee: Tencent Technology (Shenzhen) Co Ltd
Filing date: 2021-02-26
Publication date: 2026-05-22
Anticipated expiration: 2041-02-26

Abstract

The invention provides a multimedia information processing method, a device, an electronic device and a storage medium, wherein the method comprises the steps of obtaining corresponding play configuration information in a multimedia information play environment; based on the play configuration information, configuring a corresponding test interface for the play strategy adjustment process of the multimedia information, configuring a matched topology file for the play strategy adjustment process of the multimedia information so as to obtain the play configuration information which is dynamically adjusted through the topology file, and dynamically adjusting the play strategy of the multimedia information through the play strategy adjustment process according to the play effect parameters and the play configuration information of the multimedia information. The invention can reduce the repeated exposure of the exposed multimedia information to the user in a short time, reduce the throwing cost of the multimedia information, improve the effectiveness of the freshness policy, promote the user experience, diversify the playing form of the multimedia information and meet the use demands of different users.

Description

Multimedia information processing method and device, electronic equipment and storage medium

Technical Field

The present invention relates to a multimedia information generating technology, and in particular, to a multimedia information processing method, apparatus, electronic device, and storage medium.

Background

In the related art, advertisements can be inserted at the head or tail of a video when the advertisements are put. The freshness policy of advertisements is a control policy that prevents users from repeatedly exposing the same or similar advertisements for a short period of time to preserve the user experience. At present, manual flow distribution is generally adopted, namely, in a certain period of time, the effect index of each sub-flow under the condition of current flow proportion distribution is observed manually, then the sub-flow with the best effect is selected, and the flow proportion is increased in the next observation period, and the defects of high labor cost, low distribution efficiency and influence by subjective factors are overcome. Or based on the dynamic adjustment of batch processing, namely, sampling and accumulating the flow batch, and then applying the Toepson sampling method in the MAB algorithm according to the effect data of each sub-flow of the batch in the current period to give the proportional allocation of each sub-flow in the next period, the defects are that the allocation result is easy to fluctuate, the allocation difference is not obvious, and the algorithm mobility is poor.

Disclosure of Invention

In view of this, embodiments of the present invention provide a method, an apparatus, an electronic device, and a storage medium for processing multimedia information, which can reduce labor cost in a flow distribution process, improve efficiency of flow distribution, reduce distribution fluctuation, make flow distribution after adjustment of a play policy of multimedia information more remarkable, reduce a delivery cost of multimedia information, improve validity of a freshness policy, improve user experience, make play forms of multimedia information diversified, and satisfy use requirements of different users.

The technical scheme of the embodiment of the invention is realized as follows:

The embodiment of the invention provides a multimedia information processing method, which comprises the following steps:

acquiring corresponding play configuration information in a multimedia information play environment;

based on the play configuration information, configuring a corresponding test interface for a play strategy adjustment process of the multimedia information;

Responding to the configured test interface, configuring a matched topology file for the play strategy adjustment process of the multimedia information so as to obtain dynamically adjusted play configuration information through the topology file;

acquiring the playing effect parameters of the multimedia information through the playing strategy adjustment process;

According to the playing effect parameters and the playing configuration information of the multimedia information, determining flow parameters and iteration experiment parameters matched with the playing strategy of the multimedia information through the playing strategy adjustment process;

and dynamically adjusting the playing strategy of the multimedia information based on the flow parameters and the iteration experiment parameters matched with the playing strategy of the multimedia information.

The embodiment of the invention also provides a multimedia information processing device, which comprises:

the information transmission module is used for corresponding playing configuration information in the multimedia information playing environment;

The information processing module is used for configuring a corresponding test interface for a play strategy adjustment process of the multimedia information based on the play configuration information;

The information processing module is used for responding to the configured test interface and configuring a matched topology file for the play strategy adjustment process of the multimedia information so as to obtain the dynamically adjusted play configuration information through the topology file;

The information processing module is used for acquiring the playing effect parameters of the multimedia information through the playing strategy adjustment process;

the information processing module is used for determining flow parameters and iteration experiment parameters matched with the playing strategy of the multimedia information according to the playing effect parameters and the playing configuration information of the multimedia information through the playing strategy adjustment process;

In the above-described arrangement, the first and second embodiments,

The information transmission module is used for monitoring operation information in the play configuration display interface;

The information transmission module is used for responding to the monitored operation information and determining the triggering states of different control components in the display interface, wherein the different control components in the display interface comprise a strategy index component, a strategy type component, a strategy name component and an iteration time component.

In the above-described arrangement, the first and second embodiments,

The information processing module is used for determining version information of the topology file;

The information processing module is used for acquiring playing effect data of the multimedia information corresponding to the version information of the topology file;

the information processing module is used for respectively accumulating the play effect data of different types when the play effect data of the multimedia information is the play effect data with accumulated dimension, so as to obtain play effect parameters of the multimedia information;

and the information processing module is used for determining a calculation factor matched with the play effect data with the non-accumulative dimension when the play effect data of the multimedia information is the play effect data with the non-accumulative dimension, and carrying out accumulation processing on the calculation factor to obtain the play effect parameters of the multimedia information.

In the above-described arrangement, the first and second embodiments,

The information processing module is used for determining a playing strategy of the corresponding multimedia information according to the version information of the topology file;

the information processing module is used for determining optimization target data of the multimedia information based on the playing effect parameters of the multimedia information and the playing strategy of the multimedia information;

The information processing module is used for determining flow parameters and iteration experiment parameters matched with the playing strategies of the multimedia information through the playing strategies of the multimedia information and the optimization target data of the multimedia information and through the playing strategy adjustment process, wherein the experiment parameters are matched with the corresponding playing strategies.

In the above-described arrangement, the first and second embodiments,

The information processing module is used for dynamically adjusting the interval of the flow parameters of the multimedia information playing environment through the test interface based on the determined exposure times matched with the playing strategy of the multimedia information and the iteration experiment parameters.

In the above-described arrangement, the first and second embodiments,

The information processing module is used for sending the determined flow parameters, iteration experiment parameters and adjustment history information of intervals of the flow parameters, which are matched with the play strategy of the determined multimedia information, to the corresponding server;

And the information processing module is used for presenting flow parameters matched with the playing strategy of the multimedia information, iteration experiment parameters and adjustment history information of intervals of the flow parameters in a display interface when receiving the playing strategy query instruction.

In the above-described arrangement, the first and second embodiments,

The information processing module is used for monitoring exposure parameters of the short video when the multimedia information is the embedded advertisement information in the short video;

The information processing module is used for determining a Manrong visual effect index corresponding to the implanted advertisement information according to the exposure parameters of the short video;

The information processing module is used for adjusting playing configuration information corresponding to the embedded advertisement information in the short video through the topology file according to the Manrong visual effect index corresponding to the embedded advertisement information.

In the above-described arrangement, the first and second embodiments,

The information processing module is used for sending the exposure parameters during the short video playing to a monitoring server so as to realize the monitoring of the short video exposure by the monitoring server;

and the information processing module is used for taking the exposure parameters stored by the monitoring server during the short video playing as a data source of the playing effect parameters of the multimedia information.

In the above-described arrangement, the first and second embodiments,

The information processing module is used for determining the use environment of the terminal display interface;

The information processing module is used for determining the category of the multimedia information to be played according to the use environment of the terminal display interface;

the information processing module is used for responding to the class of the multimedia information to be played and triggering the matched multimedia information data source so as to realize the adjustment of the multimedia information to be played through the multimedia information data source matched with the class of the multimedia information to be played.

In the above-described arrangement, the first and second embodiments,

The information processing module is used for sending the multimedia information identification, the playing configuration information and the playing strategy to the blockchain network so as to enable

And filling the multimedia information identification, the playing configuration information and the playing strategy into a new block by the node of the blockchain network, and adding the new block to the tail of the blockchain when the new block is consistent in consensus.

In the above-described arrangement, the first and second embodiments,

The information processing module is used for receiving data synchronization requests of other nodes in the blockchain network;

The information processing module is used for responding to the data synchronization request and verifying the authority of the other nodes;

and the information processing module is used for controlling the current node to synchronize data with the other nodes when the authority of the other nodes passes the verification so as to realize that the other nodes acquire the multimedia information identification, the playing configuration information and the playing strategy.

In the above-described arrangement, the first and second embodiments,

The information processing module is used for responding to the query request and analyzing the query request to obtain a corresponding object identifier;

The information processing module is used for acquiring authority information in a target block in a block chain network according to the object identification;

the information processing module is used for checking the matching of the authority information and the object identifier;

the information processing module is used for acquiring corresponding multimedia information identifiers, play configuration information and play strategies from the blockchain network when the authority information is matched with the object identifiers;

The information processing module is used for pushing the obtained corresponding multimedia information identifier, playing configuration information and playing strategy to the corresponding client in response to the query instruction so as to enable the client to obtain the corresponding multimedia information identifier, playing configuration information and playing strategy stored in the blockchain network.

The embodiment of the invention also provides electronic equipment, which comprises:

A memory for storing executable instructions;

and the processor is used for realizing the preamble multimedia information processing method when the executable instructions stored in the memory are run.

The embodiment of the invention also provides a computer readable storage medium which stores executable instructions which when executed by a processor realize the method for processing the multimedia information.

The embodiment of the invention has the following beneficial effects:

The method comprises the steps of obtaining corresponding play configuration information in a multimedia information play environment, configuring a corresponding test interface for a play strategy adjustment process of the multimedia information based on the play configuration information, configuring a matched topology file for the play strategy adjustment process of the multimedia information in response to the configured test interface so as to obtain the play configuration information which is dynamically adjusted through the topology file, obtaining play effect parameters of the multimedia information through the play strategy adjustment process, determining flow parameters and iteration experiment parameters which are matched with the play strategy of the multimedia information through the play strategy adjustment process according to the play effect parameters and the play configuration information of the multimedia information, and dynamically adjusting the play strategy of the multimedia information based on the flow parameters and the iteration experiment parameters which are matched with the play strategy of the multimedia information. The method can reduce the labor cost in the flow distribution process, improve the efficiency of flow distribution, reduce distribution fluctuation, enable the flow distribution after the play strategy of the multimedia information is adjusted to be more obvious, reduce the delivery cost of the multimedia information, improve the effectiveness of the freshness strategy, promote the user experience, enable the play modes of the multimedia information to be diversified, and meet the use requirements of different users.

Drawings

Fig. 1 is a schematic diagram of a usage scenario of a multimedia information processing method according to an embodiment of the present invention;

fig. 2 is a schematic diagram of a composition structure of a multimedia information processing apparatus according to an embodiment of the present invention;

FIG. 3 is a schematic flow chart of an alternative method for processing multimedia information according to an embodiment of the present invention;

fig. 4 is a schematic flow chart of an alternative method for processing multimedia information according to an embodiment of the present invention;

Fig. 5 is a schematic diagram of a topology structure of a multimedia information processing procedure according to an embodiment of the present invention;

fig. 6A is a schematic flow chart of an alternative method for processing multimedia information according to an embodiment of the present invention;

Fig. 6B is a schematic diagram of an alternative display effect of the multimedia information processing method according to the embodiment of the present invention;

fig. 7 is a schematic flow chart of an alternative method for processing multimedia information according to an embodiment of the present invention;

Fig. 8 is a schematic diagram of a multimedia information processing apparatus 100 according to an embodiment of the present invention;

FIG. 9 is a block chain architecture diagram of a block chain in a block chain network 700 according to an embodiment of the present invention;

FIG. 10 is a functional architecture diagram of a blockchain network 700 provided by an embodiment of the present invention;

FIG. 11 is a schematic diagram of an alternative multimedia information playing method according to an embodiment of the present invention;

Fig. 12 is a schematic flow chart of an alternative method for processing multimedia information according to an embodiment of the present invention;

FIG. 13 is a schematic diagram showing an alternative multimedia information playing mode according to an embodiment of the present invention;

fig. 14 is a schematic diagram of playing back alternative multimedia information according to an embodiment of the present invention.

Detailed Description

The present invention will be further described in detail with reference to the accompanying drawings, for the purpose of making the objects, technical solutions and advantages of the present invention more apparent, and the described embodiments should not be construed as limiting the present invention, and all other embodiments obtained by those skilled in the art without making any inventive effort are within the scope of the present invention.

In the following description, reference is made to "some embodiments" which describe a subset of all possible embodiments, but it is to be understood that "some embodiments" can be the same subset or different subsets of all possible embodiments and can be combined with one another without conflict.

Before describing embodiments of the present invention in further detail, the terms and terminology involved in the embodiments of the present invention will be described, and the terms and terminology involved in the embodiments of the present invention will be used in the following explanation.

In the embodiment of the application, the relevant data collection processing should be strictly according to the requirements of relevant laws and regulations when the example is applied, so as to acquire the informed consent or independent consent of the personal information body, and develop the subsequent data use and processing within the authorized range of the laws and regulations and the personal information body.

1) The Manrong visual effect index specifically comprises 1 and the minimum exposure, namely the picture exposure time length is required to be longer than 1 second. 2. The visibility of the multimedia information, i.e. the proportion of the implanted multimedia information displayed on the screen, must be higher than a preset threshold. The threshold consists of the threshold of the first exposure and the remaining exposures. 3. Definition, i.e. definition must be above a predetermined threshold (definition threshold), different sizes will have different predetermined values. Specifically, a visual effect index (VIS) of the corresponding multimedia information may be calculated according to the following parameters:

The exposure size accounts for the specific parameters of the screen, the saliency parameters (the visibility of the embedded brand in the scene and environment), the proximity effect parameters (the proximity to the primary activity task/object in the scene).

2) In response to a condition or state representing a dependency of an operation performed, the one or more operations performed may be in real-time or with a set delay when the dependency is satisfied, and without any particular limitation to execution sequencing.

3) The advertisement is implanted, and the product or brand information is implanted into video content in the form of a physical object or a picture or a video, so that brand impression is left for audiences, and the marketing purpose is achieved. Wherein the expression of "advertisement" is multimedia information, and the type of the multimedia information includes but is not limited to pictures, words, video and audio. The embedded advertisement is hidden in the carrier and integrated with the carrier, and meanwhile, the advertisement information is carefully coded by a non-advertisement expression method, so that the audience can feel commodity and brand information in an unconscious state, thereby receiving the stimulation of the advertisement information, and the advertisement effect cannot be achieved by the common advertisement because the audience receives the advertisement in a non-countermeasure state.

4) Terminals, including but not limited to, ordinary terminals that maintain long and/or short connections with a transmission channel, and dedicated terminals that maintain long connections with the transmission channel.

5) Transactions (transactions), which are equivalent to computer terms "transactions," include operations that need to be submitted to a blockchain network for execution, and do not refer solely to transactions in a business context, which embodiments of the present invention follow in view of the terminology "transactions" being colloquially used in blockchain technology.

6) A blockchain (Blockchain) is a storage structure of encrypted, chained transactions formed by blocks (blocks).

7) A blockchain network (Blockchain Network) incorporates new blocks into a set of nodes of the blockchain by way of consensus.

8) Ledger (Ledger) is a generic term for blockchains (also known as ledger data) and state databases that are synchronized with the blockchain.

9) A smart contract (Smart Contracts), also referred to as a chain code (Chaincode) or application code, is deployed in a node of the blockchain network, which executes smart contracts invoked in received transactions to update or query key values of the state database.

10 Consensus (Consensus), a process in a blockchain network for agreeing on transactions in blocks among the multiple nodes involved, the agreed blocks will be appended to the tail of the blockchain, mechanisms for implementing Consensus including Proof of Work (PoW, proof of Work), proof of equity (PoS, proof of status), proof of equity authorization (DPoS, DELEGATED PROOF-of-status), proof of elapsed amount of time (PoET, proof of ELAPSED TIME), and the like.

11 A carrier in the terminal that implements a specific function, for example, a mobile client (APP) is a carrier of a specific function in the mobile terminal, for example, a function of performing live video on line or a play function of video on line.

12 Exposure), pushing corresponding multimedia information to the user when the effective condition is met, or selecting to watch by the user, for example, pushing different videos to the user for watching when the pushing condition of the videos is met.

13 MAB Multi-armed Bandit, multi-arm gambling machine problem. A classical problem in statistics is that gambler, to shake the slot machines, the appearance of a row of slot machines is identical, but the probability of each slot machine spitting money is different, gambler does not know the probability distribution of each slot machine spitting money, and how to select the slot machines each time can achieve the maximum benefit, which is the problem of the multi-arm gambling machine, and the corresponding algorithm is the multi-arm gambling machine algorithm.

14 A/B test, a method of verifying differences in effects of a target object before and after applying a policy. In a recommended advertisement scenario, the target object may be a request set, a user set, an advertisement set, etc., and the effect may be a statistical indicator of system and platform attention, including exposure, clicking, consumption, etc. Dividing the target object into mutually exclusive experimental group and control group by random sampling, keeping the control group unchanged, applying new strategy to the experimental group, and finally comparing the difference of the effect indexes between the experimental group and the control group

15 Flow rate, referred to herein, generally refers to the collection of elements having a common characteristic that occur over time. In the recommended advertisement scenario, the request set, the user set, the advertisement set, etc. may be considered as traffic because new elements are continuously generated over time.

16 Flow distribution, namely, the flow is divided into a plurality of sub-flows according to a certain rule based on a certain purpose, so that different strategies are conveniently applied to different sub-flows or other treatments are conveniently carried out in the subsequent links. In the recommended advertising scenario, there are two general purposes of traffic distribution, one is to check the difference between different policies applied to different sub-traffic, and the other is to maximize the overall effect of traffic, where the effect may include general advertising effect indicators such as click-through rate, conversion rate, etc.

17 Dynamic flow regulation, namely, under the condition of no manual intervention, the flow is automatically distributed according to a certain algorithm aiming at the purpose of flow distribution.

Fig. 1 is a schematic view of a usage scenario of a multimedia information processing method according to an embodiment of the present application, referring to fig. 1, a terminal (including a terminal 10-1 and a terminal 10-2) is provided with a corresponding client capable of playing embedded multimedia information, the terminal is connected to a server 200 through a network 300, the network 300 may be a wide area network or a local area network, or a combination of the two, and data transmission is implemented by using a wireless link, where the multimedia information includes, but is not limited to, video, pictures, GIF animation, and advertisement information. The types of multimedia information acquired by the terminals (including the terminal 10-1 and the terminal 10-2) from the corresponding server 200 through the network 300 may be the same or different, for example, the terminals (including the terminal 10-1 and the terminal 10-2) may acquire video advertisements served by advertisers from the corresponding server 200 through the network 300, or may acquire image advertisements served by advertisers from the corresponding server 200 through the network 300. Different multimedia information may be stored in the server 200, wherein the multimedia information used as an advertisement may be content in different dynamic formats, such as gif, mp4, mov, etc.

In the process that the terminal (terminal 10-1 and/or terminal 10-2) obtains and displays the corresponding service with embedded multimedia information from the server 200 through the network 300, the user can perform different operations on the multimedia information displayed in the multimedia information playing window through the terminal (terminal 10-1 and/or terminal 10-2), so as to generate different user behaviors, for example, when the multimedia information is a video advertisement, the user can share and/or like the exposed short video in the process of watching the information, and also can click. When the multimedia information is a dynamic GIF advertisement, the user may forward and/or comment on the advertisement during the exposure of the advertisement through the terminal (terminal 10-1 and/or terminal 10-2), or may jump to the corresponding product purchase link page through the GIF advertisement.

As an example, when determining what kind of multimedia information is recommended to the terminal 10-1 or 10-2 of the user to play, the server 200 needs to timely adjust the multimedia information to be played, for example, replace any multimedia information in a multimedia information set to be played, so as to adapt to the viewing requirements of different target users, for example, corresponding play configuration information in a multimedia information playing environment can be obtained, based on the play configuration information, a corresponding test interface is configured for a play policy adjustment process of the multimedia information, a matched topology file is configured for the play policy adjustment process of the multimedia information in response to the configured test interface, so as to obtain dynamically adjusted play configuration information through the topology file, obtain play effect parameters of the multimedia information through the play policy adjustment process, determine flow parameters and iteration experiment parameters matched with the play policy of the multimedia information through the play policy adjustment process according to the play effect parameters and the play configuration information of the multimedia information, and dynamically adjust the play policy of the multimedia information based on the flow parameters matched with the play policy of the multimedia information and the iteration experiment parameters. Wherein, the

The following describes the structure of the multimedia information processing apparatus according to the embodiment of the present invention in detail, and the multimedia information processing apparatus may be implemented in various forms, such as a dedicated terminal with a multimedia information processing function, or may be a server provided with a multimedia information processing function, for example, the server 200 in fig. 1. Fig. 2 is a schematic diagram of a composition structure of a multimedia information processing apparatus according to an embodiment of the present invention, and it is understood that fig. 2 shows only an exemplary structure of the multimedia information processing apparatus, not all the structures, and that a part of or all the structures shown in fig. 2 may be implemented as needed.

The multimedia information processing apparatus provided by the embodiment of the invention comprises at least one processor 201, a memory 202, a user interface 203 and at least one network interface 204. The various components in the multimedia information processing apparatus are coupled together by a bus system 205. It is understood that the bus system 205 is used to enable connected communications between these components. The bus system 205 includes a power bus, a control bus, and a status signal bus in addition to the data bus. But for clarity of illustration the various buses are labeled as bus system 205 in fig. 2.

The user interface 203 may include, among other things, a display, keyboard, mouse, trackball, click wheel, keys, buttons, touch pad, or touch screen, etc.

It will be appreciated that the memory 202 may be either volatile memory or nonvolatile memory, and may include both volatile and nonvolatile memory. The memory 202 in embodiments of the present invention is capable of storing data to support operation of the terminal (e.g., 10-1). Examples of such data include any computer program for operating on a terminal (e.g., 10-1), such as an operating system and application programs. The operating system includes various system programs, such as a process layer, a core library layer, a driver layer, and the like, for implementing various basic services and processing hardware-based tasks. The application may comprise various applications.

In some embodiments, the multimedia information processing apparatus provided by the embodiments of the present invention may be implemented by combining software and hardware, and as an example, the multimedia information processing method apparatus provided by the embodiments of the present invention may be a processor in the form of a hardware decoding processor, which is programmed to execute the multimedia information processing method provided by the embodiments of the present invention. For example, a processor in the form of a hardware decoding processor may employ one or more Application Specific Integrated Circuits (ASICs), DSPs, programmable logic devices (PLDs, programmable Logic Device), complex Programmable logic devices (CPLDs, complex Programmable Logic Device), field-Programmable gate arrays (FPGAs), or other electronic components.

As an example of implementation of the multimedia information processing apparatus provided by the embodiment of the present invention by combining software and hardware, the multimedia information processing apparatus provided by the embodiment of the present invention may be directly embodied as a combination of software modules executed by the processor 201, the software modules may be located in a storage medium, the storage medium is located in the memory 202, and the processor 201 reads executable instructions included in the software modules in the memory 202, and performs the multimedia information processing method provided by the embodiment of the present invention in combination with necessary hardware (including, for example, the processor 201 and other components connected to the bus system 205).

By way of example, the Processor 201 may be an integrated circuit chip having signal processing capabilities such as a general purpose Processor, such as a microprocessor or any conventional Processor, a digital signal Processor (DSP, digital Signal Processor), or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like.

As an example of a hardware implementation of the multimedia information processing apparatus provided by the embodiment of the present invention, the apparatus provided by the embodiment of the present invention may be directly implemented by the processor 201 in the form of a hardware decoding processor, for example, one or more Application specific integrated circuits (ASICs, application SPECIFIC INTEGRATED circuits), DSPs, programmable logic devices (PLDs, programmable Logic Device), complex Programmable logic devices (CPLDs, complex Programmable Logic Device), field-Programmable gate arrays (FPGAs), or other electronic components to implement the multimedia information processing method provided by the embodiment of the present invention.

The memory 202 in the embodiment of the present invention is used to store various types of data to support the operation of the multimedia information processing apparatus. Examples of such data include any executable instructions for operating on the multimedia information processing apparatus, such as executable instructions, in which a program implementing the slave multimedia information processing method of the embodiment of the present invention may be contained.

In other embodiments, the multimedia information processing apparatus provided in the embodiments of the present invention may be implemented in a software manner, and fig. 2 shows the multimedia information processing apparatus stored in the memory 202, which may be software in the form of a program, a plug-in, or the like, and includes a series of modules, and as an example of the program stored in the memory 202, the multimedia information processing apparatus may be included, where the multimedia information processing apparatus includes software modules, i.e., an information transmission module 2081 and an information processing module 2082. When software modules in the multimedia information processing apparatus are read into the RAM by the processor 201 and executed, the multimedia information processing method provided by the embodiment of the present invention will be implemented, and the functions of the respective software modules in the multimedia information processing apparatus will be described further below, wherein,

The information transmission module 2081 is configured to play the corresponding play configuration information in the multimedia information playing environment.

The information processing module 2082 is configured to configure a corresponding test interface for a play policy adjustment process of the multimedia information based on the play configuration information.

The information processing module 2082 is configured to configure a topology file matched with the play policy adjustment process of the multimedia information in response to the configured test interface, so as to obtain dynamically adjusted play configuration information through the topology file.

The information processing module 2082 is configured to obtain, through the play policy adjustment process, a play effect parameter of the multimedia information.

The information processing module 2082 is configured to determine, according to the playback effect parameter and the playback configuration information of the multimedia information, a flow parameter and an iteration experiment parameter that are matched with the playback policy of the multimedia information through the playback policy adjustment process.

The information processing module 2082 is configured to dynamically adjust the playing policy of the multimedia information based on the flow parameter and the iteration experiment parameter that are matched with the playing policy of the multimedia information

According to the multimedia information processing apparatus shown in fig. 2, in one aspect of the present application, the present application also provides a computer program product or computer program including computer instructions stored in a computer-readable storage medium. The computer instructions are read from a computer-readable storage medium by a processor of an electronic device, which executes the computer instructions, causing the electronic device to perform the different embodiments and combinations of embodiments provided in the various alternative implementations of the multimedia information processing method described above.

The server in the embodiment of the application can be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, and also can be a cloud server for providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDNs, basic cloud computing services such as big data and artificial intelligent platforms and the like. The terminal and the server may be directly or indirectly connected through wired or wireless communication, and the present application is not limited herein.

In some embodiments of the present invention, the terminal 110, the traffic end 120, the multimedia information system 130, and the distributed cloud storage system 140 may be node devices in a blockchain system, and may share the acquired and generated information to other node devices in the blockchain system, so as to implement information sharing between multiple node devices.

The embodiment of the invention can also realize the exposure control of the multimedia information based on cloud technology. Cloud technology (Cloudtechnology) is a generic term of network technology, information technology, integration technology, management platform technology, application technology and the like based on cloud computing business model application, can form a resource pool, is used as required, is flexible and convenient, and becomes an important support. Cloud computing (cloud computing) refers to the delivery and usage mode of an IT infrastructure, to obtaining required resources in an on-demand, easily scalable manner over a network, and generalized cloud computing refers to the delivery and usage mode of a service, to obtaining required services in an on-demand, easily scalable manner over a network. Such services may be IT, software, internet related, or other services. Cloud Computing is a product of fusion of traditional computer and network technology developments such as Grid Computing (Grid Computing), distributed Computing (DistributedComputing), parallel Computing (ParallelComputing), utility Computing (Utility Computing), network storage (Network StorageTechnologies), virtualization (Virtualization), load balancing (Load Balance), and the like. With the development of the internet, real-time data flow and diversification of connected devices, and the promotion of demands of search services, social networks, mobile commerce, open collaboration and the like, cloud computing is rapidly developed. Unlike the previous parallel distributed computing, the generation of cloud computing will promote the revolutionary transformation of the whole internet mode and enterprise management mode in concept.

Cloud storage (cloud storage) is a new concept that extends and develops in the concept of cloud computing, and a distributed cloud storage system (hereinafter referred to as a storage system for short) refers to a storage system that integrates a large number of storage devices (storage devices are also referred to as storage nodes) of various types in a network to work cooperatively through application software or application interfaces through functions such as cluster application, grid technology, and a distributed storage file system, so as to provide data storage and service access functions for the outside. At present, a storage method of a storage system is that logical volumes are created, and when the logical volumes are created, a physical storage space is allocated to each logical volume, where the physical storage space may be a disk of a certain storage device or a plurality of storage devices. The client stores data on a certain logical volume, that is, the data is stored on a file system, the file system divides the data into a plurality of parts, each part is an object, the object not only contains the data but also contains additional information such as a data Identification (ID) and the like, the file system writes each object into a physical storage space of the logical volume, and the file system records storage position information of each object, so that when the client requests to access the data, the file system can enable the client to access the data according to the storage position information of each object. The storage system allocates physical storage space for a logical volume, specifically, the physical storage space is divided into stripes in advance according to the set of capacity estimation of objects stored in the logical volume (the estimation often has a large margin with respect to the capacity of the objects actually to be stored) and redundant array of independent disks (RAID, redundant Array of INDEPENDENT DISK), and one logical volume can be understood as one stripe, so that the physical storage space is allocated for the logical volume.

When the multimedia information is an advertisement, the server 200 transmits corresponding advertisement information to the terminal (terminal 10-1 and/or terminal 10-2) through the network 300 to enable the user of the terminal (terminal 10-1 and/or terminal 10-2) to browse the multimedia information. In the process, the information flow advertisement is a mainstream form of mobile advertisement because of the advantages of being embedded in the information flow, infinitely brushing along with the content and the like, but in the process of delivering the advertisement, an advertiser is an initiator of an advertisement campaign and is a merchant selling or propaganda of own products and services on the internet, and any merchant promoting or selling the products or services can be used as the advertiser. The advertiser issues an advertising campaign and pays the website owner a fee according to the total number of marketing effects and the price per unit effect specified in the advertising campaign completed by the advertising platform. The advertiser may set optimization objectives in the advertisement delivery, such as downloading, activating, or paying for mobile applications, etc., and conversion costs willing to pay for the optimization objectives, and the advertising platform automatically bids when there is an exposure opportunity so that the actual conversion costs of the advertisement approach the conversion costs expected by the advertiser.

When the play strategy is configured to realize flow distribution, manual flow distribution is generally adopted, namely, in a certain period of time, the effect index of each sub-flow under the condition of current flow proportion distribution is observed manually, then the sub-flow with the best effect is selected, and the flow proportion is increased in the next observation period, so that the defects of high labor cost, low distribution efficiency and influence by subjective factors are overcome. Or based on the dynamic adjustment of batch processing, namely, sampling and accumulating the flow batch, and then applying the Toepson sampling method in the MAB algorithm according to the effect data of each sub-flow of the batch in the current period to give the proportional allocation of each sub-flow in the next period, the defects are that the allocation result is easy to fluctuate, the allocation difference is not obvious, and the algorithm mobility is poor.

In order to solve the above-mentioned problems, the method for processing multimedia information according to the embodiment of the present invention is described with reference to the server 200 shown in fig. 2, and referring to fig. 3, fig. 3 is an optional flowchart of the method for processing multimedia information according to the embodiment of the present invention, it will be understood that the steps shown in fig. 3 may be performed by various electronic devices running the multimedia information processing apparatus, for example, a dedicated terminal, an electronic device or a cluster of electronic devices with multimedia information processing functions. The following is a description of the steps shown in fig. 3.

Step 301, the multimedia information processing apparatus obtains corresponding playing configuration information in the multimedia information playing environment.

At least one multimedia information playing window can be set on the multimedia information display interface of the terminal, and the multimedia information playing window is used for playing various types of multimedia information, such as advertising information of different advertisers.

Referring to fig. 4, fig. 4 is a schematic diagram illustrating multimedia information play adjustment according to an embodiment of the present invention, and in some embodiments of the present invention, obtaining corresponding play configuration information in a multimedia information play environment may be implemented by:

And responding to the monitored operation information, determining the triggering states of different control components in the display interface, wherein the different control components in the display interface comprise a strategy index component, a strategy type component, a strategy name component and an iteration time component. Taking multimedia information as an advertisement as an example, when the advertisement flow is configured offline, the advertisement experiment system is a set of evaluation system built for the advertisement recommendation platform based on an A/B test by applying a statistical principle and used for checking the effect and influence of a new strategy on the platform. The advertisement experiment system is mainly oriented to advertisement platform developers. The developer configures experimental information through the front end of the experimental system, sets a plurality of experimental groups and experimental parameters, develops experimental logic under each parameter value in the advertisement platform system (for example, different algorithms or strategies are adopted for different parameter values), groups experiments aiming at certain elements (such as requests, users or advertisements), then takes effect of different parameter values on different experimental groups, and triggers the experimental logic to act on line. And finally, evaluating the influence of the analysis strategy on the platform by off-line statistics of the effect of each experimental group. In advertising experiment systems, classical A/B tests are commonly used for evaluation and analysis of policy effects. The method has the characteristics of simple principle, easiness in implementation and the like, and has the defects of long experiment period, long time data accumulation usually required to judge the effect of each experiment group, fixed distribution ratio of experimental flow, and manual adjustment of flow interval when the flow needs to be enlarged for experiments with good effect. The experimental information configuration page is added with an automatic adjustment switch, and four selectable items of strategy index, strategy type, strategy name and iteration time are respectively used for specifying the effect index of algorithm optimization, an automatic adjustment object, an applied specific algorithm and the period of algorithm iteration after the switch is turned on. The dynamic regulation process of the multimedia information processing server can start the dynamic regulation process by acquiring the configuration of the information, and the experiment flow can be dynamically regulated.

Step 302, the multimedia information processing device configures a corresponding test interface for the play strategy adjustment process of the multimedia information based on the play configuration information.

In order to realize flow parameters and iteration experiment parameters matched according to the playing strategy of the multimedia information, the playing strategy is dynamically adjusted to adapt to different playing environments, specifically, whether the corresponding interface information and component information in the query information of the program framework information support the test program in the playing strategy adjustment process set or not (wherein, the test program in the playing strategy adjustment process can execute the corresponding flow distribution test through the multi-arm gambling algorithm) is obtained, so that the adaptation condition of the interface information and the component information is obtained, when the adaptation parameter list is generated later, the content of the corresponding interface information and the component information is added, so that the adaptation parameter list with more content is obtained, and the application is convenient, wherein, when the interface is configured, the UI automatic test information and the monitoring interface parameter can be configured. The UI automation test information comprises names, paths or calling methods of a UI automation project (or script) and the like, and the monitoring interface parameters comprise parameters such as interface addresses (such as a packet capturing domain name/ip path), interface parameter assignment, assignment code numbers and value ranges and the like which need to be monitored.

Therefore, after program frame information of a play strategy adjustment process is determined, a test program set is correspondingly determined, the test program set is adopted to carry out iterative test on the play strategy of the multimedia information, a test result is obtained, an adaptive parameter list is generated, and finally the adaptive parameter list containing the program frame information is output, so that the suitability of the play strategy of the dynamically adjusted multimedia information to different play environments is determined according to the adaptive parameter list, the efficiency of multimedia information processing can be improved, and meanwhile, the triggered interface can be flexibly adjusted according to the play environment, so that the multimedia information processing method provided by the application is adaptive to more types of play environments.

In some embodiments of the invention, the use environment of a terminal display interface can be determined, the class of the multimedia information to be played is determined according to the use environment of the terminal display interface, and the matched multimedia information data source is triggered in response to the class of the multimedia information to be played so as to realize adjustment of the multimedia information to be played through the multimedia information data source matched with the class of the multimedia information to be played. Therefore, taking multimedia information as an advertisement as an example, game advertisements can be selected in a game video playing interface, commodity advertisements can be selected in a TV play environment, and the advertisement exposure is more targeted.

Step 303, the multimedia information processing device responds to the configured test interface to configure matched topology files for the play strategy adjustment process of the multimedia information.

The topology file matched with the play strategy adjustment process configuration of the multimedia information at least comprises topology structure information, topology data and topology structure version information, and the topology is encapsulation of dynamic adjustment flow logic of the multimedia information play strategy. The topology structure information is used for describing node configuration states in any topology structure version, when dynamic adjustment of the playing strategy is carried out, the dynamic adjustment experiment strategy framework can construct experiment configuration topology from an experiment system database according to the topology structure version, and the topology data is stored as a structured topology file at regular time, so that the strategy framework can acquire full amount of experiment configuration information at regular time and screen out the dynamic adjustment experiment information therein, and the dynamic adjustment of the playing strategy is realized. In some embodiments of the present invention, fig. 5 is a schematic topological structure diagram of a multimedia information processing process provided in the embodiment of the present invention, and as shown in fig. 5, nodes in the topological structure are divided into two types, one type is a source node for playing data, and the other type is a working node. The source node of playing data is a source of data stream in the topology structure, when the source node of playing data dynamically adjusts in the dynamic adjustment experimental strategy framework, the source node of playing data reads the data stream from an external data source (wherein the transmitted data stream may include topology structure version information and playing effect information) and then transmits the acquired topology data to the source node of playing data, and the source node of playing data may send a plurality of data streams. The working node is responsible for data processing and other works. A version of the topology may be composed of one or more source nodes and working nodes that play data. One source node playing data can send data to a plurality of working nodes at the same time, and one working node can also receive the source nodes or the plurality of working nodes playing data, and finally a plurality of processing data streams are formed. Besides the connection relation of the service nodes, the topology structure can also comprise port identifiers for dynamically adjusting the data read and sent by the experimental strategy framework. By reading the corresponding key value pairs, the initial topological structure and the corresponding topological file configured during the creation of the dynamic adjustment experiment strategy framework can be rewritten, so that the dynamic adjustment is convenient to flexibly adjust according to different video playing environments.

With continued reference to fig. 5, in some embodiments of the present invention, the obtaining, by the play policy adjustment process, the play effect parameter of the multimedia information may be implemented by:

The method comprises the steps of determining version information of a topology file, obtaining playing effect data of multimedia information corresponding to the version information of the topology file, respectively carrying out accumulation processing on different types of playing effect data to obtain playing effect parameters of the multimedia information when the playing effect data of the multimedia information is playing effect data with accumulated dimensions, determining calculation factors matched with the playing effect data with the non-accumulated dimensions when the playing effect data of the multimedia information is playing effect data with non-accumulated dimensions, and carrying out accumulation processing on the calculation factors to obtain the playing effect parameters of the multimedia information. The totalizable effect indexes (such as exposure number, click number, etc.) are directly accumulated, and the non-totalizable effect indexes (such as click rate CTR, conversion rate CVR, etc.) are respectively accumulated according to the calculation factors of the indexes (such as conversion rate capable of respectively accumulating the click number and conversion number). In the dynamic adjustment strategy framework, the cumulative effect value of the last period is recorded through the checkpoint of SPARK STREAMING, and the repeated calculation is avoided through the incremental accumulation mode.

When the types of the multimedia information are advertisements, as the advertisement putting scenes are various, taking the micro-letter reading applet putting scenes as an example, specifically, at least one group of test interfaces can be triggered to form multiple versions of test scenes in response to a play strategy adjusting process, version information of topology files in the micro-letter reading applet in the play strategy adjusting process is determined, the version information of the topology files corresponding to the micro-letter reading applet can be obtained according to the micro-letter reading applet of different versions, and the sequence of the formed different test scenes can be adjusted to adapt to the attribute information of the test user. The advertisement delivery environment of the WeChat book comprises H5 items with a large number of electronic books (e.g. electronic books and electronic novels), and each electronic book in the H5 items can correspond to a URL (Uniform Resource Locator ) address. Each URL address may be used to access a target page (i.e., H5 page) of a particular electronic reading. In the development test of the WeChat reading applet scene, in order to detect the compatibility of target pages corresponding to the URL addresses in different devices, the advertisement playing strategy in the WeChat reading applet is required to be tested, at least one group of interfaces is triggered in response to the applet test process, the test scene of which the user identity is a new reader is simulated, the WeChat reading is tested by the corresponding test cases to obtain the playing effect data of the advertisement, at least two interfaces can be triggered to form different test scenes, and the new reader is respectively simulated to be the in-process advertisement playing test scene, the old user reader advertisement playing (the exposure rate of the advertisement is adjusted according to the calculation factors matched with the historical data of the user) test scene and the guest user test scene.

Therefore, the dynamically adjusted playing configuration information can be obtained through the topology file.

Step 304, the multimedia information processing device obtains the playing effect parameters of the multimedia information through the playing strategy adjustment process.

Step 305, the multimedia information processing device determines the flow parameters and the iteration experiment parameters matched with the playing strategy of the multimedia information according to the playing effect parameters and the playing configuration information of the multimedia information through the playing strategy adjustment process.

Step 306, the multimedia information processing device dynamically adjusts the playing strategy of the multimedia information based on the flow parameters and the iteration experiment parameters matched with the playing strategy of the multimedia information.

And when the multimedia information to be played is not presented through a terminal display interface, the transition multimedia information is presented through the terminal display interface. The transition multimedia information can be a key frame animation and lottie animation, so that a user can interact with information in a terminal display interface and simultaneously display the information in an animation mode, thereby enhancing the interest.

With continued reference to fig. 6A, fig. 6A is an optional flowchart of a multimedia information processing method according to an embodiment of the present invention, and it will be understood that the steps shown in fig. 6A may be performed by various terminals running the multimedia information processing apparatus, for example, a dedicated terminal with a multimedia information processing function, an electronic device (a mobile phone or a tablet computer), or the like. The following is a description of the steps shown in fig. 6A.

And 601, determining a playing strategy of the corresponding multimedia information according to the version information of the topology file.

Referring to fig. 6B and fig. 6B, an optional display effect schematic diagram of the multimedia information processing method provided by the embodiment of the present application is shown in fig. 6B, where video advertisements can be sequentially played in the window 1, the window 2 and the window 3 for playing multimedia information according to the playing sequence of the multimedia information through the index information of the multimedia information playing window, or the image frame of the same video advertisement can be divided into three parts and respectively presented in the window 1, the window 2 and the window 3, so that a user obtains complete multimedia information through viewing the window 1, the window 2 and the window 3. Further, when the multimedia information is an advertisement, the terminal may obtain the video advertisement served by the advertiser from the corresponding server 200 through the network 30, or may obtain the image advertisement served by the advertiser from the corresponding server 200 through the network 300, which is not limited in the specific type of the present application. Different multimedia information can be stored in the server 200, wherein the multimedia information used as advertisements can be content with different dynamic formats, such as gif, mp4, mov and the like, and the number of the advertisement content and the number of the multimedia information playing windows can be adapted by dividing and adjusting image frames through the advertisement content with different dynamic formats.

In some embodiments of the present application, when the multimedia information played in the multimedia information playing window through the short video is a video advertisement, a triggering operation for the multimedia information playing window is received, and in response to the triggering operation, the service processing interface is presented to jump to a commodity display interface indicated by the multimedia information, so that a user can more conveniently purchase the commodity presented by the multimedia information playing window.

Step 602, determining optimization target data of the multimedia information based on the playing effect parameters of the multimedia information and the playing strategy of the multimedia information.

And 603, triggering and utilizing a multi-arm gambling machine algorithm through the play strategy of the multimedia information and the optimization target data of the multimedia information and the play strategy adjustment process.

In the recommended advertisement scenario, this goal is usually to select the traffic with the best effect through traffic comparison. Commonly used advertising effectiveness indexes include CTR, CVR, actual consumption, etc., which can be regarded as the cumulative value of basic indexes (exposure number, click number, conversion number, etc.), or the ratio of the basic indexes. For the ratio-type effect index, in combination with consideration of MAB algorithm, the business meaning of the index is creatively modeled by correlating with 'try' and 'benefit' in MAB scene. Taking multimedia information as an advertisement put by an advertiser as an example, after a user triggers the exposed advertisement, the user is guided to browse or purchase goods, and the advertiser can obtain the playing effect of the advertisement, so that the use scene of the test advertisement playing strategy can be converted into 'try' and 'income' in the MAB scene.

Taking CTR as an example, it is defined as the number of clicks divided by the number of exposures, and represents the probability of clicks that a single exposure may bring. Each sub-flow under a flow can be considered to correspond to multiple "play policies", an exposure in a flow is an "attempt" to the "play policy", which attempts to obtain a "benefit" with a certain probability, the benefit being a click, and an exposure under multiple flows is an attempt to multiple play policies. Under the view angle, the flow with the highest click rate is sought, the click rate of the full flow in the seeking process is maximized as much as possible, the playing strategy with the highest click rate is sought in an MAB scene, the total income in the seeking process is maximized as much as possible, and the targets and the processes are completely consistent. The modeling process of CPM, CVR and other proportional effect indexes is similar to CTR. The correlation algorithm of the MAB can be fully applied to the index.

When playing multimedia information in a live video scene (for example, playing advertisements in live video), the terminal may upload monitored advertisement playing content and playing effects to the application programming interface in real time through the client, where the monitored content may include user related information and monitored content, and the user related information may be, for example, a user identifier, an address of the terminal I P, an operator where the terminal is located, a network type, and the like, and the monitored content may include video quality data when the live video is generated and video quality data when the live video is watched, and the monitored content may also be, for example, an attempt "and" profit "of advertisement playing in the foregoing embodiment. In the process of resolving the live video real server address, the terminals can send content acquisition requests to node equipment of a target server in the content distribution network through the API so as to acquire a specific URL (Uniform Resource Locator ) webpage address.

However, the automatic flow adjustment also has a special point, namely, usually, only one play strategy, namely, sub-flow is not selected, but a plurality of play strategies are selected according to probability, or the sub-flows are distributed according to a certain proportion. There is also a certain difference from the general MAB algorithm. For this, the MAB algorithm is converted using a Soft Max function. That is, for a certain MAB algorithm, such as the confidence interval upper bound method, assuming that the score of each "play policy" output by it is xi, i=1, 2,..n, the probability (or the assigned proportion) of each play policy selection refers to equation 1:

Equation 1

For some MAB algorithms, for example, different sample distributions can be obtained by Soft Max MAB and Thompson sampling to adapt to different advertisement delivery environments, and the probability value of each playing strategy is selected as output, so that conversion is not needed.

Step 604, determining flow parameters and iterative experiment parameters matched with the playing strategies of the multimedia information, wherein the experiment parameters are matched with the corresponding playing strategies.

The flow parameter and the iteration experiment parameter matched with the playing strategy can come from different video recommendation systems, such as a short video recommendation system, so that the playing strategy is matched with the playing environment of the short video, the flow parameter and the iteration experiment parameter can come from an advertisement recommendation system, and the advertiser obtains the maximum advertising benefit through the dynamic adjustment of the advertisement playing strategy.

In some embodiments of the present invention, the interval of the flow parameter of the multimedia information playing environment may be dynamically adjusted through the test interface based on the determined exposure times matched by the playing policy of the multimedia information and the iteration experiment parameter.

The MAB algorithm commonly used has a limitation condition including confidence interval upper bound, tompson sampling and other methods, namely the value of the yield (or effect) must be in the [0,1] interval, and the partial improvement method can also popularize the methods to [ a, b ] (a, b belongs to real numbers).

Soft Max MAB is a method applicable to the whole real number domain range, and the calculation mode is shown in the formula (2). But it has two problems, namely that the probability of output is affected by the absolute difference of effect, and that the order of magnitude of the absolute difference of effect is not uniform among different types of indexes. For example, for CPM, the difference of 0.01 is not significant, whereas for CTR the difference of 0.01 is already very large. Under the advertising experimental scene, because the effect indexes of different playing strategies (sub-flows) are usually very small, the probability difference of each playing strategy calculated by adopting a Soft Max MAB mode is also very small, so that the distribution proportion of each sub-flow is basically the same, and the final convergence to a certain sub-flow is difficult, and the formula 2 is referred to.

Equation 2

Therefore, the Soft Max MAB is modified in two parts, one part is that the effect indexes are firstly logarithmic and then substituted into the Soft Max MAB, the output probability of indexes of different orders of magnitude is ensured to be unchanged under the condition that the relative difference is the same, the other part is that a convergence coefficient is introduced, under the same relative difference, the output probability is more uneven along with the increase of the convergence coefficient, and the playing strategy probability with good effect is higher. The specific calculation mode is shown in the formula 3.

Equation 3

Referring to fig. 7, fig. 7 is an optional flowchart of a multimedia information processing method according to an embodiment of the present invention, where the determined flow parameter, iteration experiment parameter and adjustment history information of a section of the flow parameter, which are determined to be matched with a play policy of multimedia information, may be sent to a corresponding server, and when a play policy query instruction is received, the flow parameter, iteration experiment parameter and adjustment history information of the section of the flow parameter, which are matched with the play policy of multimedia information, are presented in a display interface.

After the adjustment of the multimedia information to be played is completed, when the multimedia information is the embedded advertisement information in the short video, monitoring the exposure parameter of the short video, determining the Manrong visual effect index corresponding to the embedded advertisement information according to the exposure parameter of the short video, and adjusting the playing configuration information corresponding to the embedded advertisement information in the short video according to the Manrong visual effect index corresponding to the embedded advertisement information through the topology file. When any parameter in the mannian visual effect index corresponding to the implanted multimedia information does not reach the corresponding parameter threshold, the playing of the target video may be adjusted, for example, the video to be implanted may be replaced. For example, when the proportion of the implanted multimedia information displayed on the screen is lower than a preset proportion threshold value of 0.1 (the ratio of the multimedia information to the face value of the display screen), the video to be implanted is replaced again, so that the re-implantation of the corresponding multimedia information is realized, and the user to which the multimedia information belongs can push the multimedia information to the audience in time, thereby ensuring the throwing effect of the multimedia information.

In some embodiments of the present invention, the multimedia information processing method further includes:

Transmitting the multimedia information identifier, the play configuration information and the play strategy to the blockchain network so that

And filling the multimedia information identifier, the playing configuration information and the playing strategy into a new block by the nodes of the blockchain network, and when the new block is commonly recognized, adding the new block to the tail part of the blockchain to realize that the terminals in different use environments of the same user can acquire the information in the block, wherein the identifier information is used for representing the multimedia information put by an advertiser.

Referring to fig. 8, fig. 8 is a schematic diagram of an architecture of a multimedia information processing apparatus 100 according to an embodiment of the present invention, including a blockchain network 700 (illustrating a consensus node 710-1, a consensus node 710-2, and a consensus node 710-3), an authentication center 800, a service entity 400, and a service entity 500, respectively, are described below.

The type of blockchain network 700 is flexible and diverse, and may be any of public, private, or federated chains, for example. Taking public chains as an example, any electronic equipment of a service body, such as a user terminal and a server, can access the blockchain network 700 without authorization, taking alliance chains as an example, electronic equipment (such as a terminal/server) under the jurisdiction of the service body after the service body obtains authorization can access the blockchain network 700, and at the moment, the electronic equipment becomes a client node in the blockchain network 700.

In some embodiments, the client node may be implemented as a mere observer of blockchain network 700, i.e., providing functionality that supports a business entity to initiate transactions (e.g., for storing data in the uplink or querying data on the chain), and may default or be selectively implemented (e.g., depending on the specific business needs of the business entity) for the functions of the consensus nodes of blockchain network 700, such as ordering functions, consensus services, ledger functions, and the like. Thus, the data and service processing logic of the service body can be migrated to the blockchain network 700 to the greatest extent, and the credibility and traceability of the data and service processing process are realized through the blockchain network 700.

The consensus nodes in blockchain network 700 receive transactions submitted from client nodes (e.g., client node 410 attributed to business entity 400, and client node 510 attributed to the respective servers, shown in fig. 8) of different business entities (e.g., business entity 400 and business entity 500, shown in fig. 8), execute the transactions to update or query the ledger, and various intermediate or final results of executing the transactions may be displayed back in the client nodes of the business entity.

For example, the client nodes 410/510 may subscribe to events of interest in the blockchain network 700, such as transactions occurring in a particular organization/channel in the blockchain network 700, with the consensus node pushing a corresponding transaction notification to the client nodes 410/510, triggering corresponding business logic in the client nodes 410/510.

An exemplary application of the blockchain network is described below taking as an example the accessing of multiple service principals to the blockchain network to enable the management and processing of multimedia information.

Referring to fig. 8, a plurality of service entities involved in the management link, such as service entity 400 may be a multimedia information processing device carried thereon, service entity 500 may be a display system with a multimedia information display (operation) function, and register and obtain respective digital certificates from authentication center 800, where the digital certificates include a public key of the service entity, and a digital signature signed by authentication center 800 for the public key and identity information of the service entity, and are used to be attached to a transaction together with the digital signature of the service entity for the transaction, and sent to a blockchain network, so that the blockchain network can take out the digital certificates and signatures from the transaction, verify the reliability (i.e. whether it has not been tampered) of the message and the identity information of the service entity sending the message, and the blockchain network can verify according to the identity, for example, whether it has authority to initiate the transaction. A client operated by an electronic device (e.g., a terminal or a server) under the control of a service entity may request access from the blockchain network 700 to become a client node.

The client node 410 of the service body 400 acquires corresponding play configuration information in a multimedia information play environment, configures a corresponding test interface for a play strategy adjustment process of the multimedia information based on the play configuration information, configures a matched topology file for the play strategy adjustment process of the multimedia information in response to the configured test interface to acquire the play configuration information dynamically adjusted through the topology file, acquires play effect parameters of the multimedia information through the play strategy adjustment process, determines flow parameters and iteration experiment parameters matched with the play strategy of the multimedia information through the play strategy adjustment process according to the play effect parameters and the play configuration information of the multimedia information, dynamically adjusts the play strategy of the multimedia information based on the flow parameters and the iteration experiment parameters matched with the play strategy of the multimedia information, and sends the multimedia information identification, the play configuration information and the play strategy to the block chain network 700 through the terminal display interface to display the corresponding multimedia information.

The service logic may be set in advance in the client node 410 when the corresponding multimedia information is formed, the client node 410 will automatically send the multimedia information identifier, the play configuration information and the play policy to the blockchain network 700, or a service person of the service body 400 may log in the client node 410, manually package new multimedia information with a purpose matching the use environment, and send the new multimedia information to the blockchain network 700. At the time of transmission, the client node 410 generates a transaction corresponding to the update operation according to the new multimedia information matched with the use environment, specifies in the transaction a smart contract that needs to be invoked to implement the update operation, and parameters transferred to the smart contract, the transaction further carries a digital certificate of the client node 410, a signed digital signature (e.g., obtained by encrypting a digest of the transaction using a private key in the digital certificate of the client node 410), and broadcasts the transaction to consensus nodes in the blockchain network 700.

When a transaction is received in a consensus node in the blockchain network 700, a digital certificate and a digital signature carried by the transaction are verified, after the verification is successful, whether the transaction main body 400 has transaction permission is confirmed according to the identity of the transaction main body 400 carried in the transaction, and any one verification judgment of the digital signature and the permission verification can cause the transaction to fail. After verification is successful, the consensus node's own digital signature (e.g., encrypted with the private key of consensus node 710-1) is signed and broadcast continues in blockchain network 700.

After receiving a successful transaction, the consensus node in blockchain network 700 populates the new block with the transaction and broadcasts the transaction. When a new block is broadcast by a consensus node in the blockchain network 700, a consensus process is performed on the new block, if the consensus is successful, the new block is added to the tail of the blockchain stored by the new block, and a state database is updated according to the result of the transaction, wherein for the transaction of submitting updated multimedia information, the identification information of the target user and the control component information, a key value pair comprising the identification of the multimedia information, playing configuration information and playing strategy is added in the state database.

The service personnel of the service entity 500 logs in the client node 510, inputs multimedia information or a multimedia information query request, the client node 510 generates a transaction corresponding to the update operation/query operation according to the multimedia information or the multimedia information query request, specifies an intelligent contract required to be invoked for implementing the update operation/query operation and parameters transferred to the intelligent contract in the transaction, the transaction further carries a digital certificate of the client node 510, a signed digital signature (for example, a digest of the transaction is encrypted using a private key in the digital certificate of the client node 510), and broadcasts the transaction to consensus nodes in the blockchain network 700.

After the transaction is verified, the block is filled and the consensus is consistent, the filled new block is added to the tail part of the block chain stored by the block chain network 700, the state database is updated according to the transaction result, the transaction in the new block is executed, the key value pair corresponding to the multimedia information in the state database is updated according to the manual identification result for the submitted transaction updating the manual identification result corresponding to the multimedia information, and the key value pair corresponding to the multimedia information is queried from the state database and the transaction result is returned for the submitted transaction querying the multimedia information.

It should be noted that, in fig. 8, the process of linking the multimedia information identifier, the play configuration information, and the play policy is exemplarily shown, but in other embodiments, for the case that the data size of the multimedia information is large, the client node 410 may pair-link the hash of the multimedia information and the hash of the corresponding multimedia information, and store the original multimedia information and the corresponding multimedia information in the distributed file system or the database. After the client node 510 obtains the multimedia information and the corresponding multimedia information from the distributed file system or database, it may perform verification in combination with the corresponding hash in the blockchain network 700, thereby reducing the workload of the uplink operation.

As an example of a blockchain, referring to fig. 9, fig. 9 is a schematic diagram of a blockchain structure in a blockchain network 700 provided by an embodiment of the present invention, where a header of each block may include hash values of all transactions in the block, and also include hash values of all transactions in a previous block, a record of a newly generated transaction is filled into the block and after passing through a node in the blockchain network, is appended to a tail of the blockchain to form a chain growth, and a chain structure based on the hash values between the blocks ensures tamper resistance and forgery resistance of transactions in the block. The multimedia information stored in the blockchain network may be single multimedia information (such as a picture or a poster or a video) put by a certain advertiser, and the multimedia information may be shared between different nodes by storing in the blockchain network.

Referring to fig. 10, fig. 10 is a schematic diagram of a functional architecture of a blockchain network 700 according to an embodiment of the present invention, including an application layer 701, a consensus layer 702, a network layer 703, a data layer 704, and a resource layer 705, which are described below.

The resource layer 705 encapsulates computing resources, storage resources, and communication resources that implement various consensus nodes in the blockchain network.

Data layer 704 encapsulates various data structures that implement the ledger, including blockchains implemented with files in a file system, a keyed state database, and presence certificates (e.g., hash trees of transactions in the blocks).

The network layer 703 encapsulates the functions of Point-to-Point (P2P) network protocols, data propagation mechanisms and data verification mechanisms, access authentication mechanisms, and service body identity management.

Wherein the P2P network protocol enables communication between the consensus nodes in the blockchain network 700, a data propagation mechanism ensures propagation of transactions in the blockchain network 700, a data verification mechanism is used to enable reliability of data transmission between the consensus nodes based on cryptography methods (e.g., digital certificates, digital signatures, public/private key pairs), an access authentication mechanism is used to authenticate identities of service principals joining the blockchain network 700 according to actual service scenarios and to give the service principals access rights to the blockchain network 700 when authentication passes, and a service principal identity management is used to store identities of service principals allowed to access the blockchain network 700, and rights (e.g., types of transactions that can be initiated).

Consensus layer 702 encapsulates the functionality of the mechanisms by which consensus nodes in blockchain network 700 agree on blocks (i.e., consensus mechanisms), transaction management, and ledger management. The consensus mechanism comprises consensus algorithms such as POS, POW and DPOS, and the like, and supports the pluggable of the consensus algorithms.

The transaction management is used for verifying a digital signature carried in the transaction received by the consensus node, verifying the identity information of the service entity, judging and confirming whether the service entity has authority to conduct the transaction according to the identity information (reading related information from the identity management of the service entity), and for the service entity which obtains the authorization of accessing the blockchain network 700, all the service entity has a digital certificate issued by an authentication center, and the service entity signs the submitted transaction by utilizing a private key in the own digital certificate so as to declare the legal identity of the service entity.

Ledger management is used to maintain blockchains and state databases. And executing the transaction in the block with the consensus, updating the key value pairs in the state database when the transaction comprises an updating operation, querying the key value pairs in the state database when the transaction comprises a querying operation and returning a query result to the client node of the business entity. The query operation supporting multiple dimensions of the state database comprises the steps of querying a block according to a block vector number (such as a hash value of a transaction), querying the block according to the hash value of the block, querying the block according to the transaction vector number, querying the transaction according to the transaction vector number, querying account data of a service body according to an account number (vector number) of the service body, and querying a blockchain in a channel according to a channel name.

The application layer 701 encapsulates various services that the blockchain network can implement, including tracing, certification, verification, etc. of transactions.

In the following, taking multimedia information as an advertisement of a commodity as an example, the method for processing multimedia information provided by the present invention is described with reference to fig. 11, and fig. 11 is a schematic diagram of playing an alternative multimedia information in an embodiment of the present invention, where in some embodiments of the present invention, when multimedia information played in a multimedia information playing window through a short video is a video advertisement, a triggering operation for the multimedia information playing window is received, and in response to the triggering operation, the service processing interface is presented and jumps to a commodity display interface indicated by the multimedia information, so that a user can more conveniently purchase a commodity presented for the multimedia information playing window. When the advertisement is played, manual flow distribution is generally adopted, namely, in a certain period of time, the effect index of each sub-flow under the condition of current flow proportion distribution is observed manually, then the sub-flow with the best effect is selected, and the flow proportion is increased in the next observation period, so that the advertisement has the defects of high labor cost, low distribution efficiency and influence by subjective factors. Or based on the dynamic adjustment of batch processing, namely, sampling and accumulating the flow batch, and then applying the Toepson sampling method in the MAB algorithm according to the effect data of each sub-flow of the batch in the current period to give the proportional allocation of each sub-flow in the next period, the defects are that the allocation result is easy to fluctuate, the allocation difference is not obvious, and the algorithm mobility is poor.

With continued reference to fig. 12, fig. 12 is an optional flowchart of a multimedia information processing method according to an embodiment of the present invention, and it will be appreciated that the steps shown in fig. 12 may be performed by various terminals running the multimedia information processing apparatus, for example, a dedicated terminal with a multimedia information processing function, an electronic device (a mobile phone or a tablet computer), or the like. The following is a description of the steps shown in fig. 12.

Step 1201, obtaining original data of the playing effect of the advertisement corresponding to the version information of the topology file.

Step 1202, accumulating the play effect data with accumulated dimension in the play effect data of the advertisement, determining matched calculation factors by the play effect data with non-accumulated dimension, and performing accumulation processing.

Step 1203, acquiring the total experimental configuration information in the advertisement test.

Step 1204, adjusting a convergence factor matched with the advertisement information.

With reference to table 1, for the same advertisement combination, by configuring the allocation results of different convergence coefficients, it can be determined that as the convergence coefficient increases, the larger the difference of the flow allocation results, that is, the higher the ratio of the effective playing policy to the flow is, the smaller the ratio of the flow allocated to the playing policy with poor effect is.

TABLE 1

And 1205, dynamically adjusting the advertisement playing strategy through the playing strategy adjusting process.

Step 1206, playing the advertisement based on the adjusted advertisement playing policy, and recording the playing effect data.

Referring to table 2, for the advertisement playing strategy configured by the multimedia information processing method provided by the application, a more suitable advertisement playing strategy can be obtained for different advertisements, more suitable traffic is obtained, the advertising efficiency is improved, and the use experience of advertisers is improved.

TABLE 2

Referring to fig. 13, fig. 13 is a schematic diagram of optional multimedia information playing in an embodiment of the present invention, and by using the multimedia information processing method provided in the embodiment of the present invention in fig. 12, advertisement information played in an advertisement space in a multimedia information playing environment may be replaced, and advertisement a is replaced by advertisement B, so as to achieve configuring more playing traffic for advertisement B, and achieve better viewing experience for a user. Specifically, based on the flow parameter and the iteration experiment parameter matched with the playing strategy of the advertisement information, when the playing strategy of the advertisement information is dynamically adjusted, the exposure rate of the advertisement can be increased, in some embodiments of the invention, the exposure channel of the advertisement A can be adjusted from the current short video client to the contact state information of the instant messaging client for advertisement delivery, and the exposure position of the advertisement A can be adjusted from the friend circle advertisement of the instant messaging client to the open screen advertisement when the exposure position of the advertisement A is adjusted so as to accord with different dynamically adjusted playing strategies.

The method comprises the steps of obtaining historical browsing information of a target user when a playing strategy of the multimedia information is dynamically adjusted, determining the multimedia information exposure history corresponding to the historical browsing information based on the historical browsing information of the target user, dynamically adjusting the playing strategy of the multimedia information based on the multimedia information exposure history corresponding to the historical browsing information, taking fig. 13 as an example, when the condition that the advertisement B is shielded in the historical browsing information of the target user 1 is determined, replacing the advertisement A with other advertisement information (such as the advertisement C) through the dynamic adjustment of the playing strategy, and when the condition that the advertisement C is shielded in the historical browsing information of the target user 2 is determined, replacing the advertisement A with other advertisement information (such as the advertisement D) through the dynamic adjustment of the playing strategy, so that the use habit of the target user is met, and better use experience is obtained for the user.

Referring to fig. 14, fig. 14 is a schematic diagram of optional multimedia information playing in an embodiment of the present invention, where when different advertisements of the same advertiser are included in a target resource, advertisement information included in different resource groups may be sequentially played in a multimedia information playing window, when all multimedia information playing areas in a display interface are contracted by the advertiser, when the advertisement information playing is finished, the advertisement information of the same advertiser may be circularly presented in the multimedia information playing window of the advertisement information display interface, and meanwhile when the multimedia information of the advertiser is a video advertisement, the video advertisement information of the same advertiser may be circularly presented, and the audio volume carried by the video may be sequentially adjusted to be maximum, so as to prompt the user to watch the played video advertisement. Therefore, the flow parameters and the iteration experiment parameters matched based on the playing strategy of the multimedia information are used for dynamically adjusting the playing strategy of the advertisement information, so that the cost of total deduction (EFFECTIVE COST PER MILLE, ecpm) of each thousand exposures of an advertiser can be reduced, and a better advertisement playing effect is obtained.

The embodiment of the invention has the following beneficial effects:

The foregoing description of the embodiments of the invention is not intended to limit the scope of the invention, but is intended to cover any modifications, equivalents, and alternatives falling within the spirit and principles of the invention.

Claims

1. A multimedia information processing method, the method comprising:

obtaining playing effect data of the multimedia information corresponding to the version information of the topology file;

when the play effect data of the multimedia information is play effect data with accumulated dimension, respectively accumulating the play effect data of different types to obtain play effect parameters of the multimedia information;

When the play effect data of the multimedia information is play effect data with a non-accumulative dimension, determining a calculation factor matched with the play effect data with the non-accumulative dimension, and performing accumulation processing on the calculation factor to obtain play effect parameters of the multimedia information;

and dynamically adjusting the playing strategy of the multimedia information based on the flow parameters and the iteration experiment parameters matched with the playing strategy of the multimedia information so as to realize the exposure strategy suitable for the configuration of the multimedia information.

2. The method according to claim 1, wherein the obtaining the corresponding play configuration information in the multimedia information playing environment includes:

Monitoring operation information in a play configuration display interface;

And responding to the monitored operation information, and determining the triggering states of different control components in the display interface, wherein the different control components in the display interface comprise a strategy index component, a strategy type component, a strategy name component and an iteration time component.

3. The method according to claim 1, wherein the determining, according to the playback effect parameter and the playback configuration information of the multimedia information, the flow parameter and the iteration experiment parameter that are matched with the playback policy of the multimedia information through the playback policy adjustment process includes:

determining a playing strategy of the corresponding multimedia information according to the version information of the topology file;

Determining optimization target data of the multimedia information based on the playing effect parameters of the multimedia information and the playing strategy of the multimedia information;

and determining flow parameters and iteration experiment parameters matched with the playing strategy of the multimedia information through the playing strategy of the multimedia information and the optimizing target data of the multimedia information, wherein the experiment parameters are matched with the corresponding playing strategy.

4. The method according to claim 3, wherein the dynamically adjusting the play policy of the multimedia information based on the flow parameter and the iteration experiment parameter matched with the play policy of the multimedia information to implement the exposure policy adapted to the configuration of the multimedia information includes:

dynamically adjusting the exposure rate corresponding to the multimedia information, or

Adjusting the exposure channel corresponding to the multimedia information, or

And adjusting the exposure position corresponding to the multimedia information.

5. A method according to claim 3, characterized in that the method further comprises:

And dynamically adjusting the interval of the flow parameters of the multimedia information playing environment through the test interface based on the determined exposure times matched with the playing strategy of the multimedia information and the iteration experiment parameters.

6. A method according to claim 3, characterized in that the method further comprises:

transmitting the determined flow parameters, iteration experiment parameters and adjustment history information of intervals of the flow parameters, which are matched with the play strategy of the determined multimedia information, to a corresponding server;

when a play strategy query instruction is received, flow parameters, iteration experiment parameters and adjustment history information of intervals of the flow parameters, which are matched with the play strategy of the multimedia information, are presented in a display interface.

7. The method according to claim 1, wherein the method further comprises:

When the multimedia information is embedded advertisement information in a short video, monitoring exposure parameters of the short video;

Determining a Manrong visual effect index corresponding to the implanted advertisement information according to the exposure parameters of the short video;

and adjusting playing configuration information corresponding to the embedded advertisement information in the short video through the topology file according to the Manrons visual effect index corresponding to the embedded advertisement information.

8. The method of claim 7, wherein the method further comprises:

Transmitting the exposure parameters during the short video playing to a monitoring server so as to realize the monitoring of the short video exposure by the monitoring server;

and taking the exposure parameters stored by the monitoring server during the short video playing as a data source of the playing effect parameters of the multimedia information.

9. The method according to claim 1, wherein the method further comprises:

Acquiring historical browsing information of a target user;

determining a multimedia information exposure history corresponding to the history browsing information based on the history browsing information of the target user;

and dynamically adjusting the playing strategy of the multimedia information based on the multimedia information exposure history corresponding to the history browsing information.

10. The method according to claim 1, wherein the method further comprises:

Determining the use environment of a terminal display interface;

Determining the class of the multimedia information to be played according to the use environment of the terminal display interface;

And responding to the category of the multimedia information to be played, and triggering the matched multimedia information data source to realize the adjustment of the multimedia information to be played through the multimedia information data source matched with the category of the multimedia information to be played.

11. The method according to any one of claims 1-9, wherein the method further comprises:

sending the multimedia information identification, the play configuration information and the play strategy to the blockchain network so that

12. A multimedia information processing apparatus, characterized in that the apparatus comprises:

the information transmission module is used for acquiring corresponding playing configuration information in the multimedia information playing environment;

The information processing module is used for acquiring the play effect data of the multimedia information corresponding to the version information of the topology file, respectively carrying out accumulation processing on different types of play effect data to obtain the play effect parameters of the multimedia information when the play effect data of the multimedia information is play effect data with an accumulated dimension, determining a calculation factor matched with the play effect data with the non-accumulated dimension when the play effect data of the multimedia information is play effect data with a non-accumulated dimension, and carrying out accumulation processing on the calculation factor to obtain the play effect parameters of the multimedia information;

13. The apparatus of claim 12, wherein the device comprises a plurality of sensors,

The information transmission module is used for monitoring operation information in a play configuration display interface, and responding to the monitored operation information, determining trigger states of different control components in the display interface, wherein the different control components in the display interface comprise a strategy index component, a strategy type component, a strategy name component and an iteration time component.

14. The apparatus of claim 12, wherein the device comprises a plurality of sensors,

The information processing module is used for determining a playing strategy of corresponding multimedia information according to version information of the topology file, determining optimization target data of the multimedia information based on playing effect parameters of the multimedia information and the playing strategy of the multimedia information, and determining flow parameters and iteration experiment parameters matched with the playing strategy of the multimedia information through the playing strategy of the multimedia information and the optimization target data of the multimedia information, wherein the experiment parameters are matched with the corresponding playing strategy.

15. An electronic device, the electronic device comprising:

A memory for storing executable instructions;

a processor for implementing the multimedia information processing method according to any one of claims 1 to 11 when executing the executable instructions stored in the memory.

16. A computer-readable storage medium storing executable instructions which, when executed by a processor, implement the multimedia information processing method of any one of claims 1 to 11.

17. A computer program product comprising computer instructions which, when executed by a processor, implement the multimedia information processing method of any one of claims 1 to 11.