CN113420244A - Dynamic effect template generation method, dynamic picture display method and device and electronic equipment - Google Patents
Dynamic effect template generation method, dynamic picture display method and device and electronic equipment Download PDFInfo
- Publication number
- CN113420244A CN113420244A CN202010701672.0A CN202010701672A CN113420244A CN 113420244 A CN113420244 A CN 113420244A CN 202010701672 A CN202010701672 A CN 202010701672A CN 113420244 A CN113420244 A CN 113420244A
- Authority
- CN
- China
- Prior art keywords
- picture
- commodity
- dynamic effect
- dynamic
- effect template
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/957—Browsing optimisation, e.g. caching or content distillation
- G06F16/9577—Optimising the visualization of content, e.g. distillation of HTML documents
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0641—Shopping interfaces
Abstract
The embodiment of the invention provides a dynamic effect template generation method, a dynamic picture display device and electronic equipment, wherein the dynamic picture display method comprises the steps of receiving a commodity picture to be displayed; determining a matched dynamic effect template based on the characteristics of the commodity picture; and dynamically displaying the commodity picture on a client according to the dynamic effect template. In the embodiment of the invention, the dynamic effect template is flexibly matched on the client according to the received commodity picture, the commodity picture is dynamically displayed based on the dynamic effect template, the user can realize dynamic display only by providing the static commodity picture, the video file is not required to be stored and transmitted by the server in the whole process, and flexible and changeable dynamic display can be performed based on the dynamic effect template.
Description
Technical Field
The application relates to a dynamic effect template generation method, a dynamic picture display device and electronic equipment, and belongs to the technical field of computers.
Background
With the development of mobile internet technology and e-commerce industry, merchants on e-commerce platforms increasingly use short videos to display various commodities, and due to the fact that the commodities can be displayed in a more interesting and vivid manner through the short videos, users are willing to know commodity information, and therefore the commodity display effect is greatly improved.
However, short videos published on current e-commerce platforms are pre-made and uploaded by merchants. Because good short video production needs a certain professional level, production difficulty is high for some merchants, or special personnel needs to be configured for video production, so that operation cost is also increased. On some C2C e-commerce platforms, since many businesses are individual users, short videos are more rare, and the advertising effect of the goods is also reduced.
Disclosure of Invention
The embodiment of the invention provides a dynamic effect template generation method, a picture dynamic display device and electronic equipment, and aims to improve the dynamic display effect of pictures.
In order to achieve the above object, an embodiment of the present invention provides a method for dynamically displaying a picture, including:
receiving a commodity picture to be displayed;
determining a matched dynamic effect template based on the characteristics of the commodity picture;
and dynamically displaying the commodity picture on a client according to the dynamic effect template.
The embodiment of the invention also provides a dynamic effect template generation method, which comprises the following steps:
acquiring background audio, and analyzing rhythm characteristic information and frequency domain characteristic information in the background audio;
determining a matched picture display special effect and/or transition special effect according to the frequency domain characteristic information, and determining a picture display stuck point according to the rhythm characteristic information;
and synthesizing the background audio, the picture display stuck point, the picture display special effect and/or the transition special effect to generate the dynamic effect template.
The embodiment of the invention also provides a picture dynamic display device, which comprises:
the acquisition module is used for receiving a commodity picture to be displayed;
the dynamic effect template determining module is used for determining a matched dynamic effect template based on the characteristics of the commodity picture;
and the dynamic display module is used for dynamically displaying the commodity picture on the client according to the dynamic effect template.
The embodiment of the invention also provides a dynamic effect template generation device, which comprises:
the audio characteristic analysis module is used for acquiring background audio and analyzing rhythm characteristic information and frequency domain characteristic information in the background audio;
the special effect stuck point determining module is used for determining the matched picture display special effect and/or transition special effect according to the frequency domain characteristic information and determining a picture display stuck point according to the rhythm characteristic information;
and the dynamic effect template generating module is used for synthesizing the background audio, the picture display stuck point, the picture display special effect and/or the transition special effect to generate the dynamic effect template.
The implementation of the invention also provides a picture dynamic display method, which comprises the following steps:
receiving a commodity picture to be displayed;
determining a corresponding dynamic effect template according to the display position of the commodity picture;
and dynamically displaying the commodity picture on a client according to the dynamic effect template.
The embodiment of the invention also provides a method for generating the video effect, which comprises the following steps:
receiving a picture;
generating a video based on the determined dynamic effect template;
and displaying the video at the client.
An embodiment of the present invention further provides an electronic device, including:
a memory for storing a program;
and the processor is used for operating the program stored in the memory so as to execute the picture dynamic display method.
An embodiment of the present invention further provides an electronic device, including:
a memory for storing a program;
and the processor is used for operating the program stored in the memory so as to execute the dynamic effect template generation method.
According to the dynamic effect template generation method, the dynamic picture display device and the electronic equipment, the dynamic effect template is flexibly matched on the client according to the received commodity picture, the commodity picture is dynamically displayed based on the dynamic effect template, a user can realize dynamic display only by providing a static commodity picture, a server is not required to store and transmit a video file in the whole process, and flexible and changeable dynamic display can be carried out based on the dynamic effect template.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
Drawings
FIG. 1 is a schematic diagram of a system architecture for dynamically displaying pictures according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart illustrating a method for dynamically displaying pictures according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating a dynamic effect template generating method according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of a dynamic picture display device according to an embodiment of the present invention;
FIG. 5 is a schematic structural diagram of a dynamic effect template generating apparatus according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
The technical solution of the present invention is further illustrated by some specific examples.
The embodiment of the invention provides a dynamic picture display method. As a user of a merchant, in the publishing process, only a static picture needs to be provided, the effect based on video display can be realized without professional video production, and in the displaying process, video files do not need to be stored and transmitted, so that the resource utilization rate is reduced.
Fig. 1 is a schematic diagram of a system architecture for dynamically displaying pictures according to an embodiment of the present invention. The method comprises the steps that a merchant user uploads a commodity picture to be displayed to a server of an e-commerce platform for publishing, the e-commerce platform stores the commodity picture provided by the merchant in a correlation mode with a corresponding commodity, the publishing process can be a static picture publishing process, videos do not need to be generated and stored, and extra operation is not needed in the publishing process of the merchant user.
When the client accesses the e-commerce platform, the e-commerce platform sends the commodity picture corresponding to the accessed commodity page to the client. At the local part of the client, a plurality of dynamic effect template sets are stored in advance. After receiving a commodity picture to be displayed, extracting the characteristics of the commodity picture, inputting the characteristics of the commodity picture into a dynamic effect template matching model for processing, wherein the model can match a more suitable dynamic effect template from a dynamic effect template set based on the characteristics of the commodity picture so as to be used for dynamic display of pictures in the future study. The feature extraction module can extract image features in aspects of color gamut, saliency and the like in the commodity picture, can also identify content in the commodity picture to extract features in aspects of picture content, and then matches out a proper dynamic effect template based on the features.
The dynamic effect template matching model may adopt a machine learning model, the machine learning model may use some existing dynamic effect videos and commodity pictures for generating the dynamic effect videos as training data, where the dynamic effect video refers to a video file which is made by a platform of an e-commerce or a merchant user and dynamically shows the pictures, and the video file is restored to a static picture and a dynamic effect template having a corresponding relationship, so as to be used as a training sample for the dynamic effect template matching model, of course, the training sample may also adopt a calibration mode, that is, a matching relationship between the static picture and the dynamic effect template as the training sample may be manually marked for training the machine learning model. It should be noted that the feature extraction module can be trained with the dynamic template matching model as part of the machine learning model.
The dynamic effect template matching model can perform dynamic effect model matching based on the characteristics of the commodity picture, and can also incorporate the user characteristics and/or the commodity characteristics into the model matching processing. The two parts of characteristics are shown by dotted arrows, and can be used as auxiliary information to acquire dynamic effect templates which are more suitable for users and commodities. The commodity features can be obtained from feature extraction of commodity information, and the commodity information can be pushed to a client together with a commodity picture when the client accesses a commodity page of the E-commerce platform. The commodity information may include commodity names, commodity specification information, commodity descriptions, and the like, and these information may generally exist in a text form, and corresponding commodity features are extracted by performing semantic parsing on the text. The user features may be derived from feature extraction of one or more of user information, user transaction behavior data, and user operational behavior data. The user information may be some registration information of the user as a consumer on the e-commerce platform, such as age, gender, address information, and the like, and the user transaction behavior data may be a record of the commodity purchase of the user, and the like. The user operation behavior data can be an access record, an operation mode, a browsing mode and the like of the user accessing the commodity page. The user information and the user transaction behavior data can come from the e-commerce platform, and the user operation behavior data can come from a local record of the client. The user feature extraction and the commodity feature extraction can be completed by a feature extraction module, and the feature extraction module can configure corresponding image feature coding models, text feature coding models and the like according to actual needs to realize the feature extraction processing.
After various features are extracted, the features are input as features of a dynamic effect template matching model, a suitable dynamic effect template is found out from an existing dynamic effect template set based on the processing of the trained dynamic effect template matching model, in the actual processing, each dynamic effect template can be scored according to the matching degree, the picture is displayed according to the dynamic effect template with the highest selection score, of course, a plurality of dynamic effect templates with the front scores can be selected to prompt a user to select, and the picture is dynamically displayed after the user selects.
The dynamic effect template matched by the dynamic effect template matching model can give consideration to various characteristics. When the user characteristics are taken as one of the configuration characteristics, the personalized picture dynamic display for the user can be realized, for example, a softer and lovely dynamic effect template can be used for girls, and a milder dynamic effect template can be used for old people, so that the personalized display of thousands of people is realized.
The above-mentioned dynamic effect template may be included as one or more of background audio, a picture showing stuck point, a picture showing special effect, and a transition special effect. The animation template itself may be a JSON (JavaScript Object Notation, a lightweight data exchange format) formatted file, which is actually a sequence file, in which background audio is used as a time line to form a series of sequences of picture display clips, picture display special effects, and transition special effects. In the process of dynamic display, commodity pictures are inserted into the picture display checkpoints of the dynamic templates to form a picture dynamic effect display sequence, and then the sequence files are operated, so that the picture dynamic effect display sequence is executed, and the dynamic display of the pictures is realized. It should be noted that, in the embodiment of the present invention, a video file is not generated and then played, but a sequence file obtained by combining an action template and a still picture is directly executed, so that the video file does not need to be saved, and a player for playing a video does not need to be embedded.
In the process of dynamically displaying pictures based on the dynamic effect template, the special effect display may be implemented based on an OpenGL (Open Graphics Library) Library and/or a WebGL (Web Graphics Library), where the OpenGL Library is mainly for dynamic display on an application interface of a client and the WebGL Library is mainly for dynamic display on a browser page of the client.
The dynamic effect template set on the client can periodically acquire the updated dynamic effect template set from the e-commerce platform, or access the e-commerce platform to acquire the updated dynamic effect template set when the client application is started every time, or acquire the updated dynamic effect template set from the e-commerce platform when a user accesses a shop page for the first time, and after the updated dynamic effect template set is acquired for the first time, the updated dynamic effect template set can be stored in a local set of the client for subsequent use. The function of obtaining the dynamic effect template can be completed by a dynamic effect template obtaining module arranged on the client. The E-commerce platform can be provided with a dynamic effect template library, all dynamic effect templates are stored in the dynamic effect template library, and the dynamic effect template library is continuously updated. The client can synchronize all the templates in the dynamic effect template library to the local, and can selectively synchronize. For example, the customer may be selectively synchronized with the customer's approval template at the e-commerce platform based on the customer's rating or the customer's characteristics. On the e-commerce platform side, the function of sending the dynamic effect template to the client can be completed by the dynamic effect template sending module.
On one side of the e-commerce platform, a new dynamic effect template can be generated according to specific requirements so as to enrich a dynamic effect template library. In particular, the dynamic effect template generation module in the graph may automatically generate dynamic effect templates based on given background audio. Specifically, after a certain background audio which can be used as a dynamic template music background is acquired, rhythm feature information and frequency domain feature information in the background audio are analyzed. And then, determining the matched picture display special effect and/or transition special effect according to the frequency domain characteristic information, and determining a picture display stuck point according to the rhythm characteristic information. And finally, synthesizing the background audio, the picture display stuck point, the picture display special effect and/or the transition special effect to form a sequence file, namely generating the dynamic effect template. The image display special effect and/or the transition special effect are matched according to the frequency domain characteristic information, the image display stuck point is determined according to the rhythm characteristic information, the two parts of processing can be completed through a machine learning model, and the matching relation between the frequency domain characteristic information in the audio and the image display special effect and/or the transition special effect is established through training of the machine learning model, so that the image display special effect and/or the transition special effect can be matched according to different background audio. Similarly, a matching relation between the rhythm characteristics in the audio and the set positions of the picture display stuck points is established through training of the machine learning model, so that the matching relation is used for matching out the proper stuck points according to different background audio frequencies.
The E-commerce platform can bring the characteristics of the commodities into the process of special effect matching in the process of generating the dynamic effect template, namely, the dynamic effect template with pertinence is generated for different commodities, and the part mainly matches suitable special effects for different types of commodities, for example, sports commodities match special effects with dynamic and active effects, children commodities can match special effects with cartoon styles, and the like. Specifically, after the commodity features of the specified commodity are obtained, when the special effect is matched, the matched picture display special effect and/or transition special effect can be determined according to the frequency domain feature information of the background audio and the commodity features. After the formed dynamic effect template is adopted, the corresponding commodity category label can be distributed to the dynamic effect template according to the commodity category corresponding to the specified commodity, so that the dynamic effect template is more accurately matched in the subsequent use process. Specifically, the client may receive the commodity picture and the related commodity information provided from the e-commerce platform, and then determine the category corresponding to the commodity according to the commodity information, that is, determine the commodity category label. The client can add the characteristic dimension of the commodity category label when matching the dynamic effect template, can use the characteristics of the commodity picture and the commodity category label as the input of the dynamic effect template matching model, and determines the matched dynamic effect template from the dynamic effect template set. In this way, a dynamic template more suitable for the current displayed commodity can be determined.
In the picture dynamic display technology of the embodiment of the invention, the proper dynamic effect template is flexibly matched through the commodity picture and information such as user characteristics, commodity characteristics and the like can be combined, the static picture is dynamically played based on the dynamic effect template, the matching of the dynamic effect template and the picture dynamic display process are completed on a client, the resources of a power utility platform cannot be occupied, and video files do not need to be transmitted. In addition, when the user characteristics are introduced to match the dynamic effect template, personalized dynamic effect display can be provided for different users, so that the display effect of thousands of people can be realized.
In addition, in the aspect of displaying contents, not only still pictures, but also short video clips, that is, video clips are used as display units, and long videos are generated and displayed by combining special effect processing of the dynamic effect template. In addition, the uploaded pictures can also contain some dynamic information, such as text information or audio information, and the information can also be embodied in the template.
In the aspect of application scenes, the display device can be used for commodity display in commodity stores, and can also be applied to advertisement space display and the like. For a merchant user, the technology provided by the embodiment of the invention can be integrated into various merchant tools, and products with personalized display effects are provided for merchants.
In the aspect of interaction with the user, the template can be dynamically updated based on the interaction condition with the consumer user, for example, the browsing time, the operation mode and the like of the user can be collected, and the template is updated according to the user behavior, so that the subsequent picture display can better conform to the habit of the user. When the dynamic effect template is oriented to the merchant user, the appropriate dynamic effect template can be recommended to the merchant user in a recommending mode so that the merchant user can select the dynamic effect template.
Example one
Fig. 2 is a schematic flow chart of a method for dynamically displaying pictures according to an embodiment of the present invention, which may be executed on a client, where in an embodiment of the present invention, the client serves as a display and provides dynamic display of commodity pictures to a user serving as a consumer. The method comprises the following steps:
s101: and receiving a commodity picture to be displayed. The commodity picture can be a commodity picture from a server, and then, the characteristics of the commodity picture are extracted according to the commodity picture. The features extracted for the commodity picture may mainly include extracting a color gamut and/or a saliency in the commodity picture, and generating features of the commodity picture according to the color gamut and/or the saliency. The color gamut and/or the saliency can be used as important references for matching the display special effects and transition special effects of the pictures, for example, the bright pictures in the color gamut can be matched with the cool special effects, and the transition from clear to dim or from dim to clear can be added to the special effects with strong saliency during transition between the pictures, so that the picture transition is rich in variability. Besides the characteristics of the commodity picture, the user characteristics and/or the commodity characteristics can be acquired to serve as the matching basis of the follow-up dynamic effect template. The commodity characteristics can be obtained by receiving commodity information from the server, extracting the commodity characteristics according to the commodity information, and the commodity information can include commodity names, commodity specification information, commodity descriptions and the like. The user characteristics can be from characteristic extraction of user information and/or user transaction behavior data and/or user operation behavior data, wherein the user information and/or user transaction behavior data can be from a server on the network side, and the user operation behavior data can be from a local record of a client. The server on the network side referred to here may correspond to the server of the e-commerce platform described above.
S102: and determining a matched dynamic effect template based on the characteristics of the commodity picture. In addition, in the aspect of determining the dynamic effect template, matching processing can be performed based on the user characteristics and/or the commodity characteristics. In particular, a matching dynamic effect template may be determined based on features of the commodity picture using a dynamic effect template matching model. The dynamic effect template matching model can adopt a machine learning model, and the machine learning model can use some existing dynamic effect videos and commodity pictures for generating the dynamic effect videos as training data to establish a corresponding relation between the dynamic effect template for generating the dynamic effect videos and the commodity pictures, namely the corresponding relation between the characteristics of the dynamic effect template and the commodity pictures. In addition, the user characteristics and/or the commodity characteristics can be introduced as input of the dynamic template matching model, and accordingly, the user characteristics and/or the commodity characteristics also need to be incorporated into model training.
The above-described matching process of the dynamic effect template is executed on the client side, and a dynamic effect template set may be stored in the client, where the dynamic effect template set is acquired by the client from the server and stored locally. Specifically, the client may periodically obtain the updated dynamic effect template set from the server, or access the e-commerce platform to obtain the updated dynamic effect template set each time the client application is started. Therefore, in the process of matching the dynamic effect model according to the characteristics of the commodity picture and the user characteristics and/or the commodity characteristics, the dynamic effect template matching model can perform matching based on the local dynamic effect template set, namely, the matched dynamic effect template can be determined from the dynamic effect template set.
S103: and dynamically displaying the commodity picture on the client according to the dynamic effect template. In the embodiment of the present invention, the dynamic effect template may include one or more of a background audio, a picture display stuck point, a picture display special effect, and a transition special effect. The dynamic effect template itself may be a JSON formatted file that is actually a sequence file in which background audio is used as a timeline to form a series of sequences of picture presentation checkpoints, picture presentation effects, and transition effects. In the process of dynamic display, commodity pictures are inserted into the picture display checkpoints of the dynamic templates to form a picture dynamic effect display sequence, so that the picture dynamic effect display sequence is executed, and the dynamic display of the pictures is realized.
It should be noted that, in the embodiment of the present invention, the dynamic effect video does not need to be finally generated based on the combination of the dynamic effect template and the commodity picture, but only needs to be stored or cached in the form of the sequence file, and after the playing is completed, the dynamic effect video can be deleted along with the exit of the client application or the end of the access to the commodity page.
According to the picture dynamic display method provided by the embodiment of the invention, the dynamic effect template is flexibly matched on the client according to the received commodity picture, the commodity picture is dynamically displayed based on the dynamic effect template, the user can realize dynamic display only by providing the static commodity picture, the video file is not required to be stored and transmitted by the server in the whole process, and flexible and changeable dynamic display can be performed based on the dynamic effect template.
Example two
Fig. 3 is a schematic flow chart of a dynamic effect template generation method according to an embodiment of the present invention, where the method may be run on an e-commerce platform, that is, may be run on a side of a network-side server, and provides dynamic effect templates for displaying commodities for merchant users and consumer users, and the method includes:
s201: and acquiring background audio, and analyzing rhythm characteristic information and frequency domain characteristic information in the background audio. The background audio may be from audio uploaded by the merchant user or some audio selected by the e-commerce platform, etc. After determining the background audio to be used, rhythm feature information and frequency domain feature information may be extracted based on an audio feature extraction model, wherein the rhythm feature information may be from drumbeats in the audio or audio features of other rhythm-type musical instruments, and the frequency domain feature information may be from frequency distribution features extracted after fourier transform of the audio.
S202: and determining the matched picture display special effect and/or transition special effect according to the frequency domain characteristic information, and determining a picture display stuck point according to the rhythm characteristic information. The two parts of processing can be completed through a machine learning model, and the matching relation between the frequency domain characteristic information in the audio and the picture display special effect and/or the transition special effect is established through training of the machine learning model, so that the method is used for matching a proper special effect according to different background audios. Similarly, a matching relation between the rhythm characteristics in the audio and the set positions of the picture display stuck points is established through training of the machine learning model, so that the matching relation is used for matching out the proper stuck points according to different background audio frequencies.
In addition, in the process of generating the dynamic effect template, the commodity characteristics can be incorporated into the process of special effect matching, that is, the matched picture display special effect and/or transition special effect are determined according to the frequency domain characteristic information and the commodity characteristics, for example, a sports commodity is matched with a special effect with dynamic effect and vitality, and a children commodity is matched with a special effect with a cartoon style and the like.
On the premise that the dynamic effect template is generated according to the commodity characteristics, the corresponding commodity category label can be distributed to the dynamic effect template according to the commodity category corresponding to the specified commodity so as to identify that the dynamic effect template is suitable for a certain type of commodity, and therefore the dynamic effect template suitable for specific commodity display can be matched more accurately when the dynamic effect model is matched subsequently. Specifically, in the process of performing dynamic effect template matching based on the dynamic effect template matching model, the commodity information from the server can be received, and the corresponding commodity category label is determined; and then, based on the dynamic effect template matching model, determining a matched dynamic effect template from the dynamic effect template set according to the characteristics of the commodity picture and the commodity category label.
S203: and synthesizing the background audio, the picture display stuck point, the picture display special effect and/or the transition special effect to generate the dynamic effect template. As described above, the dynamic effect template itself is a sequence file, and after determining the background audio, the picture display stuck point, the picture display special effect and/or the transition special effect, the stuck point and the special effect position can be set on the basis of the time sequence of the background audio, thereby forming the final dynamic effect template. The dynamic effect template can be stored at one side of the server, and then is provided for the client side for subsequent dynamic display of the commodity pictures when being synchronized or updated with the client side.
The method for generating the dynamic effect template can automatically generate the dynamic effect template based on the background audio, so that abundant template resources are provided for dynamic display of commodity pictures by the client side, in addition, in the process of determining the special effect of the dynamic effect template, commodity information can be introduced as the characteristic dimension of special effect matching, the dynamic effect template which meets the commodity display requirements better can be generated, and therefore when the template matching is carried out on one side of a subsequent client side, the proper dynamic effect template can be matched more accurately.
EXAMPLE III
Fig. 4 is a schematic structural diagram of a dynamic picture display device according to an embodiment of the present invention, which may be disposed on a client, where in the embodiment of the present invention, the client serves as a display to provide dynamic display of a commodity picture to a user serving as a consumer. The device includes:
the acquisition module 11 is configured to receive a commodity picture to be displayed. The commodity picture can be a commodity picture from a server, and then, the characteristics of the commodity picture are extracted according to the commodity picture. The features extracted for the commodity picture may mainly include extracting a color gamut and/or a saliency in the commodity picture, and generating features of the commodity picture according to the color gamut and/or the saliency. In addition, the feature obtaining module may be further configured to obtain a user feature, where the user feature may be derived from feature extraction of user information and/or user transaction behavior data and/or user operation behavior data, where the user information and/or user transaction behavior data may be derived from a server on the network side, and the user operation behavior data may be derived from a local record of the client. In addition, the characteristic acquisition module can also receive commodity information from the server, and extract commodity characteristics according to the commodity information, wherein the commodity information can comprise commodity names, commodity specification information, commodity descriptions and the like.
And the dynamic effect template matching module 12 is used for determining a matched dynamic effect template based on the characteristics of the commodity picture. In addition, in the aspect of determining the dynamic effect template, matching processing can be performed based on the user characteristics and/or the commodity characteristics. In particular, a matching dynamic effect template may be determined based on features of the commodity picture using a dynamic effect template matching model. The dynamic effect template matching model can adopt a machine learning model, and the machine learning model can use some existing dynamic effect videos and commodity pictures for generating the dynamic effect videos as training data to establish a corresponding relation between the dynamic effect template for generating the dynamic effect videos and the commodity pictures, namely the corresponding relation between the characteristics of the dynamic effect template and the commodity pictures. In addition, the user characteristics and/or the commodity characteristics acquired by the characteristic acquisition module 11 may also be introduced as input of a dynamic effect template matching model, that is, the dynamic effect template matching module may also be configured to determine a matched dynamic effect template according to the characteristics of the commodity picture and the user characteristics and/or the commodity characteristics based on the dynamic effect template matching model.
The above-described matching process of the dynamic effect template is executed on the client side, and a dynamic effect template set may be stored in the client, where the dynamic effect template set is acquired by the client from the server and stored locally. Specifically, the client may periodically obtain the updated dynamic effect template set from the server, or access the e-commerce platform to obtain the updated dynamic effect template set each time the client application is started. Therefore, in the process of matching the dynamic effect model according to the characteristics of the commodity picture and the user characteristics and/or the commodity characteristics, the dynamic effect template matching model can perform matching based on the local dynamic effect template set, namely, the matched dynamic effect template can be determined from the dynamic effect template set.
And the dynamic display module 13 is used for dynamically displaying the commodity pictures on the client according to the dynamic effect template. The dynamic effect template can be in a JSON file form and can comprise one or more of background audio, picture display card points, picture display special effects and transition special effects. The dynamic effect template is actually a sequence file, wherein background audio is used as a time line to form a series of sequences of picture display stuck points, picture display special effects and transition special effects. In the process of dynamic display, commodity pictures are inserted into the picture display checkpoints of the dynamic templates to form a picture dynamic effect display sequence, and then the sequence files are operated, so that the picture dynamic effect display sequence is executed, and the dynamic display of the pictures is realized.
The detailed description of the above processing procedure, the detailed description of the technical principle, and the detailed analysis of the technical effect are described in the foregoing embodiments, and are not repeated herein.
According to the picture dynamic display device provided by the embodiment of the invention, the dynamic effect template is flexibly matched on the client according to the received commodity picture, the commodity picture is dynamically displayed based on the dynamic effect template, a user only needs to provide a static commodity picture to realize dynamic display, a server is not needed to store and transmit a video file in the whole process, and flexible and changeable dynamic display can be performed based on the dynamic effect template.
Example four
Fig. 5 is a schematic structural diagram of a device for generating a dynamic effect template according to an embodiment of the present invention, where the device may be disposed on an e-commerce platform, that is, may run on a side of a network-side server, and provides dynamic effect templates for displaying commodities for merchant users and consumer users, and the device includes:
and the audio characteristic analysis module 21 is configured to acquire a background audio, and analyze rhythm characteristic information and frequency domain characteristic information in the background audio. The background audio may be from audio uploaded by the merchant user or some audio selected by the e-commerce platform, etc. After determining the background audio to be used, rhythm feature information and frequency domain feature information may be extracted based on an audio feature extraction model, wherein the rhythm feature information may be from drumbeats in the audio or audio features of other rhythm-type musical instruments, and the frequency domain feature information may be from frequency distribution features extracted after fourier transform of the audio.
And the special effect stuck point determining module 22 is configured to determine the matched picture display special effect and/or transition special effect according to the frequency domain characteristic information, and determine a picture display stuck point according to the rhythm characteristic information. The two parts of processing can be completed through a machine learning model, and the matching relation between the frequency domain characteristic information in the audio and the picture display special effect and/or the transition special effect is established through training of the machine learning model, so that the method is used for matching a proper special effect according to different background audios. Similarly, a matching relation between the rhythm characteristics in the audio and the set positions of the picture display stuck points is established through training of the machine learning model, so that the matching relation is used for matching out the proper stuck points according to different background audio frequencies. In addition, in the process of generating the dynamic effect template, the commodity characteristics can be also incorporated into the process of special effect matching, namely, the matched picture display special effect and/or transition special effect are determined according to the frequency domain characteristic information and the commodity characteristics.
And the dynamic effect template generating module 23 is configured to synthesize the background audio, the picture display stuck point, the picture display special effect and/or the transition special effect to generate a dynamic effect template. As described above, the dynamic effect template itself is a sequence file, and after determining the background audio, the picture display stuck point, the picture display special effect and/or the transition special effect, the stuck point and the special effect position can be set on the basis of the time sequence of the background audio, thereby forming the final dynamic effect template.
The detailed description of the above processing procedure, the detailed description of the technical principle, and the detailed analysis of the technical effect are described in the foregoing embodiments, and are not repeated herein.
The generation device of the dynamic effect template provided by the embodiment of the invention can automatically generate the dynamic effect template based on the background audio, thereby providing abundant template resources for dynamic display of commodity pictures for the client side.
EXAMPLE five
The embodiment of the invention also provides a dynamic picture display method which can be operated on a client side. The method comprises the following steps:
s301: and receiving a commodity picture to be displayed.
S302: and determining a corresponding dynamic effect template according to the display position of the commodity picture. In this embodiment, the dynamic effect template may correspond to a specific display position in the page, or a certain type of display position. For example, the client performs pre-matching, a plurality of picture display areas are arranged on the page, each picture display area corresponds to one dynamic effect template, and when a commodity picture is received, the display area in which the commodity picture should be displayed is also received. For example, each display area may correspond to a different store, and accordingly, the merchandise corresponding to the store should be displayed in the corresponding area.
S303: and dynamically displaying the commodity picture on a client according to the dynamic effect template. The specific process of displaying the picture based on the dynamic effect template can adopt the manner of the foregoing embodiment.
In the above processing, the dynamic effect template corresponding to each display area may be updated, and therefore, the method of this embodiment may further include processing of dynamically updating the dynamic effect template. The specific updating method may include: and updating the dynamic effect template corresponding to the display position according to the characteristics of the user and/or the characteristics of the commodity picture. And the client or the server can acquire the adaptive dynamic effect template from the dynamic effect template library for updating based on the characteristics of the user and/or the characteristics of the commodity picture.
By the method, matching processing in the picture display process is omitted, and a dynamic effect template is dynamically updated based on the display position, so that the picture display efficiency is further improved, and the display effect of thousands of people is kept.
EXAMPLE six
The embodiment of the invention also provides a dynamic picture display method which can be operated on the client side. The method comprises the following steps:
s401: and receiving the picture. The pictures are not limited to commodity pictures and can be various pictures needing to be displayed.
S402: and generating a video based on the determined dynamic effect template, wherein the determination mode of the dynamic effect template can be matched according to the characteristics of the picture and/or the characteristics of the user and/or the characteristics of the commodity so as to determine the adaptive dynamic effect template, and then generating the video at the client based on the dynamic effect template.
S403: and displaying the video at the client.
The dynamic picture display method provided by the embodiment can generate a video from a picture to be displayed and then play the video on the client side based on the determined dynamic effect template instead of generating the video on the publishing side, so that the processing pressure of the publishing side, namely the server side, and the network transmission pressure are reduced, and in addition, the dynamic effect template used can be flexibly determined on the client side, so that the picture-based video display can be flexibly performed.
EXAMPLE seven
The foregoing embodiment describes a flow process and a device structure for generating a dynamic effect template and dynamically displaying a picture, and the functions of the method and the device can be implemented by an electronic device, as shown in fig. 6, which is a schematic structural diagram of the electronic device according to an embodiment of the present invention, and specifically includes: a memory 110 and a processor 120.
And a memory 110 for storing a program.
In addition to the programs described above, the memory 110 may also be configured to store other various data to support operations on the electronic device. Examples of such data include instructions for any application or method operating on the electronic device, contact data, phonebook data, messages, pictures, videos, and so forth.
The memory 110 may be implemented by any type or combination of volatile or non-volatile memory devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The processor 120, coupled to the memory 110, is configured to execute the program in the memory 110 to perform the operation steps of the dynamic effect template generating method or the dynamic picture displaying method described in the foregoing embodiments.
Furthermore, the processor 120 may also include various modules described in the foregoing embodiments to perform the processes of dynamic template generation and dynamic picture presentation, and the memory 110 may be used for storing data required by the modules to perform operations and/or output data, for example.
The detailed description of the above processing procedure, the detailed description of the technical principle, and the detailed analysis of the technical effect are described in the foregoing embodiments, and are not repeated herein.
Further, as shown, the electronic device may further include: communication components 130, power components 140, audio components 150, display 160, and other components. Only some of the components are schematically shown in the figure and it is not meant that the electronic device comprises only the components shown in the figure.
The communication component 130 is configured to facilitate wired or wireless communication between the electronic device and other devices. The electronic device may access a wireless network based on a communication standard, such as WiFi, a mobile communication network, such as 2G, 3G, 4G/LTE, 5G, or a combination thereof. In an exemplary embodiment, the communication component 130 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 130 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
The power supply component 140 provides power to the various components of the electronic device. The power components 140 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for an electronic device.
The audio component 150 is configured to output and/or input audio signals. For example, the audio component 150 includes a Microphone (MIC) configured to receive external audio signals when the electronic device is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 110 or transmitted via the communication component 130. In some embodiments, audio assembly 150 also includes a speaker for outputting audio signals.
The display 160 includes a screen, which may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.
Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The aforementioned program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (19)
1. A picture dynamic display method comprises the following steps:
receiving a commodity picture to be displayed;
determining a matched dynamic effect template based on the characteristics of the commodity picture;
and dynamically displaying the commodity picture on a client according to the dynamic effect template.
2. The method of claim 1, further comprising: the characteristics of the user are obtained and,
the determining the matched dynamic effect template based on the characteristics of the commodity picture comprises: and determining a matched dynamic effect template according to the characteristics of the commodity picture and the characteristics of the user.
3. The method of claim 2, wherein the obtaining user characteristics comprises:
receiving user information and/or user transaction behavior data from a server and/or locally acquiring user operation behavior data from a client;
and extracting user characteristics according to the user information and/or the user transaction behavior data and/or the user operation behavior data.
4. The method of claim 1, further comprising: receiving commodity information from a server, extracting commodity characteristics according to the commodity information,
the determining the matched dynamic effect template based on the characteristics of the commodity picture comprises:
and determining a matched dynamic effect template according to the characteristics of the commodity picture and the characteristics of the commodity.
5. The method of claim 1, further comprising: acquiring a dynamic effect template set from the server and storing the dynamic effect template set in the client,
based on the characteristics of the commodity picture, determining a matched dynamic effect template comprises:
and determining a matched dynamic effect template from the dynamic effect template set according to the characteristics of the commodity picture.
6. The method of claim 1, further comprising:
and extracting the color gamut and/or the saliency in the commodity picture, and generating the characteristics of the commodity picture according to the color gamut and/or the saliency.
7. The method of claim 1, wherein the dynamic effect templates include one or more of background audio, picture presentation stuck points, picture presentation effects, and transition effects.
8. The method of claim 1, wherein dynamically displaying the picture of the commodity on the client according to the dynamic effect template comprises:
and inserting the commodity picture into a picture display checkpoint of the dynamic template to form a picture dynamic effect display sequence, and executing the picture dynamic effect display sequence.
9. A dynamic effect template generation method comprises the following steps:
acquiring background audio, and analyzing rhythm characteristic information and frequency domain characteristic information in the background audio;
determining a matched picture display special effect and/or transition special effect according to the frequency domain characteristic information, and determining a picture display stuck point according to the rhythm characteristic information;
and synthesizing the background audio, the picture display stuck point, the picture display special effect and/or the transition special effect to generate the dynamic effect template.
10. The method of claim 9, further comprising: the commodity characteristics of the specified commodity are acquired,
determining the matched picture display special effect and/or transition special effect according to the frequency domain characteristic information comprises the following steps: and determining the matched picture display special effect and/or transition special effect according to the frequency domain characteristic information and the commodity characteristics.
11. A picture motion exhibiting device, comprising:
the acquisition module is used for receiving a commodity picture to be displayed;
the dynamic effect template determining module is used for determining a matched dynamic effect template based on the characteristics of the commodity picture;
and the dynamic display module is used for dynamically displaying the commodity picture on the client according to the dynamic effect template.
12. The apparatus of claim 11, wherein the means for obtaining is further for obtaining a user characteristic,
the determining the matched dynamic effect template based on the characteristics of the commodity picture comprises: and determining a matched dynamic effect template according to the characteristics of the commodity picture and the characteristics of the user.
13. The device of claim 11, wherein the obtaining module is further configured to receive merchandise information from a server, extract merchandise features according to the merchandise information,
the determining the matched dynamic effect template based on the characteristics of the commodity picture comprises:
and determining a matched dynamic effect template according to the characteristics of the commodity picture and the characteristics of the commodity.
14. A dynamic effect template generation apparatus comprising:
the audio characteristic analysis module is used for acquiring background audio and analyzing rhythm characteristic information and frequency domain characteristic information in the background audio;
the special effect stuck point determining module is used for determining the matched picture display special effect and/or transition special effect according to the frequency domain characteristic information and determining a picture display stuck point according to the rhythm characteristic information;
and the dynamic effect template generating module is used for synthesizing the background audio, the picture display stuck point, the picture display special effect and/or the transition special effect to generate the dynamic effect template.
15. A picture dynamic display method comprises the following steps:
receiving a commodity picture to be displayed;
determining a corresponding dynamic effect template according to the display position of the commodity picture;
and dynamically displaying the commodity picture on a client according to the dynamic effect template.
16. The method of claim 15, further comprising:
and updating the dynamic effect template corresponding to the display position according to the characteristics of the user and/or the characteristics of the commodity picture.
17. A method of generating a video effect, comprising:
receiving a picture;
generating a video based on the determined dynamic effect template;
and displaying the video at the client.
18. An electronic device, comprising:
a memory for storing a program;
a processor for operating the program stored in the memory to execute the method of displaying the dynamic picture according to any one of claims 1 to 8.
19. An electronic device, comprising:
a memory for storing a program;
a processor for executing the program stored in the memory to perform the dynamic effect template generation method of claim 9 or 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010701672.0A CN113420244A (en) | 2020-07-20 | 2020-07-20 | Dynamic effect template generation method, dynamic picture display method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010701672.0A CN113420244A (en) | 2020-07-20 | 2020-07-20 | Dynamic effect template generation method, dynamic picture display method and device and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113420244A true CN113420244A (en) | 2021-09-21 |
Family
ID=77711567
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010701672.0A Pending CN113420244A (en) | 2020-07-20 | 2020-07-20 | Dynamic effect template generation method, dynamic picture display method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113420244A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114302184A (en) * | 2021-12-28 | 2022-04-08 | 阿里巴巴（中国）有限公司 | Commodity information display method and equipment |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120185772A1 (en) * | 2011-01-19 | 2012-07-19 | Christopher Alexis Kotelly | System and method for video generation |
| CN103488749A (en) * | 2013-09-24 | 2014-01-01 | 长沙裕邦软件开发有限公司 | Network electronic album display method and system |
| CN103927175A (en) * | 2014-04-18 | 2014-07-16 | 深圳市中兴移动通信有限公司 | Method with background interface dynamically changing along with audio and terminal equipment |
| CN105488156A (en) * | 2015-11-30 | 2016-04-13 | 广州一刻影像科技有限公司 | Method for automatically selecting electronic album template and generating electronic album |
| CN107360383A (en) * | 2017-07-26 | 2017-11-17 | 北京百思科技有限公司 | A kind of method and system for automatically generating video |
| CN108076357A (en) * | 2016-11-14 | 2018-05-25 | 腾讯科技（北京）有限公司 | Media content method for pushing, device and system |
| CN108694602A (en) * | 2017-04-11 | 2018-10-23 | 阿里巴巴集团控股有限公司 | Promotional literature generation method and device |
| CN110933354A (en) * | 2019-11-18 | 2020-03-27 | 深圳传音控股股份有限公司 | Customizable multi-style multimedia processing method and terminal thereof |
-
2020
- 2020-07-20 CN CN202010701672.0A patent/CN113420244A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120185772A1 (en) * | 2011-01-19 | 2012-07-19 | Christopher Alexis Kotelly | System and method for video generation |
| CN103488749A (en) * | 2013-09-24 | 2014-01-01 | 长沙裕邦软件开发有限公司 | Network electronic album display method and system |
| CN103927175A (en) * | 2014-04-18 | 2014-07-16 | 深圳市中兴移动通信有限公司 | Method with background interface dynamically changing along with audio and terminal equipment |
| CN105488156A (en) * | 2015-11-30 | 2016-04-13 | 广州一刻影像科技有限公司 | Method for automatically selecting electronic album template and generating electronic album |
| CN108076357A (en) * | 2016-11-14 | 2018-05-25 | 腾讯科技（北京）有限公司 | Media content method for pushing, device and system |
| CN108694602A (en) * | 2017-04-11 | 2018-10-23 | 阿里巴巴集团控股有限公司 | Promotional literature generation method and device |
| CN107360383A (en) * | 2017-07-26 | 2017-11-17 | 北京百思科技有限公司 | A kind of method and system for automatically generating video |
| CN110933354A (en) * | 2019-11-18 | 2020-03-27 | 深圳传音控股股份有限公司 | Customizable multi-style multimedia processing method and terminal thereof |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114302184A (en) * | 2021-12-28 | 2022-04-08 | 阿里巴巴（中国）有限公司 | Commodity information display method and equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110278388B (en) | Display video generation method, device, equipment and storage medium | |
| US20240107127A1 (en) | Video display method and apparatus, video processing method, apparatus, and system, device, and medium | |
| CN110134931B (en) | Medium title generation method, medium title generation device, electronic equipment and readable medium | |
| US8972265B1 (en) | Multiple voices in audio content | |
| CN106790120B (en) | Terminal equipment and video stream associated information live broadcast control and interaction method | |
| CN113420247A (en) | Page display method and device, electronic equipment, storage medium and program product | |
| CN109493888B (en) | Cartoon dubbing method and device, computer-readable storage medium and electronic equipment | |
| WO2021057740A1 (en) | Video generation method and apparatus, electronic device, and computer readable medium | |
| CN112672188B (en) | Method, equipment and storage medium for recommending anchor | |
| CN113821690B (en) | Data processing method and device, electronic equipment and storage medium | |
| CN113923462A (en) | Video generation method, live broadcast processing method, video generation device, live broadcast processing device and readable medium | |
| CN106921749A (en) | For the method and apparatus of pushed information | |
| WO2021136362A1 (en) | Page access processing method and apparatus, page configuration processing method and apparatus, and electronic device | |
| EP3806016A1 (en) | Commodity traceability link information processing method and apparatus, and electronic device | |
| TW201319981A (en) | System and method for displaying information of television advertised product and recording media thereof | |
| WO2021088468A1 (en) | Information pushing method and apparatus | |
| CN112287168A (en) | Method and apparatus for generating video | |
| CN112100558A (en) | Method, device, equipment and storage medium for object recommendation | |
| CN113420244A (en) | Dynamic effect template generation method, dynamic picture display method and device and electronic equipment | |
| KR20120129015A (en) | Method for creating educational contents for foreign languages and terminal therefor | |
| CN110517096A (en) | Content method for implantation, device, electronic equipment and storage medium | |
| WO2021136334A1 (en) | Video generating method and apparatus, electronic device, and computer readable storage medium | |
| US20220415360A1 (en) | Method and apparatus for generating synopsis video and server | |
| CN113411517B (en) | Video template generation method and device, electronic equipment and storage medium | |
| WO2022089427A1 (en) | Video generation method and apparatus, and electronic device and computer-readable medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |