CN117319699B - Live video generation method and device based on intelligent digital human model - Google Patents

Live video generation method and device based on intelligent digital human model Download PDF

Info

Publication number
CN117319699B
CN117319699B CN202311632680.4A CN202311632680A CN117319699B CN 117319699 B CN117319699 B CN 117319699B CN 202311632680 A CN202311632680 A CN 202311632680A CN 117319699 B CN117319699 B CN 117319699B
Authority
CN
China
Prior art keywords
product
live
live broadcast
scenario
drainage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202311632680.4A
Other languages
Chinese (zh)
Other versions
CN117319699A (en
Inventor
黄杰
陈鹏
李火亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tuoshe Technology Group Co ltd
Jiangxi Tuoshi Intelligent Technology Co ltd
Original Assignee
Tuoshe Technology Group Co ltd
Jiangxi Tuoshi Intelligent Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tuoshe Technology Group Co ltd, Jiangxi Tuoshi Intelligent Technology Co ltd filed Critical Tuoshe Technology Group Co ltd
Priority to CN202311632680.4A priority Critical patent/CN117319699B/en
Publication of CN117319699A publication Critical patent/CN117319699A/en
Application granted granted Critical
Publication of CN117319699B publication Critical patent/CN117319699B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0201Market modelling; Market analysis; Collecting market data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254Management at additional data server, e.g. shopping server, rights management server
    • H04N21/2542Management at additional data server, e.g. shopping server, rights management server for selling goods, e.g. TV shopping
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/47815Electronic shopping
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Development Economics (AREA)
  • Finance (AREA)
  • Strategic Management (AREA)
  • Databases & Information Systems (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Game Theory and Decision Science (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Marketing (AREA)
  • Economics (AREA)
  • Data Mining & Analysis (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The application discloses a live video generation method and device based on an intelligent digital human model, which are applied to a server of a digital human live broadcast system, wherein the method comprises the following steps: acquiring a text generation request from the electronic equipment; determining the live broadcast sequence of each live broadcast product according to product positioning; generating a scenario frame of the live scenario according to the live broadcasting sequence; generating a reference live scenario according to the product basic information of each live product and the scenario frame; generating a digital live video according to the reference live scenario; and sending the digital live video to the electronic equipment, so that the electronic equipment performs live broadcast based on the digital live video. The method and the device have the advantages that the function of determining the live broadcasting sequence and generating the live broadcasting script according to the basic information of the product to be live broadcast is achieved, the user does not need to upload the sequence of the live broadcasting product and the live broadcasting script to the server, the content required by the server for generating the live broadcasting video is simplified, and the efficiency of generating the live broadcasting video is improved.

Description

Live video generation method and device based on intelligent digital human model
Technical Field
The application relates to the field of live video application in image communication, in particular to a live video generation method and device based on an intelligent digital human model.
Background
Due to the development of technology, the live video generated by the live broadcast system occupies a certain proportion in the live video, so that in order to improve user experience, manufacturers of the live broadcast system are always dedicated to simplifying the content required by the generation of the live video, and the user invests less time cost.
In the prior art, a user is required to send a video generation request to a server of a live broadcast system through a client before a live broadcast is generated through the live broadcast system, meanwhile, the live broadcast product sequence and the live broadcast script are uploaded, the server of the live broadcast system recognizes the video generation request and then generates the live broadcast video according to the live broadcast product sequence and the live broadcast script, the user is required to spend a large amount of time for selecting and making the live broadcast script before uploading the live broadcast product sequence and the live broadcast script to the server, and the efficiency of video generation through the live broadcast system is reduced.
Disclosure of Invention
The embodiment of the application provides a live video generation method and device based on an intelligent digital human model, wherein a server determines the live product order and generates a live script by acquiring basic information of a product to be live uploaded by a client, and the live product order and the live script are not required to be uploaded by a user, so that the content required by the server for generating the live video is simplified, and the video generation efficiency of the user through a live system is improved.
In a first aspect, an embodiment of the present application provides a live video generation method based on an intelligent digital mannequin, which is applied to a server of a digital mannequin live broadcast system, where the digital mannequin live broadcast system includes the server and an electronic device, and the method includes:
acquiring a text generation request from the electronic equipment, wherein the text generation request comprises product basic information of at least one live broadcast product to be live broadcast and product positioning of each live broadcast product, and the product positioning is used for indicating that each live broadcast product is a main push product or a drainage product;
Determining the live broadcast sequence of each live broadcast product according to the product positioning;
generating a scenario frame of the live scenario according to the live broadcasting sequence;
Generating a reference live scenario according to the product basic information of each live product and the scenario frame;
Generating a digital live video according to the reference live scenario;
And sending the digital live video to the electronic equipment, so that the electronic equipment performs live broadcast based on the digital live video.
In a second aspect, an embodiment of the present application provides a live video generating device based on an intelligent digital mannequin, including:
The electronic equipment comprises an acquisition unit, a display unit and a display unit, wherein the acquisition unit is used for acquiring a text generation request from the electronic equipment, the text generation request comprises product basic information of at least one live broadcast product to be live broadcast and product positioning of each live broadcast product, and the product positioning is used for indicating whether each live broadcast product is a main push product or not;
The determining unit is used for determining the live broadcast sequence of each live broadcast product according to the product positioning;
the first generation unit is used for generating a script frame of the live broadcasting script according to the live broadcasting sequence;
The second generation unit is used for generating a reference live scenario according to the product basic information of each live product and the scenario frame;
the third generation unit is used for generating a digital live video according to the reference live scenario;
and the sending unit is used for sending the digital live video to the electronic equipment so that the electronic equipment can conduct live broadcast based on the digital live video.
In a third aspect, an embodiment of the present application provides a computer apparatus, including:
A memory, a processor, and computer readable instructions stored in the memory and executable on the processor, which when executed perform some or all of the steps described in any of the methods of the first aspect.
In a fourth aspect, embodiments of the present application provide a computer-readable storage medium storing a computer program for electronic data exchange, the computer program comprising execution instructions for performing some or all of the steps described in any of the methods of the first aspect.
In a fifth aspect, embodiments of the present application provide a computer program product, wherein the computer program product comprises a computer program operable to cause a computer to perform some or all of the steps described in any of the methods of the first aspect of the embodiments of the present application. The computer program product may be a software installation package.
By implementing the embodiment of the application, a server firstly acquires a text generation request from electronic equipment, wherein the text generation request comprises product basic information of at least one live broadcast product to be live broadcast and product positioning of each live broadcast product, and the product positioning is used for indicating that each live broadcast product is a main push product or a drainage product; then determining the live broadcast sequence of each live broadcast product according to the product positioning; then generating a script frame of the live broadcast script according to the live broadcast sequence; then generating a reference live play according to the product basic information and the play frame of each live broadcast product; then generating a digital live video according to the reference live scenario; and finally, sending the digital live video to the electronic equipment, so that the electronic equipment performs live broadcast based on the digital live video. Compared with the existing live video generation scheme, the digital human live system achieves the functions of determining the live sequence and generating the live script according to the basic information of the product to be live, and a user does not need to upload the live product sequence and the live script, so that the content required by the server for generating the live video is simplified, and the video generation efficiency of the user through the live system is improved.
Drawings
In order to more clearly describe the embodiments of the present application or the technical solutions in the background art, the following description will describe the drawings that are required to be used in the embodiments of the present application or the background art.
Fig. 1 is a schematic architecture diagram of a digital live system according to an embodiment of the present application;
Fig. 2 is a flowchart of a live video generation method based on an intelligent digital human model according to an embodiment of the present application;
FIG. 3 is a flow chart of the following operations performed for each of the drainage products provided by an embodiment of the present application;
Fig. 4 is a schematic structural diagram of a live video generation device based on an intelligent digital mannequin according to an embodiment of the present application;
Fig. 5 is a schematic structural diagram of a computer device according to an embodiment of the present application.
Detailed Description
In order that those skilled in the art will better understand the present application, a technical solution in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present application without making any inventive effort, shall fall within the scope of the present application.
The terms first, second, third and the like in the description and in the claims and drawings are used for distinguishing between different objects and not for describing a particular sequential order. Furthermore, the terms "comprise" and "have," as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those listed steps or elements but may include other steps or elements not listed or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the application. The appearances of such phrases in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those of skill in the art will explicitly and implicitly appreciate that the embodiments described herein may be combined with other embodiments.
Referring to fig. 1, fig. 1 is a schematic architecture diagram of a digital live system according to an embodiment of the present application, and as shown in fig. 1, the digital live system 100 includes a server 101 and an electronic device 102.
The server 101 is in connection communication with the electronic device 102, receives a text generation request sent by the electronic device 102, and sends an electronic form to the electronic device 102, where the electronic device 102 may upload a promotional text of a live product to be live or an acquisition link of the promotional text. The server 101 can acquire the basic information of the live broadcast product to be live broadcast according to the text generation request sent by the electronic device to determine the live broadcast sequence and generate the live broadcast scenario, and compared with the existing live broadcast video generation scheme, the user does not need to spend a great deal of time in the selection stage and the live broadcast scenario generation stage, so that the preparation time of video generation is saved, and the efficiency of live broadcast video generation is improved.
Based on the above, the application provides a live video generation method based on an intelligent digital human model, and the application is described in detail below with reference to the accompanying drawings.
In a possible implementation manner, referring to fig. 2, fig. 2 is a flowchart of a live video generation method based on an intelligent digital mannequin according to an embodiment of the present application, as shown in fig. 2, the method includes the following steps:
s201, acquiring a text generation request from the electronic equipment;
s202, determining the live broadcast sequence of each live broadcast product according to the product positioning;
s203, generating a scenario frame of the live scenario according to the live broadcasting sequence;
s204, generating a reference live scenario according to the product basic information of each live product and the scenario frame;
S205, generating a digital live video according to the reference live scenario;
S206, the digital live video is sent to the electronic equipment, so that the electronic equipment performs live broadcast based on the digital live video.
The text generation request comprises at least one product basic information of a live broadcast product to be live broadcast, wherein the product basic information of the live broadcast product comprises a name of the live broadcast product to be live broadcast, a price of the live broadcast product to be live broadcast, preferential conditions of the live broadcast product to be live broadcast, product specificity of the live broadcast product to be live broadcast, product positioning of the live broadcast product to be live broadcast and product type of the live broadcast product to be live broadcast.
Wherein the product location is used to indicate that each live product is a push product or a drain product.
After the server acquires the text generation request from the electronic equipment, the server returns an electronic form filled in based on the text generation request to the electronic equipment, wherein the information of the electronic form comprises the product basic information of the at least one live broadcast product to be live broadcast.
The script framework comprises a main framework and a sub framework, wherein the main framework comprises product introduction and price introduction, and the sub framework comprises product story sharing, guiding attention, interaction and knowledge sharing. Each script frame of the live product to be live comprises two main frames and at least one auxiliary frame.
Illustratively, a scenario frame of a live broadcast product includes two main frames of product introduction and price introduction, the price introduction is firstly performed on the live broadcast product, the price and specification of the live broadcast product are described, then the product introduction is performed on the live broadcast product, the main frame of the product introduction includes a plurality of subframes, specifically, during the product introduction, story sharing and interaction links can be inserted, and a specific frame arrangement can be a product price, a product introduction, a product story or product introduction, a product price and a product story, wherein the scenario frame can be a main frame structure which uses a fixed structure and randomly inserts subframes in the main frame structure, and the specific frame arrangement is not limited.
After determining the scenario frame, the scenario frame is filled in according to the acquired basic information of the live broadcast product, and illustratively, the product price part in the scenario frame can be filled in according to the price of the live broadcast product to be live broadcast and the preferential condition of the live broadcast product to be live broadcast in the acquired basic information of the live broadcast product.
In this example, compared with the existing live video generation scheme, the digital live system realizes the functions of determining the live sequence and generating the live scenario according to the basic information of the product to be live, does not need to spend a great deal of time in the selection stage and the live scenario manufacturing stage, saves the live preparation time of the user, and improves the efficiency of live video generation.
In one possible implementation manner, the determining the live sequence of each live product according to the product positioning includes:
determining a main pushing product and a drainage product in the at least one live product to be live broadcast according to the product positioning; obtaining the product heat and/or the product sales of each main pushing product; dividing the main pushing product into a plurality of sales grades according to the product heat and/or the product sales volume; acquiring predicted live broadcast time length; dividing the predicted live time length into a plurality of live time periods according to the predicted live time length and the plurality of sales grades; determining a live broadcast period of each main push product according to the sales grade corresponding to each main push product, wherein each live broadcast period corresponds to at least one main push product, and the sales grades of a plurality of main push products corresponding to the same live broadcast period are different; generating a reference live broadcast sequence according to the live broadcast period of each main push product; and generating the live broadcast sequence of each live broadcast product according to the drainage product and the reference live broadcast sequence.
The server presets a plurality of intervals divided according to the product heat and/or the product sales volume in advance, and divides the main pushing products falling into different interval thresholds into a plurality of sales grades according to the intervals, wherein each interval threshold corresponds to one sales grade.
For example, if three intervals are preset in advance by the server, the product heat or the product sales volume is less than or equal to 1 ten thousand and is a first interval, the product heat or the product sales volume is greater than 1 ten thousand and less than or equal to 5 ten thousand and is a second interval, the product heat or the product sales volume is greater than 5 ten thousand and is a third interval, the main pushing products of the first interval are products 1 and 2, the main pushing products of the second interval are products 3 and 4, the main pushing products of the third interval are products 5 and 6, the predicted live time length of the electronic device is 90 minutes at this time, the live time length is divided into a plurality of time periods according to the three intervals on average, each corresponding live time period is 30 minutes, one sales product serving as the time period is randomly extracted from the main pushing products in sales grades corresponding to the three intervals, the first direct time period is randomly extracted from the three sales grades to the products 1,3 and5 respectively, and the order of sales orders of different main pushing products, namely, the reference order is first product 1 and then the live time period is 3. When few live broadcast products exist and the main push products in all sales grades cannot be met in each live broadcast period, the main push products in more sales grades are preferentially ensured to be contained in the later period.
In this example, compared with the existing live video generation scheme, the server of the digital live video system divides products into different sales grades according to the sales volume and/or the product heat of the products, and then each live time period of the live scenario contains products with different sales grades, so that the live broadcasting room can be ensured to sell products with higher sales volume in different live time periods, and accordingly higher heat is maintained, and live broadcasting efficiency and conversion rate are improved.
In a possible implementation manner, the generating the live sequence of each live product according to the drainage product and the reference live sequence includes: determining the product type of each live broadcast product according to the product information of each live broadcast product; marking each drainage product according to the product type to obtain at least one piece of marking information corresponding to each drainage product, wherein the marking information is used for indicating a main pushing product associated with each drainage product;
wherein, live broadcast product includes owner pushes away product and drainage product, and every owner pushes away the product and all has at least one drainage product, and drainage product is used for arranging to sell before the owner pushes away the product and does not push away the product accumulation people's flow.
Referring to fig. 3, fig. 3 is a flowchart of the following operations performed on each of the drainage products according to the embodiment of the present application, and as shown in fig. 3, the following operations are performed on each of the drainage products:
Determining whether a plurality of marks correspond to the current drainage product; if the current drainage product is one, determining that the playing period of the current drainage product is the playing period of the main pushing product indicated by the mark corresponding to the drainage product, and sequencing the playing period of the main pushing product indicated by the mark; if the number of the current drainage products is multiple, determining that the current drainage products are target drainage products, and determining the playing time period of the current drainage products according to the number of the products corresponding to the playing time period of the main pushing products indicated by the marks corresponding to the target drainage products; determining the next drainage product as the current drainage product until the playing time period of all the drainage products is determined; and generating the live broadcast sequence of each live broadcast product according to the playing time periods of all the drainage products and the reference live broadcast sequence.
It can be seen that, in this example, compared to the existing live video generation scheme, the digital live system is beneficial to maintaining the flow of the live broadcasting room through the drainage products related to the main push products by determining the drainage products corresponding to each main push product according to the product information of each live broadcast product, so as to improve the live broadcasting benefit.
In a possible implementation manner, the determining the playing period of the current drainage product according to the number of products corresponding to the playing period of the main pushing product indicated by the mark corresponding to the target drainage product includes: determining the number of live broadcast products corresponding to each playing period; determining the number of the target drainage products; determining the maximum receivable number for receiving the broadcasting of the live broadcast product in each broadcasting period according to the number of the target drainage products and the number of the live broadcast products corresponding to each broadcasting period; the following operations are performed for each target drainage product: determining a plurality of reference main stream products indicated by marks corresponding to the current target drainage product; determining a reference playing period corresponding to each reference mainstream product in the plurality of reference mainstream products; determining an alternative playing period which can accommodate the playing of the drainage product in the reference playing period according to the maximum accommodating quantity of the reference playing period; determining the alternative playing time period with the least quantity of the corresponding live broadcast products in the alternative playing time periods as a target playing time period; determining the playing time interval of the current drainage product as the target playing time interval, and changing the maximum accommodating quantity of the target playing time interval; and determining the next target drainage product as the current drainage product until the playing period of each target drainage product is determined.
When determining the drainage product associated with the main pushing product, the method first judges according to the product type information in the product information of each live broadcasting product, for example, if the main pushing product A, the drainage product B and the drainage product C belong to kitchen supplies, the drainage product B and the drainage product C are the drainage products corresponding to the main pushing product A.
If a plurality of direct broadcast products corresponding to the main push products exist, the operation is carried out on the direct broadcast products so that the overlapped direct broadcast products are only related to one main push product.
Specifically, whether the reference drainage products corresponding to each main pushing product are overlapped or not is determined, if so, whether the main pushing product with the overlapped drainage products is only corresponding to one reference drainage product is determined, if so, the reference drainage product is determined to be the target drainage product of the main pushing product, and the reference drainage product is deleted from the reference drainage products corresponding to other main pushing products. And the like, wherein a plurality of drainage products respectively correspond to the main pushing products corresponding to the reference drainage products which are overlapped at last.
Illustratively, the drainage products corresponding to the main pushing product a include a drainage product 1, a drainage product 2 and a drainage product 3, the drainage products corresponding to the main pushing product B include a drainage product 1, a drainage product 3, a drainage product 4 and a drainage product 5, the drainage products corresponding to the main pushing product C include a drainage product 3, the drainage products 1 and 3 appear in the drainage products corresponding to the main pushing products, at this time, regarding the drainage product 3, the number of live broadcast products corresponding to the main pushing product C in the alternative playing period is the minimum, regarding the drainage product 1, the number of live broadcast products corresponding to the main pushing product C in the alternative playing period is the minimum, the drainage product 1 is the drainage product corresponding to the main pushing product a, the drainage products 1 and 2 corresponding to the main pushing product a are finally obtained, the drainage products corresponding to the main pushing product B correspond to the drainage products 4 and 5, and the main pushing product C corresponds to the drainage product 3.
Therefore, in this example, compared with the existing live video generation scheme, the server of the digital human live broadcast system can ensure that each drainage product only appears once in one live broadcast process by continuously removing the overlapped drainage products in the plurality of main push products, so that user loss caused by repeatedly playing the same commodity in the generated live video is avoided, flow and heat between live broadcast rooms are ensured, and live broadcast efficiency is improved.
In one possible implementation manner, the generating a reference live scenario according to the product basic information of each live product and the scenario frame includes: determining the product type of each live broadcast product according to the product basic information; determining a description template of each live broadcast product according to the product type; acquiring a live broadcast universal conversation corresponding to each product type; generating an initial live script through the description template according to the product type of each product; and generating a reference live scenario according to the live universal conversation and the initial live scenario.
One or more description templates of the live broadcast product are obtained according to the product type, and then one of the description templates is selected to be filled in the basic information of the live broadcast product to be live broadcast, so that an initial live broadcast scenario is obtained.
Illustratively, the product price portion text in one description template of the filled-in scenario frame is: in the following, a total of 10 cans, one 6 cans and one 8 cans of sea buckthorn juice, 68 pieces of money, are described. When imitation is performed, information can be filled in by referring to the sentence pattern, wherein the reference sentence pattern is as follows: in the template text, A is filled in the name of the live broadcast product to be directly broadcast, B is filled in the price of the live broadcast product to be directly broadcast, C is filled in the specification of the live broadcast product to be directly broadcast, and D is filled in the unit price of the live broadcast product to be directly broadcast, so that the reference live broadcast script is completed.
After the initial live scenario is obtained, the initial live scenario can be improved by inserting some live commonly used conversations in different stages of the initial live scenario.
In this example, compared with the existing live video generation scheme, the server of the digital human live broadcast system generates the live scenario through the product basic information and the description template and improves the live scenario by using the live universal phone, so that the efficiency and the accuracy of the generation of the live scenario can be ensured.
In one possible implementation manner, before the generating the reference live scenario according to the live general speaking and the initial live scenario, the method further includes: searching in a preset website according to the product name of each live broadcast product to obtain propaganda content corresponding to each product; determining propaganda emphasis of each live broadcast product according to the propaganda content; acquiring a target propaganda text corresponding to the propaganda key point; and the initial live broadcast script is moistened according to the target propaganda text.
Specifically, acquiring the propaganda content includes searching in the product official network by taking the brand name and the product as keywords, or opening a sales page of the product in a sales platform, and extracting text from a product introduction page of the sales page to obtain the propaganda content. Or sending data request information to the user, and uploading propaganda text of the product or linking the propaganda text by the user.
The propaganda emphasis is determined according to propaganda content of each live product, for example, the propaganda emphasis can be a research and development process of the product, a use experience of the product or after-sales service of the product.
It can be seen that, in this example, compared with the existing live video generation scheme, the server of the digital live system obtains the propaganda content of each product through inquiry and determines propaganda emphasis, so as to moisten the initial live scenario, which is favorable for better grasping the propaganda emphasis of the product of the reference live scenario generated later, effectively attracts attention of users, and improves the benefit of live broadcasting.
In one possible implementation manner, the rendering the initial live scenario according to the target advertisement text includes: dividing the scenario content of the initial live scenario into first scenario content and second scenario content, wherein the first scenario content is scenario content with higher propaganda key relevance than a preset value with the target propaganda text, and the second scenario content is scenario content except the first scenario content in the scenario content of the initial live scenario; replacing the first script content with the target propaganda text to obtain target first script content; performing spoken language modification on the content which is not related to the transcript content of the initial live broadcast transcript and has the transcript content association degree higher than a preset value in the propaganda key point to obtain target second transcript content; and generating an initial live broadcast scenario after the color rendering according to the target first scenario content and the target second scenario content.
The method comprises the steps of performing sentence breaking on an initial live script through punctuation marks, and comparing the relevancy of each sentence with the propaganda key point of a target propaganda text, wherein the relevancy is higher than a preset value and is the content of a first script.
The preset value can be modified at the server to adjust the association degree of the first script content and the propaganda key point of the target propaganda text.
If the association degree of a certain propaganda key point of the propaganda text in the initial live broadcast script is not higher than a preset value, carrying out text analysis on the propaganda key point, generating a spoken text, and adding the spoken text into the initial live broadcast script. For example, if the scenario content of the initial live scenario has A, B, C and D, the propaganda emphasis has emphasis 1 and emphasis 2, at this time, the association degree between A, C and the emphasis 1 in the scenario content is higher than a preset value, the association degree between A, B, C and D and the emphasis 2 are both lower than the preset value, at this time, the first scenario content is A, C, the second scenario content is B, D, the first scenario content is replaced by the target propaganda text, and at the same time, the emphasis 2 is subjected to spoken modification to obtain the target second scenario content, and then the target second scenario content is added into the scenario content of the initial live scenario to obtain the initial live scenario after the color is moistened.
It can be seen that, in this example, compared with the existing live video generation scheme, the server of the digital live system generates the target first scenario and the target second scenario by comparing the initial live scenario and the propaganda key, so as to moisten the initial live scenario, and the moistened live scenario can more easily highlight the propaganda key of the live product to be live, thereby being beneficial to increasing the attention of the live product to be live and improving the live efficiency and conversion rate.
Referring to fig. 4, fig. 4 is a schematic structural diagram of a live video generation device based on an intelligent digital mannequin according to an embodiment of the present application, and as shown in fig. 4, a live video generation device 400 based on an intelligent digital mannequin includes:
An obtaining unit 401, configured to obtain a text generation request from an electronic device, where the text generation request includes product basic information of at least one live product to be live broadcast, and a product location of each live product, where the product location is used to indicate whether each live product is a push product;
A determining unit 402, configured to determine a live broadcast sequence of each live broadcast product according to the product positioning;
a first generating unit 403, configured to generate a scenario frame of the live scenario according to the live broadcast sequence;
A second generating unit 404, configured to generate a reference live scenario according to the product basic information of each live product and the scenario frame;
a third generating unit 405, configured to generate a digital live video according to the reference live scenario;
And the sending unit 406 is configured to send the digital live video to the electronic device, so that the electronic device performs live broadcast based on the digital live video.
Referring to fig. 5, fig. 5 is a schematic structural diagram of a computer device according to an embodiment of the application, as shown in fig. 5, including:
The processor, the memory and the communication interface are connected with each other and complete the communication work among each other;
The memory stores executable program codes, and the communication interface is used for wireless communication;
The processor is configured to retrieve executable program code stored on the memory, perform part or all of the steps of the method of generating an applet asynchronous component configuration as described in any of the method embodiments above, the computer comprising an electronic terminal device.
The processor may include one or more processing cores. The processor uses various interfaces and lines to connect various portions of the overall electronic device, perform various functions of the electronic device, and process data by executing or executing instructions, programs, code sets, or instruction sets stored in memory, and invoking data stored in memory. Alternatively, the processor may be implemented in hardware in at least one of digital signal Processing (DIGITAL SIGNAL Processing, DSP), field-Programmable gate array (Field-Programmable GATE ARRAY, FPGA), programmable logic array (ProgrammableLogic Array, PLA). The processor may integrate one or a combination of several of a central processing unit (CentralProcessing Unit, CPU), an image processor (Graphics Processing Unit, GPU), and a modem, etc. It will be appreciated that the modem may not be integrated into the processor and may be implemented solely by a single communication chip.
The Memory may include random access Memory (Random Access Memory, RAM) or Read-Only Memory (ROM). The memory may be used to store instructions, programs, code sets, or instruction sets. The memory may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing examples of the respective methods described above, and the like. The storage data area may also store data created by the electronic device in use, etc.
It will be appreciated that the electronic device may include more or fewer structural elements than those described in the above structural block diagrams, including, for example, a power module, physical key, wiFi (WIRELESS FIDELITY ) module, speaker, bluetooth module, sensor, etc., without limitation.
The present application provides a computer readable storage medium storing a computer program for electronic data exchange, the computer program comprising execution instructions for performing part or all of the steps of any one of the intelligent digital mannequin-based live video generation methods described in the above method examples.
The present application also provides a computer program product comprising a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform part or all of the steps of any one of the intelligent digital person model-based live video generation methods described in the method examples above. The computer program product may be a software installation package.
It should be noted that, for simplicity of description, any of the foregoing examples of the live video generation method based on the intelligent digital mannequin are described as a series of combinations of actions, but those skilled in the art should appreciate that the present application is not limited by the order of actions described, as some steps may be performed in other orders or simultaneously according to the present application. Further, it should be understood by those skilled in the art that the examples described in the specification are preferred examples and that the actions involved are not necessarily required for the present application.
Although the application is described herein in connection with various examples, other variations to the disclosed examples can be understood and effected by those skilled in the art in practicing the claimed application, from a review of the figures, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other elements or steps, and the "a" or "an" does not exclude a plurality. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.
Those of ordinary skill in the art will appreciate that all or a portion of the steps in any of the various methods described above for an example of a live video generation method based on an intelligent digital mannequin may be accomplished by a program that instructs associated hardware, which may be stored in a computer readable memory, which may include: flash disk, read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), magnetic disk or optical disk.
The application is described in detail above, and specific examples are applied to illustrate the principles and embodiments of the method and apparatus for generating live video based on intelligent digital human model, and the above illustration is only used to help understand the method and core idea of the application; meanwhile, according to the idea of the method and the device for generating the live video based on the intelligent digital human model, which are disclosed by the application, for a person skilled in the art, the specific implementation and the application range are changed, so that the content of the description is not to be interpreted as limiting the application.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, hardware products, and computer program products according to the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be appreciated that any product of the processing method of the flowchart described in the examples of the live video generation method based on the intelligent digital mannequin of the present application, such as the terminal of the flowchart and the computer program product, falls within the relevant product described in the present application.
It is apparent that those skilled in the art can make various modifications and variations to the method and apparatus for generating live video based on intelligent digital human model provided in the present application without departing from the spirit and scope of the application. Thus, it is intended that the present application also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.

Claims (9)

1. The live video generation method based on the intelligent digital human model is characterized by being applied to a server of a digital human live system, wherein the digital human live system comprises the server and electronic equipment, and the method comprises the following steps:
acquiring a text generation request from the electronic equipment, wherein the text generation request comprises product basic information of at least one live broadcast product to be live broadcast and product positioning of each live broadcast product, and the product positioning is used for indicating that each live broadcast product is a main push product or a drainage product;
Determining a main pushing product and a drainage product in the at least one live product to be live broadcast according to the product positioning;
obtaining the product heat and/or the product sales of each main pushing product;
dividing the main pushing product into a plurality of sales grades according to the product heat and/or the product sales volume;
Acquiring predicted live broadcast time length;
Dividing the predicted live time length into a plurality of live time periods according to the predicted live time length and the plurality of sales grades;
Determining a live broadcast period of each main push product according to the sales grade corresponding to each main push product, wherein each live broadcast period corresponds to at least one main push product, and the sales grades of a plurality of main push products corresponding to the same live broadcast period are different;
Generating a reference live broadcast sequence according to the live broadcast period of each main push product;
Generating a live broadcast sequence of each live broadcast product according to the drainage products and the reference live broadcast sequence;
generating a scenario frame of the live scenario according to the live broadcasting sequence;
Generating a reference live scenario according to the product basic information of each live product and the scenario frame;
Generating a digital live video according to the reference live scenario;
And sending the digital live video to the electronic equipment, so that the electronic equipment performs live broadcast based on the digital live video.
2. The method of claim 1, wherein the generating the live sequence of each live product from the drainage product and the reference live sequence comprises:
Determining the product type of each live broadcast product according to the product information of each live broadcast product;
marking each drainage product according to the product type to obtain at least one piece of marking information corresponding to each drainage product, wherein the marking information is used for indicating a main pushing product associated with each drainage product;
the following is performed for each of the drainage products:
determining whether a plurality of marks correspond to the current drainage product;
If the current drainage product is one, determining that the playing period of the current drainage product is the playing period of the main pushing product indicated by the mark corresponding to the drainage product, and sequencing the playing period of the main pushing product indicated by the mark;
If the number of the current drainage products is multiple, determining that the current drainage products are target drainage products, and determining the playing time period of the current drainage products according to the number of the products corresponding to the playing time period of the main pushing products indicated by the marks corresponding to the target drainage products;
determining the next drainage product as the current drainage product until the playing time period of all the drainage products is determined;
and generating the live broadcast sequence of each live broadcast product according to the playing time periods of all the drainage products and the reference live broadcast sequence.
3. The method of claim 2, wherein the determining the playing period of the current drainage product according to the corresponding number of products in the playing period of the main push product indicated by the mark corresponding to the target drainage product comprises:
Determining the number of live broadcast products corresponding to each playing period;
Determining the number of the target drainage products;
Determining the maximum receivable number for receiving the broadcasting of the live broadcast product in each broadcasting period according to the number of the target drainage products and the number of the live broadcast products corresponding to each broadcasting period;
the following operations are performed for each target drainage product:
determining a plurality of reference main stream products indicated by marks corresponding to the current target drainage product;
determining a reference playing period corresponding to each reference mainstream product in the plurality of reference mainstream products;
Determining an alternative playing period which can accommodate the playing of the drainage product in the reference playing period according to the maximum accommodating quantity of the reference playing period;
determining the alternative playing time period with the least quantity of the corresponding live broadcast products in the alternative playing time periods as a target playing time period;
determining the playing time interval of the current drainage product as the target playing time interval, and changing the maximum accommodating quantity of the target playing time interval;
and determining the next target drainage product as the current drainage product until the playing period of each target drainage product is determined.
4. The method of claim 1, wherein the generating a reference live scenario from the product base information of each live product and the scenario frame comprises:
Determining the product type of each live broadcast product according to the product basic information;
Determining a description template of each live broadcast product according to the product type;
Acquiring a live broadcast universal conversation corresponding to each product type;
Generating an initial live script through the description template according to the product type of each product;
And generating a reference live scenario according to the live universal conversation and the initial live scenario.
5. The method of claim 4, wherein prior to generating a reference live transcript from the live general speaking and the initial live transcript, the method further comprises:
searching in a preset website according to the product name of each live broadcast product to obtain propaganda content corresponding to each product;
Determining propaganda emphasis of each live broadcast product according to the propaganda content;
acquiring a target propaganda text corresponding to the propaganda key point;
and the initial live broadcast script is moistened according to the target propaganda text.
6. The method of claim 5, wherein the rendering the initial live scenario according to the target promotional text comprises:
Dividing the scenario content of the initial live scenario into first scenario content and second scenario content, wherein the first scenario content is scenario content with higher propaganda key relevance than a preset value with the target propaganda text, and the second scenario content is scenario content except the first scenario content in the scenario content of the initial live scenario;
replacing the first script content with the target propaganda text to obtain target first script content;
Performing spoken language modification on the content which is not related to the transcript content of the initial live broadcast transcript and has the transcript content association degree higher than a preset value in the propaganda key point to obtain target second transcript content;
and generating an initial live broadcast scenario after the color rendering according to the target first scenario content and the target second scenario content.
7. A live video generation device based on an intelligent digital mannequin, the device comprising:
The system comprises an acquisition unit, a display unit and a display unit, wherein the acquisition unit is used for acquiring a text generation request from electronic equipment, the text generation request comprises product basic information of at least one live broadcast product to be live broadcast and product positioning of each live broadcast product, and the product positioning is used for indicating whether each live broadcast product is a push product or not; the method comprises the steps of obtaining the product heat and/or the product sales of each main pushing product; the method comprises the steps of acquiring a predicted live broadcast time length;
The determining unit is used for determining a main pushing product and a drainage product in the at least one live broadcast product to be live broadcast according to the product positioning; and dividing the main pushing product into a plurality of sales grades according to the product heat and/or the product sales volume; and dividing the predicted live time length into a plurality of live time periods according to the predicted live time length and the plurality of sales grades; the method comprises the steps of determining a live broadcast period of each main push product according to a sales grade corresponding to each main push product, wherein each live broadcast period corresponds to at least one main push product, and sales grades of a plurality of main push products corresponding to the same live broadcast period are different;
The generation unit is used for generating a reference live broadcast sequence according to the live broadcast period of each main push product; and generating a live sequence of each live product according to the drainage product and the reference live sequence; and a scenario frame for generating a live scenario according to the live sequence; the method comprises the steps of generating a live broadcast script according to the basic product information of each live broadcast product and the script frame; the method comprises the steps of generating a digital live video according to the reference live scenario;
and the sending unit is used for sending the digital live video to the electronic equipment so that the electronic equipment can conduct live broadcast based on the digital live video.
8. A computer device comprising a memory, a processor and computer readable instructions stored in the memory and executable on the processor, when executing the computer readable instructions, performing the steps of the intelligent digital person model based live video generation method of any of claims 1-6.
9. A computer-readable storage medium, characterized in that it stores a computer program for electronic data exchange, the computer program comprising execution instructions for performing the steps of the intelligent digital mannequin-based live video generation method according to any one of claims 1 to 6.
CN202311632680.4A 2023-12-01 2023-12-01 Live video generation method and device based on intelligent digital human model Active CN117319699B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311632680.4A CN117319699B (en) 2023-12-01 2023-12-01 Live video generation method and device based on intelligent digital human model

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311632680.4A CN117319699B (en) 2023-12-01 2023-12-01 Live video generation method and device based on intelligent digital human model

Publications (2)

Publication Number Publication Date
CN117319699A CN117319699A (en) 2023-12-29
CN117319699B true CN117319699B (en) 2024-04-26

Family

ID=89288787

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311632680.4A Active CN117319699B (en) 2023-12-01 2023-12-01 Live video generation method and device based on intelligent digital human model

Country Status (1)

Country Link
CN (1) CN117319699B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117596420B (en) * 2024-01-18 2024-05-31 江西拓世智能科技股份有限公司 Fusion live broadcast method, system, medium and electronic equipment based on artificial intelligence

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006067343A (en) * 2004-08-27 2006-03-09 Nippon Telegr & Teleph Corp <Ntt> Method and device for creating metadata
CN110996110A (en) * 2019-12-02 2020-04-10 深圳市云积分科技有限公司 Commodity adjusting method and device in live broadcast process
CN112104899A (en) * 2020-09-11 2020-12-18 腾讯科技(深圳)有限公司 Information recommendation method and device in live broadcast, electronic equipment and storage medium
CN113038152A (en) * 2021-02-26 2021-06-25 北京达佳互联信息技术有限公司 Live broadcast data processing method and device, terminal and storage medium
CN114125569A (en) * 2022-01-27 2022-03-01 阿里巴巴(中国)有限公司 Live broadcast processing method and device
CN116257162A (en) * 2021-12-10 2023-06-13 北京字跳网络技术有限公司 Data processing method, device, equipment and storage medium
CN117041623A (en) * 2023-08-08 2023-11-10 京东科技信息技术有限公司 Digital person live broadcasting method and device
CN117119211A (en) * 2023-08-08 2023-11-24 北京百度网讯科技有限公司 Live broadcast pushing method and device, electronic equipment and storage medium

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006067343A (en) * 2004-08-27 2006-03-09 Nippon Telegr & Teleph Corp <Ntt> Method and device for creating metadata
CN110996110A (en) * 2019-12-02 2020-04-10 深圳市云积分科技有限公司 Commodity adjusting method and device in live broadcast process
CN112104899A (en) * 2020-09-11 2020-12-18 腾讯科技(深圳)有限公司 Information recommendation method and device in live broadcast, electronic equipment and storage medium
CN113038152A (en) * 2021-02-26 2021-06-25 北京达佳互联信息技术有限公司 Live broadcast data processing method and device, terminal and storage medium
CN116257162A (en) * 2021-12-10 2023-06-13 北京字跳网络技术有限公司 Data processing method, device, equipment and storage medium
CN114125569A (en) * 2022-01-27 2022-03-01 阿里巴巴(中国)有限公司 Live broadcast processing method and device
CN117041623A (en) * 2023-08-08 2023-11-10 京东科技信息技术有限公司 Digital person live broadcasting method and device
CN117119211A (en) * 2023-08-08 2023-11-24 北京百度网讯科技有限公司 Live broadcast pushing method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN117319699A (en) 2023-12-29

Similar Documents

Publication Publication Date Title
CN117319699B (en) Live video generation method and device based on intelligent digital human model
CN107797984B (en) Intelligent interaction method, equipment and storage medium
US10097884B2 (en) Media playback method, client and system
CN103366729B (en) Speech dialogue system, terminal installation and data center&#39;s device
CN111667814A (en) Multi-language voice synthesis method and device
CN111276123B (en) Method and device for voice broadcasting message, computer equipment and storage medium
CN101127210A (en) Method and device for implementing lyric synchronization when broadcasting song
CN109036372B (en) Voice broadcasting method, device and system
EP2940644A1 (en) Method, apparatus, device and system for inserting audio advertisement
CN107943914A (en) Voice information processing method and device
CN108021622A (en) Information determination method and device, electronic equipment and storage medium
CN109242555B (en) Voice-based advertisement playing method and related product
CN111107442B (en) Method and device for acquiring audio and video files, server and storage medium
CN106921749A (en) For the method and apparatus of pushed information
CN110069769B (en) Application label generation method and device and storage device
CN114902702B (en) Short message pushing method, device, server and storage medium
CN114520931B (en) Video generation method, device, electronic equipment and readable storage medium
CN111666059A (en) Reminding information broadcasting method and device and electronic equipment
CN111008287B (en) Audio and video processing method and device, server and storage medium
CN112784022B (en) Government affair FAQ knowledge base automatic construction method and device and electronic equipment
CN112151034B (en) Voice control method and device of equipment, electronic equipment and storage medium
CN111933133A (en) Intelligent customer service response method and device, electronic equipment and storage medium
CN111782172B (en) Information display method and device
CN114817582A (en) Resource information pushing method and electronic device
CN113240447A (en) Advertisement pushing method and device, storage medium and server

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant