WO2025011071A1 - Interactive resource generation method and apparatus, and device and computer-readable storage medium - Google Patents
Interactive resource generation method and apparatus, and device and computer-readable storage medium Download PDFInfo
- Publication number
- WO2025011071A1 WO2025011071A1 PCT/CN2024/081311 CN2024081311W WO2025011071A1 WO 2025011071 A1 WO2025011071 A1 WO 2025011071A1 CN 2024081311 W CN2024081311 W CN 2024081311W WO 2025011071 A1 WO2025011071 A1 WO 2025011071A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- interactive
- subtitle
- resource
- interaction
- user
- Prior art date
Links
- 230000002452 interceptive effect Effects 0.000 title claims abstract description 444
- 238000000034 method Methods 0.000 title claims abstract description 153
- 230000003993 interaction Effects 0.000 claims abstract description 119
- 230000015654 memory Effects 0.000 claims description 65
- 238000013473 artificial intelligence Methods 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 14
- 230000008569 process Effects 0.000 abstract description 66
- 238000005516 engineering process Methods 0.000 abstract description 5
- 230000002708 enhancing effect Effects 0.000 abstract 1
- 230000000875 corresponding effect Effects 0.000 description 135
- 230000006870 function Effects 0.000 description 28
- 230000007704 transition Effects 0.000 description 23
- 238000012545 processing Methods 0.000 description 22
- 238000004891 communication Methods 0.000 description 17
- 238000013461 design Methods 0.000 description 15
- 238000010586 diagram Methods 0.000 description 10
- 239000000463 material Substances 0.000 description 6
- 238000012552 review Methods 0.000 description 6
- 206010047289 Ventricular extrasystoles Diseases 0.000 description 5
- 238000004458 analytical method Methods 0.000 description 5
- 230000006399 behavior Effects 0.000 description 5
- 238000005129 volume perturbation calorimetry Methods 0.000 description 5
- 230000004044 response Effects 0.000 description 4
- 230000001360 synchronised effect Effects 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 239000000284 extract Substances 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000008447 perception Effects 0.000 description 3
- 239000007787 solid Substances 0.000 description 3
- 101000827703 Homo sapiens Polyphosphoinositide phosphatase Proteins 0.000 description 2
- 102100023591 Polyphosphoinositide phosphatase Human genes 0.000 description 2
- 101100233916 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) KAR5 gene Proteins 0.000 description 2
- 230000002596 correlated effect Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000008707 rearrangement Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 101001121408 Homo sapiens L-amino-acid oxidase Proteins 0.000 description 1
- 102100026388 L-amino-acid oxidase Human genes 0.000 description 1
- 101100012902 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) FIG2 gene Proteins 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 239000000969 carrier Substances 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003058 natural language processing Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000036961 partial effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000004549 pulsed laser deposition Methods 0.000 description 1
- 230000002829 reductive effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
Definitions
- the present application relates to the field of digital technology, and in particular to a method, device, equipment and computer-readable storage medium for generating interactive resources.
- the objects with interactive behaviors include the virtual anchor who is broadcasting live and the audience watching the live broadcast.
- the virtual anchor interacts with the audience during the live broadcast and needs to rely on interactive resources to perform actions. Therefore, a method for generating interactive resources is needed.
- the present application provides a method, apparatus, device and computer-readable storage medium for generating interactive resources to obtain interactive resources for interaction.
- the technical solution is as follows:
- a method for generating interactive resources comprising: obtaining at least one interactive intention information of at least one first user, the attributes of the interactive intention information comprising one or more of type and user level, the type of the interactive intention information comprising one or more of text message, reward, like, dislike, share, follow, and unfollow; adjusting a first interactive resource according to the at least one interactive intention information, the first interactive resource being content viewed by the first user, the first interactive resource comprising a sub-interactive resource corresponding to at least one subtitle, the type of the first interactive resource comprising one or more of text, audio, picture, and video.
- the first interactive resource is adjusted in real time according to the interactive intention information generated during the interactive process, thereby improving the real-time performance of the first interactive resource.
- the adjustment efficiency of the first interactive resource is high, so that the first interactive resource is more adapted to the interactive process, thereby improving the interactive capability in the interactive scenario and the experience of interacting based on the first interactive resource.
- the method further includes: receiving an interactive resource adjustment strategy, the interactive resource adjustment strategy including one or more of a priority, a weight, or a threshold corresponding to an attribute of interactive intent information; adjusting the first interactive resource according to at least one interactive intent information includes: adjusting the first interactive resource according to at least one interactive intent information and the interactive resource adjustment strategy.
- the type of information included in the interactive resource adjustment strategy is not limited, and may be at least one of a priority, a weight, or a threshold, and has high versatility. Regardless of the type of information included in the interactive resource adjustment strategy, the first interactive resource can be adjusted according to the interactive intent information and the interactive resource adjustment strategy, and the flexibility of adjusting the first interactive resource is high.
- adjusting the first interactive resource includes: skipping the sub-interaction resources corresponding to the subtitle currently displayed and the n subtitles to be displayed in the first interactive resource, where n is an integer greater than or equal to 0; and displaying the sub-interaction resources corresponding to the n+1 subtitles after the currently displayed subtitle.
- the sub-interaction resources corresponding to the subtitles that the first user does not want to view can be skipped according to the interactive intention information, thereby achieving flexible display of the first interactive resource and ensuring the viewing experience of the first user.
- the first interactive resource is generated based on the second interactive resource.
- the method further includes: obtaining reference intention information input by the second user, the reference intention information is used to indicate the theme of the second interactive resource; obtaining at least one subtitle and the text content corresponding to each of the at least one subtitle according to the reference intention information, the subtitle is used to indicate the theme of part of the content in the theme of the second interactive resource; and displaying the second interactive resource, the second interactive resource including at least one subtitle and the text content corresponding to each subtitle.
- the subtitle is determined by the reference intention information, and the text content corresponding to the subtitle is automatically obtained, thereby generating the second interactive resource required for use in the interactive process.
- the process of generating the second interactive resource has low manual participation, low generation cost, and high generation efficiency.
- the method further includes: obtaining a subtitle configuration request input by a second user, the subtitle configuration request is used to delete the first subtitle in at least one subtitle, or to add a second subtitle; the subtitle configuration request is used to add a second subtitle, the subtitle configuration request also includes the subtitle text of the second subtitle, and the method further includes: obtaining the text content corresponding to the second subtitle.
- the adjustment of the subtitle can be to delete the first subtitle or to add the second subtitle, and the adjustment methods are diverse and highly versatile.
- the text content corresponding to the second subtitle is obtained, and the text content included in the second interactive resource is added, so that the second interactive resource The text content is more comprehensive and accurate.
- the method further includes: obtaining a media resource corresponding to each of at least one subtitle, the type of the media resource includes one or more of an image, an audio, and a video, and the source of the media resource is one or more of a knowledge base, the Internet, and an artificial intelligence (AI) model generation; and displaying a first interactive resource, the first interactive resource being generated based on a second interactive resource corresponding to each of the at least one subtitle and a corresponding media resource.
- the method of obtaining the media resource required to be used in the process of generating the first interactive resource is not limited, and can be obtained through any method such as a knowledge base, the Internet, and an AI model, which is highly flexible.
- the method further includes: receiving a media resource input by a second user; and storing the media resource in a knowledge base. Storing the received media resource in the knowledge base enriches the media resources included in the knowledge base, and the media resources corresponding to each sub-title obtained by searching based on the richer knowledge base are more accurate.
- a device for generating interactive resources which includes: an acquisition module for acquiring at least one interactive intention information of at least one first user, the attributes of the interactive intention information include one or more of type and user level, and the type of the interactive intention information includes one or more of text message, reward, like, dislike, share, follow, and unfollow; an adjustment module for adjusting a first interactive resource according to at least one interactive intention information, the first interactive resource being content viewed by the first user, the first interactive resource including a sub-interactive resource corresponding to at least one subtitle, and the type of the first interactive resource including one or more of text, audio, picture, and video.
- the device also includes: a receiving module for receiving an interaction resource adjustment strategy, the interaction resource adjustment strategy including one or more of a priority, a weight or a threshold corresponding to the attributes of the interaction intent information; an adjustment module for adjusting the first interaction resource according to at least one interaction intent information and the interaction resource adjustment strategy.
- the adjustment module is used to skip the sub-interaction resources corresponding to the currently displayed subtitle and n subtitles to be displayed in the first interaction resource, where n is an integer greater than or equal to 0; and display the sub-interaction resources corresponding to the n+1 subtitle after the currently displayed subtitle.
- a first interactive resource is generated based on a second interactive resource
- an acquisition module is further used to acquire reference intent information input by a second user, where the reference intent information is used to indicate a subject of the second interactive resource; at least one subtitle and text content corresponding to each of at least one subtitle are acquired based on the reference intent information, where the subtitle is used to indicate a subject of part of the subject of the second interactive resource; the device also includes: a display module, used to display the second interactive resource, where the second interactive resource includes at least one subtitle and text content corresponding to each subtitle.
- the acquisition module is further used to obtain a subtitle configuration request input by a second user, the subtitle configuration request is used to delete a first subtitle in at least one subtitle, or to add a second subtitle; the subtitle configuration request is used to add a second subtitle, the subtitle configuration request also includes a subtitle text of the second subtitle, and the acquisition module is further used to obtain text content corresponding to the second subtitle.
- the acquisition module is also used to acquire media resources corresponding to each subtitle in at least one subtitle, where the types of media resources include one or more of images, audio, and video, and the sources of the media resources are one or more of a knowledge base, the Internet, and artificial intelligence (AI) model generation;
- the display module is also used to display a first interactive resource, which is generated based on a second interactive resource and a corresponding media resource corresponding to each subtitle in at least one subtitle.
- the acquisition module is further configured to receive a media resource input by a second user; and store the media resource in a knowledge base.
- a computing device cluster comprising at least one computing device, each computing device comprising a processor and a memory; the processor of at least one computing device is used to execute instructions stored in the memory of the at least one computing device, so that the computing device cluster executes any one of the interactive resource generation methods of the first aspect above.
- a computer-readable storage medium wherein the computer-readable storage medium includes computer program instructions.
- the computing device cluster executes any one of the interactive resource generation methods of the first aspect.
- a computer program comprising instructions is provided.
- the instructions are executed by a computing device cluster, the computing device cluster executes any one of the methods for generating interactive resources of the first aspect.
- a communication device comprising: a transceiver, a memory, and a processor.
- the transceiver, the memory, and the processor communicate with each other through an internal connection path, the memory is used to store instructions, the processor is used to execute the instructions stored in the memory to control the transceiver to receive signals and control the transceiver to send signals, and when the processor executes the instructions stored in the memory, the processor executes the method in the first aspect or any possible implementation of the first aspect.
- the number of the processors is one or more, and the number of the memories is one or more.
- the memory may be integrated with the processor, or the memory may be provided separately from the processor.
- the memory can be a non-transitory memory, such as a read-only memory (ROM), which can be integrated with the processor on the same chip or can be set on different chips.
- ROM read-only memory
- a chip comprising a processor for calling and executing instructions stored in a memory from the memory, so that a communication device equipped with the chip executes the methods in the above aspects.
- another chip comprising: an input interface, an output interface, a processor and a memory, wherein the input interface, the output interface, the processor and the memory are connected via an internal connection path, and the processor is used to execute the code in the memory.
- the processor is used to execute the methods in the above aspects.
- FIG1 is a schematic diagram of an implementation environment provided by an embodiment of the present application.
- FIG2 is a flow chart of a method for generating interactive resources provided in an embodiment of the present application.
- FIG3 is a schematic diagram of a process of obtaining a resource set provided in an embodiment of the present application.
- FIG4 is a schematic diagram of a process of adjusting a first interaction resource provided in an embodiment of the present application.
- FIG5 is a schematic diagram of an interaction process provided in an embodiment of the present application.
- FIG6 is a schematic diagram of the structure of an interactive resource generation device provided in an embodiment of the present application.
- FIG7 is a schematic diagram of the structure of a computing device provided in an embodiment of the present application.
- FIG8 is a connection diagram of a computing device provided in an embodiment of the present application.
- the different objects for interaction are the anchor who is broadcasting live and the audience watching the live broadcast.
- the interactive resources can be the video of the anchor's performance played during the live broadcast, the audience watching the played video, and adjusting the played video according to the audience's feedback to realize the interaction between the anchor and the audience. Therefore, a method for generating interactive resources is needed.
- the interactive resources displayed are manually adjusted according to the audience's feedback to achieve dynamic generation of interactive resources.
- the method of relying on manual adjustment will result in high acquisition costs of interactive resources and low adjustment efficiency.
- the reaction threshold is an indication set according to experience to indicate the number of manual reaction capabilities.
- the embodiment of the present application provides a method for generating interactive resources, which is used to dynamically generate and adjust interactive resources used in the interactive process.
- Figure 1 shows a schematic diagram of the implementation environment of the method for generating interactive resources provided in the embodiment of the present application.
- the implementation environment is a computing device cluster 10, and the computing device cluster 10 includes at least one orchestration device.
- the orchestration devices can be communicated and connected via a wired or wireless network.
- the method for generating interactive resources can be executed independently by an orchestration device, or it can be interactively executed by multiple orchestration devices included in the computing device cluster 10.
- the embodiment of the present application does not limit the number of orchestration devices included in the computing device cluster 10.
- Figure 1 only takes two orchestration devices as an example for illustration.
- the orchestration device included in the computing device cluster 10 can be any network device with data processing function, and the orchestration device can be a server, such as a central server, an edge server, or a local server in a local data center.
- the server can be a physical server or a cloud server that provides a cloud computing server.
- the orchestration device included in the computing device cluster 10 can also be a terminal device such as a desktop computer, a laptop computer, or a smart phone.
- FIG. 2 The flowchart of the method for generating interactive resources provided in the embodiment of the present application is shown in FIG. 2 , including S201 - S202 .
- S201 obtaining at least one interactive intention information of at least one first user, where the attributes of the interactive intention information include type, user level,
- the type of interaction intention information includes one or more of text messages, rewards, likes, dislikes, shares, follows, and unfollows.
- the first user refers to a user who watches a live broadcast.
- the embodiment of the present application does not limit the number of first users, which may be one or more.
- the live broadcast watched by the first user is realized by displaying a first interactive resource. Therefore, the arrangement device needs to obtain the first interactive resource first.
- the type of the first interactive resource may be one or more of text, audio, picture, and video. Regardless of the type of the first interactive resource, the process of obtaining the first interactive resource is similar.
- the first interactive resource is generated based on the second interactive resource, and the layout device needs to obtain the second interactive resource before obtaining the first interactive resource.
- the process of the layout device obtaining the second interactive resource includes: obtaining reference intent information input by the second user, the reference intent information is used to indicate the theme of the second interactive resource; according to the reference intent information, obtaining at least one subtitle and the text content corresponding to each of the at least one subtitle, the subtitle is used to indicate the theme of part of the content in the theme of the second interactive resource; displaying the second interactive resource, the second interactive resource includes at least one subtitle and the text content corresponding to each subtitle.
- the reference intent information indicates the subject of the second interactive resource, and the subject refers to the information that needs to be delivered to the first user during the interaction through the second interactive resource.
- the live interactive scenario is selling products through live broadcast
- the second user is the audience watching the live broadcast
- the information that needs to be delivered to the first user during the live broadcast through the second interactive resource is the information of the products to be sold. Therefore, the subject of the second interactive resource is the information of the products to be sold.
- the arrangement device may receive reference intent information input by the second user.
- the arrangement device provides an information input control, and the second user inputs the reference intent information according to the information input control.
- the second user may be a person who supervises and manages the live broadcast, and the second user may determine the reference intent information according to the business arrangement.
- the business arrangement requires a live broadcast to introduce product A, and the second object thereby determines the reference intent information as introducing product A, and inputs the determined reference intent information into the arrangement device through the information input control.
- the orchestration device can also determine reference intent information based on historical interaction data.
- the generation time of the historical interaction data is before the moment of generating the second interaction resource, and the interaction data generated by the first user in the process of watching the historical live broadcast is the historical interaction data.
- the orchestration device can determine the reference intent information based on the historical interaction data.
- the anchor asks about the needs of the next live broadcast at the end of the previous live broadcast, "What do you want to see when we meet next time?"
- the first user watching the live broadcast replies through the barrage, "I want to see the anchor sing.”
- the orchestration device collects the live broadcast data of the previous live broadcast as historical interaction data, parses the text information in the historical interaction data, and obtains the reference intent information.
- the arrangement device may choose to receive the reference intent information input by the second user, or may choose to determine the reference intent information based on historical interaction data, or may use the above two methods to determine the reference intent information. For example, the arrangement device determines that the reference intent information of the second interactive resource is to introduce product A and perform singing based on the introduction of product A input by the second user and the performance of singing determined by historical interaction data. That is, the embodiment of the present application does not limit the number of reference intent information used in the process of generating the second interactive resource, which can be any number.
- the reference intent information can be a topic as exemplified above, or it can be a sentence, which is not limited in the embodiment of the present application.
- the process of generating a second interactive resource based on multiple reference intent information is similar to the process of generating a second interactive resource based on one reference intent information, the method of generating a second interactive resource will be introduced below by taking the process of generating a second interactive resource based on one reference intent information as an example.
- the layout device determines at least one subtitle corresponding to the reference intent information based on the reference intent information.
- the subtitle is used to indicate the theme of part of the content in the theme of the second interactive resource.
- the theme of the second interactive resource indicates the information that needs to be transmitted, and the transmitted information can be summarized into at least one subtitle based on the content characteristics of each paragraph.
- the layout device can search according to the reference intent information to determine at least one subtitle corresponding to the reference intent information. Taking the reference intent information as an introduction to product A as an example, the layout device searches according to product A to obtain the product's function, appearance design, material quality, and usage experience. Therefore, the subtitles corresponding to the reference intent information are function introduction, appearance design introduction, material quality introduction, and usage experience introduction.
- the editing device will also refer to the interactive features corresponding to the second interactive resource in the process of determining at least one subtitle corresponding to the reference intent information.
- the interactive features are, for example, the personality characteristics of the third user and at least one of the interactive scenarios of the second interactive resource.
- the third user refers to the user who conducts the live broadcast, and the third user can be a virtual object created by technical means such as modeling, motion capture, artificial intelligence (AI), etc.
- a virtual object is, for example, a digital human with human or human-like appearance features and behavior patterns, that is, the method for generating interactive resources provided in the embodiment of the present application can be used in live interactive scenarios such as digital human live broadcast, digital human performance, or digital human intelligent interaction.
- the virtual object can also be a virtual cartoon character with the appearance features of a cartoon image.
- the arrangement device can obtain the interactive features provided by the second user and determine the subtitles based on the interactive features. Taking live broadcast as an example, since live broadcast is a way of playing that can interact with the audience, the arrangement device determines the subtitles needed for interaction, such as welfare delivery and barrage question answering. In addition, based on the personality characteristics of the third user, some information transmission needs will also arise. For example, if the personality characteristics of the third object are cheerful and outgoing and likes talent show, the arrangement device can set the subtitle as talent show according to the personality characteristics of the third object. At least one subtitle is generated in a targeted manner according to the reference intention information and the performance characteristics to clarify the content characteristics of each part of the content that needs to be displayed during the live broadcast.
- the layout device can directly obtain the text content corresponding to each subtitle, or adjust the subtitle to obtain the text content corresponding to the adjusted subtitle.
- the layout device obtains a subtitle configuration request input by the second user, and the subtitle configuration request is used to delete the first subtitle in at least one subtitle, or add a second subtitle.
- the layout device displays at least one subtitle to the second user, and the second user adjusts the displayed subtitle to obtain the adjusted subtitle.
- the adjustment can be to add a subtitle, and the added subtitle can be called the second subtitle in some cases.
- the adjustment can also be to delete a subtitle, and the deleted subtitle can be called the first subtitle in some cases.
- the second user believes that an overall introduction of the product is needed before introducing the product, which can facilitate the audience's understanding.
- the second user inputs the overall introduction as the second subtitle to be added according to the information input control provided by the layout device.
- the layout device obtains the subtitle configuration request according to the operation of the second user, and adds the second subtitle to at least one subtitle according to the subtitle configuration request to obtain the adjusted subtitle.
- the layout device can obtain text content corresponding to each subtitle in at least one subtitle.
- the text content corresponding to the subtitle refers to the text said by the third user in the process of introducing the subtitle, such as an introduction.
- the layout device can obtain the text content corresponding to each subtitle through search, or generate the text content corresponding to each subtitle according to the content characteristics of each subtitle. For example, based on natural language processing technology, by simulating the processing and understanding of human language, the corresponding text content is generated according to the subtitle.
- the layout device After the layout device determines at least one subtitle and the text content corresponding to each subtitle by performing the above operations, it obtains a second interactive resource including each subtitle and the text content of the subtitle. Afterwards, the layout device can generate a first interactive resource based on the second interactive resource.
- the process of the layout device generating a first interactive resource based on the second interactive resource includes: obtaining a media resource corresponding to each subtitle in at least one subtitle, the type of the media resource includes one or more of an image, audio, and video, and the source of the media resource is one or more of a knowledge base, the Internet, and an artificial intelligence (AI) model generation; generating a first interactive resource based on the second interactive resource corresponding to each subtitle in at least one subtitle and the corresponding media resource.
- AI artificial intelligence
- the embodiments of the present application do not limit the media resources corresponding to the subtitle.
- they may also include artistic words, stickers, backgrounds, etc.
- the video refers to the video displayed during the third user's introduction of the subtitle
- the music is the music played during the third user's introduction of the subtitle, such as the background music played when the third user reads the text content corresponding to the subtitle.
- the artistic words are text that has been artistically processed and can be used to highlight the text that needs to be emphasized during the display of the subtitle. Taking live broadcast as an example, the artistic words are the subtitle names displayed on the live video being played.
- Stickers are data for optimizing the first interactive resource by the third user in the process of displaying the subtitle.
- the stickers can be special-effect stickers for optimizing the portrait of the third user in the video.
- the background is the spatial background where the third user is located during the display of the subtitle, and the picture is the picture used by the third user in the process of introducing the subtitle.
- the editing device needs to determine the type of media resources corresponding to each subtitle, and then obtain the media resources corresponding to each subtitle according to the type of media resources corresponding to each subtitle.
- the type of media resources is referred to as media type below.
- the editing device can determine all the multiple media types involved as the media types corresponding to each subtitle, thereby ensuring the comprehensive collection of media resources, or determine the media type corresponding to each subtitle according to the selection of the second user, or randomly select a media type from multiple media types and use the selected media type as the media type to be used.
- the embodiment of the present application does not limit the method for determining the media type corresponding to each subtitle.
- the media types corresponding to different subtitles can be the same or different.
- the editing device After determining the media type corresponding to each subtitle, the editing device obtains the media resources corresponding to the subtitle according to the media type.
- the acquisition method is, for example, to search according to the subtitle and the media type to obtain the media resources.
- the editing device searches in a knowledge base or the Internet through a search engine.
- the knowledge base can be an open source knowledge base or a knowledge base created by a second user.
- the second user inputs multiple media resources
- the editing device receives the media resources input by the second user; and stores the media resources in the knowledge base.
- the editing device thereby obtains a knowledge base including multiple media resources.
- the knowledge base is, for example, a video website, a photo library, and the like.
- the editing device can also generate media resources.
- media resources are generated according to subtitles and media types through an AI model, and the AI model is, for example, a generative artificial intelligence (AIGC) model.
- AIGC generative artificial intelligence
- the arrangement device may, for example, as shown in FIG3, call the subtitle generation unit and the resource search and generation unit included in the resource generation module, generate the second interactive resource and the media resource according to the reference intent information, and then display the resource set including the media resource and the second interactive resource to the second user, who then reviews or adjusts the displayed resource set for user review.
- the second interactive resource includes each subtitle and the text content corresponding to each subtitle, and the media resource is each subtitle,
- the resource set can be understood as a set of text content and media resources corresponding to each subtitle.
- the adjustment of the resource set is, for example, adding text content or media resources included in the resource set, or deleting media resources or text content included in the resource set.
- the editing device can generate a first interactive resource based on the resource set that has passed the second user review.
- the resource collection can be referred to as a script or a script tree.
- the script is used to guide live interaction, and the guidance method is, for example, to generate a first interactive resource for live display based on the script, and the first interactive resource is, for example, a video of a digital human performance.
- the guidance method can also be to display the script to the real user so that the real user can perform according to the script.
- the subtitles included in the resource collection can be understood as the leaf nodes included in the script tree
- the text content corresponding to the subtitles can be understood as the words contained in the leaf nodes
- the media resources corresponding to the subtitles can be understood as the materials corresponding to the leaf nodes.
- the editing device can generate a first interactive resource based on the media resources and text content corresponding to each subtitle.
- the editing device can select a subtitle to be displayed from at least one subtitle to generate a first interactive resource based on the second interactive resource and media resource corresponding to the subtitle to be displayed.
- the editing device can select a subtitle to be displayed from multiple subtitles based on a reference threshold, and the reference threshold can be an arbitrary value set based on experience.
- the editing device can also determine the subtitle to be displayed based on the selection of the second user.
- the editing device can select the media type of the media resource required to display each subtitle from the media resources corresponding to each subtitle in the process of generating the first interactive resource based on the media resources and the second interactive resources corresponding to the subtitle, and generate the sub-interactive resource corresponding to each subtitle based on the selected media type, so as to obtain a first interactive resource including the sub-interactive resources corresponding to multiple subtitles.
- the layout device performs semantic analysis on the text content of each subtitle, and determines the media type to be used based on the semantic analysis results.
- the layout device performs semantic analysis on the text content corresponding to the appearance design to determine that the appearance design requires displaying the shape, pattern, color, etc. of the watch.
- the layout device thus determines that the media types to be used are pictures/backgrounds and artistic words. Among them, pictures are used to display the shape and pattern of the watch, etc., and artistic words are used to emphasize the design features of the watch.
- the layout device can also use other methods. For example, receive the media type of the subtitle input by the second user. Regardless of the method used to complete the selection of the media type, the layout device can generate a sub-interaction resource corresponding to the subtitle according to the selected media type.
- the layout device selects a high-definition photo of a watch as the background or as a picture displayed by a third user, and adds some artistic words to the photo of the watch to highlight the design features of the watch.
- the introduction words and the watch photo as text content are integrated with the artistic words to generate an introductory video or graphic content introducing the appearance design of the watch.
- the generation process of the sub-interaction resources corresponding to other subtitles is similar.
- different subtitles have a display order, and the display order can be determined according to the language logic order.
- the subtitles that need to be displayed include function introduction, appearance design introduction, material quality introduction, user experience introduction, welfare delivery, and barrage question answering as an example.
- the editing device determines the display order of multiple subtitles as appearance design introduction, function introduction, welfare delivery, material quality introduction, user experience introduction, and barrage question answering according to the language logic order.
- the sub-interaction resources corresponding to each subtitle are arranged in sequence according to the execution order of the subtitles.
- the transition processing process includes: determining two sub-titles that need transition processing, the two sub-titles are adjacent sub-titles in the display order; generating transition data according to the text content corresponding to the two sub-titles, the transition data is used to connect the text content corresponding to the two sub-titles; generating transition resources according to the transition data, the transition resources are used to connect the sub-interaction resources corresponding to the two sub-titles.
- the arrangement device may display the first interactive resource to realize the interaction between the third user and the first user.
- the arrangement device may also obtain the interactive intention information to adjust the displayed first interactive resource according to the interactive intention information.
- the interactive intention information is, for example, the interactive intention information of at least one first user.
- the user's interactive intention information may be intention information generated by the first user in the process of watching the first interactive resource. For example, as shown in FIG4 , the arrangement device starts the interactive performance by displaying the first interactive resource, and the first user performs some user behaviors in the process of watching the interactive performance, and the user behaviors generated the interactive intention information of the first user.
- the interactive intent information obtained by the orchestration device also has attributes, and the attributes include one or more of type or user level.
- the types of intent information include text messages, rewards, on-demand, clicks, sharing, and attention.
- the type of interactive intent information refers to the way in which the interactive intent information is generated.
- the user level in the attributes of the interactive intent information refers to the user level of the first user who generates the interactive intent information.
- the user level of the first user indicates the importance of the first user.
- the user level can be determined based on the historical interaction of the first user. For example, the higher the historical rewards accumulated by the first user and the more historical barrage releases, the higher the user level of the first user.
- the process of the orchestration device obtaining the interactive intention information of the first user includes: obtaining the interactive environment data of the first interactive resource, the interactive environment data including the interactive intention information of the first user; extracting at least one interactive intention information from the interactive environment data.
- the interactive environment data is, for example, the background data of the live broadcast room that plays the first interactive resource.
- the orchestration device can, as shown in Figure 4, pull the background data of the live broadcast room through the interactive environment perception unit in the environment perception module as the interactive environment data.
- the interactive environment data includes the interactive intention information of the first user.
- the background data of the live broadcast room as the interactive environment data includes the text message of the first user sending the barrage, the gift record generated by the reward, the transaction data generated by placing an order, and the fan attention record generated by following or unfollowing.
- the embodiment of the present application does not limit the way in which the orchestration device obtains the interactive intention information from the interactive environment data.
- the orchestration device can obtain the interactive conditions and extract the interactive intention information from the interactive environment data through the interactive conditions.
- the interactive conditions can be obtained based on experience and implementation environment settings, and the implementation environment is, for example, an interactive scene.
- the interactive conditions corresponding to the live broadcast room are set according to experience as one or more of text messages, rewards, likes, dislikes, sharing, following and unfollowing.
- the orchestration device obtains the interactive conditions, it determines whether the information included in the interactive environment data hits the interactive conditions. When the information in the interactive environment data hits any interactive condition, it determines that the information is interactive intention information that requires interactive feedback from a third user. When the information in the interactive environment data does not hit the interactive condition, it determines that the information does not require interactive feedback from a third user.
- the above operations are also the operations performed by the interactive condition unit included in the environmental perception module in Figure 4.
- the arrangement device extracts barrage data, gift records, transaction data and fan attention records from the background data to obtain multiple interactive intention information.
- a second object can correspond to one interactive intention information or multiple interactive intention information, which is not limited in the embodiment of the present application.
- the solid arrow indicates that the processing is performed by the module included in the arrangement device, and the dotted arrow indicates that the processing is performed by the user, such as the first user or the second user.
- the interaction intention information may also be the intention information generated by the second user.
- the second user finds that the introduction of product B in the first interaction resource needs to be canceled because the cooperation time of product B has ended.
- the interaction intention information is to cancel the introduction of product B.
- the orchestration device may receive the interaction intention information input by the second user to obtain the interaction intention information.
- the second user inputs the interaction intention information through the information input control provided by the orchestration device, and the orchestration device thereby obtains the interaction intention information generated during the interaction process.
- the first interactive resource is content viewed by a first user
- the first interactive resource includes a sub-interactive resource corresponding to at least one subtitle
- the type of the first interactive resource includes one or more of text, audio, picture, and video.
- the arrangement device can adjust the first interactive resource according to the multiple interactive intents after acquiring the multiple interactive intent information. Because there may be interactive intent information that requires interaction among the multiple interactive intent information, such as the barrage question that the first user needs the third user to answer, or the first user needs the third user to thank his reward. And there may also be interactive intent information that does not require interaction among the multiple interactive intent information acquired by the arrangement device. For example, in order to improve his user level during the process of watching the first interactive resource, the first user will send meaningless water posts, such as emoticons and numbers, through the barrage. For such meaningless water posts, the third user does not need to interact and feedback. Or, the number of interactive intent information that the third user can interact and feedback is limited. For example, in order to control the length of the live broadcast, the host only has ten minutes to interact with the audience after introducing the product, or the host can only answer ten barrage questions.
- the orchestration device needs to select interactive intent information for interactive feedback from multiple interactive intent information.
- the orchestration device receives an interactive resource adjustment strategy, which includes one or more of the priority, weight, or threshold corresponding to the attributes of the interactive intent information, and then can select the interactive intent information that requires interactive feedback according to the interactive resource adjustment strategy, thereby adjusting the first interactive resource according to at least one interactive intent information and the interactive resource adjustment strategy.
- the embodiment of the present application does not limit the process of determining the weight of the interactive intent information.
- the orchestration device can cluster each interactive intent information according to the interaction requested by each interactive intent information to obtain multiple intent sets, and any intent set includes at least one interactive intent information; Take at least one of the first weight, second weight and third weight of any intention set, and determine the weight of any intention set according to at least one of the first weight, second weight and third weight, the first weight is determined according to the amount of interactive intent information included in any intention set, the second weight is determined according to the user level of the first user corresponding to any intention set, and the third weight is determined according to the conditional weight of the interactive condition hit by any interactive set.
- the same first user posts the same question multiple times in the barrage in order to attract the attention of the third user.
- the questions asked by different first users in the barrage are consistent in intent, for example, there is a first user A who asks: What size should I wear if I am XXX in height and XX in weight, and there is a first user B who asks: I am curious about the size information.
- the interactions of the interactive intent information of the first user A and the interactive intent information request of the first user B are both to feedback the product size chart.
- the orchestration device can cluster multiple interactive intent information according to the interactions requested by each interactive intent information to obtain multiple intent sets, and the interactions required for the interactive intent information included in any intent set are consistent.
- the clustering process is, for example, when the interactions requested by multiple interactive intent information are the same, dividing the multiple interactive intent information into one intent set.
- the interactive intent information of the first user A and the interactive intent information of the first user B belong to one intent set.
- the orchestration device can determine the interaction weight of any intent set.
- the orchestration device may determine the first weight according to the number of interactive intent information included in any one intent set.
- the number of interactive intent information and the first weight are positively correlated.
- the more interactive intent information included in any one intent set the more interested the first user is in the interaction requested by the interactive intent information, and the more the third user needs to interact.
- the orchestration device may determine the number of interactive intent information included in any one intent set as the first weight, or may process the number to obtain the first weight.
- the processing is, for example, to analyze the number using an analytic hierarchy process (AHP) to obtain the first weight.
- AHP an analytic hierarchy process
- the first user corresponding to any intent set will also affect the weight of any intent set.
- the first user corresponding to any intent set refers to the interactive intent information generated by the first user as the interactive intent information included in any intent set.
- the user level and the second weight are positively correlated.
- the orchestration device can determine the second weight of each intent set according to the user level and the second weight determination strategy included in the interactive resource adjustment strategy.
- the process of determining the second weight according to the user level is similar to the process of determining the first weight according to the quantity. For detailed description, please refer to the above embodiment, which will not be repeated here.
- the interactive conditions hit by any intent set will also affect the weight of any intent set.
- Each interactive condition also has a conditional weight, and the conditional weight of the interactive condition indicates the importance of the interactive condition.
- the conditional weight of each interactive condition can be determined according to the interactive resource adjustment strategy. Taking the interactive conditions including rewards and text information as an example, the interactive resource adjustment strategy indicates that the importance of text information is higher than the importance of rewards, then the conditional weight of text information is higher than the conditional weight of rewards.
- the orchestration device can determine the third weight according to the conditional weight based on the interactive conditions hit by the interactive intent information included in any intent set. When the conditional weights hit by each interactive intent information included in any intent set are the same, the conditional weight of the hit can be determined as the third weight. When the conditional weights hit by each interactive intent information included in any intent set are different, the third weight can be calculated based on multiple conditional weights.
- the orchestration device may determine the weight of the intent set according to at least one of the first weight, the second weight, and the third weight.
- the orchestration device may determine the first weight as the weight of the intent set, or the second weight as the weight of the intent set, or the third weight as the weight of the intent set, or may determine the weight of any intent set through weighted calculation based on any two or three of the first weight, the second weight, and the third weight.
- the orchestration device can determine at least one intent set that needs to interact based on the weights of each intent set.
- the orchestration device can select at least one intent set that needs to interact based on the weights of the intent sets. For example, a weight threshold is set based on experience, and for any intent set, if the weight of any intent set is greater than the weight threshold, then any intent set needs to interact.
- a quantity threshold is set based on experience, and multiple intent sets are arranged in sequence according to the weights of the intent sets, and the intent sets whose arrangement order is not lower than the quantity threshold are determined as intent sets that need to interact.
- the interactive intent information corresponding to the intent set can be determined as the interactive intent information for adjusting the first interactive resource.
- the interactive intent information for adjusting the first interactive resource is determined to skip the subtitle.
- the information volume of the interactive intent information is higher than the second threshold, it is determined that the first user has a low interest in the subtitle, and the interactive intent information for adjusting the first interactive resource is determined to skip the subtitle.
- the second user has a high degree of interest in the subtitle, and the interactive intention information used to adjust the first interactive resource is determined to enrich the sub-interactive resource corresponding to the subtitle.
- the first threshold and the second threshold are values of any size set based on experience.
- the orchestration device may also obtain the priorities corresponding to the attributes of each interactive intent information, and select the interactive intent information used to adjust the first interactive resource according to the priorities corresponding to the attributes of each interactive intent information.
- the orchestration device extracts the priorities corresponding to the attributes of each interactive intent information from the received interactive resource adjustment strategy, arranges each interactive intent information in sequence according to the priorities corresponding to the attributes of each interactive intent information, and determines the interactive intent information whose arrangement order is not lower than the quantity threshold as the interactive intent information used to adjust the first interactive resource.
- the priorities corresponding to the attributes of the interactive intent information are, for example, that the priority of text messages is higher than that of sharing, and the priority of clicks is higher than that of text messages.
- the first interactive resource can be adjusted according to the determined interactive intent information.
- the adjustment process includes: adjusting the subtitle corresponding to the first interactive resource according to the interactive intent information to obtain an adjusted subtitle; and obtaining the adjusted first interactive resource according to the sub-interactive resource corresponding to the adjusted subtitle.
- the editing device deletes the function introduction of product A and the subtitle included in the introduction of product A after the function introduction of product A. After completing the adjustment of the subtitle, the editing device can determine the sub-interaction resource corresponding to the adjusted subtitle.
- the dotted box in Figure 5 indicates the currently displayed subtitle.
- the editing device can skip the sub-interaction resources corresponding to the subtitle currently displayed and the n subtitles to be displayed in the first interactive resource, where n is an integer greater than or equal to 0; and display the sub-interaction resources corresponding to the n+1 subtitle after the currently displayed subtitle.
- the currently displayed subtitle and the n subtitles to be displayed are determined according to the interactive intent information.
- the n subtitles to be displayed are the appearance design, material quality, and user experience of product A.
- the editing device skips displaying the multiple sub-interaction resources corresponding to the introduction of product A in Figure 5, and then starts to display the sub-interaction resources corresponding to the n+1th subtitle after the currently displayed subtitle, that is, the sub-interaction resources corresponding to the overall introduction of product B in Figure 5.
- the problem of discontinuity of the sub-interaction resources corresponding to the sub-titles may occur due to the adjustment of the first interaction resource.
- the sub-interaction resources corresponding to the newly added sub-titles are discontinuous with the sub-interaction resources corresponding to the original sub-titles, or after skipping the sub-interaction resources corresponding to the original sub-titles, the sub-interaction resources corresponding to the currently displayed content and the sub-interaction resources corresponding to the n+1th sub-title to be displayed are discontinuous.
- the editing device needs to perform transition processing on the adjusted first interactive resource.
- the transition data corresponding to the subtitle is generated, or the text data of the sub-interactive resource corresponding to the adjusted subtitle is rewritten to ensure that the sub-interactive resource corresponding to the adjusted subtitle is smooth and natural.
- the editing device can call the interactive rearrangement unit in the resource editing module as shown in Figure 4 to perform transition processing on the adjusted first interactive resource.
- the resource generation module can directly send the full amount of resources to the resource editing module, or the second user can first review the full amount of resources as shown in Figure 4, and send the full amount of resources after user review to the resource editing module.
- the resource orchestration module can perform transition processing on the full amount of resources.
- the process of transition processing is similar to the process of transition processing in the process of generating the first interactive resource in S201. Please refer to the relevant description and will not be repeated here.
- the orchestration device can adjust the first interactive resource according to the interactive intent information generated during each interaction process, thereby achieving different interactive processes.
- the method for generating interactive resources adjusts the first interactive resource in real time according to the interactive intention information generated during the interaction process, so that the first interactive resource is more adapted to the interactive process, and the adjustment efficiency of the first interactive resource is high, so that the first interactive resource is more adapted to the interactive process, the interactive ability in the interactive scene is improved, and the experience of the interaction based on the first interactive resource is improved.
- At least one subtitle is determined by referring to the intention information, and then the text content and media resources required to be used are automatically obtained according to the subtitle, so as to generate the first interactive resource required to be used in the interactive process.
- the process of generating the first interactive resource has low manual participation, low cost and high efficiency.
- FIG. 6 is a structural schematic diagram of a device for generating interactive resources provided by an embodiment of the present application. Based on the following multiple modules shown in Figure 6, the device for generating interactive resources shown in Figure 6 can perform all or part of the operations shown in Figure 2 above. It should be understood that the device may include more additional modules than the modules shown or omit some of the modules shown therein, and the embodiment of the present application does not limit this. As shown in Figure 6, the device is used for live broadcast interaction, and the device includes:
- An acquisition module 601 is used to acquire at least one interaction intention information of at least one first user, where the attributes of the interaction intention information include one or more of type and user level, and the type of the interaction intention information includes one or more of text message, reward, like, dislike, share, follow, and unfollow;
- Adjustment module 602 is used to adjust the first interaction resource according to at least one interaction intention information, where the first interaction resource is the content viewed by the first user, the first interaction resource includes a sub-interaction resource corresponding to at least one subtitle, and the type of the first interaction resource includes one or more of text, audio, picture, and video.
- the adjustment module 602 is used to skip the sub-interaction resources corresponding to the currently displayed subtitle and n subtitles to be displayed in the first interaction resource, where n is an integer greater than or equal to 0; and display the sub-interaction resources corresponding to the n+1 subtitle after the currently displayed subtitle.
- the first interactive resource is generated based on the second interactive resource
- the acquisition module 601 is also used to obtain reference intent information input by the second user, and the reference intent information is used to indicate the subject of the second interactive resource; according to the reference intent information, at least one subtitle and the text content corresponding to each subtitle in at least one subtitle are obtained, and the subtitle is used to indicate the subject of part of the content in the subject of the second interactive resource;
- the device also includes: a display module, which is used to display the second interactive resource, and the second interactive resource includes at least one subtitle and the text content corresponding to each subtitle.
- the acquisition module 601 is further used to obtain a subtitle configuration request input by a second user, the subtitle configuration request is used to delete a first subtitle in at least one subtitle, or to add a second subtitle; the subtitle configuration request is used to add a second subtitle, the subtitle configuration request also includes a subtitle text of the second subtitle, and the acquisition module 601 is further used to obtain text content corresponding to the second subtitle.
- the acquisition module 601 is also used to acquire media resources corresponding to each subtitle in at least one subtitle, where the types of media resources include one or more of images, audio, and video, and the sources of the media resources are one or more of a knowledge base, the Internet, and artificial intelligence AI model generation; the display module is also used to display a first interactive resource, which is generated based on a second interactive resource and a corresponding media resource corresponding to each subtitle in at least one subtitle.
- the acquisition module 601 is further configured to receive a media resource input by a second user; and store the media resource in a knowledge base.
- the above-mentioned device adjusts the first interactive resource in real time according to the interactive intention information generated during the interactive process, thereby improving the real-time performance of the first interactive resource.
- the adjustment efficiency of the first interactive resource is high, so that the first interactive resource is more adaptable to the interactive process, and the interactive ability in the interactive scenario and the experience of interaction based on the first interactive resource are enhanced.
- both the acquisition module 601 and the adjustment module 602 can be implemented by software or by hardware.
- the implementation of the acquisition module 601 is described below by taking the acquisition module 601 as an example.
- the implementation of the adjustment module 602 can refer to the implementation of the acquisition module 601.
- the acquisition module 601 may include code running on a computing instance.
- the computing instance may include at least one of a physical host (computing device), a virtual machine, and a container. Further, the above-mentioned computing instance may be one or more.
- the acquisition module 601 may include code running on multiple hosts/virtual machines/containers. It should be noted that the multiple hosts/virtual machines/containers used to run the code may be distributed in the same region (region) or in different regions.
- the multiple hosts/virtual machines/containers used to run the code may be distributed in the same availability zone (AZ) or in different AZs, each AZ including one data center or multiple data centers with close geographical locations. Among them, usually a region may include multiple AZs.
- the acquisition module 601 may include at least one computing device, such as a server, etc.
- the acquisition module 601 may also be a device implemented using an application-specific integrated circuit (ASIC) or a programmable logic device (PLD).
- the PLD may be a complex programmable logical device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL) or any combination thereof.
- the multiple computing devices included in the acquisition module 601 can be distributed in the same region or in different regions.
- the multiple computing devices included in the acquisition module 601 can be distributed in the same AZ or in different AZs.
- the multiple computing devices included in the acquisition module 601 can be distributed in the same VPC or in multiple VPCs.
- the multiple computing devices can be any combination of computing devices such as servers, ASICs, PLDs, CPLDs, FPGAs, and GALs.
- the acquisition module 601 can be used to execute any step in the method for generating interactive resources
- the adjustment module 602 can be used to execute any step in the method for generating interactive resources.
- the steps that the acquisition module 601 and the adjustment module 602 are responsible for implementing can be specified as needed.
- the full functions of the interactive resource generation device are realized by respectively implementing different steps in the method for generating interactive resources through the acquisition module 601 and the adjustment module 602.
- the present application also provides a computing device 700.
- the computing device 700 includes: a bus 702, a processor 704, a memory 706, and a communication interface 708.
- the processor 704, the memory 706, and the communication interface 708 communicate with each other through the bus 702.
- the computing device 700 can be a server or a terminal device. It should be understood that the present application does not limit the number of processors and memories in the computing device 700.
- the bus 702 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc.
- the bus may be divided into an address bus, a data bus, a control bus, etc.
- FIG. 7 is represented by only one line, but does not mean that there is only one bus or one type of bus.
- the bus 702 may include a path for transmitting information between various components of the computing device 700 (e.g., the memory 706, the processor 704, and the communication interface 708).
- the memory 706 may include a volatile memory, such as a random access memory (RAM).
- the processor 704 may also include a non-volatile memory, such as a read-only memory (ROM), a flash memory, a hard disk drive (HDD), or a solid state drive (SSD).
- ROM read-only memory
- HDD hard disk drive
- SSD solid state drive
- the memory 706 stores executable program codes, and the processor 704 executes the executable program codes to respectively implement the functions of the acquisition module and the adjustment module, thereby implementing the interactive resource generation method. That is, the memory 706 stores instructions for executing the interactive resource generation method.
- the communication interface 708 uses a transceiver module such as, but not limited to, a network interface card or a transceiver to implement communication between the computing device 700 and other devices or communication networks.
- a transceiver module such as, but not limited to, a network interface card or a transceiver to implement communication between the computing device 700 and other devices or communication networks.
- the embodiment of the present application also provides a computing device cluster.
- the computing device cluster includes at least one computing device.
- the computing device can be a server, such as a central server, an edge server, or a local server in a local data center.
- the computing device can also be a terminal device such as a desktop computer, a laptop computer, or a smart phone.
- the structure of at least one computing device included in the computing device cluster may refer to the computing device 700 shown in Fig. 7.
- the memory 706 in one or more computing devices 700 in the computing device cluster may store the same instructions for executing the method for generating interactive resources.
- the memory 706 of one or more computing devices 700 in the computing device cluster may also store partial instructions for executing the method for generating interactive resources.
- the combination of one or more computing devices 700 may jointly execute instructions for executing the method for generating interactive resources.
- the memory 706 in different computing devices 700 in the computing device cluster can store different instructions, which are respectively used to execute part of the functions of the interactive resource generation device. That is, the instructions stored in the memory 706 in different computing devices 700 can implement the functions of one or more modules in the acquisition module and the adjustment module.
- one or more computing devices in the computing device cluster can be connected via a network.
- the network can be a wide area network or a local area network, etc.
- FIG. 8 shows a possible implementation. As shown in FIG. 8 , two computing devices 800A and 800B are connected via a network. Specifically, the network is connected via a communication interface in each computing device.
- computing devices 800A and 800B include a bus 802, a processor 804, a memory 806, and a communication interface 808. Instructions for executing the functions of the acquisition module are stored in the memory 806 in the computing device 800A. At the same time, instructions for executing the functions of the adjustment module are stored in the memory 806 in the computing device 800B.
- connection method between the computing device clusters shown in Figure 8 can be considered to be that the method for generating interactive resources provided in this application needs to obtain interactive intention information based on the display of the first interactive resource, so it is considered to hand over the functions implemented by the adjustment module to the computing device 800B for execution.
- the embodiment of the present application also provides a communication device, which includes: a transceiver, a memory, and a processor.
- the transceiver, the memory, and the processor communicate with each other through an internal connection path, the memory is used to store instructions, and the processor is used to execute the instructions stored in the memory to control the transceiver to receive signals and control the transceiver to send signals, and when the processor executes the instructions stored in the memory, the processor executes the method for generating interactive resources.
- the memory may include a read-only memory and a random access memory, and provide instructions and data to the processor.
- the memory may also include a non-volatile random access memory.
- the memory may also store information about the device type.
- the memory may be a volatile memory or a nonvolatile memory, or may include both volatile and nonvolatile memory.
- the nonvolatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory.
- the volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available.
- SRAM static RAM
- DRAM dynamic random access memory
- SDRAM synchronous DRAM
- DDR SDRAM double data rate synchronous dynamic random access memory
- ESDRAM enhanced synchronous dynamic random access memory
- SLDRAM synchronous link dynamic random access memory
- DR RAM direct rambus RAM
- the embodiment of the present application also provides a computer program (product) containing instructions.
- the computer program (product) may be software or a program (product) containing instructions that can be run on a computing device or stored in any available medium.
- the computer program (product) is run on at least one computing device, the at least one computing device executes the method for generating interactive resources.
- the embodiment of the present application also provides a computer-readable storage medium.
- the computer-readable storage medium can be any available medium that can be stored by a computing device or a data storage device such as a data center containing one or more available media.
- the available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk).
- the computer-readable storage medium includes instructions that instruct the computing device to execute a method for generating interactive resources.
- An embodiment of the present application also provides a chip, including a processor, for calling and executing instructions stored in a memory from the memory, so that a communication device equipped with the chip executes any of the above-described methods for generating interactive resources.
- An embodiment of the present application also provides another chip, including: an input interface, an output interface, a processor and a memory, wherein the input interface, the output interface, the processor and the memory are connected via an internal connection path, and the processor is used to execute the code in the memory.
- the processor is used to execute any of the interactive resource generation methods described above.
- the computer program product includes one or more computer instructions.
- the computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device.
- the computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium.
- the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means.
- the computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more available media integrated.
- the available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive Solid State Disk), etc.
- the computer program code for realizing the method for the embodiment of the present application can be written in one or more programming languages. These computer program codes can be provided to the processor of a general-purpose computer, a special-purpose computer or other programmable rule-finding device, so that the program code, when executed by a computer or other programmable rule-finding device, causes the function/operation specified in the flow chart and/or block diagram to be implemented.
- the program code can be executed completely on a computer, partially on a computer, as an independent software package, partially on a computer and partially on a remote computer or completely on a remote computer or server.
- computer program codes or related data may be carried by any appropriate carrier to enable a device, apparatus or processor to perform the various processes and operations described above.
- carriers include signals, computer readable media, etc.
- signals may include electrical, optical, radio, acoustic or other forms of propagation signals, such as carrier waves, infrared signals, etc.
- the disclosed systems, devices and methods can be implemented in other ways.
- the device embodiments described above are only schematic.
- the division of the module is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed.
- the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or modules, or it can be an electrical, mechanical or other form of connection.
- modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, that is, they may be located in one place or distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the embodiments of the present application.
- each functional module in each embodiment of the present application can be integrated into one processing module, or each module can exist physically separately, or two or more modules can be integrated into one module.
- the above integrated modules can be implemented in the form of hardware or software functional modules.
- the information including but not limited to user device information, user personal information, etc.
- data including but not limited to data used for analysis, stored data, displayed data, etc.
- signals involved in this application are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions.
- the interactive intent information involved in this application is obtained with full authorization.
- first, second, etc. are used to distinguish the same or similar items with basically the same role and function. It should be understood that there is no logical or temporal dependency between “first”, “second”, and “nth”, nor does it limit the quantity and execution order. It should also be understood that although the following description uses the terms first, second, etc. to describe various elements, these elements should not be limited by the terms. These terms are only It is used to distinguish one element from another element. For example, a first link could be referred to as a second link, and similarly, a second link could be referred to as a first link without departing from the scope of the various described examples.
- the size of the serial number of each process does not mean the order of execution.
- the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
- determining B based on A does not mean determining B only based on A.
- B can also be determined based on A and/or other information.
- references to “one embodiment”, “an embodiment”, or “a possible implementation” throughout the specification mean that specific features, structures, or characteristics related to the embodiment or implementation are included in at least one embodiment of the present application. Therefore, the references to “in one embodiment” or “in an embodiment”, or “a possible implementation” throughout the specification do not necessarily refer to the same embodiment. In addition, these specific features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
本申请要求于2023年7月8日提交的申请号为202310835116.6、发明名称为“交互资源的生成方法、装置、设备及计算机可读存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims priority to Chinese patent application No. 202310835116.6, filed on July 8, 2023, and entitled “Method, device, apparatus and computer-readable storage medium for generating interactive resources”, the entire contents of which are incorporated by reference into this application.
本申请涉及数字技术领域,特别涉及交互资源的生成方法、装置、设备及计算机可读存储介质。The present application relates to the field of digital technology, and in particular to a method, device, equipment and computer-readable storage medium for generating interactive resources.
随着数字技术的不断发展,不同对象之间的交互行为越发普遍。以交互场景为虚拟直播为例,存在交互行为的对象包括正在直播的虚拟主播和观看直播的观众,虚拟主播在直播过程中和观众交互,需要依赖交互资源进行动作。因此,需要一种交互资源的生成方法。With the continuous development of digital technology, interactive behaviors between different objects are becoming more and more common. Taking virtual live broadcast as an example, the objects with interactive behaviors include the virtual anchor who is broadcasting live and the audience watching the live broadcast. The virtual anchor interacts with the audience during the live broadcast and needs to rely on interactive resources to perform actions. Therefore, a method for generating interactive resources is needed.
发明内容Summary of the invention
本申请提供了一种交互资源的生成方法、装置、设备及计算机可读存储介质,以获取用于交互的交互资源,技术方案如下:The present application provides a method, apparatus, device and computer-readable storage medium for generating interactive resources to obtain interactive resources for interaction. The technical solution is as follows:
第一方面,提供了一种交互资源的生成方法,方法包括:获取至少一个第一用户的至少一个互动意图信息,互动意图信息的属性包括类型、用户等级中的一者或多者,互动意图信息的类型包括文本消息、打赏、点赞、点踩、分享、关注、取消关注中的一者或多者;根据至少一个互动意图信息,调整第一交互资源,第一交互资源为第一用户观看的内容,第一交互资源包含与至少一个子标题对应的子交互资源,第一交互资源的类型包括文本、音频、图片、视频中的一者或多者。In a first aspect, a method for generating interactive resources is provided, the method comprising: obtaining at least one interactive intention information of at least one first user, the attributes of the interactive intention information comprising one or more of type and user level, the type of the interactive intention information comprising one or more of text message, reward, like, dislike, share, follow, and unfollow; adjusting a first interactive resource according to the at least one interactive intention information, the first interactive resource being content viewed by the first user, the first interactive resource comprising a sub-interactive resource corresponding to at least one subtitle, the type of the first interactive resource comprising one or more of text, audio, picture, and video.
根据交互过程中产生的互动意图信息对第一交互资源进行实时调整,提高了第一交互资源的实时性,第一交互资源的调整效率高,以使第一交互资源更适应交互过程,提升了交互场景下的互动能力与基于第一交互资源进行交互的体验感。The first interactive resource is adjusted in real time according to the interactive intention information generated during the interactive process, thereby improving the real-time performance of the first interactive resource. The adjustment efficiency of the first interactive resource is high, so that the first interactive resource is more adapted to the interactive process, thereby improving the interactive capability in the interactive scenario and the experience of interacting based on the first interactive resource.
在一种可能的实现方式中,方法还包括:接收交互资源调整策略,交互资源调整策略包括互动意图信息的属性对应的优先级、权重或阈值中的一者或多者;根据至少一个互动意图信息,调整第一交互资源包括:根据至少一个互动意图信息和交互资源调整策略,调整第一交互资源。不限定交互资源调整策略包括的信息类型,可以是优先级、权重或阈值中的至少一种,通用度高。无论交互资源调整策略包括何种信息类型,均可以根据互动意图信息和交互资源调整策略调整第一交互资源,调整第一交互资源的灵活度高。In a possible implementation, the method further includes: receiving an interactive resource adjustment strategy, the interactive resource adjustment strategy including one or more of a priority, a weight, or a threshold corresponding to an attribute of interactive intent information; adjusting the first interactive resource according to at least one interactive intent information includes: adjusting the first interactive resource according to at least one interactive intent information and the interactive resource adjustment strategy. The type of information included in the interactive resource adjustment strategy is not limited, and may be at least one of a priority, a weight, or a threshold, and has high versatility. Regardless of the type of information included in the interactive resource adjustment strategy, the first interactive resource can be adjusted according to the interactive intent information and the interactive resource adjustment strategy, and the flexibility of adjusting the first interactive resource is high.
在一种可能的实现方式中,调整第一交互资源,包括:跳过第一交互资源中当前展示的子标题和即将展示的n个子标题对应的子交互资源,n为大于等于0的整数;展示当前展示的子标题后n+1子标题对应的子交互资源。根据互动意图信息可以跳过第一用户不想观看的子标题对应的子交互资源,实现第一交互资源的灵活展示,进而保证第一用户的观看体验感。In a possible implementation, adjusting the first interactive resource includes: skipping the sub-interaction resources corresponding to the subtitle currently displayed and the n subtitles to be displayed in the first interactive resource, where n is an integer greater than or equal to 0; and displaying the sub-interaction resources corresponding to the n+1 subtitles after the currently displayed subtitle. The sub-interaction resources corresponding to the subtitles that the first user does not want to view can be skipped according to the interactive intention information, thereby achieving flexible display of the first interactive resource and ensuring the viewing experience of the first user.
在一种可能的实现方式中,第一交互资源基于第二交互资源生成,获取至少一个第一用户的至少一个互动意图信息之前,方法还包括:获取第二用户输入的参考意图信息,参考意图信息用于指示第二交互资源的主题;根据参考意图信息,获取至少一个子标题和至少一个子标题中的每个子标题对应的文本内容,子标题用于指示第二交互资源的主题中部分内容的主题;展示第二交互资源,第二交互资源包括至少一个子标题和每个子标题对应的文本内容。通过参考意图信息确定子标题,再自动获取子标题对应的文本内容,从而生成交互过程中需要使用的第二交互资源,生成第二交互资源的过程中人工参与度低,生成成本低,生成效率高。In a possible implementation, the first interactive resource is generated based on the second interactive resource. Before obtaining at least one interactive intention information of at least one first user, the method further includes: obtaining reference intention information input by the second user, the reference intention information is used to indicate the theme of the second interactive resource; obtaining at least one subtitle and the text content corresponding to each of the at least one subtitle according to the reference intention information, the subtitle is used to indicate the theme of part of the content in the theme of the second interactive resource; and displaying the second interactive resource, the second interactive resource including at least one subtitle and the text content corresponding to each subtitle. The subtitle is determined by the reference intention information, and the text content corresponding to the subtitle is automatically obtained, thereby generating the second interactive resource required for use in the interactive process. The process of generating the second interactive resource has low manual participation, low generation cost, and high generation efficiency.
在一种可能的实现方式中,方法还包括:获取第二用户输入的子标题配置请求,子标题配置请求用于删除至少一个子标题中的第一子标题,或添加第二子标题;子标题配置请求用于添加第二子标题,子标题配置请求还包括第二子标题的子标题文本,方法还包括:获取第二子标题对应的文本内容。对子标题的调整可以是删除第一子标题,也可以是添加第二子标题,调整方式多样,通用度高。并且,针对添加第二子标题,获取第二子标题对应的文本内容,实现对第二交互资源包括的文本内容的添加,以使第二交互资源 的文本内容更全面,准确率高。In a possible implementation, the method further includes: obtaining a subtitle configuration request input by a second user, the subtitle configuration request is used to delete the first subtitle in at least one subtitle, or to add a second subtitle; the subtitle configuration request is used to add a second subtitle, the subtitle configuration request also includes the subtitle text of the second subtitle, and the method further includes: obtaining the text content corresponding to the second subtitle. The adjustment of the subtitle can be to delete the first subtitle or to add the second subtitle, and the adjustment methods are diverse and highly versatile. In addition, for adding the second subtitle, the text content corresponding to the second subtitle is obtained, and the text content included in the second interactive resource is added, so that the second interactive resource The text content is more comprehensive and accurate.
在一种可能的实现方式中,该方法还包括:获取至少一个子标题中的每个子标题对应的媒体资源,媒体资源的类型包括图像、音频、视频中的一者或多者,媒体资源的来源为知识库、互联网、人工智能(artificial intelligence,AI)模型生成中的一者或多者;展示第一交互资源,第一交互资源基于至少一个子标题中的每个子标题对应的第二交互资源和对应的媒体资源生成。不限定生成第一交互资源过程中需要使用的媒体资源的获取方式,可以是通过知识库、互联网和AI模型等任意方式获取,灵活度高。In a possible implementation, the method further includes: obtaining a media resource corresponding to each of at least one subtitle, the type of the media resource includes one or more of an image, an audio, and a video, and the source of the media resource is one or more of a knowledge base, the Internet, and an artificial intelligence (AI) model generation; and displaying a first interactive resource, the first interactive resource being generated based on a second interactive resource corresponding to each of the at least one subtitle and a corresponding media resource. The method of obtaining the media resource required to be used in the process of generating the first interactive resource is not limited, and can be obtained through any method such as a knowledge base, the Internet, and an AI model, which is highly flexible.
在一种可能的实现方式中,该方法还包括:接收第二用户输入的媒体资源;将媒体资源存入知识库中。将接收到的媒体资源存入知识库,丰富了知识库中包括的媒体资源,基于更丰富的知识库搜索得到的各个子标题对应的媒体资源更精确。In a possible implementation, the method further includes: receiving a media resource input by a second user; and storing the media resource in a knowledge base. Storing the received media resource in the knowledge base enriches the media resources included in the knowledge base, and the media resources corresponding to each sub-title obtained by searching based on the richer knowledge base are more accurate.
第二方面,提供了一种交互资源的生成装置,该装置包括:获取模块,用于获取至少一个第一用户的至少一个互动意图信息,互动意图信息的属性包括类型、用户等级中的一者或多者,互动意图信息的类型包括文本消息、打赏、点赞、点踩、分享、关注、取消关注中的一者或多者;调整模块,用于根据至少一个互动意图信息,调整第一交互资源,第一交互资源为第一用户观看的内容,第一交互资源包含与至少一个子标题对应的子交互资源,第一交互资源的类型包括文本、音频、图片、视频中的一者或多者。In a second aspect, a device for generating interactive resources is provided, which includes: an acquisition module for acquiring at least one interactive intention information of at least one first user, the attributes of the interactive intention information include one or more of type and user level, and the type of the interactive intention information includes one or more of text message, reward, like, dislike, share, follow, and unfollow; an adjustment module for adjusting a first interactive resource according to at least one interactive intention information, the first interactive resource being content viewed by the first user, the first interactive resource including a sub-interactive resource corresponding to at least one subtitle, and the type of the first interactive resource including one or more of text, audio, picture, and video.
在一种可能的实现方式中,装置还包括:接收模块,用于接收交互资源调整策略,交互资源调整策略包括互动意图信息的属性对应的优先级、权重或阈值中的一者或多者;调整模块,用于根据至少一个互动意图信息和交互资源调整策略,调整第一交互资源。In one possible implementation, the device also includes: a receiving module for receiving an interaction resource adjustment strategy, the interaction resource adjustment strategy including one or more of a priority, a weight or a threshold corresponding to the attributes of the interaction intent information; an adjustment module for adjusting the first interaction resource according to at least one interaction intent information and the interaction resource adjustment strategy.
在一种可能的实现方式中,调整模块,用于跳过第一交互资源中当前展示的子标题和即将展示的n个子标题对应的子交互资源,n为大于等于0的整数;展示当前展示的子标题后n+1子标题对应的子交互资源。In a possible implementation, the adjustment module is used to skip the sub-interaction resources corresponding to the currently displayed subtitle and n subtitles to be displayed in the first interaction resource, where n is an integer greater than or equal to 0; and display the sub-interaction resources corresponding to the n+1 subtitle after the currently displayed subtitle.
在一种可能的实现方式中,第一交互资源基于第二交互资源生成,获取模块,还用于获取第二用户输入的参考意图信息,参考意图信息用于指示第二交互资源的主题;根据参考意图信息,获取至少一个子标题和至少一个子标题中的每个子标题对应的文本内容,子标题用于指示第二交互资源的主题中部分内容的主题;装置还包括:展示模块,用于展示第二交互资源,第二交互资源包括至少一个子标题和每个子标题对应的文本内容。In a possible implementation, a first interactive resource is generated based on a second interactive resource, and an acquisition module is further used to acquire reference intent information input by a second user, where the reference intent information is used to indicate a subject of the second interactive resource; at least one subtitle and text content corresponding to each of at least one subtitle are acquired based on the reference intent information, where the subtitle is used to indicate a subject of part of the subject of the second interactive resource; the device also includes: a display module, used to display the second interactive resource, where the second interactive resource includes at least one subtitle and text content corresponding to each subtitle.
在一种可能的实现方式中,获取模块,还用于获取第二用户输入的子标题配置请求,子标题配置请求用于删除至少一个子标题中的第一子标题,或添加第二子标题;子标题配置请求用于添加第二子标题,子标题配置请求还包括第二子标题的子标题文本,获取模块,还用于获取第二子标题对应的文本内容。In a possible implementation, the acquisition module is further used to obtain a subtitle configuration request input by a second user, the subtitle configuration request is used to delete a first subtitle in at least one subtitle, or to add a second subtitle; the subtitle configuration request is used to add a second subtitle, the subtitle configuration request also includes a subtitle text of the second subtitle, and the acquisition module is further used to obtain text content corresponding to the second subtitle.
在一种可能的实现方式中,获取模块,还用于获取至少一个子标题中的每个子标题对应的媒体资源,媒体资源的类型包括图像、音频、视频中的一者或多者,媒体资源的来源为知识库、互联网、人工智能AI模型生成中的一者或多者;展示模块,还用于展示第一交互资源,第一交互资源基于至少一个子标题中的每个子标题对应的第二交互资源和对应的媒体资源生成。In one possible implementation, the acquisition module is also used to acquire media resources corresponding to each subtitle in at least one subtitle, where the types of media resources include one or more of images, audio, and video, and the sources of the media resources are one or more of a knowledge base, the Internet, and artificial intelligence (AI) model generation; the display module is also used to display a first interactive resource, which is generated based on a second interactive resource and a corresponding media resource corresponding to each subtitle in at least one subtitle.
在一种可能的实现方式中,获取模块,还用于接收第二用户输入的媒体资源;将媒体资源存入知识库中。In a possible implementation, the acquisition module is further configured to receive a media resource input by a second user; and store the media resource in a knowledge base.
第三方面,提供了一种计算设备集群,计算设备集群包括至少一个计算设备,每个计算设备包括处理器和存储器;至少一个计算设备的处理器用于执行所述至少一个计算设备的存储器中存储的指令,以使得所述计算设备集群执行上述第一方面中任一种的交互资源的生成方法。In a third aspect, a computing device cluster is provided, the computing device cluster comprising at least one computing device, each computing device comprising a processor and a memory; the processor of at least one computing device is used to execute instructions stored in the memory of the at least one computing device, so that the computing device cluster executes any one of the interactive resource generation methods of the first aspect above.
第四方面,提供了一种计算机可读存储介质,所述计算机可读存储介质包括计算机程序指令,当所述计算机程序指令由计算设备集群执行时,所述计算设备集群执行上述第一方面中任一种的交互资源的生成方法。In a fourth aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium includes computer program instructions. When the computer program instructions are executed by a computing device cluster, the computing device cluster executes any one of the interactive resource generation methods of the first aspect.
第五方面,提供了一种包含指令的计算机程序(产品),当所述指令被计算设备集群运行时,使得所述计算设备集群执行上述第一方面任一种的交互资源的生成方法。In a fifth aspect, a computer program (product) comprising instructions is provided. When the instructions are executed by a computing device cluster, the computing device cluster executes any one of the methods for generating interactive resources of the first aspect.
第六方面,提供了一种通信装置,该装置包括:收发器、存储器和处理器。其中,该收发器、该存储器和该处理器通过内部连接通路互相通信,该存储器用于存储指令,该处理器用于执行该存储器存储的指令,以控制收发器接收信号,并控制收发器发送信号,并且当该处理器执行该存储器存储的指令时,使得该处理器执行第一方面或第一方面的任一种可能的实施方式中的方法。 In a sixth aspect, a communication device is provided, the device comprising: a transceiver, a memory, and a processor. The transceiver, the memory, and the processor communicate with each other through an internal connection path, the memory is used to store instructions, the processor is used to execute the instructions stored in the memory to control the transceiver to receive signals and control the transceiver to send signals, and when the processor executes the instructions stored in the memory, the processor executes the method in the first aspect or any possible implementation of the first aspect.
可选地,所述处理器为一个或多个,所述存储器为一个或多个。Optionally, the number of the processors is one or more, and the number of the memories is one or more.
可选地,所述存储器可以与所述处理器集成在一起,或者所述存储器与处理器分离设置。Optionally, the memory may be integrated with the processor, or the memory may be provided separately from the processor.
在具体实现过程中,存储器可以为非瞬时性(non-transitory)存储器,例如只读存储器(read only memory,ROM),其可以与处理器集成在同一块芯片上,也可以分别设置在不同的芯片上,本申请对存储器的类型以及存储器与处理器的设置方式不做限定。In the specific implementation process, the memory can be a non-transitory memory, such as a read-only memory (ROM), which can be integrated with the processor on the same chip or can be set on different chips. This application does not limit the type of memory and the setting method of the memory and the processor.
第七方面,提供了一种芯片,包括处理器,用于从存储器中调用并运行所述存储器中存储的指令,使得安装有所述芯片的通信设备执行上述各方面中的方法。In a seventh aspect, a chip is provided, comprising a processor for calling and executing instructions stored in a memory from the memory, so that a communication device equipped with the chip executes the methods in the above aspects.
第八方面,提供另一种芯片,包括:输入接口、输出接口、处理器和存储器,所述输入接口、输出接口、所述处理器以及所述存储器之间通过内部连接通路相连,所述处理器用于执行所述存储器中的代码,当所述代码被执行时,所述处理器用于执行上述各方面中的方法。In an eighth aspect, another chip is provided, comprising: an input interface, an output interface, a processor and a memory, wherein the input interface, the output interface, the processor and the memory are connected via an internal connection path, and the processor is used to execute the code in the memory. When the code is executed, the processor is used to execute the methods in the above aspects.
应当理解的是,本申请的第二方面至第八方面的技术方案及对应的可能的实现方式所取得的有益效果可以参见上述对第一方面及其对应的可能的实现方式的技术效果,此处不再赘述。It should be understood that the beneficial effects achieved by the technical solutions of the second to eighth aspects of the present application and the corresponding possible implementation methods can be referred to the above-mentioned technical effects of the first aspect and its corresponding possible implementation methods, and will not be repeated here.
图1为本申请实施例提供的一种实施环境的示意图;FIG1 is a schematic diagram of an implementation environment provided by an embodiment of the present application;
图2为本申请实施例提供的一种交互资源的生成方法的流程图;FIG2 is a flow chart of a method for generating interactive resources provided in an embodiment of the present application;
图3为本申请实施例提供的一种获取资源集合的过程示意图;FIG3 is a schematic diagram of a process of obtaining a resource set provided in an embodiment of the present application;
图4为本申请实施例提供的一种调整第一交互资源的过程示意图;FIG4 is a schematic diagram of a process of adjusting a first interaction resource provided in an embodiment of the present application;
图5为本申请实施例提供的一种交互过程示意图;FIG5 is a schematic diagram of an interaction process provided in an embodiment of the present application;
图6为本申请实施例提供的一种交互资源的生成装置的结构示意图;FIG6 is a schematic diagram of the structure of an interactive resource generation device provided in an embodiment of the present application;
图7为本申请实施例提供的一种计算设备的结构示意图;FIG7 is a schematic diagram of the structure of a computing device provided in an embodiment of the present application;
图8为本申请实施例提供的一种计算设备的连接示意图。FIG8 is a connection diagram of a computing device provided in an embodiment of the present application.
本申请的实施方式部分使用的术语仅用于对本申请的具体实施例进行解释,而非旨在限定本申请。为使本申请的目的、技术方案和优点更加清楚,下面将结合附图对本申请实施方式作进一步地详细描述。The terms used in the implementation method of this application are only used to explain the specific embodiments of this application, and are not intended to limit this application. In order to make the purpose, technical solution and advantages of this application clearer, the implementation method of this application will be further described in detail below with reference to the accompanying drawings.
随着数字技术的发展,越来越多的交互场景开始通过交互资源实现不同对象之间的交互。以交互场景为直播互动为例,进行交互的不同对象分别为正在直播的主播和观看直播的观众,交互资源可以是直播过程中播放的主播表演的视频,观众观看播放的视频,并根据观众的反馈调整所播放的视频,以实现主播和观众的交互。因此,需要一种交互资源的生成方法。With the development of digital technology, more and more interactive scenarios begin to realize the interaction between different objects through interactive resources. Taking the interactive scenario of live broadcast interaction as an example, the different objects for interaction are the anchor who is broadcasting live and the audience watching the live broadcast. The interactive resources can be the video of the anchor's performance played during the live broadcast, the audience watching the played video, and adjusting the played video according to the audience's feedback to realize the interaction between the anchor and the audience. Therefore, a method for generating interactive resources is needed.
相关技术中,通过人工根据观众的反馈对展示的交互资源进行调整,以实现动态生成交互资源。然而依赖人工调整的方法会导致交互资源的获取成本高,调整效率低,在观众的互动意图的数量超过反应阈值的情况下,会导致人工无法及时根据互动意图调整交互资源,交互资源的实时性降低,基于实时性低的交互资源进行的交互的体验感较差。其中,反应阈值为根据经验设置的指示用于指示人工反应能力的数量。In the related art, the interactive resources displayed are manually adjusted according to the audience's feedback to achieve dynamic generation of interactive resources. However, the method of relying on manual adjustment will result in high acquisition costs of interactive resources and low adjustment efficiency. When the number of audience interaction intentions exceeds the reaction threshold, it will lead to the inability to adjust the interactive resources according to the interaction intentions in time, and the real-time performance of the interactive resources will be reduced. The experience of interaction based on low real-time interactive resources is poor. Among them, the reaction threshold is an indication set according to experience to indicate the number of manual reaction capabilities.
本申请实施例提供了一种交互资源的生成方法,用于对交互过程中使用的交互资源进行动态生成和调整。请参考图1,其示出了本申请实施例提供的交互资源的生成方法的实施环境示意图。该实施环境为计算设备集群10,计算设备集群10包括至少一台编排设备,编排设备之间可通过有线或无线网络的方式进行通信连接。可选地,交互资源的生成方法可以由一台编排设备独立执行,也可由计算设备集群10中包括的多台编排设备交互执行,本申请实施例不限定计算设备集群10包括的编排设备的数量,图1中仅以两台编排设备为例进行举例说明。The embodiment of the present application provides a method for generating interactive resources, which is used to dynamically generate and adjust interactive resources used in the interactive process. Please refer to Figure 1, which shows a schematic diagram of the implementation environment of the method for generating interactive resources provided in the embodiment of the present application. The implementation environment is a computing device cluster 10, and the computing device cluster 10 includes at least one orchestration device. The orchestration devices can be communicated and connected via a wired or wireless network. Optionally, the method for generating interactive resources can be executed independently by an orchestration device, or it can be interactively executed by multiple orchestration devices included in the computing device cluster 10. The embodiment of the present application does not limit the number of orchestration devices included in the computing device cluster 10. Figure 1 only takes two orchestration devices as an example for illustration.
示例性地,计算设备集群10包括的编排设备可以是任意具有数据处理功能的网络设备,编排设备可以是服务器,例如是中心服务器、边缘服务器,或者是本地数据中心中的本地服务器。服务器可以是物理服务器,还可以是提供云计算服务器的云服务器。在一些实施例中,计算设备集群10包括的编排设备也可以是台式机、笔记本电脑或者智能手机等终端设备。Exemplarily, the orchestration device included in the computing device cluster 10 can be any network device with data processing function, and the orchestration device can be a server, such as a central server, an edge server, or a local server in a local data center. The server can be a physical server or a cloud server that provides a cloud computing server. In some embodiments, the orchestration device included in the computing device cluster 10 can also be a terminal device such as a desktop computer, a laptop computer, or a smart phone.
本申请实施例提供的交互资源的生成方法的流程图如图2所示,包括S201-S202。The flowchart of the method for generating interactive resources provided in the embodiment of the present application is shown in FIG. 2 , including S201 - S202 .
S201,获取至少一个第一用户的至少一个互动意图信息,互动意图信息的属性包括类型、用户等级中 的一者或多者,互动意图信息的类型包括文本消息、打赏、点赞、点踩、分享、关注、取消关注中的一者或多者。S201, obtaining at least one interactive intention information of at least one first user, where the attributes of the interactive intention information include type, user level, The type of interaction intention information includes one or more of text messages, rewards, likes, dislikes, shares, follows, and unfollows.
示例性地,第一用户是指观看直播的用户。本申请实施例不限定第一用户的数量,可以是一个,也可以是多个。在一种可能的情况下,第一用户观看的直播是通过展示第一交互资源实现。因此,编排设备需要先获取第一交互资源。其中,第一交互资源的类型可以是文本、音频、图片、视频中的一种或多种。而无论第一交互资源属于何种类型,获取第一交互资源的过程均类似。Exemplarily, the first user refers to a user who watches a live broadcast. The embodiment of the present application does not limit the number of first users, which may be one or more. In one possible case, the live broadcast watched by the first user is realized by displaying a first interactive resource. Therefore, the arrangement device needs to obtain the first interactive resource first. Among them, the type of the first interactive resource may be one or more of text, audio, picture, and video. Regardless of the type of the first interactive resource, the process of obtaining the first interactive resource is similar.
在一种可能的实现方式中,第一交互资源是基于第二交互资源生成,编排设备在获取第一交互资源之前,还需要获取第二交互资源。可选地,编排设备获取第二交互资源的过程包括:获取第二用户输入的参考意图信息,参考意图信息用于指示第二交互资源的主题;根据参考意图信息,获取至少一个子标题和至少一个子标题中的每个子标题对应的文本内容,子标题用于指示第二交互资源的主题中部分内容的主题;展示第二交互资源,第二交互资源包括至少一个子标题和每个子标题对应的文本内容。In a possible implementation, the first interactive resource is generated based on the second interactive resource, and the layout device needs to obtain the second interactive resource before obtaining the first interactive resource. Optionally, the process of the layout device obtaining the second interactive resource includes: obtaining reference intent information input by the second user, the reference intent information is used to indicate the theme of the second interactive resource; according to the reference intent information, obtaining at least one subtitle and the text content corresponding to each of the at least one subtitle, the subtitle is used to indicate the theme of part of the content in the theme of the second interactive resource; displaying the second interactive resource, the second interactive resource includes at least one subtitle and the text content corresponding to each subtitle.
示例性地,参考意图信息指示了第二交互资源的主题,主题是指在通过第二交互资源进行交互的过程需要向第一用户传递的信息。以直播互动场景为直播售卖产品,第二用户为观看直播的观众为例,在通过第二交互资源进行直播的过程中需要向第一用户传递的信息为售卖的产品的信息,因此,第二交互资源的主题为需要售卖的产品的信息。Exemplarily, the reference intent information indicates the subject of the second interactive resource, and the subject refers to the information that needs to be delivered to the first user during the interaction through the second interactive resource. For example, if the live interactive scenario is selling products through live broadcast, and the second user is the audience watching the live broadcast, the information that needs to be delivered to the first user during the live broadcast through the second interactive resource is the information of the products to be sold. Therefore, the subject of the second interactive resource is the information of the products to be sold.
在一种可能的实现方式中,编排设备可以接收由第二用户输入的参考意图信息。示例性地,编排设备提供信息输入控件,第二用户根据信息输入控件输入参考意图信息。第二用户可以是监督管理直播的人员,第二用户可以根据业务安排确定参考意图信息,例如业务安排需要直播介绍产品A,第二对象由此确定参考意图信息为介绍产品A,将确定的参考意图信息通过信息输入控件输入至编排设备。In a possible implementation, the arrangement device may receive reference intent information input by the second user. Exemplarily, the arrangement device provides an information input control, and the second user inputs the reference intent information according to the information input control. The second user may be a person who supervises and manages the live broadcast, and the second user may determine the reference intent information according to the business arrangement. For example, the business arrangement requires a live broadcast to introduce product A, and the second object thereby determines the reference intent information as introducing product A, and inputs the determined reference intent information into the arrangement device through the information input control.
可选地,编排设备也可以根据历史交互数据确定参考意图信息。其中,历史交互数据的产生时间为生成第二交互资源的时刻之前,第一用户在观看历史直播过程中产生的交互数据为历史交互数据。编排设备可以根据历史交互数据确定参考意图信息。继续以直播互动为例,主播在上一场直播结尾询问有关下一场直播的需求,“下一次见面大家想看到什么?”观看直播的第一用户通过弹幕进行回复,“想看主播唱歌。”编排设备收集上一场直播的直播数据作为历史交互数据,解析历史交互数据中的文本信息,得到参考意图信息。Optionally, the orchestration device can also determine reference intent information based on historical interaction data. The generation time of the historical interaction data is before the moment of generating the second interaction resource, and the interaction data generated by the first user in the process of watching the historical live broadcast is the historical interaction data. The orchestration device can determine the reference intent information based on the historical interaction data. Continuing with the live broadcast interaction as an example, the anchor asks about the needs of the next live broadcast at the end of the previous live broadcast, "What do you want to see when we meet next time?" The first user watching the live broadcast replies through the barrage, "I want to see the anchor sing." The orchestration device collects the live broadcast data of the previous live broadcast as historical interaction data, parses the text information in the historical interaction data, and obtains the reference intent information.
编排设备可以选择接收由第二用户输入的参考意图信息,也可以选择根据历史交互数据确定参考意图信息,还可以采用上述两种方式,确定参考意图信息。例如,编排设备根据第二用户输入的介绍产品A,通过历史交互数据确定的表演唱歌,确定第二交互资源的参考意图信息为介绍产品A并表演唱歌。也即本申请实施例不限定生成第二交互资源过程中使用到的参考意图信息的数量,可以是任意数量。而参考意图信息可以是上述举例的一个主题,也可以是一句话,本申请实施例对此不进行限定。由于根据多种参考意图信息生成第二交互资源和根据一种参考意图信息生成第二交互资源的过程类似,接下来暂以根据一种参考意图信息生成第二交互资源的过程为例,介绍第二交互资源的生成方法。The arrangement device may choose to receive the reference intent information input by the second user, or may choose to determine the reference intent information based on historical interaction data, or may use the above two methods to determine the reference intent information. For example, the arrangement device determines that the reference intent information of the second interactive resource is to introduce product A and perform singing based on the introduction of product A input by the second user and the performance of singing determined by historical interaction data. That is, the embodiment of the present application does not limit the number of reference intent information used in the process of generating the second interactive resource, which can be any number. The reference intent information can be a topic as exemplified above, or it can be a sentence, which is not limited in the embodiment of the present application. Since the process of generating a second interactive resource based on multiple reference intent information is similar to the process of generating a second interactive resource based on one reference intent information, the method of generating a second interactive resource will be introduced below by taking the process of generating a second interactive resource based on one reference intent information as an example.
示例性地,编排设备根据参考意图信息,确定参考意图信息对应的至少一个子标题。其中,子标题用于指示第二交互资源的主题中部分内容的主题。第二交互资源的主题指示需要传递的信息,而传递的信息可以根据每段的内容特征概括成至少一个子标题。可选地,编排设备可根据参考意图信息进行检索,确定该参考意图信息对应的至少一个子标题。以参考意图信息为介绍产品A为例,编排设备根据产品A进行检索,得到产品的功能、外观设计、材质质量和使用体验。因此,参考意图信息对应的子标题为功能介绍、外观设计介绍、材质质量介绍和使用体验介绍。Exemplarily, the layout device determines at least one subtitle corresponding to the reference intent information based on the reference intent information. The subtitle is used to indicate the theme of part of the content in the theme of the second interactive resource. The theme of the second interactive resource indicates the information that needs to be transmitted, and the transmitted information can be summarized into at least one subtitle based on the content characteristics of each paragraph. Optionally, the layout device can search according to the reference intent information to determine at least one subtitle corresponding to the reference intent information. Taking the reference intent information as an introduction to product A as an example, the layout device searches according to product A to obtain the product's function, appearance design, material quality, and usage experience. Therefore, the subtitles corresponding to the reference intent information are function introduction, appearance design introduction, material quality introduction, and usage experience introduction.
在一种可能的情况下,编排设备在确定参考意图信息对应的至少一个子标题的过程中,还会参考第二交互资源对应的互动特征,互动特征例如是第三用户的性格特征和第二交互资源的交互场景中的至少一种。其中,第三用户是指进行直播的用户,第三用户可以是通过建模、动作捕捉、人工智能(artificial intelligence,AI)等技术手段制作出的虚拟对象。虚拟对象例如是具有人或类人的外貌特征和行为模式的数字人,也即本申请实施例提供的交互资源的生成方法可以用于数字人直播、数字人演艺或数字人智能互动等直播互动场景。此外,虚拟对象也可以是具有卡通形象的外貌特征的虚拟卡通人物。In one possible case, the editing device will also refer to the interactive features corresponding to the second interactive resource in the process of determining at least one subtitle corresponding to the reference intent information. The interactive features are, for example, the personality characteristics of the third user and at least one of the interactive scenarios of the second interactive resource. Among them, the third user refers to the user who conducts the live broadcast, and the third user can be a virtual object created by technical means such as modeling, motion capture, artificial intelligence (AI), etc. A virtual object is, for example, a digital human with human or human-like appearance features and behavior patterns, that is, the method for generating interactive resources provided in the embodiment of the present application can be used in live interactive scenarios such as digital human live broadcast, digital human performance, or digital human intelligent interaction. In addition, the virtual object can also be a virtual cartoon character with the appearance features of a cartoon image.
编排设备可以获取第二用户提供的互动特征,根据互动特征确定子标题。继续以交互场景为直播为例,由于直播是一种可以与观众进行互动的播放方式,编排设备由此确定需要用于交互的子标题,例如包括福利发送和弹幕疑问解答。此外,基于第三用户的性格特征,也会产生一些信息传递需求,以第三对象的性 格特征为开朗外向且喜爱才艺展示为例,编排设备可根据第三对象的性格特征设置子标题为才艺表演。根据参考意图信息和表演特征,针对性地生成至少一个子标题,以明确需要在直播过程中展示的各部分内容的内容特征。The arrangement device can obtain the interactive features provided by the second user and determine the subtitles based on the interactive features. Taking live broadcast as an example, since live broadcast is a way of playing that can interact with the audience, the arrangement device determines the subtitles needed for interaction, such as welfare delivery and barrage question answering. In addition, based on the personality characteristics of the third user, some information transmission needs will also arise. For example, if the personality characteristics of the third object are cheerful and outgoing and likes talent show, the arrangement device can set the subtitle as talent show according to the personality characteristics of the third object. At least one subtitle is generated in a targeted manner according to the reference intention information and the performance characteristics to clarify the content characteristics of each part of the content that needs to be displayed during the live broadcast.
示例性地,编排设备确定至少一个子标题后,可以直接获取各个子标题对应的文本内容,也可以对子标题进行调整,获取调整后的子标题对应的文本内容。例如,编排设备获取第二用户输入的子标题配置请求,子标题配置请求用于删除至少一个子标题中的第一子标题,或添加第二子标题。可选地,编排设备将至少一个子标题显示给第二用户,由第二用户对显示的子标题进行调整,得到调整后的子标题。调整可以是增加子标题,增加的子标题在一些情况下可以称为第二子标题,调整也可以是删除子标题,删除的子标题在一些情况下可以称为第一子标题。例如,第二用户认为在介绍产品之前需要对产品的整体介绍,这样可以便于观众理解,第二用户根据编排设备提供的信息输入控件输入整体介绍作为待添加的第二子标题,编排设备根据第二用户的操作获取子标题配置请求,根据子标题配置请求在至少一个子标题中添加第二子标题,得到调整后的子标题。Exemplarily, after determining at least one subtitle, the layout device can directly obtain the text content corresponding to each subtitle, or adjust the subtitle to obtain the text content corresponding to the adjusted subtitle. For example, the layout device obtains a subtitle configuration request input by the second user, and the subtitle configuration request is used to delete the first subtitle in at least one subtitle, or add a second subtitle. Optionally, the layout device displays at least one subtitle to the second user, and the second user adjusts the displayed subtitle to obtain the adjusted subtitle. The adjustment can be to add a subtitle, and the added subtitle can be called the second subtitle in some cases. The adjustment can also be to delete a subtitle, and the deleted subtitle can be called the first subtitle in some cases. For example, the second user believes that an overall introduction of the product is needed before introducing the product, which can facilitate the audience's understanding. The second user inputs the overall introduction as the second subtitle to be added according to the information input control provided by the layout device. The layout device obtains the subtitle configuration request according to the operation of the second user, and adds the second subtitle to at least one subtitle according to the subtitle configuration request to obtain the adjusted subtitle.
无论是否对至少一个子标题进行调整,编排设备均可以获取至少一个子标题中的各个子标题对应的文本内容。其中,子标题对应的文本内容指第三用户在介绍该子标题过程中所说的文本,例如是介绍词。编排设备可以通过搜索获取各个子标题对应的文本内容,也可以根据各个子标题的内容特征生成各个子标题对应的文本内容。例如,基于自然语言处理技术,通过模拟人类语言的处理和理解方式,根据子标题生成对应的文本内容。Regardless of whether at least one subtitle is adjusted, the layout device can obtain text content corresponding to each subtitle in at least one subtitle. The text content corresponding to the subtitle refers to the text said by the third user in the process of introducing the subtitle, such as an introduction. The layout device can obtain the text content corresponding to each subtitle through search, or generate the text content corresponding to each subtitle according to the content characteristics of each subtitle. For example, based on natural language processing technology, by simulating the processing and understanding of human language, the corresponding text content is generated according to the subtitle.
编排设备通过执行上述操作确定至少一个子标题和各个子标题对应的文本内容后,得到包括各个子标题和子标题的文本内容的第二交互资源。之后,编排设备可根据第二交互资源生成第一交互资源。示例性地,编排设备根据第二交互资源生成第一交互资源的过程包括:获取至少一个子标题中的每个子标题对应的媒体资源,媒体资源的类型包括图像、音频、视频中的一者或多者,媒体资源的来源为知识库、互联网、人工智能(artificial intelligence,AI)模型生成中的一者或多者;根据至少一个子标题中的每个子标题对应的第二交互资源和对应的媒体资源生成第一交互资源。After the layout device determines at least one subtitle and the text content corresponding to each subtitle by performing the above operations, it obtains a second interactive resource including each subtitle and the text content of the subtitle. Afterwards, the layout device can generate a first interactive resource based on the second interactive resource. Exemplarily, the process of the layout device generating a first interactive resource based on the second interactive resource includes: obtaining a media resource corresponding to each subtitle in at least one subtitle, the type of the media resource includes one or more of an image, audio, and video, and the source of the media resource is one or more of a knowledge base, the Internet, and an artificial intelligence (AI) model generation; generating a first interactive resource based on the second interactive resource corresponding to each subtitle in at least one subtitle and the corresponding media resource.
本申请实施例不限定子标题对应的媒体资源,除了上述实施例示出的图像、音频、视频,还可以包括艺术字、贴纸、背景等。其中,视频指第三用户介绍子标题过程中展示的视频,音乐为第三用户介绍子标题过程中播放的音乐,例如是第三用户在念子标题对应的文本内容过程中播放的背景音乐。艺术字为经过艺术处理的文字,可用于突出展示子标题期间需要强调的文字,以直播为例,则艺术字为播放的直播视频上显示的子标题名称。贴纸为第三用户在展示子标题的过程中优化第一交互资源的数据,以第一交互资源为视频为例,则贴纸可以是优化视频中第三用户的人像特效贴纸。背景为第三用户展示子标题过程中所位于的空间背景,图片为第三用户介绍子标题过程中使用到的图片。The embodiments of the present application do not limit the media resources corresponding to the subtitle. In addition to the images, audio, and video shown in the above embodiments, they may also include artistic words, stickers, backgrounds, etc. Among them, the video refers to the video displayed during the third user's introduction of the subtitle, and the music is the music played during the third user's introduction of the subtitle, such as the background music played when the third user reads the text content corresponding to the subtitle. The artistic words are text that has been artistically processed and can be used to highlight the text that needs to be emphasized during the display of the subtitle. Taking live broadcast as an example, the artistic words are the subtitle names displayed on the live video being played. Stickers are data for optimizing the first interactive resource by the third user in the process of displaying the subtitle. Taking the first interactive resource as a video as an example, the stickers can be special-effect stickers for optimizing the portrait of the third user in the video. The background is the spatial background where the third user is located during the display of the subtitle, and the picture is the picture used by the third user in the process of introducing the subtitle.
在一种可能的情况下,编排设备需要确定各个子标题对应的媒体资源的类型,再根据各个子标题对应的媒体资源的类型获取各个子标题对应的媒体资源。为了描述更清楚,下文将媒体资源的类型简称为媒体类型。可选地,编排设备可以将涉及到的多个媒体类型全部确定为各个子标题对应的媒体类型,从而保证媒体资源的全面收集,也可以根据第二用户的选择确定各个子标题对应的媒体类型,或者从多个媒体类型中随机选择媒体类型,将所选择的媒体类型作为需要使用的媒体类型,本申请实施例对确定各个子标题对应的媒体类型的方式不进行限定。并且,不同子标题对应的媒体类型可以相同,也可以不同。In one possible case, the editing device needs to determine the type of media resources corresponding to each subtitle, and then obtain the media resources corresponding to each subtitle according to the type of media resources corresponding to each subtitle. For a clearer description, the type of media resources is referred to as media type below. Optionally, the editing device can determine all the multiple media types involved as the media types corresponding to each subtitle, thereby ensuring the comprehensive collection of media resources, or determine the media type corresponding to each subtitle according to the selection of the second user, or randomly select a media type from multiple media types and use the selected media type as the media type to be used. The embodiment of the present application does not limit the method for determining the media type corresponding to each subtitle. Moreover, the media types corresponding to different subtitles can be the same or different.
在确定各个子标题对应的媒体类型后,编排设备根据媒体类型获取子标题对应的媒体资源。获取方式例如是根据子标题和媒体类型进行搜索,得到媒体资源。示例性地,编排设备通过搜索引擎在知识库、互联网中进行搜索,该知识库可以是开源知识库,也可以是第二用户创建的知识库。例如,第二用户输入多个媒体资源,编排设备接收第二用户输入的媒体资源;将媒体资源存入知识库。编排设备由此得到包括多个媒体资源的知识库。知识库例如是视频网站、图片库等。此外,编排设备除了通过搜索获取媒体资源,还可以生成媒体资源。例如通过AI模型根据子标题和媒体类型生成媒体资源,AI模型例如是生成式人工智能(artificial intelligence generated content,AIGC)模型。After determining the media type corresponding to each subtitle, the editing device obtains the media resources corresponding to the subtitle according to the media type. The acquisition method is, for example, to search according to the subtitle and the media type to obtain the media resources. Exemplarily, the editing device searches in a knowledge base or the Internet through a search engine. The knowledge base can be an open source knowledge base or a knowledge base created by a second user. For example, the second user inputs multiple media resources, and the editing device receives the media resources input by the second user; and stores the media resources in the knowledge base. The editing device thereby obtains a knowledge base including multiple media resources. The knowledge base is, for example, a video website, a photo library, and the like. In addition, in addition to obtaining media resources through search, the editing device can also generate media resources. For example, media resources are generated according to subtitles and media types through an AI model, and the AI model is, for example, a generative artificial intelligence (AIGC) model.
在获取各个子标题对应的媒体资源后,编排设备可以例如图3所示,在调用资源生成模块包括的子标题生成单元和资源搜索及生成单元,根据参考意图信息生成第二交互资源和媒体资源后,将包括媒体资源和第二交互资源的资源集合显示给第二用户,由第二用户对显示的资源集合进行审核或调整,进行用户审阅。可选地,由于第二交互资源包括的是各个子标题和各个子标题对应的文本内容,而媒体资源为各个子 标题对应的媒体资源,因此,资源集合可以理解为一个包括各个子标题对应的文本内容和媒体资源的集合。其中,对资源集合的调整例如是添加资源集合中包括的文本内容或媒体资源,或者是删除资源集合中包括的媒体资源或文本内容。在完成用户审阅后,编排设备可根据通过第二用户审核的资源集合生成第一交互资源。After obtaining the media resources corresponding to each subtitle, the arrangement device may, for example, as shown in FIG3, call the subtitle generation unit and the resource search and generation unit included in the resource generation module, generate the second interactive resource and the media resource according to the reference intent information, and then display the resource set including the media resource and the second interactive resource to the second user, who then reviews or adjusts the displayed resource set for user review. Optionally, since the second interactive resource includes each subtitle and the text content corresponding to each subtitle, and the media resource is each subtitle, The media resources corresponding to the title, therefore, the resource set can be understood as a set of text content and media resources corresponding to each subtitle. Among them, the adjustment of the resource set is, for example, adding text content or media resources included in the resource set, or deleting media resources or text content included in the resource set. After completing the user review, the editing device can generate a first interactive resource based on the resource set that has passed the second user review.
在一些情况下,可将资源集合称为剧本或者剧本树。其中,剧本用于指导直播互动,指导方式例如是根据剧本生成直播展示的第一交互资源,第一交互资源例如是数字人表演的视频。在直播的主播为真实用户的情况下,指导方式也可以是将剧本显示给真实用户,以使真实用户根据剧本进行表演。在资源集合称为剧本树的场景下,资源集合包括的子标题可以理解为剧本树包括的叶子节点,子标题对应的文本内容可以理解为叶子节点包含的话术,子标题对应的媒体资源可以理解为叶子节点对应的素材。In some cases, the resource collection can be referred to as a script or a script tree. The script is used to guide live interaction, and the guidance method is, for example, to generate a first interactive resource for live display based on the script, and the first interactive resource is, for example, a video of a digital human performance. In the case where the host of the live broadcast is a real user, the guidance method can also be to display the script to the real user so that the real user can perform according to the script. In the scenario where the resource collection is called a script tree, the subtitles included in the resource collection can be understood as the leaf nodes included in the script tree, the text content corresponding to the subtitles can be understood as the words contained in the leaf nodes, and the media resources corresponding to the subtitles can be understood as the materials corresponding to the leaf nodes.
而无论是资源集合,还是剧本或剧本树,编排设备均可根据各个子标题对应的媒体资源和文本内容生成第一交互资源。示例性地,编排设备可以从至少一个子标题中选择需要展示的子标题,以根据需要展示的子标题对应的第二交互资源和媒体资源生成第一交互资源。例如,编排设备可以根据参考阈值从多个子标题中选择需要展示的子标题,参考阈值可以是基于经验设置的任意数值,编排设备也可以根据第二用户的选择确定需要展示的子标题。在一种可能的情况下,编排设备在根据子标题对应的媒体资源和第二交互资源生成第一交互资源的过程中,可从各个子标题对应的媒体资源中选择展示各个子标题需要使用的媒体资源的媒体类型,根据选择的媒体类型生成各个子标题对应的子交互资源,得到包括多个子标题对应的子交互资源的第一交互资源。Regardless of whether it is a resource collection, a script or a script tree, the editing device can generate a first interactive resource based on the media resources and text content corresponding to each subtitle. Exemplarily, the editing device can select a subtitle to be displayed from at least one subtitle to generate a first interactive resource based on the second interactive resource and media resource corresponding to the subtitle to be displayed. For example, the editing device can select a subtitle to be displayed from multiple subtitles based on a reference threshold, and the reference threshold can be an arbitrary value set based on experience. The editing device can also determine the subtitle to be displayed based on the selection of the second user. In one possible case, the editing device can select the media type of the media resource required to display each subtitle from the media resources corresponding to each subtitle in the process of generating the first interactive resource based on the media resources and the second interactive resources corresponding to the subtitle, and generate the sub-interactive resource corresponding to each subtitle based on the selected media type, so as to obtain a first interactive resource including the sub-interactive resources corresponding to multiple subtitles.
可选地,编排设备对各个子标题的文本内容进行语义分析,根据语义分析结果确定需要使用的媒体类型。以参考意图信息为介绍手表,子标题为外观设计为例,编排设备对外观设计对应的文本内容进行语义分析确定外观设计是需要对手表的形状、图案、色彩等进行展示。编排设备由此确定需要使用的媒体类型为图片/背景以及艺术字。其中,图片用于展示手表的形状和图案等,艺术字用于强调手表的设计特征。Optionally, the layout device performs semantic analysis on the text content of each subtitle, and determines the media type to be used based on the semantic analysis results. Taking the reference intent information as introducing the watch and the subtitle as the appearance design as an example, the layout device performs semantic analysis on the text content corresponding to the appearance design to determine that the appearance design requires displaying the shape, pattern, color, etc. of the watch. The layout device thus determines that the media types to be used are pictures/backgrounds and artistic words. Among them, pictures are used to display the shape and pattern of the watch, etc., and artistic words are used to emphasize the design features of the watch.
示例性地,编排设备除了可以通过语义分析选择任一子标题的媒体类型,也可以通过其他方式。例如,接收由第二用户输入的子标题的媒体类型。而无论通过何种方式完成媒体类型的选择,编排设备均可根据选择后的媒体类型生成子标题对应的子交互资源。继续以介绍手表的外观设计为例,编排设备选择一张高清的手表照片作为背景或者作为第三用户展示的图片,同时在手表照片上添加一些艺术字来突出手表的设计特征。之后,将作为文本内容的介绍词和手表照片与艺术字整合在一起,生成一个介绍手表的外观设计的介绍视频或者图文内容,其他子标题对应的子交互资源的生成过程类似。Exemplarily, in addition to selecting the media type of any subtitle through semantic analysis, the layout device can also use other methods. For example, receive the media type of the subtitle input by the second user. Regardless of the method used to complete the selection of the media type, the layout device can generate a sub-interaction resource corresponding to the subtitle according to the selected media type. Continuing with the example of introducing the appearance design of a watch, the layout device selects a high-definition photo of a watch as the background or as a picture displayed by a third user, and adds some artistic words to the photo of the watch to highlight the design features of the watch. Afterwards, the introduction words and the watch photo as text content are integrated with the artistic words to generate an introductory video or graphic content introducing the appearance design of the watch. The generation process of the sub-interaction resources corresponding to other subtitles is similar.
在一种可能的实现方式中,不同子标题存在展示顺序,该展示顺序可根据语言逻辑顺序确定。以参考意图信息为介绍产品,需要展示的子标题包括功能介绍、外观设计介绍、材质质量介绍、使用体验介绍、福利发送和弹幕疑问解答为例,编排设备根据语言逻辑顺序确定多个子标题的展示顺序为外观设计介绍、功能介绍、福利发送、材质质量介绍、使用体验介绍和弹幕疑问解答。根据子标题的执行顺序对各个子标题对应的子交互资源进行顺序排列。In one possible implementation, different subtitles have a display order, and the display order can be determined according to the language logic order. Taking the reference intent information as an introduction to a product, the subtitles that need to be displayed include function introduction, appearance design introduction, material quality introduction, user experience introduction, welfare delivery, and barrage question answering as an example. The editing device determines the display order of multiple subtitles as appearance design introduction, function introduction, welfare delivery, material quality introduction, user experience introduction, and barrage question answering according to the language logic order. The sub-interaction resources corresponding to each subtitle are arranged in sequence according to the execution order of the subtitles.
此外,编排设备在对各个子标题对应的子交互资源进行顺序排列后,还需要对各个子标题进行过渡处理,以实现不同子标题对应的子交互资源的连接,从而得到包括多个子交互资源的第一交互资源。示例性地,过渡处理的过程包括:确定需要过渡处理的两个子标题,两个子标题为展示顺序相邻的子标题;根据两个子标题对应的文本内容生成过渡数据,过渡数据用于连接两个子标题对应的文本内容;根据过渡数据生过渡资源,过渡资源用于连接两个子标题对应的子交互资源。In addition, after the arrangement device arranges the sub-interaction resources corresponding to each sub-title in sequence, it is also necessary to perform transition processing on each sub-title to achieve the connection of the sub-interaction resources corresponding to different sub-titles, thereby obtaining a first interaction resource including multiple sub-interaction resources. Exemplarily, the transition processing process includes: determining two sub-titles that need transition processing, the two sub-titles are adjacent sub-titles in the display order; generating transition data according to the text content corresponding to the two sub-titles, the transition data is used to connect the text content corresponding to the two sub-titles; generating transition resources according to the transition data, the transition resources are used to connect the sub-interaction resources corresponding to the two sub-titles.
以需要过渡处理的子标题为功能介绍和外观设计介绍为例,第三用户在介绍完产品功能开始介绍外观设计的过程中,需要考虑到子标题对应的子交互资源之间转变的合理性,避免转变过快,导致第一用户的观看体验感降低。因此,需要对子标题进行过渡处理,编排设备根据两个子标题对应的文本内容生成过渡数据“在了解完52号产品的外观后,相信大家会更好奇该产品的功能,请耐心等待,主播这就为大家一一介绍”。根据过渡数据生成媒体资源,该媒体资源可以是一段第三用户朗读过渡数据的视频。通过对各个子标题进行过渡处理,保证各个子标题对应的子交互资源之间的连续性,从而保证整个第一交互资源的内容流畅自然。Taking the subtitles that need transition processing as function introduction and appearance design introduction as an example, when the third user introduces the product function and then starts to introduce the appearance design, it is necessary to consider the rationality of the transition between the sub-interaction resources corresponding to the subtitles to avoid too fast transition, which will reduce the viewing experience of the first user. Therefore, it is necessary to perform transition processing on the subtitles, and the editing device generates transition data based on the text content corresponding to the two subtitles, "After understanding the appearance of product No. 52, I believe everyone will be more curious about the functions of this product. Please wait patiently. The host will introduce them to you one by one." Media resources are generated based on the transition data. The media resource can be a video of a third user reading the transition data. By performing transition processing on each subtitle, the continuity between the sub-interaction resources corresponding to each subtitle is guaranteed, thereby ensuring that the content of the entire first interaction resource is smooth and natural.
在获取第一交互资源之后,编排设备可以展示第一交互资源,实现第三用户和第一用户之间的交互。在展示第一交互资源进行交互的过程中,编排设备还可以获取互动意图信息,以根据互动意图信息对展示的第一交互资源进行调整。可选地,互动意图信息例如是至少一个第一用户的互动意图信息。其中,第一 用户的互动意图信息可以是通过第一用户在观看第一交互资源的过程中产生的意图信息。例如图4所示,编排设备通过展示第一交互资源,开始互动表演,第一用户在观看互动表演的过程中执行一些用户行为,所进行的用户行为产生了第一用户的互动意图信息。After acquiring the first interactive resource, the arrangement device may display the first interactive resource to realize the interaction between the third user and the first user. In the process of displaying the first interactive resource for interaction, the arrangement device may also obtain the interactive intention information to adjust the displayed first interactive resource according to the interactive intention information. Optionally, the interactive intention information is, for example, the interactive intention information of at least one first user. The user's interactive intention information may be intention information generated by the first user in the process of watching the first interactive resource. For example, as shown in FIG4 , the arrangement device starts the interactive performance by displaying the first interactive resource, and the first user performs some user behaviors in the process of watching the interactive performance, and the user behaviors generated the interactive intention information of the first user.
在一种可能的实现方式中,编排设备获取的互动意图信息还存在属性,属性包括类型或用户等级中的一者或多者。意图信息的类型包括文本消息、打赏、点播、点踩、分享、关注。其中,互动意图信息的类型是指互动意图信息的产生方式。互动意图信息的属性中的用户等级,是指产生该互动意图信息的第一用户的用户等级。第一用户的用户等级指示了第一用户的重要程度,用户等级可以是根据第一用户的历史互动情况确定,例如,第一用户的历史打赏累积越高,历史弹幕发布数量越多,该第一用户的用户等级越高。In a possible implementation, the interactive intent information obtained by the orchestration device also has attributes, and the attributes include one or more of type or user level. The types of intent information include text messages, rewards, on-demand, clicks, sharing, and attention. Among them, the type of interactive intent information refers to the way in which the interactive intent information is generated. The user level in the attributes of the interactive intent information refers to the user level of the first user who generates the interactive intent information. The user level of the first user indicates the importance of the first user. The user level can be determined based on the historical interaction of the first user. For example, the higher the historical rewards accumulated by the first user and the more historical barrage releases, the higher the user level of the first user.
可选地,编排设备获取第一用户的互动意图信息的过程包括:获取第一交互资源的互动环境数据,互动环境数据包括第一用户的互动意图信息;从互动环境数据中提取至少一个互动意图信息。继续以直播互动为例,互动环境数据例如是播放第一交互资源的直播间的后台数据。编排设备可以如图4所示,通过环境感知模块中的互动环境感知单元拉取直播间的后台数据,作为互动环境数据。在一种可能的情况下,互动环境数据包括第一用户的互动意图信息,例如,作为互动环境数据的直播间的后台数据包括第一用户发送弹幕的文本消息、打赏产生的礼物记录、下单产生的交易数据以及关注或取消关注产生的粉丝关注记录。Optionally, the process of the orchestration device obtaining the interactive intention information of the first user includes: obtaining the interactive environment data of the first interactive resource, the interactive environment data including the interactive intention information of the first user; extracting at least one interactive intention information from the interactive environment data. Continuing with the live broadcast interaction as an example, the interactive environment data is, for example, the background data of the live broadcast room that plays the first interactive resource. The orchestration device can, as shown in Figure 4, pull the background data of the live broadcast room through the interactive environment perception unit in the environment perception module as the interactive environment data. In one possible case, the interactive environment data includes the interactive intention information of the first user. For example, the background data of the live broadcast room as the interactive environment data includes the text message of the first user sending the barrage, the gift record generated by the reward, the transaction data generated by placing an order, and the fan attention record generated by following or unfollowing.
本申请实施例不限定编排设备从互动环境数据中获取互动意图信息的方式,编排设备可以获取互动条件,通过互动条件从互动环境数据中提取互动意图信息。互动条件可以是根据经验和实施环境设置得到,实施环境例如是交互场景等。例如,根据经验设置直播间对应的互动条件为文本消息、打赏、点赞、点踩、分享、关注和取消关注中的一者或多者。编排设备获取互动条件后,确定互动环境数据中包括的信息是否命中互动条件,当互动环境数据中的信息命中任一互动条件,确定该信息为需要第三用户进行互动反馈的互动意图信息,当互动环境数据中的信息未命中互动条件,确定该信息不需要第三用户进行互动反馈,上述操作也即是图4中环境感知模块包括的互动条件单元执行的操作。The embodiment of the present application does not limit the way in which the orchestration device obtains the interactive intention information from the interactive environment data. The orchestration device can obtain the interactive conditions and extract the interactive intention information from the interactive environment data through the interactive conditions. The interactive conditions can be obtained based on experience and implementation environment settings, and the implementation environment is, for example, an interactive scene. For example, the interactive conditions corresponding to the live broadcast room are set according to experience as one or more of text messages, rewards, likes, dislikes, sharing, following and unfollowing. After the orchestration device obtains the interactive conditions, it determines whether the information included in the interactive environment data hits the interactive conditions. When the information in the interactive environment data hits any interactive condition, it determines that the information is interactive intention information that requires interactive feedback from a third user. When the information in the interactive environment data does not hit the interactive condition, it determines that the information does not require interactive feedback from a third user. The above operations are also the operations performed by the interactive condition unit included in the environmental perception module in Figure 4.
通过互动条件,编排设备从后台数据中提取弹幕数据、礼物记录、交易数据和粉丝关注记录,得到多个互动意图信息。其中,一个第二对象可以对应一个互动意图信息,也可以对应多个互动意图信息,本申请实施例对此不进行限定。图4中,实线箭头指示处理由编排设备中包括的模块执行,虚线箭头指示处理由用户执行,用户例如是第一用户或第二用户。Through the interactive conditions, the arrangement device extracts barrage data, gift records, transaction data and fan attention records from the background data to obtain multiple interactive intention information. Among them, a second object can correspond to one interactive intention information or multiple interactive intention information, which is not limited in the embodiment of the present application. In Figure 4, the solid arrow indicates that the processing is performed by the module included in the arrangement device, and the dotted arrow indicates that the processing is performed by the user, such as the first user or the second user.
可选地,互动意图信息还可以是第二用户产生的意图信息,例如,第二用户在根据第一交互资源进行直播过程中,发现因为产品B的合作时间结束,需要取消执行第一交互资源中的产品B的介绍,互动意图信息为取消介绍产品B。此种情况下,编排设备可以接收由第二用户输入的互动意图信息,实现互动意图信息的获取。例如,第二用户通过编排设备提供的信息输入控件输入互动意图信息,编排设备由此获取交互过程中产生的互动意图信息。Optionally, the interaction intention information may also be the intention information generated by the second user. For example, during the live broadcast based on the first interaction resource, the second user finds that the introduction of product B in the first interaction resource needs to be canceled because the cooperation time of product B has ended. The interaction intention information is to cancel the introduction of product B. In this case, the orchestration device may receive the interaction intention information input by the second user to obtain the interaction intention information. For example, the second user inputs the interaction intention information through the information input control provided by the orchestration device, and the orchestration device thereby obtains the interaction intention information generated during the interaction process.
S202,根据至少一个互动意图信息,调整第一交互资源,第一交互资源为第一用户观看的内容,第一交互资源包含与至少一个子标题对应的子交互资源,第一交互资源的类型包括文本、音频、图片、视频中的一者或多者。S202, adjusting a first interactive resource according to at least one interactive intention information, where the first interactive resource is content viewed by a first user, the first interactive resource includes a sub-interactive resource corresponding to at least one subtitle, and the type of the first interactive resource includes one or more of text, audio, picture, and video.
无论编排设备基于何种方式实现互动意图信息的获取,编排设备均可在获取多个互动意图信息后,根据多个互动意图调整第一交互资源。由于多个互动意图信息中可能存在需要互动的互动意图信息,例如第一用户需要第三用户进行解答的弹幕问题,或者第一用户需要第三用户对自己的打赏发表感谢。而编排设备获取的多个互动意图信息中也可能存在不需要互动的互动意图信息,例如,第一用户在观看第一交互资源过程中为了提升自己的用户等级,会通过弹幕发送无意义水贴,如表情包和数字等,对于该类无意义水贴第三用户则无需进行互动反馈。或者,第三用户能够互动反馈的互动意图信息的数量有限制,例如,为了控制直播时长,主播介绍产品之余,仅存在十分钟可用于和观众互动,或主播仅能够回答十条弹幕提问。Regardless of the method by which the arrangement device acquires the interactive intent information, the arrangement device can adjust the first interactive resource according to the multiple interactive intents after acquiring the multiple interactive intent information. Because there may be interactive intent information that requires interaction among the multiple interactive intent information, such as the barrage question that the first user needs the third user to answer, or the first user needs the third user to thank his reward. And there may also be interactive intent information that does not require interaction among the multiple interactive intent information acquired by the arrangement device. For example, in order to improve his user level during the process of watching the first interactive resource, the first user will send meaningless water posts, such as emoticons and numbers, through the barrage. For such meaningless water posts, the third user does not need to interact and feedback. Or, the number of interactive intent information that the third user can interact and feedback is limited. For example, in order to control the length of the live broadcast, the host only has ten minutes to interact with the audience after introducing the product, or the host can only answer ten barrage questions.
因此,编排设备需要从多个互动意图信息中选择进行互动反馈的互动意图信息。示例性地,编排设备接收交互资源调整策略,交互资源调整策略包括互动意图信息的属性对应的优先级、权重或阈值中的一者或多者,之后可以根据交互资源调整策略选择需要互动反馈的互动意图信息,从而实现根据至少一个互动意图信息和交互资源调整策略,调整第一交互资源。Therefore, the orchestration device needs to select interactive intent information for interactive feedback from multiple interactive intent information. Exemplarily, the orchestration device receives an interactive resource adjustment strategy, which includes one or more of the priority, weight, or threshold corresponding to the attributes of the interactive intent information, and then can select the interactive intent information that requires interactive feedback according to the interactive resource adjustment strategy, thereby adjusting the first interactive resource according to at least one interactive intent information and the interactive resource adjustment strategy.
接下来分别根据权重、阈值和优先级介绍根据交互资源调整策略选择需要互动反馈的互动意图信息的过程。本申请实施例不限定确定互动意图信息的权重的过程,编排设备可以根据各个互动意图信息请求的互动对各个互动意图信息进行聚类,得到多个意图集合,任一个意图集合包括至少一个互动意图信息;获 取任一个意图集合的第一权重、第二权重和第三权重中的至少一种,根据第一权重、第二权重和第三权重中的至少一种确定任一个意图集合的权重,第一权重根据任一个意图集合包括的互动意图信息的数量确定,第二权重根据任一个意图集合对应的第一用户的用户等级确定,第三权重根据任一个互动集合命中的互动条件的条件权重确定。Next, the process of selecting the interactive intent information that requires interactive feedback according to the interactive resource adjustment strategy is introduced according to the weight, threshold and priority. The embodiment of the present application does not limit the process of determining the weight of the interactive intent information. The orchestration device can cluster each interactive intent information according to the interaction requested by each interactive intent information to obtain multiple intent sets, and any intent set includes at least one interactive intent information; Take at least one of the first weight, second weight and third weight of any intention set, and determine the weight of any intention set according to at least one of the first weight, second weight and third weight, the first weight is determined according to the amount of interactive intent information included in any intention set, the second weight is determined according to the user level of the first user corresponding to any intention set, and the third weight is determined according to the conditional weight of the interactive condition hit by any interactive set.
在一种可能的情况下,会存在多个互动意图信息请求的互动相同的情况下,例如同一个第一用户为了能够让第三用户关注到自己的问题,在弹幕中多次发布同样一个问题。又或者,不同的第一用户弹幕询问的问题意图一致,例如,存在第一用户A提问:身高XXX,体重XX应该穿多大码,存在第一用户B提问:好奇尺码信息。第一用户A的互动意图信息和第一用户B的互动意图信息请求的互动均为反馈产品尺码表。In one possible case, there may be multiple interactions with the same interactive intent information request, for example, the same first user posts the same question multiple times in the barrage in order to attract the attention of the third user. Alternatively, the questions asked by different first users in the barrage are consistent in intent, for example, there is a first user A who asks: What size should I wear if I am XXX in height and XX in weight, and there is a first user B who asks: I am curious about the size information. The interactions of the interactive intent information of the first user A and the interactive intent information request of the first user B are both to feedback the product size chart.
对于请求相同互动的互动意图信息,第三用户互动反馈一次即可。因此,编排设备可根据各个互动意图信息请求的互动对多个互动意图信息进行聚类,得到多个意图集合,任一个意图集合包括的互动意图信息需要进行的互动一致。聚类过程例如是,在多个互动意图信息请求的互动相同的情况下,将多个互动意图信息划分为一个意图集合。例如上述实施例中第一用户A的互动意图信息和第一用户B的互动意图信息属于一个意图集合。通过聚类得到至少一个意图集合后,编排设备可确定任一个意图集合的互动权重。For the interactive intent information requesting the same interaction, the third user only needs to provide interactive feedback once. Therefore, the orchestration device can cluster multiple interactive intent information according to the interactions requested by each interactive intent information to obtain multiple intent sets, and the interactions required for the interactive intent information included in any intent set are consistent. The clustering process is, for example, when the interactions requested by multiple interactive intent information are the same, dividing the multiple interactive intent information into one intent set. For example, in the above embodiment, the interactive intent information of the first user A and the interactive intent information of the first user B belong to one intent set. After obtaining at least one intent set through clustering, the orchestration device can determine the interaction weight of any intent set.
可选地,编排设备可根据任一个意图集合中包括的互动意图信息的数量确定第一权重。在一种可能的情况下,互动意图信息的数量和第一权重呈正相关关系,当任一个意图集合中包括的互动意图信息越多,说明第一用户对该互动意图信息请求的互动越感兴趣,越需要第三用户进行互动。编排设备可将任一个意图集合包括的互动意图信息的数量确定为第一权重,也可以对数量进行处理,得到第一权重。处理例如是采用层次分析法(analytic hierarchy process,AHP)对数量进行分析,得到第一权重。Optionally, the orchestration device may determine the first weight according to the number of interactive intent information included in any one intent set. In one possible case, the number of interactive intent information and the first weight are positively correlated. The more interactive intent information included in any one intent set, the more interested the first user is in the interaction requested by the interactive intent information, and the more the third user needs to interact. The orchestration device may determine the number of interactive intent information included in any one intent set as the first weight, or may process the number to obtain the first weight. The processing is, for example, to analyze the number using an analytic hierarchy process (AHP) to obtain the first weight.
在一种可能的情况下,任一个意图集合对应的第一用户也会影响任一个意图集合的权重。其中,任一个意图集合对应的第一用户是指该第一用户产生的互动意图信息为任一个意图集合包括的互动意图信息。示例性地,用户等级和第二权重呈正相关关系,编排设备可以根据交互资源调整策略中包括的用户等级和第二权重的确定策略确定各个意图集合的第二权重,根据用户等级确定第二权重的过程和根据数量确定第一权重的过程类似,详细描述可参见上述实施例,此处不再重复赘述。In one possible case, the first user corresponding to any intent set will also affect the weight of any intent set. Among them, the first user corresponding to any intent set refers to the interactive intent information generated by the first user as the interactive intent information included in any intent set. Exemplarily, the user level and the second weight are positively correlated. The orchestration device can determine the second weight of each intent set according to the user level and the second weight determination strategy included in the interactive resource adjustment strategy. The process of determining the second weight according to the user level is similar to the process of determining the first weight according to the quantity. For detailed description, please refer to the above embodiment, which will not be repeated here.
可选地,任一个意图集合所命中的互动条件也会影响任一个意图集合的权重。各个互动条件也存在条件权重,互动条件的条件权重指示该互动条件的重要程度,各个互动条件的条件权重可以根据交互资源调测策略确定。以互动条件包括打赏和文本信息为例,交互资源调整策略指示文本信息的重要程度高于打赏的重要程度,则文本信息的条件权重高于打赏的条件权重。编排设备可根据任一个意图集合中包括的互动意图信息命中的互动条件,根据条件权重确定第三权重。当任一个意图集合包括的各个互动意图信息命中的条件权重相同的情况下,可将命中的条件权重确定为第三权重。当任一个意图集合包括的各个互动意图信息命中的条件权重不同的情况下,可根据多个条件权重计算得到第三权重。Optionally, the interactive conditions hit by any intent set will also affect the weight of any intent set. Each interactive condition also has a conditional weight, and the conditional weight of the interactive condition indicates the importance of the interactive condition. The conditional weight of each interactive condition can be determined according to the interactive resource adjustment strategy. Taking the interactive conditions including rewards and text information as an example, the interactive resource adjustment strategy indicates that the importance of text information is higher than the importance of rewards, then the conditional weight of text information is higher than the conditional weight of rewards. The orchestration device can determine the third weight according to the conditional weight based on the interactive conditions hit by the interactive intent information included in any intent set. When the conditional weights hit by each interactive intent information included in any intent set are the same, the conditional weight of the hit can be determined as the third weight. When the conditional weights hit by each interactive intent information included in any intent set are different, the third weight can be calculated based on multiple conditional weights.
在获取第一权重、第二权重和第三权重中的至少一种后,编排设备可根据第一权重、第二权重和第三权重中的至少一种确定意图集合的权重。可选地,编排设备可以将第一权重确定为意图集合的权重,也可以将第二权重确定为意图集合的权重,或者将第三权重确定为意图集合的权重、还可以根据第一权重、第二权重和第三权重的任意两个或三个,通过加权计算确定任一个意图集合的权重。After obtaining at least one of the first weight, the second weight, and the third weight, the orchestration device may determine the weight of the intent set according to at least one of the first weight, the second weight, and the third weight. Optionally, the orchestration device may determine the first weight as the weight of the intent set, or the second weight as the weight of the intent set, or the third weight as the weight of the intent set, or may determine the weight of any intent set through weighted calculation based on any two or three of the first weight, the second weight, and the third weight.
在得到各个意图集合的权重后,编排设备可根据各个意图集合的权重,确定需要互动的至少一个意图集合。示例性地,编排设备可以根据意图集合的权重选择需要互动的至少一个意图集合。例如,基于经验设置权重阈值,对于任一个意图集合,该任一个意图集合的权重大于权重阈值,则任一个意图集合需要互动。或者,基于经验设置数量阈值,根据意图集合的权重对多个意图集合进行顺序排列,将排列顺序不低于数量阈值的意图集合确定为需要互动的意图集合。在选择完需要互动的意图集合后,可将该意图集合对应的互动意图信息确定为用于调整第一交互资源的互动意图信息。After obtaining the weights of each intent set, the orchestration device can determine at least one intent set that needs to interact based on the weights of each intent set. Exemplarily, the orchestration device can select at least one intent set that needs to interact based on the weights of the intent sets. For example, a weight threshold is set based on experience, and for any intent set, if the weight of any intent set is greater than the weight threshold, then any intent set needs to interact. Alternatively, a quantity threshold is set based on experience, and multiple intent sets are arranged in sequence according to the weights of the intent sets, and the intent sets whose arrangement order is not lower than the quantity threshold are determined as intent sets that need to interact. After selecting the intent set that needs to interact, the interactive intent information corresponding to the intent set can be determined as the interactive intent information for adjusting the first interactive resource.
上述为根据权重选择用于调整第一交互资源的互动意图信息,在一种可能的情况下,编排设备还可以根据各个互动意图信息的信息量和阈值确定用于调整第一交互资源的互动意图信息。信息量是指互动意图信息的数量。例如,根据各个子标题对应的互动意图信息的信息量和阈值确定第一用户对各个子标题的感兴趣程度。其中,子标题对应的互动意图信息是指该互动意图信息为第一用户在展示该子标题对应的子交互资源的过程中产生的。当互动意图信息的信息量低于第一阈值,确定第一用户对该子标题的感兴趣程度较低,确定用于调整第一交互资源的互动意图信息为跳过该子标题,当互动意图信息的信息量高于第二阈 值,确定第二用户对该子标题的感兴趣程度较高,则确定用于调整第一交互资源的互动意图信息为丰富该子标题对应的子交互资源。其中,第一阈值和第二阈值为基于经验设置的任意大小的数值。The above is the interactive intent information for adjusting the first interactive resource selected according to the weight. In one possible case, the editing device can also determine the interactive intent information for adjusting the first interactive resource according to the information volume and threshold of each interactive intent information. The information volume refers to the amount of interactive intent information. For example, the first user's interest in each subtitle is determined based on the information volume and threshold of the interactive intent information corresponding to each subtitle. Among them, the interactive intent information corresponding to the subtitle means that the interactive intent information is generated by the first user in the process of displaying the sub-interactive resource corresponding to the subtitle. When the information volume of the interactive intent information is lower than the first threshold, it is determined that the first user has a low interest in the subtitle, and the interactive intent information for adjusting the first interactive resource is determined to skip the subtitle. When the information volume of the interactive intent information is higher than the second threshold, it is determined that the first user has a low interest in the subtitle, and the interactive intent information for adjusting the first interactive resource is determined to skip the subtitle. value, it is determined that the second user has a high degree of interest in the subtitle, and the interactive intention information used to adjust the first interactive resource is determined to enrich the sub-interactive resource corresponding to the subtitle. The first threshold and the second threshold are values of any size set based on experience.
可选地,编排设备还可以获取各个互动意图信息的属性对应的优先级,根据各个互动意图信息的属性对应的优先级选择用于调整第一交互资源的互动意图信息。示例性地,编排设备从接收到的交互资源调整策略中提取各个互动意图信息的属性对应的优先级,根据各个互动意图信息的属性对应的优先级对各个互动意图信息进行顺序排列,将排列顺序不低于数量阈值的互动意图信息确定用于调整第一交互资源的互动意图信息。其中,互动意图信息的属性对应的优先级例如是文本消息的优先级高于分享的优先级,点踩的优先级高于文本消息的优先级。Optionally, the orchestration device may also obtain the priorities corresponding to the attributes of each interactive intent information, and select the interactive intent information used to adjust the first interactive resource according to the priorities corresponding to the attributes of each interactive intent information. Exemplarily, the orchestration device extracts the priorities corresponding to the attributes of each interactive intent information from the received interactive resource adjustment strategy, arranges each interactive intent information in sequence according to the priorities corresponding to the attributes of each interactive intent information, and determines the interactive intent information whose arrangement order is not lower than the quantity threshold as the interactive intent information used to adjust the first interactive resource. Among them, the priorities corresponding to the attributes of the interactive intent information are, for example, that the priority of text messages is higher than that of sharing, and the priority of clicks is higher than that of text messages.
无论编排设备基于何种方式确定用于调整第一交互资源的互动意图信息,均可根据所确定的互动意图信息对第一交互资源进行调整。在一种可能的情况下,调整过程包括:根据互动意图信息对第一交互资源对应的子标题进行调整,得到调整后的子标题;根据调整后的子标题对应的子交互资源获取调整后的第一交互资源。Regardless of the method by which the editing device determines the interactive intent information for adjusting the first interactive resource, the first interactive resource can be adjusted according to the determined interactive intent information. In one possible case, the adjustment process includes: adjusting the subtitle corresponding to the first interactive resource according to the interactive intent information to obtain an adjusted subtitle; and obtaining the adjusted first interactive resource according to the sub-interactive resource corresponding to the adjusted subtitle.
其中,调整子标题可以是增加新的子标题,例如,针对互动意图信息请求的互动为反馈产品A的尺码表,编排设备增加名为产品A的尺码介绍的子标题。如图5所示的直播间流程,在介绍产品A包括的子标题中,增加子标题1.4:产品A的尺码介绍。调整交互主题也可以是减少原有的子标题,例如,针对互动意图信息请求的互动为取消介绍产品A,编排设备将第一交互资源中包括的名为介绍产品A对应的当前展示的子标题和即将展示的子标题删除。如图5所示,当前展示的子标题为产品A的功能介绍,编排设备删除产品A的功能介绍以及产品A的功能介绍之后的介绍产品A所包括的子标题。在完成子标题的调整后,编排设备可确定调整后的子标题对应的子交互资源。图5中的虚线框指示当前展示的子标题。Among them, adjusting the subtitles may be adding new subtitles. For example, in response to the interaction requested for interactive intent information, the interaction is to provide feedback on the size chart of product A, and the editing device adds a subtitle called size introduction of product A. In the live broadcast room process shown in Figure 5, in the subtitles included in the introduction of product A, add subtitle 1.4: size introduction of product A. Adjusting the interactive theme may also be reducing the original subtitles. For example, in response to the interaction requested for interactive intent information, the interaction is to cancel the introduction of product A, and the editing device deletes the currently displayed subtitle and the subtitle to be displayed corresponding to the name of introducing product A included in the first interactive resource. As shown in Figure 5, the currently displayed subtitle is the function introduction of product A. The editing device deletes the function introduction of product A and the subtitle included in the introduction of product A after the function introduction of product A. After completing the adjustment of the subtitle, the editing device can determine the sub-interaction resource corresponding to the adjusted subtitle. The dotted box in Figure 5 indicates the currently displayed subtitle.
针对增加的新的子标题,编排设备获取新的子标题对应的子交互资源。以增加的子标题为第二子标题为例,编排设备获取第二子标题对应的文本内容,获取第二子标题对应的媒体资源,得到第二子标题对应的增量资源,之后,编排设备可以如图4所示,将调用资源生成模块生成的增量资源发往资源编排模块,通过智能编排单元生成该增量资源对应的子交互资源。关于生成增量资源和根据增量资源生成第二子标题对应的子交互资源的过程和S201中生成第一交互资源中包括的子交互资源的过程类似,可参考相关描述,此处不再赘述。For the added new subtitle, the editing device obtains the sub-interaction resource corresponding to the new subtitle. Taking the added subtitle as the second subtitle as an example, the editing device obtains the text content corresponding to the second subtitle, obtains the media resources corresponding to the second subtitle, and obtains the incremental resources corresponding to the second subtitle. After that, the editing device can send the incremental resources generated by calling the resource generation module to the resource editing module as shown in Figure 4, and generate the sub-interaction resource corresponding to the incremental resource through the intelligent editing unit. The process of generating incremental resources and generating sub-interaction resources corresponding to the second subtitle based on the incremental resources is similar to the process of generating sub-interaction resources included in the first interactive resource in S201. Please refer to the relevant description and will not be repeated here.
上述为请求增加子标题后对子标题对应的子交互资源的调整过程,针对请求删除子标题,编排设备可跳过第一交互资源中当前展示的子标题和即将展示的n个子标题对应的子交互资源,n为大于等于0的整数;展示当前展示的子标题后n+1子标题对应的子交互资源。其中,当前展示的子标题和即将展示的n个子标题根据互动意图信息确定。继续以图5为例,在互动意图信息请求的互动为停止介绍产品A的情况下,即将展示的n个子标题为产品A的外观设计、材质质量和用户体验等。编排设备跳过展示图5中介绍产品A对应的多个子交互资源,之后,开始展示位于当前展示的子标题后的第n+1的子标题对应的子交互资源,也即图5中产品B的总体介绍对应的子交互资源。The above is the adjustment process of the sub-interaction resource corresponding to the subtitle after requesting to add a subtitle. For the request to delete a subtitle, the editing device can skip the sub-interaction resources corresponding to the subtitle currently displayed and the n subtitles to be displayed in the first interactive resource, where n is an integer greater than or equal to 0; and display the sub-interaction resources corresponding to the n+1 subtitle after the currently displayed subtitle. Among them, the currently displayed subtitle and the n subtitles to be displayed are determined according to the interactive intent information. Continuing with Figure 5 as an example, when the interaction requested by the interactive intent information is to stop introducing product A, the n subtitles to be displayed are the appearance design, material quality, and user experience of product A. The editing device skips displaying the multiple sub-interaction resources corresponding to the introduction of product A in Figure 5, and then starts to display the sub-interaction resources corresponding to the n+1th subtitle after the currently displayed subtitle, that is, the sub-interaction resources corresponding to the overall introduction of product B in Figure 5.
由于调整后的第一交互资源会出现子标题对应的子交互资源不连续的问题。例如,新增的子标题对应的子交互资源和原有的子标题对应的子交互资源之间不连续,或者,跳过了原有的子标题对应的子交互资源后,导致当前展示的内容和即将展示的第n+1的子标题对应的子交互资源之间不连续。The problem of discontinuity of the sub-interaction resources corresponding to the sub-titles may occur due to the adjustment of the first interaction resource. For example, the sub-interaction resources corresponding to the newly added sub-titles are discontinuous with the sub-interaction resources corresponding to the original sub-titles, or after skipping the sub-interaction resources corresponding to the original sub-titles, the sub-interaction resources corresponding to the currently displayed content and the sub-interaction resources corresponding to the n+1th sub-title to be displayed are discontinuous.
因此,编排设备需要对调整后的第一交互资源进行过渡处理,例如,对于调整的子标题,生成该子标题对应的过渡数据,或者对所调整的子标题对应的子交互资源进行文本数据重写,以保证调整后的子标题对应的子交互资源流畅自然。可选地,编排设备可以如图4所示调用资源编排模块中的互动重排单元对调整后的第一交互资源进行过渡处理。由于过渡处理过程中需要考虑多个子标题对应的子交互资源之间的连续性,因此,需要如图4所示获取全量资源,也即调整后的第一交互资源整体,以根据调整后的第一交互资源整体进行互动重排,保证整个第一交互资源流程自然。可选地,资源生成模块可以直接将全量资源发发往资源编排模块,也可以如图4所示先由第二用户对全量资源进行用户审阅,将用户审阅后的全量资源发往资源编排模块。Therefore, the editing device needs to perform transition processing on the adjusted first interactive resource. For example, for the adjusted subtitle, the transition data corresponding to the subtitle is generated, or the text data of the sub-interactive resource corresponding to the adjusted subtitle is rewritten to ensure that the sub-interactive resource corresponding to the adjusted subtitle is smooth and natural. Optionally, the editing device can call the interactive rearrangement unit in the resource editing module as shown in Figure 4 to perform transition processing on the adjusted first interactive resource. Since the continuity between the sub-interactive resources corresponding to multiple subtitles needs to be considered during the transition processing, it is necessary to obtain the full amount of resources as shown in Figure 4, that is, the adjusted first interactive resource as a whole, so as to perform interactive rearrangement according to the adjusted first interactive resource as a whole, so as to ensure that the entire first interactive resource flow is natural. Optionally, the resource generation module can directly send the full amount of resources to the resource editing module, or the second user can first review the full amount of resources as shown in Figure 4, and send the full amount of resources after user review to the resource editing module.
无论通过何种方式获取全量资源,资源编排模块均可对全量资源进行过渡处理。过渡处理的过程和S201中生成第一交互资源的过程中的过渡处理的过程类似,可参考相关描述,此处不再重复说明。编排设备通过调整第一交互资源,实现了即使采用同一个第一交互资源进行多次交互,也可以根据每次交互过程中产生的互动意图信息对第一交互资源进行调整,进而实现交互过程的不同。 Regardless of the method used to obtain the full amount of resources, the resource orchestration module can perform transition processing on the full amount of resources. The process of transition processing is similar to the process of transition processing in the process of generating the first interactive resource in S201. Please refer to the relevant description and will not be repeated here. By adjusting the first interactive resource, the orchestration device can adjust the first interactive resource according to the interactive intent information generated during each interaction process, thereby achieving different interactive processes.
综上所述,本申请实施例提供的交互资源的生成方法,根据交互过程中产生的互动意图信息对第一交互资源进行实时调整,以使第一交互资源更适应交互过程,第一交互资源的调整效率高,以使第一交互资源更适应交互过程,提升了交互场景下的互动能力,提高了基于第一交互资源进行的交互的体验感高。通过参考意图信息确定至少一个子标题,再根据子标题自动获取需要使用到的文本内容和媒体资源,从而生成交互过程中需要使用的第一交互资源,生成第一交互资源的过程中人工参与度低,成本低,效率高。在获取媒体资源的过程中,编排设备可以自动进行检索和生成,降低了第二用户在第一交互资源生成过程中的检索成本和人工精力,降低了资源生成难度,提高了资源制作效率和生成的第一交互资源的质量。由于子标题对应多个媒体资源,根据第一交互资源进行互动的第三用户可以表现出丰富的互动能力,例如手势、表情等,提升了第一交互资源的交互体验感。In summary, the method for generating interactive resources provided by the embodiment of the present application adjusts the first interactive resource in real time according to the interactive intention information generated during the interaction process, so that the first interactive resource is more adapted to the interactive process, and the adjustment efficiency of the first interactive resource is high, so that the first interactive resource is more adapted to the interactive process, the interactive ability in the interactive scene is improved, and the experience of the interaction based on the first interactive resource is improved. At least one subtitle is determined by referring to the intention information, and then the text content and media resources required to be used are automatically obtained according to the subtitle, so as to generate the first interactive resource required to be used in the interactive process. The process of generating the first interactive resource has low manual participation, low cost and high efficiency. In the process of acquiring media resources, the layout device can automatically search and generate, reducing the search cost and manual effort of the second user in the process of generating the first interactive resource, reducing the difficulty of resource generation, and improving the resource production efficiency and the quality of the generated first interactive resource. Since the subtitle corresponds to multiple media resources, the third user who interacts according to the first interactive resource can show rich interactive capabilities, such as gestures, expressions, etc., which improves the interactive experience of the first interactive resource.
以上介绍了本申请实施例的交互资源的生成方法,与上述方法对应,本申请实施例还提供了交互资源的生成装置。图6是本申请实施例提供的一种交互资源的生成装置的结构示意图。基于图6所示的如下多个模块,该图6所示的交互资源的生成装置能够执行上述图2所示的全部或部分操作。应理解到,该装置可以包括比所示模块更多的附加模块或者省略其中所示的一部分模块,本申请实施例对此并不进行限制。如图6所示,装置用于直播互动,该装置包括:The above introduces the method for generating interactive resources of the embodiment of the present application. Corresponding to the above method, the embodiment of the present application also provides a device for generating interactive resources. Figure 6 is a structural schematic diagram of a device for generating interactive resources provided by an embodiment of the present application. Based on the following multiple modules shown in Figure 6, the device for generating interactive resources shown in Figure 6 can perform all or part of the operations shown in Figure 2 above. It should be understood that the device may include more additional modules than the modules shown or omit some of the modules shown therein, and the embodiment of the present application does not limit this. As shown in Figure 6, the device is used for live broadcast interaction, and the device includes:
获取模块601,用于获取至少一个第一用户的至少一个互动意图信息,互动意图信息的属性包括类型、用户等级中的一者或多者,互动意图信息的类型包括文本消息、打赏、点赞、点踩、分享、关注、取消关注中的一者或多者;An acquisition module 601 is used to acquire at least one interaction intention information of at least one first user, where the attributes of the interaction intention information include one or more of type and user level, and the type of the interaction intention information includes one or more of text message, reward, like, dislike, share, follow, and unfollow;
调整模块602,用于根据至少一个互动意图信息,调整第一交互资源,第一交互资源为第一用户观看的内容,第一交互资源包含与至少一个子标题对应的子交互资源,第一交互资源的类型包括文本、音频、图片、视频中的一者或多者。Adjustment module 602 is used to adjust the first interaction resource according to at least one interaction intention information, where the first interaction resource is the content viewed by the first user, the first interaction resource includes a sub-interaction resource corresponding to at least one subtitle, and the type of the first interaction resource includes one or more of text, audio, picture, and video.
在一种可能的实现方式中,装置还包括:接收模块,用于接收交互资源调整策略,交互资源调整策略包括互动意图信息的属性对应的优先级、权重或阈值中的一者或多者;调整模块602,用于根据至少一个互动意图信息和交互资源调整策略,调整第一交互资源。In one possible implementation, the device also includes: a receiving module for receiving an interaction resource adjustment strategy, the interaction resource adjustment strategy including one or more of a priority, a weight or a threshold corresponding to the attributes of the interaction intent information; an adjustment module 602 for adjusting the first interaction resource according to at least one interaction intent information and the interaction resource adjustment strategy.
在一种可能的实现方式中,调整模块602,用于跳过第一交互资源中当前展示的子标题和即将展示的n个子标题对应的子交互资源,n为大于等于0的整数;展示当前展示的子标题后n+1子标题对应的子交互资源。In a possible implementation, the adjustment module 602 is used to skip the sub-interaction resources corresponding to the currently displayed subtitle and n subtitles to be displayed in the first interaction resource, where n is an integer greater than or equal to 0; and display the sub-interaction resources corresponding to the n+1 subtitle after the currently displayed subtitle.
在一种可能的实现方式中,第一交互资源基于第二交互资源生成,获取模块601,还用于获取第二用户输入的参考意图信息,参考意图信息用于指示第二交互资源的主题;根据参考意图信息,获取至少一个子标题和至少一个子标题中的每个子标题对应的文本内容,子标题用于指示第二交互资源的主题中部分内容的主题;装置还包括:展示模块,用于展示第二交互资源,第二交互资源包括至少一个子标题和每个子标题对应的文本内容。In one possible implementation, the first interactive resource is generated based on the second interactive resource, and the acquisition module 601 is also used to obtain reference intent information input by the second user, and the reference intent information is used to indicate the subject of the second interactive resource; according to the reference intent information, at least one subtitle and the text content corresponding to each subtitle in at least one subtitle are obtained, and the subtitle is used to indicate the subject of part of the content in the subject of the second interactive resource; the device also includes: a display module, which is used to display the second interactive resource, and the second interactive resource includes at least one subtitle and the text content corresponding to each subtitle.
在一种可能的实现方式中,获取模块601,还用于获取第二用户输入的子标题配置请求,子标题配置请求用于删除至少一个子标题中的第一子标题,或添加第二子标题;子标题配置请求用于添加第二子标题,子标题配置请求还包括第二子标题的子标题文本,获取模块601,还用于获取第二子标题对应的文本内容。In a possible implementation, the acquisition module 601 is further used to obtain a subtitle configuration request input by a second user, the subtitle configuration request is used to delete a first subtitle in at least one subtitle, or to add a second subtitle; the subtitle configuration request is used to add a second subtitle, the subtitle configuration request also includes a subtitle text of the second subtitle, and the acquisition module 601 is further used to obtain text content corresponding to the second subtitle.
在一种可能的实现方式中,获取模块601,还用于获取至少一个子标题中的每个子标题对应的媒体资源,媒体资源的类型包括图像、音频、视频中的一者或多者,媒体资源的来源为知识库、互联网、人工智能AI模型生成中的一者或多者;展示模块,还用于展示第一交互资源,第一交互资源基于至少一个子标题中的每个子标题对应的第二交互资源和对应的媒体资源生成。In one possible implementation, the acquisition module 601 is also used to acquire media resources corresponding to each subtitle in at least one subtitle, where the types of media resources include one or more of images, audio, and video, and the sources of the media resources are one or more of a knowledge base, the Internet, and artificial intelligence AI model generation; the display module is also used to display a first interactive resource, which is generated based on a second interactive resource and a corresponding media resource corresponding to each subtitle in at least one subtitle.
在一种可能的实现方式中,获取模块601,还用于接收第二用户输入的媒体资源;将媒体资源存入知识库中。In a possible implementation, the acquisition module 601 is further configured to receive a media resource input by a second user; and store the media resource in a knowledge base.
上述装置根据交互过程中产生的互动意图信息对第一交互资源进行实时调整,提高了第一交互资源的实时性,第一交互资源的调整效率高,以使第一交互资源更适应交互过程,提升了交互场景下的互动能力与基于第一交互资源进行交互的体验感。The above-mentioned device adjusts the first interactive resource in real time according to the interactive intention information generated during the interactive process, thereby improving the real-time performance of the first interactive resource. The adjustment efficiency of the first interactive resource is high, so that the first interactive resource is more adaptable to the interactive process, and the interactive ability in the interactive scenario and the experience of interaction based on the first interactive resource are enhanced.
其中,获取模块601和调整模块602均可以通过软件实现,或者可以通过硬件实现。示例性的,接下来以获取模块601为例,介绍获取模块601的实现方式。类似的,调整模块602的实现方式可以参考获取模块601的实现方式。 Wherein, both the acquisition module 601 and the adjustment module 602 can be implemented by software or by hardware. Exemplarily, the implementation of the acquisition module 601 is described below by taking the acquisition module 601 as an example. Similarly, the implementation of the adjustment module 602 can refer to the implementation of the acquisition module 601.
模块作为软件功能单元的一种举例,获取模块601可以包括运行在计算实例上的代码。其中,计算实例可以包括物理主机(计算设备)、虚拟机、容器中的至少一种。进一步地,上述计算实例可以是一台或者多台。例如,获取模块601可以包括运行在多个主机/虚拟机/容器上的代码。需要说明的是,用于运行该代码的多个主机/虚拟机/容器可以分布在相同的区域(region)中,也可以分布在不同的region中。进一步地,用于运行该代码的多个主机/虚拟机/容器可以分布在相同的可用区(availability zone,AZ)中,也可以分布在不同的AZ中,每个AZ包括一个数据中心或多个地理位置相近的数据中心。其中,通常一个region可以包括多个AZ。As an example of a software functional unit, the acquisition module 601 may include code running on a computing instance. Among them, the computing instance may include at least one of a physical host (computing device), a virtual machine, and a container. Further, the above-mentioned computing instance may be one or more. For example, the acquisition module 601 may include code running on multiple hosts/virtual machines/containers. It should be noted that the multiple hosts/virtual machines/containers used to run the code may be distributed in the same region (region) or in different regions. Furthermore, the multiple hosts/virtual machines/containers used to run the code may be distributed in the same availability zone (AZ) or in different AZs, each AZ including one data center or multiple data centers with close geographical locations. Among them, usually a region may include multiple AZs.
同样,用于运行该代码的多个主机/虚拟机/容器可以分布在同一个虚拟私有云(virtual private cloud,VPC)中,也可以分布在多个VPC中。其中,通常一个VPC设置在一个region内,同一region内两个VPC之间,以及不同region的VPC之间跨区通信需在每个VPC内设置通信网关,经通信网关实现VPC之间的互连。Similarly, multiple hosts/virtual machines/containers used to run the code can be distributed in the same virtual private cloud (VPC) or in multiple VPCs. Usually, a VPC is set up in a region. For cross-region communication between two VPCs in the same region and between VPCs in different regions, a communication gateway needs to be set up in each VPC to achieve interconnection between VPCs through the communication gateway.
模块作为硬件功能单元的一种举例,获取模块601可以包括至少一个计算设备,如服务器等。或者,获取模块601也可以是利用专用集成电路(application-specific integrated circuit,ASIC)实现、或可编程逻辑器件(programmable logic device,PLD)实现的设备等。其中,上述PLD可以是复杂程序逻辑器件(complex programmable logical device,CPLD)、现场可编程门阵列(field-programmable gate array,FPGA)、通用阵列逻辑(generic array logic,GAL)或其任意组合实现。As an example of a hardware functional unit, the acquisition module 601 may include at least one computing device, such as a server, etc. Alternatively, the acquisition module 601 may also be a device implemented using an application-specific integrated circuit (ASIC) or a programmable logic device (PLD). The PLD may be a complex programmable logical device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL) or any combination thereof.
获取模块601包括的多个计算设备可以分布在相同的region中,也可以分布在不同的region中。获取模块601包括的多个计算设备可以分布在相同的AZ中,也可以分布在不同的AZ中。同样,获取模块601包括的多个计算设备可以分布在同一个VPC中,也可以分布在多个VPC中。其中,所述多个计算设备可以是服务器、ASIC、PLD、CPLD、FPGA和GAL等计算设备的任意组合。The multiple computing devices included in the acquisition module 601 can be distributed in the same region or in different regions. The multiple computing devices included in the acquisition module 601 can be distributed in the same AZ or in different AZs. Similarly, the multiple computing devices included in the acquisition module 601 can be distributed in the same VPC or in multiple VPCs. The multiple computing devices can be any combination of computing devices such as servers, ASICs, PLDs, CPLDs, FPGAs, and GALs.
需要说明的是,在其他实施例中,获取模块601可以用于执行交互资源的生成方法中的任意步骤,调整模块602可以用于执行交互资源的生成方法中的任意步骤,获取模块601和调整模块602负责实现的步骤可根据需要指定,通过获取模块601以及调整模块602分别实现交互资源的生成方法中不同的步骤来实现交互资源的生成装置的全部功能。It should be noted that, in other embodiments, the acquisition module 601 can be used to execute any step in the method for generating interactive resources, and the adjustment module 602 can be used to execute any step in the method for generating interactive resources. The steps that the acquisition module 601 and the adjustment module 602 are responsible for implementing can be specified as needed. The full functions of the interactive resource generation device are realized by respectively implementing different steps in the method for generating interactive resources through the acquisition module 601 and the adjustment module 602.
本申请还提供一种计算设备700。如图7所示,计算设备700包括:总线702、处理器704、存储器706和通信接口708。处理器704、存储器706和通信接口708之间通过总线702通信。计算设备700可以是服务器或终端设备。应理解,本申请不限定计算设备700中的处理器、存储器的个数。The present application also provides a computing device 700. As shown in FIG7 , the computing device 700 includes: a bus 702, a processor 704, a memory 706, and a communication interface 708. The processor 704, the memory 706, and the communication interface 708 communicate with each other through the bus 702. The computing device 700 can be a server or a terminal device. It should be understood that the present application does not limit the number of processors and memories in the computing device 700.
总线702可以是外设部件互连标准(peripheral component interconnect,PCI)总线或扩展工业标准结构(extended industry standard architecture,EISA)总线等。总线可以分为地址总线、数据总线、控制总线等。为便于表示,图7中仅用一条线表示,但并不表示仅有一根总线或一种类型的总线。总线702可包括在计算设备700各个部件(例如,存储器706、处理器704、通信接口708)之间传送信息的通路。The bus 702 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, FIG. 7 is represented by only one line, but does not mean that there is only one bus or one type of bus. The bus 702 may include a path for transmitting information between various components of the computing device 700 (e.g., the memory 706, the processor 704, and the communication interface 708).
处理器704可以包括中央处理器(central processing unit,CPU)、图形处理器(graphics processing unit,GPU)、微处理器(micro processor,MP)或者数字信号处理器(digital signal processor,DSP)等处理器中的任意一种或多种。Processor 704 may include any one or more of a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MP), or a digital signal processor (DSP).
存储器706可以包括易失性存储器(volatile memory),例如随机存取存储器(random access memory,RAM)。处理器704还可以包括非易失性存储器(non-volatile memory),例如只读存储器(read-only memory,ROM),快闪存储器,机械硬盘(hard disk drive,HDD)或固态硬盘(solid state drive,SSD)。The memory 706 may include a volatile memory, such as a random access memory (RAM). The processor 704 may also include a non-volatile memory, such as a read-only memory (ROM), a flash memory, a hard disk drive (HDD), or a solid state drive (SSD).
存储器706中存储有可执行的程序代码,处理器704执行该可执行的程序代码以分别实现前述获取模块和调整模块的功能,从而实现交互资源的生成方法。也即,存储器706上存有用于执行交互资源的生成方法的指令。The memory 706 stores executable program codes, and the processor 704 executes the executable program codes to respectively implement the functions of the acquisition module and the adjustment module, thereby implementing the interactive resource generation method. That is, the memory 706 stores instructions for executing the interactive resource generation method.
通信接口708使用例如但不限于网络接口卡、收发器一类的收发模块,来实现计算设备700与其他设备或通信网络之间的通信。The communication interface 708 uses a transceiver module such as, but not limited to, a network interface card or a transceiver to implement communication between the computing device 700 and other devices or communication networks.
本申请实施例还提供了一种计算设备集群。该计算设备集群包括至少一台计算设备。该计算设备可以是服务器,例如是中心服务器、边缘服务器,或者是本地数据中心中的本地服务器。在一些实施例中,计算设备也可以是台式机、笔记本电脑或者智能手机等终端设备。 The embodiment of the present application also provides a computing device cluster. The computing device cluster includes at least one computing device. The computing device can be a server, such as a central server, an edge server, or a local server in a local data center. In some embodiments, the computing device can also be a terminal device such as a desktop computer, a laptop computer, or a smart phone.
可选地,计算设备集群包括的至少一个计算设备的结构可参见图7示出的计算设备700。计算设备集群中的一个或多个计算设备700中的存储器706中可以存有相同的用于执行交互资源的生成方法的指令。Optionally, the structure of at least one computing device included in the computing device cluster may refer to the computing device 700 shown in Fig. 7. The memory 706 in one or more computing devices 700 in the computing device cluster may store the same instructions for executing the method for generating interactive resources.
在一些可能的实现方式中,该计算设备集群中的一个或多个计算设备700的存储器706中也可以分别存有用于执行交互资源的生成方法的部分指令。换言之,一个或多个计算设备700的组合可以共同执行用于执行交互资源的生成方法的指令。In some possible implementations, the memory 706 of one or more computing devices 700 in the computing device cluster may also store partial instructions for executing the method for generating interactive resources. In other words, the combination of one or more computing devices 700 may jointly execute instructions for executing the method for generating interactive resources.
需要说明的是,计算设备集群中的不同的计算设备700中的存储器706可以存储不同的指令,分别用于执行交互资源的生成装置的部分功能。也即,不同的计算设备700中的存储器706存储的指令可以实现获取模块和调整模块中的一个或多个模块的功能。It should be noted that the memory 706 in different computing devices 700 in the computing device cluster can store different instructions, which are respectively used to execute part of the functions of the interactive resource generation device. That is, the instructions stored in the memory 706 in different computing devices 700 can implement the functions of one or more modules in the acquisition module and the adjustment module.
在一些可能的实现方式中,计算设备集群中的一个或多个计算设备可以通过网络连接。其中,所述网络可以是广域网或局域网等等。图8示出了一种可能的实现方式。如图8所示,两个计算设备800A和800B之间通过网络进行连接。具体地,通过各个计算设备中的通信接口与所述网络进行连接。在这一类可能的实现方式中,计算设备800A和800B包括总线802、处理器804、存储器806和通信接口808。计算设备800A中的存储器806中存有执行获取模块的功能的指令。同时,计算设备800B中的存储器806中存有执行调整模块的功能的指令。In some possible implementations, one or more computing devices in the computing device cluster can be connected via a network. Wherein, the network can be a wide area network or a local area network, etc. FIG. 8 shows a possible implementation. As shown in FIG. 8 , two computing devices 800A and 800B are connected via a network. Specifically, the network is connected via a communication interface in each computing device. In this type of possible implementation, computing devices 800A and 800B include a bus 802, a processor 804, a memory 806, and a communication interface 808. Instructions for executing the functions of the acquisition module are stored in the memory 806 in the computing device 800A. At the same time, instructions for executing the functions of the adjustment module are stored in the memory 806 in the computing device 800B.
图8所示的计算设备集群之间的连接方式可以是考虑到本申请提供的交互资源的生成方法需要根据第一交互资源的展示获取互动意图信息,因此考虑将调整模块实现的功能交由计算设备800B执行。The connection method between the computing device clusters shown in Figure 8 can be considered to be that the method for generating interactive resources provided in this application needs to obtain interactive intention information based on the display of the first interactive resource, so it is considered to hand over the functions implemented by the adjustment module to the computing device 800B for execution.
应理解,图8中示出的计算设备800A的功能也可以由多个计算设备完成。同样,计算设备800B的功能也可以由多个计算设备完成。It should be understood that the functions of the computing device 800A shown in Figure 8 can also be completed by multiple computing devices. Similarly, the functions of the computing device 800B can also be completed by multiple computing devices.
本申请实施例还提供了一种通信装置,该装置包括:收发器、存储器和处理器。其中,该收发器、该存储器和该处理器通过内部连接通路互相通信,该存储器用于存储指令,该处理器用于执行该存储器存储的指令,以控制收发器接收信号,并控制收发器发送信号,并且当该处理器执行该存储器存储的指令时,使得该处理器执行交互资源的生成方法。The embodiment of the present application also provides a communication device, which includes: a transceiver, a memory, and a processor. The transceiver, the memory, and the processor communicate with each other through an internal connection path, the memory is used to store instructions, and the processor is used to execute the instructions stored in the memory to control the transceiver to receive signals and control the transceiver to send signals, and when the processor executes the instructions stored in the memory, the processor executes the method for generating interactive resources.
应理解的是,上述处理器可以是中央处理器(Central Processing Unit,CPU),还可以是其他通用处理器、数字信号处理器(digital signal processing,DSP)、专用集成电路(application specific integrated circuit,ASIC)、现场可编程门阵列(field-programmable gate array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者是任何常规的处理器等。值得说明的是,处理器可以是支持进阶精简指令集机器(advanced RISC machines,ARM)架构的处理器。It should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc. It is worth noting that the processor may be a processor supporting the advanced RISC machines (ARM) architecture.
进一步地,在一种可选的实施例中,上述存储器可以包括只读存储器和随机存取存储器,并向处理器提供指令和数据。存储器还可以包括非易失性随机存取存储器。例如,存储器还可以存储设备类型的信息。Further, in an optional embodiment, the memory may include a read-only memory and a random access memory, and provide instructions and data to the processor. The memory may also include a non-volatile random access memory. For example, the memory may also store information about the device type.
该存储器可以是易失性存储器或非易失性存储器,或可包括易失性和非易失性存储器两者。其中,非易失性存储器可以是只读存储器(read-only memory,ROM)、可编程只读存储器(programmable ROM,PROM)、可擦除可编程只读存储器(erasable PROM,EPROM)、电可擦除可编程只读存储器(electrically EPROM,EEPROM)或闪存。易失性存储器可以是随机存取存储器(random access memory,RAM),其用作外部高速缓存。通过示例性但不是限制性说明,许多形式的RAM可用。例如,静态随机存取存储器(static RAM,SRAM)、动态随机存取存储器(dynamic random access memory,DRAM)、同步动态随机存取存储器(synchronous DRAM,SDRAM)、双倍数据速率同步动态随机存取存储器(doubledata rate SDRAM,DDR SDRAM)、增强型同步动态随机存取存储器(enhanced SDRAM,ESDRAM)、同步连接动态随机存取存储器(synchlink DRAM,SLDRAM)和直接内存总线随机存取存储器(direct rambus RAM,DR RAM)。The memory may be a volatile memory or a nonvolatile memory, or may include both volatile and nonvolatile memory. Among them, the nonvolatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available. For example, static RAM (SRAM), dynamic random access memory (DRAM), synchronous DRAM (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct rambus RAM (DR RAM).
本申请实施例还提供了一种包含指令的计算机程序(产品)。所述计算机程序(产品)可以是包含指令的,能够运行在计算设备上或被储存在任何可用介质中的软件或程序(产品)。当所述计算机程序(产品)在至少一个计算设备上运行时,使得至少一个计算设备执行交互资源的生成方法。The embodiment of the present application also provides a computer program (product) containing instructions. The computer program (product) may be software or a program (product) containing instructions that can be run on a computing device or stored in any available medium. When the computer program (product) is run on at least one computing device, the at least one computing device executes the method for generating interactive resources.
本申请实施例还提供了一种计算机可读存储介质。所述计算机可读存储介质可以是计算设备能够存储的任何可用介质或者是包含一个或多个可用介质的数据中心等数据存储设备。所述可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如,DVD)、或者半导体介质(例如固态硬盘)等。该计算机可读存储介质包括指令,所述指令指示计算设备执行交互资源的生成方法。 The embodiment of the present application also provides a computer-readable storage medium. The computer-readable storage medium can be any available medium that can be stored by a computing device or a data storage device such as a data center containing one or more available media. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk). The computer-readable storage medium includes instructions that instruct the computing device to execute a method for generating interactive resources.
本申请实施例还提供了一种芯片,包括处理器,用于从存储器中调用并运行所述存储器中存储的指令,使得安装有所述芯片的通信设备执行如上任一所述的交互资源的生成方法。An embodiment of the present application also provides a chip, including a processor, for calling and executing instructions stored in a memory from the memory, so that a communication device equipped with the chip executes any of the above-described methods for generating interactive resources.
本申请实施例还提供另一种芯片,包括:输入接口、输出接口、处理器和存储器,所述输入接口、输出接口、所述处理器以及所述存储器之间通过内部连接通路相连,所述处理器用于执行所述存储器中的代码,当所述代码被执行时,所述处理器用于执行如上任一所述的交互资源的生成方法。An embodiment of the present application also provides another chip, including: an input interface, an output interface, a processor and a memory, wherein the input interface, the output interface, the processor and the memory are connected via an internal connection path, and the processor is used to execute the code in the memory. When the code is executed, the processor is used to execute any of the interactive resource generation methods described above.
在上述实施例中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时,全部或部分地产生按照本申请所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线)或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如,DVD)、或者半导体介质(例如固态硬盘Solid State Disk)等。In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in this application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive Solid State Disk), etc.
为了清楚地说明硬件和软件的可互换性,在上述说明中已经按照功能一般性地描述了各实施例的步骤及组成。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。本领域普通技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。In order to clearly illustrate the interchangeability of hardware and software, the steps and components of each embodiment have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. A person of ordinary skill in the art may use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
用于实现本申请实施例的方法的计算机程序代码可以用一种或多种编程语言编写。这些计算机程序代码可以提供给通用计算机、专用计算机或其他可编程的规则查找装置的处理器,使得程序代码在被计算机或其他可编程的规则查找装置执行的时候,引起在流程图和/或框图中规定的功能/操作被实施。程序代码可以完全在计算机上、部分在计算机上、作为独立的软件包、部分在计算机上且部分在远程计算机上或完全在远程计算机或服务器上执行。The computer program code for realizing the method for the embodiment of the present application can be written in one or more programming languages. These computer program codes can be provided to the processor of a general-purpose computer, a special-purpose computer or other programmable rule-finding device, so that the program code, when executed by a computer or other programmable rule-finding device, causes the function/operation specified in the flow chart and/or block diagram to be implemented. The program code can be executed completely on a computer, partially on a computer, as an independent software package, partially on a computer and partially on a remote computer or completely on a remote computer or server.
在本申请实施例的上下文中,计算机程序代码或者相关数据可以由任意适当载体承载,以使得设备、装置或者处理器能够执行上文描述的各种处理和操作。载体的示例包括信号、计算机可读介质等等。信号的示例可以包括电、光、无线电、声音或其它形式的传播信号,诸如载波、红外信号等。In the context of the embodiments of the present application, computer program codes or related data may be carried by any appropriate carrier to enable a device, apparatus or processor to perform the various processes and operations described above. Examples of carriers include signals, computer readable media, etc. Examples of signals may include electrical, optical, radio, acoustic or other forms of propagation signals, such as carrier waves, infrared signals, etc.
所属领域的技术人员可以清楚地了解到,为了描述的方便和简洁,上述描述的系统、设备和模块的具体工作过程,可以参见前述方法实施例中的对应过程,在此不再赘述。Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and modules described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
在本申请所提供的几个实施例中,应该理解到,所揭露的系统、设备和方法,可以通过其它的方式实现。例如,以上所描述的设备实施例仅仅是示意性的,例如,该模块的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个模块或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另外,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口、设备或模块的间接耦合或通信连接,也可以是电的,机械的或其它的形式连接。In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the module is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or modules, or it can be an electrical, mechanical or other form of connection.
该作为分离部件说明的模块可以是或者也可以不是物理上分开的,作为模块显示的部件可以是或者也可以不是物理模块,即可以位于一个地方,或者也可以分布到多个网络模块上。可以根据实际的需要选择其中的部分或者全部模块来实现本申请实施例方案的目的。The modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, that is, they may be located in one place or distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the embodiments of the present application.
另外,在本申请各个实施例中的各功能模块可以集成在一个处理模块中,也可以是各个模块单独物理存在,也可以是两个或两个以上模块集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。In addition, each functional module in each embodiment of the present application can be integrated into one processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or software functional modules.
需要说明的是,本申请所涉及的信息(包括但不限于用户设备信息、用户个人信息等)、数据(包括但不限于用于分析的数据、存储的数据、展示的数据等)以及信号,均为经用户授权或者经过各方充分授权的,且相关数据的收集、使用和处理需要遵守相关国家和地区的相关法律法规和标准。例如,本申请中涉及到的互动意图信息等都是在充分授权的情况下获取的。It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in this application are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions. For example, the interactive intent information involved in this application is obtained with full authorization.
本申请中术语“第一”“第二”等字样用于对作用和功能基本相同的相同项或相似项进行区分,应理解,“第一”、“第二”、“第n”之间不具有逻辑或时序上的依赖关系,也不对数量和执行顺序进行限定。还应理解,尽管以下描述使用术语第一、第二等来描述各种元素,但这些元素不应受术语的限制。这些术语只 是用于将一元素与另一元素区别分开。例如,在不脱离各种所述示例的范围的情况下,第一链路可以被称为第二链路,并且类似地,第二链路可以被称为第一链路。In this application, the terms "first", "second", etc. are used to distinguish the same or similar items with basically the same role and function. It should be understood that there is no logical or temporal dependency between "first", "second", and "nth", nor does it limit the quantity and execution order. It should also be understood that although the following description uses the terms first, second, etc. to describe various elements, these elements should not be limited by the terms. These terms are only It is used to distinguish one element from another element. For example, a first link could be referred to as a second link, and similarly, a second link could be referred to as a first link without departing from the scope of the various described examples.
还应理解,在本申请的各个实施例中,各个过程的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本申请实施例的实施过程构成任何限定。It should also be understood that in the various embodiments of the present application, the size of the serial number of each process does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
本申请中术语“至少一个”的含义是指一个或多个,本申请中术语“多个”的含义是指两个或两个以上,例如,多个第二报文是指两个或两个以上的第二报文。本文中术语“系统”和“网络”经常可互换使用。The term "at least one" in this application means one or more, and the term "multiple" in this application means two or more, for example, multiple second messages means two or more second messages. The terms "system" and "network" are often used interchangeably herein.
应理解,在本文中对各种所述示例的描述中所使用的术语只是为了描述特定示例,而并非旨在进行限制。如在对各种所述示例的描述和所附权利要求书中所使用的那样,单数形式“一个(“a”,“an”)”和“该”旨在也包括复数形式,除非上下文另外明确地指示。It should be understood that the terms used in the description of the various examples herein are only for describing specific examples and are not intended to be limiting. As used in the description of the various examples and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
还应理解,术语“包括”(也称“includes”、“including”、“comprises”和/或“comprising”)当在本说明书中使用时指定存在所陈述的特征、整数、步骤、操作、元素、和/或部件,但是并不排除存在或添加一个或多个其他特征、整数、步骤、操作、元素、部件、和/或其分组。It should also be understood that the term “comprise” (also known as “includes,” “including,” “comprises” and/or “comprising”) when used in this specification specifies the presence of stated features, integers, steps, operations, elements, and/or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
还应理解,根据上下文,短语“若确定...”或“若检测到[所陈述的条件或事件]”可被解释为意指“在确定...时”或“响应于确定...”或“在检测到[所陈述的条件或事件]时”或“响应于检测到[所陈述的条件或事件]”。It should also be understood that, depending on the context, the phrase “if it is determined that…” or “if [stated condition or event] is detected” may be interpreted to mean “upon determining that…” or “in response to determining that…” or “upon detecting [stated condition or event]” or “in response to detecting [stated condition or event]”.
应理解,根据A确定B并不意味着仅仅根据A确定B,还可以根据A和/或其它信息确定B。It should be understood that determining B based on A does not mean determining B only based on A. B can also be determined based on A and/or other information.
还应理解,说明书通篇中提到的“一个实施例”、“一实施例”、“一种可能的实现方式”意味着与实施例或实现方式有关的特定特征、结构或特性包括在本申请的至少一个实施例中。因此,在整个说明书各处出现的“在一个实施例中”或“在一实施例中”、“一种可能的实现方式”未必一定指相同的实施例。此外,这些特定的特征、结构或特性可以任意适合的方式结合在一个或多个实施例中。It should also be understood that the references to "one embodiment", "an embodiment", or "a possible implementation" throughout the specification mean that specific features, structures, or characteristics related to the embodiment or implementation are included in at least one embodiment of the present application. Therefore, the references to "in one embodiment" or "in an embodiment", or "a possible implementation" throughout the specification do not necessarily refer to the same embodiment. In addition, these specific features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
最后应说明的是:以上实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的保护范围。 Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the protection scope of the technical solutions of the embodiments of the present application.
Claims (16)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202310835116.6A CN119292489A (en) | 2023-07-08 | 2023-07-08 | Interactive resource generation method, device, equipment and computer-readable storage medium |
CN202310835116.6 | 2023-07-08 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2025011071A1 true WO2025011071A1 (en) | 2025-01-16 |
Family
ID=94150321
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2024/081311 WO2025011071A1 (en) | 2023-07-08 | 2024-03-13 | Interactive resource generation method and apparatus, and device and computer-readable storage medium |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN119292489A (en) |
WO (1) | WO2025011071A1 (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111813944A (en) * | 2020-09-09 | 2020-10-23 | 北京神州泰岳智能数据技术有限公司 | Live comment analysis method and device, electronic equipment and storage medium |
CN112423089A (en) * | 2020-11-19 | 2021-02-26 | 维沃移动通信有限公司 | Live broadcasting method and device |
CN113689253A (en) * | 2021-07-09 | 2021-11-23 | 广州华多网络科技有限公司 | Live scene order generation method and corresponding device, equipment and medium thereof |
CN113901226A (en) * | 2021-12-08 | 2022-01-07 | 阿里巴巴达摩院(杭州)科技有限公司 | Real-time live broadcast data processing method and computer storage medium |
CN114082198A (en) * | 2021-11-30 | 2022-02-25 | 完美世界(北京)软件科技发展有限公司 | Interaction method and device, storage medium, and electronic device in cloud game live broadcast |
CN115767204A (en) * | 2022-11-10 | 2023-03-07 | 北京奇艺世纪科技有限公司 | Video processing method, electronic equipment and storage medium |
-
2023
- 2023-07-08 CN CN202310835116.6A patent/CN119292489A/en active Pending
-
2024
- 2024-03-13 WO PCT/CN2024/081311 patent/WO2025011071A1/en unknown
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111813944A (en) * | 2020-09-09 | 2020-10-23 | 北京神州泰岳智能数据技术有限公司 | Live comment analysis method and device, electronic equipment and storage medium |
CN112423089A (en) * | 2020-11-19 | 2021-02-26 | 维沃移动通信有限公司 | Live broadcasting method and device |
CN113689253A (en) * | 2021-07-09 | 2021-11-23 | 广州华多网络科技有限公司 | Live scene order generation method and corresponding device, equipment and medium thereof |
CN114082198A (en) * | 2021-11-30 | 2022-02-25 | 完美世界(北京)软件科技发展有限公司 | Interaction method and device, storage medium, and electronic device in cloud game live broadcast |
CN113901226A (en) * | 2021-12-08 | 2022-01-07 | 阿里巴巴达摩院(杭州)科技有限公司 | Real-time live broadcast data processing method and computer storage medium |
CN115767204A (en) * | 2022-11-10 | 2023-03-07 | 北京奇艺世纪科技有限公司 | Video processing method, electronic equipment and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN119292489A (en) | 2025-01-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11223868B2 (en) | Promotion content push method and apparatus, and storage medium | |
US9936184B2 (en) | Code execution in complex audiovisual experiences | |
CN105701217B (en) | Information processing method and server | |
US10452250B2 (en) | Method for associating media files with additional content | |
WO2021238913A1 (en) | Method and apparatus for displaying live broadcast data, and device and storage medium | |
US20140188997A1 (en) | Creating and Sharing Inline Media Commentary Within a Network | |
US20150365359A1 (en) | Html5-based message protocol | |
US20190104325A1 (en) | Event streaming with added content and context | |
CN108259409A (en) | Information processing method, terminal and system | |
WO2015103636A9 (en) | Injection of instructions in complex audiovisual experiences | |
WO2024104423A1 (en) | Image processing method and apparatus, electronic device, and storage medium | |
KR102809069B1 (en) | Method and device for processing history browsing content, electronic device and storage medium | |
US20240298075A1 (en) | Data processing method and apparatus, computer device, and readable storage medium | |
US20230300183A1 (en) | Methods and systems for multimedia communication while accessing network resources | |
WO2023273692A1 (en) | Method and apparatus for replying to information, electronic device, computer storage medium, and product | |
CN113645472B (en) | Interaction method and device based on play object, electronic equipment and storage medium | |
CN112907703A (en) | Expression package generation method and system | |
CN117793478A (en) | Explain information generation methods, devices, equipment, media and program products | |
JP5624056B2 (en) | Method, apparatus and computer program for generating a query | |
JP2021534606A (en) | Synchronization of digital content consumption | |
WO2025011071A1 (en) | Interactive resource generation method and apparatus, and device and computer-readable storage medium | |
US20240281103A1 (en) | Interaction method and apparatus based on multimedia content, and device and storage medium | |
CN112543365A (en) | Method, device and equipment for playing media information and computer readable storage medium | |
JP2025521195A (en) | Text material acquisition method, device, equipment, medium, and program product | |
CN116600151A (en) | Live broadcast interaction method and device of live broadcast room and video live broadcast system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 24838332 Country of ref document: EP Kind code of ref document: A1 |