RU2764375C1 - Method for forming images with augmented and virtual reality with the possibility of interaction within the virtual world containing virtual world data - Google Patents

Abstract

FIELD: computing technology.

SUBSTANCE: invention relates to the field of information technology and computing equipment, in particular, to methods for collecting and processing information for modifying the virtual world. The technical result is achieved due to the fact, that the claimed solution involves the possibility of representing and for modifying audiovisual content containing three-dimensional objects, graphic objects, video and audio materials, wherein said modifications are entered in an indexed data array, and the visual element comprises information on the current achieved level of user impact on the object.

EFFECT: increase in the efficiency of using computing resources for modifying audiovisual content providing automation of processing and increase in the efficiency of collecting and processing user data for modifying audiovisual content with formation thereof using three-dimensional objects.

18 cl, 10 dwg

Description

FIELD OF TECHNOLOGY

The invention relates to the field of electrical engineering and information technology and computer technology, in particular to methods for collecting and processing information to change the virtual world by performing actions by users with the formation of images with augmented and/or virtual reality and to methods for generating images with augmented and/or virtual reality with the ability to change the virtual world through actions by users and depending on the information of users.

BACKGROUND OF THE INVENTION

From the prior art, a method is known that is performed by a computer in a network environment (network communications), containing a network service implemented by at least one server network node (see US20160342303A1, publ. 11/24/2016), which includes: linking a document with a network service virtual area; establishment by the network service of the corresponding presence in the virtual area for each of several communicators managing the respective nodes of the client network; control of the network service of collaboration on a document in real time by those of the communicators who are jointly present in the virtual area, while the control includes the provision of appropriate client data streams to generate the corresponding parallel representations of the document on the client network nodes of the communicators, performing operations on the document based on input streams data received from the respective client network nodes of the communicators regarding the document, and managing real-time communication between the client network nodes of those communicators that are jointly present in the virtual area.

The disadvantage of this solution is at least the inability to change the virtual world and its parts, including the impact on the presented content, as well as the limited ways and means of user influence on the presented content, including the inability to change content using third-party data, as well as no processing of data provided by users and used to change the virtual world.

A computer-implemented method is also known (see US20180189254A1, publ. 07/05/2018), including: obtaining by a computer system of detected information related to user-to-user interaction in a digital environment, aimed at a concept related to text content; and causing, by the computing system, to display at least a portion of the text content to the user in response to user interaction.

The disadvantage of this solution is at least the inability to change the virtual world and its parts, including the impact on the presented content, as well as the limited ways and means of user influence on the presented content, including the inability to change content using third-party data, as well as no processing of data provided by users and used to change the virtual world.

A method is also known from the prior art (see US10701077, published 06/30/2020), which comprises instantiating two or more virtual environments, a subset of which is defined as at least one of two or more virtual environments; determining one or more objects according to the protocol for the subset virtual environment; creating one or more scenes in a subset virtual environment; storage of data defining the scope of permission for each of the objects, scenes, subsets and virtual environments for the purpose of permission to provide or use with one or more other objects, scenes, subsets or virtual environments; implementing these permissions in a subset instance by restricting the ability of objects, scenes, subsets, and two or more virtual environments to interact consistent with the scope of permissions, where two or more virtual environments are allowed to require, allow, prevent, or in any combination, grant permission for scenes lower in the hierarchy, and scenes are allowed to require, allow, prevent, or a combination of them granting permissions to objects lower in the hierarchy; and the hierarchy within each subset is determined independently of the hierarchy within any other subset.

The disadvantage of this solution is at least the inability to change the virtual world and its parts, including the impact on the presented content, as well as the limited ways and means of user influence on the presented content, including the inability to change content using third-party data, as well as no processing of data provided by users and used to change the virtual world.

The present invention overcomes at least part of the above disadvantages or all of these disadvantages, as well as realizing the advantages of the present invention, as described within the scope of the present invention.

SUMMARY OF THE INVENTION

The technical result achieved by the invention is to increase the efficiency of the use of computing resources to change the audiovisual content with the automation of processing and increase the efficiency of collecting and processing user data to change the audiovisual content with its formation using three-dimensional objects.

According to one of the implementation options, a method is proposed for collecting information for changing audiovisual content in real time with the formation of audiovisual content with the processing of user-provided data, in which: the central data processing server receives data from at least one service server, configured at least presentation to the user of audiovisual content containing at least three-dimensional objects, graphic materials in the format of images, video recordings and visual effects and audio materials, and made with the possibility of changing the audiovisual content presented to the user by the user at least using interface elements of such a service, data associated with users and associated with user actions and stored in at least one associated with at least one such service server, data store, where data associated with user actions does not include user interaction data with interface elements aimed at changing the audiovisual content presented to the user, and where user-related data includes user data received by at least one service server from at least one user computing device or a third server and / or provided by the user using the user's computing device or by a third server to the service server by entering data using at least one data input means and stored in at least one data store associated with at least one service server, where such user-related data contains data in a text , graphic, and/or audio data formats; the formation by the central data processing server of a database of text fragments with their corresponding predetermined changes in audiovisual content is carried out, while the database of text fragments is stored in the data warehouse of the central server; the identification by the central data processing server in the received data of user actions aimed at changing the audiovisual content by the user is carried out, and the formation by the central data processing server of an array of control signals is carried out, in which one or more elements of the control array corresponds to a predetermined control signal so that the values of the indexes of the control array correspond to a predetermined change in the audiovisual content, where the predetermined change in the audiovisual content is at least a change in the values of the parameters of the geometry of the object of the audiovisual content, and/or a change in the coordinates of the location of the object, and/or a change in the color of the object, and/or the addition of graphic materials to the audiovisual content, and / or adding a visual effect with execution: matching the fragments of text contained in the received data with fragments of text from the database fragment text ov with adding a control signal corresponding to the change in the audiovisual content in the format of at least one value corresponding to the control signal to the array of control signals in case at least one matched text fragment from the received data matches the text fragment stored in the text fragments database; search in the received data for information corresponding to user interaction with a specific element of the service interface corresponding to the predefined change in audiovisual content, adding a control signal corresponding to the change in audiovisual content to the array of control signals if such information is detected; the formation by the central data processing server of at least one visual element is carried out, which determines at least one level of user influences aimed at at least one change in the audiovisual content, specified by user interactions, data about which are received by at least one service server from at least one element of the service interface and / or provided by the user using the user's computing device or from a third server to the service server, where, upon reaching at least one of the preset levels, at least one of the parts of the audiovisual content is changed, and the visual element contains information about the current achieved the level of user impact on the change in the audiovisual content and information about the level upon reaching which the change in the audiovisual content will be carried out, and is presented to at least one user; at least one part of the audiovisual content is changed: with the formation and placement of a visual effect in predetermined coordinates in virtual space with the corresponding values of the visual effect parameters using the value of the corresponding index of the control array; and/or changing at least one parameter of at least one virtual space object using the value at the corresponding index of the control array; presentation of the modified audiovisual content is carried out by at least one computing device.

In one of the private implementation options, the central data processing server converts the received audio-video recording with the formation of at least a video recording; the central data processing server converts the received data in text format by at least one service server from at least one user computing device or a third server and / or provided by the user using the user computing device or a third server to the service server by entering data using at least at least one input means into at least one image; the central data processing server receives graphic materials in the format of images, video recordings, and / or audio-video recordings, and / or audio recordings from at least one user computing device or a third server and / or provided by the user using the user computing device or a third server to the service server through entering data using at least one data entry means; a video texture is formed by the central data processing server, containing at least one video recording and/or containing at least one image from the received graphic materials, and/or at least one generated visual element that determines the level of user impact, and/or at least one image generated from data in text format; the formation of a video texture by the central data processing server is carried out, containing at least one video recording and / or at least one image, and / or at least one visual element located in it, which determines the level of user impact, where the dimensions of the video texture, video recordings, images and visual elements that determine the level of user impact, vertically and horizontally in pixels, are set by the central data processing server, and the dimensions of the video texture, videos, images and visual elements that determine the level of user impacts, vertically and horizontally in pixels, are set by the central data processing server so that the placed in the video texture of video recordings, images and visual elements that determine the level of user impact occupied the maximum area of the video texture, leaving the minimum size of unoccupied video recordings, images and visual elements that determine the level of user actions, video texture areas; the formation of a pixel UV map by the central data processing server is carried out, containing the correspondence of UV coordinates on the surfaces of three-dimensional objects of virtual space to coordinates on the video texture, and determining the placement of at least part of at least one video recording, image, visual element that determines the level of user impact, video texture at least one object of virtual space in accordance with the placement of at least one video, image, visual element that determines the level of user impact, in the video texture; at least one part of the audiovisual content is changed with the placement of at least one part of the video texture on at least one three-dimensional object of the virtual space of the audiovisual content in accordance with the pixel UV map data, and the generated audiovisual content is presented with changes by at least one computing device .

In one of the private implementation options, the data received by the central data processing server contains information about the number of user ratings, the number of comments on messages, a marker of whether the message is private or public, a link to the message, the message type with specified parameters, with the corresponding text fragments identifying them, compared to text snippets in the text snippet database, and a message-id name to set for each message.

In one of the private implementation options, transactions are registered, each of which refers to the expression of the attitude of one user to a content event or refers to a change in content, while unique identifiers of data blocks are registered, while each of the transactions of one data set is initiated by the user and contains a user identifier and event details.

In one of the private implementation options, the central server receives a message about a financial transaction associated with a change in audiovisual content, and containing a sign of transaction registration and transaction data, and the said transaction data contains a personal account identifier and the amount of the transaction, and the level of user impact is changed, as function of the transaction amount.

In one of the particular implementation options, the identification in the received data of information related to the change in audiovisual content and the comparison of the text fragments contained in the received data with text fragments from the database of text fragments, and the search in the received data for information corresponding to user interaction, is carried out by the parser using the protocol DMX, and in order to receive data, the parser sends requests to at least the API of websites, and / or user interaction services, and / or monetization services and / or receives data on a POST / GET request, via an established WEB SOCKET connection, and / or in a message over TCP/UDP.

In one of the private implementation options, when setting a user action aimed at changing the audiovisual content corresponding to: changing the color of the virtual space object, the values corresponding to the color selected by the user are stored in the control array; changing the location coordinates of the virtual space object, the new coordinates of the object in the virtual space are stored in the control array; changing the shape of the virtual space object, the new coordinates of the object's vertices in the virtual space are stored in the control array; adding at least one visual effect of the virtual space, the values corresponding to the selected special effect and the parameters of such a special effect are stored in the control array.

In one of the private implementation options, visual effects are special effects, including fireworks, implemented by a particle system in virtual space.

In one of the private implementation options, the service is an online store, a social network, or a service provided by an application running on the user's computing device.

In one of the private implementation options, the data provided by users includes registration data in the service, made at least with the possibility of presenting the audiovisual content to the user and made with the possibility of changing the audiovisual content presented to the user by the user and including at least the first name and/or surname and/or patronymic, and / or date of birth, and / or age of the user, and / or user name displayed in the service, and / or an image that is a graphical representation of the user in the service, and / or user profile data in the service.

In one particular embodiment, the audiovisual content presented to the user is formed and/or modified in a virtual environment formed from at least three-dimensional objects, graphic materials in image and video format, visual effects and audio materials.

In one of the particular implementation options, changing the audiovisual content presented to the user is at least changing the properties of the objects presented to the user of the audiovisual content, where the properties of the audiovisual content objects are at least the coordinates of three-dimensional objects, the coordinates of the vertices of three-dimensional objects, the color, shape, geometry, location, transparency of three-dimensional objects and/or visual effects and/or images and/or video recordings.

In one of the private implementation options, data is received by the central data processing server in response to a request for such data by the central data processing server or according to a predetermined schedule, instructions for which are stored on the user interaction service server, or in response to user actions.

In one of the private implementation options, the video texture is an image generated in real time with a preset frame rate per second, which is transmitted to the virtual space using the video texture exchange protocols NDI, SPOUT, RTSP, RTMP, SRT SDI, Memory sharing, using image capture by cameras, using camera video capture and/or web page capture and which is applied in virtual space to predetermined objects, changing the visual component of the audiovisual content for presentation to the user.

In one of the particular implementation options, the data associated with changes in the audiovisual content is extracted from the data received from the service server, and the selected data is converted into the format of at least one message.

In one particular implementation, the message is a JSON message.

In one of the private implementation options, all users who are presented with audiovisual content are notified by adding data provided by the user in image, video and/or text format to the audiovisual content.

In one of the private implementation options, at least two or all users are presented with at least two levels, upon reaching each of which at least one of the parts of the audiovisual content is changed, so that users can observe each of the levels and perform actions, aimed at achieving one or another level in order to change the desired part of the audiovisual content.

BRIEF DESCRIPTION OF GRAPHICS

FIG. 1 illustrates an exemplary overall diagram of a system implementing the present invention, according to one embodiment of the present invention;

FIG. 2 illustrates one embodiment of a system implementing the present invention, according to one embodiment of the present invention;

FIG. 3 illustrates one of the options presented to the user content, according to one of the embodiments of the present invention;

FIG. 4 illustrates one embodiment of the scheme for implementing the present invention, including the operation of an embodiment of a system implementing the present invention;

FIG. 5 illustrates a block diagram of one of the options for the process of processing user actions and generating a response of a system that implements the present invention;

FIG. 6 illustrates an exemplary video texture generation according to one embodiment of the present invention;

FIG. 7 illustrates an exemplary virtual world modification by changing the color of light emitted by lighting fixtures in the virtual world, according to one embodiment of the present invention;

FIG. 8 illustrates an exemplary variant of the generated content for presentation to the user with the placement of parts of the generated video texture and an activated effect, according to one embodiment of the present invention;

FIG. 9 illustrates a block diagram of an exemplary embodiment of the present invention;

FIG. 10 illustrates an example of a general purpose computer system.

DESCRIPTION OF EMBODIMENTS

The objects and features of the present invention, methods for achieving these objects and features will become apparent by reference to exemplary embodiments. However, the present invention is not limited to the exemplary embodiments disclosed below, but may be embodied in various forms. The gist of the description is nothing but specific details provided to assist a person skilled in the art in a thorough understanding of the invention, and the present invention is defined only within the scope of the appended claims.

As used in this specification, the terms "module", "component", "element", "part", "unit", "component" and the like are used to refer to computer entities that may be hardware, such as a device or part of a device. , in particular, including at least one processor, microcontroller, etc., or software, for example, a computer program, "firmware" (from English firmware), etc., allowing the computer system hardware to perform calculations or control functions, which are a combination of instructions and data.

FIG. 1 shows an exemplary embodiment illustrating an exemplary general scheme of a system implementing the present invention, according to one embodiment of the present invention.

A system that implements the method (or at least one part of the method) described in the framework of the present invention, an exemplary version of which is shown in FIG. 1 contains servers of user interaction services 120 that contain user data received by such servers and transmitted to such servers data (information) by computing devices, for example, computing devices of users, other servers, etc. So, for example, on such servers of user interaction services 120 can be installed (on such servers of user interaction services 120 can be deployed) and operate social networking services, data (information) exchange services, including text, audiovisual data, etc., those. such user interaction service servers 120 may be social networking servers, messaging service servers, forum servers, hosting services such as video hosting sites, etc., including services where users can post information (e.g., in a message format), and Express your attitude to events (and content, in particular, content containing data in digital data format), including those related to at least one user. Thus, the mentioned events may be the placement of audio data, video data, audio-video data in the format of recordings or live broadcasts, including those transmitted and placed in the format (method, method) of streaming data (in particular, in the "stream" format - from English. stream - stream).

The user interaction services servers 120 transmit data stored in or part of the data stores associated with the user interaction services servers 120 in response to a request for such data from the central data processing server 150 , in particular in response to a request from the data acquisition unit 160 , or on a predetermined schedule, the instructions for which may be stored on the user interaction services servers 120 , or in response to actions by at least one user, such as an administrator, of at least one user interaction services server 120 . For example, the data transmitted from the servers of user interaction services 120 may include information about user actions and data posted by users. Thus, the information transmitted from the servers of the user interaction services 120 may be the number of expressions of the attitude of one user to an action, a posted message, etc. another user, for example, the number of “likes” (from English like - like) users for the posted message (published post), comments, the number of user interactions with the presented elements, for example, the number of clicks on the button with the answer option during live voting (live -golosovanii), not only for action in social networks, and, for example, pressing the buttons website etc.

Shown in FIG. 1, the system also includes a central data processing server 150 to which data is transmitted for processing and for generating content to be presented to users, and which generates content to be presented to users.

The central data processing server 150 contains a data acquisition unit 160 that receives data at least about user actions (liked, donated, clicked on a button on a website, left a comment, etc.), in in particular, which transmits a request to receive data from at least the servers of user interaction services 120 , the servers of websites 110 . So, for example, to request the number of "likes", the data retrieval block 160 sends a request, for example, a json request (request in JSON format), to the post link. Said requests can be sent to obtain: the number of user interactions, for example, the number of ratings (likes) and/or comments, information about the user who performed the action (interacted, etc.). The exchange of information can occur not only through API requests, but also by receiving (simple receiving) data on the server. For example, communication can be established via TCPIP / UDP / WEBSOCKET (if, for example, data is received from a website, in particular, the backend (from the English back-end) of the website, in particular, with which (on which and so that the data acquisition block 160 may contain software, for example, in the Python programming language, which, using a software component (module), for example, a software library, can send an API request, at least to one server of at least one service, for example, sends a request to receive data from the servers of user interaction services 120 , website servers 110 , audio-video data servers 130. So, for example, in response to a request for the number of "likes" can be sent json-request by the link of the post by the data receiving block 160 to at least one of the servers of user interaction services 120 , in response to which the corresponding server from the servers of the service to user interactions 120 sends data containing at least the number of requested “likes”, as well as data related to “likes”, for example, information about the message, information about users who rated the message, including from personal accounts, profiles etc. users, time of ratings ("likes"), etc. A json request can also be sent in response to a request for the number of comments. In a particular case, a request may be sent containing a combined request, assuming the return of a combined response, for example, one request may contain a request for the number of likes and the number of comments, the time of comments, the user (information identifying the user, for example, user ID, user name, user alias etc.), which in one way or another interacted with the message, including its placement (publication, transmission, etc.), for example, posted, marked, commented, rated, etc. So, for example, a response to an API request (from English - application programming interface - application programming interface) can be sent by one of the servers of user interaction services 120 in one of the well-known data storage and transmission formats, for example, in text format, for example, in JSON format (JavaScript Object Notation), for example, in json string format. For example, the data transmitted by one of the user interaction services servers 120 and received by the data acquisition unit 160 may include data in the form of {number of likes=150} or {link to user avatar=liked} or {username=started fireworks} or { username=clicked the button}, for example, ({"post": "we1", "type": "post info", "url": "https://www.instagram.com/p/11111111111/", "is_private": false, "likes": 150, "count_comments": 0, "end_action_time": "2020-08-25 12:06"}'), where

- "likes": 150 - the number of likes (150) of the message (under the placed "post");

- "count_comments": 0 - the number of comments on the message (under the placed "post");

- "is_private": false - a marker of whether the message is private (private) or public (public);

- "url": https://www.instagram.com/p/CDpLEs1DbBF/ - link to the post;

- "post": "we1" - name-identifier of the publication post, which is set in the parser and can be used to identify the post (publication),

- "type": "post info" - setting the post type with parameters, for example, "post info" - information about the post, "comment" - comment, "like" - like (rating), etc.

- "end_action_time": "2020-08-25 12:06" – date (and time) when parsing of the current post ends.

Also, the data transmitted by one of the user interaction services servers 120 and received by the data acquisition unit 160 may include data in the form {'name':'Alexander', 'registration':'yes'}, i.e., for example, information may come about registration ('registration':'yes') of a user named "Alexander"('name':'Alexander') on the website to which the broadcast is attached, which is also processed as described in the framework of the present invention; or in the form {'currency':'75.434'}, i.e., for example, information about the exchange rate ('currency':'75.434'), for example, the dollar, etc., can come (be received), moreover, on the basis of such received data, the scene can be changed, for example, graphics, inside the virtual world (space, environment).

So, for example, at least one software library (from the English library) can be used, which allows you to interact with applications, for example, web applications, to transfer information from one computing device to another computing device, including exchanging information between servers, for example, between the central data processing server 150 (in particular, the data acquisition unit 160 of the central data processing server 150 ) and the monetization service servers 115 , website servers ( 110 ), user interaction services servers 120 , etc. To request the amount of money transferred by users (for example, “donates”, from the English donate - donate, donate), the data receiving block 160 sends an API request, for example, in the json request format, to at least one of the servers monetization services 115 . So, for example, in response to a request for the amount of transferred funds by at least one user, at least one (other) user can be sent a json request by the data receiving block 160 to at least one of the monetization service servers 115 , in response to which the corresponding monetization service server server 115 sends data containing data on new incoming funds, as well as related data, for example, information about the content for which the transfer of funds was made, information about users who made a transfer, including from personal accounts, profiles, etc. users, time of transfers ("donations"), etc. So, the identification is transmitted (arrives, arrives) in the request itself, i.e., in a particular case, it is contained in the request itself. For example, if "Donation Alerts" is used, then the first and last name of the user (in particular, "donator") is displayed in the response to the request. If the means of the payment system are used, then the user's first and last name is also transmitted to the central data processing server 150 after a request or automatically when passing (receiving, confirming) payment. For example, a response to an API request (from English - application programming interface - application programming interface) can be sent by one of the servers of the monetization services 115 to the data acquisition unit 160 in one of the well-known data storage and transmission formats, for example, in text format, for example, in JSON format (JavaScript Object Notation), for example, in json string format. For example, the data responses sent by the monetization service servers 115 and received by the data acquisition unit 160 may include data in the form (format) {'name':'Alexander', 'item':'Firework', 'cur':'USD' }, where 'name' is a nickname (from the English nickname) or a name, identifier, etc. user, 'item' - the object acquired (purchased) by the user, 'cur' - the currency in which the purchase was made, i.e. in this example, on the store's website, a user with the nickname "Alexander" bought "Fireworks" in the "Dollar" currency. This example contains an exemplary version of data (information) about making a purchase, which can be transmitted to the central data processing server 150 .

So, at a specified interval, for example, every five seconds, the data receiving unit 160 sends an API request to at least one of the monetization service servers 115 , in response to which the monetization service server server 115 that received the request returns a json string with new donations (donations), username and amount, which are transmitted by the data receiving unit 160 to the data processing unit 170 via one of the data transfer protocols, for example, via the TCP/IP protocol.

Also, for example, at a specified interval, the data receiving unit 160 sends an API request to at least one of the website servers 110 , in response to which one of the website servers 110 that received the request returns a json string with elements, with which the user interacted, for example, identifiers (names, etc.) of elements placed on the web pages of websites, for example, soft buttons, text fields, etc., and actions corresponding to such elements can also be transmitted web pages, for example, a purchase has been made, which are transmitted by the data acquisition unit 160 to the data processing unit 170 via one of the data transfer protocols, for example, the TCP/IP protocol. Also, when the user interacts with the elements of the web page, for example, when the user selects (clicks, touches, etc.) a soft button on the web page, the website tools transmit a GET request to the central data processing server 150 , in in particular, to the data receiving block, for example, to the parser, in particular, thereby signaling that the user interacted with the site element, in particular, the soft button was pressed. Further, the data of such user interaction is transmitted to the data processing unit 170 , for example, using the TCP/IP protocol. So, on the website, the user can:

- interact with the elements presented to it (in particular, graphic ones), for example, by pressing a soft button, which either causes (including immediately) the execution of an activity (in particular, the button either immediately sets the activity into action, for example, starts fireworks), or when interacting with at least one presented element, the activity becomes available for performing actions with it (in particular, when a button is pressed, this activity can be purchased, such activity can be purchased, etc.);

- enter information (using at least one means, device, etc. data entry), for example, in a text field, which will be transmitted to the central data processing server 150 . So, for example, such input data can be comments for a certain type of activity. So, for example, an activity can be an inducement of the user to an action that activates a predetermined functionality, for example, an activity can be the following: write your wish and it will appear on the LED screen. In the text field (text field, field for entering information) on the website, the user enters "Happiness" and clicks on the button to start (purchase, purchase) activity. Further, this data is transmitted to the central data processing server 150 (and obtained by at least one block, for example, data acquisition block 160 ), for example, in the form (format) {'text':'Happiness', 'name':'Alexander'}, i.e. user Alexander bought an activity and wrote the text "Happiness" in it. Further, such data is further processed by the central data processing server 150 (at least one of its blocks, in particular, the data processing block 170 ) and converted (including added) into a video texture, for example, and displayed on an LED screen in virtual 3D the world behind the presented user (artist);

- write comments in the chat, which, for example, are transmitted (in particular, broadcast) via websocket (WEBSOCKET) to the central data processing server 150 in the form of {'comment':'This is my comment'}, which are then presented at least one user (including chat);

- vote and choose from the provided (and presented) options. For example, the user may be presented with two soft buttons "red" and "blue" for selection. Data on the number of interactions of the user with the presented elements, in particular on the number of clicks on the soft buttons, can be counted on the website backend (counted by the website tools) and transmitted, in particular, to the central data processing server 150 , in the form {'red ':'20' , 'blue':'70'}, i.e. twenty users voted for red, and seventy voted for blue. Further, such received data is processed and added (embedded) as described in the framework of the present invention (using appropriate logic) to the control array. For example, a vote was launched for the color of the sky. The blue color won (for example, the most users voted for it). The RGB number of the blue color (0,0,1) is written to the corresponding place (position) in the control array, then the implementation of obtaining such data and applying them to the color of the sky, as described in the framework of the present invention. Or data about pressing (for example, the fact of pressing) on the soft button can be transmitted to the central data processing server 150 (and received by the data acquisition unit 160 ) and processed (in particular, counted) by means of the central data processing server 150 , for example, by the processing unit data 170 .

In a particular case, the data acquisition block 160 includes a parser, in particular, a parser (from the English parser, parse - analysis, parsing) that accesses data sources on the servers of the monetization services 115 , the servers of user interaction services 120 , etc., for example , to web pages, services (as well as websites, servers, etc.) of weather, sports (providing scores for matches, for example) services, exchange rates, etc., and analyzes, in particular, "parse" data, such as activity, likes, comments, etc., received from data source servers, for example, in the format of a JSON string ({"post": "we1", "type": "post info", "url" : "https://www.instagram.com/p/11111111111/", "is_private": false, "likes": 150, "count_comments": 0, "end_action_time": "2020-08-25 12:06"}').

Thus, the block for obtaining data 160 may include the "Requests" software library, using which an API request is transmitted to at least one server of at least one service, for example, sends a request to receive data from the servers of user interaction services 120 , website servers ( 110 ), user interaction services servers 120 .

The data processing unit 170 , using the received data, forms an array of control signals, in particular, forms (generates) an array of data, for example, in the format [number, number, number, number, number, ...], in particular, in the video texture format (video -textures). Such an array can include both numbers and text, such as [number, word, number, number, number, word]. Each position (in particular, index) in the array corresponds to a specific control signal, and a specific location (position) in the array corresponds to a specific control signal.

Thus, as described in the framework of the present invention, the data processing unit 170 generates two types of signals:

1) An array of numbers;

2) Video texture.

The video texture contains pixels in a predetermined (defined) resolution (and may vary depending on the current project, the resolution of the source image, the required image resolution, etc.), which form various images (for example, user avatars, comment text , video files, etc.). In a particular case, a video texture is an image generated in real time with a certain frame rate per second, which can contain variously located parts of the image (likes in one specified area, video files in another specified area, video files in the third specified area - generative video texture with comments, etc./), which is then transferred to the 3D world via video texture exchange protocols (for example, NDI, SPOUT, RTSP, RTMP, SRT, "sharing" (from the English "to share" - to share ) by a block of RAM, etc.) and which is applied inside this 3D world to predetermined (defined) objects, as a result of which the formation (with further presentation), for example, of a virtual screen (for example, an LED screen) with avatars ( avatars) of users, in particular, images that are graphical representations of users.

The control signal in a particular case may correspond to (or include data corresponding to) at least one of the activities (in particular, an action, an effect, an object, including a three-dimensional virtual space, etc.), including those in encoded format that can be added to audio-video data, in particular, to an audio-video signal, forming the content presented to the user. So, for example, the value of the "word" in the array can be the word "FIREWORKS", corresponding to the control signal "Fireworks", and the numbers can be equal, for example, "1", "2", "22", etc., where each number corresponds to a certain activity, for example, the number "1" corresponds to the control signal "Special effect", for example, "Fireworks", "Lighting", etc.

So, for example, the user can interact with elements of the content presented to him, for example, with soft buttons, virtual world objects, including three-dimensional objects, etc., including a three-dimensional scene, etc., which is presented to the user, for example , a web page on a website, in an app, etc. So, for example, the soft button corresponding to the launch of fireworks in the three-dimensional world is located at index number 2 (two) in the array of data, in particular, in the array of signals (control signals), so that the array of signals looks like this "[number, number , FIREWORKS, number, number....]", then a message like "{username=fireworks}" will be received by the data acquisition unit 160 , in particular, for example, if one of the users has interacted with the element corresponding to the launch of fireworks, for example, Pressed the "Fireworks" softkey. Also, any actions, user activities (inputs - from English input input), data about which are transmitted to the data acquisition block 160 (in particular, from servers of user interaction services 120 ), then any such "input" can be associated with at least the corresponding control signal, for example, with the launch of fireworks, for example, if the user left a comment "Fireworks" (Fireworks) under a message in a social network, for example, "VKontakte", etc.

The data processing block 170 receives a message from the data receiving block 160 containing inputs, for example, in the format {username=comment} (for example, in the form {Denis=Fireworks}). The data processing unit 170 compares the received inputs, in particular the contents of the inputs, for example, the received comment, in particular the value of the field (variable, etc.) of the received comment, with the possible values stored (for example, in the data store of the central data processing server 150 ) for the given field (variable) (for example, if the comment value is "Fireworks" or "FIREWORKS", or "fireworks", etc., if comment == 'Fireworks'). And if the condition is true (satisfied, worked), then the data processing unit 170 writes the signal to the corresponding (desired) position, in particular, to the desired array index. So, for example, if no user starts fireworks, then the number at the second index in the array (the number with (sub)index "2") is zero ("0") when at least one of the users has started fireworks, then the number under the index "2" is equal to one ("1"). The array in this case looks like this: [number, number, 0, number] - for the case without fireworks (when the fireworks are not fired), and [number, number, 1, number] - for the case when the user performed the desired action (for example, left a comment of a certain kind, rated (liked) a certain post, clicked on a button on a website, etc.) and set off fireworks. In a particular case, the array can be of any length (in particular, the length can be limited, for example, by the maximum size of the array of the data type used), including its size can change dynamically and contain different triggers [fireworks, particle system launch, the color of something, the size of the object....], where the trigger is the fulfillment of a condition. For example, if the number of likes under the post is more than fifty, then the trigger fires, i.e. the condition is met and this entails a predetermined reaction (eg favorite fireworks, etc.). Next, the control array (video texture) is passed to the content generation unit 180 . The array (control array) can be transferred from the data processing unit 170 to the content generation unit 180 via a network protocol (including as a message over TCP/IP, UDP, Socket, DMX, OSC, etc.), including if the block data processing unit 170 and content generation unit 180 are servers (both software and hardware), various computing devices, programs (applications), etc. In a particular case, the blocks described in the present invention (for example, a data acquisition unit 160 , a data processing unit 170 , a content generation unit 180 , etc.) can be servers (software, hardware), various computing devices, programs (applications) and etc.

In a particular case, if you want to change a three-dimensional (3D, 3D) object in the presented content (in particular, generated by the content generation unit 180 ), for example, a three-dimensional object (3D object, 3D object, 3D object, 3D object) grew, for example , from at least one particular action (interaction) of at least one user, for example, depending on the number of user likes, then the data processing unit 170 records the number received in at least one message from data acquisition block 160 , into the array at the appropriate index (at the corresponding position in the array), for example, at array index "4", then the content generator 180 receives the value for such an index in the array (which in particular is transmitted to the content generator 180 data processing unit 170 ), in particular, the content generation unit 180 subtracts ("pulls out") the value of this index and writes to the size parameter of the 3D object.

In a particular case, when data is transmitted by the data acquisition block 160 to the data processing block 170, a “node” is created that opens a TCP connection.

At least one part of the data processing unit 170 , in particular, part of the functionality of the data processing unit 170 may be implemented (or may be used) by the TouchDesigner software component (in particular, the TouchDesigner tools). So, for example, a functionality that opens a TCP server, a functionality for creating a widget, a functionality for filling a filled visual element (for example, a circle), etc. can be used.

So, for example, in the TouchDesigner environment (a visual platform for developing interactive media systems; based on nodes, ready-made logical blocks, a solution that uses a visual programming language to create applications, interactive installations, virtual reality), a block (in particular, a module) can be used , which opens the TCP server in a software (in particular, software-hardware) way, for example, using a software (hardware-software) module, for example, using the “tcpinDAT” module (in the program). Also, a node can be used that creates a TCP client for data transfer. The mentioned block and node can be implemented not only using the TouchDesigner environment, but also separately (or together with it) in one of the well-known programming languages, for example, Python and any other programming languages and programs. In a particular case, the data processing unit 170 establishes a connection between the data receiving unit 160 and the data processing unit 170, and the data processing unit 170 waits for a connection on a predetermined port (listening to a port), in particular, on one of the available ports, for example, on the port "5000".

After the connection is established and the data from the data acquisition block 160 is received by the data processing block 170 containing data on user actions, data related to messages, including in social networks, with the user, from user personal accounts, etc. , for example, with the number of likes under the message (post), etc., for example, in the json-string format, for example, in the form mentioned above ({"post": "we1", "type": "post info", "url": "https://www.instagram.com/p/CDpLEs1DbBF/", "is_private": false, "likes": 150, "count_comments": 0, "end_action_time": "2020-08-25 12 :06"}'), the value of at least one of the parameters, for example, the number of likes, is obtained (subtracted), and using the obtained value, audio-video data is generated (generated), for example, in the format of an audio-video signal or a DMX signal (depending on on how the widget is obtained ) , which is a widget, where the widget is a visual element that displays in yourself information. For example, if there is an activity "get 400 likes", then the widget can be (including contain) a filling visual element, for example, a circle (ring, etc.). The type and format of the widget is determined by the artistic task for a certain activity. So, such a generated (generated) signal (DMX or (audio) video signal) mentioned in this case, in a particular case, is a visual element generated by the data processing unit 170 and added by the content formation unit 180 to the presented content. Such a visual element, in particular, an interactive visual element, an element with which the user can interact, for example, a graphical user interface element, may be a circle that is filled (by the content generator 180 ) from the number of likes. Such a widget is added to the presented content (broadcast), for example, as a separate layer, in particular, on top of the screen, in particular, as a layer on top of the video. So, for example, a widget is overlaid on top of the broadcast with a filling (filled) visual element. Also, such a widget can be embedded in a video texture and displayed inside a virtual 3D world. In a particular case, the 3D scene of the 3D space of the presented content, or at least one part of the 3D scene, for example, a 3D object, can be changed (boosting" or improving the 3D scene) depending on at least one of the parameters, for example , on the number of likes.For example, for a 3D scene, the number of states (improvement levels) is set (by the user, administrator, developer), i.e. The 3D scene has several preset enhancement levels: the first level is an empty scene, the second level is with added lighting (lights turn on), third level - with added decorations (decorations turn on), fourth level - with visualized people added (crowd of people appears) As soon as a given level of user actions is reached, for example, as soon as fifty likes are typed under the post, the trigger fires (for example, if there are more than fifty likes, then press the button: if likes>50: push the button) data processing block 170. After When such a trigger of data processing units is triggered, formation (generation) is carried out in an array, in particular, in a DMX array, at the corresponding (defined) index of the signal array, and the generated array (DMX array) is transferred to the content formation unit 180 . Next, the content generation unit 180 reads the value at the corresponding array index and performs the corresponding action, for example, the light is turned on (in particular, the value of the light source intensity parameter changes from one value, for example, equal to zero ("0"), to another value , for example, equal to "200"), etc. As for the example above, the presented content, its parts, including, but not limited to, scenes, scene objects, etc. can be changed. using data about other user interactions, for example, information from comments can be used. So, for example, the user can leave a comment containing motivations for the mentioned changes in the presented content, for example, a comment on the user's message (for example, on an Internet resource, in an application, etc., including in a social network, on a forum and etc.) may contain the word "fireworks". The data acquisition block 160 receives from the servers of user interaction services 120 data on such interaction and the data contained in them, for example, it receives “fireworks” from a comment in a publication message (in particular, in a comment to a post), including upon request from the block receiving data 160 to at least one of the servers of user interaction services 120 , the data processing unit 170 generates a signal and transmits it to the content generation unit 180 , which launches fireworks in three-dimensional space, in particular, inside the 3D world.

Also, the data processing unit 170 generates (generates) a video signal that can be used by the content generation unit 180' . In a particular case, the data acquisition block 160 receives data to generate a video signal, or at least a portion of it. Thus, the data acquisition block 160 (using a parser, a parser-program, tools provided by the parser) receives from the servers of user interaction services 120 links (for example, url) to avatars (avatar, avatar - from the English avatar), userpics (eng. userpic, short for English user's picture - "user's picture") of users who commented on something, like, clicked, etc., if the service allows such user interaction with elements, including elements of the interface, service, web -site, application, etc. Data acquisition block 160 receives images located at such links (in particular, avatars, userpics, etc.) and transfers to data processing block 170 for adding to the video texture, and the size of the video texture can have a different size, in particular, depending on tasks. For example, if there is a task to show high-quality avatars in high resolution, then the size of the video texture can be 4K. If there is no such task, then a video texture in 2K resolution can be used for optimization. Thus, adding to the video texture is carried out by the data processing unit 170 by placing data (in particular, video data) on it from various data sources (in particular, from the data acquisition unit 160 ). So, for example, the size of the video texture is (given size) 1920x1080 pixels, and the size of the avatar is 256x256 pixels. The data processing unit 170 creates a pixel map (UV map, pixel UV map) of such a video texture of the appropriate (1920 pixels by 1080 pixels) size, which determines the placement of parts of the video texture (in particular, added to the video texture) in the required (desired) positions ( places) 3D world. So, for example, a 3D world contains a 3D object ( 353 , 354 , FIG. 3 ), on which a video image can be played, for example, in the virtual space in a 3D scene there is (added) a screen (for example, an LED screen) on which a video texture is displayed , in particular, a part of the video texture, for example, only that part of the video texture that is in the upper left corner and has dimensions of 256x256 (pixels) from the upper left corner (which in a particular case is the origin of coordinates for the texture, in particular, the video texture) . Thus, when the content generation unit 180 (and/or the data processing unit 170 ) is added to the specified area of the image, in particular, the user's avatars (343 , 344 , FIG. 3 ), it is presented in the virtual world by the content presentation server 190 . When the content generation unit 180 (and/or the data processing unit 170 ) is added to the specified image area, it is presented in the virtual world by the content presentation server 190 using UV coordinates (UV coordinates) that determine how the virtual 3D object displays the applied on it texture (video texture, video texture, video texture, image texture). Accordingly, the UV coordinates of the virtual object can display a certain part of the video texture. So, for example, for a virtual square, its UV texture display coordinates can be set to display only some part of the texture that is applied to it. For example, a 1280x720 rectangle texture can be applied to it (it can be superimposed on it), and the UV coordinates of this texture on the object can be adjusted so that only a part of such an applied 720x720 texture is displayed, and the rest of the texture is not displayed (as if cut off). Thus, by combining different areas on the video texture described in the present invention (avatars are placed in some area, a video file is placed in some area, comments are displayed somewhere, etc.) can be configured (including initially set) 3D objects so that they display a certain part of it. Thus, the content generation unit 180 (and/or the data processing unit 170' ) can obtain information about the image, in particular image parameters such as image size, RGB (red, green, blue) value, image histogram, EXIF information, for example. (from the English Exchangeable Image File Format), etc. Also, the content generation unit 180 (and/or the data processing unit 170 ) can change the size of the image, including by scaling the image, extracting a part of the image (crop the image), getting the coordinates of the part of the image, rotating the image, passing the image to the widget, getting ( including "download") an image using the URL of the image, place text on the image, apply image processing filters, convert an image from one format to another, such as from JPG to PNG, create a GrayScale black and white image, etc. ., moreover, at least part of the specified functionality of the content generation unit 180 (and / or data processing unit 170 ) can be implemented by the “pillow” software library for “python” or part of it.

Also, the 3D world may contain (may be created, for example, by the content generation unit 180 ) at least one 3D object ( 373 , FIG. 3 ) on which a video image can be played, in particular, on which a video texture is displayed (or , at least one part thereof), for example, video data transmitted by AV servers 130 , received from servers of user interaction services 120 , website servers 110 , etc., transmitted to the central data processing server 150 (for example, by a block data processing unit 170 and/or data acquisition unit 160 ), for example, a video that is recorded using appropriate means, in particular, recorded and demonstrated (transmitted for further demonstration using at least one computing device, for example, a server, a device user and presentation means, in particular, data visualization), in particular, "streamer", a user, for example, an artist, blogger, a private videoconference operator, etc., or which the user has uploaded to the AV data servers 130 (or to which the AV data has been transmitted), which the user has posted on websites (including website servers), social networks (including on servers of social networks), etc., and in a particular case , audio-video data servers can be website servers 110 , servers of user interaction services 120 or used by websites, user interaction services, including for storing data, for example, audio-video data .

Thus, when the content generation unit 180 (and/or the data processing unit 170 ) is added to the specified image area, in particular, the video of the artist, with the artist, etc., it is presented in the virtual world by the content presentation server 190 .

In a particular case, the content generation unit 180 (and/or the data processing unit 170 ) may generate other "visualizations". So, for example, the user can send his video (transmit video in the form of video data, audio-video data), for example, using the servers of user interaction services 120 and / or servers of audio -video data 130 , for example, by transferring to them a recorded or previously stored recording (in particular, a video recording , including with sound, for example, in an audio recording format), which is transmitted to the central data processing server 150 , in particular, to the data acquisition unit 160 or to the data processing unit 170 , which, as described above, is placed on the video texture (including, in at least one part of the video texture), in particular, is added to the video texture, with further presentation by at least one content presentation server 190 (i.e. this user video will appear in the 3D world).

In a particular case, the content generation unit 180 (and/or the data processing unit 170' ) may create (in particular, generate) various widgets. For example, the content generation unit 180 generates two 3D worlds, for example, one 3D world is a world on the planet Earth in virtual space, the second 3D world is a world on the planet Mars. Next, the content generation unit 180 (or data processing unit 170 ) selects, in particular, sets, a condition (in particular, a trigger) from a list of triggers previously created (for example, by a user, including a developer, an administrator, etc.) and corresponding events from a list of pre-created (by the user) possible events, for example, it is selected that the movement from Earth to Mars in the 3D world is being carried out (implemented, for example, by moving a virtual program camera from one point with given coordinates of virtual space to another, or by loading into the memory of the computing device of another 3D scene, including with the change of the virtual software camera, etc.) if users write two hundred (200) comments under a message (post), in particular, under a certain (preset). So, the task of which publication to track is carried out by the user, for example, the director. Those. can be determined based on creative ideas. The conditional director can set which publication to parse from at the moment or from which source (from a website or from other services, etc.) . In this case, the data processing unit 170 generates a widget, for example, in the form of a filling circle, for example, which is filled as the number of comments increases. Thus, a widget is generated which visualizes the received (in particular received) data from the data acquisition block 160 .

In a particular case, conditions, in particular, triggers, are formed by users.

The data processing unit 170 transmits data (signal, in particular, audio signal, video signal, audio signal) to the content creation unit 180 in one of the known ways in one of the known formats, for example, via the streaming protocols RTSP (Real Time Streaming Protocol), RTMP, SRT and etc., NDI (Network Device Interface), SPOUT, etc. protocols, in particular, the data processing unit 170 can encode data (in particular, the output signal) for transmission to at least one server, to at least one other block, etc., in particular, to the content generation block 180 , thereby passing the generated video texture.

The content generation unit 180 generates content for presentation to the user, for example, by means of and/or using at least one content presentation server 190' . In a particular case, the content generation unit 180 may be a graphics "engine" (from the English graphics engine), or include a graphics engine, or implement at least part of the functionality of the graphics engine. In a particular case, the content generation unit 180 can be a renderer (visualizer), a game engine, a computer game development environment, including a cross-platform one. So, for example, the content generator 180 can be an engine (or implement its functionality, or at least part of it), such as Unity, Unreal Engine, CryEngine, Blender (Blender Game Engine), etc. In the content generation unit 180 , a 3D world is pre-created in a 3D virtual space, or at least a part of the 3D world, such as 3D objects, a group of 3D objects, parts of 3D objects, etc.

The content generation unit 180 generates content for presentation to the user by combining 3D objects of the 3D world and data obtained from the data acquisition unit 160 and / or data, in particular, video data transmitted by audio-video data servers 130 , for example, by overlaying 3D objects of the 3D world over video data , for example, over the broadcast of AR (from the English augmented reality - augmented reality), or by overlaying (including mixing, merging, combining) video data on 3D objects of the 3D world, in particular, forming a single image presented to the user.

Thus, by the content generator 180 , for example, using software, including firmware, such as software scripts, or by the user using the content generator 180 , in particular, the tools provided by the content generator 180 , such as software tools , program scripts, etc., 3D objects are created (for interaction). Such 3D objects can be particle systems, 3D models, materials, the parameters of which can be changed, for example, the size, color of the material, the size of the 3D model, the number of particles of the particle system, particle velocity, location, etc. can be changed.

In a particular case, data transfer by the data processing unit 170 to the content generation unit 180 may be performed by creating ("opening") a network connection, for example, by the content formation unit 180' . Thus, in the content generation unit 180 (in particular, by means of the content formation unit 180 ) a server (for example, a TCP, UDP server, etc.) can be created, to which the data processing unit 170 transmits (sends) data, and to which data is received (received) from the data processing unit 170 . The created server (in particular, a software server) by content creator 180 can be created by code in a programming language supported by content creator 180 , in particular, in a programming language in which the graphics engine is written or supported by the graphics engine, for example, in python language, Blueprints (Unreal Engine Blueprints), including using code generation.

Next, the content generation unit 180 distributes data from the received data array (in the particular case, the DMX data array), in particular, the received control signals are distributed, in particular, the content formation unit 180 assigns the corresponding index to the corresponding parameter. So, in the fireworks example above, the resulting dataset is the dataset [number, number, 1, number]. Under the index "2" in the array there is a unit ("1") - this means that a firework is required (in particular, the firework trigger is the second index in the DMX array). The content generator 180 assigns an index (in a particular case, a channel) "2" of the input array to a parameter (per parameter) of the activation of the particle system, in particular, the activation of the fireworks particle system: if the value is zero ("0"), then the number of particles emitted by the system particles is equal to a given number, in particular, equal to zero ("0"). If the value is one ("1"), as in the example above, then the number of emitted particles is equal to the specified number of particles, for example, ten thousand particles ("10000"), and the parameters of fireworks (and other objects) are stored in at least one data store, for example, in the data store of the content creator 180 . Thus, the content generation unit 180 distributes the values of the incoming data array to the values of the interactive 3D objects. The above method also processes other activities (which may be creative ideas of user interaction with the virtual 3D world, for example, fireworks, meteor showers, modification of the 3D world, etc.), in particular, the required (desired) index is identified by the content generation unit 180 from an array (in particular, a DMX array) and parses it to the required parameter.

So, in python code (programming language) it might look like this:

input=[0,0,1,0] - received array;

fireworks=input[2] - value "1" from the array, since the second index is assigned to the fireworks parameter;

emitter=fireworks*1000 - particle emission parameter: if the value is equal to zero (when zero is received), no actions are performed, if "1" is received, one thousand particles are emitted.

In the same way, users interact with any element responsible for changing the color of objects, turning on the light, changing the location of the 3D world, etc.

In a particular case, the described invention allows users to influence the presented content (for example, stream) in real time. So, within the framework of the present invention, data can be obtained from social networks, websites and other "inputs" that are available to the user and integration of such interactions into the 3D world is carried out: broadcasts, etc., depending on the actions of users.

In a particular case, not only the presentation of interface elements, controls, interactions, ratings (likes), comments, etc. is carried out. video layer on top of the broadcast, but is also carried out by allowing users to interact with virtual objects inside the broadcast in the 3D world or in AR with the processing of such interactions and changing the content presented.

The system implementing the present invention, an exemplary embodiment of which is shown in FIG. 1 also includes website servers 110 . So, for example, a website can be an online store, as well as a web page that displays a broadcast from a virtual 3D world or a broadcast from a real camera of an artist’s performance that performs against the background of a virtual 3D world that can be displayed on LED screens, 3D mapping (from the English mapping - mapping, mapping, mapping), etc.

On the website, the user can:

- acquire a certain activity (which is pre-designed and formed based on the creative concept and technical means, as described in the framework of the present invention);

- rate (like), add a comment, etc.;

- call a free defined (in particular, one of the available, predefined, etc.) activity.

Shown in FIG. 1, the system also includes monetization service servers 115 . The monetization service can be one of the online stores with the appropriate infrastructure that allows you to make purchases. So, such a service can be, in a particular case, a website (application, etc.), in particular, a platform that allows users (administrators, sellers, etc.) to post information about upcoming online events, hold events, exchange various kind of information, content, etc., as well as having the functionality of an online store, where the user (in particular, the buyer), as in any classic online store, can purchase something for a certain cost, in particular, acquire activity (in particular, the implementation, addition, etc. of activities). In a particular case, one of the servers of the monetization services 115 may be the server of the "Donation Alerts" service. In a particular case, in response to the API data request sent by the data receiving block 160, the monetization service server ( 115 ) sends a json string with new donations (for example, ['ROMAN OLIZAROVICH', 150, 'RUB', '2020-07 -23 18:36:46 ', 'FIREWORKS'], where the user "ROMAN OLIZAROVICH" transferred one hundred and fifty rubles on July 23, two thousand and twenty at eighteen hours thirty-six minutes forty-six seconds for fireworks), user name and amount, in data acquisition block 160 , which is further transferred to the data processing block 170 , including, in a particular case, via one of the data transfer protocols, for example, via TCP / IP. Also, the mentioned data (including in the json-string format) can be sent (to the data receiving block 160 ) by the monetization services server 115 without an API data request. So, for example, the central data processing server 150 as a client can connect to the website backend via sockets and receive data, send POST requests.

Shown in FIG. 1, the system also contains AV data servers 130 transmitting AV data created by users on AV data servers 130 , created by users on users' computing devices and transmitted by users to AV data servers 130 , in particular, to the data processing unit 170 , including saving audio video data, at least , in one data store of at least one of the AV data servers 130 . Thus, data can be stored in the memory of the AV data servers 130 , including in RAM, in the data stores of the AV data servers 130 , in at least one of the known formats of AV data, audio data, video data, image formats, in particular, in digital formats, e.g. WAV, AIFF, APE, FLAC, MP3, Ogg, MPEG, AVI (Audio-Video Interleaved), WMV (Windows Media Video), MOV, MKV, 3gp, RAW, JPEG (JPG), TIFF, BMP, PNG, GIF and others.

Data can be transmitted to the AV data servers 130 (in particular, from at least one server, to at least one other server, including within at least one server, block, etc.) with other computing devices, data storages, etc., in at least one of the known formats of audio-video data, audio data, video data, image formats, including in the form of an audio-video signal (audio signal, video signal) using at least one of known data transfer protocols, for example, using a streaming data transfer protocol, in particular, via RTMP (Real-Time Messaging Protocol), SRT (Secure Reliable Transport Protocol), WebRTC (web and real-time communications), etc. .d. Thus, data to the AV data servers 130 may be transmitted from other servers and/or from users' computing devices. The computing devices of users can be personal computers, electronic computers (computers), laptops, servers, workstations, monoblocks, computer stands, desktop computers, test stands, demonstration computer stands, tablet, smartphone, etc.

Data may be transmitted from AV servers 130 from other computing devices, data stores, etc., in at least one of the known AV, audio, video, image formats, to a central processing server. 150 , in particular, to the data processing unit 170 , including in the form of an audio-video signal (audio signal, video signal) using at least one of the known data transfer protocols, for example, using a data streaming protocol. Thus, the central data processing server 150 , in particular, to the data processing unit 170 , receives audio-video data from the audio-video data servers 130 .

Data can be transferred to the audio-video data servers 130 from the servers of user interaction services 120 , user computing devices, from data storages, including cloud data storages, data centers, etc., which can then be transferred to the data acquisition unit 160 and /or in the data processing unit 170 for further processing, as described in the framework of the present invention. So, for example, data, or at least part of it, can be transferred to the data receiving unit 160 and data processing unit 170 , for example, data about the user, messages posted by the user, interactions, actions can be transferred to the data processing unit. etc. user, etc., and video content posted on social networks, etc. can be transmitted to the data processing unit 170. or from the user's computing device, data storage. Also, in a particular case, the data received by the central data processing server 150 from the servers of the user interaction services 120 , including video data, can be obtained by the data acquisition unit 160 , and the video data transmitted by the user using at least the user's computing devices, for example, live, or previously downloaded, can be received by the data processing unit 170 from the AV data servers 130 .

In a particular case, video data (video content) is transmitted to the data processing unit 170 , from which the content presented to the user is formed, including those added to the video texture, to which three-dimensional objects are added, a 3D scene, etc., and the data acquisition unit 160 is transmitted information about user interactions, information related to video data, user, user actions, including interactions, purchases made, activity launches, etc., at least some of which is further transmitted to the data processing unit 170 , including for formation of content presented to the user.

In a particular case, the data stores described in the present invention, for example, at least one data store of the central data processing server 150 , at least one data store of the monetization services servers 115 , at least one data store of the web servers sites 110 , at least one data storage of user interaction services servers 120 , at least one data storage of audio video data servers 130 , at least one data storage of content presentation servers 190 is a means, in particular, a device, for storing information ( data) and can be implemented by at least one hard disk drive (HDD / HDD, eng. hard (magnetic) disk drive), solid state drive (SSD, eng. solid-state drive), hybrid hard drive (SSHD , solid-state hybrid drive), storage area network (SHD / SAN, Storage Area Network), network storage system / network storage (NAS, English Network Attached Storage) and / or any other means (device) that allows at least recording and / or storing data. The data in said data stores may be stored in any known format, such as in a database (DB), for example, in the form of at least one table or a set of related or unrelated database tables. It is worth noting that at least one of said database may be a hierarchical, object, object-oriented, object-relational, relational, network and/or functional database, each of which may be centralized, concentrated, distributed, heterogeneous, homogeneous, fragmented/partitioned, replicated, spatial, temporal, space-time, cyclic, extra-large database, etc., and various database management systems (DBMS) can be used to manage, create and use databases.

Also, the data in said data stores may be stored in at least one file, in particular in the form of a text file, or the data may be stored in any of at least one other currently known data/information storage format, or in a data format invented later.

It is worth noting that the components (parts) depicted in FIG. 1 systems can be interconnected (and any other components, devices and services (services) capable of receiving information from the components (parts) of the described system and / or transmitting data to the described system components) through various types of communication, for example, through local computing network (LAN), Internet, (means of) mobile communication, satellite communication and / or through any other type or method of wired communication (for example, via USB interface, RS-232/COM port interface, etc.) and/or wireless communications, such as Bluetooth, Wi-Fi, mobile cellular communications (GSM), including 3G, 4G, LTE, in particular in the 850/900/1800/1900 MHz bands, satellite communications, trunked communications and data transmission channels with ultra-low power consumption, forming complex wireless networks with mesh topology (ZigBee), etc.

It is worth noting that a server, such as a central data processing server 150 , a monetization service server, a website server, a user interaction service server, an AV data server, a content presentation server, may be a web server or include a web server. It is worth noting that the connection between the central data processing server 150 , monetization service servers 115 , at least one data warehouse of website servers 110 , user interaction services servers 120 , audio-video data servers 130 , content presentation servers 190 , as well as between their blocks can be carried out via at least one data transfer protocol, including a network protocol, for example, TCP/IP, HTTP/HTTPs (Hyper Text Transfer Protocol), FTP (File Transfer Protocol, file transfer protocol), POP3 (Post Office Protocol, a standard mail connection protocol), SMTP (Simple Mail Transfer Protocol, a protocol that specifies a set of rules for sending mail), TELNET (remote access protocol), XMPP (from English .Extensible Messaging and Presence Protocol - extensible messaging and presence protocol, formerly known as Jabber - open source written in XML, a protocol for instant messaging and near real-time presence information), DTN, etc.

FIG. 2 shows one of the options for the operation of one of the variants of the system that implements the present invention, according to one of the embodiments of the present invention.

In step 210, the data acquisition unit 160 receives from the user interaction services servers 120 (in the particular case, from the audio-video data servers 130 ) the data stored in the data stores associated with the user interaction services servers 120 or being part of them, including in response to a request such data from the central data processing server 150 , in particular in response to a request from the data acquisition unit 160 , or according to a predetermined schedule, instructions for the execution of which can be stored on the servers of user interaction services 120 , or in response to actions, at least one user.

In step 215, the data acquisition unit 160 transfers the received data to the data processing unit 170 , including pre-processing, for example, removing information not used by the data processing unit 170 .

In step 220, the data processing unit 170 generates control signals, including using the data received from the data acquisition unit 160 .

In step 225, the data processing unit 170 receives audio-video data from the servers of the user interaction services 120 (in the particular case, from the audio-video data servers 130 ).

In step 235, the data processing unit 170 performs the formation of a pixel map (pixel map) of a video texture (video texture) with the formation of a video texture, as described in the framework of the present invention.

In step 240, the data processing unit 170 performs the formation of a 3D world with the formation of 3D objects using the received data.

In step 245, the data processing unit 170 transmits the generated video signal (user video, avatars of likers, comments, etc.), control signals, generative signals (current camera index, triggers for launching activities, etc.) to the content generation unit 180 . In the virtual world, virtual cameras (3D cameras, virtual 3D cameras) can be created, which can be switched as in a real broadcast, in particular, switching from one camera to another can be carried out (by the user, or in an automated mode, including the means shown in Fig. 1 of the system, for example, the central data processing server 150 , the website server ( 110 ), one of the servers of user interaction services 120 , etc. The mentioned camera index is created (set, formed) when the camera is created and can be any assigned , for example, an identifier.Further, switching between cameras is carried out by setting (selecting) the desired index, including specifying it at a certain place in the array.For example, a close-up is a camera with an index of "1", a distant plan is a camera with an index "2", etc.

In step 250, the content generation unit 180 generates content for presentation to the user, including adding additional user data, user interactions, etc. .d., in a particular case, comments are parsed in which there is a marker corresponding to a color change ("color", "colour", "blue", "blue", etc.), which are processed and assigned to the scene (for example, the comment looks like "blue", in DMX an array of color values is passed to indexes 15,16,17 and assigned to the scene or at least one scene object). In a particular case, the content generator 180 receives at least one array of data, and the content generator 180 parses the data in its place (for example, index 1,2,3 is RGB for color management), and the acquisition and parsing can be implemented by a submodule using the DMX protocol (DMX component).

In step 255 , content is presented to at least one user transferred from the content generation unit, for example, by at least one content presentation server 190 , for example, with a streaming service.

FIG. 3 shows an exemplary version of the content presented to the user.

As shown in FIG. 3 presented by at least one of the content presentation servers 190 to the user, the content may contain 3D objects, for example, 3D object 353 , 3D object 354 , 3D object 373 , on which it can be presented, in particular, can be played, a video image in the video texture format, in particular, parts of the video texture, for example, an image (avatar, avatars) of the user. For example, in 3-D object 353 may be presented to the avatar 343, on the 3D-object 354 may be presented to the avatar 344, on the 3D-object 373 may be presented video (artist), in particular the live video (user video user Video ) 333 artist, for example, which the user streams, video images posted by users on social networks, other services, including on various servers for storing data, including for posting, publishing and presenting data, in particular, audio-video data.

In a particular case, the proposed invention can be carried out in the process of broadcasting from the virtual world, and the virtual world can also be presented (in particular, it can be displayed in the virtual world) during a live performance of artists, speakers on LED screens, 3D mapping and other ways of displaying content, in including at concerts, events, etc. So, in a particular case, instead of designing from footages (English footage, in particular, the footage is raw, unedited material, originally filmed by a video camera or recorded by a video camera), a generative 3D world is formed, broadcast in real time to the stage with the artist and which is controlled by users , as described in the scope of the present invention.

The proposed invention can be used in (at) concerts, business conferences, presentations, etc., including by changing the virtual 3D world in real time and outputting a render (from the English rendering - visualization) of this 3D world to presentation means ( in particular reproduction) of the content.

In a particular case, users can, through the website (using the tools provided by the website), applications, social networks, etc. influence the virtual 3D world in real time with the presentation of the generated (formed) 3D world to users, for example, generate a broadcast from the 3D world (make a stream from the 3D world), display it on screens, projections, holograms during a real performance of an artist (performance in the real world ), apply in XR, AR technology, etc.

FIG. 4 shows one embodiment of the scheme for implementing the present invention, including the operation of an embodiment of a system implementing the present invention.

As shown in FIG. 4 using a user interface, in particular a graphical user interface, users can perform actions (interact, have an impact) using user interface elements (for example, soft buttons such as "Like", "Fireworks, etc., related with corresponding activities"), including for the purpose of modifying, changing the content or part of the content that will be presented to the user in the form of modified and generated content for presentation, which will be presented in a modified format in the user interface ( 486 ), i.e. in particular, to influence the presented content. Said user interfaces may be a website interface 404 , an online store interface 414 , a mobile application interface 434 on a user's mobile computing device, a social media interface 424 , an application interface on a user's desktop computing device, etc., including those using technologies Web API (Web API), SOAP (from the English. Simple Object Access Protocol - a simple protocol for accessing objects), etc., and placed (including functioning) on (using) various servers, such as servers websites 110 , user interaction service servers 120 , audio video data servers 130 , monetization service servers 115 and other servers of other services with which it can exchange data (at least from which it can receive, or at least to which it can send) a central data processing server 150 using the corresponding service APIs 444 provided by such services. Thus, various data can be transmitted from the services API 444 to (c) the central data processing server 150 , used for processing and generating data and data sets, as described in the framework of the present invention, including for the formation of content presented to the user, and such transmitted data may be about the weather, exchange rate, statistics, etc.

So, for example, a user using an interface (user interface), in particular, interface elements, registers, on a website, in an online store, in a social network, in an application, etc., for example, using a web interface site 404 is registered on the website, using the interface of the online store 414 is registered in the online store, using the interface of social networks 424 is registered in the social network, using the interface of the mobile application 434 is registered in the mobile application, for the formation of the corresponding computing devices (servers , computing devices of the user) for such a user of an identifier (user), in particular, a unique identifier, which, among other things, may be a name, nickname, user avatar, etc.

Using the interface elements of the website, the user can call the activity, using the interface elements of the online store - to buy activity through the payment system, using the interface elements of the mobile application, the user can buy the activity through the payment system, using the interface elements of social networks, the user likes, comments on posts (posts, publications), etc. and information about the user's actions and related data (eg, data from payment systems, servers, applications, etc.) are transmitted to the central data processing server 150 for further processing, as described in the framework of the present invention.

So, for example, a user on a social network using the user interface elements under the publication added a message containing the word "fireworks" to start fireworks (step 505 , FIG. 5 ). The content of the user's message is passed to the parser 454 , as described in the framework of the present invention (step 515 , FIG. 5 ), which in a particular case, may be part of the data processing block 170 or the data acquisition block 160 , or be an independent block (for example, the analysis block , including semantic, data). Parser 454 performs (step 525 , FIG. 5 ) compares the content of the message with the word "fireworks", for example, contained in the dictionary of changes in the three-dimensional world (modifications, reactions to user actions, possible effects added to the three-dimensional world, scene, etc.) , for example, in the format of words that may be contained in data (messages) received by the central data processing server 150 , for example, occur in user messages. If the message contains the word "fireworks", then the data processing unit 170 performs the formation of a logical unit in the control array, in particular, the data of the incoming message is processed and a control array is formed, in a particular case containing the parameters of color, launching particle systems, changing objects (size and etc.), their positions (positions, coordinates), and the location of the parameters is determined depending on the tasks being solved and can be set, including changed, by the user in the process of creating the described system. Thus, a predetermination is performed (step 535 , FIG. 5 ) in the control array of the index on which the activation of the particle system in the virtual world is located. When a unit is received at this array index, fireworks will be fired by the particle system by means of the system, an exemplary version of which is shown in FIG. 1 as described in the scope of the present invention.

So, the parser 454 generates messages ( 458 ), for example, JSON messages, from incoming message data from services (websites, etc.) with the extraction (allocation) of meaningful data (in particular, related to user actions, activities and etc.).

At least one generated message 458 is transmitted to the data processing unit 170 using the (means) TCP/IP server 462 (at the request of the TCP/IP server 462 or parser 454 without request), in particular, over a network protocol, and the data processing unit 170 , the control array is formed ( 466 ), as described in the framework of the present invention. Thus, the data processing unit 170 processes the received (incoming) generated message 458 with the addition of data from it to the control array ( 466 ), which is then transmitted to the content generation unit 180 .

Also, data from websites, user interaction services, monetization services, applications, including mobile applications, including, in particular, from website servers 110 , is transmitted to the data processing unit 170 using a TCP/IP server 462. servers of user interaction services 120 , servers of audio-video data 130 , servers of monetization services 115 , computing devices of users, including mobile computing devices of users, etc. used to form a video texture ( 470 ) and a pixel UV map ( 474 ) for it ( or at least part of it) application (including overlay, combination, mixing, etc.) to objects of the 3D world with the formation of content for presentation ( 482 ). Such data from websites, user interaction services, monetization services, applications, including mobile applications, including, but not limited to, website servers 110 , user interaction services servers 120 , audio-video data servers 130 , monetization service servers 115 , user computing devices, including user mobile computing devices, may be transmitted to the data processing unit 170 through the data receiving unit 160 . In a particular case, data, including audio-video data, including images, from websites, servers, etc. can be uploaded to the central data processing server 150 and transmitted to at least the data processing unit 170 using links, such as URLs, to such data. So, for example, if data received from website servers 110 , user interaction services servers 120 , audio video data servers 130 , monetization service servers 115 , user computing devices contains a link to an image, video recording, etc., then such an image, video recording and etc. is transmitted (downloaded via link) to the central data processing server 150 for further processing. Also, these links can be contained in messages generated and transmitted by the parser 454 to the data processing unit 170 , according to which the data processing unit 170 downloads such images, in the particular case with saving, at least in one of the data stores associated with the central data processing server 150 , or to generate a video texture ( 470 ) and a pixel UV map ( 474 ) without first saving them to the data storage. Thus, loading (transferring to the central data processing server 150 ) of images (avatars, photographs, video recordings, etc.) can be carried out in the process of forming a video texture ( 470 ) and a pixel UV map ( 474 ) while preserving the already formed video texture 470 and pixel UV maps 474 in at least one of the data stores associated with the central processing server 150 .

As described in the context of the present invention, the data processing unit 170 generates a video texture ( 470 ) and a pixel map (UV map, pixel UV map) of such a video texture of the appropriate size, which determines the placement of parts of the video texture (in particular, added to the video texture and obtained as described above, for example, from the parser) at the required positions of the virtual 3D world, as shown in FIG. 6 .

The generated video texture 470 , the generated pixel UV map 474 , and the generated control array 466 are passed to the content generator 180 .

The content generation unit 180 generates content for presentation ( 482 ), which, together with the generated 3D objects 478, will be presented to the user ( 486 ).

The content generation unit 180 uses the generated video texture 470 , the generated pixel UV map 474 and the generated 3D objects 478 , including sets (sets) of such objects, including those that form a 3D scene (world), stored in memory to generate content for presentation ( 482 ) the central data processing server 150 , which are obtained by the content generation unit 180 of their data store, and can also be formed by the content generation unit 180 and modified (including the shape, color, number of vertices, particles used, particle emission speed, etc.). ) depending on the contents of the generated control array 466 . The generated 3D objects 478 , including whole scenes, parts of a scene, etc., can be stored in the memory of the central data processing server 150 and in the data storage of the central data processing server 150 in one of the well-known formats for storing three-dimensional models, for example, in formats files for storing models MD5, DAE, MD3, MD2, BLEND, 3DS, OBJ, PLY, STL, etc.

The generated presentation content 482 is presented ( 486 ) to the user on at least one of the user's computing device. Thus, for example, generated content may be transmitted to user interaction service servers 120 , website servers 110 , user computing devices, and so on. and displayed in user interfaces such as a website interface 404 , an online store interface 414 , a mobile application interface 434 on a user's mobile computing device, a social media interface 424 , an application interface on a user's desktop computing device, etc., in including to the content presentation server 190 and through the content presentation server 190 , which can store and present content, for example, by transferring (including broadcasting) the generated content for presentation to computing devices, for example, servers of user interaction services 120 , web servers sites 110 , user computing devices, etc. In a particular case, the content presentation server 190 may be a video server or a video service server.

FIG. 5 shows a block diagram of one of the options for processing user actions and generating a response from a system that implements the present invention, including changing at least part of the content presented to the user, in particular, the three-dimensional world.

In step 505, the user on the social network under the post added a message containing the word "fireworks" to start it.

Next, in step 515, the content of the message is passed to the parser 454 . Parser 454 is configured to transmit (send) requests to API services, including APIs for websites, user interaction services, monetization services, etc.

The parser 454 is also configured to send (send) a request ( 426 , 416 ) to get data from the database at the back end of the website, so that it sends in response ( 427 , 417 ) the requested data (data about interactions such as likes , button presses, etc.).

The website, in particular, the back-end of the website, can send ( 428 , 418 ) to the parser 454 (including through the data receiving block 160 ) messages, for example, messages about purchases, other user interactions, for example:

- make a POST/GET request;

- open connection with the parser via WEB SOCKET;

- send a message, for example, via TCP/UDP.

In a particular case, not only the parser 454 can make a request to the back-end of the site, but a network connection can be established (open) (for example, at system startup, an exemplary version of which is shown in FIG. 1 ), over which the back-end will communicate and parser 454 .

Step 525 compares (by parser 454 or data processing unit 170 or data acquisition unit 160 ) the content of the message with the word "fireworks". If the message contains the word "fireworks", then a logical unit is formed in the system memory, an exemplary version of which is shown in FIG. 1 .

Also, the parser 454 from incoming messages from services (websites, etc.) selects (isolates) significant data (in particular, related to user interactions, including those related to modification of the virtual world) and converted into a format acceptable for processing, for example, data processing unit 170 , for example, in the JSON format, in particular, JSON messages. For example, the parser received a message of the form "({"post": "we1", "type": "post info", "url": "https://www.instagram. com/p/11111111111/", "is_private": false, "likes": 150, "count_comments": 0, "end_action_time": "2020-08-25 12:06"}'", from which the following message is formed "{"url": "https://www.instagram.com/p/11111111111/", "likes": 150}'" containing the required data.

In step 535, the data processing unit 170 predetermines in the control array the index on which the activation of the particle system in the virtual world is located. When a unit is received at this array index, fireworks will be fired by the particle system by means of the system, an exemplary version of which is shown in FIG. 1 , for example, by the content generation unit 180 .

FIG. 6 shows an exemplary version of the formation of a video texture that is transmitted to the virtual world.

So, after receiving the videos of users received from the website, images of users, for example, avatars of users who appreciated the posted message (liked posts), posted photos of users in personal accounts, published in messages, etc. data processing unit 170 , including using (means) TCP / IP server 462 , including from the parser 454 (including in the generated messages 458 , for example, in the format of links), such received data is processed by the data processing unit 170 with the formation of a video texture ( 470 ) and its corresponding pixmap UV_map ( 474 ).

When a user rates (likes), for example, a broadcast (in particular, presented content) on a social network, for example, using social network interface elements 424 , a link to the user's avatar image is obtained by the central data processing server 150, for example, in a message from the parser data processing unit 170 . The central data processing server 150 downloads the user avatar image 616 if it has not been transferred to the central data processing server 150 earlier. Next, the data processing unit 170 sets the resolution for the downloaded image, for example, 512x512 pixels, and in a particular case can be determined based on the resolution of the downloaded image by analyzing data on size, resolution, etc. images contained in the uploaded image file, or determined by the parameters and requirements for images of social networks, etc., and the setting of the resolution can be carried out taking into account such parameters and requirements for the size, image resolution or match them, or use the resolution and size of the image, into which the corresponding services (social networks, etc.) convert images uploaded by users.

The loaded and in a particular case transformed avatar image ( 617 ) is placed on the generated video texture ( 470 ) by the data processing unit 170 .

When a user posts a user video, in particular, when video content has been transmitted to at least one server, including using interface elements, the central data processing server 150 receives a link to such user video (video content), for example, in a message from the parser data processing unit 170 . The central data processing server 150 downloads the user video 626 of the user if it has not been transferred to the central data processing server 150 before. Next, the data processing unit 170 sets the resolution for the downloaded user video, for example, 720x1080 pixels, and in a particular case can be determined based on the resolution of the downloaded user video by analyzing data on size, resolution, etc. video recordings contained in the uploaded video file, or determined by the parameters and requirements for video recordings hosted on servers, including social networks, video servers, video services, etc., and the resolution can be set taking into account such parameters and requirements for size, resolution of videos or match them, or use resolutions, etc. video recordings into which images uploaded by users are converted by the corresponding services (social networks, etc.), servers, etc.

The uploaded and optionally converted user video ( 627 ) is placed on the generated video texture ( 470 ) by data processing unit 170 .

After the user has posted a comment, for example, commented on a social network post, image, broadcast, etc., for example, in a social network using social network interface elements 424 , a comment link is obtained by the central data processing server 150, for example, in the message from the parser by the data processing unit 170 . The central data server 150 downloads the contents of the user's comment ( 606 ) if it has not been previously transmitted to the central data server 150 . Next, the data processing unit 170 generates an image containing the text of the user's comment, the data processing unit 170 sets the resolution for the generated comment image, for example, 1280x100 pixels, and in a particular case can be determined based on the comment length, font size, etc. Text to image conversion can also be done using a text to image converter.

The generated user comment image ( 607 ) is placed on the generated video texture ( 470 ) by the data processing unit 170 .

Formed by the data processing unit 170 , at least one visual element (in particular, visualizations), in particular the widget 636 , is also added to the generated video texture ( 470 ). So, for example, if voting was carried out for the red or blue color of the light emitted by lighting fixtures in the virtual world, then such a vote is visualized by creating a new widget and adding it ( 637 ) to the video texture ( 470 ) including after transformation, for example, resizing, etc..

Placement of the loaded and in a particular case transformed avatar image ( 617 ), loaded and in a particular case transformed user video ( 627 ), generated comment image ( 607 ), widget ( 637 ) on the generated video texture ( 470 ) is carried out in accordance with the generated pixel UV- map 474 as described in the present invention, and the generated video texture 470 and the generated pixel UV map 474 are transmitted to the content generator 180 , for example, via spout/NDI.

On theFIG. 7 shown an exemplary version of changing the virtual world using the example of changing the color of light emitted by lighting fixtures in the virtual world.

After users vote to change the color of lighting fixtures in the social network using the appropriate interface elements (step 707 ), in step 717 , voting data (in particular, voting results, for example, in the format of a set of values, an array, etc.) is transmitted by the data receiving block 160 and they are transferred to the data processing unit 170 , including after they have been processed by the parser 454 , as described in the framework of the present invention.

In step 727 , data processing unit 170 predefines in the control array the indexes corresponding to the color of the fixtures (and other parameter values, as described in the framework of the present invention).

In step 737 , the control array is passed to the content creator 180 .

In step 747, the content generator 180 obtains data for the respective indexes in the control array, and in step 757 , the corresponding color of light emitted by lighting fixtures is generated, as described within the scope of the present invention.

So, for example, users in the social network voted to change the color of the lighting devices of the virtual stage and the yellow color won the maximum number of votes, data about which were transmitted to the central data processing server 150 , in which the data processing unit 170 adds the corresponding information to the control array on the corresponding positions (for example, at indexes 15, 16, 17) that contain the color values of fixtures controlled by users. The content generation unit 180 obtains these values and generates the corresponding color of the light emitted from the fixtures.

FIG. 8 shows an example of generated content for presentation 482 to a user with parts of the generated video texture 470 placed and an activated effect, in particular fireworks 888 , according to one embodiment of the present invention;

The content generation unit 180 receives at least one value on the corresponding index of the generated control array 466 (on the index predefined in the control array on which the activation of the particle system in the virtual world is located) corresponding to the launch of the fireworks by the particle system and starts ( 818 ) fireworks 888 particle system.

The content generation unit 180 receives at least one value on the corresponding index of the generated control array 466 (on the index predefined in the control array, on which the values for the color of the corresponding element in the virtual world are located), corresponding to the color of the corresponding element (including the object ) 3D world and change ( 828 ) the color of the element of the three-dimensional world, for example, the color of rays ( 888 ), 3D object, etc.

On the 3D object 353, the content generation unit 180 presents ( 838 ) the image of the user's avatar, on the 3D object 373 the user's video is presented ( 858 ), and the widget is also presented ( 848 ), and the widget can also be presented on the 3D object ( as well as planes, etc.) or superimposed on top of objects in the 3D world

FIG. 9 is a block diagram of an exemplary embodiment of the present invention.

At step 905, the central data server 150 receives from at least one server a service configured at least to present the user with audiovisual content containing at least three-dimensional objects, graphic materials in image format, video recordings and visual effects and audio materials, and configured to change the audiovisual content presented to the user by the user at least using interface elements of such a service, in particular, from servers, including such services, for example, website servers 110 , monetization service servers 115 , user interaction services servers 120 , AV data servers 130 , content presentation servers 190 , data associated with users and associated with user actions and stored in at least one associated with at least one such service server, a data store. Said user-related data includes data of at least one interaction of at least one user with interface elements aimed at changing the audiovisual content presented to the user, and where user-related data includes user data received by at least one service server from at least at least one user computing device or a third server (e.g., website servers 110 , monetization service servers 115 , user interaction services servers 120 , audiovisual data servers 130 , content presentation servers 190 , etc.) and/or provided by the user using computing user device or a third server to the service server by entering data using at least one data input means and stored in at least one data store associated with at least one service server, where such data is associated User-generated data contains data in textual, graphical, and/or audio data formats.

In a particular case, the service server is at least capable of presenting to the user audiovisual content containing at least three-dimensional objects, graphic materials in the format of images, video recordings and visual effects and audio materials, and is configured to change the audiovisual content presented to the user by the user at least using interface elements of such a service may be one of (or a combination of) website servers 110 , monetization service servers 115 , user interaction services servers 120 , audio-video data servers 130 , content presentation servers 190 . In a particular case, one of the servers may perform or include the functionality of at least one of one of the other servers, for example, the website/websites server ( 110 ) can be a monetization service server, a user interaction service server, an audio video server, a presentation server content or implement at least part of their functionality; the user interaction service(s ) server ( 120 ) may be an audio-video data server, a content presentation server, a website server, a monetization service server, or implement at least part of their functionality, etc.

In a particular case, the data received by the central data processing server 150 contains information about the number of user ratings, the number of comments on messages, a marker of whether the message is private or public, a link to the message, the type of message with specified parameters, with the corresponding text fragments identifying them, compared with text snippets of the text snippet database, and a custom message-id name for each message.

In a particular case, the data provided by users includes registration data in the service, made at least with the possibility of presenting the audiovisual content to the user and made with the possibility of changing the audiovisual content presented to the user by the user and including at least the first name and/or surname and/or patronymic, and /or date of birth and/or age of the user, and/or username displayed in the service, and/or an image that is a graphical representation of the user in the service, and/or user profile data in the service.

In a particular case, data is received by the central data processing server in response to a request for such data by the central data processing server or according to a specified schedule, instructions for which are stored on the user interaction service server, or in response to user actions.

At step 910, the central data processing server 150 generates a database of text fragments with their corresponding predefined changes in audiovisual content, while storing the database of text fragments in the data store of the central data processing server 150 .

At step 915, the central data processing server 150 identifies user actions in the received data aimed at changing the audiovisual content by the user, and the central data processing server 150 generates an array of control signals, in which one or more elements of the control array corresponds to a predetermined control signal so that that the values of the indexes of the control array correspond to a predetermined change in the audiovisual content, where the predetermined change in the audiovisual content is at least a change in the values of the parameters of the geometry of the object of the audiovisual content, and/or a change in the coordinates of the location of the object, and/or a change in the color of the object, and/or adding graphic materials to audiovisual content, and/or adding a visual effect by performing: matching text fragments contained in the received data with text fragments from a text fragment database with adding a control signal corresponding to the change in the audiovisual content in the format of at least one value corresponding to the control signal to the array of control signals in case at least one matched text fragment from the received data matches the text fragment stored in the text fragment database; search in the received data for information corresponding to user interaction with a specific element of the service interface corresponding to a preset change in the audiovisual content, with the addition of a control signal corresponding to the change in the audiovisual content to the array of control signals if such information is detected.

In a particular case, the identification in the received data of information related to the change in audiovisual content and the comparison of the text fragments contained in the received data with the text fragments from the database of text fragments, and the search in the received data for information corresponding to user interaction, is carried out by the parser using the DMX protocol, and to obtain data, the parser sends requests to at least APIs of websites and/or user interaction services and/or monetization services and/or receives data via a POST/GET request, via an established WEB SOCKET connection, and/or in a message over TCP/UDP.

In a particular case, when setting a user action aimed at changing the audiovisual content corresponding to: changing the color of the virtual space object, the values corresponding to the color selected by the user are stored in the control array; changing the location coordinates of the virtual space object, the new coordinates of the object in the virtual space are stored in the control array; changing the shape of the virtual space object, the new coordinates of the object's vertices in the virtual space are stored in the control array; adding at least one visual effect of the virtual space, the values corresponding to the selected special effect and the parameters of such a special effect are stored in the control array.

At step 920, the central data processing server 150 generates at least one visual element that defines at least one level of user interactions aimed at at least one change in audiovisual content, defined by user interactions, data about which are received by at least one service server from at least one element of the service interface and / or provided by the user using the user's computing device or from a third server to the service server, where, upon reaching at least one of the preset levels, at least one of the parts of the audiovisual content is changed, and the visual element contains information about the current achieved level of user impact on the change in audiovisual content and information about the level upon reaching which the change in audiovisual content will be carried out, and is presented to at least one user.

At step 925, the central data processing server 150 changes at least one part of the audiovisual content:

- with the formation and placement of the visual effect in the preset coordinates in the virtual space with the corresponding values of the visual effect parameters using the value of the corresponding index of the control array; and/or

- by changing at least one parameter of at least one virtual space object using the value at the corresponding index of the control array.

At step 930 , the modified audiovisual content is presented by at least one computing device, for example, one of the website servers 110 , the monetization services servers 115 , the user interaction services server 120 , the audiovisual data servers 130 and/or at least one content presentation server 190 , and/or a central data processing server 150 .

In a particular case, the central data processing server 160 converts the received audio-video recording with the formation of at least a video recording, and also converts the received data in text format by the central data processing server 150 by at least one service server from at least one user computing device or a third server and/or provided by the user using the user's computing device or by a third server to the service server by inputting data using at least one input means into at least one image. The central data processing server 150 receives graphic materials in the format of images, video recordings, and / or audio-video recordings, and / or audio recordings from at least one user computing device or a third server and / or provided by the user using the user computing device or a third server to the service server by entering data using at least one data entry means. The central data processing server 150 generates a video texture containing at least one video recording and/or containing at least one image from the received graphic materials, and/or at least one generated visual element that determines the level of user impact, and/or at least at least one image generated from data in text format. The central data processing server 150 generates a video texture containing at least one video and/or at least one image placed in it, and/or at least one visual element that determines the level of user impact, where the dimensions of the video texture, videos, images and visual elements that determine the level of user impact, vertically and horizontally in pixels, are set by the central data processing server, and the dimensions of the video texture, videos, images and visual elements that determine the level of user impacts, vertically and horizontally in pixels, are set by the central data processing server so that placed in the video texture video recordings, images and visual elements that determine the level of user impact, occupied the maximum area of the video texture, leaving the minimum size unoccupied by video recordings, images and visual elements that determine the level user impacts, video texture areas. The central data processing server 150 generates a pixel UV map containing the correspondence of UV coordinates on the surfaces of three-dimensional objects of virtual space to coordinates on the video texture, and determines the placement of at least part of at least one video, image, visual element that determines the level of user impact, video textures on at least one object of virtual space in accordance with the placement of at least one video, image, visual element that determines the level of user impact in the video texture. The central data processing server 150 changes at least one part of the audiovisual content with the placement of at least one part of the video texture on at least one three-dimensional object of the virtual space of the audiovisual content in accordance with the pixel UV map data and presents the generated audiovisual content with changes according to at least one computing device.

In a particular case, at least one server registers transactions, each of which refers to the expression of the attitude of one user to a content event or refers to a change in content, while unique identifiers of data blocks are registered, while each of the transactions of one data set is initiated by the user and contains the user ID and event details.

In a particular case, the central data processing server 150 receives a message about a financial transaction associated with a change in audiovisual content, and contains a sign of transaction registration and transaction data, moreover, said transaction data contains a personal account identifier and a transaction amount, and a change in the level of user impact is carried out, as function of the transaction amount.

In a particular case, visual effects are special effects, including fireworks, implemented by a particle system in virtual space.

In a particular case, a service is an online store, a social network, or a service provided by an application running on the user's computing device.

In a particular case, the audiovisual content presented to the user is formed and/or modified in a virtual environment formed from at least three-dimensional objects, graphic materials in image and video formats, visual effects and audio materials.

In a particular case, a change in the audiovisual content presented to the user is at least a change in the properties of the objects presented to the user of the audiovisual content, where the properties of the audiovisual content objects are at least the coordinates of three-dimensional objects, the coordinates of the vertices of three-dimensional objects, the color, shape, geometry, location, transparency of three-dimensional objects and / or visual effects and/or images and/or video recordings.

In a particular case, a video texture is an image generated in real time with a preset frame rate per second, which is transmitted to the virtual space using the video texture exchange protocols NDI, SPOUT, RTSP, RTMP, SRT SDI, Memory sharing, using image capture by cameras, using capture camera video signal and / or using web page capture and which is applied in virtual space to predetermined objects, changing the visual component of the audiovisual content for presentation to the user.

In a particular case, data related to changes in the audiovisual content is extracted from the data received from the service server, and the extracted data is converted into the format of at least one message, and the message can be a JSON message.

In a particular case, all users who are presented with audiovisual content are notified, for example, by adding data provided by the user in image, video and/or text format to the audiovisual content.

In a particular case, at least two or all users are presented with at least two levels, upon reaching each of which at least one of the parts of the audiovisual content is changed, so that users can observe each of the levels and perform actions aimed at achieving of one level or another in order to change the desired part of the audiovisual content.

FIG. 10 shows an example of a general purpose computer system that includes a multi-purpose computing device in the form of a computer 20 or a server, or a unit (module) of the system described in the present invention, including a processor 21 , system memory 22 and a system bus 23 that connects various system components, including system memory with processor 21 .

The system bus 23 may be any of various types of bus structures, including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. The system memory includes read only memory (ROM) 24 and random access memory (RAM) 25 . The ROM 24 stores the Basic Input/Output System (BIOS) 26 , which consists of basic routines that help exchange information between elements within the computer 20 , for example, at startup.

Computer 20 may also include a hard disk drive 27 for reading from and writing to a hard disk, not shown, a magnetic disk drive 28 for reading from or writing to a removable magnetic disk 29 , and an optical disk drive 30 for reading from or recording on a removable optical disc 31 such as CD, digital video disc and other optical media. Drive 27 to the hard disk drive 28, magnetic disk drive 30, and optical disk connected to the system bus 23 through, respectively, the interface 32 of the hard disk drive interface 33, magnetic disk and an optical drive interface 34. The drives and their respective computer-readable media provide non-volatile storage of computer-readable instructions, data structures, program modules, and other data to the computer 20 .

Although the typical configuration described here uses a hard drive, a removable magnetic disk 29 and a removable optical disk 31 , one skilled in the art will appreciate that in a typical operating environment, other types of computer-readable media can also be used that can store data that is accessible by a computer, such as magnetic cassettes, flash memory cards, digital video discs, Bernoulli cartridges, random access memory (RAM), read only memory (ROM) and the like.

Various software modules, including the operating system 35 , can be stored on a hard disk, magnetic disk 29 , optical disk 31 , ROM 24 or RAM 25 . Computer 20 includes a file system 36 associated with or included with operating system 35 , one or more software applications 37 , other program modules 38, and program data 39. A user may enter commands and information into computer 20 using input devices such as like a keyboard 40 and a pointing device 42 . Other input devices (not shown) may include a microphone, joystick, gamepad, satellite dish, scanner, or any other.

These and other input devices are connected to the processor 21, often via a serial port interface 46 that is connected to the system bus, but may be connected via other interfaces such as a parallel port, game port, or universal serial bus (USB). A monitor 47 or other type of visual display device is also connected to the system bus 23 via an interface such as a video adapter 48' . In addition to the monitor 47 , personal computers typically include other peripheral output devices (not shown) such as speakers and printers.

Computer 20 may operate in a networked environment through logical connections to one or more remote computers 49 . The remote computer (or computers) 49 may be another computer, server, router, network PC, peering device, or other node on a single network, and also typically includes most or all of the elements described above with respect to computer 20 , although only shown information storage device 50 . Logical connections include a local area network (LAN) 51 and a global computer network (GCN) 52 . Using the host adapter 55 , an external or remote storage (data) device 57 can be connected. Such network environments are commonly found in institutions, corporate computer networks, and the Internet.

The computer 20 used in the LAN network environment is connected to the local network 51 via a network interface or adapter 53 . The computer 20 used in a GCN network environment typically uses a modem 54 or other means to communicate with a wide area computer network 52 such as the Internet.

The modem 54 , which may be internal or external, is connected to the system bus 23 via a serial port interface 46 . In a networked environment, program modules or portions thereof described in connection with computer 20 may be stored on a remote storage device. It should be appreciated that the network connections shown are typical and other means may be used to establish a communication link between computers.

In conclusion, it should be noted that the information given in the description are examples that do not limit the scope of the present invention defined by the formula. A person skilled in the art will appreciate that there may be other embodiments of the present invention consistent with the spirit and scope of the present invention.

Claims (40)

1. A method for collecting information for changing audiovisual content in real time with the formation of audiovisual content with the processing of data provided by the user, in which: - the central data processing server receives from at least one service server, which is at least capable of presenting audiovisual content to the user, containing at least three-dimensional objects, graphic materials in image format, video recordings and visual effects, and audio materials, and configured to changes by the user of the audiovisual content presented to the user using at least the interface elements of such a service, data associated with users and associated with user actions and stored in at least one data store associated with at least one such service server, where data associated with user actions data includes user interaction data with interface elements aimed at changing the audiovisual content presented to the user, and where user-related data includes user data obtained by changing by more than one service server from at least one user computing device or a third server and/or provided by the user using the user computing device or by a third server to the service server by inputting data using at least one input means and stored in at least one a data store associated with at least one service server, where such user-related data contains data in text, graphic and/or sound data formats; - the formation by the central data processing server of a database of text fragments with the predetermined changes in the audiovisual content corresponding to them is carried out, while the database of text fragments is stored in the data warehouse of the central server; - the identification by the central data processing server in the received data of user actions aimed at changing the audiovisual content by the user is carried out, and the formation by the central data processing server of an array of control signals is carried out, in which one or more elements of the control array corresponds to a predetermined control signal so that the values of the indices of the control of the array correspond to a predetermined change in the audiovisual content, where the predetermined change in the audiovisual content is at least changing the parameter values of the geometry of the object of the audiovisual content, and/or changing the coordinates of the location of the object, and/or changing the color of the object, and/or adding graphic materials in audiovisual content, and/or adding a visual effect by doing: - comparing the text fragments contained in the received data with text fragments from the database of text fragments with the addition of a control signal corresponding to the change in the audiovisual content in the format of at least one value corresponding to the control signal to the array of control signals in the event that at least one matched text fragment from the received data with a text snippet stored in a text snippet database; - search in the received data for information corresponding to the user's interaction with a specific element of the service interface corresponding to a preset change in the audiovisual content, with the addition of a control signal corresponding to the change in the audiovisual content to the array of control signals if such information is detected; - the formation by the central data processing server of at least one visual element is carried out, which determines at least one level of user influences aimed at at least one change in the audiovisual content, specified by user interactions, data about which are received by at least one service server from at least at least one element of the service interface and / or provided by the user using the user's computing device or from a third server to the service server, where, upon reaching at least one of the preset levels, at least one of the parts of the audiovisual content is changed, and the visual element contains information about the current the achieved level of user impact on changing the audiovisual content and information about the level upon reaching which the change in the audiovisual content will be carried out, and is presented to at least one user; - at least one part of the audiovisual content is changed: - with the formation and placement of a visual effect in predetermined coordinates in virtual space with the corresponding values of the visual effect parameters using the value at the corresponding index of the control array and/or - by changing at least one parameter of at least one virtual space object using the value at the corresponding index of the control array; - the presentation of the modified audiovisual content is carried out by at least one computing device. 2. The method according to claim 1, in which: - the transformation by the central data processing server of the received audio-video recording is carried out with the formation of at least a video recording; - the central data processing server converts the received data in text format by at least one service server from at least one user computing device or a third server and / or provided by the user using the user computing device or a third server to the service server by entering data using software at least one means of inputting data into at least one image; - the central data processing server receives graphic materials in the format of images, video recordings, and / or audio-video recordings, and / or audio recordings from at least one user computing device or a third server and / or provided by the user using the user computing device or a third server to the service server by entering data using at least one data entry means; - the formation of a video texture by the central data processing server is carried out, containing at least one video recording and/or containing at least one image from the received graphic materials, and/or at least one generated visual element that determines the level of user impact, and/or at least at least one image generated from data in text format; - the formation of a video texture by the central data processing server is carried out, containing at least one video recording and/or at least one image, and/or at least one visual element placed in it, which determines the level of user impact, where the dimensions of the video texture, video recordings, images and visual elements that determine the level of user impact, vertically and horizontally in pixels, are set by the central data processing server, and the dimensions of the video texture, videos, images and visual elements that determine the level of user impact, vertically and horizontally in pixels, are set by the central data processing server as follows: so that video recordings, images and visual elements that determine the level of user interactions placed in the video texture occupy the maximum area of the video texture, leaving a minimum size of unoccupied video recordings, images and visual elements that determine the level user impacts, video texture areas; - the formation of a pixel UV map by the central data processing server is carried out, containing the correspondence of UV coordinates on the surfaces of three-dimensional objects of virtual space to coordinates on the video texture and determining the placement of at least part of at least one video recording, image, visual element that determines the level of user impact, video texture at least one object of virtual space in accordance with the placement of at least one video, image, visual element that determines the level of user impact, in the video texture; - at least one part of the audiovisual content is changed with the placement of at least one part of the video texture on at least one three-dimensional object of the virtual space of the audiovisual content in accordance with the pixel UV map data, and - the presentation of the generated audiovisual content with changes is carried out by at least one computing device. 3. The method according to claim 1, in which the data received by the central data processing server contains information about the number of user ratings, the number of comments on messages, a marker of whether the message is private or public, a link to the message, the type of message with set parameters, with the corresponding identifying their snippets of text compared to the snippets of text in the snippet database, and a name-specific message ID for each message. 4. The method according to claim 1, which registers transactions, each of which refers to the expression of the attitude of one user to a content event or refers to a change in content, while registering unique identifiers of data blocks, while each of the transactions of one set of data is initiated by the user and contains the user ID and event details. 5. The method according to claim 1, in which the central server receives a message about a financial transaction associated with a change in audiovisual content and contains a transaction registration sign and transaction data, wherein said transaction data contains a personal account identifier and a transaction amount, and the level is changed user impacts as a function of the transaction amount. 6. The method according to claim 1, in which the identification in the received data of information related to the change of audiovisual content, and the comparison of the fragments of text contained in the received data with the fragments of text from the database of fragments of text and the search in the received data for information corresponding to the interaction of the user is carried out parser using the DMX protocol, and to receive data, the parser sends requests to at least the API of websites, and / or user interaction services, and / or monetization services and / or receives data on a POST / GET request, via an established WEB connection SOCKET, and/or in a TCP/UDP message. 7. The method according to claim 1, in which when establishing a user action aimed at changing the audiovisual content corresponding to: - changing the color of the virtual space object, the values corresponding to the color selected by the user are stored in the control array; - changing the coordinates of the location of the object in the virtual space, the new coordinates of the object in the virtual space are stored in the control array; - changing the shape of the virtual space object, the new coordinates of the object's vertices in the virtual space are stored in the control array; - adding at least one visual effect of the virtual space, the values corresponding to the selected special effect and the parameters of such special effect are stored in the control array. 8. The method of claim 1, wherein the visual effects are special effects including fireworks implemented by a particle system in virtual space. 9. The method of claim 1, wherein the service is an online store, social network, or service provided by an application running on the user's computing device. 10. The method according to claim 1, in which the data provided by users includes registration data in the service, made at least with the possibility of presenting the audiovisual content to the user and made with the possibility of changing the audiovisual content presented to the user by the user and including at least the first name and / or surname , and / or middle name, and / or date of birth, and / or age of the user, and / or user name displayed in the service, and / or an image that is a graphical representation of the user in the service, and / or user profile data in the service. 11. The method according to claim 1, in which the audiovisual content presented to the user is formed and/or modified in a virtual environment formed from at least three-dimensional objects, graphic materials in image and video format, visual effects and audio materials. 12. The method according to claim 1, in which changing the audiovisual content presented to the user is at least changing the properties of the audiovisual content objects presented to the user, where the properties of the audiovisual content objects are at least the coordinates of three-dimensional objects, the coordinates of the vertices of three-dimensional objects, color, shape, geometry , location, transparency of 3D objects and/or visual effects and/or images and/or videos. 13. The method according to claim 1, in which data is received by the central data processing server in response to a request for such data by the central data processing server or according to a predetermined schedule, instructions for which are stored on the user interaction service server, or in response to user actions. 14. The method according to claim 1, in which the video texture is an image generated in real time with a preset frame rate per second, which is transmitted to the virtual space via video texture exchange protocols NDI, SPOUT, RTSP, RTMP, SRT SDI, Memory sharing using capture images by cameras, using camera video capture and/or using web page capture and which is applied in virtual space to predefined objects, changing the visual component of the audiovisual content for presentation to the user. 15. The method according to claim 1, which extracts from the data received from the service server related to changes in audiovisual content, and converts the extracted data into the format of at least one message. 16. The method of claim 15, wherein the message is a JSON message. 17. The method of claim 1, wherein all users who are presented with audiovisual content are notified by adding to the audiovisual content data provided by the user in image, video and/or text format. 18. The method according to claim 1, in which at least two or all users are presented with at least two levels, upon reaching each of which at least one of the parts of the audiovisual content is changed, so that users can observe each of the levels and carry out actions aimed at achieving one or another level in order to change the desired part of the audiovisual content.

Images