RU2739262C1 - Information presentation control method - Google Patents

Abstract

FIELD: computer equipment.

SUBSTANCE: invention relates to the computer equipment. Technical result is achieved by adding to presented content a predefined token related to information for said token, which contains information on presented content or part of content, wherein the token-related information, together with the token identifier, is stored in the data server of the data processing server, wherein the token content is determined by the token parameters set on the server, presenting the token user along with the presented content, using the interface, input of information contained in the token and presented to the user, into the memory of the computing device, transmitting to the data processing server from the computing device the information entered into the user's computing device, obtaining, at the data processing server, the transmitted information and searching for the transmitted information in the data stored in the server database containing the token identifiers, additional information for the found token identifier is transmitted to the user computer from the server and additional information in the visual format and/or audio format is presented on the computing device.

EFFECT: faster information acquisition.

15 cl, 5 dwg

Description

FIELD OF TECHNOLOGY

This invention relates to computer technology and, in particular, to methods for controlling the presentation of information (content), and can be used to control the process of presentation of content presented by content, including by setting and changing parameters (characteristics, etc.), at least the process of presenting content and submitted content, including before and during the process of presenting content.

LEVEL OF TECHNOLOGY

It is known from the prior art to read markers from playback devices and output additional information in augmented reality environment to the user's device corresponding to the readable marker (https://www.sostav.ru/publication/ar-vr-v-reklame-kak-ispolzovat-novyj -opyt-v-kommunikatsii-s-potrebitelem-34312.html), as well as solutions in which a label is added to the video on the TV screen, to which the user points the phone and receives a link, upon selecting which a three-dimensional model is displayed in front of him, or pointing at which the user is presented with advertising material (advertising content).

In addition, a method and system is known in the art for adding an augmented reality marker or a real photo associated with a product to a television broadcast and for using it to establish a connection for ordering goods from an online store or application (see WO 2018212521A1, publ. 22.11.2018), and the invention includes: a marker generator for generating an augmented reality marker for a product; an augmented reality marker server for receiving and storing a marker generated by a marker generator; a token signal generator for generating a signal for a token received from the token server, the signal being generated in a format compatible with the broadcast signal; automatic program controller (APC) to control the signal generation of the marker signal generator; an image synthesizer that receives a marker signal and creates a broadcast image; a transmission terminal for transmitting a broadcast signal; a television for receiving a broadcast signal transmitted from the transmitting terminal and displaying the broadcast signal on a screen; an augmented reality (AR) trading application for marker signal recognition and product order display and menu for adding event image; and a terminal for recognizing a commercial product marker displayed on the television.

Also, from the prior art there is known a method of providing an improved viewing of a broadcast by a user through an augmented reality device (see US 20170201808, published on 07/13/2017), which includes: providing an application on an augmented reality device that is programmed to: receive at least a part of a broadcast displayed on a display device, wherein the broadcast includes an AR layer; displaying images from the camera using an augmented reality device; recognizing in the AR layer the received broadcast of at least one watermark or image; access to the database of watermarks or images and obtain the corresponding data; and rendering the data or a related virtual object as an overlay on the camera image.

Also, a solution is known from the prior art (see US 9449343, published 20.09.2016) for making purchases in augmented reality using a network mobile device, in which a user can perform a number of trading operations with augmented reality using a local client application for purchases on a mobile device, and functions related to the implementation of the current topic may include, but are not limited to, the ability to view an augmented reality image of a shopping display using a mobile device and perform various "e-commerce" functions available through an augmented reality image.

The disadvantages of such solutions are the lack of transmission to the user's computing device of additional information for the presented token associated with the objects presented to the user and data about such objects and events on the content presentation device, storage and retrieval of such additional information associated with the token identifier stored on the data processing server along with additional information, as well as the lack of determination of the content of the marker by the parameters of the marker set on the data processing server, where the parameters of the marker also determine the change in the content and the marker itself during the presentation of the marker and / or the presented content, as well as the lack of input of the information contained in the marker and presented to the user in the memory of the user's computing device.

SUMMARY OF THE INVENTION

The technical result achieved by the proposed invention is to increase the efficiency receiving and processing additional information presented to the user.

Also, the technical result is to simplify and accelerate the acquisition of additional information when presenting the content to the user.

Another technical result is to improve the efficiency of user engagement analysis.

According to one of the embodiments, a method is proposed for controlling the presentation of information, in which: add to the presented content at least one pre-created marker associated with information for this marker, which contains information about the presented content or part of the presented content, and associated with information along with the token identifier is stored in the data storage of the data processing server and the information associated with the token identifier contains additional information, including additional content, transmitted to the user's computing device and displayed on the user's computing device, and at least the content of the token is determined marker parameters set on the data processing server, where the marker parameters also determine the change in the content and the marker itself during the presentation of the marker and / or the presented content; presenting the token to the user on the content presentation device along with the presented content; using the interface of the user's computing device, the information contained in the token and presented to the user is entered into the memory of the user's computing device; transmitting to the data processing server from the user's computing device information entered into the user's computing device; receiving the transmitted information on the data processing server and searching for the transmitted information in the data stored in the data processing server database containing marker identifiers corresponding to the information in the tokens and additional information associated with such marker identifiers; transmitting additional information for the found token identifier to the user's computing device from the data processing server; additional information is presented on the user's computing device, and the additional information presented is presented to the user in a visual format and / or an audio format.

In one particular implementation, the information contained in the marker is presented to the user in a data format suitable for processing by the user's computing device or for perception by the user visually or aurally.

In one particular implementation, the information contained in the marker is presented to the user in text format, in image format and / or in audio format.

In one particular implementation, the information contained in the marker is presented to the user in the format of at least numbers and / or letters and / or words and / or geometric shapes.

In one particular implementation, before presenting the token, the user is presented with a warning message about the upcoming presentation of the token.

In one particular implementation, the content is presented to the user from the media server, which stores the content for presentation, by transferring at least the content to the content presentation device.

In one of the private embodiments, the content presented to the user is supplemented with at least one marker, and the marker can be added by means (and / or, in particular cases, using means, for example, by a user, such as, for example, an administrator) of the media server and / or a processing server and / or a content presentation device and / or a user's computing device.

In one of the particular embodiments, the input of the information contained in the token and presented to the user is performed by the user into the memory of the user's computing device using the means of the user's computing device.

In one of the particular embodiments, the input of the information contained in the marker and presented to the user is carried out by means of the user's computing device in an automated mode.

In one of the particular embodiments, the input of information contained in the marker and presented to the user is carried out in a graphical data format using the camera of the user's computing device, or in a text data format using an input device of the user's computing device, or audio format by means of voice input or sound recording by a computing device microphone. user's device.

In one of the private embodiments, the user enters the information contained in the token and presented to the user using a virtual voice assistant capable of entering data by voice.

In one of the private embodiments, the additional information presented to the user on the user's computing device contains at least the same content that is presented to the user on the content presentation device to the user and / or user interface elements for the user to make a purchase of a product or service associated with additional information presented to the user

In one of the private embodiments, the content is an advertising material or a television show, or a sports broadcast, or an animation, or a film, or a TV series, or a music video.

In one of the private embodiments, the additional information is elements of augmented reality.

In one of the private embodiments, additional information is transferred from one user to another user, from one user's computing device to another user's computing device, in the format of a web page with a single resource locator associated with it, and such a web page includes at least , elements of the user interface and additional content, and for the formation, use and transmission of the web page, the technology of the progressive web application and / or the technology of accelerated mobile pages are used.

BRIEF DESCRIPTION OF THE GRAPHIC MATERIALS

FIG. 1 illustrates an exemplary embodiment of a system implementing the present invention;

FIG. 2 illustrates an exemplary visual marker presentation;

FIG. 3 illustrates an exemplary embodiment of presenting a visual warning message in accordance with the present invention;

FIG. 4 illustrates an exemplary embodiment of a method for carrying out the present invention;

FIG. 5 illustrates an example of a general purpose computing (computer) system:

DESCRIPTION OF OPTIONS FOR CARRYING OUT THE INVENTION

Objects and features of the present invention, methods for achieving these objects and features will become apparent by reference to exemplary embodiments. However, the present invention is not limited to the exemplary embodiments disclosed below, but may be embodied in various forms. The essence recited in the description is nothing more than specific details provided to assist a person skilled in the art in a comprehensive understanding of the invention, and the present invention is defined only within the scope of the appended claims.

Used in the present description of the present technical solution, the terms "module", "component", "element" and the like are used to refer to computer entities, which can be hardware / equipment (for example, a device, tool, apparatus, equipment, part of a device, for example , processor, microprocessor, integrated circuit, printed circuit board, including electronic printed circuit board, breadboard, motherboard, etc., microcomputer, and so on), software (for example, executable program code, compiled application, software module, part of software or program code, and so on) and / or firmware (in particular, firmware). So, for example, a component can be a process running on a processor (processor), an object, executable code, program code, file, program / application, function, method, (software) library, subroutine, coroutine, and / or computing device (for example, microcomputer or computer) or a combination of software or hardware components.

FIG. 1 shows an exemplary embodiment of a system implementing the present invention.

As shown in FIG. 1 , a system implementing the present invention includes at least one (or more) content presentation device (user) 111 , one (or more) user computing device 113 , one (or more) data processing server 115 , one (or more) additional (including intermediate) device 130 , one (or more) data storage.

The content presentation device 111 presents content to the user, in particular, visual content (video content) 117 using the screen of such a device, and audio content using sound reproducing means. The content presentation device 111 may include, but is not limited to, a TV, monitor, laptop, tablet computer (tablet), smartphone, etc. The content presentation device 111 may include means for recording (in particular, recording) sound, converting acoustic vibrations into an electrical signal, for example, a microphone, for recording ambient sounds, for example, the voice (in particular, voice commands) of the user, etc.

The content presentation device 111 may be associated with a data processing server 115 , a media server 121 , a television (television network) 127 , a user's computing device 113 , a data store 123 , etc. for receiving (receiving) and transmitting (sending) data using the Internet 119 , including using additional devices ( 130 ).

The visual content can be information received by the content presentation device 111 and presented (displayed, reproduced, broadcast, etc.) to at least one user in a visual presentation format.

The audible content can be, for example, the soundtrack of the visual content.

So, for example, visual content 117 and audio content can be transmitted and presented (in one of the well-known formats of transmission and presentation of image and sound) educational programs, public events, etc., broadcast on television (television network) 127 , as well as various videos transmitted to the content presentation device 111 , for example, the media server 121 , the data processing server, another user's computing device, a data storage device (for example, NAS - from the English Network Attached Storage, SAN - from the English Storage Area Network), etc. etc.

Visual content and audio content can be transmitted in one of the well-known data transmission formats, including digital, analog.

Shown in FIG. 1, the system also includes a data processing server 115 , which processes data stored in a data store 123 associated with it (including a part of it, connected via a local network, etc.), as well as data received by it from other sources, including servers, user computing devices (user computing devices), etc., as described in the framework of the present invention. The data processed by the data processing server 115 may be, for example, data received from the user's computing device 113 , the media server 121 , a data storage (eg, NAS, SAN, etc.) 123 , etc., as well as data, resulting from the processing of such data by the data processing server 115 .

Shown in FIG. 1, the system may also include one (or more) additional devices (additional equipment) 130 , which can be used, for example, to transfer data (including content) between the media server 121 , the data processing server 115 , the data storage 123 , the content presentation device 111 , user's computing device 113 , etc. For example, auxiliary device 130 can be used to transfer content from media server 121 to content presentation device 111 , to transfer data from data processing server to content presentation device 111 and / or user computing device 113 , etc. The accessory 130 can be, for example, a Wi-Fi router, digital TV receiver, tuner, interface device, etc.

Shown in FIG. 1, the system also includes a user's computing device 113 , using which the user can at least interact with the presented tokens (and content) presented on the content presentation device 111 and transmit data, including information associated with the tokens (token information ), at least one component part (module, device, etc., for example, to the data processing server 115 ) of the system, an example of which is shown in FIG. 1 , and receive data from at least one component of the system, an example of which is shown in FIG. 1 . Also, using the user's computing device 113 , data entry (including by the user or in an automated, automatic, etc., including user initiated, mode) can be performed, as described in the framework of the present invention. Also, on the user's computing device 113 , content (including additional information, including additional content, which is described in more detail below) can be presented to the user. Also, by means of the user's computing device 113 using the software loaded and running on it, the user can interact with the content (including additional information and additional content), user interface elements, including the graphical user interface (GUI, GUI - from English . graphical user interface), in particular for the implementation of actions of various nature, including as described in the framework of the present invention.

User computing device 113 may include audio recording means, for example, to register (eg, record) sound played by content presentation device 111 , speech (voice commands, spoken, user-repeated markers, etc.), etc.

On the user's computing device 113 , software is downloaded and installed on it, with the use of which the user can interact with at least the tokens presented to him, for example, enter information associated with the tokens into the memory of the user's computing device 113 , as described in the framework of the present invention.

Shown in FIG. 1 the system includes at least one 123 datastore. A data store, for example, a data store 123 , can be associated with at least one part of the system or be a constituent element (component, module, etc.) of at least one part of the system, an example of which is shown in FIG . 1 . For example, data store 123 may be part of a data processing server 115 , a media server 121 , a content presentation device 111 , a user's computing device 113 , etc. or may be associated with them using at least one known form of communication, for example, using a wired connection and / or wireless connection.

The content can be stored in the data store 123 , for example, in an open container format for multimedia files (in particular, in an open media container).

The data store 123 , in particular the database, also stores markers (visual, auditory, audiovisual) as well as content identifiers (eg, movie, audio recordings, etc.), as well as the association of the markers with such content identifiers. The content identifier can be the title of the content, the identifier on the media server 121 , etc., and the content identifier uniquely identifies one or another of the mentioned content. The mentioned association of markers with such content identifiers includes, at least, the association of the identifier of the token (set or assigned to the token at the time or after its creation, adding to the mentioned database, in the presented content, etc.) with the identifier of the content (specified or assigned content at the time or after it was created, added to the database, to the media server, etc.). Also, the mentioned connection may include as arguments parameters (characteristics) of presentation (and presentation) of markers and the content of markers.

The mentioned parameters of markers can be the time of the beginning and / or the end of the presentation of the marker in the presented content, the duration of the presentation of the marker, the form of the visual marker, the transparency of the visual marker, the volume of the auditory marker, the location of the visual marker in the visual content, the number of presented markers, the order of presentation of the markers, the joint presentation markers, etc.

It is worth noting that 123 data storage can be at least one hard disk drive (HDD), solid-state drive (solid-state drive / SSD), storage area network (SAN, from the English Storage Area Network) ), a network storage system (NAS, from the English Network Attached Storage) and / or any other device that allows you to write, read and / or store data, in particular content, on a device that implements a data storage. It is also worth noting that the content in the mentioned data storage can be stored in any known format, for example, in the form of at least one database (DB), in the format of video files, audio files, etc. Various database management systems (DBMS) can be used to manage, create and use said database.

Content (audio content and / or visual content), including additional information and additional content, or at least one piece of content, can be broadcast to the content presentation device 111 using the television network or from the media server 121 , and / or from the user's computing device 113 , from the data store 123 , and / or the data processing server 115 , etc.

Also, content, including additional information and additional content, or at least one piece of content, can be broadcast to the user's computing device 113 using the television network or from the media server 121 , and / or from the content presentation device 111 , from the storage data 123 , and / or data processing server 115 , etc.

Shown in FIG. 1, the system includes at least one media server 121 on which it is at least stored and / or generated and / or processed, etc. content transmitted to the content presentation device 111 and / or the user's computing device 113 and / or the data processing server 115 , including for its storage, additional processing, transmission, presentation, etc., depending on the supported ( and the provided) functionality of the part (receiving data) of the system, an exemplary version of which is shown in FIG. 1 .

The media content can also be broadcast from the data processing server 115 , including after it has been transmitted from the media server 121 and / or data storage 123 (and / or from another data source, in particular, content) and additional processing, for example, at least after adding markers (code markers, stimuli) to it, for example, auditory markers and / or visual markers 135 , additional information, including additional content, user interface elements, etc.

FIG. 2 shows an example of one of the variants of presenting a token to a user according to the present invention.

Thus, in FIG. 2 shows an exemplary presentation of a visual marker 135 in visual content 117 presented to a user on a content presentation device 111 .

The visual marker 135 is presented to the user by adding such a marker to the visual content 117 presented to the user. The described visual marker 135 can be presented in one of the known formats for displaying information in a graphic or text format, for example, in the form of an image, in a text format, etc., and before presenting a visual marker 135 it can be pre-converted from one format to another format (by means of a data processing server 115 , a media server 121 , a content presentation device 111 , etc.), for example, from a text format to a graphic, in particular, from text to an optical image using known conversion methods, for example, methods and systems ( optical) recognition of text (characters).

The visual marker 135 can be an animated or static image, and can also move over time within the boundaries of the content presentation area (screen) according to a predetermined algorithm.

The visual marker 135 may be stored and presented, including added to visual content (in particular, visual content) 117 , in one of the known graphic formats, for example, in raster and / or vector formats.

The visual marker 135 can be presented to the user by superimposing two images (visual marker and visual content). So, for example, the visual marker 135 can be presented over the visual content 117 , for example, in a separate layer, or can be presented as a result of mixing with the visual content 117 .

The visual marker 135 can be added using a non-linear video editor, and the visual marker can be added to the visual content, both in advance and during the rendering of the visual content 117 (online, from English online). So, for example, the visual marker 135 can be added to the visual content 117 using an editor, including a non-linear editor, prior to the presentation of the visual content 117 , for example, by adding a marker on the data processing server 115 to the media server 121 , etc., or in the process of presenting visual content 117 , while on the content presenting device 111 (or on the additional device 130 ) software must be installed (downloaded and launched) capable of performing such an addition, for example, said video editor or installed and launched on the content presentation device 111, the media player (multimedia player) must support the addition of the aforementioned visual markers, or in the case of presentation of visual content 117 using web technologies (for example, using web content presentation services), the media player using which content submission, must support the addition of such markers, etc.

Adding (in particular, overlaying) a marker, for example, in a video format, or an image, over the main video track can be carried out using a special additional video track. Thus, several markers (in particular, clips) can be placed in one frame, even without cutting the main video.

Thus, the visual marker 135 can be added (in particular integrated) into the presented visual content 117 , in particular, integrated into the presented visual content 117 , in the format of numbers ("1", "2", "123", etc.), letters (A, B, "C", etc.), words ("Open", "Buy", "Find", "Best offer", "Learn more", etc.), special characters (hyphen , dash, minus, etc.), geometric shapes (square, circle, etc.), mathematical symbols, hieroglyphs, etc. and their combinations, for example, "Offer No. 1", "1-Best Offer, 2-Open", etc.

The audio marker can be added (in particular, integrated) into the presented visual content 117 , in particular, integrated into the presented visual content 117 , in the format of sound, audio, voice message, sequential presentation (playback, pronunciation) of a visual marker, etc.

An audiovisual marker includes at least one auditory marker and a visual marker, wherein an auditory marker can add a visual marker or a visual marker can add an auditory marker. An auditory marker can contain the same information (in particular, meaning, or repeat text, etc.) as a visual marker, and a visual marker can contain the same information as an auditory marker.

So, for example, an audiovisual marker can be an audio recording that repeats (in particular, duplicate) information presented by means of a visual marker. Thus, an auditory marker may contain a voice reproduction of the text contained in the visual marker. For example, a user may be presented with an audiovisual marker containing an image of "Airview 1234" and a voice reproduction of "Airview one two three four", wherein the audio component of the audio visual marker may be presented simultaneously, before or after the visual component. Thus, the user simultaneously sees the presented part of the visual marker (in a particular case, a visual marker) "Airview 1234" and hears the audio component (in a particular case, an auditory marker) "Airview one two three four".

An auditory marker can be presented during (simultaneously), before or after presentation of a visual marker, and a visual marker can be presented during, before, or after presentation of an auditory marker.

An audio marker can contain information that complements the information contained in a visual marker, for example, it can contain a description of a product or service, the name of a website associated with the possibility of purchasing a product or service, etc., or be an additional marker containing additional information, associated with a visual marker. A visual marker may contain information that complements the information contained in an auditory marker,

Marker parameters, such as the start and / or end time of the presentation of the marker in the presented content, the duration of the presentation of the marker, the shape of the visual marker 135 , the transparency of the visual marker 135 , the volume of the auditory marker, the location of the visual marker 135 in the visual content 117 , the number of markers presented, the order presentations of markers, joint presentation of markers, etc., can be set by the user (or in an automated mode, for example, using the algorithm for analyzing previous presentations of markers, the TV channel on which the markers and content are presented, including the location of the TV channel logo, the frequency of user interaction with markers with the same or different parameters, etc.), for example, on the data processing server 115 , and the parameters of the markers can be set before, after or during the creation of tokens, as well as before or during the presentation of the tokens. So, for example, the order of presentation of markers can be set with setting the start time of presentation of markers, when, for example, first the first visual marker is presented ten minutes after the start of presentation of the content, then an auditory marker is presented two minutes after the start of presentation of the first visual marker (or after eleven minutes after the start of presentation of visual content), then a second visual marker is presented one minute after the start of presentation of an auditory marker, etc. Also, the position of markers on the screen of the content presentation device 111 can be specified, for example, one (in particular, the first) visual marker is presented in the upper left corner of the screen of the content presentation device 111 , the second visual marker is presented in the lower part of the screen in the center. The location of visual markers can be set depending on the size (resolution) of the presented visual content, for example, in graphic coordinates, where a point with zero coordinates ({0,0}, x = 0, y = 0) can be located in the lower left corner of the visual content, and the point with maximum coordinates (for example, {1920, 1080} for visual content resolution of 1920x1080), in the upper right corner of the screen. Also, the size of the visual marker can be set, for example, the width and height of the visual marker.

The tokens described in the present invention may be associated with content presented to a user, or a portion of presented content. So, for example, the marker may be associated with the clothing of the character (displayed on the screen of the content presentation device 111 ), the text spoken by the character, etc. So, for example, a character's hat can be associated with a visual marker with the identifier (ID) "12345B", which is presented to the user in an image (or text) format like "Learn more 12345B", and / or with an auditory marker with an identifier (ID) "12345A", which is presented to the user in the format of a voice message "Learn more 12345A", or with an audiovisual marker with an identifier (ID) 12345AB, which is presented to the user in the format of an image (or text) and a voice message "Learn more 12345AB". The marker can be placed anywhere on the screen, including over the character's hat, next to it, from one of the edges of the screen, etc., including so as not to obscure the user with other (including important) elements of the presented content ...

Also, for example, in a television show, the first marker is presented, which is associated, for example, with a jacket (and the corresponding additional information, including additional content presented to the user, as described in the framework of this work), which is worn by the host of the program, the image of which is presented to the user at the moment (or which was or will be presented to the user earlier or later, respectively), and after a certain (including a given) period of time, a second marker is presented associated with the blouse on the presenter, the image of which is presented to the user, including simultaneously with the image of the presenter (and a marker for his jacket) or after the image of the presenter, where the first and second tokens can be simultaneously displayed on the screen of the content presentation device 111 , i.e. the removal of the first marker is carried out with a delay after the display of the presenter's image stops, or the first marker can be removed before the presentation of the second marker.

In a particular case, the location of visual markers is set (for example, by the administrator, or in an automated mode, for example, using the technology of recognizing objects in the image) on the data processing server 115 , or on the media server 121 or any other device on which they can be created, added , edited, posted, etc. markers described in the framework of the present invention.

The placement of the visual marker in a certain place of the visual content (respectively, in a certain place on the screen of the content presentation device 111 , taking into account that the screen content can be displayed as picture-in-picture, in windowed mode, etc.) can be set depending on the simplicity and speed of detection of such a marker by the user. For example, users may more often pay attention primarily to the upper left corner of the screen, the lower part of the screen, etc. In a particular case, for maximum perception of markers, they should be placed precisely in such parts of the presented content (as in the case of placing markers on an object with which such a marker is associated). Also, the setting of the location (position) of the visual marker can be determined depending on its possible overlap (so that the marker will not be visible or part of it will be visible) by other elements displayed on the content presentation device, which can be a TV channel logo, creeping line, device menu content presentation, etc. Such elements are displayed over (overlap) the presented content (and markers) and prevent the user from perceiving (including clear perception) markers. Thus, the location of the markers is set taking into account their possible overlap by other elements, including depending on the characteristics of the content presentation device 111 , the channel on which the content is broadcast, the broadcast network, etc.

Visual markers can be displayed in creeping line, marker list, marker table, marker drop-down menu, etc.

Visual markers can be created using a marker template in a marker editor, for example, on a data processing server 115 (media server 121 and any other device capable of creating and editing a template for creating markers). So, for example, a marker template allows you to set parameters (characteristics) of markers, add images, text, audio recording to a marker, depending on the type of marker being created. So, for example, in the marker editor, the user can open one of the previously created marker templates to create a new marker, and marker templates can differ in pre-selected and saved ones, as well as the marker parameters allowed for change (assignment, editing), marker types, etc. etc. So, for example, the user can select (open) the first template (template No. 1) for the visual type of markers with saved marker parameters, such as allowed (not blocked, for example, by another user, such as the administrator of the data processing server 115 ) height, width , the transparency of the marker and with such a parameter locked for editing as marker location. After adding marker content, for example, marker text, marker image, setting (setting) the marker parameters allowed for editing, the user saves the marker, which can then be associated with one (or more) content, in particular, can be added (integrated) into content.

Before presenting the token, the user can be presented with a warning message containing information that the user will now be presented with the token. Such a message can be either auditory, visual or audiovisual. So, for example, before presenting the token to the user, a text message may be presented to the user on the content presentation device stating that the user will now display the token, and such a message may contain the type of token that will be presented to the user, for example, auditory, visual or audiovisual, as well as information associated with the marker or the object to which the marker is associated. So, for example, the user can display on the screen the message "Now you will be shown a visual marker", "Now you will be played an auditory marker about the jacket that the host of the TV program is wearing". Such a message can be an image, for example, an image of a blinking red lamp, the logo of the company, the manufacturer of the object, an unblinking white square, etc., as well as the sound of a given (including changing) tonality, pitch, length, etc.

The warning message can inform, in particular, warn the user about the need to prepare the user's computing device 113 to register information that contains the marker (eg, text, image, sound) that will be presented to him, as described in the framework of the present invention. So, for example, the user needs to turn on or unlock the user's computing device 113 , open (launch) an application to interact with the token, including with information contained in the token (token data, token presentation data) or associated with it, as described in the framework of the present invention.

In the process of presenting the token to the user on the screen of the content presentation device 111, the information associated with the token may be entered into the user's computing device 113 using the data input interface provided by such user computing device 113 .

Thus, the user can enter the information displayed to him, contained in the presented token (in the representation of the token), using the voice input function of the computing device of the user 113 . Also, the user can enter the information displayed to him, contained in the presented marker (in the marker representation), using the text input means of the user's computing device 113 , for example, using a keyboard, including a virtual one, displayed on the user's computing device 113 . The user can also enter the information displayed to him, contained in the presented token, using the means of registration of the (video) image of the user's computing device 113 , for example, using the camera of the user's computing device 113 .

Thus, when viewing the content, the user sees and / or hears the marker presented to him. The user on his device launches (opens) the application and enters a marker or enters a marker into the address bar of the Internet browser on the user's computing device 113 using at least one of the known data input methods: text input, voice input and input of an image that contains the marker ...

Also, the input of marker information (contained in the marker, in the marker representation) using any other known methods of inputting information (data) in one of the known data presentation formats (text and / or graphic, and / or audio format, in particular, audible, for example, voice).

Said input of the marker information (contained in the marker representation) may be performed using software (application) installed on the user's computing device 113 .

To start voice data input, the user can activate a (graphical) user interface element of said application, for example, select (touch, use the mouse, etc.) a program element of the "button" type.

Also, the user can activate a voice assistant (virtual assistant, virtual digital assistant) downloaded (or built-in, preinstalled) on the user's computing device 113 , for example, "Siri" or "Google Assistant", in particular, by pressing (and holding) the corresponding software buttons or activating the voice assistant by voice (for example, "Ok, Google"), and then enter by voice (say) "Airview one two three four" or "Ok Google Airview one two three four", i.e. the content (all or at least part of) of the marker (for example, an image, including in text format, "Airview 1234"). Next, the information entered by the user using the voice assistant API (and / or the API of the application installed on the user's computing device described in the present invention) is transmitted to the said application installed on the user's computing device for processing (including preprocessing) and transmission to the processing server data, including to provide additional information, as described in the framework of the present invention. Also, the information (data) entered by the user using the voice assistant can be transmitted to the web browser installed on the user's computing device to obtain additional information by the user, and the API of the application installed on the user's computing device can be used to add information to the information entered by the user. web address of the web page (corresponding website) for more information. So, for example, the address of the web page of the website “my_site_airview.ru” can be added to the information entered by the user “Airview one two three four” to obtain a web link of the form “https://www.my_site_airview.ru/Airview one two three four". Also, information entered by the user using the voice assistant by voice (in audio format) can be converted (converted) into a text format, for example, "Airview 1234" (or "Airview 1234", or "Airview one two three four", etc.). by means of an application installed on the user's computing device, or a voice assistant before adding (entering) to the address bar of the web browser. Also, when the user enters information (in text, audio or graphic format) in a web browser, the default search engine can be used, for example, the search engine Google, Yandex, etc., with the use of which by means of the user's computing device (and means provided by the corresponding service), the information entered by the user will be searched, acting in this case as a search query (in particular, converted into a search query, including the search engine format), and the search results are displayed in the form of web links, when the choice of which the user will be moved to the web page corresponding to the entered information to obtain additional information and / or download the application to the user's computing device, described in the framework of the present invention, and / or to implement the opportunity to share the contents of the link (on the web page) additional information with other users lami. When performing a search, a search can be used (and carried out) by the entered image (using the camera), text (by means of manual input or after image processing, audio recording), audio recording.

Thus, using voice input (using, for example, a voice assistant), the user in the application can hold the “icon” for voice input and dictate a marker, for example, “Arview 1234”, which is then transmitted to the data processing server, including after additional conversion to text format (view).

Thus, the user can read aloud the displayed marker information (contained in the presented marker) by pressing and holding the button ("Voice input marker") to enter marker data (information).

Also, the user can enter the marker data by photographing the image of the presented marker using the said camera of the user's computing device 113 , including in the launched said application, for example, by selecting the “button” corresponding to the registration of the image (for example, the “Camera” button, “Take a photo of the marker », Etc.), to enter data (information) of the marker in the image format (photos, videos, etc.).

Also, the user can enter the marker data using an input means (software or hardware) as described above in text format. So, for example, the user can select a button ("icon", "pictogram", "menu item", etc.) corresponding to the input of marker data in text format, and then using a data input means, for example, a software keyboard displayed on the screen of the user's computing device 113 , enter the text contained (displayed) in the marker.

Thus, during text input, the user enters a marker, for example "Arview 1234", into a special field in the software (application) on the user's computing device 113 or enters into the address bar of the Internet browser on the user's computing device 113 .

Also, the input of the marker data can be carried out in an automated mode by means of the user's computing device 113 . For example, the microphone of the user's computing device 113 can be turned on and register (in particular, record) presented audio markers, including sequentially presented markers. Also, the camera of the user's computing device 113 can be turned on and directed (by the user) to the screen of the content presentation device 111 to register visual images of markers (in particular, representations of markers). The launch for automated registration of visual (including graphic and text) and auditory markers can be carried out by the user, for example, after the start of presenting the content to the user, after the marker appears on the screen, etc.

Also, the data entry of the marker can be carried out using the previously registered (in particular, photographed in the case of presentation of the marker in a graphic format or recorded in the case of presentation of the marker in the audio format) presented marker. For example, a user can take a photograph of a visual marker presented to him and save it on the user's computing device 113 , and then (after some time) select it in an application to enter marker data. Also, the user can record the audio marker presented to him and save it on the user's computing device 113 , and then (after some time) select it in the application to enter the marker data.

In a particular case, as described above, at the beginning of the presentation of the content or before the presentation of the first token (or each of the tokens), the user may also be presented with a warning message about the upcoming presentation of the token (s), including to stimulate the user to open (run, install, etc. .d.) an application on the user's computing device for the purpose of entering it into the memory of the user's computing device 113 .

Also, the warning message may contain data for data entry in an automated (or semi-automatic) mode, as described above. So, for example, a warning message may contain an image recorded and processed by the camera of the user's computing device 113 and containing service information about the need to turn on the microphone, display the virtual keyboard on the user's computing device 113 , the need for additional camera settings (in automatic or manual mode), forthcoming the location of the marker, etc.

Also, the registered marker (marker data) entered into the memory of the user's computing device 113 can be converted by means of the user's computing device 113 into one other data format, for example, by means of the computing device, the text displayed in the marker (or the text of the reproduced audio marker) can be recognized and converted from graphic (or auditory) to text format, etc. Such conversion may also be performed by the data processing server 115 after the registered (and / or entered) data has been transmitted, as described in the context of the present invention.

After entering the token data by the user's computing device 113 , the entered token data is transmitted (including after preprocessing such data and / or the token itself by the user's computing device 113 ) to the data processing server 115 .

After the data processing server 115 receives the input token information (data), the data processing server 115 searches for the transferred token information in the database of the data store 123 and associated data. So, the data processing server 115 (for example, the data retrieval module) searches the received information with the stored information in the database, for example, compares such marker information (information contained in the marker) as the marker text (the text contained in the marker) "Learn more than 12345T "with records in the database of the data store 123 and after the record" Learn more than 12345T "is found in the database, the data processing server 115 obtains additional information associated with such a record stored in the same database or related with the data processing server 115 to another database. Also, the search for marker data can be performed on a piece of marker data. The token can contain the identifier of the token in the database. So, for example, in the above example, the text "1234" or "1234T" can be used to search for a marker. In a particular case, the text "1234" can be a marker identifier, and the letter "T" is a sign of the marker belonging to text markers (in a particular case, being a variant of a visual marker).

Also, when entering marker data in an image format, an image is transmitted to the data processing server 115 by the user's computing device 113 , which is compared with the images stored in the data store 123 , in particular in the database, of the data processing server 115 . After finding such an image in the database, the data processing server 115 obtains additional information associated with such an image (in particular, marker data) (including using the marker identifier, additional information identifier, etc.). So, on the data processing server 115, the image is compared with the images contained in the database. Also, additional processing of the image received by the data processing server 115 can be carried out to extract information from it in a text format, for example, using text recognition technologies (converting text from a graphic representation to a textual one). Upon recognition of the marker, additional information can be searched for (and obtained) as described for finding (and obtaining) additional information for the marker data obtained in text format.

Also, when the marker data is entered in an audio format (including in the audio recording format) to the data processing server 115 , the user's computing device 113 transmits the recorded (including recorded or recorded) pronunciation of the marker data by the user using a microphone, or reproduced by the speakers of the content presentation device 111 auditory marker, which are compared with the data of the audio marker stored in the data store 123 , in particular in the database, the data processing server 115 . After finding such an audio marker (audio marker data) in the database, the data processing server 115 receives additional information associated with such an audio marker (in particular, marker data) (including using the marker identifier, additional information identifier, etc.) .). Thus, at the data processing server 115, the auditory marker is compared with the audio markers contained in the database. Also, additional processing of the audio marker received by the data processing server 115 can be carried out to extract information from it in a text format, for example, using text recognition technologies (converting text from an audio format to a text format). Upon recognition of the marker, additional information can be searched for (and obtained) as described for finding (and obtaining) additional information for the marker data obtained in text format. So, for example, using the active microphone of the user's computing device 113 , the soundscape (containing the audio marker data) is registered and transmitted to the data processing server 115 in the format converted into an electrical signal. Further, the received signal is converted by means of the data processing server 155 into a discrete format, and by means of the data processing server 155 , the sound background is analyzed for the presence of an audio marker in it (the audio marker is extracted) using at least one of the known search methods, the variants of which are saved in datastore database 123 . In a particular case, the conversion of the signal into a discrete format can be carried out by means of the user's computing device 113 to transmit it to the data processing server in the converted discrete format.

Thus, said associated additional information can be obtained from a link associated with said entry in the database of the data store 123 to the location of the additional information (for example, to the position in the database, file name, etc.). Also, for additional information, a token identifier corresponding to the token data, corresponding to the token data and stored in the database of data store 123 can be used . So, after finding the marker data in the database of the data store 123 , for example, in the database table (table 1), the data processing server 115 receives the marker identifier from the same table (for example, from a neighboring cell of the table) or from another table (table 2 ) by key, if, for example, the data is stored in key-value tables (or using the hash value if the data is stored in a hash table), or in any other known way. Further, according to the token identifier, the data processing server 115 searches for additional information stored in the data store 123 (or other associated with the data processing server 115 ), for example, using a database table that stores the relationship of the token identifiers and additional information. Next, the data processing server 115 transmits the found additional information (including using the additional information identifier associated with the token identifier and / or content, in particular, data, token) additional information to the user's computing device 113 .

The additional information found is transmitted to the user's computing device 113 in a format suitable for execution by software (application) installed on the user's computing device 113 . So, for example, additional information can include additional content that can be displayed on the user's computing device 113 , for example, a video, voice message, user interface elements, etc., and with which the user can interact, for example, select these items (select soft buttons by touching their images on the screen, select using the mouse, etc.).

In a particular case, marker data (or at least part of it, for example, text contained in markers, marker images, etc.), as well as marker identifiers, can be downloaded to the user's computing device 113 (and stored on it ), so that processing (or at least part of it) of registered tokens (token data) can be performed on such a computing device of the user 113 . So, for example, on the user's computing device 113 , a comparison of token data can be performed, as well as a search for token identifiers, so that only token identifiers are transmitted to the data processing server, which makes it possible to reduce the network load (for example, in the case of a low data transfer rate, limited available traffic, including Internet traffic, etc.) by reducing the amount of transmitted data.

Additional information may include information about the submitted content. For example, if a marker is integrated into an advertising video, then additional information may contain information about the advertised product, as well as the possibility of purchasing this product without further switching to third-party resources, but not excluding the possibility of switching to a third-party resource. The purchase can be made by the user using elements of the software interface installed on the user's computing device 113 , including those transmitted for a specific token and / or content to the user's computing device 113 along with additional user information. So, for example, the user can select the software "button""Buygoods" displayed to him to go to the process of selecting and paying for the goods.

Additional information can be previously transmitted to the user's computing device 113 (for example, from the media server 121 and / or the data processing server 115 ), for example, after or during the installation of software (application) on the user's computing device 113 , after presenting a warning message, after the beginning of the presented content, including depending on the presented content and / or the markers contained therein.

If the marker is presented upon presentation of a music video (TV show, film, series, etc.), then additional information may contain information about the clip and / or the performer, about heroes, actors, players, as well as the possibility of purchasing goods presented in the presented content, including the provision of the ability not to switch to third-party resources.

Also, additional information can include elements of augmented reality with which the user can interact through the interface provided by the application, for example, characters of animated films (animation) can be displayed on the user's computing device 113 , including launching other installed applications, mini-games, controlling characters, and etc. Elements of augmented reality (in particular, displayed on a separate layer) can be presented together with content presented on the user's computing device 113 , duplicating the content presented on the content presentation device 111 , or without it, and the user can direct the user's computing device 113 to the display device screen content 111 so that the augmented reality elements are displayed in addition to the content (including over the content) displayed on the content presentation device 111 . So, the user can interact with cartoon characters in augmented reality using the user's computing device 113 , as well as buy goods (order services) related to these characters, for example, toy copies of these characters, order animators for these characters, etc. etc.

Also, as described in the framework of the present invention, additional information can be (may be presented, presented, etc.) information duplicating (including copying), supplementing (in particular, revealing) the presented content on at least one device of the system, an exemplary embodiment of which is shown in FIG. 1 , for example, on a content presentation device 111 and / or a user's computing device 113 . Thus, the marker can be used to transfer (duplicate, supplement, etc.) content, for example, to the user's computing device 113 .

After the end of the user's interaction with augmented reality (elements of augmented reality, including markers), he can leave the environment of augmented (virtual, etc.) reality and return to viewing the presented content, including at the time at which it was the user interacted with the marker, started submitting additional information, etc. (in particular, the presentation of content can be paused or stopped, including stopped), or at the current time of presentation of the content, in particular, without pausing (stopping, etc.) the presentation of the content on the content presentation device 111 .

Each of the markers can be added (assigned, set, etc.), for example, using the data processing server 115 to each specific time interval (or specific time) of the presented content, or one marker can be added to several time intervals of the presented content, and the token may contain information about the content being presented at such a time period (or starting at such a moment in time), or it can be associated with information about the presented content.

The token, as well as the information in it (information associated with it, etc.) can be changed (including it can be changed, for example, by means of the data processing server 115 , the content presentation device 111 , etc.), for example, each a specified period of time, for example, every ten seconds, one minute, etc., and the marker can be changed to another marker. So, for example, both the marker itself and the information contained in it can be changed, including without changing the information presented in the marker. So, for example, different information can correspond to one image (visual representation) of one marker, for example, depending on the time of the marker presentation. So, for example, if a visual marker is presented in the format of a one-dimensional code (1D-code), for example, EAN (from the English European Article Number, European product number), UPC (from the English Universal Product Code, universal product code), and / or a two-dimensional code (2D code) like DataMatrix code, QR code, etc., i.e. contains encoded information, then one such image (in particular, a code image) can correspond to different information (or a part of information that is different from each other) stored in the database of the data store 123 of the data processing server 115 .

In a particular case, the data processing server 115 can analyze the actions of users with markers, including depending on the presented content, including with the aim of increasing the level of perception of markers by users. So, for example, if the user interacts more often with markers located in the lower right part of the screen of the content presentation device (including in the same content presented to different users), but less often interacts with markers located in the upper left part of the screen, then the location can be changed (for example, by means of the data processing server 115 and / or by the user using the means of the data processing server 115 ) for other markers placed in the same content or other content, including for the same or different (different) additional content associated with the same or different marker (s).

The described invention makes it possible to trace (and build) a chain from the presentation of content to the user, to the purchase by the user of a product (service), including the stage of presenting tokens and interaction with them by the user.

Also, using the computing device of the user 113, users can share with other users the presented content, additional information, including information about goods and services, etc. with other users, including through social networks (using the API, from English - application program interface), for example, using the “Share” soft button in the application (software) interface installed on the user's computing device 113 .

When ordering goods by the user, the user can display interface elements that allow him to select the quantity of the ordered goods, delivery address, etc., and also allows him to pay for his order using other applications installed on the user's computing device 113 or using the API provided by such applications (services, etc.).

FIG. 3 illustrates an exemplary presentation of a visual alert message 156 in accordance with the present invention.

FIG. 4 shows an exemplary embodiment of an embodiment of the present invention.

In step 401 , at least one pre-created token is added to the presented content, associated with information for this token, which contains information about the presented content or part of the presented content, and the information associated with the token, together with the token identifier, is stored in the data store of the processing server data and information associated with the identifier of the token contains additional information, including additional content, transmitted to the user's computing device and displayed on the user's computing device, and at least the content of the token is determined by the token parameters set on the data processing server, where the token parameters also determine the change in the content and the marker itself during the presentation of the marker and / or the presented content.

A part of the presented content can be an object contained in the presented content. Thus, a part of the content can be an image of a part of the presented content, for example, an image of an object in the presented content.

In a particular case, the information contained in the marker is presented to the user in a format that can be processed by the user's computing device or perceived by the user visually or by ear.

In a particular case, the information contained in the marker is presented to the user in text format, in image format and / or in audio format.

In a particular case, the information contained in the marker is presented to the user, at least in the format of numbers and / or letters, and / or words, and / or geometric shapes, and / or mathematical symbols, and / or hieroglyphs and their combinations.

In a particular case, a visual marker is added to visual content using an editor, including a non-linear editor, before the presentation of the visual content begins, for example, by adding a marker on the data processing server, a media server, etc., or during the presentation of visual content, while on the content presentation device (or on an additional device), software is installed that is capable of performing such an addition.

In step 411, the token is presented to the user on the content presentation device along with the presented content.

In a particular case, before presenting the token, the user is shown a warning message about the upcoming presentation of the token.

In a particular case, the presentation of the content to the user is carried out from the media server, which stores the content for presentation, by transferring at least the content to the content presentation device.

In a particular case, the content presented to the user is supplemented with at least one marker, and the marker can be added by means (and / or, in special cases, using means, for example, by a user, such as, for example, an administrator) of the media server and / or server processing and / or device for presenting content, and / or computing device of the user.

In a particular case, a visual marker is stored and presented, including added to visual content, in one of the well-known graphic formats, for example, in a raster image format and / or a vector image format.

In a particular case, a visual marker is presented to the user by superimposing two images on top of each other (visual marker and visual content). In a particular case, a visual marker is presented on top of the visual content, in particular on a layer different from the layer on which the visual content is presented or in the same layer after it has been combined with the visual content.

In step 421 , using the interface of the user's computing device, the information contained in the token and presented to the user (in the format of a token) into the memory of the user's computing device is entered.

In a particular case, the input of the information contained in the token and presented to the user is carried out by the user into the memory of the user's computing device using the means of the user's computing device.

In a particular case, the input of information contained in the marker and presented to the user is carried out by means of the user's computing device in an automated mode.

In a particular case, the input of the information contained in the marker and presented to the user is carried out in a graphical data format using the camera of the user's computing device, or text data format using an input device of the user's computing device, or audio format by means of voice input or sound recording by a microphone of the user's computing device.

In a particular case, the input of the information contained in the marker and presented to the user is carried out by the user using a virtual voice assistant capable of entering user data by voice.

In step 431 , the user computing device transmits to the data processing server the information entered into the user computing device.

In step 441, the processing server receives the transmitted information and searches for the transmitted information in the data stored in the database of the processing server containing token identifiers corresponding to the information in the tokens and additional information, including additional content, associated with such token identifiers.

In step 451, the data processing server transmits additional information, including additional content, for the found token identifier to the user's computing device.

In step 461 , additional information, including additional content, is presented on the user's computing device, and the presented additional information is presented to the user in a visual and / or audible format, including the format of user interface elements.

In a particular case, the additional information presented to the user on the user's computing device contains at least the same content that is presented to the user on the content presentation device to the user.

The described invention can be used in advertising, when the user broadcasts and watches TV shows, sports broadcasts, animation, films, TV series, music videos, etc.

The described invention, in which at least the presentation, reading and recognition of markers in the presented content is carried out, as well as the presentation (output) on the user's device of information corresponding to the marker, in particular additional information, allows at least the user in a convenient form to make purchases while watching TV, increase the level of sales of goods presented in the broadcast content, free up warehouse space faster, in connection with the accelerated sale of goods using the proposed invention, or abandon the use of at least part of the warehouse space, due to more accurate sales forecasting based on the analysis of user demand generated by advertising content. So, in a particular case, as described in the framework of the present invention, depending on the types (and parameters) of tokens, the user has several methods of obtaining information from the content presentation device in the user's computing device, some of the options of which are given below:

- download (install) the application on the user's computing device, point the user's computing device camera to the content presentation device;

- manually enter the code from the content into a special field in the application installed on the user's computing device;

- turn to a voice assistant, for example, "Siri" or "Google Assistant",

after which (the aforementioned actions, including interaction with markers), additional information and a menu for managing information expressed by graphic icons (icons, etc.) are displayed on the user's computing device.

So, as described in the framework of the present invention, each marker can have its own interface, in particular, a set of user interface elements, including the information management menu expressed by graphic icons (icons).

So, graphic icons, icons (icons) of information management can be, but are not limited to:

- an icon (icon) for playing 3D content within the interface displayed on the user's computing device;

- an icon (icon) for launching augmented reality, for example, putting a model of a food processor on a table in augmented reality, inside the interface;

- icon (icon) for starting and playing video inside the interface;

- an icon (icon) for launching the purchase functionality within the interface (buy a product).

- an icon (icon) that activates the functionality that allows you to share information using the means (systems) of exchange, including instant messages, for example, in "messengers".

- an icon (icon) is a cross-function that implements the functionality within the interface responsible for displaying information about related products, groups of products for the presented product initially, as well as displaying information - people buy with this product.

- an icon (icon) add to the favorites interface containing information, including the information management menu expressed by graphic icons (icons), for subsequent quick access to it and search.

Also, for example, if the user is presented with an advertisement for a watch, then the user, after interacting with the marker using the interface, can point the camera of the device at the hand, and the camera determines the location of the hand in space (relative to the camera of the user's computing device), and the watch is displayed on the hand in augmented reality (watch on hand).

So, for example, the user can select the cross-function icon in the interface to display on the user's computing device interface elements with goods or groups of goods that are adjacent or close in content to the previously selected product, to which the cross-function icon corresponded (for example, for a presented wine after selecting the icon cross-function, the user is offered other wines, including this manufacturer, or combined products such as cheese, in the format of application interface elements with which the user can interact, as described in the framework of the present invention).

Also, additional information presented to the user and with which he can interact (including which he can control) using the interface may contain a three-dimensional model (3D model) of the product, be able to try it on in augmented reality, receive additional audio and video information, make an instant purchase, for example, using the technology of mobile payment systems and electronic wallets (for example, "Apple Pay"), share information with other users who will also have access to the listed functions, including after downloading the application to users' devices or from using the web interface.

Depending on the type of marker and place, objects, etc. its presentation (placement), the following options are possible:

- a marker integrated into an advertising video allows you to quickly get information about the advertised product and immediately buy it without further switching to third-party resources;

- a marker integrated into the music video allows you to get additional information about the video and the artist, as well as buy the goods that are presented in the video;

- a marker integrated into a program broadcast on television or a sports broadcast, or an announcement, allows you to obtain additional information about heroes, players and buy goods presented in a sports broadcast or broadcast;

- a marker integrated into a cartoon or animated content allows you to interact with cartoon characters in augmented reality on the user's device, as well as buy a toy for these characters;

- a marker integrated into a film or series allows you to get information about the actors in the frame and buy the clothes the actors are wearing;

- a marker applied to a physical object, for example, a product, allows you to obtain information about this product on the user's computing device;

- a marker printed in the advertising module of a glossy magazine, for example, a watch, allows you to get information about this product, try them on in augmented reality and buy immediately without further switching to third-party resources.

The described invention allows you to save and accumulate data, and also allows you to track the entire chain of user interaction with information on all devices, applications and platforms, including using the application installed on the user's device, including user interaction with tokens, with additional information, application interface elements etc.

In a particular case, the technologies and advantages of the present invention are a tool for converting content coverage, including television content, into real-time sales, a tool that links content and sales.

The described invention also allows the additional information described in the present invention to be reproduced in the same (its) format in its full functionality on other computing devices (including computing devices of other users (interoperability). For example, if the first user shared, for example, in messenger, additional information (or information contained in the marker) with another (second) user, then additional information can be presented to the second user on another computing device in a web format (in particular, using a web view, Webview), in particular, reproduced in the environment (environment, shell) of the software in which the second user received information from the first user, for example, in the "shell" of the messenger, and the second user is provided with the same functionality that is available to the first user (perform all actions from it, as in attached ai) - buy, try on in augmented reality, etc.

In a particular case, the additional information transmitted to the computing device (user) is transmitted in the format of a web page with its own generated (data processing server, computing device of the user from which additional information is transmitted, etc.) a single resource locator (URL), moreover, such a web page may include at least user interface elements, for example, content management menu icons and the content itself, and the web page can be implemented using PWA technologies (from the English Progressive Web Applications - progressive web application) and / or AMP (Accelerated Mobile Pages - technology of accelerated mobile pages).

In some implementations, the data processing server is configured to analyze user engagement based on the presented content tokens. Thus, in some embodiments, at least one portion of the system, an exemplary embodiment of which is shown in FIG. 1 (for example, a data processing server, a content presentation device, etc.), can, for example, change the parameters of markers, presented content, additional information (for example, change the time of presentation of content and an associated marker, change the location of markers, brightness of content , transparency of markers, speed of presentation of markers, time between presentation of markers, etc.), including for identifying the best (optimal) location of the marker, in particular for determining the efficiency of location (placement) of the marker (for example, using a neural network), in a particular case in order to increase conversion. Also, to identify (determine, calculate) the effectiveness of the location (placement) of the marker (increase conversion, etc.), the resulting (in the process) of the user's interaction with the user's computing device (as well as the content presentation device and other parts of the system) , an exemplary version of which is shown in FIG. 1 ), for example, registered by software installed on the user's computing device (content presentation device, etc.).

So, such recorded data, which are further processed by means (in particular, parts) of the system, including after they are received by such parts of the system, may be the time spent by the user in the interface advising a specific marker (in particular, the average time), the time of user interaction with the type of content, the number of views of content units, including animations in augmented reality, as well as the number of views of all content to which this metric can be applied. Also, such processed data can be the average viewing duration (average viewing duration in minutes); time (viewing) during which the user watched the video, animation; the total number of minutes of content, the ratio of the total number of minutes of content to the retention of the user within the interface - the time spent in it; cumulative time spent by users in the interface; the number of interface launches for each carrier of the token presentation, for example, product packaging, TV screen, monitor, module in the log, total number of launches; the recognition rate (Recognition rate) by carriers of presentation of tokens, the number of repeated calls by one user to a specific interface corresponding to a specific marker, indicating the types of content that motivates the user to restart; the average number of launches of the interface corresponding to a specific marker by one user; the number of users who added the interface corresponding to a specific marker to their favorites; number of interface launches from favorites; the number of requests in the search for a specific interface; the number of launches of the interface from the search; the number of users shared by the interface; the number of launches of the interface in third-party applications.

In a particular case, the data entered by the user, for example, the content of the marker, processed by the system means, as well as the content (in particular, the data and content parameters), markers, etc., processed by the system means, can be used to determine the effectiveness of the placement presented along with the content. markers. So, for example, the parameters (and data) of the content can be determined by the means of the system (for example, by the data processing server), so, for example, the brightness of the presented content in various parts of such content can be determined (calculated), for example, by processing a stored or presented video file (video stream, etc.), in particular, the brightness of the part can be determined. content. So, for example, it can be determined that part of the image in the upper right corner of the video content in the time interval from the twentieth minute to the twenty-first minute of the video content contains a light background on which a marker will be clearly visible, including a dark marker (for example, black text, text on a black background, a dark image such as a black hat, etc.). Therefore, it is more effective to place a darker marker on such an area. On the contrary, it is more effective to place light markers on a darker background, also because they are more visible to the user (in particular, the probability of attracting the user's attention is higher), and, therefore, the user is more likely to pay attention to the more noticeable (including in relation to other parts of the content) marker. After identifying such prominent content areas by means of the system, the marker parameters can be changed, for example, its location upon presentation, the marker background color, marker transparency, marker text, etc. can be changed, or another marker can be selected, more noticeable in the corresponding area. content. Also, to determine the effectiveness, the frequency of user interaction with markers can be used depending on the marker parameters (for example, the user often interacts with markers located in the upper right corner of the screen, on a light background, presented in the evening, at the beginning of content presentation, etc. .), content parameters, etc., for example, depending on the location of the marker (including depending, for example, on the brightness of part or all of the content), the time of its presentation, the time of presentation of the content, etc., and such the data is processed by the means of the system, including can be processed by a neural network to determine the effectiveness of marker parameters. Also, to determine the effectiveness of the marker parameters, for example, audio markers, content data, both video content and audio content, can be processed, for example, by means of the system, a time interval can be calculated when the sound volume in the content (video content) is lower (for example, during one minutes, etc.), in relation to parts of the content before and after such a period of time, and in such a period of time it is more effective to present audio content, since the user is more likely to pay attention to it (including hearing it). Also, moments of time with a sharp increase in the volume of a sound (for example, explosion, splash, scream, etc.) or with other sounds attracting the attention of users (silence, mouse squeak, hiss, etc.), during ( or after) which is more effective to present the user with an auditory marker or visual marker.

To determine the efficiency of the marker parameters (including the efficiency of marker placement), a neural network can be used, during training of which data including marker parameters (for example, marker location, marker presentation time) is transmitted to the input of at least one layer. Also, data is transmitted to the input of at least one layer, including the above-described specific features of the content with parameters of such features (for example, the time of occurrence and end of such features, for example, the start and end times of loud music, the start and end times of the display of the light content area etc.).

Also, the input of at least one layer is data including data entered by the user, in particular, data of the user's interaction with the markers, for example, the content of the markers entered by the user. For example, a user interacted with a token with a unique identifier "123" with the specified parameters "upper left corner, presentation time 20 seconds", presentation start - 20 minutes from the start of content presentation, etc., in content with a unique identifier "1235423" 20 times in 20 submissions of such content, and with a marker with a unique identifier "1341" with the specified parameters "upper right corner, submission time 200 seconds", submission start - 40 minutes from the end of content submission, etc., in content with a unique identifier "1242" the user interacted 10 times in 40 submissions of such content, therefore it is more efficient to place the marker, as in the first case than in the second, therefore, it is necessary to process (in particular, analyze) such data, including using a neural network, transmitting the indicated parameters, identifiers, etc., for at least one input layer of the neural network,

Further, the parameters of at least one marker are fed to the input of at least one layer of the neural network in order to obtain (calculate) the efficiency factor for placing such a marker depending on the input data (including content data, content presentation devices, etc.) ). If the coefficient is below the specified threshold, then the input data of the neural network (marker parameters, etc.) is changed in order to obtain a higher (in particular, maximum) marker placement coefficient. Setting and changing the input parameters of markers can be carried out by means of the system, for example, by a data processing server, including until a predetermined (or maximum of all possible) marker placement coefficient is reached, including for a given content (with given parameters).

Thus, using at least the above-mentioned input data (including collected statistics, statistical data), the neural network is trained in order to obtain the efficiency coefficient of the marker parameters at the output of the neural network, including for certain content, for example, the coefficient the effectiveness of placing a visual marker with a unique identifier "1234" in the content "Video 123454", an efficiency factor of placing an audio marker with a unique identifier "12346" in the content "Video 123454", and so on. Thus, a neural network can at least be used to determine the efficiency of placing (in time, in location) markers in the content.

FIG. 5 illustrates an example of a general-purpose computing (computer) system that includes a multipurpose computing device in the form of a computer 20 or server, including a processor 21, system memory 22, and a system bus 23 that links various system components, including system memory to the processor. 21.

The system bus 23 can be any of various types of bus structures, including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. System memory includes read-only memory (ROM) 24 and random access memory (RAM) 25. ROM 24 stores a basic input / output system (BIOS) 26, consisting of basic routines that help exchange information between elements within a computer 20, for example, at the time of launch.

The computer 20 may also include a hard disk drive 27 for reading from and writing to a hard disk not shown, a magnetic disk drive 28 for reading from or writing to a removable magnetic disk 29, and an optical disk drive 30 for reading from or recording on a removable optical disc 31 such as a compact disc, digital video disc, and other optical media. The hard disk drive 27, the magnetic disk drive 28, and the optical disk drive 30 are connected to the system bus 23 through a hard disk drive interface 32, a magnetic disk drive interface 33, and an optical drive interface 34, respectively. The storage media and their corresponding computer-readable media provide non-volatile storage of computer-readable instructions, data structures, program modules, and other data for the computer 20.

While the typical configuration described herein uses a hard disk, a removable magnetic disk 29, and a removable optical disk 31, one skilled in the art will appreciate that other types of computer readable media may also be used in a typical operating environment that can store data that is accessible by a computer. such as magnetic cassettes, flash memory cards, digital video discs, Bernoulli cartridges, random access memory (RAM), read only memory (ROM), and the like.

Various software modules, including the operating system 35, can be stored on a hard disk, magnetic disk 29, optical disk 31, ROM 24, or RAM 25. Computer 20 includes a file system 36 associated with or included in operating system 35, one or more software application 37, other program modules 38, and program data 39. A user can enter commands and information into computer 20 using input devices such as keyboard 40 and pointing device 42. Other input devices (not shown) may include a microphone , joystick, gamepad, satellite dish, scanner or any other.

These and other input devices are connected to the processor 21, often through a serial port interface 46 that communicates with the system bus, but may be connected through other interfaces such as a parallel port, a game port, or a universal serial bus (USB). A monitor 47 or other type of display device is also connected to the system bus 23 via an interface such as a video adapter 48. In addition to monitor 47, personal computers typically include other peripheral output devices (not shown) such as speakers and printers.

Computer 20 may operate in a networked environment through logical connections to one or more remote computers 49. The remote computer (or computers) 49 may be another computer, server, router, networked PC, peer-to-peer device, or other node on a single network, and also typically includes includes most or all of the elements described above in relation to computer 20, although only storage device 50 is shown. Logical connections include a local area network (LAN) 51 and a wide area computer network (WAN) 52. Such networking environments are commonly found in institutions , corporate computer networks, the Internet.

A computer 20 used in a LAN environment connects to a local area network 51 via a network interface or adapter 53. A computer 20 used in a GCS network environment typically uses a modem 54 or other means to communicate with a global computer network 52 such as the Internet.

Modem 54, which can be internal or external, is connected to the system bus 23 via a serial port interface 46. In a networked environment, program modules or portions thereof described with respect to computer 20 may be stored on a remote storage device. It will be appreciated that the network connections shown are typical and other means may be used to establish communication links between computers.

In conclusion, it should be noted that the information given in the description are examples, which do not limit the scope of the present invention defined by the claims. One skilled in the art realizes that there may be other embodiments of the present invention consistent with the spirit and scope of the present invention.

Claims (22)

1. A method for managing the presentation of information, in which: - add to the presented content at least one pre-created marker associated with information for this marker, which contains information about the presented content or part of the presented content, and the information associated with the token, together with the token identifier, is stored in the data store of the data processing server, and information associated with the token identifier contains additional information, including additional content, transmitted to the user's computing device and displayed on the user's computing device, and at least the content of the token is determined by the token parameters set on the data processing server, where the token parameters also determine changing the content and the marker itself during the presentation of the marker and / or the presented content; - present the token to the user on the content presentation device together with the presented content; - using the interface of the user's computing device, the information contained in the token and presented to the user is entered into the memory of the user's computing device; - transfer to the data processing server from the user's computing device information entered into the user's computing device; - receive the transmitted information on the data processing server and search for the transmitted information in the data stored in the database of the data processing server containing marker identifiers corresponding to the information in the tokens and additional information associated with such marker identifiers; - transfer to the user's computing device from the data processing server additional information for the found marker identifier; - additional information is presented on the user's computing device, and the additional information presented is presented to the user in a visual format and / or an audio format. 2. The method of claim 1, wherein the information contained in the token is presented to the user in a data format suitable for processing by the user's computing device or for the user to perceive visually or aurally. 3. The method of claim 1, wherein the information contained in the marker is presented to the user in text format, image format and / or audio format. 4. The method according to claim 1, wherein the information contained in the marker is presented to the user in a format of at least numbers and / or letters and / or words and / or geometric shapes. 5. The method of claim 1, wherein prior to presenting the token, the user is presented with a warning message about the impending presentation of the token. 6. The method according to claim 1, wherein the presentation of the content to the user is carried out from a media server that stores the content for presentation by transmitting at least the content to the content presentation device. 7. The method according to claim 1, wherein the content presented to the user is supplemented with at least one marker, and the marker can be added by means of a media server and / or a processing server and / or a content presentation device and / or a user's computing device. 8. The method according to claim 1, wherein the input of the information contained in the token and presented to the user is performed by the user into the memory of the user's computing device using the means of the user's computing device. 9. The method according to claim 1, wherein the input of the information contained in the token and presented to the user is carried out by means of the user's computing device in an automated mode. 10. The method according to claim 1, wherein the input of the information contained in the marker and presented to the user is performed in a graphical data format using the camera of the user's computing device, or a text data format using an input device of the user's computing device, or an audio format using voice input, or registration of sound by the microphone of the user's computing device. 11. The method according to claim 1, wherein the user enters the information contained in the token and presented to the user using a virtual voice assistant capable of entering data by voice. 12. The method according to claim. 1, in which the additional information presented to the user on the user's computing device contains at least the same content that is presented to the user on the content presentation device to the user and / or user interface elements for the user to purchase a product or service, related to additional information presented to the user. 13. The method according to claim 1, wherein the content is an advertising material or a TV show or an announcement, or a sports broadcast, or an animation, or a film, or a TV series, or a music video. 14. The method according to claim 1, wherein the additional information is elements of augmented reality. 15. The method according to claim 1, in which additional information is transferred from one user to another user, from one computing device of the user to another computing device of the user, in the format of a web page with an associated single resource locator, and such a web page includes at least user interface elements and additional content, wherein progressive web application technology and / or accelerated mobile page technology is used to generate, use and transmit the web page.

Images