WO2020085943A1 - Procédé de démonstration interactive d'informations contextuelles lors de la reproduction d'un flux vidéo - Google Patents

Procédé de démonstration interactive d'informations contextuelles lors de la reproduction d'un flux vidéo Download PDF

Info

Publication number
WO2020085943A1
WO2020085943A1 PCT/RU2019/000541 RU2019000541W WO2020085943A1 WO 2020085943 A1 WO2020085943 A1 WO 2020085943A1 RU 2019000541 W RU2019000541 W RU 2019000541W WO 2020085943 A1 WO2020085943 A1 WO 2020085943A1
Authority
WO
WIPO (PCT)
Prior art keywords
contextual information
video stream
information
user
frame
Prior art date
Application number
PCT/RU2019/000541
Other languages
English (en)
Russian (ru)
Inventor
Станислав Бернардович ДУХНЕВИЧ
Original Assignee
Станислав Бернардович ДУХНЕВИЧ
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Станислав Бернардович ДУХНЕВИЧ filed Critical Станислав Бернардович ДУХНЕВИЧ
Publication of WO2020085943A1 publication Critical patent/WO2020085943A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/48—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2387—Stream processing in response to a playback request from an end-user, e.g. for trick-play
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally

Definitions

  • the invention relates to computer and television technology, and in particular to methods of reproducing video information, and can be used for interactive demonstration of contextual information when playing a video stream.
  • contextual information refers to information related to the image contained in a particular frame or a specific area of the frame specified by the user, and not to the video stream as a whole.
  • Arbitrary information is understood as information in any format at the choice of the organizer of the distribution of information, as well as information that is not strictly connected with the video stream and can be added, deleted or changed at any time between the formation of the video stream and its viewing by the consumer.
  • An interactive demonstration is understood to be a demonstration that is initiated by the user, while the user selects a point in time, the object within the frame for which he wants to receive contextual information, can stop demonstrating the requested contextual information at any time, and also has the ability to interact with contextual information.
  • Video editing methods are widely known that require changes to the original video information; a subtitle demonstration in which information displayed is limited to text format; none of these methods provides interactive interaction with the user, reproducing additional information in a predetermined volume.
  • a disadvantage of video editing is that the information entered with it cannot be updated after the video file is delivered to the user.
  • tickers according to the patent RU 128050 U1, published 2013-05-10, US 2015067733 A1 and similar solutions that allow dynamic change of the contents of the ticker, which can be not only subtitles or other text information, but also hyperlinks updated real-time data or even another video stream.
  • the above inventions are in fact a menu system similar to the menus in windows of the Windows, Linux, Mac OS X and other graphical computer operating systems for television programs.
  • the tickers are controlled by a menu bar along the lower edge of the TV screen.
  • the TV’s remote control is used, which does not have a means of displaying the cursor on the screen, methods for accurately positioning the user's control action, and allows extremely discrete movement of the “ticker” menu items.
  • this invention is applicable only to television, does not have universality, does not solve the problem of demonstrating contextual information for video files on a computer that are played from a DVD or other source on a video player, broadcast from the Internet, and so on.
  • tickers also do not correlate with specific frames in time. Moreover, it follows from the description that the ticker is generally shown constantly if the broadcaster has decided to provide the broadcast or even the entire television channel with a ticker, regardless of the user's desire to see information from the ticker or refuse to view this information.
  • tickers information in “interactive tickers” is not contextual, as it is not directly related to frame elements (events on the screen, displayed objects or other parts of the image);
  • interactive tickers do not provide for the determination of either the coordinates of the control action, or the time moment of the control action with respect to the video stream, but only discrete interaction with menu items.
  • Interactive tickers do not imply the processing and synchronization of contextual information with the video stream. - “interactive tickers” can only be realized in television broadcasting systems of a video stream and cannot be saved together with a video file on a computer’s hard drive, DVD-ROM or other storage medium;
  • tickers can only be text or hypertext information, the tickers do not allow the demonstration of video, photos, play sound files, and so on;
  • tickers does not have the ability to pause the video stream, so the user’s attention is scattered: either he is distracted from the content of the broadcast and interacts with the ticker, or absorbed in events on the screen and does not notice the information in the ticker;
  • tickers are shown to the user at the request of the broadcaster, if the user does not need tickers or the information in the tickers is not relevant for him, he is still forced to see them;
  • tickers provide only hardware (Ticker device), but not software processing, and thus are not feasible without special new equipment.
  • tickers in the form of pop-up windows for Internet browsers described in US Pat. No. 8,645,856 B1.
  • the ticker display area shows the ticker moving hypertext data associated with the selected ticker types and fields.
  • Ticker data may be provided by third-party providers such as sponsors.
  • Activating ticker hypertext data displays related information.
  • This technical solution is intended for organizing a demonstration of pop-ups on the Internet when browsing sites. Since it has nothing to do with video playback, transmission and reception of a television signal, and similar problems, it does not solve the corresponding problems.
  • the interaction of users with web pages is a long-known process, and the similarity of the names of “tickers” should not be misleading regarding their functionality.
  • “Tickers” in the form of pop-up windows of the Internet browser are rigidly attached to hyperlinks, which, in turn, are embedded in the HTML layout of the page.
  • the task of determining the coordinates of the user's control action and correlating them with the elements and frame number simply does not stand behind the absence of any dynamic change in the object of influence (web page). This technical solution is not related to the demonstration of the video stream.
  • the problem solved by the claimed invention is to eliminate the above disadvantages of the known technical solutions and to create a method for interactive demonstration of contextual information when playing a video stream, characterized by the following features:
  • the method should allow for the playback of the video stream according to the user's control at any point in the frame to demonstrate the specified contextual information related to the corresponding area of the frame and the time interval for playing the video stream at the choice of the organizer of the distribution of information; - the method should allow to demonstrate contextual information of any format technically feasible on the reproducing device (text, hypertext, sound, image, other video stream, and so on);
  • the method should allow you to specify contextual information, any areas of the frame and the time intervals of the video stream with which it is mapped, at any time, and not only when creating the video stream, and change it at any time.
  • the method should allow, depending on the format of the contextual information (in addition to the capabilities common to all formats, initiate the demonstration of contextual information at any desired time and with respect to the object of interest, as well as stop the demonstration of contextual information):
  • hypertext information - click on links and return to previous pages
  • the problem is solved and the technical result in the implementation of the proposed method is achieved by the fact that in the method of interactive demonstration of contextual information when playing a video stream, including the control action of the user at any point in the frame the video stream and the user’s interactive interaction with the contextual information, create a file containing timing information — the start and end times of the possible demonstration of contextual information, the coordinates of the frame area to which the contextual information relates, the need to suspend, if it is technically possible to play the video stream for the duration of the contextual information demonstration, as well as data on the location of contextual information, using a video stream playback tool equipped with the function of reading information from the mentioned file, and the function of correlating contextual information with any area of the frame, carried out on the basis of data on the coordinates of the frame area and timing of the frames, moreover, according to the user’s control effect on the selected frame point using the video stream playback means, the contextual information contained directly in the video stream or in a separate file that is delivered to the user simultaneously with the video file or at any other time, or Pass the
  • the user interacts with contextual information depending on the type of information: text, hypertext, images, sound and video files, respectively, in the form of scrolling or scrolling pages; following links and returning to previous pages; scrolling images and using images as hyperlinks; start, stop and rewind playback.
  • computer software or a television receiver or video player is used as a means of reproducing a video stream.
  • the function of reading information from a file and correlating contextual information with any area of the frame that the video stream playback means is equipped with is implemented as software or as a hardware solution.
  • this file with contextual information contains several options for contextual information for one area of the frame and one time range.
  • the data file is made in the form of a table, which is embedded in the video stream or transmitted synchronously with the video stream via digital television broadcasting channels or through Internet channels, or is contained in a separate file.
  • the user exercises a control action on any point of the frame with the cursor using the mouse or other coordinate-positioning device.
  • the method is implemented as follows.
  • a data file is created, for example, in the form of a table in which the timing (start and end time of a possible demonstration of information) is indicated, the coordinates of the frame area to which the contextual information belongs, in the presence of a control action of the user within which the contextual information is displayed , the need to suspend, if it is technically possible to play the video stream for the duration of the demonstration of contextual information, as well as textual information, for example, the name of the file, the address of the information inside the file and / or archive, a hyperlink to the site containing the necessary information, and so on.
  • the file may contain several options for contextual information for one area and time range.
  • the window with contextual information is equipped with buttons for selecting options for contextual information.
  • This table can be embedded in a video stream (the corresponding video file format or service information in a television broadcast), transmitted synchronously with the video stream through digital channels television broadcasting or via Internet channels, or contained in a separate file.
  • a video stream reproducing tool equipped with a function of reading information from a data file in the form of a table, and a function of correlating contextual information with any area of the frame based on data on the coordinates of the frame area and frame timing.
  • This function can be implemented as software (specialized video playback software or plug-in to existing software), as well as pparatnogo solutions.
  • the contextual information contained directly in the video stream or in a separate file is demonstrated, which is delivered to the user simultaneously with the video file or at any other time, or transmitted via interactive communication channels.
  • the used video stream reproducing means When implementing the method, the used video stream reproducing means:
  • Tickers are electronic messages displayed across the display screen, such as during news broadcasts or sports news programs.
  • a news ticker may include fragmentary newspaper material, stock quotes, a list of subject headings.
  • ticker is not contextual information, its contents are not related to what is displayed on the screen, the ticker is just an additional channel for delivering information from the broadcaster to the user.
  • the contextual information used in the proposed method is supplied, using a data file in the form of a coordinate table, in accordance with an image at any point of which (and not elements ticker, as in well-known technical solutions), the user's control action is recorded.
  • an “interactive ticker” can only be displayed in conjunction with a television audio-visual content that is also displayed for viewing, while in the case of implementing a method of interactive demonstration of contextual information when playing a video stream, the specified video stream can be any, including video from the Internet, from the saved on a user's computer a file of any format, DVD or other disk.
  • the novelty of the proposed method consists, including, regardless of format, in the possibility of implementation on any device and at any time (and not just when watching a TV show).
  • the user is not interested in obtaining contextual information regarding any of the objects, events, people or phenomena displayed on the screen, then no additional elements containing information irrelevant to the user are displayed on the screen.
  • the information displayed in response to the control action of the user is contextual, as it is directly related to frame elements.
  • the method of interactive demonstration of contextual information when playing a video stream determines the coordinates of the control action, the time of the control action in relation to the video stream.
  • the proposed method synchronizes contextual information with a video stream.
  • the method of interactive demonstration of contextual information when playing a video stream allows you to save contextual information or a table with information about the location of the contextual information along with the video file on the computer’s hard drive, DVD-ROM or other storage medium.
  • contextual information like a table with links to it, can be changed after they are created and even transmitted and / or delivered to the user, including through the online update mechanism.
  • the contextual information window when implementing the proposed method allows you to display videos, photos, play sound files and any other data formats.
  • the range of reproducible data is limited only by the technical capabilities of the device on which playback is performed.
  • “interactive tickers” when implementing the proposed method for interactive demonstration of contextual information using a video file, it is possible to pause the video stream, so the user’s attention is not scattered: he is not distracted from the content of the program to interact with the ticker, but has the opportunity to calmly study the contextual interest information and return to watching the video file.
  • contextual information is not shown to the user at the request of the broadcaster, but solely of his own free will - if the user does not need contextual information at this particular moment, he will not see it.
  • the method of interactive demonstration of contextual information when playing a video stream provides the possibility of not only hardware but also software processing of user control actions, and thus can be implemented without special new equipment, by updating the software of a personal computer, Smart- TV, DVD player firmware, etc.
  • the video stream is a video file played on a personal computer with a feature film.
  • the computer monitor window has a video playback program (it can occupy the entire surface of the monitor in full screen mode), in which the movie is shown.
  • the user can move the cursor to any part of the frame within the window of the video playback program.
  • a video stream playback means is used, equipped with a function for reading information from a data file and a function for correlating contextual information with any area of the frame, namely, software that is equipped with a module that allows you to determine the coordinates of the cursor position and the timing of the video file with an accuracy of 1 frame at a time user keystrokes (control action).
  • the obtained coordinates and frame number are compared with a table containing information about all available contextual data for this video file.
  • This table may be contained in the video file itself or in a separate file of the appropriate format. It indicates, for each frame or interval, the coordinates of the areas within which the control action should cause the display of contextual information, and for each such coordinate area, a link to the data (file, text, Internet address) that must be demonstrated. If the coordinates and frame number obtained by the module fall into the corresponding intervals from the table, the module pauses the video file and opens an additional window on top of the video playback program window into which the contextual information specified in the table is loaded.
  • a window with a description of the given object and an advertisement from a nearby dealer of this car brand can be opened (the window may also contain buttons for selecting several such options, for example, choosing between reference technical and advertising information).
  • the video stream is a historical popular science film transmitted over a television cable network.
  • playback of the video stream is carried out on the screen of a television receiver used as a means of reproducing a video stream equipped with a function of reading information from a data file and a function of correlating contextual information with any area of the frame.
  • a device is also connected to the television receiver (in the form of an external device or an additional electronic module in the design of the television receiver), which receives signals from the coordinate-positioning device in the hands of user, displays the cursor on the TV screen and determines its current position, and also receives a table with information about available contextual data.
  • the table is downloaded to the device over the Internet.
  • the table may be transmitted over a cable network along with a television signal or otherwise be included in the digital television broadcast signal.
  • the device synchronizes the tabular data with the video stream and expects a control action from the user.
  • a control action arrives at any point in the frame (by pressing a mouse button or other coordinate-positioning device)
  • the device determines the cursor coordinates at the moment of exposure and, as in the previous implementation example, compares the frame number and cursor coordinates with tabular data.
  • the device When the cursor coordinates fall into the specified area, the device provides rendering on the screen of the window interface and loads the information prescribed by the table into it. At the same time, in contrast to the situation when playing a video stream from a local medium (computer hard drive, DVD player, or others), the video stream is not stopped, therefore, for this implementation option, the information about the desired position of the window being opened is included in the table of contextual data with this calculation, so that it minimally impedes further viewing of TV shows.
  • a local medium computer hard drive, DVD player, or others
  • the device or software module that implements the described method provides user interaction with these elements at the level of modern standards of interactive graphic programs and / or browsers.
  • a window with contextual information contains, in addition to other elements, a close button, when clicked by the user, the window closes and if the video stream is paused, it resumes.
  • any of the proposed implementation options if the software has access to or the device is connected to the Internet, information can be implemented and, at the request of the user, information updating is activated.
  • Contextual information as well as a table with links to it, can be changed after they are created and even transmitted and / or delivered to the user, including through the online update mechanism. In this way, information can be kept up to date. Links that have lost relevance can be replaced by active, biographical and statistical data, corrected, updated and supplemented. Outdated information can be completely deleted and replaced with a new one.
  • the technical and economic advantages of this method include the fact that it allows users to show contextual information of any nature (advertising, informational, informational, educational) and any format (text, graphic, sound, video, hyperlinks and other) related not only to the frame as a whole, but also to individual parts of the frame, to deliver this information at any time both before and after the delivery of the video file (video stream) and update it as necessary, which does not allow any of the available methods bov.

Abstract

L'invention porte sur un procédé de démonstration interactive d'informations contextuelles lors de la reproduction d'un flux vidéo. On crée un fichier contenant des données sur la temporisation, à savoir l'heure du début et de la fin d'affichage d'informations contextuelles, les coordonnées du domaine de la séquence à laquelle correspondent les informations contextuelles, la nécessité de suspendre la reproduction du flux vidéo pendant l'affichage des informations contextuelles et les données sur l'emplacement des informations concrètes. On utilise le moyen de reproduction d'un flux vidéo avec fonction de lecture d'informations dans ledit fichier et une fonction de mise en correspondance d'informations contextuelles avec le domaine d'une séquence réalisée sur la base des données sur les coordonnées du domaine d'une séquence et sur la temporisation des séquences. En fonction de l'action de commande d'un utilisateur sur un point sélectionné dans la séquence on effectue la démonstration des informations contextuelles contenues dans le flux vidéo ou dans un fichier séparé qui sont transmis via des canaux de communication interactifs. L'invention assure la démonstration d'informations contextuelles liées aux objets qui ont été d'intérêt pour un utilisateur donné.
PCT/RU2019/000541 2018-10-23 2019-08-01 Procédé de démonstration interactive d'informations contextuelles lors de la reproduction d'un flux vidéo WO2020085943A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
RU2018137390 2018-10-23
RU2018137390A RU2699999C1 (ru) 2018-10-23 2018-10-23 Способ интерактивной демонстрации контекстной информации при воспроизведении видеопотока

Publications (1)

Publication Number Publication Date
WO2020085943A1 true WO2020085943A1 (fr) 2020-04-30

Family

ID=67990056

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/RU2019/000541 WO2020085943A1 (fr) 2018-10-23 2019-08-01 Procédé de démonstration interactive d'informations contextuelles lors de la reproduction d'un flux vidéo

Country Status (2)

Country Link
RU (1) RU2699999C1 (fr)
WO (1) WO2020085943A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2750422C1 (ru) * 2020-08-27 2021-06-28 Сарафан Технолоджи Инк Способ выбора и демонстрации контекстной информации, связанной с видеопотоком

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120047119A1 (en) * 2009-07-21 2012-02-23 Porto Technology, Llc System and method for creating and navigating annotated hyperlinks between video segments
US20140064706A1 (en) * 2012-09-05 2014-03-06 Verizon Patent And Licensing Inc. Tagging video content
US20140074855A1 (en) * 2012-09-13 2014-03-13 Verance Corporation Multimedia content tags
RU2598808C2 (ru) * 2010-11-16 2016-09-27 МАЙКРОСОФТ ТЕКНОЛОДЖИ ЛАЙСЕНСИНГ, ЭлЭлСи Способы для аннотирования изображений вида улицы контекстной информацией
US20180041807A1 (en) * 2015-02-17 2018-02-08 Jong Park Interaction system and interaction method thereof

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080263472A1 (en) * 2007-04-19 2008-10-23 Microsoft Corporation Interactive ticker
US20120324507A1 (en) * 2011-06-15 2012-12-20 Michael Ryan Weber Interactive Ticker
US9583074B2 (en) * 2011-07-20 2017-02-28 Google Inc. Optimization of label placements in street level images

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120047119A1 (en) * 2009-07-21 2012-02-23 Porto Technology, Llc System and method for creating and navigating annotated hyperlinks between video segments
RU2598808C2 (ru) * 2010-11-16 2016-09-27 МАЙКРОСОФТ ТЕКНОЛОДЖИ ЛАЙСЕНСИНГ, ЭлЭлСи Способы для аннотирования изображений вида улицы контекстной информацией
US20140064706A1 (en) * 2012-09-05 2014-03-06 Verizon Patent And Licensing Inc. Tagging video content
US20140074855A1 (en) * 2012-09-13 2014-03-13 Verance Corporation Multimedia content tags
US20180041807A1 (en) * 2015-02-17 2018-02-08 Jong Park Interaction system and interaction method thereof

Also Published As

Publication number Publication date
RU2699999C1 (ru) 2019-09-12

Similar Documents

Publication Publication Date Title
AU2007200584B2 (en) Video interaction
US8571936B2 (en) Dynamic integration and non-linear presentation of advertising content and media content
US7890849B2 (en) Concurrent presentation of media and related content lists
US8843584B2 (en) Methods for displaying content on a second device that is related to the content playing on a first device
US20080319852A1 (en) Interactive advertisement overlays on full-screen content
US9137577B2 (en) System and method of a television for providing information associated with a user-selected information element in a television program
US20080163283A1 (en) Broadband video with synchronized highlight signals
KR102271191B1 (ko) 미디어 데이터에 있는 아이템을 인식하고 이와 관련된 정보를 전달하기 위한 시스템 및 방법
US20070300264A1 (en) Interactive music and video delivery method and system
US20120233646A1 (en) Synchronous multi-platform content consumption
US20110154200A1 (en) Enhancing Media Content with Content-Aware Resources
US20090083815A1 (en) Generating synchronized interactive link maps linking tracked video objects to other multimedia content in real-time
US20080109844A1 (en) Playing video content with advertisement
US20130031593A1 (en) System and method for presenting creatives
AU2001295029A1 (en) Video interaction
WO2009101624A2 (fr) Appareil et procédé pour manipuler un objet inséré dans un contenu vidéo
KR20140113934A (ko) 소셜 메시지들을 기반으로 제2 스크린에 동적 광고를 제공하기 위한 방법 및 시스템
US20070287431A1 (en) Instant footballer
WO2012040596A1 (fr) Systèmes et procédés de guidage multimédia tactile
US9015179B2 (en) Media content tags
US20080184132A1 (en) Media content tagging
CA2456100A1 (fr) Television a contenu personnalise ameliore
CN103108248A (zh) 一种互动式视频的实现方法和系统
RU2699999C1 (ru) Способ интерактивной демонстрации контекстной информации при воспроизведении видеопотока
KR20000054044A (ko) 인터넷 방송용 동영상 창을 활용한 광고방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19876294

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19876294

Country of ref document: EP

Kind code of ref document: A1