EP2989788A1 - Système intégré pour le traitement vidéo par des moyens matériels - Google Patents

Système intégré pour le traitement vidéo par des moyens matériels

Info

Publication number
EP2989788A1
EP2989788A1 EP14706494.3A EP14706494A EP2989788A1 EP 2989788 A1 EP2989788 A1 EP 2989788A1 EP 14706494 A EP14706494 A EP 14706494A EP 2989788 A1 EP2989788 A1 EP 2989788A1
Authority
EP
European Patent Office
Prior art keywords
embedded system
data stream
network
video
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP14706494.3A
Other languages
German (de)
English (en)
Inventor
Martin Zimmerl
Thomas SCHLÖGL
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Novomatic AG
Original Assignee
Novomatic AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Novomatic AG filed Critical Novomatic AG
Priority to EP14706494.3A priority Critical patent/EP2989788A1/fr
Publication of EP2989788A1 publication Critical patent/EP2989788A1/fr
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/14—Display of multiple viewports
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/70—Media network packetisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/756—Media network packet handling adapting media to device capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/214—Specialised server platform, e.g. server located in an airplane, hotel, hospital
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/214—Specialised server platform, e.g. server located in an airplane, hotel, hospital
    • H04N21/2143—Specialised server platform, e.g. server located in an airplane, hotel, hospital located in a single building, e.g. hotel, hospital or museum
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/233—Processing of audio elementary streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234309—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2347—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving video stream encryption
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2365—Multiplexing of several video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2368—Multiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2389—Multiplex stream processing, e.g. multiplex stream encrypting
    • H04N21/23895—Multiplex stream processing, e.g. multiplex stream encrypting involving multiplex stream encryption
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2665—Gathering content from different sources, e.g. Internet and satellite
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41415—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance involving a public display, viewable by several users in a public space outside their home, e.g. movie theatre, information kiosk
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/418—External card to be used in combination with the client device, e.g. for conditional access
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/418—External card to be used in combination with the client device, e.g. for conditional access
    • H04N21/4183—External card to be used in combination with the client device, e.g. for conditional access providing its own processing capabilities, e.g. external module for video decoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4341—Demultiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4344—Remultiplexing of multiplex streams, e.g. by modifying time stamps or remapping the packet identifiers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4347—Demultiplexing of several video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43632—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wired protocol, e.g. IEEE 1394
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
    • H04N21/4385—Multiplex stream processing, e.g. multiplex stream decrypting
    • H04N21/43853—Multiplex stream processing, e.g. multiplex stream decrypting involving multiplex stream decryption
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • H04N21/440272—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA for performing aspect ratio conversion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/4424—Monitoring of the internal components or processes of the client device, e.g. CPU or memory load, processing speed, timer, counter or percentage of the hard disk space used
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61—Network physical structure; Signal processing
    • H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6125—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H04N21/64322—IP
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/02—Handling of images in compressed format, e.g. JPEG, MPEG
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/045—Zooming at least part of an image, i.e. enlarging it or shrinking it
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/0492—Change of orientation of the displayed image, e.g. upside-down, mirrored
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00—Aspects of data communication
    • G09G2370/02—Networking aspects
    • G09G2370/022—Centralised management of display operation, e.g. in a server instead of locally
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00—Aspects of data communication
    • G09G2370/12—Use of DVI or HDMI protocol in interfaces along the display data pipeline

Definitions

  • the invention relates to an embedded video processing system and a video distribution system.
  • Such devices are particularly useful for distributing video data from multiple sources to multiple presentation units (eg, screens).
  • presentation units eg, screens
  • a typical area of application is betting offices.
  • Other infotainment systems in which different information or different data streams for common output to display simultaneously on one or more screens, such as displays at stations, airports, shopping centers, etc., are areas of application.
  • IPTV IP Television
  • Internet TV a local carrier-specific application executes the content navigation
  • a standards-based browser is used to enable navigation of the content.
  • video content delivers video content over an Internet connection to a viewer's TV.
  • EP2247108A1 "Distributed TV access System” discloses an on-line application for the navigation of broadcasts (broadcast signals, ie broadcast signals) transmitted through a network such as cable or satellite A customer receives the broadcast signals through a first network connection and navigate the television content through an online application through a second network
  • the first network connection and the second network connection can be two ports on the same network (eg two connections via two different software ports) or two Connections in two different networks (eg the Internet and a private TV network such as a cable from satellite TV network).
  • the invention has for its object to provide a system of the type mentioned, which is versatile.
  • the proposed measures achieve a high level of flexibility in the modes and the connections and resolutions and achieve a high degree of combination in the processing of a wide variety of broadcast signals and the provision of the broadcast signals to the user.
  • an advantageous scalability in terms of number of participants and structure of the system is achieved and allows real-time capability and security of the signal processing and the system.
  • An embedded video processing system includes hardware means to perform the following functions:
  • a client function ii) a client function, the following functions being implemented to realize the client function:
  • the hardware means for realizing the server function and the client function are arranged on a common board.
  • the hardware means are designed to provide a continuous image and audio data stream at at least 24 frames per second, preferably at least 25 frames per second, more preferably at least 50 frames per second, and most preferably at least 60 frames per second without data congestion compress and decompress.
  • the hardware means for realizing the server function and the client function are arranged on a common board, a compact structure is provided.
  • the common board is designed as a PC plug-in card and can be faded in as a network card in a PC operating system environment.
  • the system has a) hardware means for accepting more than one combined data stream over the protocol-based network; b) hardware means for decompressing more than one combined data stream; c) hardware means for scaling and / or rotating and / or merging and / or fading more than one decompressed picture and audio stream; d) hardware means for co-outputting more than one decompressed image and audio stream for simultaneous display on a screen; and e) hardware means for the shared output of one or more combined data streams to a plurality of screens arranged as a video wall.
  • the currents can be arranged arbitrarily on one or more screens.
  • the hardware means are designed such that they are
  • Enabling code monitoring means comprise monitoring and reconciling enabling codes.
  • the unlock code and the unlock code monitoring means provide relatively high security against product piracy.
  • the unlock code monitoring means are expediently designed to output an enable code warning signal or an enable code enable signal.
  • the hardware means are advantageously designed such that they compress and decompress a continuous image and audio data stream with at least 60 images per second and with a resolution of at least 1920 ⁇ 1080 pixels without congestion.
  • the embedded system is thus able to process data streams in "fill HD" resolution, of course, a resolution of 1280 ⁇ 720 is also possible.
  • the compression of the data streams takes place according to the H.264 or the H.265 standard. This allows a particularly high compression rate for video streams, so that the required Bandwidth for the data transmission over the network can be kept as low as possible. Support for other compression standards, such as MPEG-2, may alternatively or additionally be provided.
  • the server function is a function for encrypting the combined data stream
  • the client function is a function for decrypting the at least one combined data stream.
  • This encryption and decryption takes place in real time using hardware, preferably according to the AES ("advanced encryption standard") encryption method, preferably with a key length of at least 256 bits, which allows the data to be protected against attackers in the transmission link between server and client ,
  • AES advanced encryption standard
  • the embedded system according to the invention has hardware means for converting an interlaced image data stream to the full-frame method. This allows a high quality progressive video stream to be generated in real time, even when the video source provides only interlaced material.
  • the embedded system has a) a memory module with a BIOS; b) a memory module with an operating system; and c) means for accepting control signals over the protocol-based network.
  • the embedded system according to the invention can operate independently of other devices ("standalone") and, in particular, does not have to be connected to a computer for operation, however, the embedded system can be controlled via the protocol-based network, for example with respect to Selecting the sources of the data streams and the desired transmission format (server), or, for example, with regard to the selection of the data streams to be displayed and the display mode (client).
  • a further advantageous embodiment of the embedded system according to the invention has means for outputting control signals for the remote control of connected devices. This allows remote control of the connected devices via the embedded system, such as satellite television receivers (servers) or screens (client), without the need for additional remote control units.
  • control signals can be output via an optionally present infrared interface or via an optionally present HD MI output or also via the network. Because the control commands can be transmitted to the embedded system via the network, it is also possible to operate the connected devices over greater distances and, if necessary, over structural obstacles. The operation can be carried out locally for individual embedded or centrally connected to the network according to the invention all embedded systems.
  • the connected devices are displayed on a display device such as a personal computer (PC) or a tablet computer and the representations are associated with selection menus to select display formats or define, and / or assign a specific data stream of a particular server to a client , It is also possible to present a visualized infrared remote control to set screen-specific properties in a manner that is easy for the user of the system to detect.
  • the representation of the infrared remote control can correspond to a remote control known to control a television.
  • the embedded system has hardware means for improving the image quality of the image data stream, which provide the following functions: a) change in brightness and / or b) change in contrast and / or c) change in image sharpness and / or d) Noise suppression and / or e) color corrections and / or f) reduction of artifacts and / or g) application of further filters.
  • the hardware means can be represented for example on a graphical user interface and controlled by means of associated selection menus, wherein an operator can see a change made to the client, ie the display device, and / or a representation in the user interface.
  • the hardware means can also be automatically adjustable, for example on the basis of applied measurement data and comparison data for optimizing actual data of the data stream to be changed.
  • a further advantageous embodiment of the embedded system according to the invention is characterized in that the hardware means comprise an FPGA (Field Programmable Gate Array), wherein the following functions are provided by the FPGA: a) connection to the protocol-based network; b) firewall; c) encryption of the output combined stream when the embedded system is operating as a server; and d) decrypting the at least one combined data stream when the embedded system is operating as a client.
  • FPGA Field Programmable Gate Array
  • the firewall allows the filtering of IP, port and / or Mac addresses via a rule table.
  • An adjustable logging function of the firewall allows the logging of valid and / or invalid access attempts to the embedded system.
  • idle ports / 1 Ps / Mac addresses can be automatically locked after a certain number of failed attempts, or an alarm can be raised if there is too much unauthorized access to the embedded system per unit of time.
  • the FPGA also includes a 256-bit AES encryption unit that can encrypt and decrypt incoming and outgoing network data in real-time. This implementation of the embedded system achieves the highest possible network security.
  • the configuration of the FPGA is individually encrypted. As a result, a safeguard against product piracy is achieved since possibly read-out configuration data of an FPGA in an embedded system according to the invention can not be used to configure another such embedded system.
  • the individual hardware serial number and / or the individual activation code can serve this purpose.
  • the hardware means comprise a DSP (Digital Signal Processor), the following functions being provided by the DSP:
  • DSP Digital Signal Processor
  • the embedded system has a) at least one network connection and b) at least one interface to a data bus and / or c) at least one interface according to a video interface.
  • Standard and / or d) at least one interface according to an audio standard and / or e) has an infrared interface.
  • the network connection is mandatory in this case, the other interfaces or connections are optional.
  • These can, for example, HDMI interfaces - preferably a port for data acquisition from a video source and a data output to a screen - and / or a PAL interface and / or an additional stereo audio interface and / or a USB interface and / or an infrared interface for remote control of the connected video source or the connected screen.
  • the protocol-based network to which the embedded system according to the invention is connected has a transmission capacity of at least 100 Mbit per second.
  • this is a Gigabit Ethernet network, ie a network that uses the Ethernet protocol and has a transmission capacity of at least 1000 Mbit per second.
  • a video distribution system for accepting and distributing at least one video stream from at least one video source, comprising:
  • At least one embedded system described above operating as a server, accepting, compressing and outputting at least one of the image streams from the at least one video source via the protocol-based network;
  • At least one embedded system described above which acts as a client and accepts at least one compressed data stream from the protocol-based network, decompresses and outputs via an interface.
  • Such a video distribution system is very versatile and almost arbitrarily scalable or expandable due to its modular structure and the characteristics of the embedded systems used. It is advantageous if in the video distribution system according to the invention a) as video sources satellite TV receiver or cable television connections or DVBT receiver or PCs or media players, etc. are used; and b) screens are connected to the interfaces of the embedded systems acting as clients over which the data streams are output.
  • a video distribution system for accepting and distributing at least one video stream from at least one video source comprising: a) a protocol-based network;
  • At least one embedded system that operates as a server and accepts at least one of the image streams from the at least one video source, compresses and outputs over the protocol-based network; and c) at least one embedded system acting as a client and at least one compressed data stream from the protocol-based one
  • a control PC is connected to a network in which image and / or audio data streams are present, and a display device for displaying at least one controllable screen, wherein the control PC comprises at least one input device and, wherein by means of a on the Display device displayable selection menu
  • the screen is on or off and / or
  • the data streams to be displayed on the screens are selectable and / or
  • a position of images on at least one screen is selectable or adjustable and / or
  • a display format is selectable and / or e. a representation of a remote control with a plurality of switches can be displayed, wherein by means of the switch of the remote control functions of the screen are switchable.
  • the graphical user interface it is possible to control all the screens present in the system or network, not only with regard to their settings but also with regard to the content to be displayed, by means of an appropriate allocation of the data streams with the video / audio data, for example television channels.
  • a selection and assignment of information data for example in the form of a so-called news ticker, browser URL, so Internet pages, and / or image data is easily possible.
  • data streams of multiple screens which are composed as a video wall, individually compiled.
  • the graphical user interface can also save and / or recall default settings and / or user settings.
  • a current arrangement and occupancy of the screens in a selected network is automatically displayed on the display device. Accordingly, the actual screens are visualized and easily selectable by a user. If a visualized screen is selected, then the user can open the associated selection menu, for example by a mouse click, a keyboard command or the touch of a sensor field, if the display device is designed as a touch screen.
  • the selection menu only displays those menu items, ie commands for the control, which can also be executed on the respective screen or the screen arrangement in the form of the video wall.
  • the control PC can also be a tablet computer or the like. In the visualization, all changes made are immediately noticeable to the user.
  • the arrangement of the visualization of existing screens can be user-specific or according to a predetermined and stored standard or a specification.
  • screens corresponding data on the position in a room
  • their adjustability and addressing, and optionally a representation of a specific remote control are stored and connected to the network and thus also available for visualization.
  • a video wall which also allows a superimposed displayability of so-called windows with different contents
  • both the video wall and the windows are visualized displayed on the display device.
  • the contents, that is, the data streams are selectable and the individual windows within the video wall by the user as images perceptibly freely arranged. Each window can be placed arbitrarily and the arrangement can be recalled.
  • the viewer of the video wall sees, for example, a large background image on which two or more further images, even mutually overlapping or merging with one another, are arranged.
  • These images which are visualized on the display device as a window, can also be changed in size by means of the input device.
  • area information always includes all - not mentioned - intermediate values and all imaginable subintervals.
  • FIG. 1 shows the schematic structure of an embodiment of the video distribution system according to the invention for use in a betting office.
  • Fig. 2 shows the structure of a simple embodiment of the video distribution system according to the invention
  • Fig. 3 is a more complex embodiment of the invention
  • Fig. 4 shows schematically the structure of an embedded system according to the invention
  • FIG. 5 schematically shows the structure of an embedded system according to the invention with server functionality
  • Fig. 6 shows schematically the structure of an embedded invention
  • FIG. 7 shows an illustration of an embedded system according to the invention as a module
  • Fig. 8 is a schematic diagram of video data processing in an embedded system according to the invention operating as a server;
  • Fig. 10 shows a selection of display modes with a client
  • Fig. 1 a software engineering structure of a branch
  • Fig. 12 is a schematic illustration of the network security module.
  • FIG. 13 is a schematic representation of driver decoupling of a VideoWizard module in a PC operating system environment.
  • Fig. 15 shows an application of the system as a live game transmission outside a casino
  • Fig. 16 is a schematic representation of the fuse of
  • Fig. 18 is a schematic representation of a user interface of a
  • FIG. 19 shows a schematic partial representation of a detail XIX according to FIG. 19
  • Fig. 20 is a partial schematic representation of a detail XIX of FIG. 19 in a further alternative embodiment.
  • the invention comprises a modern video distribution system based on network-based multiple H.264 data streams. Different video sources are converted from server-embedded systems to H.264 data streams and decoded by embedded client-client systems and displayed on screens.
  • the use of the video distribution system is z. B. betting offices are provided in which the image sources are usually supplied by satellite receivers and distributed by shop masters / operators individually to the existing TV monitors.
  • the typical structure of a video distribution system according to the invention in a betting office is shown in Fig. 1 and consists of the four functional units recording, distribution, display and control.
  • the recording function is realized by a variable number of satellite receivers 100, which have respectively assigned embedded systems 1 10, which work as a server.
  • the encoded video streams of the satellite receivers 1 0 0 are distributed over a network 120 (with switch / distributor, VLAN).
  • the representation is over a variable number of screens 130 that receive their images from associated embedded systems 140 operating as clients, with the clients 140 providing the selected image data streams individually from the offering of the host servers 110.
  • the selection of the image data streams takes place here on local control PC 150, at which the shop master / operator can establish the association between satellite program and monitor 130 dynamically (control).
  • the TV screens 130 and the satellite receivers 100 are graphically visualized on a display device 155 assigned to the control PC 150, as can be seen for example in FIG. 18.
  • Each embedded system 1 10 or 140 connected to a satellite receiver 100 or TV monitor 130 also has an infrared control function that allows remote control of the associated device 100 or 130.
  • Each satellite receiver 1 00 is also optionally connected to a network port through which the satellite channel lists can be updated and changed.
  • control of the embedded systems 1 10 or 140 and thus the associated devices 100 or 130 takes place physically via network 120 and structurally via the operating PC software.
  • several such operator stations 150 allow control of the devices 100, 130.
  • the inventive system forms a flexible hardware based multi-functional video television and digital media content monitoring and visualization system, combination of a freely selectable global hardware based video stream network with game visualizations and interactive live content presentation.
  • the system according to the invention is almost arbitrarily scalable due to its modular structure (see also FIG. 2 and FIG. 3).
  • a client can access several hundred server streams.
  • the only restriction is the capacity of the network used.
  • a subdivision into clients and servers takes place.
  • Servers record image data and feed it into the network.
  • Clients accept the network streams and set them up very much Interactive control via network (eg PC, IPad, network-capable device). Mixed usage as client and server at the same time is possible.
  • network eg PC, IPad, network-capable device
  • the system according to the invention processes different sources which can be fed in locally or remotely (globally globally worldwide) via satellite or network (live cams, digital and analog TV sources, hard disk, hard disk storage, media player, etc.).
  • the system according to the invention for recording the image sources and real-time coding according to the H.264 method is embodied in hardware (data reduction for transmission via network).
  • the system according to the invention is designed for the decoding of several H.264 source data streams per client module.
  • the system according to the invention can provide different visualization modes by the client (see also Fig. 10): a) 1 stream; b) 2 streams at the same time; c) 4 streams at the same time per TV; d) 3 currents are rotating; e) 6 streams etc ,; f) video wall mode, where one or more streams can be distributed on one wall of many monitors; g) blending mode of different streams (Blue Box); h) on / fading of live streams into game application; i) interactive control of the mode of user; j) Replay function of video streams on demand.
  • the encryption and decryption of the data streams takes place in real time in hardware.
  • the system provides a northerly way to re-display video content or to interactively change the data streams and display modes.
  • the transmission takes place via network and distribution via switch system (eg Gigabit Ethernet, UDP protocol, etc.).
  • switch system eg Gigabit Ethernet, UDP protocol, etc.
  • the system is constructed using combined FPGA and DSP / special chip technology (real-time hardware).
  • the basic concept of the video distribution system and embedded video processing system is shown schematically in Figure 2 and is based on two functional units in combination: the H.264 video compression and decompression functions and the network security functions with hardware firewall and real-time data encryption.
  • the embedded system's video unit consists of one or more H.264 encoders that can compress image data in real time using the modern H.264 process, and one or more H.264 decoders that can simultaneously decode and display multiple compressed image streams ,
  • Image and sound data is captured via a camera system or an HDMI / PAL source at up to 60 frames per second and forwarded to an embedded server-based system that processes, records and converts to a H.264 data format compressed.
  • the image streams can then be either uncompressed transferred to a PC or a monitor or forwarded via a network connection. This is shown schematically in FIG. 9.
  • the image data source is provided by GigE Vision-compatible cameras 210, satellite receivers with HDMI output, DVD players or other HDMI-capable devices.
  • the embedded system additionally has the opposite functionality (client). Both H.264 and MPEG2 data streams can be fed in, which are decompressed in real time in this embedded system and can either be recoded or output directly via HDMI. This is shown schematically in FIG. It is It is also possible to play video in progressive as well as interlaced (interlaced) data format and deinterlace it as needed.
  • Fig. 10.1 a, 10.2a shows a single video data stream, which is scaled and positioned on a display (LCD, LED, OLED, TV, etc. screen) and is backed by a background color.
  • a display LCD, LED, OLED, TV, etc. screen
  • Fig. 1 0.1 b, 10.2b shows two individual video data streams, both scaled and positioned and backed up with a background color. One of the two videos is scaled down and in the foreground.
  • Fig. 10c shows two individual video streams, both scaled and positioned and backed by a background color. One of the two videos is scaled down and shown in a blending with the other video.
  • Figure 10d shows four individual video streams, all four scaled and fixed (non-overlapping).
  • 10e shows three individual video data streams, all three scaled and rotated 90 ° and positioned fixed (non-overlapping).
  • Figure 10f shows six individual video streams, all six scaled and fixed (non-overlapping).
  • 10g shows a video data stream on a video wall realized with 4 screens (VideoWall), wherein each of the 4 screens reproduces a corresponding partial section of an entire picture to be displayed.
  • VideoWall VideoWall
  • Fig. 10h shows three streams of data, with both video streams and HTML browser streams being mixedly displayed in different windows.
  • the windows are scalable, positionable, rotatable (rotatable), and mutually coverable to arrange.
  • Fig. 10i shows two video streams in different windows, one larger window representing an image, for example from a satellite receiver, and a smaller window representing an information string, for example a so-called news ticker.
  • VideoWizard module VideoWizard module
  • This embedded System is designed for security in terms of data streams, but also in terms of product piracy.
  • the video distribution system is designed so that systems with more than 100 servers and clients can be implemented in a single Gigabit network trunk (this depends on the resolution of the data streams).
  • the data string can be cascaded like a tree.
  • a system with many components is shown schematically in FIG.
  • the second concurrent functionality of the embedded system is network security functionality that includes hardware-implemented firewall and AES real-time data encryption
  • the core functions are in this case a 256-bit AES encryption of network traffic and a hardware firewall with port activation and logging function.
  • the embedded system 400 consists of a single module or module ("VideoWizard Hardware"), which is supplemented by a base board 710 containing the additional functions for stand-alone operation.
  • the module can realize server functions, client functions and network security functions. These are described in more detail below.
  • the embedded system is structurally (see FIGS. 5 and 8) a combination of FPGA and embedded processor, GPU and special hardware technology (all three functions in the deployed DSP). Both units share different functions.
  • the functionality of the FPGA 410 is needed for real-time processing and rendering of the GigE data of the camera 210, the processing of HDMI input data, and In particular PC connection and security aspects needed, the DSP realized the DVI expenditure and scaling as well as the H.264 data processing as encoder / decoder.
  • the embedded system enables driver decoupling of the VideoWizard module for (for example, various operating systems such as Windows XP Embedded and Linux) in which the VideoWizard module embodied as a PC plug-in card is inserted as a network card in the operating system environment.
  • the connection is a network driver which allows the use of all standardized network programs of the operating system.
  • the second access interface is via a low-level user library, which provides the necessary control, image acquisition and DMA functions.
  • the FPGA can take over the network functions in combination with the Tl coprocessor.
  • an image data and control driver 133 is provided in conjunction with a so-called application programming interface API 134 and a separate network driver 135 (see Figures 13 and 12).
  • the display device 155 associated with the control PC 150 represents a graphical user interface for visualizing the existing screens 156 and / or windows 157 and / or a remote control unit 158.
  • the screens 156 can be switched on or off by means of selection menus 154 on the screens 156 or in the windows 157 representing screen sections, data streams to be displayed selected, a display format selected and the display size defined.
  • the individually selected data streams may include video data, information data, for example in the form of a so-called news ticker, browser URL, that is to say Internet pages, and / or image data.
  • the graphical user interface can also save and / or recall default settings and / or user settings.
  • a large area visualized on the display device 155 Image A ' which is partially covered by two windows 157 which display the images B' and C, wherein the window 157 with the image C, the window 157 with the image B 'partially overlaps.
  • this is selected by means of an input device, for example a mouse, assigned to the control PC 150 and the display device 155, as is to be known by the gray background, and the window 157 associated selection menu 154 with different menu items 153 is unfolded visually perceptible.
  • the assigned remote control unit 158 appears with whose switches settings are to be made which are sent to the selected window 157 or to the corresponding screens or clients by means of specially adapted commands.
  • the display device 155 may be formed as a touch screen, whereby the operation by a user is very easy to implement.
  • the representation of the configurations, that is to say in particular the visualized arrangement and the sizes, of the screens 156 or window 157 on display unit 155 corresponds to the actual arrangement of the screens or is defined by means of a defined image.
  • Already stored configurations can be selected under a corresponding menu item 153, which can also be displayed in a title bar on the display device 155.
  • a selection menu with the representation of all available clients can be displayed.
  • Picture A picture defined by the user is displayed. You can select images that reside on an image server in a specific directory.
  • -Info display All channels available in the Infodisplay system can be selected.
  • TV channels Modules detected as servers can be set as TV channels.
  • GUIDs can be created by a GUI D generator. e.g. : http://www.guidgenerator.com/online-guid-generator.aspx
  • GUID is an acronym for "Globally Unique Identifier” (or “Universally Unique Identifier”) It can be a 128-bit integer to identify resources
  • the name entry is used by the system, so a name should also be entered which describes the distribution.
  • ⁇ / Translations> describes how the monitors or screens are arranged in the coordinate system, their resolution and rotation.
  • the left upper point of the display as a reference to
  • Positioning can be used.
  • rotation "0" describes the orientation, i. Rotation of the display. For example, only the values 0 °, 90 °, 180 ° and 270 ° can be supported. Make sense z.Z. only 0 and 90 since z.Z. in the device setting can only be adjusted horizontally and vertically as orientation.
  • ⁇ Contents> defines the display areas in the coordinate system. These areas can span multiple monitors.
  • the upper left point may be used as a reference for positioning.
  • the content is adjusted to the content area and scaled.
  • a video wall 159 consists of six FullHD TV 's (3x2) and three
  • Display area E ' Content over the entire wall of 3x2 TVs
  • Display area F ' Content over a section of 4 TVs.
  • Display area G ' Content over a section of 4 TVs.
  • An appropriately structured XML configuration file can be transmitted to the client modules via an API interface, for example.
  • the server functionality of the embedded system is shown schematically in Fig. 5 and partly in Fig. 12 (left hand of the network) and consists of the following detailed functions:
  • Stand-alone capability with access via Server PC 510) via Gigabit Ethernet to internal registers of the embedded system;
  • the client functionality of the embedded system is shown schematically in Fig. 6 and partly in Fig. 12 (right hand of the network) and consists of the following detailed functions:
  • Stand-alone capability with access via client PC 610) via Gigabit Ethernet to internal registers of the embedded system;
  • the embedded system (the VideoWizard) can be advantageously used in combined modes. For example, a mixture of client and server is possible (with a choice of subfunctions) or a recoding of multiple input data streams to new output streams.
  • the network functionality of the embedded system consists of a hardware-implemented firewall and AES real-time data encryption, which dramatically increases data transmission security.
  • the core functions are in this case a 256-bit AES encryption of network traffic and a hardware firewall 131 with port activation and logging function.
  • the FPGA 410 takes over the Network functions (Fig. 13).
  • the FPGA contains a 256-bit AES real-time encryption unit 132 which encrypts and decrypts the incoming and outgoing network data. It can be selected between different H.264 data streams, which are transferred via network into / from the embedded system.
  • the firewall 131 allows the filtering of IP, port and Mac addresses via a rule table.
  • An adjustable logging function of the firewall 131 allows the logging of valid / invalid access attempts to the embedded system.
  • unlocked ports / Ips / Mac addresses can be automatically locked after a certain number of failed attempts, or an alarm can be triggered if too many unauthorized accesses occur per second to the embedded system.
  • false-monitoring means are provided in the system for monitoring the occurrence of failed attempts over a defined threshold.
  • the system may include enable code monitoring means 161 which may perform a check of enable codes with a database and may optionally issue an enable code warning signal if there is no match of the enable code or if it can issue an enable code enable signal a match of the / unlock code is given.
  • the image streams can be backed up over the network using AES encryption, protecting the data from attackers in the transmission link.
  • AES AES encryption
  • High stability and reliability in image data transmission and display The use of two independent real-time computational components ensures high reliability with high power reserves.
  • a hardware firewall can prevent unauthorized access from the outside by unauthorized ports, unprotected IP addresses or unauthorized Mac addresses.
  • logging allows logging of permitted and unauthorized accesses.
  • the firewall can not pass unauthorized packets through an overload, as is the case with software-implemented firewalls.
  • an embedded system according to the invention can also be used without a network, while simultaneously providing the server and client functionality.
  • coding and encryption standards or methods can be used, and likewise, depending on the desired field of application, different interfaces, network protocols and network architectures can be used without changing the essence of the invention.
  • Image data stream, audio data stream, video data stream, combined data stream We understand this as data streams with one channel each of the corresponding content (pictures, audio, video).
  • a combined data stream contains both image and audio data.
  • a video data stream may thus be an image data stream or a combined data stream.
  • a streaming client is a special client for streaming media; It can either be software or hardware.
  • Typical streaming clients support special streaming protocols such as RTP, RTCP and / or RSVP.
  • a streaming server is a dedicated server for the delivery of streaming media data over a network.
  • Typical streaming servers support special streaming protocols such as RTP, RTSP, RTCP, and RSVP (help protocol for QoS IntServ).
  • Streaming Media refers to audio and video data received from a computer network and reproduced at the same time. The process of data transmission itself is called streaming, and transmitted ("streamed") programs are referred to as livestream or short stream.
  • embedded system refers to an electronic computer or computer that is embedded (embedded) in a technical context.
  • the computer either monitors, controls or controls or is responsible for some form of data or signal processing, such as encryption or decryption, coding or decoding or filtering.
  • DSPs digital signal processors
  • FPGAs field-programmable gate arrays
  • ASIC application-specific integrated circuit
  • ARM processors embedded microprocessors
  • hardware means does not encompass general purpose microprocessors that are not optimized for the purposes stated herein.
  • Multi-purpose microprocessors eg from Intel or AMD are typically found as central processing units in personal computers.
  • a digital signal processor or DSP is used to continuously process digital signals (eg audio or video signals).
  • digital signals eg audio or video signals
  • the DSP is used in conjunction with analog-to-digital converters and digital-to-analog converters.
  • DSPs contain a processor optimized for common mathematical operations compared to general-purpose microprocessors. Some DSPs already contain the required A / D and D / A converters at the input and output.
  • a Field Programmable Gate Array or FPGA is an integrated circuit into which a logic circuit can be programmed.
  • Ethernet GigE
  • Ethernet is a technology that specifies software (protocols, etc.) and hardware (cables, distributors, network cards, etc.) for wired data networks. It enables data exchange in the form of data packets between the devices connected in a local area network (LAN).
  • LAN local area network
  • a firewall is a backup system that protects a network or a single computer from unwanted network access.
  • the firewall is used to restrict network access based on sender or destination address and services used. It monitors traffic and uses established rules to decide whether certain network packets are allowed or not. Simple filtering of data packets based on network addresses is the basic function of all firewalls.
  • the video resolution includes the same parameters as the image resolution (lines and columns or pixel number, aspect ratio) and extends them by the temporal aspect of the refresh rate. In this case, a distinction must be made between the repetition of partial (mostly interlaced fields) and frames (progressive scan). Usual refresh rates are 24, 25, 50 or 60 Hz. In the HDTV range are 720p and 1080i usual. From Golf HD one speaks from 1080p25, ie 1920 ⁇ 1080 pixels, progressive, 25 Hz. (After http://de.wikipedia.org/wiki/Videoaufl0sung, http://de.wikipedia.org/wiki/Full_HD and http : //en.wikipedia.org/wiki/High_ Definition_Television)
  • the interlace method serves to reduce picture flicker in television technology. It was developed with the intention to display the signals with the lowest possible bandwidth flicker-free. This builds up a complete picture (frame) of two different fields.
  • the progressive scan technique refers to a technique in image construction, in which the output device - unlike the interlaced process - not sent line-interlaced fields, but is fed with real frames.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Astronomy & Astrophysics (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

L'invention concerne un système intégré pour le traitement vidéo, comprenant des moyens matériels pour la réalisation des fonctions suivantes : i) une fonction serveur, les fonctions suivantes étant réalisées pour la réalisation de la fonction serveur : i1) réception d'au moins un flux de données d'image, et d'au moins un flux de données audio; i2) compression d'au moins un des flux de données d'image et audio, respectivement en un flux de données combiné; i3) sortie d'au moins un des flux de données combinés, via un réseau basé sur protocole; ii) une fonction client, les fonctions suivantes étant réalisées pour la réalisation de la fonction client : ii1) réception d'au moins un flux de données combiné, provenant du réseau basé sur protocole; ii2) décompression du au moins un flux de données combiné; ii3) sortie du flux de données d'image et audio décompressé; iii) les moyens matériels étant conçus de manière à compresser et décompresser un flux de données combiné continu, et iv) les moyens matériels étant disposés sur une carte à connexion commune, pour la réalisation de la fonction serveur et de la fonction client.
EP14706494.3A 2013-02-02 2014-02-03 Système intégré pour le traitement vidéo par des moyens matériels Ceased EP2989788A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP14706494.3A EP2989788A1 (fr) 2013-02-02 2014-02-03 Système intégré pour le traitement vidéo par des moyens matériels

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
EP13153777.1A EP2763401A1 (fr) 2013-02-02 2013-02-02 Système intégré pour le traitement vidéo avec des moyens matériels
PCT/EP2014/051861 WO2014118306A1 (fr) 2013-02-02 2014-01-30 Système de traitement vidéo intégré doté de moyens matériels
PCT/EP2014/052073 WO2014118378A1 (fr) 2013-02-02 2014-02-03 Système intégré pour le traitement vidéo par des moyens matériels
EP14706494.3A EP2989788A1 (fr) 2013-02-02 2014-02-03 Système intégré pour le traitement vidéo par des moyens matériels

Publications (1)

Publication Number Publication Date
EP2989788A1 true EP2989788A1 (fr) 2016-03-02

Family

ID=47709930

Family Applications (2)

Application Number Title Priority Date Filing Date
EP13153777.1A Ceased EP2763401A1 (fr) 2013-02-02 2013-02-02 Système intégré pour le traitement vidéo avec des moyens matériels
EP14706494.3A Ceased EP2989788A1 (fr) 2013-02-02 2014-02-03 Système intégré pour le traitement vidéo par des moyens matériels

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP13153777.1A Ceased EP2763401A1 (fr) 2013-02-02 2013-02-02 Système intégré pour le traitement vidéo avec des moyens matériels

Country Status (8)

Country Link
US (3) US10038931B2 (fr)
EP (2) EP2763401A1 (fr)
KR (2) KR102064031B1 (fr)
CN (2) CN105122831A (fr)
HK (2) HK1212527A1 (fr)
MY (2) MY181424A (fr)
SG (3) SG10201706252RA (fr)
WO (2) WO2014118306A1 (fr)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11284137B2 (en) 2012-04-24 2022-03-22 Skreens Entertainment Technologies, Inc. Video processing systems and methods for display, selection and navigation of a combination of heterogeneous sources
US20180316939A1 (en) * 2012-04-24 2018-11-01 Skreens Entertainment Technologies, Inc. Systems and methods for video processing, combination and display of heterogeneous sources
CN103793190A (zh) * 2014-02-07 2014-05-14 北京京东方视讯科技有限公司 一种信息显示方法、信息显示装置及显示设备
US20170228206A1 (en) * 2014-12-16 2017-08-10 Hewlett-Packard Development Company, L.P. Processing data in a thin client terminal
CN104796769A (zh) * 2015-04-28 2015-07-22 杭州罗莱迪思照明系统有限公司 一种脱机系统中直接播放视频文件的led显示控制方法
EP3278499A4 (fr) * 2015-05-15 2019-01-09 Hewlett-Packard Development Company, L.P. Intégration d'informations à un flux audio en vue d'une connectivité
CN106648507B (zh) * 2016-12-05 2020-02-14 中国航空工业集团公司洛阳电光设备研究所 一种用于嵌入式处理器扩展dvi显示输出的电路及方法
JP7212611B2 (ja) * 2017-02-27 2023-01-25 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ 画像配信方法、画像表示方法、画像配信装置及び画像表示装置
CN107067365A (zh) * 2017-04-25 2017-08-18 中国石油大学(华东) 基于深度学习的分布嵌入式实时视频流处理系统及方法
CN107295302A (zh) * 2017-05-12 2017-10-24 苏州大学 基于arm和fpga的智能网络摄像头的分析系统及分析方法
US10992960B2 (en) 2019-02-06 2021-04-27 Jared Michael Cohn Accelerated video exportation to multiple destinations
CN111669623B (zh) * 2020-06-28 2023-10-13 腾讯科技（深圳）有限公司 视频特效的处理方法、装置以及电子设备
US12099473B1 (en) 2020-12-14 2024-09-24 Cigna Intellectual Property, Inc. Systems and methods for centralized logging for enhanced scalability and security of web services
US11743440B2 (en) 2021-04-19 2023-08-29 Apple Inc. Transmission and consumption of multiple image subframes via superframe
CN113726782B (zh) * 2021-08-31 2023-06-27 江苏食品药品职业技术学院 一种计算机网络监控平台
KR102544747B1 (ko) * 2023-03-17 2023-06-20 주식회사 노비텍 복수개의 독립된 Ethernet 인터페이스를 지원하는 카메라

Family Cites Families (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6870886B2 (en) * 1993-12-15 2005-03-22 Koninklijke Philips Electronics N.V. Method and apparatus for transcoding a digitally compressed high definition television bitstream to a standard definition television bitstream
US7926097B2 (en) * 1996-11-29 2011-04-12 Ellis Iii Frampton E Computer or microchip protected from the internet by internal hardware
DE69834704T2 (de) * 1997-04-03 2006-09-21 Matsushita Electric Industrial Co., Ltd., Kadoma Videoproduktionssystem für progress-fernseh-modus sowie aufnahme- und wiedergabevorrichtung dafür
US6366617B1 (en) * 1998-10-09 2002-04-02 Matsushita Electric Industrial Co., Ltd. Programmable filter for removing selected user data from an MPEG-2 bit stream
EP1145218B1 (fr) * 1998-11-09 2004-05-19 Broadcom Corporation SYSTEME D'AFFICHAGE pour mélanger de données graphiques et de données vidéo
US6538656B1 (en) * 1999-11-09 2003-03-25 Broadcom Corporation Video and graphics system with a data transport processor
JP3998399B2 (ja) * 1999-12-03 2007-10-24 松下電器産業株式会社 映像信号変換装置
US20020129280A1 (en) * 2001-01-29 2002-09-12 Enjoyweb, Inc. Method, apparatus, and system for distributing compressed digital media in a secured manner
US6652378B2 (en) * 2001-06-01 2003-11-25 Igt Gaming machines and systems offering simultaneous play of multiple games and methods of gaming
US8661496B2 (en) * 2002-12-10 2014-02-25 Ol2, Inc. System for combining a plurality of views of real-time streaming interactive video
US7685027B2 (en) * 2003-12-04 2010-03-23 International Business Machines Corporation Method and system for enterprise-wide migration
US20080007612A1 (en) * 2004-12-06 2008-01-10 Synelec Telecom Multimedia Zone Industrielle, Saint Sernin Sur Rance Multiplexed image distribution system
US8665967B2 (en) * 2006-02-15 2014-03-04 Samsung Electronics Co., Ltd. Method and system for bit reorganization and packetization of uncompressed video for transmission over wireless communication channels
US20080120675A1 (en) * 2006-11-22 2008-05-22 Horizon Semiconductors Ltd. Home gateway for multiple units
US8436943B2 (en) 2007-03-22 2013-05-07 Control4 Corporation System and method for automated audio visual system control
US20090069049A1 (en) * 2007-09-12 2009-03-12 Devicefidelity, Inc. Interfacing transaction cards with host devices
US20090079694A1 (en) 2007-09-20 2009-03-26 Rgb Spectrum Integrated control system with keyboard video mouse (kvm)
EP2247108A1 (fr) 2007-12-31 2010-11-03 Digital Keystone, Inc. Système d'accès à la TV distribuée
TW201026056A (en) * 2008-12-16 2010-07-01 Quanta Comp Inc Image capturing device and image delivery method
US8164617B2 (en) * 2009-03-25 2012-04-24 Cisco Technology, Inc. Combining views of a plurality of cameras for a video conferencing endpoint with a display wall
US8495234B2 (en) * 2009-06-29 2013-07-23 Sandisk Il Ltd. Storage device with multimedia interface connector
US20110166968A1 (en) * 2010-01-06 2011-07-07 Richard Yin-Ching Houng System and method for activating display device feature
EP2591460A1 (fr) * 2010-06-22 2013-05-15 Nokia Corp. Procédé, appareil et produit-programme d'ordinateur permettant de fournir un suivi d'objet au moyen d'une commutation de modèle et d'une adaptation de caractéristiques
KR101315670B1 (ko) * 2011-05-25 2013-10-08 주식회사 슈프리마 보안인증 디바이스에 접근하는 스마트폰 등록 방법 및 등록된 스마트폰의 접근 권한 인증방법
US8472619B1 (en) * 2011-07-13 2013-06-25 Xilinx, Inc. Multiple validly decryptable messages
US9071854B2 (en) * 2011-09-12 2015-06-30 Disney Enterprises, Inc. System and method for transmitting a services list to a playback device
US9128876B2 (en) * 2011-12-06 2015-09-08 Honeywell International Inc. Memory location specific data encryption key
US8621651B2 (en) * 2012-01-23 2013-12-31 Verizon Patent And Licensing Inc. Enforcing content blackout
CN102801941B (zh) * 2012-09-04 2015-11-11 山东大学 一种嵌入式无线投影接入设备

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
None *
See also references of WO2014118378A1 *

Also Published As

Publication number Publication date
US10038931B2 (en) 2018-07-31
HK1212834A1 (zh) 2016-06-17
KR20150112033A (ko) 2015-10-06
US20150373382A1 (en) 2015-12-24
KR20150115826A (ko) 2015-10-14
KR102064031B1 (ko) 2020-01-08
SG10201706252RA (en) 2017-10-30
MY181424A (en) 2020-12-21
US10237603B2 (en) 2019-03-19
WO2014118306A1 (fr) 2014-08-07
US20170237796A1 (en) 2017-08-17
SG11201506009QA (en) 2015-09-29
CN105122831A (zh) 2015-12-02
CN105075243A (zh) 2015-11-18
HK1212527A1 (en) 2016-06-10
WO2014118378A1 (fr) 2014-08-07
SG11201506006YA (en) 2015-09-29
US9596492B2 (en) 2017-03-14
EP2763401A1 (fr) 2014-08-06
KR102225765B1 (ko) 2021-03-10
MY179681A (en) 2020-11-11
US20150373402A1 (en) 2015-12-24

Similar Documents

Publication Publication Date Title
EP2989788A1 (fr) Système intégré pour le traitement vidéo par des moyens matériels
US9990476B2 (en) System for interactive matrix manipulation control of streamed data and media
DE60224669T2 (de) Graphische benutzerschnittstelle
DE69106033T2 (de) Verfahren und Vorrichtung zur Verwürfelung-Entwürfelung digitaler Bilddaten.
EP2274739B1 (fr) Système à multiples spectateurs vidéo avec interface numérique série et procédés associés
DE10120806B4 (de) Vorrichtung und Verfahren zur Übertragung von multimedialen Datenobjekten
US20160249108A1 (en) Method and apparatus for providing a customized viewing experience
DE10236679A1 (de) Drahtloses Videoanzeigegerät und Verfahren
US20090276541A1 (en) Graphical data processing
DE102005009621A1 (de) Schaltung, Vorrichtung und Verfahren zum Empfangen, bedingten Zugriff und Kopierschutz digitaler Videoübertragungssignale
DE112013007509T5 (de) Verfahren, Einrichtung und System zum Auswählen von Audio-Video-Daten zum Streamen
US20230244764A1 (en) System for Interactive Matrix Manipulation Control of Streamed Data
DE102019122181B4 (de) Generalisierte niedriglatenzbenutzerinteraktion mit video auf verschiedenen transporteinrichtungen
US20110321104A1 (en) System and method for mass distribution of high quality video
KR101877034B1 (ko) 멀티비전 가상화 시스템 및 가상화 서비스 제공 방법
US20090274379A1 (en) Graphical data processing
DE102013001814A1 (de) Eingebettetes System zur Videoverarbeitung mit Hardware-Mitteln
WO2021223819A2 (fr) Système et boîtier système pour recevoir des flux vidéo
EP2688289B1 (fr) Procédé de traitement des signaux vidéo et/ou audio
EP2670155A2 (fr) Récepteur TV hybride doté d'un dispositif de mélange vidéo pour une restitution multi-images destinée à la représentation visuelle simultanée de contenus multimédia sur un écran de restitution
WO2021028178A1 (fr) Procédé permettant de transmettre des méta-informations à une image d'un flux vidéo
DE102015113265B3 (de) Empfangsgerät für digitale Fernseh- und/oder Rundfunksignale
DE102007030675B4 (de) Verfahren und Vorrichtung zur Entschlüsselung in mehreren verschiedenen Transportströmen enthaltener Dienste
DE19963045A1 (de) System und Verfahren zum Bereitstellen von durch Anwender angeforderten Daten, insbesondere Audio- und/oder Videodaten

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20151209

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20170109

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

APBK Appeal reference recorded

Free format text: ORIGINAL CODE: EPIDOSNREFNE

APAF Appeal reference modified

Free format text: ORIGINAL CODE: EPIDOSCREFNE

APBK Appeal reference recorded

Free format text: ORIGINAL CODE: EPIDOSNREFNE

APBN Date of receipt of notice of appeal recorded

Free format text: ORIGINAL CODE: EPIDOSNNOA2E

APBR Date of receipt of statement of grounds of appeal recorded

Free format text: ORIGINAL CODE: EPIDOSNNOA3E

APAF Appeal reference modified

Free format text: ORIGINAL CODE: EPIDOSCREFNE

REG Reference to a national code

Ref country code: DE

Ref legal event code: R003

APBT Appeal procedure closed

Free format text: ORIGINAL CODE: EPIDOSNNOA9E

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20220407