AU2022201273A1

AU2022201273A1 - System and method for personalised viewing of video content

Info

Publication number: AU2022201273A1
Application number: AU2022201273A
Authority: AU
Inventors: Samuel Martin Lehane; Christopher James Spencer
Original assignee: Venuevue Pty Ltd
Current assignee: Venuevue Pty Ltd
Priority date: 2021-03-03
Filing date: 2022-02-24
Publication date: 2022-09-22

Abstract

A system for re-directing video content to a plurality of user devices connected on a local network, the system comprising: a broadcast signal receiver for receiving and producing unrendered video data for display on one or more primary display devices located in a given area; a broadcast signal distribution network for distributing video content data from the broadcast signal receiver; a broadcasting server arranged to receive the video content data from the broadcast signal receiver via the broadcast signal distribution network; the broadcasting server comprising a memory device with executable instructions to conditionally broadcast the video data from the broadcasting server to said one or more user devices over a local area network upon verifying physical locations of each of the user devices by undertaking one or more physical location verification steps thereby providing conditional access to one or more of the user devices over the local area network (LAN). Ghann-el Encoder Sub Pmcrcesses Input Frame FIGURE 8

Description

Ghann-el Encoder Sub Pmcrcesses

Input Frame

FIGURE 8

SYSTEM AND METHOD FOR PERSONALISED VIEWING OF VIDEO CONTENT TECHNICAL FIELD

[001] The present invention relates to a system and method for personalised viewing

of video content by re-directing video content.

BACKGROUND

[002] Any references to methods, apparatus or documents of the prior art are not to

be taken as constituting any evidence or admission that they formed, or form part of

the common general knowledge.

[003] Video content has become increasingly available for viewing on personal

devices such as mobile phones and tablets. In order to obtain video content, a mobile

device typically accesses a web-based video source by using an application which

accesses a repository of videos or by logging onto a website that is streaming video

content. Usually, the user needs to pay a subscription fee to access video content. In

some instances, the user may also be provided with an option to "pay per view" to

watch content. However, internet-based video services are plagued with several

issues. First, the extent of choices available for internet-based video services is limited

especially when it comes to live events. Secondly, internet speeds can often hamper

the viewing experience especially when streaming live events or live sport. Video

content broadcast through conventional broadcasting means such as Digital Video

Broadcast (DVB) or cable television broadcasting results in a more stable viewing

experience. Finally, there are several legal limitations around content access. For example, there might be geographical or location-based limitations for viewing the content.

[004] Many people like to go to a public venue such as a public bar or a restaurant to

view live events (such as sporting events) on a big display screen. The venue usually

pays a subscription fee for publicly broadcasting the live event on one or more of such

display screens. However, with the advent of improvements in smartphone

technology, many such people attending the public venue are inclined to continue to

interact with their mobile phones and it would be desirable to link the user's interactive

phone experience with their viewing experience to at least provide an improved user

experience.

SUMMARY OF INVENTION

[005] In an aspect, the invention provides a system for re-directing video content to

a plurality of user devices connected on a local network, the system comprising:

a broadcast signal receiver for receiving and producing unrendered video data

for display on one or more primary display devices located in a given area;

a local broadcast signal distribution network for distributing video content data

from the broadcast signal receiver;

a broadcasting server arranged to receive the video content data from the

broadcast signal receiver via the broadcast signal distribution network; the

broadcasting server comprising a memory device with executable instructions to

conditionally broadcast the video data from the broadcasting server to said one or

more user devices over a local area network upon verifying physical locations of each

of the user devices by undertaking one or more physical location verification steps

:3

thereby providing conditional access to one or more of the user devices over the local

area network (LAN).

[006] In an embodiment, the system further comprises a broadcast signal decoder

for decoding encoded video signals received by the broadcast signal receiver for

producing unrendered video data for display on the one or more primary display

devices located in a given area; and

a video encoder having an input configured to be in communication with an output of

the broadcast signal receiver and decoder, the encoder being arranged for encoding

the unrendered video data produced by the broadcast signal decoder;

wherein the broadcasting server is arranged to receive the encoded video data from

an output of the video encoder.

[007] In an embodiment, the system further comprises a gateway device for receiving

live digital video broadcast (DVB) from the broadcast signal receiver and convert the

received signals into video content streams for distribution over the broadcast signal

distribution network to the broadcast server.

[008] In an embodiment, the system further comprises a remotely located server in

communication with the broadcasting server and the plurality of user devices over a

wide area network (WAN) wherein the authentication server comprises a processor in

communication with a memory device having executable instructions to: (a) receive

authentication and access requests from one or more of the user devices, (b) in

response to receiving the authentication and access request, verifying physical

location of the one or more user devices requesting authentication in accordance with one or more verification rules, (c) granting authentication to the user device, if said one or more verification conditions are met, for receiving video content from the broadcasting server over the local area network(LAN).

[009] In an embodiment, the system comprises one or more wireless access points

for allowing the plurality of user devices to access authorized video content from the

broadcasting server and for communication with the remote server whereby location

of each of said plurality of devices requesting access is determined as a function of an

Internet Protocol (IP) address associated with the wireless access point.

[010] In an embodiment, upon determining location of each of said plurality of devices

as a function of the IP address, the user device is granted access to connect with the

broadcasting server for streaming video data directly from the broadcasting server.

[011] In an embodiment, the memory device of the broadcast server further

comprises executable instructions for re-encoding the video data received by the

broadcast server and provision of one or more channels of re-encoded video data and

broadcast the re-encoded channels of video data to the one or more authorized users

upon receiving and confirming authorization instructions from the remote server to

grant video data access to one or more of said users.

[012] In an embodiment, the memory device of the broadcast server comprises

executable directions for re-encoding the encoded video data received from the

encoder before broadcasting re-encoded video data to one or more of the user

devices.

[013] In an embodiment, the system further comprises a media gateway arranged to

be in communication with the broadcasting server to broadcast re-encoded channels

of video data to the one or more authorized user devices.

[014] In an embodiment, format for re-encoding of the encoded video data carried out

by the broadcasting server is dependent upon an access request generated by the

user device whereby the access request specifies a format for receiving video content

from the broadcast server.

[015] In an embodiment, the memory device of the remote server comprises

executable instructions to receive user-provided information to determine an

identification of the user and obtaining information about the user to enable

authorization to receive video content from the broadcasting server.

[016] In an embodiment, the memory device on the broadcasting server further

comprises executable instructions to generate interactive content and displaying the

interactive content overlaid on the video content being streamed on the user's device

for pre-determined periods of time. Preferably, the interactive content is generated in

response to receiving user-provided information.

[017] In another aspect, the invention provides a method of re-directing video content

to a plurality of user devices connected on a local network, the method comprising the

steps of:

providing a broadcast signal receiver to receive and produce unrendered video

data for display on one or more primary display devices located in a given area; provisioning a local broadcast signal distribution network to communicate with the broadcast signal receiver for distributing video content data from the broadcast signal receiver; arranging a broadcasting server to be in communication with the broadcast distribution network to receive the video content data from the broadcast signal receiver via the broadcast signal distribution network; the broadcasting server comprising a memory device; and executing instructions saved on the memory device to conditionally broadcast the video data from the broadcasting server to said one or more user devices over a local area network upon verifying physical locations of each of the user devices by undertaking one or more physical location verification steps thereby providing conditional access to one or more of the user devices over the local area network (LAN).

BRIEF DESCRIPTION OF THE DRAWINGS

[018] Preferred features, embodiments and variations of the invention may be

discerned from the following Detailed Description which provides sufficient information

for those skilled in the art to perform the invention. The Detailed Description is not to

be regarded as limiting the scope of the preceding Summary of the Invention in any

way. The Detailed Description will make reference to a number of drawings as follows:

Figure 1 is a block diagram illustrating a system 1000 for re-directing video content to

one or more personal user devices 100.

Figure 2 is a flow diagram of a method of authenticating the personal user devices 100

by communicating with a remote server 400 and a local broadcasting server 300.

Figure 3 is a block diagram of a signalling sub-system used for authenticating the

personal user devices 100 by communicating with a remote server 400 and a local

broadcasting server 300.

Figure 4 is a detailed block diagram of a media broadcasting server 300 illustrating the

various components of the media broadcasting server 300.

Figure 5 illustrates a block diagram illustrating a preferred system embodiment of the

system 1000 receiving video content over a cable broadcast network that requires

encoders and or modulator for providing unrendered video output at the venue's

primary display devices.

Figure 6 illustrates a block diagram illustrating another or additional preferred system

embodiment of the system 1000 receiving video content over a cable broadcast

network that requires encoders and or modulator for providing unrendered video

output at the venue's primary display devices.

Figure 7 illustrates a block diagram illustrating another or additional preferred system

embodiment of the system 1000 receiving video content from a digital video

broadcasting (DVB) source from a terrestrial antenna with an IP Gateway that streams

the video content to the local broadcast distribution network.

Figure 8 illustrates a block diagram illustrating a method of manipulating and

overlaying content on re-directed video content streamed onto the user's personal

device in accordance with the method and system 1000.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

[019] Figures 1 illustrates a method and system 1000 for providing video content to

individual users on their individual end user devices 100. The method and system

involves a video signal that is received at a broadcast signal receiver 200 which then processes the signal to display video content on primary display devices at a venue.

The video content received at the broadcast signal receiver 200 could either be in an

encoded format from a cable television network that needs to be decoded by a set-top

box or a decoder device to produce an unrendered video signal. Alternatively, or

additionally the broadcast signal receiver could also include a DVB receiver with

demodulator for demodulating a DVB-T signal received from a terrestrial antenna. The

video content signal received by the broadcast signal receiver may then be encoded

via an encoder to h264 mpeg4 with AAC audio format before being transmitted via a

local broadcast signal distribution network (such as a local ethernet network) to a local

media broadcasting server 300. The DVB receiver may receive the video signals in

the MPEG-TS h264 or MPEG2 formats and redistribute MPEG-TS UDP packets as

UDP multicast via the local broadcast signal distribution network to the local media

broadcasting server 300.

[020] The broadcasting server 300 comprises a memory device with executable

instructions to conditionally broadcast the video data from the broadcasting server 300

to one or more user devices such as smartphones or tablets over a local area network

after verifying physical locations of each of the user's personal mobile devices. The

location verification for each of the user's personal mobile devices is carried out by

undertaking one or more physical location verification steps thereby providing

conditional access to one or more of the user devices over the local area network

(LAN). It is important to note that the method and system ensures that the video

content in a suitable format is streamed directly from the local media broadcasting

server to an authorised personal user device over the local network provided the

physical location of the user is an approved location. In at least some embodiments,

the method and system 1000 ensures that only users located at the venue (where the primary displays are located) are able to view the streamed video content on their personal devices.

[021] The video content being broadcast to the authorized end user's device never

leaves the local network, the content falls within a venue's distribution license that the

venue holds with the broadcaster to rebroadcast the content throughout the premise.

[022] Referring to Figures 1,2 and 3 a remotely located server 400 is arranged to be in

communication with the broadcasting server 300 and the plurality of personal user

devices 100. In an exemplary but non-limiting operation, the end user would need to

initially connect to the venue's local broadcasting network. The remote authentication

server 400 comprises a processor in communication with a memory device having

executable instructions to: (a) receive authentication and access requests from one or

more of the user devices, (b) in response to receiving the authentication and access

request, verifying physical location of the one or more user devices requesting

authentication in accordance with one or more verification rules, (c) granting

authentication to the user device, if said one or more verification conditions are met,

for receiving video content from the broadcasting server over the local area

network(LAN). In a preferred scenario, the user may connect to a wireless access

point (via Wi-Fi) that forms part of the local broadcast network set up at the venue and

then navigate to an application (such as but not limited to a web-based application)

hosted on the remotely located server 400. In this operation, the user may be asked

to enter personal details on a user input interface provided on the user's personal

device and the personal details may then be saved on the remote server for future

retrieval when the user tries to access the application at a later time. Upon, accessing

the application on the remote server 400, the memory device of the remote server

includes executable instructions to match the end user's Internet Protocol (IP) address to one of a plurality of media broadcasting servers. Once the end user is authenticated via the remote server 400, the end user is able to receive video content directly from the broadcasting server located at the venue's premises by selecting a video stream from one or more channels. The signalling process establishes a peer-to-peer DTSL

Encrypted webRTC connection from the local media broadcast server 300 to the

authenticated end user's personal device 100. In summary, the signalling process is

initiated by the end user through their personal mobile device.

[023] We now refer to the working of the local broadcasting server 300. The Media

Broadcast Server is comprised of four key components as shown in Figure 4.

Primary Application

Channel Provisioner

Encoder Subprocesses

Media Gateway 500

[024] The Primary Application controls the signalling connection to the Media

Gateway and Channel Provisioner. All signalling requests from End Users come via

the cloud server to the Primary Application.

[025] The Channel Provisioner controls each of the encoder processes. It is

responsible for assigning each media source and stopping and starting the Encoder

Subprocesses.

[026] The Encoder Subprocesses create a signalling connection to the Media

Gateway via the cloud server for authentication before establishing a direct peer-to

peer webRTC connection to the Media Gateway 500. The Encoder Subprocesses are

responsible for receiving the multicast MPEG-TS UDP streams and re-encoding the

streams to a format suitable for the End User devices.

[027] The Media Gateway 500 handles receiving the encoded streams from the

Encoder Subprocesses and redistributes the content to the End Users via the

established peer-to-peer webRTC connections created from a signaling

establishment. The Cloud server 400 manages an IP whitelist for each venue location

that forbids a user to establish a peer-to-peer connection to the media broadcast

server unless they are connected to the venue's network via the local access point.

If a user disconnects from a v enue's network whilst watching a stream. The

connection is immediately severed and a prompt is shown to return to the venue to

continue watching the content.

[028] Referring to Figures 5 to 8, media may be received at the Media Broadcast

Server 300 from a number of different sources via the broadcast signal receiver and

the demodulators or decoders as discussed in the previous sections. The media

broadcast server 300 may also receive media content from URL based media

sources. The source decoders (usually provided by cable broadcast companies to

decode the broadcast signal) may be directed to a media encoder or modulator and

thereafter media content may be received via a: "MPEG-TS multicast UDP stream"

over the Venue's local area network. This arrangement allows the content being

streamed by the media broadcast server to be in sync with MATV devices and IPTV

decoders as the source derives from the same origin. However, the sources can be

from any source available via the local network or the internet and can be redistributed

as MPEG-TS multicast UDP streams to transmit the content in sync to IPTV decoders.

Media may also be ingested via USB capture cards such as a Blackmagic ATEM

broadcast switcher or a HDMI capture device.

[029] Configuration for the media sources is done via an application hosted on the

remote cloud-based server 400 that handles User Account Control and management

of the venue's Media Broadcast Servers 300.

[030] Media Conversions-The media broadcast server encodes all incoming media

sources to a suitable format for webRTC transmission to the user's personal devices

100. Currently the broadcast server 300 is configured to convert the streams to:

Video Codec: VP8

Audio Codec: OPUS

[031] The only time the media server 300 does not re-encode the stream is if the

source is coming directly from webRTC and is already in a suitable format for

retransmission. The media broadcast server can convert a webRTC source to MPEG

TS UDP to transmit back to the venue's IPTV network.

[032] The above-described method and system 1000 ensures that the video content

being broadcast on the end user's personal mobile device 100 is transmitted directly

from the venue's local broadcasting server 300 and the video content never leaves the

local broadcasting distribution network. As a result, the content received on the

broadcast signal receiver 200 never leaves the physical boundaries of the venue

location and the local media distribution of the content falls within the scope of the

terms and conditions venue's subscription or contractual obligations. The content

being broadcast to an End User's device never leaves the local network as a result of

which the content falls within a venue's distribution license that a venue holds with

the broadcaster to rebroadcast the content throughout their physical premises.

[033] Referring to Figure 8, a method of overlaying additional content on the re

directed video stream received on the personal user's devices through the media

broadcast network 300. The memory device on the broadcasting server 300 comprises executable instructions to generate interactive content and displaying the interactive content overlaid on the video content being streamed on the user's device for pre determined periods of time. Frames captured from the channel encoder subprocess in the media gateway device are sent to an intercepting "GPU" process (that may be undertaken at the media broadcasting server 300) that:

Receives the decoded video frame by frame from the input source.

Frame is Uploaded to the GPU context.

Frame is rendered as a texture element on a canvas that allows manipulation.

Overlaid content (eg, video, Images, Text) is applied and manipulated.

Frame data is downloaded back into GPU memory device and is inserted

before the content is streamed to the end user encoder.

[034] In at least some embodiments, the overlaid content may be generated in

response to the user-input received on the remote cloud server 400. As a result, the

overlaid content may be tailored in line with the user's personal preferences as

received on the user input interface of the user's device when they access the

application on the remote server.

[035] In compliance with the statute, the invention has been described in language

more or less specific to structural or methodical features. The term "comprises" and

its variations, such as "comprising" and "comprised of" is used throughout in an

inclusive sense and not to the exclusion of any additional features.

[036] It is to be understood that the invention is not limited to specific features shown

or described since the means herein described comprises preferred forms of putting

the invention into effect.

[037] The invention is, therefore, claimed in any of its forms or modifications within

the proper scope of the appended claims appropriately interpreted by those skilled in

the art.

Claims

1. A system for re-directing video content to a plurality of user devices

connected on a local network, the system comprising:

a broadcast signal receiver for receiving and producing unrendered

video data for display on one or more primary display devices located in a given

area;

a local broadcast signal distribution network for distributing video content

data from the broadcast signal receiver;

a broadcasting server arranged to receive the video content data from

the broadcast signal receiver via the broadcast signal distribution network;

the broadcasting server comprising a memory device with executable

instructions to conditionally broadcast the video data from the broadcasting

server to said one or more user devices over a local area network upon verifying

physical locations of each of the user devices by undertaking one or more

physical location verification steps thereby providing conditional access to one

or more of the user devices over the local area network (LAN).

2. A system in accordance with claim 1 further comprising a broadcast

signal decoder for decoding encoded video signals received by the broadcast

signal receiver for producing unrendered video data for display on the one or

more primary display devices located in a given area; and

a video encoder having an input configured to be in communication with

an output of the broadcast signal receiver and decoder, the encoder being

arranged for encoding the unrendered video data produced by the broadcast

signal decoder; wherein the broadcasting server is arranged to receive the encoded video data from an output of the video encoder.

3. A system in accordance with claim 1 or claim 2 further comprising a gateway

device for receiving live digital video broadcast (DVB) from the broadcast

signal receiver and convert the received signals into video content streams

for distribution over the broadcast signal distribution network to the broadcast

server.

4. A system in accordance with any one of the preceding claims further

comprising a remotely located server in communication with the

broadcasting server and the plurality of user devices over a wide area

network (WAN) wherein the authentication server comprises a processor in

communication with a memory device having executable instructions to: (a)

receive authentication and access requests from one or more of the user

devices, (b) in response to receiving the authentication and access request,

verifying physical location of the one or more user devices requesting

authentication in accordance with one or more verification rules, (c) granting

authentication to the user device, if said one or more verification conditions

are met, for receiving video content from the broadcasting server overthe

local area network(LAN).

5. A system in accordance with claim 4 comprising one or more wireless access

points for allowing the plurality of user devices to access authorized video

content from the broadcasting server and for communication with the remote server whereby location of each of said plurality of devices requesting access is determined as a function of an Internet Protocol (IP) address associated with the wireless access point.

6. A system in accordance with claim 5 wherein upon determining location of

each of said plurality of devices as a function of the IP address, the user

device is granted access to connect with the broadcasting server for

streaming video data directly from the broadcasting server.

7. A system in accordance with any one of the preceding claims wherein the

memory device of the broadcast server further comprises executable

instructions for re-encoding the video data received by the broadcast server

and provision of one or more channels of re-encoded video data and

broadcast the re-encoded channels of video data to the one or more

authorized users upon receiving and confirming authorization instructions

from the remote server to grant video data access to one or more of said

users.

8. A system in accordance with any one of the preceding claims wherein the

memory device of the broadcast server comprises executable directions for

re-encoding the encoded video data received from the encoder before

broadcasting re-encoded video data to one or more of the user devices.

9. A system in accordance with any one of the preceding claims further

comprising a media gateway arranged to be in communication with the broadcasting server to broadcast re-encoded channels of video data to the one or more authorized user devices.

10. A system in accordance with any one of the preceding claims wherein format

for re-encoding of the encoded video data carried out by the broadcasting

server is dependent upon an access request generated by the user device

whereby the access request specifies a format for receiving video content

from the broadcast server.

11.A system in accordance with any one of the preceding claims wherein the

memory device of the remote server comprises executable instructions to

receive user-provided information to determine an identification of the user

and obtaining information about the user to enable authorization to receive

video content from the broadcasting server.

12.A system in accordance with claim 11 wherein the memory device on the

broadcasting server further comprises executable instructions to generate

interactive content and displaying the interactive content overlaid on the

video content being streamed on the user's device for pre-determined

periods of time.

13. A system in accordance with claim 12 wherein the interactive content is

generated in response to receiving user-provided information.

14.A method of re-directing video content to a plurality of user devices

connected on a local network, the method comprising the steps of: providing a broadcast signal receiver to receive and produce unrendered video data for display on one or more primary display devices located in a given area; provisioning a local broadcast signal distribution network to communicate with the broadcast signal receiver for distributing video content data from the broadcast signal receiver; arranging a broadcasting server to be in communication with the broadcast distribution network to receive the video content data from the broadcast signal receiver via the broadcast signal distribution network; the broadcasting server comprising a memory device; and executing instructions saved on the memory device to conditionally broadcast the video data from the broadcasting server to said one or more user devices over a local area network upon verifying physical locations of each of the user devices by undertaking one or more physical location verification steps thereby providing conditional access to one or more of the user devices over the local area network (LAN).

2022201273

Cloud Server 400 (Authentication, Signaling, Application Serving)

200 Media Broadcasting 300 Server

100

FIGURE 1

End User connects to the Venue Network via Access Point 2022201273

Location of End User determined by the IP Address of the Access Point when User accesses Application on Remote Server

Remote Server matches the IP address of the end user with a Media Broadcast Server located in close physical proximity to the end user

Upon authentication, End User is provided a selection of available channels of video content by Media Broadcasting Server

After channel selection, video content is broadcast from the Media Broadcasting Server to End User over the Venue Network

FIGURE 2

Cloud Server 400 (Authentication, Signaling, Application Serving)

Media Broadcasting Server

300 100

FIGURE 3

FIGURE 4

200

Media Broadcasting Server

300

FIGURE 5 100

200

Media Broadcasting Server 300

FIGURE 6 100

Media Broadcasting Server

300

FIGURE 7

FIGURE 8