WO2022025751A1 - A system and method for mirroring and distributing a presentation content - Google Patents

A system and method for mirroring and distributing a presentation content Download PDF

Info

Publication number
WO2022025751A1
WO2022025751A1 PCT/MY2020/050172 MY2020050172W WO2022025751A1 WO 2022025751 A1 WO2022025751 A1 WO 2022025751A1 MY 2020050172 W MY2020050172 W MY 2020050172W WO 2022025751 A1 WO2022025751 A1 WO 2022025751A1
Authority
WO
WIPO (PCT)
Prior art keywords
content
web
mirroring
source device
captured
Prior art date
Application number
PCT/MY2020/050172
Other languages
French (fr)
Inventor
Khong Neng Choong
Chrishanton Vethanayagam A/L SEBASTIAMPILLAI
Heng Tze Chieng
Kee Ngoh Ting
Putri Shahnim BINTI KHALID
Original Assignee
Mimos Berhad
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mimos Berhad filed Critical Mimos Berhad
Publication of WO2022025751A1 publication Critical patent/WO2022025751A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440236—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
    • H04N21/8153—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics comprising still images, e.g. texture, background image
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/12—Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
    • G09G2340/125—Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels wherein one of the images is motion video
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00—Aspects of data communication
    • G09G2370/16—Use of wireless transmission of display information

Definitions

  • the present invention relates to a system and method for content mirroring and distribution. More particularly, the present invention relates to a system and method for content mirroring and distribution in a network based on a wired and wireless communication medium.
  • Screen mirroring is widely implemented for content sharing during presentation sessions, where a presentation content on a local screen is captured and mirrored onto a bigger display device such as a projector.
  • screen mirroring allows for a better presentation experience, other users especially the viewers or audiences prefer to have an access to the presentation content on their own devices. Therefore, various systems and methods have been invented that are capable of distributing the presentation content to a number of user devices across a network.
  • Screen mirroring facilitates the content sharing and distribution among a large number of user devices, where a seamless display and distribution of the presentation content in real-time with a lightweight image footprint is desirable in order to increase users’ satisfaction and encourage participation during the presentation sessions. Therefore, there is a need for a system and method that addresses the abovementioned drawbacks.
  • a system (1000) for mirroring and distributing a presentation content comprises a first source device (10) configured to mirror the presentation content to a second source device (20) and a first display device (70), the second source device (20) configured to superimpose an additional content onto the presentation content and mirror the presentation content to a wireless presentation system or WPS (30), wherein the second source device (20) is connected to the first source device (10); the wireless presentation system or WPS (30) configured to capture the presentation content, analyse the presentation content, and convert the presentation content into a web- readable image, wherein the WPS (30) is connected to the second source device (20); and an application server (40) configured to store and transmit the web-readable image to at least one user device (60) directly or via an access point (50).
  • the first source device (10) further comprising a mirroring sender (11) configured to capture the presentation content, encode the presentation content, and transmit the presentation content to a mirroring receiver (21) of the second source device (20) as a video stream.
  • a mirroring sender (11) configured to capture the presentation content, encode the presentation content, and transmit the presentation content to a mirroring receiver (21) of the second source device (20) as a video stream.
  • the second source device (20) further comprising the mirroring receiver (21) configured to receive the video stream from the mirroring sender (11) of the first source device (10), a mirroring player (22) configured to read and display the video stream as a continuous video playback, a mirroring sender (23) configured to capture, encode, and transmit a new video stream to a mirroring receiver (31) of the WPS (30), and a video adaptation manager (24) configured to detect any incoming video stream from the first source device (10).
  • the mirroring receiver (21) configured to receive the video stream from the mirroring sender (11) of the first source device (10)
  • a mirroring player (22) configured to read and display the video stream as a continuous video playback
  • a mirroring sender (23) configured to capture, encode, and transmit a new video stream to a mirroring receiver (31) of the WPS (30)
  • a video adaptation manager (24) configured to detect any incoming video stream from the first source device (10).
  • the WPS (30) further comprising the mirroring receiver (31) configured to receive the video stream from the mirroring sender (23) of the second source device (20), a mirroring player (32) configured to read and display the video stream as a continuous video playback on the WPS (30) and a second display device (80), a content analyser (33) configured to capture a local screen of the mirroring player (32) and perform a content verification on the captured content, a content storage (34) configured to store a copy of the captured content as a web-readable image, and a content uploader (35) configured to copy and upload the web-readable image produced by the content analyser (33) into a web storage (41) of the application server (40).
  • the mirroring receiver (31) configured to receive the video stream from the mirroring sender (23) of the second source device (20)
  • a mirroring player (32) configured to read and display the video stream as a continuous video playback on the WPS (30) and a second display device (80)
  • a content analyser (33) configured to capture a local screen of the
  • the application server (40) further comprising the web storage (41) configured to store the web-readable image received from the content uploader (35) of the WPS (30), a content notifier (42) configured to notify a corresponding content notifier (52) on the access point (50) and a content manager (61) on the user device (60) of the web-readable image uploaded on the web storage (41) of the application server (40) and a web storage (51) of the access point (50), and a web server (43) configured to provide the web-readable image to a webpage in the user device (60).
  • the web storage (41) configured to store the web-readable image received from the content uploader (35) of the WPS (30)
  • a content notifier (42) configured to notify a corresponding content notifier (52) on the access point (50) and a content manager (61) on the user device (60) of the web-readable image uploaded on the web storage (41) of the application server (40) and a web storage (51) of the access point (50)
  • a web server (43) configured to provide the web
  • the access point (50) further comprising the web storage (51) configured to store the web-readable image received from the application server (40), the content notifier (52) configured to notify the content manager (61) on the user device (60) of the web-readable image uploaded on the web storage (51) of the access point (50), and a web server (53) configured to provide the web-readable image to the webpage in the user device (60).
  • the web storage (51) configured to store the web-readable image received from the application server (40)
  • the content notifier (52) configured to notify the content manager (61) on the user device (60) of the web-readable image uploaded on the web storage (51) of the access point (50)
  • a web server (53) configured to provide the web-readable image to the webpage in the user device (60).
  • the user device (60) further comprising the content manager (61) configured to request for the web-readable image from the application server (40) or from the access point (50).
  • a method for mirroring and distributing a presentation content is provided.
  • the method is characterised by the steps of activating a screen mirroring capability by defining a local display of a first source device (10) as a primary screen and a first display device (70) as a secondary screen; capturing the presentation content on the primary screen or the secondary screen by a mirroring sender (11) on the first source device (10), wherein the presentation content is encoded as a video stream; transmitting the video stream to a mirroring receiver (21) of a second source device (20) by the mirroring sender (11) if the connection between the first source device and the second source device (20) is established via a network cable; detecting the video stream on a Universal Serial Bus, USB port of the second source device (20) if the connection between the first source device and the second source device (20) is established via a USB connection; displaying the video stream on a mirroring player (22) of the second source device (20); capturing a local screen of the mirroring player (22) of the second source
  • the step of performing content verification on the captured content includes determining whether the captured content is an entirely white or black image, wherein the captured content is not verified if the captured content is determined to consist of an entirely white or black pixels; determining whether the captured content matches a default playback static content, wherein, the captured content is not verified if the pixels of the captured content match the pixels of the default playback static content; determining whether the captured content matches a previously captured content, wherein the captured content is not verified if the captured content matches the previously captured content; determining whether the captured content is a presentation slide, wherein the captured content is not verified if the captured content is identified to be a non-presentation slide; and determining whether the captured content is an objectionable content, wherein the captured content is not verified if the captured content is identified to be an objectionable content.
  • the step of determining whether the captured content is an entirely white or black image includes determining each pixel value in the captured content, wherein each pixel may contain a value ranging from 0 to 255, with 0 represents a black pixel and 255 represents a white pixel.
  • the step of determining whether the captured content matches a default playback static content includes comparing each pixel of the captured content with the pixels of the default playback static content.
  • the step of determining whether the captured content matches a previously captured content includes retrieving a previously captured content from a content storage (34); and performing an image comparison between the captured content and the previously captured content.
  • the step of determining whether the captured content is a presentation slide includes performing an identification of the captured content based on an information of the currently active application window on the second source device (20).
  • the step of determining whether the captured content is an objectionable content includes inputting the captured content into an image classifier model to produce an output decision, wherein the image classifier model separates the captured content into an objectional or non-objectional content; and producing Not- Safe-For-Work image and Safe-For-Work image scores by the image classifier model.
  • the step of determining the transmission of the web-readable image to the at least one user device (60) based on the number of users requesting for the web-readable image by the content notifier (42) includes determining if there is only a single user requesting for the web-readable image; notifying a content manager (61) of the user device (60) to read the web-readable image directly from the application server (40) if there is only a single user requesting for the web-readable image; and loading the web-readable image on a webpage of the user device (60).
  • the step includes transmitting the web-readable image to a web storage (51 ) of the access point (50); notifying the content manager (61) of the user device (60) to read the web- readable image from the access point (50); and loading the web-readable image on a webpage of the user device (60).
  • FIG. 1 illustrates an architecture diagram of a system (1000) for mirroring and distributing a presentation content according to an embodiment of the present invention.
  • FIG. 2 illustrates a block diagram of a first source device (10), a second source device (20), a wireless presentation system or WPS (30), an application server (40), an access point (50), and a user device (60) of the system (1000) of FIG.1.
  • FIG. 3a illustrates a flowchart of a method for mirroring and distributing a presentation content according to an embodiment of the present invention.
  • FIG. 3b illustrates a flowchart of a step for performing content verification by a content analyser (33) of the method of FIG. 3a.
  • FIG. 3c illustrates a flowchart of a step for determining a mode of transmission of a web-readable image to at least one user device (60) based on the number of users requesting for the web-readable image by a content notifier (42) of the method of FIG.
  • FIG. 1 illustrates an architecture diagram of a system (1000) for mirroring and distributing a presentation content according to an embodiment of the present invention.
  • the system (1000) is configured to mirror the presentation content from source devices (10, 20) to display devices (70, 80) via a wired connection while continuously distribute the presentation content to the user devices (60) across a network via a wireless connection.
  • the system (1000) includes a first source device (10), a second source device (20), a wireless presentation system or WPS (30), and an application server (40).
  • the first source device (10) may be connected directly to the second source device (20) using a network cable.
  • the first source device (10) may be connected to the second source device (20) via a video hub, wherein the connection is established if the second source device (20) is equipped with an incoming port that is capable of receiving and interpreting video signal such as a Universal Serial Bus or USB port.
  • a clicker device (95) may be used to coordinate pagination or navigation of the presentation content on the first source device (10) and second source device (20) via a USB connection.
  • the second source device (20) is connected to an alternative content database (94), wherein the alternative content database (94) provides an additional information that can be superimposed onto the presentation content such as advertisements, messages, videos, and etc.
  • the alternative content database (94) may be located within the devices such as the second source device (20) or the WPS (30), or externally in another device.
  • the second source device (20) is further connected to the WPS (30) via a wireless medium such as Wi-Fi.
  • the first source device (10) is connected to a first display device (70) via the video hub (91) and a video switcher (92) using a wired medium such as a Video Graphics Array or VGA or High Definition Multimedia Interface or HDMI connection.
  • the WPS (30) is connected to a second display device (80) via the video switcher (92) using a wired medium such as a VGA or HDMI connection.
  • the first display device (70) is used to display the presentation content mirrored from the first source device (10) while the second display device (80) is used to display a superimposed presentation content mirrored from the WPS (30).
  • the WPS (30), the application server (40), and at least one access point (50) are connected to a network switch (93) via a network cable to allow the distribution of the presentation content over the network, wherein the presentation content is transmitted to at least one user device (60) via a wireless connection.
  • the network may also include a network router (96) and an access controller (97).
  • FIG.2 illustrates a block diagram of the first source device (10), the second source device (20), the wireless presentation system or WPS (30), the application server (40), the access point (50) and the user device (60).
  • the first source device (10) is configured to mirror the presentation content to the second source device (20) and the first display device (70).
  • the first source device (10) further comprises a mirroring sender (11) configured to capture, encode, and transmit the presentation content as a video stream.
  • the mirroring sender (11 ) is connected to a mirroring receiver (21 ) of the second source device (20).
  • the second source device (20) is configured to receive the presentation content from the first source device (10), superimpose an additional content onto the presentation content and mirror the presentation content to the WPS (30).
  • the second source device (20) further comprises the mirroring receiver (21), a mirroring player (22), a mirroring sender (23), and a video adaptation manager (24).
  • the mirroring receiver (21) is configured to receive the video stream from the mirroring sender (11) of the first source device (10).
  • the mirroring receiver (21) is connected to the mirroring player (22).
  • the mirroring player (22) is configured to read and display the video stream as a continuous video playback.
  • the mirroring player (22) is connected to the mirroring sender (23).
  • the mirroring sender (23) is configured to capture, encode, and transmit a new video stream to a mirroring receiver (31) of the WPS (30), wherein the video stream consists of the presentation content that is superimposed with the additional content.
  • the mirroring sender (23) is connected to a mirroring receiver (31) of the WPS (30).
  • the video adaptation manager (24) is configured to detect any incoming video stream from the first source device (10), wherein the video adaptation manager (24) provides an alternative configuration to detect the video stream that is transmitted from the first source device (10) via a USB connection.
  • the video adaptation manager (24) is connected to the first source device (10) and the mirroring player (22) of the second source device (20).
  • the WPS (30) is configured to capture, analyse, and convert the presentation content into a web-readable image.
  • the WPS (30) further comprises the mirroring receiver (31), a mirroring player (32), a content analyser (33), a content storage (34), and a content uploader (35).
  • the mirroring receiver (31) is configured to receive the video stream from the mirroring sender (23) of the second source device (20).
  • the mirroring receiver (31) is connected to the mirroring player (32).
  • the mirroring player (32) is configured to read and display the video stream as a continuous video playback on the WPS (30) and the second display device (80).
  • the mirroring player (32) is connected to the content analyser (33).
  • the content analyser (33) is configured to capture a local screen of the mirroring player (32) and perform a content verification on the captured content.
  • the content analyser (33) is also configured to superimpose the captured content with the additional content.
  • the content analyser (33) is connected to the content storage (34).
  • the content storage (34) is configured to store a copy of the captured content as a web-readable image.
  • the content storage (34) is connected to the content uploader (35).
  • the content uploader (35) is configured to copy and upload the web-readable image produced by the content analyser (33) into a web storage (41 ) of the application server (40).
  • the application server (40) is configured to store and transmit the web-readable image to the user device (60) directly or via the access point (50).
  • the application server (40) further comprises the web storage (41), a content notifier (42), and a web server (43).
  • the web storage (41) is configured to store the web-readable image received from the content uploader (35) of the WPS (30).
  • the web storage (41) is connected to the content notifier (42) and the web server (43).
  • the content notifier (42) is configured to notify a corresponding content notifier (52) on the access point (50) and a content manager (61) on the user device (60) of the web-readable image uploaded on the web storage (41) of the application server (40) and a web storage (51) of the access point (50).
  • the content notifier (42) is connected to the content notifier (52) of the access point (50), a web storage (51) of the access point (50), and the content manager (61) of the user device (60).
  • the web server (43) is configured to provide the web-readable image to a webpage in the user device (60).
  • the web server (43) is connected to the user device
  • the access point (50) is configured to provide the web-readable image to multiple user devices (60).
  • the access point (50) serves as an intermediate device that is able to reduce the network traffic and processing overheads that may be incurred at the application server (40) whenever there are multiple users requesting for the same web-readable image.
  • the access point (50) further comprises the web storage (51), the content notifier (52), and a web server (53).
  • the web storage (51) is configured to store the web-readable image received from the application server (40).
  • the web storage (51) is connected to the content notifier (52) and the web server (53).
  • the content notifier (52) is configured to notify the content manager (61) on the user device (60) of the web-readable image uploaded on the web storage (51) of the access point (50).
  • the content notifier (52) is connected to the content manager (61) of the user device (60).
  • the web server (53) is configured to provide the web-readable image to the webpage in the user device (60).
  • the web server (53) is connected to the user device
  • the user device (60) is configured to display the web-readable image on the webpage of a browser.
  • the user device (60) further comprises a content manager (61 ) configured to request for the web-readable image from the application server (40) or from the access point (50).
  • FIG. 3a illustrates a flow chart of a method for mirroring and distributing presentation content according to an embodiment of the present invention.
  • the first source device (10) activates its screen mirroring capability by defining its local display as a primary screen and the first display device (70) as a secondary screen as in step 100.
  • the presentation content on the primary screen or the secondary screen is captured by the mirroring sender (11) on the first source device (10) as in step 101 , wherein the presentation content is encoded into a light-weight video stream by the mirroring sender (11).
  • the transmission of the video stream to the second source device (20) is determined based on the connection between the first source device (10) and the second source device (20) as in step 102. If the connection between the first source device (10) and the second source device (20) is established via the network cable, the video stream is transmitted to the mirroring receiver (21) of the second source device (20) by the mirroring sender (11) as in step 103. The video stream will then be displayed on the mirroring player (22) as a continuous video playback as in step 105.
  • the video stream will be detected on the USB port of the second source device (20) by the video adaptation manager (24) as in step 104.
  • the video stream will then be displayed on the mirroring player (22) as a continuous video playback as in step 105.
  • step 105 While the video stream is displayed on the mirroring player (22) as in step 105, an application window containing an additional information retrieved from the alternative content database (94) is loaded on top of the mirroring player (22) to generate a superimposed content.
  • the step of generating the superimposed content on the second source device (20) may be omitted if the user chooses to generate the superimposed content on the WPS (30).
  • the mirroring sender (23) then captures the local screen of the second source device (20) containing the video stream and the additional information as in step 106, wherein the captured content is encoded as a video stream.
  • the video stream is then transmitted to the mirroring receiver (31) on the WPS (30) by the mirroring sender (23) as in step 107.
  • step 108 the mirroring receiver (31) on the WPS (30) receives the video stream and displays the video stream as a continuous video playback on the mirroring player (32) of the WPS (30) and the second display device (80).
  • the mirroring player (32) then maximises its application window size, where the application window is then captured by the content analyser (33) as in step 109.
  • the content analyser (33) then performs a content verification to determine whether to store the captured content into the content storage (34) as in step 110.
  • the step of performing content verification by the content analyser (33) will be described further in relation to FIG. 3b.
  • the captured content may be superimposed with an additional content, wherein an application window containing additional information retrieved from the alternative content database (94) is loaded on top of the mirroring player (32) to generate a superimposed content.
  • the content analyser (33) may then captures the local screen of the WPS (30) containing the video stream and the additional information.
  • the step of generating the superimposed content on the WPS (30) may be omitted if the user chooses to generate the superimposed content on the second source device (20).
  • the captured content is then transmitted to the web storage (41) of the application server (40) by the content uploader (35) and stored as a web-readable image with its name, current date and time, and running number to indicate a sequence as in step 111.
  • the content notifier (42) determines a mode of transmission of the web-readable image to at least one user device (60) based on the number of users requesting for the web-readable image, wherein the web-readable image may be transmitted directly to the user device (60) from the application server (40) or through the access point (50).
  • the access point (50) is used to serve as the intermediate device that is able to reduce the network traffic and processing overheads that may be incurred at the application server (40) whenever there are multiple users requesting for the same web-readable image.
  • the step of determining the mode of transmission of the web-readable image to the at least one user device (60) by the content notifier (42) will be described further in relation to FIG.3c.
  • the web-readable image is then displayed on a webpage of the user device (60) as in step 113.
  • FIG. 3b illustrates the sub-steps for performing content verification by the content analyser (33) as in step 110 of the method of FIG. 3a.
  • the content analyser (33) determines whether the captured content is an entirely white or black image by determining each pixel value in the captured content. Each pixel may contain a value ranging from 0 to 255, with 0 represents a black pixel and 255 represents a white pixel. If the captured content is determined to consist of an entirely white or black pixels, the captured content is not verified and the method ends. Otherwise, the captured content is verified as in step 110b.
  • step 110c the content analyser (33) determines whether the captured content matches a default playback static content such as a default wallpaper which is shown on the display screen whenever the WPS (30) is first booted up. Each pixel of the captured content is compared to the pixels of the default playback static content. If the pixels of the captured content match the pixels of the default playback static content, the captured content is not verified and the method ends. Otherwise, the captured content is verified as in step 110d.
  • a default playback static content such as a default wallpaper which is shown on the display screen whenever the WPS (30) is first booted up.
  • Each pixel of the captured content is compared to the pixels of the default playback static content. If the pixels of the captured content match the pixels of the default playback static content, the captured content is not verified and the method ends. Otherwise, the captured content is verified as in step 110d.
  • step 110e the content analyser (33) determines whether the captured content matches a previously captured content.
  • the content analyser (33) retrieves a previously captured content from the content storage (34) and performs an image comparison between the captured content and the previously captured content. If the captured content matches the previously captured content, the captured content is not verified and the method ends. Otherwise, the captured content is verified as in step 11 Of.
  • the content analyser (33) determines whether the captured content is a presentation slide by performing an identification of the captured content based on an information of the currently active application window on the second source device (20).
  • the mirroring sender (22) of the second source device (20) invokes a system function in the operating system or OS to provide the information of the currently active application window, wherein the information may include but not limited to name of the application window, current window size, document filename and total number of pages.
  • the mirroring sender (22) then transmits the information to the mirroring receiver (31) of the WPS (30), where the information is then transmitted to the content analyser (33) for the identification of the captured content. If the captured content is identified to be a non-presentation slide, the captured content is not verified and the method ends. Otherwise, the captured content is verified as in step 11 Oh.
  • the content analyser (33) determines whether the captured content is an objectionable content using a deep learning technique, wherein the objectionable content is referred as any content that are deemed inappropriate to be displayed in a workplace.
  • the content analyser (33) builds an image classifier model which can separate the captured content into an objectional or non-objectional content.
  • the content analyser (33) can trained the classifier model using a Not-Safe-For-Work or NSFW dataset images, wherein the dataset images consist of NSFW images as positives and Safe-For-Work or SFW images as negatives.
  • the content analyser (33) may tune the learning rate to five times of the multiplier of the deep learning layers in order to achieve optimum performance.
  • the content analyser (33) then inputs the captured content into the classifier model to produce an image scores, wherein the content analyser (33) analyses both the NSFW image and SFW image scores produced by the classifier model. If the NSFW score reaches a specific threshold, the captured content is not verified and the method ends. Otherwise, the captured content is verified as in step 110j.
  • FIG. 3c illustrates the sub-steps of determining the mode of transmission of the web-readable image to the at least one user device (60) by the content notifier (42) as in step 112 of the method of FIG. 3a.
  • the content notifier (42) determines the number of users requesting for the web-readable image. If there is only a single user requesting for the web readable image, the content notifier (42) on the application server (40) notifies the content manager (61 ) on the user device (60) to read the web-readable image directly from the application server (40) as in step 112b.
  • the web server (43) on the application server (40) then responds by loading the web-readable image on the webpage of the user device (60) as in step 112c.
  • the content notifier (42) determines that there are more than one user requesting for the web-readable image
  • the content notifier (42) transmits the web-readable image to the web storage (51) of the access point (50) as in step 112d.
  • the content notifier (52) then notifies the content manager (61) on the user device (60) to read the web-readable image from the access point (50) as in step 112e.
  • the web server (53) on the access point (50) then responds by loading the web- readable image on the webpage of the user device (60) as in step 112f.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Graphics (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The present invention relates to a system (1000) and method for content mirroring and distribution. The system is configured to mirror a presentation content from source devices (10, 20) to display devices (70, 80) via a wired connection while continuously distribute the presentation content to user devices (60) across a network via a wireless connection. The system (1000) comprises a first source device (10), a second source device (20), a wireless presentation system or WPS (30), and an application server (40).

Description

A SYSTEM AND METHOD FOR MIRRORING AND DISTRIBUTING A PRESENTATION CONTENT
FIELD OF INVENTION
The present invention relates to a system and method for content mirroring and distribution. More particularly, the present invention relates to a system and method for content mirroring and distribution in a network based on a wired and wireless communication medium.
BACKGROUND OF THE INVENTION
Screen mirroring is widely implemented for content sharing during presentation sessions, where a presentation content on a local screen is captured and mirrored onto a bigger display device such as a projector. Although screen mirroring allows for a better presentation experience, other users especially the viewers or audiences prefer to have an access to the presentation content on their own devices. Therefore, various systems and methods have been invented that are capable of distributing the presentation content to a number of user devices across a network.
An example of system and method to perform screen mirroring and content distribution is disclosed by the United States Patent Publication No. US 2018167426 A1 which provides a screen sharing system that is accessible to user devices that could access the Internet. The system provides a browser-based client software on a host device that generates a unique session identification upon users’ request and performs a real-time screen sharing session via a website provided by a server.
Although most of the systems and methods are capable of performing screen mirroring and content distribution among multiple devices, such systems and methods are designed to execute both screen mirroring and content distribution over a shared wireless communication medium, which resulted in signal interference and congestion problems. Since most of the systems distribute the content over the Internet, it introduces further delay in transmitting the content to the user devices. Furthermore, most systems and methods are only capable of capturing a primary display of a host device at a time. This may cause a disengagement of the screen mirroring between the host device and the user devices whenever the host device is required to perform backstage or localised activities such as content or file searching. Screen mirroring facilitates the content sharing and distribution among a large number of user devices, where a seamless display and distribution of the presentation content in real-time with a lightweight image footprint is desirable in order to increase users’ satisfaction and encourage participation during the presentation sessions. Therefore, there is a need for a system and method that addresses the abovementioned drawbacks.
SUMMARY OF INVENTION
According to one aspect of the present invention, a system (1000) for mirroring and distributing a presentation content is provided. The system comprises a first source device (10) configured to mirror the presentation content to a second source device (20) and a first display device (70), the second source device (20) configured to superimpose an additional content onto the presentation content and mirror the presentation content to a wireless presentation system or WPS (30), wherein the second source device (20) is connected to the first source device (10); the wireless presentation system or WPS (30) configured to capture the presentation content, analyse the presentation content, and convert the presentation content into a web- readable image, wherein the WPS (30) is connected to the second source device (20); and an application server (40) configured to store and transmit the web-readable image to at least one user device (60) directly or via an access point (50).
Preferably, the first source device (10) further comprising a mirroring sender (11) configured to capture the presentation content, encode the presentation content, and transmit the presentation content to a mirroring receiver (21) of the second source device (20) as a video stream.
Preferably, the second source device (20) further comprising the mirroring receiver (21) configured to receive the video stream from the mirroring sender (11) of the first source device (10), a mirroring player (22) configured to read and display the video stream as a continuous video playback, a mirroring sender (23) configured to capture, encode, and transmit a new video stream to a mirroring receiver (31) of the WPS (30), and a video adaptation manager (24) configured to detect any incoming video stream from the first source device (10). Preferably, the WPS (30) further comprising the mirroring receiver (31) configured to receive the video stream from the mirroring sender (23) of the second source device (20), a mirroring player (32) configured to read and display the video stream as a continuous video playback on the WPS (30) and a second display device (80), a content analyser (33) configured to capture a local screen of the mirroring player (32) and perform a content verification on the captured content, a content storage (34) configured to store a copy of the captured content as a web-readable image, and a content uploader (35) configured to copy and upload the web-readable image produced by the content analyser (33) into a web storage (41) of the application server (40).
Preferably, the application server (40) further comprising the web storage (41) configured to store the web-readable image received from the content uploader (35) of the WPS (30), a content notifier (42) configured to notify a corresponding content notifier (52) on the access point (50) and a content manager (61) on the user device (60) of the web-readable image uploaded on the web storage (41) of the application server (40) and a web storage (51) of the access point (50), and a web server (43) configured to provide the web-readable image to a webpage in the user device (60).
Preferably, the access point (50) further comprising the web storage (51) configured to store the web-readable image received from the application server (40), the content notifier (52) configured to notify the content manager (61) on the user device (60) of the web-readable image uploaded on the web storage (51) of the access point (50), and a web server (53) configured to provide the web-readable image to the webpage in the user device (60).
Preferably, the user device (60) further comprising the content manager (61) configured to request for the web-readable image from the application server (40) or from the access point (50).
According to another aspect of the present invention, a method for mirroring and distributing a presentation content is provided. The method is characterised by the steps of activating a screen mirroring capability by defining a local display of a first source device (10) as a primary screen and a first display device (70) as a secondary screen; capturing the presentation content on the primary screen or the secondary screen by a mirroring sender (11) on the first source device (10), wherein the presentation content is encoded as a video stream; transmitting the video stream to a mirroring receiver (21) of a second source device (20) by the mirroring sender (11) if the connection between the first source device and the second source device (20) is established via a network cable; detecting the video stream on a Universal Serial Bus, USB port of the second source device (20) if the connection between the first source device and the second source device (20) is established via a USB connection; displaying the video stream on a mirroring player (22) of the second source device (20); capturing a local screen of the mirroring player (22) of the second source device (20) by a mirroring sender (23), wherein the captured content is encoded as a video stream; transmitting the video stream to a mirroring receiver (31) of a Wireless Presentation System, WPS (30) by the mirroring sender (23); displaying the video stream on a mirroring player (32) of the WPS (30) and a second display device (80); capturing an application window of the mirroring player (32) of the WPS (30) by a content analyser (33); performing content verification on the captured content by the content analyser (33); transmitting the captured content to a web storage (41) of an application server (40) by the content uploader (35), wherein the captured content is stored as a web-readable image; determining the transmission of the web-readable image to at least one user device (60) based on the number of users requesting for the web-readable image by a content notifier (42); and displaying the web-readable image on a webpage of the user device (60).
Preferably, the step of performing content verification on the captured content includes determining whether the captured content is an entirely white or black image, wherein the captured content is not verified if the captured content is determined to consist of an entirely white or black pixels; determining whether the captured content matches a default playback static content, wherein, the captured content is not verified if the pixels of the captured content match the pixels of the default playback static content; determining whether the captured content matches a previously captured content, wherein the captured content is not verified if the captured content matches the previously captured content; determining whether the captured content is a presentation slide, wherein the captured content is not verified if the captured content is identified to be a non-presentation slide; and determining whether the captured content is an objectionable content, wherein the captured content is not verified if the captured content is identified to be an objectionable content. Preferably, the step of determining whether the captured content is an entirely white or black image includes determining each pixel value in the captured content, wherein each pixel may contain a value ranging from 0 to 255, with 0 represents a black pixel and 255 represents a white pixel.
Preferably, the step of determining whether the captured content matches a default playback static content includes comparing each pixel of the captured content with the pixels of the default playback static content.
Preferably, the step of determining whether the captured content matches a previously captured content includes retrieving a previously captured content from a content storage (34); and performing an image comparison between the captured content and the previously captured content.
Preferably, the step of determining whether the captured content is a presentation slide includes performing an identification of the captured content based on an information of the currently active application window on the second source device (20).
Preferably, the step of determining whether the captured content is an objectionable content includes inputting the captured content into an image classifier model to produce an output decision, wherein the image classifier model separates the captured content into an objectional or non-objectional content; and producing Not- Safe-For-Work image and Safe-For-Work image scores by the image classifier model.
Preferably, the step of determining the transmission of the web-readable image to the at least one user device (60) based on the number of users requesting for the web-readable image by the content notifier (42) includes determining if there is only a single user requesting for the web-readable image; notifying a content manager (61) of the user device (60) to read the web-readable image directly from the application server (40) if there is only a single user requesting for the web-readable image; and loading the web-readable image on a webpage of the user device (60). On the other hand, if there are more than one user requesting for the web-readable image, the step includes transmitting the web-readable image to a web storage (51 ) of the access point (50); notifying the content manager (61) of the user device (60) to read the web- readable image from the access point (50); and loading the web-readable image on a webpage of the user device (60).
BRIEF DESCRIPTION OF THE DRAWINGS
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.
FIG. 1 illustrates an architecture diagram of a system (1000) for mirroring and distributing a presentation content according to an embodiment of the present invention.
FIG. 2 illustrates a block diagram of a first source device (10), a second source device (20), a wireless presentation system or WPS (30), an application server (40), an access point (50), and a user device (60) of the system (1000) of FIG.1.
FIG. 3a illustrates a flowchart of a method for mirroring and distributing a presentation content according to an embodiment of the present invention.
FIG. 3b illustrates a flowchart of a step for performing content verification by a content analyser (33) of the method of FIG. 3a.
FIG. 3c illustrates a flowchart of a step for determining a mode of transmission of a web-readable image to at least one user device (60) based on the number of users requesting for the web-readable image by a content notifier (42) of the method of FIG.
3a.
DESCRIPTION OF THE PREFERRED EMBODIMENT
A preferred embodiment of the present invention will be described herein below with reference to the accompanying drawings. In the following description, well known functions or constructions are not described in detail since they would obscure the description with unnecessary detail. An initial reference is made to FIG. 1 which illustrates an architecture diagram of a system (1000) for mirroring and distributing a presentation content according to an embodiment of the present invention. The system (1000) is configured to mirror the presentation content from source devices (10, 20) to display devices (70, 80) via a wired connection while continuously distribute the presentation content to the user devices (60) across a network via a wireless connection. Generally, the system (1000) includes a first source device (10), a second source device (20), a wireless presentation system or WPS (30), and an application server (40).
The first source device (10) may be connected directly to the second source device (20) using a network cable. Alternatively, the first source device (10) may be connected to the second source device (20) via a video hub, wherein the connection is established if the second source device (20) is equipped with an incoming port that is capable of receiving and interpreting video signal such as a Universal Serial Bus or USB port. A clicker device (95) may be used to coordinate pagination or navigation of the presentation content on the first source device (10) and second source device (20) via a USB connection.
The second source device (20) is connected to an alternative content database (94), wherein the alternative content database (94) provides an additional information that can be superimposed onto the presentation content such as advertisements, messages, videos, and etc. The alternative content database (94) may be located within the devices such as the second source device (20) or the WPS (30), or externally in another device. The second source device (20) is further connected to the WPS (30) via a wireless medium such as Wi-Fi. The first source device (10) is connected to a first display device (70) via the video hub (91) and a video switcher (92) using a wired medium such as a Video Graphics Array or VGA or High Definition Multimedia Interface or HDMI connection. The WPS (30) is connected to a second display device (80) via the video switcher (92) using a wired medium such as a VGA or HDMI connection. The first display device (70) is used to display the presentation content mirrored from the first source device (10) while the second display device (80) is used to display a superimposed presentation content mirrored from the WPS (30).
The WPS (30), the application server (40), and at least one access point (50) are connected to a network switch (93) via a network cable to allow the distribution of the presentation content over the network, wherein the presentation content is transmitted to at least one user device (60) via a wireless connection. The network may also include a network router (96) and an access controller (97).
FIG.2 illustrates a block diagram of the first source device (10), the second source device (20), the wireless presentation system or WPS (30), the application server (40), the access point (50) and the user device (60). The first source device (10) is configured to mirror the presentation content to the second source device (20) and the first display device (70). The first source device (10) further comprises a mirroring sender (11) configured to capture, encode, and transmit the presentation content as a video stream. The mirroring sender (11 ) is connected to a mirroring receiver (21 ) of the second source device (20).
The second source device (20) is configured to receive the presentation content from the first source device (10), superimpose an additional content onto the presentation content and mirror the presentation content to the WPS (30). The second source device (20) further comprises the mirroring receiver (21), a mirroring player (22), a mirroring sender (23), and a video adaptation manager (24).
The mirroring receiver (21) is configured to receive the video stream from the mirroring sender (11) of the first source device (10). The mirroring receiver (21) is connected to the mirroring player (22).
The mirroring player (22) is configured to read and display the video stream as a continuous video playback. The mirroring player (22) is connected to the mirroring sender (23).
The mirroring sender (23) is configured to capture, encode, and transmit a new video stream to a mirroring receiver (31) of the WPS (30), wherein the video stream consists of the presentation content that is superimposed with the additional content. The mirroring sender (23) is connected to a mirroring receiver (31) of the WPS (30).
The video adaptation manager (24) is configured to detect any incoming video stream from the first source device (10), wherein the video adaptation manager (24) provides an alternative configuration to detect the video stream that is transmitted from the first source device (10) via a USB connection. The video adaptation manager (24) is connected to the first source device (10) and the mirroring player (22) of the second source device (20).
The WPS (30) is configured to capture, analyse, and convert the presentation content into a web-readable image. The WPS (30) further comprises the mirroring receiver (31), a mirroring player (32), a content analyser (33), a content storage (34), and a content uploader (35).
The mirroring receiver (31) is configured to receive the video stream from the mirroring sender (23) of the second source device (20). The mirroring receiver (31) is connected to the mirroring player (32).
The mirroring player (32) is configured to read and display the video stream as a continuous video playback on the WPS (30) and the second display device (80). The mirroring player (32) is connected to the content analyser (33).
The content analyser (33) is configured to capture a local screen of the mirroring player (32) and perform a content verification on the captured content. The content analyser (33) is also configured to superimpose the captured content with the additional content. The content analyser (33) is connected to the content storage (34).
The content storage (34) is configured to store a copy of the captured content as a web-readable image. The content storage (34) is connected to the content uploader (35).
The content uploader (35) is configured to copy and upload the web-readable image produced by the content analyser (33) into a web storage (41 ) of the application server (40).
The application server (40) is configured to store and transmit the web-readable image to the user device (60) directly or via the access point (50). The application server (40) further comprises the web storage (41), a content notifier (42), and a web server (43). The web storage (41) is configured to store the web-readable image received from the content uploader (35) of the WPS (30). The web storage (41) is connected to the content notifier (42) and the web server (43).
The content notifier (42) is configured to notify a corresponding content notifier (52) on the access point (50) and a content manager (61) on the user device (60) of the web-readable image uploaded on the web storage (41) of the application server (40) and a web storage (51) of the access point (50). The content notifier (42) is connected to the content notifier (52) of the access point (50), a web storage (51) of the access point (50), and the content manager (61) of the user device (60).
The web server (43) is configured to provide the web-readable image to a webpage in the user device (60). The web server (43) is connected to the user device
(60).
The access point (50) is configured to provide the web-readable image to multiple user devices (60). The access point (50) serves as an intermediate device that is able to reduce the network traffic and processing overheads that may be incurred at the application server (40) whenever there are multiple users requesting for the same web-readable image. The access point (50) further comprises the web storage (51), the content notifier (52), and a web server (53).
The web storage (51) is configured to store the web-readable image received from the application server (40). The web storage (51) is connected to the content notifier (52) and the web server (53).
The content notifier (52) is configured to notify the content manager (61) on the user device (60) of the web-readable image uploaded on the web storage (51) of the access point (50). The content notifier (52) is connected to the content manager (61) of the user device (60).
The web server (53) is configured to provide the web-readable image to the webpage in the user device (60). The web server (53) is connected to the user device
(60). The user device (60) is configured to display the web-readable image on the webpage of a browser. The user device (60) further comprises a content manager (61 ) configured to request for the web-readable image from the application server (40) or from the access point (50).
Reference is now made to FIG. 3a which illustrates a flow chart of a method for mirroring and distributing presentation content according to an embodiment of the present invention. Initially, the first source device (10) activates its screen mirroring capability by defining its local display as a primary screen and the first display device (70) as a secondary screen as in step 100. Next, the presentation content on the primary screen or the secondary screen is captured by the mirroring sender (11) on the first source device (10) as in step 101 , wherein the presentation content is encoded into a light-weight video stream by the mirroring sender (11).
Thereon, the transmission of the video stream to the second source device (20) is determined based on the connection between the first source device (10) and the second source device (20) as in step 102. If the connection between the first source device (10) and the second source device (20) is established via the network cable, the video stream is transmitted to the mirroring receiver (21) of the second source device (20) by the mirroring sender (11) as in step 103. The video stream will then be displayed on the mirroring player (22) as a continuous video playback as in step 105.
On the other hand, if the connection between the first source device (10) and the second source device (20) is established via the USB connection, the video stream will be detected on the USB port of the second source device (20) by the video adaptation manager (24) as in step 104. The video stream will then be displayed on the mirroring player (22) as a continuous video playback as in step 105.
While the video stream is displayed on the mirroring player (22) as in step 105, an application window containing an additional information retrieved from the alternative content database (94) is loaded on top of the mirroring player (22) to generate a superimposed content. However, the step of generating the superimposed content on the second source device (20) may be omitted if the user chooses to generate the superimposed content on the WPS (30). The mirroring sender (23) then captures the local screen of the second source device (20) containing the video stream and the additional information as in step 106, wherein the captured content is encoded as a video stream. The video stream is then transmitted to the mirroring receiver (31) on the WPS (30) by the mirroring sender (23) as in step 107.
In step 108, the mirroring receiver (31) on the WPS (30) receives the video stream and displays the video stream as a continuous video playback on the mirroring player (32) of the WPS (30) and the second display device (80). The mirroring player (32) then maximises its application window size, where the application window is then captured by the content analyser (33) as in step 109. The content analyser (33) then performs a content verification to determine whether to store the captured content into the content storage (34) as in step 110. The step of performing content verification by the content analyser (33) will be described further in relation to FIG. 3b.
The captured content may be superimposed with an additional content, wherein an application window containing additional information retrieved from the alternative content database (94) is loaded on top of the mirroring player (32) to generate a superimposed content. The content analyser (33) may then captures the local screen of the WPS (30) containing the video stream and the additional information. However, the step of generating the superimposed content on the WPS (30) may be omitted if the user chooses to generate the superimposed content on the second source device (20).
The captured content is then transmitted to the web storage (41) of the application server (40) by the content uploader (35) and stored as a web-readable image with its name, current date and time, and running number to indicate a sequence as in step 111.
In step 112, the content notifier (42) determines a mode of transmission of the web-readable image to at least one user device (60) based on the number of users requesting for the web-readable image, wherein the web-readable image may be transmitted directly to the user device (60) from the application server (40) or through the access point (50). The access point (50) is used to serve as the intermediate device that is able to reduce the network traffic and processing overheads that may be incurred at the application server (40) whenever there are multiple users requesting for the same web-readable image. The step of determining the mode of transmission of the web-readable image to the at least one user device (60) by the content notifier (42) will be described further in relation to FIG.3c.
The web-readable image is then displayed on a webpage of the user device (60) as in step 113.
Reference is now made to FIG. 3b which illustrates the sub-steps for performing content verification by the content analyser (33) as in step 110 of the method of FIG. 3a. In step 110a, the content analyser (33) determines whether the captured content is an entirely white or black image by determining each pixel value in the captured content. Each pixel may contain a value ranging from 0 to 255, with 0 represents a black pixel and 255 represents a white pixel. If the captured content is determined to consist of an entirely white or black pixels, the captured content is not verified and the method ends. Otherwise, the captured content is verified as in step 110b.
In step 110c, the content analyser (33) determines whether the captured content matches a default playback static content such as a default wallpaper which is shown on the display screen whenever the WPS (30) is first booted up. Each pixel of the captured content is compared to the pixels of the default playback static content. If the pixels of the captured content match the pixels of the default playback static content, the captured content is not verified and the method ends. Otherwise, the captured content is verified as in step 110d.
In step 110e, the content analyser (33) determines whether the captured content matches a previously captured content. The content analyser (33) retrieves a previously captured content from the content storage (34) and performs an image comparison between the captured content and the previously captured content. If the captured content matches the previously captured content, the captured content is not verified and the method ends. Otherwise, the captured content is verified as in step 11 Of. In step 110g, the content analyser (33) determines whether the captured content is a presentation slide by performing an identification of the captured content based on an information of the currently active application window on the second source device (20). The mirroring sender (22) of the second source device (20) invokes a system function in the operating system or OS to provide the information of the currently active application window, wherein the information may include but not limited to name of the application window, current window size, document filename and total number of pages. The mirroring sender (22) then transmits the information to the mirroring receiver (31) of the WPS (30), where the information is then transmitted to the content analyser (33) for the identification of the captured content. If the captured content is identified to be a non-presentation slide, the captured content is not verified and the method ends. Otherwise, the captured content is verified as in step 11 Oh.
In step 110i, the content analyser (33) determines whether the captured content is an objectionable content using a deep learning technique, wherein the objectionable content is referred as any content that are deemed inappropriate to be displayed in a workplace. The content analyser (33) builds an image classifier model which can separate the captured content into an objectional or non-objectional content. The content analyser (33) can trained the classifier model using a Not-Safe-For-Work or NSFW dataset images, wherein the dataset images consist of NSFW images as positives and Safe-For-Work or SFW images as negatives. The content analyser (33) may tune the learning rate to five times of the multiplier of the deep learning layers in order to achieve optimum performance. The content analyser (33) then inputs the captured content into the classifier model to produce an image scores, wherein the content analyser (33) analyses both the NSFW image and SFW image scores produced by the classifier model. If the NSFW score reaches a specific threshold, the captured content is not verified and the method ends. Otherwise, the captured content is verified as in step 110j.
Reference is now made to FIG. 3c which illustrates the sub-steps of determining the mode of transmission of the web-readable image to the at least one user device (60) by the content notifier (42) as in step 112 of the method of FIG. 3a. In step 112a, the content notifier (42) determines the number of users requesting for the web-readable image. If there is only a single user requesting for the web readable image, the content notifier (42) on the application server (40) notifies the content manager (61 ) on the user device (60) to read the web-readable image directly from the application server (40) as in step 112b. The web server (43) on the application server (40) then responds by loading the web-readable image on the webpage of the user device (60) as in step 112c.
On the other hand, if the content notifier (42) determines that there are more than one user requesting for the web-readable image, the content notifier (42) transmits the web-readable image to the web storage (51) of the access point (50) as in step 112d. The content notifier (52) then notifies the content manager (61) on the user device (60) to read the web-readable image from the access point (50) as in step 112e. The web server (53) on the access point (50) then responds by loading the web- readable image on the webpage of the user device (60) as in step 112f.
While embodiments of the invention have been illustrated and described, it is not intended that these embodiments illustrate and describe all possible forms of the invention. Rather, the words used in the specifications are words of description rather than limitation and various changes may be made without departing from the scope of the invention.

Claims

1. A system (1000) for mirroring and distributing a presentation content comprising: a) a first source device (10) configured to mirror the presentation content to a second source device (20) and a first display device (70), characterised in that the system (1000) further comprising: b) an application server (40) configured to store and transmit the web- readable image to at least one user device (60) directly or via an access point (50), c) wherein the second source device (20) configured to superimpose an additional content onto the presentation content and mirror the presentation content to a wireless presentation system, WPS (30), wherein the second source device (20) is connected to the first source device (10); and d) wherein the wireless presentation system, WPS (30) configured to capture the presentation content, analyse the presentation content, and convert the presentation content into a web-readable image, wherein the WPS (30) is connected to the second source device (20).
2. The system (1000) as claimed in Claim 1 , wherein the first source device (10) further comprising a mirroring sender (11) configured to capture the presentation content, encode the presentation content, and transmit the presentation content to a mirroring receiver (21) of the second source device (20) as a video stream.
3. The system (1000) as claimed in Claim 1 , wherein the second source device (20) further comprising: a) a mirroring receiver (21) configured to receive the video stream from a mirroring sender (11) of the first source device (10); b) a mirroring player (22) configured to read and display the video stream as a continuous video playback; c) a mirroring sender (23) configured to capture, encode, and transmit a new video stream to a mirroring receiver (31) of the WPS (30); and d) a video adaptation manager (24) configured to detect any incoming video stream from the first source device (10).
4. The system (1000) as claimed in Claim 1 , wherein the WPS (30) further comprising: a) a mirroring receiver (31) configured to receive the video stream from a mirroring sender (23) of the second source device (20); b) a mirroring player (32) configured to read and display the video stream as a continuous video playback on the WPS (30) and a second display device (80); c) a content analyser (33) configured to capture a local screen of the mirroring player (32) and perform a content verification on the captured content; d) a content storage (34) configured to store a copy of the captured content as a web-readable image; and e) a content uploader (35) configured to copy and upload the web- readable image produced by the content analyser (33) into a web storage (41) of the application server (40).
5. The system (1000) as claimed in Claim 1 , wherein the application server (40) further comprising: a) a web storage (41) configured to store the web-readable image received from a content uploader (35) of the WPS (30); b) a content notifier (42) configured to notify a corresponding content notifier (52) on the access point (50) and a content manager (61) on the user device (60) of the web-readable image uploaded on the web storage (41) of the application server (40) and a web storage (51) of the access point (50); and c) a web server (43) configured to provide the web-readable image to a webpage in the user device (60).
6. The system (1000) as claimed in Claim 1 , wherein the access point (50) further comprising: a) a web storage (51) configured to store the web-readable image received from the application server (40); b) a content notifier (52) configured to notify a content manager (61) on the user device (60) of the web-readable image uploaded on the web storage (51) of the access point (50); and c) a web server (53) configured to provide the web-readable image to the webpage in the user device (60).
7. The system (1000) as claimed in Claim 1 , wherein the user device (60) further comprising a content manager (61) configured to request for the web-readable image from the application server (40) or from the access point (50).
8. A method for mirroring and distributing a presentation content is characterised by the steps of: a) activating a screen mirroring capability by defining a local display of a first source device (10) as a primary screen and a first display device (70) as a secondary screen; b) capturing the presentation content on the primary screen or the secondary screen by a mirroring sender (11) on the first source device (10), wherein the presentation content is encoded as a video stream; c) transmitting the video stream to a mirroring receiver (21) of a second source device (20) by the mirroring sender (11) if the connection between the first source device and the second source device (20) is established via a network cable; d) detecting the video stream on a Universal Serial Bus, USB port of the second source device (20) if the connection between the first source device and the second source device (20) is established via a USB connection; e) displaying the video stream on a mirroring player (22) of the second source device (20); f) capturing a local screen of the mirroring player (22) of the second source device (20) by a mirroring sender (23), wherein the captured content is encoded as a video stream; g) transmitting the video stream of the local screen to a mirroring receiver (31) of a Wireless Presentation System, WPS (30) by the mirroring sender (23); h) displaying the video stream on a mirroring player (32) of the WPS (30) and a second display device (80); i) capturing an application window of the mirroring player (32) of the WPS (30) by a content analyser (33); j) performing content verification on the captured content by the content analyser (33); k) transmitting the captured content to a web storage (41 ) of an application server (40) by the content uploader (35), wherein the captured content is stored as a web-readable image;
L) determining a mode of transmission of the web-readable image to at least one user device (60) based on the number of users requesting for the web-readable image by a content notifier (42); and m) displaying the web-readable image on a webpage of the user device
(60).
9. The method as claimed in Claim 8, wherein the step of performing content verification on the captured content includes: a) determining whether the captured content is an entirely white or black image, wherein the captured content is not verified if the captured content is determined to consist of an entirely white or black pixels; b) determining whether the captured content matches a default playback static content, wherein, the captured content is not verified if the pixels of the captured content match the pixels of the default playback static content; c) determining whether the captured content matches a previously captured content, wherein the captured content is not verified if the captured content matches the previously captured content; d) determining whether the captured content is a presentation slide, wherein the captured content is not verified if the captured content is identified to be a non-presentation slide; and e) determining whether the captured content is an objectionable content, wherein the captured content is not verified if the captured content is identified to be an objectionable content.
10. The method as claimed in Claim 9, wherein the step of determining whether the captured content is an entirely white or black image includes determining each pixel value in the captured content, wherein each pixel may contain a value ranging from 0 to 255, with 0 represents a black pixel and 255 represents a white pixel.
11. The method as claimed in Claim 9, wherein the step of determining whether the captured content matches a default playback static content includes comparing each pixel of the captured content with the pixels of the default playback static content.
12. The method as claimed in Claim 9, wherein the step of determining whether the captured content matches a previously captured content includes: a) retrieving a previously captured content from a content storage (34); and b) performing an image comparison between the captured content and the previously captured content.
13. The method as claimed in Claim 9, wherein the step of determining whether the captured content is a presentation slide includes performing an identification of the captured content based on an information of a currently active application window on the second source device (20).
14. The method as claimed in Claim 9, wherein the step of determining whether the captured content is an objectionable content includes: a) inputting the captured content into an image classifier model to produce an output decision, wherein the image classifier model separates the captured content into an objectional or non-objectional content; and b) producing Not-Safe-For-Work image and Safe-For-Work image scores by the image classifier model.
15. The method as claimed in Claim 8, wherein the step of determining the mode of transmission of the web-readable image to the at least one user device (60) based on the number of users requesting for the web-readable image by the content notifier (42) includes: a) determining if there is only a single user requesting for the web- readable image; and b) notifying a content manager (61) of the user device (60) to read the web-readable image directly from the application server (40) if there is only a single user requesting for the web-readable image.
16. The method as claimed in Claim 15, wherein if there are more than one user requesting for the web-readable image, the step includes: a) transmitting the web-readable image to a web storage (51) of the access point (50); and b) notifying the content manager (61) of the user device (60) to read the web-readable image from the access point (50).
PCT/MY2020/050172 2020-07-28 2020-11-26 A system and method for mirroring and distributing a presentation content WO2022025751A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
MYPI2020003887 2020-07-28
MYPI2020003887 2020-07-28

Publications (1)

Publication Number Publication Date
WO2022025751A1 true WO2022025751A1 (en) 2022-02-03

Family

ID=80035973

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/MY2020/050172 WO2022025751A1 (en) 2020-07-28 2020-11-26 A system and method for mirroring and distributing a presentation content

Country Status (1)

Country Link
WO (1) WO2022025751A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150082241A1 (en) * 2013-09-17 2015-03-19 Samsung Electronics Co., Ltd. Method for screen mirroring and source device thereof
WO2015088322A1 (en) * 2013-12-10 2015-06-18 Mimos Berhad System and method for managing multiple presentation sessions
JP2017188878A (en) * 2016-04-05 2017-10-12 キヤノンマーケティングジャパン株式会社 Web conference system, web conference server, control method for web conference system, and program
US20180227340A1 (en) * 2015-07-28 2018-08-09 Mersive Technologies, Inc. Virtual video driver bridge system for multi-source collaboration within a web conferencing system
WO2019132643A1 (en) * 2017-12-28 2019-07-04 Mimos Berhad A system and method for managing presentation sessions

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150082241A1 (en) * 2013-09-17 2015-03-19 Samsung Electronics Co., Ltd. Method for screen mirroring and source device thereof
WO2015088322A1 (en) * 2013-12-10 2015-06-18 Mimos Berhad System and method for managing multiple presentation sessions
US20180227340A1 (en) * 2015-07-28 2018-08-09 Mersive Technologies, Inc. Virtual video driver bridge system for multi-source collaboration within a web conferencing system
JP2017188878A (en) * 2016-04-05 2017-10-12 キヤノンマーケティングジャパン株式会社 Web conference system, web conference server, control method for web conference system, and program
WO2019132643A1 (en) * 2017-12-28 2019-07-04 Mimos Berhad A system and method for managing presentation sessions

Similar Documents

Publication Publication Date Title
US10154291B2 (en) Video analysis method and system
US9749710B2 (en) Video analysis system
US11503356B2 (en) Intelligent multi-device content distribution based on internet protocol addressing
WO2021129277A1 (en) Live video replay method and device
US10929600B2 (en) Method and apparatus for identifying type of text information, storage medium, and electronic apparatus
CN104602102B (en) Transmission response method, apparatus, server and the system of video intercepting content
US8881218B2 (en) Video transmission with enhanced area
US9639248B2 (en) Autohiding video player controls
CN111277849A (en) Image processing method and device, computer equipment and storage medium
US10638135B1 (en) Confidence-based encoding
US20170235828A1 (en) Text Digest Generation For Searching Multiple Video Streams
US10499097B2 (en) Methods, systems, and media for detecting abusive stereoscopic videos by generating fingerprints for multiple portions of a video frame
US8949372B2 (en) Transmission apparatus and transmission method
US11483574B2 (en) Systems and methods for emotion and perception based video compression and video perception enhancement
US20170278130A1 (en) Method and Electronic Device for Matching Advertisement Data
KR20200077176A (en) Apparatus and method for recommending keyword related to video
US20220255981A1 (en) Method and Apparatus for Adjusting Attribute of Video Stream
WO2018145572A1 (en) Method and device for implementing vr live streaming, ott service system, and storage medium
US20070220161A1 (en) Broadcasting a presentation over a messaging network
WO2022025751A1 (en) A system and method for mirroring and distributing a presentation content
KR20180020483A (en) Method for expanding screen based on Multi Device
US11301904B2 (en) Companion content on remote control devices
KR20220013445A (en) Method, user device, server, and recording medium for creating composite videos
US20230362221A1 (en) Content delivery system
JP5395862B2 (en) Management system, management server, cloud system, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20947685

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20947685

Country of ref document: EP

Kind code of ref document: A1