WO2020055231A1 - Method and system for wireless presentation of data - Google Patents

Method and system for wireless presentation of data Download PDF

Info

Publication number
WO2020055231A1
WO2020055231A1 PCT/MY2019/050055 MY2019050055W WO2020055231A1 WO 2020055231 A1 WO2020055231 A1 WO 2020055231A1 MY 2019050055 W MY2019050055 W MY 2019050055W WO 2020055231 A1 WO2020055231 A1 WO 2020055231A1
Authority
WO
WIPO (PCT)
Prior art keywords
content
stream analyzer
receiver
switcher
screen
Prior art date
Application number
PCT/MY2019/050055
Other languages
French (fr)
Inventor
Khong Neng Choong
Gin Xian KOK
Chrishanton Vethanayagam A/L SEBASTIAMPI
Original Assignee
Mimos Berhad
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mimos Berhad filed Critical Mimos Berhad
Publication of WO2020055231A1 publication Critical patent/WO2020055231A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H04N21/42607—Internal components of the client ; Characteristics thereof for processing the incoming bitstream
    • H04N21/4263—Internal components of the client ; Characteristics thereof for processing the incoming bitstream involving specific tuning arrangements, e.g. two tuners
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43076—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/631—Multimode Transmission, e.g. transmitting basic layers and enhancement layers of the content over different transmission paths or transmitting with different error corrections, different keys or with different transmission protocols

Definitions

  • This invention relates to a wireless presentation system and more particularly M a system a i method to receive and display data from SY es ⁇ adopting itHet an open or a close mirroring system or both
  • mirroring technology is getting very common nowadays r people to display eo sRM from their devices onto a display lor better s levying pleasure
  • the screen mi r ring technology uses cither wired or wireless technology to present the content from their Jcv es onto the display. Pot the wired screen mirroring technology the 15 display requires a tiOMl cable and an adaptor for the device. I his process Is complicated each time the user bus to cany till the: eabtes an the adtr fe . Turthen. sit requires time to connect with the evices.
  • the wireless screens mirroring technology overcomes the drawbacks of the wired screen mirroring technology as it does not need ty specific ada ter of cables for the device to display its content. Except an :M application to he installed m the device to eaptrnc and strea It Screen onto the designated is lay such as TV or projector, with the help: of a receiver unis generally know as the wireless media gateway or streaming bo. ⁇ . for an example Apple ' s AirPlay ' k is a proprietarymirrprtng
  • This system ts slightly superior than Bs eo for it supports Apple Airplay w ithout the need of having an extra Apple TV device. Moreover, the syste is able h? share and distribute ⁇ the content currently being shown to other devices tor better viewing experience.
  • the vi eo 5 signals that are received from at least two heterogeneous platform* are synvhruol/ed with their associated audio signals.
  • the method concludes by simultaneously sending the synehtonhed video ei ne is and audio si nal to available output devices (he.
  • T e a certain drawbacks; since single universal receiver is used, in order to transmit the data from the multiple devices the jfO transmitted data has to be combined and fed into the receiver. This a es the process complex and requires additional software to be msujjied. Further, Shir, device oes not accept any now request tor now mirroring session during the ongoing session, and cannot switch between mirroring screens received from the two devices. Thereby, the user has to wail until t e current mirroring session is ended and then tmosmit the data 15 to the receiver. This whole process Is time consuming,
  • the present invention provide* a system and method for obtaining, converting and distributing real-time desktop content seamlessly with ms ability to switch to the rigid mirroriftg receivers fob either tbs open or closed sou ce devices 0 respectively.
  • the present invent! on provides a method for wireless presentation of content trot» 5 two evices comprising the steps: acquire the content, by a recei er, from a f irst device K: ⁇ initiate a mirroring session on a display device; and, acquire the content by the receiver, from the second device for «nbseijuent mirroting session; whereby the method is characterised by a further um of: determine, by a switcher, whether the cdhtfeht received from the second evice appears on foreground of the ongoing0 mirroring session,, s ns to: switch to the second: device to initiate the subsequent mirroring sessi n.
  • the steps to determine whether the i onic at received from th second device appears on oregroun n the ongoing mirroring session includes: checking. by the switcher, whether t e ecei er triggered Ite applIeaSion wstKknv to be appeared on tlte ; iotegro mit; cibtahreng, by the s ieitesv mfbrstfetlmi isfed t# the application ⁇ window appeared on the foreground: an . preform mg, by the snatcher. an a plication matching process to determine whether the application window appeared is from the receiver.
  • the method includes steps of; verify wit a master controller on lit ⁇ ongoing 10 mirrunng session by the switcher: terminate the ongoin nn rearing se iou, by the switcher; and, instruct the receiver, to Initiate mirroring the content from the second device bs the switcher.
  • the method further comprises the steps to analyse the content, by a stream !S analyzer for determining nature of the content.
  • the method further comprises the steps So distribute the acquired content, by r; content distributor, to the display device and a web browser.
  • the steps So analyse the cnnSenf comprises: determine, by the stream analyzer, current screen resolution of the content; compare, hy the stream analyzer, the determined screen resolution wish a threshold value, when: if the determined screen resolution is below the threshold value then She strea analyzer performs screes* change analysis process, else, the Stream analyzer performs network packet 25 analysis process: and, determine. by ⁇ the -stream an lyzer* the nature: of the eonfent, base on the comparison result.
  • the steps to perform screen change analysis comprises; capture, by the stream analyzer, an Image of the screen: content on the source device; divide, by the 0 stream analyzer, the captured screen content image into fised number of smaller regions; detect, by the stream anal zer, fea ure points for all regions by using standard feature ⁇ poin detection process; compare, by the stream : ans!y3 ⁇ 4er, all regions with : detected feature pu-nts whh he > re same regions of she captured screen content image: and storing a; I he database.
  • the steps to perform network packet analysis comprises; analyze, by the stream analyzer, each incoming network frame of the content at fixed internal, initialize, by the stream analyzer, value tor a bsg fra e size as I ⁇ increase, by the stream analyzer, the big f a e size counter by 1 for each ineeniing net or frame, where each incoming network foie is bigger than the big frame si e value by a ! ⁇ frame-change th e hold; assign by thb st a analyzer, the big frame size with the vai Of incoming frame ize, where the iftCotning lotme size is bigger the big frame sizo; Sierease, by the stream analyzer, value df the frame-change threshold; and, defortBhto, by the stream analyzer, the nature
  • the present Invention also provides a system, for wireless presentation of a content born two device comprising; a receiver, configured to ac uire the content from a first evice to initiate a mirroring session on a display device; and, acquire the content 0 frorn tire second device for subsequent mirroring session , characterized in that, a switcher, configured to determine the content received Irom the second device appears on foreground of the ongoing mirroring session, so as to switch to the second device to initiate; the suh eipamt mirroring e sion, 5
  • the first device and the second device Is an opes system and a, closed s stem or any combination of these.
  • the receiver is art open receiver or a closed receiver or eombhretionk o both.
  • the system fi rther comprises a stream analyzer configured to analyse the content for determining nature of the content
  • Figure. 1 is te block diagram of a system for wireless presentation of data, in aoe Mhutee to an embodiment of the present invention
  • Figure, 3 Is a flow chart illuatrafi g the steps te; receive and display: data from; either open or closed mirroring system or Bot systems in accordance to an embodiment of the present invention: :
  • Figure, 3: is a flow chart illustrating the steps to acquire content froni the oorce device, in accordance to an embodiment of she present in entio ;
  • Figure, 4 is a flow chart iliuairailug the ste s to: itefermirte the content at topmost
  • Figure, 5 is a flow chart illustrating the teps to analyse the acquired content, hi accordance to an embodiment of the present invention
  • Figure. 6 is a flow chart 0 lost rating the steps to perform screen change ana lysis, in ac orda ce to an embodiment of the present invention.
  • the present provides the n edited a d system to receive and display incoming video st eam f m devices adopting Cither o en or closed nufroHng s stem or bosh systems.
  • the system (100) serves a lurality If client devices wit the transcoded incoming i eo eooteru in light- weight asid hasid ⁇ ili-effiefeot s3 ⁇ 4at 3 ⁇ 4
  • a Fust device can he an open sender device an second devise can be a closed sender devise
  • a first receiver can be: an open receiver and second receiver can, be a dosed reserver.
  • the system ( M»0) for wireless presentation of data comprises of a client de ice, wherein the device is preferably but not limited to any mobile phone, tablet laptop, FCFor any other suitable electronic slc ⁇ K C with a software is installed in it Where the user are able: to stream ami inor its device screen bate & data sharing unit ( 130).
  • the data sharing unit ( i 30.* is physically connected to a display device ( 140) by either wired connection or w ireless connection.
  • the client device consists of a first device (I 10 ⁇ . a second device ( 120) and a web browser P 50).
  • the ttrst device (1 1 ) and second device i HiO t can e an open sender sod dosed sender or in any combinations of both.
  • the first device ( l id) and second device 120 ⁇ arc (he source devices: which generate content s while the web browser (ll3 ⁇ 4 is used as device to eceive: shared eothenf dlstribuied % the data sharing unit ( 130).
  • An example device for open sender is Windows. Android, Mac OS and Um.e ⁇ -tltd an example of dosed sender is Apple 105.
  • Hie Apple 105 Is considered to be closed sender because it uses proprietary mirroring technology culled Airl’lav, which has no ⁇ : p;m software lihrmy for developer to mtemci with. However, the number of source devlees are not bunked to two devices. I he number of web browsers (1501 is not lte!te footte device.
  • the display devise can: Ite a projector, eoragutor onitor tow TV wtsifeh receive htobrmng vi eo signal for displaying.
  • the ata sharing umt ( 130) consists of a receiver ( 131, 1 2), a database ( l ea), a master controller ( 134), tt sirenm aaalyger ⁇ 135), a ednteni disiritotor (l 3d) an a switcher ( 137).
  • master controller ft Itoeohfigiited to coordinate all aob-eomponetes to work; cohesively. It also stov s the; states of ail ssbtweom orient In order to keep track Of tfelr states so edtonnieleathm kferhtecs.
  • the first toeeivet (131 ⁇ and second receiver t Ui) can be an open receiver and closed5 receiver or in any combinations to interact with the corresponding pen and closed sender of the fust device (I 10 ⁇ en second device ( 130). Both open sender ( 1 .10) and open receiver ( 131 ) are controlled by the master controller * 134 ⁇ for initial registration, .status update to actual content mirroring until terminating connection.
  • the closed sender ( 130) and the dosed receiver (1321 are installed with -bird- party applications for an example an .Apple iPhone and iPad use AirPlas to mirror the screen content only ro its designated receiver 1 132).
  • This third - arty receiver which is; the closed: receiver (132) pops up on the screen and starts playback automatically after receiving Airplay trea
  • the master controller ( 1 4) has no sititif-s information on the dosed receiver ( 132 ), whether it is currently active (playing back an incoming video ⁇ , idle or ton; to its setting page ete.
  • Tito switcher (137) is configured to detect the active presence of such closed receiver ( 132).. to deactivate and rc-activate such closed receiver ( 132).
  • the .sircar? ⁇ analyzer ( 135). configured to study ⁇ he carte? ti mirroring stfOatrs t porlotm analysis on the current screen content to dote? mine whether to capture it foe distribution in the form of Images. s e analysis process is explained with .respect to figures 5 to 7 below.
  • the master controller ⁇ 134 ⁇ send instruct ions to the stream analyzer (135) to perform Its task, JO.
  • the atabase (1333, eonflgured to store the analyse images by he stream snafy3 ⁇ 4ar
  • the comen ⁇ distributor ( 136) t configured to retrieve and distribute the images front the database (153) to display on the display evice ( NO ? or to user devices if it is I S eon figured to rnn ft web browser sue!? as in some Shorn ⁇ TV.
  • the images are a series of screen content captured at uitTereni li e, further, the i age? f screen conient are distributed to fe web browser isnt devtees ( ISO, 141 or any ki nd: of device used by the client. 0 Referring to 1 igure 2, illustrates the flowchart Steps is? receive and display incoming ⁇ ides?
  • Step 200 l;ser switches on the power button of the data sharing unit (130) am) displays a wekrtmsi page oo the screen of arty cormsoted display device.
  • Nest (Step 300 register any open sende (I IQ) w3 ⁇ 4b llte soaster5 controller ( 134), (Step 400) acquire content front either open? tee ver ( 1 1 ) or closed receiver (152) to initiate the mirroring session of the registered device.
  • Step 500 the master controller (134) instructs the stream analyze ⁇ ⁇ 1351 to start analysing , the content (Step 600) the master controller (1 4 ⁇ instructs the content distributor ( 136) t3 ⁇ 4 ; i « huti6"3 ⁇ 4 ⁇ : d «alys ltotncnt to all the web browser ( i 50, 141 ) client devices.0
  • dlusioues the flowchart steps to acquire a content from the dksd doyiees cotrtprtsos the step of)
  • the master controller i 541 accept? any ineonnrg request from any registered open sender (131) To stilt! I) mirror session.
  • t xslor controller ( 1.34) Irtnis ils details snelr the 0 s tut port t soher of the open sender (1 10) to the open receiver (1.3 1 ) 5 whenever there is a ne incoming request.
  • the open receiver (131) connects to the open sender ( 1 10) using die given IP address and port number to reque t obtain anti display the content
  • the content is basically a vi eo stream transmitting rom the open sender ( 1 10 ⁇ to the open receiver 13 I ⁇ over the net wor .
  • the master controller ⁇ 134 ⁇ is unaware of the re uest front the close sender P 20) and She response of the closed receiver ( 132).
  • Step 460 ⁇ The switcher (13?);, constantly cheeks sod determines the type of content on she to most surface to manage the session jifce cle accordingly,
  • Step 470 ⁇ if the tepmost content is a 20 mirroring content then en the process.
  • Fisc repeat the (Steps 420 u> 460 ⁇ wherein the maste controller (1.34) instructs the stream analyzer (135) to start analyzing th content for subsequent content distribution.
  • Ksferrmg to Figure 4. illustrates the flowcha t steps to determine the content at the 25 topmost surface of the system (100).
  • Step 461 L separate thread process is started to perform the task this is to ensure this content cheeking ro ⁇ !. ess i,-. performed at Ned interval. Obtain the information of the topmost application in the svstem ( J 00).
  • :M application is the closed receiver P .2T If i ; . is the closed receiver ( 133). verify w ith the master controller (134 ⁇ whether there is an ongoing o en receiver session, (Step
  • Step 467) In such ease the dosed receiver (132) is t igge ed : to restart atrtoi tteally rpoiv crash to ensure the closed receiver (132) is back to standby mo e upon such termination.
  • Step 4608 fo- verify w hether there is other 111 sereetopage of the closed receiver (132) shown 6ft the display device (140), beyond the normal playback screen. This is to ensure the system; never instruct the stream analyser (135) to .start anal zing on non-playback screen.
  • Step 510 Illustrates the flowchart stops to a alyze the acquired screen content comprises steps of; (Step 510) verily toe current screen resolution of the source device. If it b hdow threshold, example 4K, then m proceed using the screen change a aly sis approach (Step 530).
  • Step 530 The output of the network packet analysis is to determine 5 whether the incoming content of video nature, or scene with lots of changes.
  • Steps 540 & 550 Start capturing the content at fixed interval if it Is determined to he of video (Step 540), otherwise proceed ith eapteriitg only when required, ;.e. there is significant screen change (Step 550), 0 Reforn ’ ng to figure 6 illustrates the flowchart steps to gertpim screen change analysis comprising steps to: (Ste 52 !) a separate thread process b initiated to perform the ta&k.
  • a flewehdff steps to perform network packet analysis comprises steps of: (Step 531 ) a separate thread rocess is initiated to receive and analyze each incoming network frame bt fi e infernal, ‘ t his network packet analysis process is performed in the baekgronrtd, (Step 532) itlalte the value of " .1 to. a variable named Uii> « i ' ramc'Si/ .
  • Step 533 UK rease the Big- Fra e coumer by f for 15 each incoming fra e which is bigger ?han the Big-i-Yame-Si/e value by certain given fiomewd e threshold.
  • Step 534 assign Big-Frnme-foiae with the value of incoming ffetoe size If the tncosning frame -size is Bigger.
  • Step 535 Increase the irmnwehange threshold using the following equation: # Frame-ahsnge threshold huse-frapfe-nhange threshold x
  • Steps S3d fe 533 ⁇ the t «e «3 ⁇ 4ig. network frame is determined as video stream if the Btg-Frsme-Sixe is ore than the Video-Capture threshold.
  • Nex inform the 5 parent proces the video stream determination result, whether the intern m network frame is regarded as video stream or oihet wo (Step 5, ‘ b?) If the Big ⁇ Frame has been earning m for the past 5 sec, continue to slap 533, else proceed to step 532.
  • life steps m distribute the acquired content by the content distributor (1365 comprises0 ste : " S ' wo se arate thread processes arc initiated to perform the task, ⁇ ids is to ensure those content distrihoiiost processes are active and p rforms their tasks in fc bsekgrountl: whenever ft is needed orlnggered,
  • the first thread process Is Initiated to serve latest contesst while the seqaad threa process is irnfittied to serve individual service request.
  • I he first thread process includes the steps ro: reorganise the content by renaming each i age follow ing a sequence.
  • trigger a signal to e bedded Webserver in order to utility the user device via the web browser 1 150) to make request for latest content t hen the user sends the request for the content to the embedded Webserver ihe embedded Webserve serves the request by referring tu fhc latest image stored In the designated folder.
  • the second thread process includes the steps to; detect any incoming request from the d em via the web browser 1 150). Next, check the type ot the request t hen, send the blest image tored in the database ( 153) to the client via the web browser 1 150) if the inquest is for the latest content is be, send the s ecific image to the client requested for. ir, send the complete fli found in the database ⁇ 133 ⁇ if the request is to save ail the contents.
  • the present invention providfs a dyBSmie refresh ihiisr a! base on: & sfg fisant changes i « eith r network &mw level or application esktep image level. Further provi es to switch between the network end application level of .screen change fracking based on the current screen resolution.
  • the switcher ⁇ 137 ⁇ can manage the loading end unloading of specific mirroring receiver according to the corresponding source device. For example, AirPiay receiver may he loaded and place on topmost of the. screen when the incoming stream is from Apple device.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

A method and system (100) for wireless presentation of content from two devices (110, 120) comprising the steps of: acquiring the content, by a receiver (131), from a first device (110) to initiate a mirroring session on a display device (140); and, acquiring the data, by the receiver (132), from a second device (120) tor subsequent mirroring session; whereby the method is characterised by a further step of: determining, by a switcher (137), whether the content received from the second device (120) appears on foreground of the ongoing mirroring session so as to switch to the second device to initiate the subsequent mirroring session.

Description

METHOD MR SYSTEM FOR WIRELESS PRESENTATION OF RATA wmm OF TMi VS TRM
5 This invention relates to a wireless presentation system and more particularly M a system a i method to receive and display data from SY es· adopting itHet an open or a close mirroring system or both
BACKGROUND OF THE IHVENTtOA
! 0
beree» mirroring technology is getting very common nowadays r people to display eo sRM from their devices onto a display lor better s levying pleasure, The screen mi r ring technology uses cither wired or wireless technology to present the content from their Jcv es onto the display. Pot the wired screen mirroring technology the 15 display requires a tiOMl cable and an adaptor for the device. I his process Is complicated each time the user bus to cany till the: eabtes an the adtr fe . Turthen. sit requires time to connect with the evices. The wireless screens mirroring technology overcomes the drawbacks of the wired screen mirroring technology as it does not need ty specific ada ter of cables for the device to display its content. Except an :M application to he installed m the device to eaptrnc and strea It Screen onto the designated is lay such as TV or projector, with the help: of a receiver unis generally know as the wireless media gateway or streaming bo.\. for an example Apple's AirPlay'k is a proprietarymirrprtng
Figure imgf000003_0001
25 and displays Apple device screen content on TV which ts cormeeted to art Apple TV box, Apple AirP!ay dods not work *m non -Apple devices ft If a dosed device which offers no software Hbniry access for developers io control and interact with Airplay, OH the contrary, Google opens ttp its software library for controlling its screen casting services, Ml acast is another open alternative to Apple \s AkHlaw allowing content 30 from both Android and Windows devices to he sSro rs wirelessly to a TV or set-to box, ese systepiS are regarded as open system for Its; openness to software developers. There exists a need for a system that: can: integrate both the open an closed devices for seh less!y presenting the content frooi both the devices,
Tho are few Wireless fesettodiob s stems avaitabto i the ofeflfet that vast integrate both the '.. pcn and closed system. One such syste is Bared CiickShare, which 5 supports both Apple and non- Apple' devices. This system requites the output of Apple FV as its input and displays the content on the end display devices it Is physica ll connected to. he .Apple evsee must fast wirelessly connect to the .Apple TV, which outputs lls screen to Batco CHckShttre device connecting to the T¾ it? Another system m the market is Extcon Shareimk feltfelr ppo bosh Apple and non·· Apple devices. This system ts slightly superior than Bs eo for it supports Apple Airplay w ithout the need of having an extra Apple TV device. Moreover, the syste is able h? share and distribute· the content currently being shown to other devices tor better viewing experience.
IS
However, then.; are certain drawfeaeks will the Exiron Sharehnk and the Bareu ClickSharc such as the capturing of content for distribution is taking place at the source is unable to capture/distributo content originated iron· close user device (e.g. IDS device). This ra hes diiliretii implesrreniatfen tor different source device of 0 different OS The update efeWeat distri ballon is baaed env fixed refresh interval, making inefficient use of bandwidth (Client always requesting for updates), and incurring long dclay/missing content (Changes within refresh interval is lost} Further, there is no page navigation feature available lot the users to refer back to; the previously shown contem. These systems arc lacking pf ilexlhiltiy m work: with any 5 content source/device, scalability to capture Abate the right content in a bandwidth efficient manner and adoptability to meet the on -demand request of end-user.
There are several patent filed on wireless presentation sysidPiit One such example is IJ Sa fi ! Sti 071)12? A k w!rtbh disclose the wife less presenMtoft system that u ses a 0 single canfefe universal m W receive mirroring streams from multiple beterogenequs |)1ait¾rs:tis, And a metho to eomfeme transmitted daUVnetwork packets provided by platform mastafeeiurers ioto the universal receiver acceptin : mitforing (f&la from heterogeneous platforms and protocote. The method include the sequential slops of preparing th universal receiver. After preparation of the universal receiver, the ¾P si Mod COotioties feblfi he receiving ol at bast H\ o video gnaK an at leas! two au io signals from the heterogeneous platforms by ie universal ruxher. The vi eo 5 signals that are received from at least two heterogeneous platform* are synvhruol/ed with their associated audio signals. The method concludes by simultaneously sending the synehtonhed video ei ne is and audio si nal to available output devices (he. video rendcrer an au io renderer), T e a certain drawbacks; since single universal receiver is used, in order to transmit the data from the multiple devices the jfO transmitted data has to be combined and fed into the receiver. This a es the process complex and requires additional software to be msujjied. Further, Shir, device oes not accept any now request tor now mirroring session during the ongoing session, and cannot switch between mirroring screens received from the two devices. Thereby, the user has to wail until t e current mirroring session is ended and then tmosmit the data 15 to the receiver. This whole process Is time consuming,
Therefore, the present invention provide* a system and method for obtaining, converting and distributing real-time desktop content seamlessly with ms ability to switch to the rigid mirroriftg receivers fob either tbs open or closed sou ce devices 0 respectively.
SUMMARY OF TH INVENTION
The present invent! on provides a method for wireless presentation of content trot» 5 two evices comprising the steps: acquire the content, by a recei er, from a f irst device K:< initiate a mirroring session on a display device; and, acquire the content by the receiver, from the second device for «nbseijuent mirroting session; whereby the method is characterised by a further um of: determine, by a switcher, whether the cdhtfeht received from the second evice appears on foreground of the ongoing0 mirroring session,, s ns to: switch to the second: device to initiate the subsequent mirroring sessi n. Freierabiv, the steps to determine whether the i onic at received from th second device appears on oregroun n the ongoing mirroring session includes: checking. by the switcher, whether t e ecei er triggered Ite applIeaSion wstKknv to be appeared on tlte; iotegro mit; cibtahreng, by the s ieitesv mfbrstfetlmi isfed t# the application § window appeared on the foreground: an . preform mg, by the snatcher. an a plication matching process to determine whether the application window appeared is from the receiver.
Further, the method includes steps of; verify wit a master controller on lit© ongoing 10 mirrunng session by the switcher: terminate the ongoin nn rearing se iou, by the switcher; and, instruct the receiver, to Initiate mirroring the content from the second device bs the switcher.
Preferably the method further comprises the steps to analyse the content, by a stream !S analyzer for determining nature of the content.
Preferably, the method further comprises the steps So distribute the acquired content, by r; content distributor, to the display device and a web browser.
:¾0: Preferably, the steps So analyse the cnnSenf comprises: determine, by the stream analyzer, current screen resolution of the content; compare, hy the stream analyzer, the determined screen resolution wish a threshold value, when: if the determined screen resolution is below the threshold value then She strea analyzer performs screes* change analysis process, else, the Stream analyzer performs network packet 25 analysis process: and, determine. by· the -stream an lyzer* the nature: of the eonfent, base on the comparison result.
Preferably, the steps to perform screen change analysis comprises; capture, by the stream analyzer, an Image of the screen: content on the source device; divide, by the 0 stream analyzer, the captured screen content image into fised number of smaller regions; detect, by the stream anal zer, fea ure points for all regions by using standard feature·· poin detection process; compare, by the stream :ans!y¾er, all regions with: detected feature pu-nts whh he >re same regions of she captured screen content image: and storing a; I he database. hy rite stream a alyzer, die eapmrcd screen content image baaed mi the comparison resold fef istributing the content f Preferably, the steps to perform network packet analysis comprises; analyze, by the stream analyzer, each incoming network frame of the content at fixed internal, initialize, by the stream analyzer, value tor a bsg fra e size as I · increase, by the stream analyzer, the big f a e size counter by 1 for each ineeniing net or frame, where each incoming network faime is bigger than the big frame si e value by a !ø frame-change th e hold; assign by thb st a analyzer, the big frame size with the vai Of incoming frame ize, where the iftCotning lotme size is bigger the big frame sizo; Sierease, by the stream analyzer, value df the frame-change threshold; and, defortBhto, by the stream analyzer, the nature of incoming etw r frame as video stream, where the value of big frame; size is greater than value of a video capture 15 threshold,,
The present Invention also provides a system, for wireless presentation of a content born two device comprising; a receiver, configured to ac uire the content from a first evice to initiate a mirroring session on a display device; and, acquire the content 0 frorn tire second device for subsequent mirroring session, characterized in that, a switcher, configured to determine the content received Irom the second device appears on foreground of the ongoing mirroring session, so as to switch to the second device to initiate; the suh eipamt mirroring e sion, 5 Preferably, the first device and the second device Is an opes system and a, closed s stem or any combination of these.
Prefe ably* the receiver is art open receiver or a closed receiver or eombhretionk o both.
o
Preferably, the system fi rther comprises a stream analyzer configured to analyse the content for determining nature of the content
Figure imgf000008_0001
RRfK RES* Rlf !lO^ O DRAWINGS
Those and other lea res,. aepeeis, and advantages o the >reseai ceidk will become bcifer understood, when the fallmvmg detailed deseripfk is rea it reference to the accompanyin m wings in which like teacters represent like parts throughout the rawi gs, wherein:
Figure. 1 is te block diagram of a system for wireless presentation of data, in aoe Mhutee to an embodiment of the present invention;
Figure, 3 Is a flow chart illuatrafi g the steps te; receive and display: data from; either open or closed mirroring system or Bot systems in accordance to an embodiment of the present invention: : Figure, 3: is a flow chart illustrating the steps to acquire content froni the oorce device, in accordance to an embodiment of she present in entio ;
Figure, 4 is a flow chart iliuairailug the ste s to: itefermirte the content at topmost
Surface of the system, in accordance to an embodiment of the presen j veiithm
Figure, 5 is a flow chart illustrating the teps to analyse the acquired content, hi accordance to an embodiment of the present invention; Figure. 6 is a flow chart 0 lost rating the steps to perform screen change ana lysis, in ac orda ce to an embodiment of the present invention; and.
Figure imgf000009_0001
The present provides the n edited a d system to receive and display incoming video st eam f m devices adopting Cither o en or closed nufroHng s stem or bosh systems. The system (100) serves a lurality If client devices wit the transcoded incoming i eo eooteru in light- weight asid hasid^ ili-effiefeot s¾at ¾
A Fust device can he an open sender device an second devise can be a closed sender devise,
A first receiver can be: an open receiver and second receiver can, be a dosed reserver.,
Referring to Figure i s the system ( M»0) for wireless presentation of data comprises of a client de ice, wherein the device is preferably but not limited to any mobile phone, tablet laptop, FCFor any other suitable electronic slc\ K C with a software is installed in it Where the user are able: to stream ami inor its device screen bate & data sharing unit ( 130). The data sharing unit ( i 30.* is physically connected to a display device ( 140) by either wired connection or w ireless connection.
The client device consists of a first device (I 10}. a second device ( 120) and a web browser P 50). The ttrst device (1 1 ) and second device i HiO t can e an open sender sod dosed sender or in any combinations of both. The first device ( l id) and second device 120} arc (he source devices: which generate contents while the web browser (ll¾ is used as device to eceive: shared eothenf dlstribuied % the data sharing unit ( 130). An example device for open sender is Windows. Android, Mac OS and Um.e<-tltd an example of dosed sender is Apple 105. Hie Apple 105 Is considered to be closed sender because it uses proprietary mirroring technology culled Airl’lav, which has no < :p;m software lihrmy for developer to mtemci with. However, the number of source devlees are not bunked to two devices. I he number of web browsers (1501 is not lte!te footte device.
The display devise ( MO} can: Ite a projector, eoragutor onitor tow TV wtsifeh receive htobrmng vi eo signal for displaying.
§
The ata sharing umt ( 130) consists of a receiver ( 131, 1 2), a database ( l ea), a master controller ( 134), tt sirenm aaalyger {135), a ednteni disiritotor (l 3d) an a switcher ( 137). 0 Th@: master controller ft ) Itoeohfigiited to coordinate all aob-eomponetes to work; cohesively. It also stov s the; states of ail ssbtweom orient In order to keep track Of tfelr states so edtonnieleathm kferhtecs.
The first toeeivet (131 } and second receiver t Ui) can be an open receiver and closed5 receiver or in any combinations to interact with the corresponding pen and closed sender of the fust device (I 10} en second device ( 130). Both open sender ( 1 .10) and open receiver ( 131 ) are controlled by the master controller * 134} for initial registration, .status update to actual content mirroring until terminating connection. The closed sender ( 130) and the dosed receiver (1321 are installed with -bird- party applications for an example an .Apple iPhone and iPad use AirPlas to mirror the screen content only ro its designated receiver 1 132). In order to receive and playback the Airplay stream, it is necessary to a aw Ire and install AtrPlav receiver software developed fry third party. This third - arty receiver which is; the closed: receiver (132) pops up on the screen and starts playback automatically after receiving Airplay trea The master controller ( 1 4) has no sititif-s information on the dosed receiver ( 132 ), whether it is currently active (playing back an incoming video}, idle or ton; to its setting page ete. Tito switcher (137) is configured to detect the active presence of such closed receiver ( 132).. to deactivate and rc-activate such closed receiver ( 132). Flic switcher (13?? s also configure to switch the right reeetypr onto the (oppost sw&te of the data sharing y ά t {130) ibf playback, aceoM tog tp the sequence of the irroring re uest Pom She cheat devices.
The .sircar?} analyzer ( 135). configured to study {he carte? ti mirroring stfOatrs t porlotm analysis on the current screen content to dote? mine whether to capture it foe distribution in the form of Images. s e analysis process is explained with .respect to figures 5 to 7 below. At the beginning of caoi» presentation session, the master controller { 134} send instruct ions to the stream analyzer (135) to perform Its task, JO. The atabase (1333, eonflgured to store the analyse images by he stream snafy¾ar
(13d
The comen† distributor ( 136) t configured to retrieve and distribute the images front the database (153) to display on the display evice ( NO? or to user devices if it is I S eon figured to rnn ft web browser sue!? as in some Shorn† TV. The images are a series of screen content captured at uitTereni li e, further, the i age? f screen conient are distributed to fe web browser isnt devtees ( ISO, 141 or any ki nd: of device used by the client. 0 Referring to 1 igure 2, illustrates the flowchart Steps is? receive and display incoming \ ides? stream from evices ado ting either oped nr osed mirroring system or both systems comprises the steps of: (Step 200) l;ser switches on the power button of the data sharing unit (130) am) displays a wekrtmsi page oo the screen of arty cormsoted display device. Nest (Step 300 register any open sende (I IQ) w¾b llte soaster5 controller ( 134), (Step 400) acquire content front either open? tee ver ( 1 1 ) or closed receiver (152) to initiate the mirroring session of the registered device. (Step 500} the master controller (134) instructs the stream analyze·· { 1351 to start analysing, the content (Step 600) the master controller (1 4} instructs the content distributor ( 136) t¾; i« huti6"¾^:d«alys ltotncnt to all the web browser ( i 50, 141 ) client devices.0
Refer ing: to Figure d, dlusioues the flowchart steps to acquire a content from the dksd doyiees cotrtprtsos the step of) |Isp 410) the rttpsier ednir ler (134) aodyaies the switcher (137), dost receiver ( 132) and open receiver ( i 31 } (Step 420) Next the master controller ( i 541 accept? any ineonnrg request from any registered open sender (131) To stilt! I) mirror session. (Step 430) t xslor controller ( 1.34) Irtnis ils details snelr the 0s tut port t soher of the open sender (1 10) to the open receiver (1.3 1 ) 5 whenever there is a ne incoming request. thren 440) the open receiver (131) connects to the open sender ( 1 10) using die given IP address and port number to reque t obtain anti display the content The content is basically a vi eo stream transmitting rom the open sender ( 1 10} to the open receiver 13 I } over the net wor .
10 M atf time, et er ope» .sender ( i 10) or closed sender (120) can start a new mirroring session The sys m < I€K>) can ttcespt the new request and later terminate tlte ehrrunt session. Still referring to Figure 3, «Step -130} assu e there Is an incoming request from itte closed sender P I», and this automatically triggers (he closed receiver ( 132) to provide a nof sites don or appear on the ibreground or topmost rtf' the i 5 isplay device ( i 30). when It is about to start playing hack the incoming v ideo streaoi.
The master controller { 134} is unaware of the re uest front the close sender P 20) and She response of the closed receiver ( 132). (Step 460} The switcher (13?);, constantly cheeks sod determines the type of content on she to most surface to manage the session jifce cle accordingly, (Step 470} if the tepmost content is a 20 mirroring content then en the process. Fisc, repeat the (Steps 420 u> 460} wherein the maste controller (1.34) instructs the stream analyzer (135) to start analyzing th content for subsequent content distribution.
Ksferrmg to Figure 4. illustrates the flowcha t steps to determine the content at the 25 topmost surface of the system (100). (Step 461 ) L separate thread process is started to perform the task this is to ensure this content cheeking ro·!. ess i,-. performed at Ned interval. Obtain the information of the topmost application in the svstem ( J 00). (Stop
462) Next it is an application na e matching process to centum the topmost "applfcatim l ire thread process started off by chucking whether the topmost content or
:M application is the closed receiver P .2T If i;. is the closed receiver ( 133). verify w ith the master controller (134} whether there is an ongoing o en receiver session, (Step
463) Terminate the ongoing open receiver session if there is any. Step 464) Sot the n
mirroring content Sa to True, (Stop 465 4§ Gtseo whether the toptoosf entiteni or application is ike open receiver (:I3ί)> IT yes. The® perform closed r ceiver verifiestioe process:, Else, lithe toirrefthg content is trite then end toe process,
S The closed receive;· verification rocess cos·: rises steps Jo etri ve information relating lo toe active applications in the s stem ( 100) These pet form a name matching on the application name with Ihose found active in the y tem (108). Once the dosed receiver ( I TT) is matched, a firewall entry is a e on the system ( 100) to block the ongoing etoittnnnieatiori of too c loses! receiver (132) at specific port so as to terminate f@ its Ossion and go back to idle mode, ertain closed recciwr 03¾ raay crash once its port when biooked hy firewall. (Step 467) In such ease the dosed receiver (132) is t igge ed: to restart atrtoi tteally rpoiv crash to ensure the closed receiver (132) is back to standby mo e upon such termination.
IS .Still referring m Figure 4, (Step 468) fo- verify w hether there is other 111 sereetopage of the closed receiver (132) shown 6ft the display device (140), beyond the normal playback screen. This is to ensure the system; never instruct the stream analyser (135) to .start anal zing on non-playback screen. 0 Referring to F igure 3, Illustrates the flowchart stops to a alyze the acquired screen content comprises steps of; (Step 510) verily toe current screen resolution of the source device. If it b hdow threshold, example 4K, then m proceed using the screen change a aly sis approach (Step 530). idse, proceed using the network packet analysis approach (Step 530). The output of the network packet analysis is to determine 5 whether the incoming content of video nature, or scene with lots of changes. (Steps 540 & 550) Start capturing the content at fixed interval if it Is determined to he of video (Step 540), otherwise proceed ith eapteriitg only when required, ;.e. there is significant screen change (Step 550), 0 Reforn’ng to figure 6 illustrates the flowchart steps to gertpim screen change analysis comprising steps to: (Ste 52 !) a separate thread process b initiated to perform the ta&k. This is to ensu e this screen : change analysis process is performed at fixed interval fSten 522 22 .523} Capture -he dvsktop screen content, then divide the newly .captured content image into fixed number of smailct regions. (Step 52Ί ) Ken the standar fea ure p mt detection bf image processing for all regions fo defect feature points tor all regions. {Step $2$} Newt, compare all regions with detected feature point ,S with those- same regions of the screen imago captured in She previous round tor ditlcKncc. (Step 526 *.% 527} Save the la t desktop screen i age· tor cement istribution ft' the fob! dittemneos from the region comparison k f»of« than the threshold value (Step 527). Else, repeat: (Steps 522 to 526), fQ Referring to igu e: 7 filustimes a flewehdff steps to perform network packet analysis comprises steps of: (Step 531 ) a separate thread rocess is initiated to receive and analyze each incoming network frame bt fi e infernal,‘t his network packet analysis process is performed in the baekgronrtd, (Step 532) itlalte the value of" .1 to. a variable named Uii>«i'ramc'Si/ . (Step 533) UK rease the Big- Fra e coumer by f for 15 each incoming fra e which is bigger ?han the Big-i-Yame-Si/e value by certain given fiomewd e threshold. (Step 534) assign Big-Frnme-foiae with the value of incoming ffetoe size If the tncosning frame -size is Bigger. (Step 535) Increase the irmnwehange threshold using the following equation: # Frame-ahsnge threshold huse-frapfe-nhange threshold x
( ( Source... W x Source H)/ (Base W x Base H) )
(Steps S3d fe 533} the t«e «¾ig. network frame is determined as video stream if the Btg-Frsme-Sixe is ore than the Video-Capture threshold. Nex (Step 538) inform the 5 parent proces the video stream determination result, whether the intern m network frame is regarded as video stream or oihet wo (Step 5,‘b?) If the Big· Frame has been earning m for the past 5 sec, continue to slap 533, else proceed to step 532. life steps m distribute the acquired content by the content distributor (1365 comprises0 ste : "S'wo se arate thread processes arc initiated to perform the task, Ί ids is to ensure those content distrihoiiost processes are active and p rforms their tasks in fc bsekgrountl: whenever ft is needed orlnggered, The first thread process Is Initiated to serve latest contesst while the seqaad threa process is irnfittied to serve individual service request.
I he first thread process includes the steps ro: reorganise the content by renaming each i age follow ing a sequence. Next, trigger a signal to e bedded Webserver in order to utility the user device via the web browser 1 150) to make request for latest content t hen, the user sends the request for the content to the embedded Webserver ihe embedded Webserve serves the request by referring tu fhc latest image stored In the designated folder.
The second thread process includes the steps to; detect any incoming request from the d em via the web browser 1 150). Next, check the type ot the request t hen, send the blest image tored in the database ( 153) to the client via the web browser 1 150) if the inquest is for the latest content is be, send the s ecific image to the client requested for. ir, send the complete fli found in the database { 133} if the request is to save ail the contents.
The present invention providfs a dyBSmie refresh ihiisr a! base on: & sfg fisant changes i« eith r network &mw level or application esktep image level. Further provi es to switch between the network end application level of .screen change fracking based on the current screen resolution. The switcher { 137} can manage the loading end unloading of specific mirroring receiver according to the corresponding source device. For example, AirPiay receiver may he loaded and place on topmost of the. screen when the incoming stream is from Apple device.
The advantages am flexibility m: work with any content souree p ice; Adspf «hffcreot semen changes analysis method automatically; Scalability to eapttpc/share the righ epnteot in a bandwidth elTleient manpor; and adapiability f« meet the on-de and request of end- user.
The present disclosure includes as contained in the appended claims, as well as that oi the foregoing description Although this invention has been described in its preferred form wit!', a degree of artkuiaFit, ft is miderdooft that iba rasaftt dis¾Itsi«¾ of' O preferred toon has been ade only by wsy of example and that niaoei ss changes in ihe tftnaib of ecmstmaioo and the combination: and anmigeomnis of part may be resori¾d to wilhouf departing m the seope of the invenion.

Claims

Figure imgf000017_0001
. A method for wireless presentation of content from two devices (P0, 120) comprising the steps of:
acquiring the content, by an open receiver (131.), from a first device (1 10) to initiate a mirroring session on a display device (140); and
acquiring the content, by a closed receiver (132), from a second device ( 120) for subsequent mirroring session;
wherein the method is characterised by a further step of;
determining, by a switcher ( 137), whether the content received from the second device (120) appears on foreground of the ongoing mirroring session so as to switch to the second device (1 0) to initiate the subsequent mirroring session. , The method according to clai 1, wherein the determining whether the content received from the second device (120) appears on foreground of the ongoing mirroring session includes the step of;
checking, by the switcher (137), whether the closed receiver (132) has triggered its application window to he appeare on the foreground;
obtaining, by the switcher (137), information related to the application window appeared on the foreground; and
preforming, by the switcher (137), an application matching process to determine whether the application window appeared is from the closed receiver (132) , The method according to claim 1, further includes the steps of:
verifying with a master controller (134), by the switcher (137), on the ongoing mirroring session;
terminating, by the switcher (137), the ongoing mirroring session; and instructing the receiver (132), by the switcher (137), to initiate mirroring the content from the second device (120).
4. The method according to claim 1, further comprises the steps of analysing the content by a stream analyzer (135), for determining nature of the content.
5. The method according to claim 1, further comprises the steps of distributing the acquired content, by a content distributor (136), to the display device (140) and a web browser (150).
6. The method according to claim 4, wherein analysing the content comprises steps of:
determining, by the stream analyzer (135). current screen resolution of the content;
comparing, by the stream analyzer (135), the determined screen resolution with a threshold value, where if the determined screen resolution is below the threshold value then the stream analyzer ( 135) performs screen change analysis process, else, the stream analyzer (135) performs network packet analysis process; and
determining, by the stream analyzer (135), the nature of the content, based on the comparison result. 7. The method according to claim 6, wherein the screen change analysis comprises steps of:
capturing, by the stream analyzer (135), an image of the screen content on the source device;
dividing, by the stream analyzer (135), the captured screen content image into fixed number of smaller regions;
detecting, by the stream analyzer ( 135), feature points for all regions by using standard feature point detection process;
comparing, by the stream analyzer’ (135), all regions with detected feature points with those same regions of the captured screen content image; and
storing in the database (133), by the stream analyzer (135), the captured screen content image based on the comparison result, for distributing die content;
8. The method according to claim 6, wherein the network packet analysis comprises steps of;
analyzing, by the stream analyzer (135), each incoming network frame of the content at fixed internal;
initializing by the stream analyzer (135), value for a big frame size as i;
increasing, by the stream analyzer (135), the big frame size counter by 1, for each incoming; network frame, where each incoming network frame is bigger than the big frame size value by a frame-change threshold;
assigning, by the stream analyzer (135), the big frame size with the value of incoming frame size, where the incoming frame size is bigger the big frame size;
increasing, by the stream analyzer (135), value of the frame-change threshold; and,
determining, by the stream analyzer ( 135), the nature of incoming network frame as video stream, where the value of big frame size is greater than value of a video capture threshold.
9. A system ( 100) for wireless presentation of content from two device ( 110, 120) comprising:
an open receiver (131 ), configured to acquire the content from a first device (1 10) to initiate a mirroring session on a display device (140); and
a closed receiyer (132), configured to acquire the conten from a second device (120) for subsequent mirroring session,
characterize in that, a switcher (137), configured to determine whether the content received from the second device ( 120) appears on foreground of the ongoing mirroring session so as to switch to the second device to initiate the subsequent mirroring session.
10. The system (100) according to claim 9, wherein the first device (1 10) and the I S
second device { 120} is an open system and a closed system or any co mb i nation o f these .
1 l . The system (100) according to claim 9, wherein the receiver (131 , 132) is an open receiver or a osed receiver or combinations of both.
12. The system (100) according to claim 9, further comprises a stream analyzer
(135) configured to analyse the content for determining nature of the content.
13. The system ( 100) according to claim 9, further comprises a content distributor
(136) configured to distribute the acquired content to the display device (140) and a web browser (150).
PCT/MY2019/050055 2018-09-13 2019-09-12 Method and system for wireless presentation of data WO2020055231A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
MYPI2018001553A MY197164A (en) 2018-09-13 2018-09-13 Method and system for wireless presentation of data
MYPI2018001553 2018-09-13

Publications (1)

Publication Number Publication Date
WO2020055231A1 true WO2020055231A1 (en) 2020-03-19

Family

ID=69778227

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/MY2019/050055 WO2020055231A1 (en) 2018-09-13 2019-09-12 Method and system for wireless presentation of data

Country Status (2)

Country Link
MY (1) MY197164A (en)
WO (1) WO2020055231A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20150040125A (en) * 2013-10-04 2015-04-14 삼성전자주식회사 Master device, client device, and method for screen mirroring thereof
US20160364201A1 (en) * 2011-07-15 2016-12-15 Vmware, Inc. Remote desktop mirroring
US20170078331A1 (en) * 2015-03-31 2017-03-16 Dell Products, Lp Policy setting for content sharing of a plurality of remotely connected computing devices in physical or virtualized space
KR20170056858A (en) * 2015-11-16 2017-05-24 주식회사 케이티 Screen sharing mathod for plural devices based on various operating systems, device and system
US20170250830A1 (en) * 2011-08-24 2017-08-31 Awind Inc. Method of establishing paid connection using screen mirroring application between multi- platforms

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160364201A1 (en) * 2011-07-15 2016-12-15 Vmware, Inc. Remote desktop mirroring
US20170250830A1 (en) * 2011-08-24 2017-08-31 Awind Inc. Method of establishing paid connection using screen mirroring application between multi- platforms
KR20150040125A (en) * 2013-10-04 2015-04-14 삼성전자주식회사 Master device, client device, and method for screen mirroring thereof
US20170078331A1 (en) * 2015-03-31 2017-03-16 Dell Products, Lp Policy setting for content sharing of a plurality of remotely connected computing devices in physical or virtualized space
KR20170056858A (en) * 2015-11-16 2017-05-24 주식회사 케이티 Screen sharing mathod for plural devices based on various operating systems, device and system

Also Published As

Publication number Publication date
MY197164A (en) 2023-05-27

Similar Documents

Publication Publication Date Title
US11153110B2 (en) Communication method and terminal in live webcast channel and storage medium thereof
US9953612B2 (en) Systems and methods for facilitating communication between mobile devices and display devices
US20180262793A1 (en) Reverse Casting from a First Screen Device to a Second Screen Device
US11641450B2 (en) Apparatus for video communication
CA2987758C (en) Systems and methods for relating configuration data to ip cameras
CN108924603B (en) Multi-terminal streaming media playing system and method based on WiFi (Wireless Fidelity) defined by software
CN113301299A (en) Multi-channel video transmission method, system, terminal and storage medium
CN113438747A (en) Processing method, processing apparatus, and storage medium
CN104270603B (en) Obtain the method and monitoring system of video flowing
US10666351B2 (en) Methods and systems for live video broadcasting from a remote location based on an overlay of audio
WO2020055231A1 (en) Method and system for wireless presentation of data
US9485458B2 (en) Data processing method and device
CN106358008B (en) Method for avoiding repeated call access and conference television terminal equipment
US10863233B2 (en) Wireliss docking system for audio-video
CN107396334B (en) Wireless sound box and method for connecting multiple intelligent devices
CN111865874B (en) Data transmission method and device
CN112272223A (en) Application running method and device, server and computer readable storage medium
CN105898543A (en) Video interaction mobile terminal, player and method
US11950019B2 (en) Mobile terminal and hub apparatus for use in a video communication system
JP6436762B2 (en) Information processing apparatus and service providing method
CN114007035B (en) Conference data sharing system and method
JPH0946340A (en) Multi-address data communication equipment
JP2019125972A (en) Terminal device, information processing method, program, and communication system
US20220022063A1 (en) Determination of extender onboarding completion status
KR101757423B1 (en) Remote control system and method thereof electronic devices having heterogeneous operating system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19859029

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19859029

Country of ref document: EP

Kind code of ref document: A1