TWI427531B - Remote management system and the method thereof - Google Patents

Remote management system and the method thereof Download PDF

Info

Publication number
TWI427531B
TWI427531B TW99133883A TW99133883A TWI427531B TW I427531 B TWI427531 B TW I427531B TW 99133883 A TW99133883 A TW 99133883A TW 99133883 A TW99133883 A TW 99133883A TW I427531 B TWI427531 B TW I427531B
Authority
TW
Taiwan
Prior art keywords
web browser
block
display
blocks
comparison
Prior art date
Application number
TW99133883A
Other languages
Chinese (zh)
Other versions
TW201216148A (en
Inventor
Wen-Shun Li
Original Assignee
Aten Int Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Aten Int Co Ltd filed Critical Aten Int Co Ltd
Priority to TW99133883A priority Critical patent/TWI427531B/en
Priority to CN2011103178835A priority patent/CN102541268A/en
Priority to CN201710038491.2A priority patent/CN107066106A/en
Publication of TW201216148A publication Critical patent/TW201216148A/en
Application granted granted Critical
Publication of TWI427531B publication Critical patent/TWI427531B/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02Input arrangements using manually operated switches, e.g. using keyboards or dials
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03543Mice or pucks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1415Digital output to display device ; Cooperation and interconnection of the display device with other functional units with means for detecting differences between the image stored in the host and the images displayed on the displays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Description

遠端管理系統及其方法Remote management system and method thereof

本發明係有關於一種遠端管理系統及其方法;具體而言,本發明之遠端管理系統及其方法使得用戶端電腦不需要額外加裝外掛程式或應用程式,而能直接以網頁瀏覽器顯示被控電腦所輸出之動態影像。The present invention relates to a remote management system and method thereof; in particular, the remote management system and method thereof of the present invention enable a client computer to directly install a web browser without requiring an additional plug-in or application. Display the motion picture output by the controlled computer.

多電腦切換器(Keyboard-Video-Mouse Switch;KVM Switch)係連接於用戶端中控裝置與多台被控電腦之間,使得使用者可以透過一組鍵盤、螢幕和滑鼠來控制多台的被控電腦。所謂的網路型多電腦切換器(Over-IP KVM)係一種具有網路介面之多電腦切換器,其經由網路將用戶端電腦耦接至一或多台被控電腦。A keyboard-Video-Mouse Switch (KVM Switch) is connected between the central control device and the plurality of controlled computers, so that the user can control multiple devices through a set of keyboards, screens and mice. Charged computer. The so-called Over-IP KVM is a multi-computer switch with a network interface that couples a client computer to one or more controlled computers via a network.

為了使用戶端電腦的使用者能對網路型多電腦切換器進行操作並進而與被控電腦進行通訊,在使用者端必須提供一個管理介面以供用戶端電腦使用。在習知技術中此管理介面包含特殊的應用程式及網頁瀏覽器,其中網頁瀏覽器係可以是原本即已安裝於用戶端電腦上的一般網頁瀏覽器,但是此應用程式則必須另外由網路型多電腦切換器之製造商處取得後進行安裝。當使用網頁作為管理介面時,網路型多電腦切換器與用戶端電腦之間的關係相當於網頁伺服器與網頁瀏覽設備之間的關係,此時使用者可利用用戶端電腦中的網頁瀏覽器所顯示的網頁來對多電腦切換器進行操作。而現今的網路型多電腦切換器產品除了允許使用者藉以管理遠端的被控電腦以外,還具備檢視被控電腦所輸出的動態影像的功能。因為現有的網頁瀏覽器本身並無法顯示被控電腦所輸出的動態影像,所以被控電腦輸出之動態影像必須藉由安裝在用戶端電腦中的特殊應用程式來顯示。如果要以網頁瀏覽器來顯示被控電腦所輸出的動態影像,此網頁瀏覽器必須額外加裝外掛程式(plug-in,例如Adobe Flash Player)或由網頁呼叫額外的應用程式。In order to enable the user of the client computer to operate the network type KVM switch and thereby communicate with the controlled computer, a management interface must be provided on the user side for the user computer to use. In the prior art, the management interface includes a special application program and a web browser. The web browser may be a general web browser originally installed on the client computer, but the application must be additionally provided by the network. The manufacturer of the KVM switch is installed and installed. When using a webpage as a management interface, the relationship between the web-based KVM switch and the client computer is equivalent to the relationship between the web server and the web browsing device, and the user can browse the webpage in the client computer. The web page displayed by the device operates on the KVM switch. In addition to allowing users to manage remotely controlled computers, today's networked KVM switches also have the ability to view the dynamic images output by the controlled computer. Because the existing web browser itself cannot display the dynamic image output by the controlled computer, the dynamic image output by the controlled computer must be displayed by a special application installed on the client computer. If you want to use a web browser to display the dynamic images output by the controlled computer, the web browser must additionally add a plug-in (such as Adobe Flash Player) or call an additional application from the web page.

由於現今網頁瀏覽器的種類繁多,各家產品所支援的功能往往會有很大的差異。因此,為了確保網頁在一般狀況下能在任何類型的網頁瀏覽器中正常顯示,就必須依照W3C推薦標準(W3C recommendation)來製作網頁。雖然相關的HTML 5等網路標準支援特定格式(例如MPEG4)的動態影像,但實際上目前的瀏覽器由於牽涉智慧財產權的緣故都不支援該些特定格式。並且,該影像格式與鍵盤及滑鼠的控制不相容,因此為了在網頁瀏覽器中顯示動態影像,還是必須如前所述額外加裝外掛程式或由網頁呼叫額外的應用程式。此外,由於外掛程式的設計會因其所附屬的網頁瀏覽器以及底層的作業系統平台而異,因此網路型多電腦切換器的製造商若要滿足不同網頁瀏覽器及作業系統的使用者,就必須針對不同的網頁瀏覽器以及作業系統來開發外掛程式或應用程式,其所耗費的人力、物力對於多電腦切換器的製造商而言將是不小的負擔。Due to the wide variety of web browsers available today, the features supported by each product tend to vary widely. Therefore, in order to ensure that a web page can be normally displayed in any type of web browser under normal conditions, it is necessary to create a web page in accordance with the W3C recommendation. Although related web standards such as HTML 5 support dynamic images of specific formats (such as MPEG4), in reality, current browsers do not support these specific formats because of the intellectual property rights involved. Moreover, the image format is incompatible with the control of the keyboard and the mouse. Therefore, in order to display the motion image in the web browser, it is necessary to additionally add a plug-in program or call an additional application by the webpage as described above. In addition, since the design of the plug-in program varies depending on the web browser to which it is attached and the underlying operating system platform, the manufacturer of the network-based KVM switch must satisfy users of different web browsers and operating systems. It is necessary to develop a plug-in or an application for different web browsers and operating systems, and the labor and material resources it consumes will be a burden for the manufacturer of the KVM switch.

本發明之一目的在於提供一種遠端管理系統及其方法,相較於先前技術,能在不需要外掛程式的前提下,實現在不同作業系統平台上的所有種類的網頁瀏覽器中顯示動態影像的功能。An object of the present invention is to provide a remote management system and a method thereof, which can display dynamic images in all kinds of web browsers on different operating system platforms without using a plug-in program compared with the prior art. The function.

本發明之另一目的在於提供一種遠端管理系統及其方法,相較於先前技術,具有局部更新網頁的功能,可達到節省網路頻寬及減輕網頁伺服器負擔的效果。Another object of the present invention is to provide a remote management system and a method thereof, which have the function of partially updating a webpage compared with the prior art, and can achieve the effect of saving network bandwidth and reducing the burden on the web server.

本發明之遠端管理系統包含一影像擷取模組、一處理/比較模組、一影像編碼模組及一傳送模組。此影像擷取模組係依據某一採樣頻率對被控電腦輸出之類比或數位動態影像訊(例如VGA或DVI訊號)號進行擷取,以將類比動態影像訊號轉換為一連串靜態圖像。處理/比較模組進一步將靜態圖像分割為比較區塊,並比較前後兩張靜態圖像的差異,以從比較區塊中找出所有有像素值變化之變化區塊。比較區塊可再分為複數個比較區塊組。瀏覽器中所顯示之網頁亦被劃分為多個顯示區塊,每個比較區塊組以一對一之方式對應至網頁顯示區中的一個顯示區塊。影像編碼模組進一步將變化區塊所屬比較區塊組中所有比較區塊之像素值經由一編碼方式轉換為編碼數據,但其編碼方式並非MPEG/MPEG2/MPEG4/AVI等數位動態影像之編碼方式。傳送模組因應於網頁瀏覽器之請求將編碼數據傳送至網頁瀏覽設備,使網頁瀏覽器可依據此編碼數據更新其對應之顯示區塊,進而顯示相應於被控電腦輸出之動態影像訊號的動態影像。The remote management system of the present invention comprises an image capturing module, a processing/comparing module, an image encoding module and a transmitting module. The image capture module captures an analog or digital motion picture (eg, VGA or DVI signal) number of the controlled computer based on a sampling frequency to convert the analog video signal into a series of still images. The processing/compare module further divides the still image into comparison blocks, and compares the difference between the two previous and subsequent still images to find all the changed blocks having the pixel value change from the comparison block. The comparison block can be further divided into a plurality of comparison block groups. The web page displayed in the browser is also divided into a plurality of display blocks, and each of the comparison block groups corresponds to one display block in the webpage display area in a one-to-one manner. The image coding module further converts the pixel values of all the comparison blocks in the comparison block group to which the change block belongs to the coded data by a coding method, but the coding mode is not the coding mode of the digital motion image such as MPEG/MPEG2/MPEG4/AVI. . The transmitting module transmits the encoded data to the web browsing device according to the request of the web browser, so that the web browser can update the corresponding display block according to the encoded data, thereby displaying the dynamics of the dynamic image signal corresponding to the output of the controlled computer. image.

本發明遠端管理方法包含:將被控電腦輸出的動態影像訊號轉換為一連串的靜態圖像,而後將每一張靜態圖像分割為複數個比較區塊,並比較前後兩張靜態圖像的差異,以從該些比較區塊中找出所有有像素值變化的變化區塊,其中比較區塊更分為複數個比較區塊組,每個比較區塊組對應於網頁瀏覽器之網頁顯示區中的一個顯示區塊。若變化區塊存在,則將變化區塊所屬的比較區塊組中的所有比較區塊之像素值轉經由一編碼方式轉換為編碼數據,而後因應於網頁瀏覽器之請求將編碼數據經由網路傳送至網頁瀏覽設備,使網頁瀏覽器可依據此編碼數據更新該顯示區塊,進而顯示相應於被控電腦輸出之動態影像訊號的動態影像。The remote management method of the present invention comprises: converting a dynamic image signal output by the controlled computer into a series of static images, and then dividing each static image into a plurality of comparison blocks, and comparing the two static images before and after The difference is to find all the changed blocks having the pixel value change from the comparison blocks, wherein the comparison block is further divided into a plurality of comparison block groups, and each comparison block group corresponds to a webpage display of the web browser A display block in the zone. If the change block exists, the pixel values of all the comparison blocks in the comparison block group to which the change block belongs are converted into encoded data by an encoding method, and then the encoded data is transmitted through the network according to the request of the web browser. The webpage browsing device is configured to enable the web browser to update the display block according to the encoded data, thereby displaying a motion image corresponding to the dynamic image signal output by the controlled computer.

本發明藉由將被控電腦輸出之動態影像以編碼數據的形式經由網路傳送至網頁瀏覽設備,使網頁瀏覽設備之網頁瀏覽器可據以顯示被控電腦所輸出之動態影像,而在不需要額外加裝外掛程式或呼叫額外的應用程式的前提下實現在不同作業系統平台上的所有種類的網頁瀏覽器中顯示被控電腦所輸出之動態影像。The invention transmits the dynamic image outputted by the controlled computer to the web browsing device via the network in the form of encoded data, so that the web browser of the web browsing device can display the dynamic image output by the controlled computer, and Dynamic images output by the controlled computer are displayed in all kinds of web browsers on different operating system platforms, with the need to additionally install plug-ins or call additional applications.

本發明提供一種遠端管理系統。在一較佳實施例中,本發明之遠端管理系統為一網路型多電腦切換器。然而在其他實施例中,本發明之遠端管理系統可以為其他類型之多電腦切換器或其他類型之遠端電腦管理系統或裝置。The invention provides a remote management system. In a preferred embodiment, the remote management system of the present invention is a network type KVM switch. In other embodiments, however, the remote management system of the present invention may be other types of KVM switches or other types of remote computer management systems or devices.

第1A圖係為本發明遠端管理系統之一實施例的方塊圖。如第1A圖所示,遠端管理系統1經由其數個連接埠連接至一或數台被控電腦2,並經由網路3與網頁瀏覽設備4中的網頁瀏覽器5產生互動,使網頁瀏覽設備4可經由網路3與遠端管理系統1進行通訊並進而控制被控電腦2。網頁瀏覽設備4之使用者可以藉由網頁瀏覽器5所顯示之網頁對遠端管理系統1進行操作,例如進行設定或是切換與控制被控電腦2之間的連接埠。在本實施例中,網路3為網際網路(Internet),網頁瀏覽設備4為一個人電腦;然而在其他實施例中,網路3可以為乙太網路(Ethernet)或令牌環網(token ring)等其他類型的電腦網路,網頁瀏覽設備4可以為筆記型電腦、個人數位助理(Personal Digital Assistant,PDA)或智慧型手機等可執行網頁瀏覽器5的任何手持行動電子裝置。網頁瀏覽器5可為Internet Explorer、Mozilla Firefox、Google Chrome、Opera及Safari等不同種類或執行於不同作業系統平台上的網頁瀏覽軟體。Figure 1A is a block diagram of one embodiment of a remote management system of the present invention. As shown in FIG. 1A, the remote management system 1 is connected to one or several controlled computers 2 via its plurality of ports, and interacts with the web browser 5 in the web browsing device 4 via the network 3 to make the webpage The browsing device 4 can communicate with the remote management system 1 via the network 3 and thereby control the controlled computer 2. The user of the web browsing device 4 can operate the remote management system 1 by using the web page displayed by the web browser 5, for example, setting or switching and controlling the connection between the controlled computer 2. In this embodiment, the network 3 is an Internet, and the web browsing device 4 is a personal computer; however, in other embodiments, the network 3 may be an Ethernet or a Token Ring ( Other types of computer networks such as token ring), the web browsing device 4 can be any handheld mobile electronic device of the executable web browser 5 such as a notebook computer, a personal digital assistant (PDA) or a smart phone. The web browser 5 can be web browsing software of different types such as Internet Explorer, Mozilla Firefox, Google Chrome, Opera, and Safari or executed on different operating system platforms.

如第1A圖所示,此遠端管理系統1包含影像擷取模組10、處理/比較模組20、影像編碼模組30及傳送模組40。影像擷取模組10以某一採樣頻率對被控電腦2輸出之類比動態影像訊號進行擷取,以將類比動態影像訊號轉換為一連串(連續)的單張數位靜態圖像,此靜態圖像亦可稱為影像禎(frame),例如每秒擷取出30禎。影像擷取模組10較佳為包含類比至數位(Analog-to-Digital)轉換功能的硬體電路。在本實施例中,被控電腦2的動態影像訊號是藉由被控電腦2的顯示卡上的VGA(Video Graphics Array,視訊圖形陣列)埠(port)輸出至遠端管理系統1;然而在其他實施例中,可藉由例如網路等其他界面(interface)來輸出。此外,採樣頻率的高低可視網路的頻寬、硬體的運算能力等軟硬體條件、對顯示畫質的要求或其他需求而調整。As shown in FIG. 1A, the remote management system 1 includes an image capturing module 10, a processing/comparing module 20, a video encoding module 30, and a transmitting module 40. The image capturing module 10 captures the analog video signal outputted by the controlled computer 2 at a sampling frequency to convert the analog video signal into a series of (continuous) single digital still images. The static image It can also be called an image frame, for example, 30 points per second. The image capturing module 10 is preferably a hardware circuit including an analog-to-digital conversion function. In this embodiment, the dynamic video signal of the controlled computer 2 is output to the remote management system 1 by a VGA (Video Graphics Array) port on the display card of the controlled computer 2; In other embodiments, it may be output by other interfaces such as a network. In addition, the sampling frequency is adjusted according to the bandwidth of the network, the hardware and software capabilities such as the hardware computing power, the requirements for display quality, or other requirements.

此遠端管理系統1更包含一路徑安排模組50,用以將由網頁瀏覽設備4所傳來之控制訊號(例如鍵盤訊號或游標控制訊號)依據一路徑選擇設定傳輸至所選定之被控電腦2。此路徑安排模組50亦將所選定之被控電腦2切換至影像擷取模組10。此路徑安排模組50可為一處理器、多工器(Multiplexer)、矩陣式切換器(cross-point switch)、場可程式化邏輯閘陣列(FPGA)、匯流排或其中之任意適當組合。The remote management system 1 further includes a routing module 50 for transmitting control signals (such as keyboard signals or cursor control signals) transmitted by the web browsing device 4 to the selected controlled computer according to a path selection setting. 2. The routing module 50 also switches the selected controlled computer 2 to the image capturing module 10. The routing module 50 can be a processor, a multiplexer, a cross-point switch, a field programmable logic gate array (FPGA), a bus, or any suitable combination thereof.

處理/比較模組20進一步將靜態圖像分割為複數個較小的比較區塊,並比較前後兩張靜態圖像在像素值上的差異,以從比較區塊中找出有變化的區塊(下稱變化區塊)。比較區塊可再畫分為多個比較區塊組。網頁瀏覽器中所顯示之網頁亦被劃分為多個顯示區塊,每個比較區塊組對應於網頁顯示區中的一個顯示區塊。換言之,網頁瀏覽器5之網頁顯示區被分為多個顯示區塊,每個顯示區塊對應於一個比較區塊組,亦即顯示區塊的大小係大於或等於比較區塊的大小。第1B圖係為第1A圖所示遠端管理系統的處理/比較模組將靜態圖像分割為區塊之一實施例的示意圖。如第1B圖所示,在本實施例中,是將每張靜態圖像分割為16乘16大小的比較區塊BC ,而從中找出變化區塊(斜線部分)。然而在其他實施例中,可視需求分割為例如32乘32等不同大小的比較區塊。處理/比較模組20較佳採用例如積體電路晶片的硬體電路來實作。The processing/comparison module 20 further divides the still image into a plurality of smaller comparison blocks, and compares the difference between the two previous and second still images in pixel values to find the changed block from the comparison block. (hereinafter referred to as the change block). The comparison block can be further divided into a plurality of comparison block groups. The webpage displayed in the web browser is also divided into a plurality of display blocks, and each of the comparison block groups corresponds to one display block in the webpage display area. In other words, the web page display area of the web browser 5 is divided into a plurality of display blocks, each of which corresponds to a comparison block group, that is, the size of the display block is greater than or equal to the size of the comparison block. FIG. 1B is a schematic diagram of an embodiment of the processing/comparing module of the remote management system shown in FIG. 1A for dividing a still image into blocks. As shown in Fig. 1B, in the present embodiment, each still image is divided into 16 by 16 size comparison blocks B C from which the change blocks (hatched portions) are found. In other embodiments, however, the visual requirements are divided into different sized comparison blocks, such as 32 by 32. The processing/comparison module 20 is preferably implemented using a hardware circuit such as an integrated circuit chip.

影像編碼模組30進一步將變化區塊所屬之的比較區塊組中的所有比較區塊之像素值經由一編碼方式轉換為編碼數據。換言之,像素值之轉換係以顯示區塊為單位,因此只要顯示區塊所對應之比較區塊組中有一個比較區塊是變化區塊,則將該顯示區塊所對應之所有比較區塊一起進行編碼。如第1B圖所示,當顯示區塊的大小為32乘32,而比較區塊BC 的大小為16乘16時,則將屬於同一個比較區塊組BS(即對應於同一個顯示區塊)的四個相鄰的比較區塊BC 一起進行編碼。編碼數據中更包含經編碼的像素值及相應之顯示區塊的座標值等資訊。The image encoding module 30 further converts the pixel values of all the comparison blocks in the comparison block group to which the change block belongs to the encoded data via an encoding method. In other words, the conversion of the pixel values is in units of display blocks, so as long as one comparison block in the comparison block group corresponding to the display block is a change block, all the comparison blocks corresponding to the display block are Coding together. As shown in FIG. 1B, when the size of the display block is 32 by 32, and the size of the comparison block B C is 16 by 16, it will belong to the same comparison block group BS (ie, corresponding to the same display area). The four adjacent comparison blocks B C of the block are encoded together. The encoded data further includes information such as the encoded pixel value and the coordinate value of the corresponding display block.

在一較佳實施例中,此像素值之轉換係依據JPEG格式之編碼方式來進行編碼/壓縮;然而在其他實施例中,亦可採用W3C標準所支援的其他種類編碼/壓縮格式,例如GIF、PNG或BMP等。值得注意的是,在將編碼數據傳送至網頁瀏覽設備4的過程中,並非每筆編碼數據都需要伴隨著數據信頭(即header,其供數據解碼之用),可以採用多筆編碼數據共用相同數據信頭的方式以節省網路頻寬。在一較佳實施例中,可以使第一筆編碼數據之封包包含此數據信頭,第二筆以後之編碼數據的封包則不包含此數據信頭,但是第二筆及第二筆以後之編碼數據仍沿用第一筆編碼數據所使用之數據信頭來進行解碼。或者是,數據信頭、第一筆編碼數據及第二筆以後之編碼數據係分別由不同之封包傳送至網頁瀏覽設備4,但第一筆編碼數據、第二筆及第二筆以後之編碼數據共用此數據信頭。In a preferred embodiment, the conversion of the pixel values is performed according to the encoding method of the JPEG format. However, in other embodiments, other types of encoding/compression formats supported by the W3C standard, such as GIF, may also be used. , PNG or BMP, etc. It should be noted that in the process of transmitting the encoded data to the web browsing device 4, not every encoded data needs to be accompanied by a data header (ie, a header for data decoding), and multiple encoded data sharing may be used. The same data header is used to save network bandwidth. In a preferred embodiment, the packet of the first encoded data may be included in the data header, and the packet of the second encoded data does not include the data header, but the second and second subsequent The encoded data is still decoded using the data header used in the first encoded data. Alternatively, the data header, the first encoded data, and the second encoded data are transmitted to the web browsing device 4 by different packets, but the first encoded data, the second and second encodings are encoded. The data shares this data header.

此外,在一較佳實施例中,如第1C圖所示,當數個相鄰的比較區塊組BS1 與BS2 所對應的比較區塊BC 有變化(斜線部分)而需要作像素值轉換時,影像編碼模組可以選擇性地將相應於該數個相鄰的比較區塊組BS所對應的所有比較區塊BC 合併編碼以提高壓縮率,從而節省傳輸所需的頻寬,並提高顯示效率。例如比較區塊組BS1 及BS2 相鄰,且比較區塊組BS1 有4個變化區塊而比較區塊組BS2 有2個變化區塊,此時可將此6個變化區塊或全部的8個區塊一起進行編碼,而非對比較區塊組BS1 及BS2 進行個別的編碼。此時必須記錄該數個相鄰顯示區塊的相關資訊,其中包含座標、寬度及高度等訊息,使得網頁瀏覽器可依據這些訊息將該數個相鄰顯示區塊正確地顯示於網頁中相應之位置。再者,在一較佳實施例中,為了增進壓縮效能起見,影像編碼模組30可使用具備圖像壓縮功能的數位訊號處理器(digital signal processor,DSP)等硬體電路來實現,例如Aspeed公司所提供之AST1000或AST2000。In addition, in a preferred embodiment, as shown in FIG. 1C, when the comparison block B C corresponding to the plurality of adjacent comparison block groups BS 1 and BS 2 has a change (hatched portion), it needs to be a pixel. During the value conversion, the image coding module can selectively combine all the comparison blocks B C corresponding to the plurality of adjacent comparison block groups BS to improve the compression ratio, thereby saving the bandwidth required for transmission. And improve display efficiency. For example, the comparison block groups BS 1 and BS 2 are adjacent, and the comparison block group BS 1 has 4 change blocks and the comparison block group BS 2 has 2 change blocks. In this case, the 6 change blocks can be made. Or all of the 8 blocks are encoded together, instead of individually coding the compared block groups BS 1 and BS 2 . At this time, information about the adjacent display blocks must be recorded, including coordinates, width, and height, so that the web browser can correctly display the plurality of adjacent display blocks in the webpage according to the messages. The location. Moreover, in a preferred embodiment, in order to improve compression performance, the image encoding module 30 can be implemented by using a hardware circuit such as a digital signal processor (DSP) having an image compression function, for example, for example, AST1000 or AST2000 provided by Aspeed.

傳送模組40可因應於網頁瀏覽器5之請求將影像編碼模組30產生之編碼數據經由網路3傳送至網頁瀏覽設備4,使網頁瀏覽器5可據以顯示相應於被控電腦2輸出之動態影像訊號的動態影像(對使用者而言此動態影像相當於被控電腦2之螢幕畫面上的影像)。傳送模組40較佳地包含網頁伺服器41。網頁伺服器41較佳地因應於網頁瀏覽器5之請求將一個用於對編碼數據進行解碼的共用數據信頭傳送至網頁瀏覽器5。網頁瀏覽設備4中的網頁瀏覽器5可經由網路3而從傳送模組40中的網頁伺服器41取得共用數據信頭及所有顯示區塊的編碼數據,並依據共用數據信頭與編碼數據即時更新網頁顯示區中相應之顯示區塊。在取得共用數據信頭以後,除非後續顯示區塊的大小(例如相鄰的顯示區塊所對應的比較區塊合併編碼)或影像品質等編碼參數有變化,否則網頁瀏覽器並不需要重新取得數據信頭,因此多筆編碼數據可共用一共用數據信頭。The transmitting module 40 can transmit the encoded data generated by the image encoding module 30 to the web browsing device 4 via the network 3 according to the request of the web browser 5, so that the web browser 5 can display the output corresponding to the controlled computer 2 according to the data. The motion picture of the motion picture signal (this motion picture is equivalent to the image on the screen of the controlled computer 2 for the user). The delivery module 40 preferably includes a web server 41. The web server 41 preferably transmits a shared data header for decoding the encoded data to the web browser 5 in response to a request from the web browser 5. The web browser 5 in the web browsing device 4 can obtain the shared data header and the encoded data of all the display blocks from the web server 41 in the transmission module 40 via the network 3, and according to the shared data header and the encoded data. Instantly update the corresponding display block in the web page display area. After the shared data header is obtained, the web browser does not need to be re-acquired unless the size of the subsequent display block (for example, the comparison block corresponding to the adjacent display block) or the encoding parameter of the image quality changes. Data header, so multiple encoded data can share a common data header.

此外,在一較佳實施例中,網頁伺服器41可以接收來自網頁瀏覽設備4之鍵盤或滑鼠等輸入裝置的”事件”(例如由執行於網頁瀏覽器5中的JavaScript程式捕獲,並經由網路3傳送到網頁伺服器41)並加以處理,進而對被控電腦2進行控制(例如移動被控電腦的螢幕畫面中的滑鼠游標)。網頁伺服器41較佳地可以在當變化區塊存在時因應於網頁瀏覽器5的請求而發送變化區塊的編碼數據,使網頁瀏覽器5能據以更新網頁顯示區,從而顯示相應於被控電腦2輸出的動態影像訊號的動態影像,而當變化區塊不存在時不對網頁瀏覽器5的請求作回應,以節省網路頻寬。再者,在一較佳實施例中,當數個相鄰的顯示區塊合併編碼時,傳送模組40可以因應於網頁瀏覽器5之請求將前述的相鄰顯示區塊的相關資訊傳送至網頁瀏覽設備4,其中包含座標、長度及寬度等訊息,使網頁瀏覽器可根據該相關資訊及編碼數據來更新網頁顯示區中相應的顯示區塊。Moreover, in a preferred embodiment, the web server 41 can receive an "event" from an input device such as a keyboard or mouse of the web browsing device 4 (eg, captured by a JavaScript program executed in the web browser 5, and via The network 3 is transmitted to the web server 41) and processed to control the controlled computer 2 (for example, moving the mouse cursor in the screen of the controlled computer). The web server 41 preferably transmits the encoded data of the changed block in response to the request of the web browser 5 when the changed block exists, so that the web browser 5 can update the webpage display area accordingly, thereby displaying corresponding to the The dynamic image of the dynamic image signal output by the computer 2 is controlled, and when the changed block does not exist, the request of the web browser 5 is not responded to save the network bandwidth. Moreover, in a preferred embodiment, when a plurality of adjacent display blocks are combined and encoded, the transmitting module 40 can transmit the related information of the foregoing adjacent display blocks to the request of the web browser 5 to The webpage browsing device 4 includes a message such as coordinates, length and width, so that the web browser can update the corresponding display block in the webpage display area according to the related information and the encoded data.

網頁伺服器除了可以是遠端管理系統1的一部分(即本實施例中的網頁伺服器41)以外,還可以是獨立的裝置(即本實施例中的網頁伺服器6)。網頁伺服器6與遠端管理系統1及網頁瀏覽設備4同為連接於網路3的獨立裝置,網頁瀏覽設備4可以經由網路3與網頁伺服器6進行通訊,並藉以對遠端管理系統1進行操作。此時網頁伺服器6相當於網路型多電腦切換器系統中的控制中心,除了提供網頁伺服器的功能以對例如遠端管理系統1等所屬的裝置進行管理以外,還可以提供網路安全機制等其他功能。網頁伺服器41或網頁伺服器6與網頁瀏覽器5之間的通訊協定為HTTP協定。The web server may be a separate device (ie, the web server 6 in this embodiment) in addition to being part of the remote management system 1 (ie, the web server 41 in this embodiment). The web server 6 and the remote management system 1 and the web browsing device 4 are independent devices connected to the network 3. The web browsing device 4 can communicate with the web server 6 via the network 3, and the remote management system is used. 1 to operate. At this time, the web server 6 is equivalent to the control center in the network type KVM switch system, and provides the function of the web server to manage the device to which the remote management system 1 belongs, for example, and also provides network security. Other functions such as mechanisms. The communication protocol between the web server 41 or the web server 6 and the web browser 5 is an HTTP protocol.

在一較佳實施例中,網頁瀏覽器5中所顯示之網頁被分成數個顯示區塊,每個顯示區塊對應於網頁中的一個HTML(HyperText Markup Language,超文件標示語言)影像標籤(image tag)。顯示區塊之大小可於網頁瀏覽器5之執行過程中進行切換。此時為了使網頁瀏覽設備4之使用者可以利用鍵盤或滑鼠等輸入裝置來對被控電腦2進行控制,可以在每個影像標籤中設置相關的鍵盤或滑鼠事件處理程序(event handler),或在所有影像標籤─亦即網頁中的整個顯示區之上加一個透明的元件,並為該元件設置相關之鍵盤或滑鼠事件處理程序。In a preferred embodiment, the web page displayed in the web browser 5 is divided into a plurality of display blocks, each of which corresponds to an HTML (HyperText Markup Language) image tag in the web page ( Image tag). The size of the display block can be switched during execution of the web browser 5. In this case, in order to enable the user of the webpage browsing device 4 to control the controlled computer 2 by using an input device such as a keyboard or a mouse, an associated keyboard or mouse event handler can be set in each image tag. Or add a transparent component over all image tags—that is, the entire display area of the web page—and set the relevant keyboard or mouse event handler for that component.

相較於先前技術,本發明之遠端管理系統使得用戶端電腦不需要額外加裝外掛程式或應用程式,而能在不同作業系統平台上的所有種類的網頁瀏覽器中顯示被控電腦所輸出之動態影像。Compared with the prior art, the remote management system of the present invention allows the client computer to display the output of the controlled computer in all kinds of web browsers on different operating system platforms without additional plug-ins or applications. Dynamic image.

第2圖係為第1A圖所示遠端管理系統的使用方法之一實施例的流程圖。此遠端管理系統可連接至一或多台被控電腦,並可與網頁瀏覽設備之網頁瀏覽器經由網路產生互動,使網頁瀏覽設備可經由網路與遠端管理系統進行通訊並進而控制被控電腦。如第2圖所示,步驟110將被控電腦輸出之動態影像訊號轉換為一連串的靜態圖像。步驟120將靜態圖像分割為複數個比較區塊,並比較前後兩張靜態圖像在像素值上的差異,以從比較區塊中找出所有有變化的區塊,其中比較區塊可再分為多個比較區塊組,每一個比較區塊組對應於網頁瀏覽器之網頁顯示區中的一個顯示區塊。此時網頁瀏覽器的網頁顯示區分為多個顯示區塊,每個顯示區塊對應於一個比較區塊組,亦即顯示區塊的大小係大於或等於比較區塊的大小。在本實施例中,係將每張靜態圖像再分割為複數個16乘16大小的比較區塊(如第1B圖所示),而從中找出變化區塊(如第1B圖斜線部分所示)。然而在其他實施例中,可視需求分割為例如32乘32等不同大小的比較區塊。Figure 2 is a flow diagram of one embodiment of a method of using the remote management system shown in Figure 1A. The remote management system can be connected to one or more controlled computers and can interact with the web browser of the web browsing device via the network, so that the web browsing device can communicate with the remote management system via the network and thereby control Charged computer. As shown in FIG. 2, step 110 converts the dynamic image signal output by the controlled computer into a series of still images. Step 120 divides the still image into a plurality of comparison blocks, and compares the difference between the two previous and second still images in pixel values to find all the changed blocks from the comparison block, wherein the comparison block can be further It is divided into a plurality of comparison block groups, and each of the comparison block groups corresponds to one display block in the webpage display area of the web browser. At this time, the webpage display of the web browser is divided into a plurality of display blocks, and each display block corresponds to one comparison block group, that is, the size of the display block is greater than or equal to the size of the comparison block. In this embodiment, each static image is further divided into a plurality of 16 by 16 size comparison blocks (as shown in FIG. 1B), and the changed blocks are found therefrom (eg, the oblique line portion of FIG. 1B). Show). In other embodiments, however, the visual requirements are divided into different sized comparison blocks, such as 32 by 32.

步驟130若變化區塊存在,則將變化區塊所屬的比較區塊組中的所有比較區塊之像素值轉換為編碼數據。換言之,像素值的轉換是以顯示區塊為單位,因此只要顯示區塊所對應的比較區塊組中的至少一個是變化區塊,則將該顯示區塊所對應的所有比較區塊一起進行編碼。例如當顯示區塊的大小為32乘32,而比較區塊BC 的大小為16乘16時,則將屬於同一個比較區塊組BS(即對應於同一個顯示區塊)的四個相鄰的比較區塊BC (如第1B圖所示)一起進行編碼。編碼數據中包含經編碼的像素值及相應的顯示區塊的座標值等資訊。在較佳實施例中,係以JPEG格式來進行像素值之編碼/壓縮;然而在其他實施例中,亦可採用W3C推薦標準所支援的其他編碼/壓縮格式,例如GIF、PNG或BMP等。編碼數據較佳地不包含用於對編碼數據進行解碼的數據信頭,而採用編碼數據共用數據信頭的方式節省傳輸所需的頻寬。此外,在一較佳實施例中,當數個相鄰的比較區塊組BS所對應的比較區塊BC 均有變化(如第1C圖斜線部分所示)而需要作像素值轉換時,可以選擇性地將相應於該數個相鄰的比較區塊組BS所對應的所有比較區塊BC 合併編碼以提高壓縮率,以節省傳輸所需的頻寬,並提高顯示效率。此時必須記錄該數個相鄰顯示區塊的相關資訊,其中包含座標、寬度及高度等訊息,使得網頁瀏覽器可據以將該數個相鄰顯示區塊正確地顯示於相應的位置。Step 130: If the change block exists, convert the pixel values of all the comparison blocks in the comparison block group to which the change block belongs to the encoded data. In other words, the conversion of the pixel values is in units of display blocks, so that as long as at least one of the comparison block groups corresponding to the display block is a change block, all the comparison blocks corresponding to the display block are performed together. coding. For example, when the size of the display block is 32 by 32, and the size of the comparison block B C is 16 by 16, then four phases belonging to the same comparison block group BS (ie, corresponding to the same display block) will be belonged. The neighboring comparison block B C (shown in Figure 1B) is encoded together. The encoded data includes information such as the encoded pixel value and the coordinate value of the corresponding display block. In the preferred embodiment, the encoding/compression of pixel values is performed in the JPEG format; however, in other embodiments, other encoding/compression formats supported by the W3C recommendation, such as GIF, PNG, or BMP, may also be employed. The encoded data preferably does not include a data header for decoding the encoded data, and the encoded data shares the data header to save the bandwidth required for transmission. In addition, in a preferred embodiment, when the comparison block B C corresponding to the plurality of adjacent comparison block groups BS changes (as shown by the hatched portion of FIG. 1C) and needs to be converted into a pixel value, All of the comparison blocks B C corresponding to the plurality of adjacent comparison block groups BS may be selectively encoded to increase the compression ratio to save the bandwidth required for transmission and improve display efficiency. At this time, information about the plurality of adjacent display blocks must be recorded, including information such as coordinates, width, and height, so that the web browser can correctly display the plurality of adjacent display blocks at the corresponding positions.

步驟140因應於網頁瀏覽器之請求將編碼數據經由網路傳送至網頁瀏覽設備,以使網頁瀏覽器可依據編碼數據更新顯示區塊,進而顯示相應於被控電腦輸出的動態影像訊號的動態影像。在一較佳實施例中,可以因應於網頁瀏覽器的請求將一個用於對編碼數據進行解碼的、共用的數據信頭傳送至網頁瀏覽器,使網頁瀏覽器可依據共用數據信頭與編碼數據即時更新網頁顯示區中相應的顯示區塊。在取得共用數據信頭以後,除非後續顯示區塊的大小(例如相鄰的顯示區塊所對應的比較區塊合併編碼)或品質等編碼參數有變化,否則網頁瀏覽器並不需要重新攫取數據信頭,因此共用數據信頭為編碼數據所共用的。Step 140, according to the request of the web browser, transmits the encoded data to the web browsing device via the network, so that the web browser can update the display block according to the encoded data, thereby displaying the dynamic image corresponding to the dynamic image signal output by the controlled computer. . In a preferred embodiment, a shared data header for decoding the encoded data can be transmitted to the web browser in response to a request from the web browser, so that the web browser can rely on the shared data header and encoding. The data instantly updates the corresponding display block in the web page display area. After obtaining the shared data header, the web browser does not need to retrieve data unless the size of the subsequent display block (for example, the comparison block corresponding to the adjacent display block) or the encoding parameter of the quality changes. The header, so the shared data header is shared by the encoded data.

此外,在一較佳實施例中,可以接收來自網頁瀏覽設備之鍵盤或滑鼠等輸入裝置的”事件”(例如由執行於網頁瀏覽器中的JavaScript程式捕獲,並經由網路傳送到網頁伺服器)並加以處理,進而對被控電腦進行控制(例如移動被控電腦的螢幕畫面中的滑鼠游標)。此外,在一較佳實施例中,可以在當變化區塊存在時因應於網頁瀏覽器的請求而發送變化區塊的編碼數據,使網頁瀏覽器能據以更新網頁顯示區,從而顯示相應於被控電腦輸出的動態影像訊號的動態影像,而當變化區塊不存在時不對網頁瀏覽器的請求作回應,以節省網路頻寬。再者,在一較佳實施例中,當數個相鄰的顯示區塊合併編碼時,可以因應於網頁瀏覽器之請求將前述的相鄰顯示區塊的相關資訊傳送至網頁瀏覽設備,其中包含座標、長度及寬度等訊息,使網頁瀏覽器可根據該相關資訊及編碼數據來更新網頁顯示區中相應的顯示區塊。In addition, in a preferred embodiment, an "event" from an input device such as a keyboard or a mouse of a web browsing device can be received (for example, captured by a JavaScript program executed in a web browser and transmitted to the web server via the network). And processing it to control the controlled computer (for example, moving the mouse cursor in the screen of the controlled computer). In addition, in a preferred embodiment, the encoded data of the changed block may be sent in response to a request of the web browser when the changed block exists, so that the web browser can update the webpage display area accordingly, thereby displaying corresponding to The dynamic image of the dynamic image signal output by the controlled computer, and does not respond to the request of the web browser when the changed block does not exist, thereby saving network bandwidth. Furthermore, in a preferred embodiment, when a plurality of adjacent display blocks are combined and encoded, the related information of the adjacent display blocks may be transmitted to the web browsing device according to the request of the web browser, wherein The message includes coordinates, length and width, so that the web browser can update the corresponding display block in the webpage display area according to the related information and the encoded data.

第3圖係為配合第2圖所示遠端管理系統之使用方法於網頁瀏覽器中顯示動態影像的實施例的流程圖。如第3圖所示,步驟210使網頁瀏覽器設備自遠端管理系統取得網頁,並於網頁瀏覽器中加以執行。步驟220使執行於網頁瀏覽器中的JavaScript程式語言對遠端管理系統發送HTTP請求,以要求遠端管理系統發送變化區塊的編碼數據及其相關資訊。在較佳實施例中,步驟220中的HTTP請求使用AJAX 技術中的XMLHttpRequest物件來實現,而變化區塊的相關資訊可以包含一組變化區塊的座標值、高度值及寬度值等數值。然而在其他實施例中,步驟220中的HTTP請求可以使用其他方式來實現,例如為了向下相容於較舊版本的Internet Explorer網頁瀏覽器,可以使用ActiveXObject物件。此外也可利用IFrame元件來實現,這裡不做限定。網頁瀏覽器之網頁顯示區分為多個顯示區塊,每個顯示區塊對應於一比較區塊組,亦即顯示區塊的大小係大於或等於比較區塊的大小。顯示區塊的大小可於網頁瀏覽器的執行過程中進行切換。在較佳實施例中,可於步驟220中的HTTP請求中指定顯示區塊的大小。Figure 3 is a flow diagram of an embodiment of displaying a motion image in a web browser in conjunction with the method of using the remote management system shown in Figure 2. As shown in FIG. 3, step 210 causes the web browser device to retrieve the web page from the remote management system and execute it in a web browser. Step 220 causes the JavaScript programming language executed in the web browser to send an HTTP request to the remote management system to request the remote management system to transmit the encoded data of the changed block and related information. In the preferred embodiment, the HTTP request in step 220 is implemented using the XMLHttpRequest object in AJAX technology, and the related information of the changed block may include values of coordinate values, height values, and width values of a set of changed blocks. In other embodiments, however, the HTTP request in step 220 can be implemented in other ways, such as to be compatible with older versions of the Internet Explorer web browser, such as ActiveXObject objects. In addition, it can also be implemented by using an IFrame component, which is not limited herein. The webpage display of the web browser is divided into a plurality of display blocks, and each display block corresponds to a comparison block group, that is, the size of the display block is greater than or equal to the size of the comparison block. The size of the display block can be switched during execution of the web browser. In a preferred embodiment, the size of the display block can be specified in the HTTP request in step 220.

步驟230使JavaScript程式語言根據自遠端管理裝置收到的編碼數據及其相關資訊來更新網頁瀏覽器中所顯示之影像。在本實施例中,係使用下列之回呼函式(callback function)來處理自遠端管理裝置收到之編碼數據及其相關資訊:Step 230 causes the JavaScript programming language to update the image displayed in the web browser based on the encoded data received from the remote management device and its associated information. In this embodiment, the following callback function is used to process the encoded data and related information received from the remote management device:

重複步驟220及230可以使得網路瀏覽器顯示相應於被控電腦輸出的動態影像訊號的動態影像。在本實施例中,係使用下列的函式來創建顯示區塊:Repeating steps 220 and 230 may cause the web browser to display a motion image corresponding to the motion image signal output by the controlled computer. In this embodiment, the following functions are used to create the display block:

在本實施例中,顯示區塊為16乘16大小的區塊;然而在其他實施例中,可視需求將顯示區塊分割為例如32乘32等不同大小。在較佳實施例中,JavaScript程式可以將來自網頁瀏覽設備的鍵盤或滑鼠等輸入裝置的”事件”發送至遠端管理系統。網頁瀏覽器的網頁顯示區分成數個顯示區塊,每個顯示區塊對應於網頁中的一個HTML影像標籤。此時為了使網頁瀏覽設備的使用者可以利用鍵盤或滑鼠等輸入裝置來對被控電腦進行控制,可以在每個影像標籤中設置相關的鍵盤或滑鼠事件處理程序,或在所有影像標籤─亦即網頁中的整個顯示區之上加一個透明的元件,並為該元件設置相關的鍵盤或滑鼠事件處理程序。In the present embodiment, the display block is a 16 by 16 size block; however, in other embodiments, the display block is divided into different sizes, such as 32 by 32, as desired. In a preferred embodiment, the JavaScript program can send an "event" from an input device such as a keyboard or mouse of the web browsing device to the remote management system. The webpage display of the web browser is divided into a plurality of display blocks, and each display block corresponds to an HTML image tag in the webpage. In this case, in order to enable the user of the web browsing device to control the controlled computer by using an input device such as a keyboard or a mouse, an associated keyboard or mouse event handler can be set in each image tag, or in all image tags. - Add a transparent component to the entire display area of the web page and set the relevant keyboard or mouse event handler for the component.

相較於先前技術,本發明除了能在不需要額外加裝外掛程式的前提下達到能在不同作業系統平台上的所有種類的網頁瀏覽器中顯示被控電腦所輸出的動態影像的目的以外,也由於本發明將靜態圖像和網頁瀏覽器的顯示區塊分割為較小的區塊,並利用AJAX技術可針對網頁中需要更新的部分進行局部更新的特點(僅更新有變化的顯示區塊),使得在網頁伺服器和網頁瀏覽器之間交換的資料量大幅減少,進而達到節省網路頻寬及減輕網頁伺服器負擔的效果。另外,由於所有同樣大小的編碼數據共用一個用來解碼的數據信頭,避免重複傳送相同的數據信頭,從而大大地節省資料量及頻寬。Compared with the prior art, the present invention can achieve the purpose of displaying the dynamic images output by the controlled computer in all kinds of web browsers on different operating system platforms, without the need to additionally install the plug-in program. Also, the present invention divides the static image and the display block of the web browser into smaller blocks, and utilizes AJAX technology to locally update the parts of the webpage that need to be updated (only the display blocks with changes are updated). ), the amount of data exchanged between the web server and the web browser is greatly reduced, thereby achieving the effect of saving network bandwidth and reducing the burden on the web server. In addition, since all the same size coded data share a data header for decoding, the same data header is not repeatedly transmitted, thereby greatly saving data amount and bandwidth.

本發明已由上述相關實施例加以描述,然而上述實施例僅為實施本發明的範例。必須指出的是,已揭露之實施例並未限制本發明的範圍。相反地,包含於申請專利範圍之精神及範圍之修改及均等設置均包含於本發明的範圍內。The present invention has been described by the above related embodiments, but the above embodiments are merely examples for implementing the present invention. It must be noted that the disclosed embodiments do not limit the scope of the invention. On the contrary, the modifications and equivalents of the spirit and scope of the invention are included in the scope of the invention.

1...遠端管理系統1. . . Remote management system

2...被控電腦2. . . Controlled computer

3...網路3. . . network

4...網頁瀏覽設備4. . . Web browsing device

5...網頁瀏覽器5. . . browser

6...網頁伺服器6. . . Web server

10...影像擷取模組10. . . Image capture module

20...處理/比較模組20. . . Processing/comparison module

30...影像編碼模組30. . . Image coding module

40...傳送模組40. . . Transfer module

41...網頁伺服器41. . . Web server

50...路徑安排模組50. . . Path scheduling module

BC ...比較區塊B C . . . Comparison block

BS...比較區塊組BS. . . Comparison block group

BS1 ...比較區塊組BS 1 . . . Comparison block group

BS2 ...比較區塊組BS 2 . . . Comparison block group

第1A圖係為本發明遠端管理系統之一實施例的方塊圖;1A is a block diagram of an embodiment of a remote management system of the present invention;

第1B圖係為第1A圖所示遠端管理系統的處理/比較模組將靜態圖像分割為區塊之一實施例的示意圖;1B is a schematic diagram of an embodiment of the processing/comparing module of the remote management system shown in FIG. 1A for dividing a still image into blocks;

第1C圖係為第1A圖所示遠端管理系統的影像編碼模組將相鄰的顯示區塊所對應的比較區塊合併編碼之一實施例的示意圖;1C is a schematic diagram of an embodiment in which the image coding module of the remote management system of FIG. 1A combines and encodes the comparison blocks corresponding to the adjacent display blocks;

第2圖係為第1A圖所示遠端管理系統的使用方法之一實施例的流程圖;以及2 is a flow chart of an embodiment of a method of using the remote management system shown in FIG. 1A;

第3圖係為配合第2圖所示遠端管理系統的使用方法於網頁瀏覽器中顯示動態影像的實施例的流程圖。Figure 3 is a flow diagram of an embodiment of displaying a motion image in a web browser in conjunction with the method of using the remote management system shown in Figure 2.

1...遠端管理系統1. . . Remote management system

2...被控電腦2. . . Controlled computer

3...網路3. . . network

4...網頁瀏覽設備4. . . Web browsing device

5...網頁瀏覽器5. . . browser

6...網頁伺服器6. . . Web server

10...影像擷取模組10. . . Image capture module

20...比較模組20. . . Comparison module

30...影像編碼模組30. . . Image coding module

40...傳送模組40. . . Transfer module

41...網頁伺服器41. . . Web server

50...路徑安排模組50. . . Path scheduling module

Claims (11)

一種遠端管理系統,可連接至至少一被控電腦,並可與一網頁瀏覽設備之一網頁瀏覽器(web browser)經由一網路產生互動,使該網頁瀏覽設備可經由該網路與該遠端管理系統進行通訊並進而控制該被控電腦,該遠端管理系統至少包含:一影像擷取模組,依據一採樣頻率將該被控電腦輸出之一影像訊號轉換為連續之複數張靜態圖像;一處理/比較模組,將每一該靜態圖像分割為複數個比較區塊,並比較前後兩張連續之該些靜態圖像之差異以從該些比較區塊中找出至少一變化區塊(changed block),其中該些比較區塊更分為複數個比較區塊組,每一該比較區塊組對應於該網頁瀏覽器之網頁顯示區中的一顯示區塊,且顯示區塊的大小係大於或等於比較區塊的大小;一影像編碼模組,將該變化區塊所屬的該比較區塊組中的所有該比較區塊之至少一像素值(pixel value)轉換為一筆編碼數據;以及一傳送模組,因應於該網頁瀏覽器之請求將該筆編碼數據經由該網路傳送至該網頁瀏覽設備,以使該網頁瀏覽器可依據該筆編碼數據更新該顯示區塊,進而顯示相應於該被控電腦輸出之該影像訊號之影像。A remote management system connectable to at least one controlled computer and interactable with a web browser of a web browsing device via a network, such that the web browsing device can communicate with the web browser The remote management system communicates and controls the controlled computer. The remote management system includes at least: an image capturing module that converts one of the output signals of the controlled computer output into a continuous plurality of static images according to a sampling frequency. An image processing/comparison module divides each of the still images into a plurality of comparison blocks, and compares the difference between the two consecutive consecutive static images to find at least the comparison blocks. a changed block, wherein the comparison blocks are further divided into a plurality of comparison block groups, each of the comparison block groups corresponding to a display block in a webpage display area of the web browser, and The size of the display block is greater than or equal to the size of the comparison block; an image coding module converts at least one pixel value of all the comparison blocks in the comparison block group to which the change block belongs a piece of encoded data; and a transmitting module, wherein the encoded data is transmitted to the web browsing device via the network in response to the request of the web browser, so that the web browser can update the display area according to the pen encoded data a block, which in turn displays an image corresponding to the image signal output by the controlled computer. 如專利申請範圍第1項所述之遠端管理系統,其中該網頁瀏覽設備係由個人電腦、個人數位助理及智慧型手機所組成之族群中所選出。The remote management system of claim 1, wherein the web browsing device is selected from the group consisting of a personal computer, a personal digital assistant, and a smart phone. 如申請專利範圍第1項所述之遠端管理系統,其中若相鄰的該些顯示區塊所對應之該些比較區塊組中皆包含該變化區塊,則該影像編碼模組將相鄰的該些顯示區塊對應的所有該些比較區塊轉換為該筆編碼數據,並產生相鄰的該些顯示區塊的至少一相關資訊,該傳送模組因應於該網頁瀏覽器之請求將該相關資訊傳送至該網頁瀏覽設備,其中該相關資訊包含該些顯示區塊之座標、長度及寬度。The remote management system of claim 1, wherein if the adjacent blocks corresponding to the display blocks comprise the changed block, the image coding module is All the compared blocks corresponding to the display blocks of the neighboring are converted into the pen-encoded data, and at least one related information of the adjacent display blocks is generated, and the transmitting module responds to the request of the web browser. Transmitting the related information to the web browsing device, wherein the related information includes coordinates, length and width of the display blocks. 如申請專利範圍第1項所述之遠端管理系統,其中更包含一網頁伺服器,若該變化區塊不存在,則該網頁伺服器不對該網頁瀏覽器之請求作回應,若該變化區塊存在,則該網頁伺服器因應於該網頁瀏覽器之請求將該筆編碼數據傳送至該網頁瀏覽器。The remote management system of claim 1, further comprising a web server, if the change block does not exist, the web server does not respond to the request of the web browser, if the change area If the block exists, the web server transmits the encoded data to the web browser in response to the request of the web browser. 如申請專利範圍第4項所述之遠端管理系統,其中該網頁伺服器因應於該網頁瀏覽器之請求將一共用數據信頭傳送至該網頁瀏覽器,使該網頁瀏覽器可依據該共用數據信頭對該筆編碼數據更新該網頁瀏覽器的該顯示區塊。The remote management system of claim 4, wherein the web server transmits a shared data header to the web browser in response to the request of the web browser, so that the web browser can be based on the sharing The data header updates the display block of the web browser for the pen encoded data. 一種遠端管理方法,用於一遠端管理系統中,該遠端管理系統可連接至至少一被控電腦,並可與一網頁瀏覽設備之一網頁瀏覽器經由一網路產生互動,使該網頁瀏覽設備可經由該網路與該遠端管理系統進行通訊並進而控制該被控電腦,該方法至少包含下列步驟:(a)將該被控電腦輸出之一影像訊號轉換為連續之複數張靜態圖像;(b)將每一該靜態圖像分割為複數個比較區塊,並比較前後兩張連續之該些靜態圖像之差異,以從該些比較區塊中找出至少一變化區塊,其中該些比較區塊更分為複數個比較區塊組,每一該比較區塊組對應於該網頁瀏覽器之網頁顯示區中的一顯示區塊,且顯示區塊的大小係大於或等於比較區塊的大小;以及若該變化區塊存在,則(c)將該變化區塊所屬的該比較區塊組中的所有該比較區塊之至少一像素值轉換為一筆編碼數據;以及(d)因應於該網頁瀏覽器之請求將該筆編碼數據經由該網路傳送至該網頁瀏覽設備,以使該網頁瀏覽器可依據該筆編碼數據更新該顯示區塊,進而顯示相應於該被控電腦輸出之該影像訊號之影像。A remote management method for a remote management system, the remote management system can be connected to at least one controlled computer, and can interact with a web browser of a web browsing device via a network to enable the remote management system to The web browsing device can communicate with the remote management system via the network and thereby control the controlled computer. The method includes at least the following steps: (a) converting one of the output signals of the controlled computer to a continuous plurality of sheets a static image; (b) dividing each of the still images into a plurality of comparison blocks, and comparing the difference between the two consecutive static images to find at least one change from the comparison blocks a block, wherein the comparison blocks are further divided into a plurality of comparison block groups, each of the comparison block groups corresponding to a display block in a webpage display area of the web browser, and the size of the display block is And greater than or equal to the size of the comparison block; and if the change block exists, (c) converting at least one pixel value of all the comparison blocks in the comparison block group to which the change block belongs to one piece of coded data ; and (d) The pen-coded data should be transmitted to the web browsing device via the network at the request of the web browser, so that the web browser can update the display block according to the pen-coded data, thereby displaying corresponding to the controlled computer. The image of the image signal outputted. 如申請專利範圍第6項所述之方法,其中該網頁瀏覽設備係由個人電腦、個人數位助理及智慧型手機所組成之族群中所選出。The method of claim 6, wherein the web browsing device is selected from the group consisting of a personal computer, a personal digital assistant, and a smart phone. 如申請專利範圍第6項所述之方法,其中步驟(c)更包含若相鄰的該些顯示區塊各自對應的該比較區塊中皆包含該變化區塊,則該影像編碼模組將相鄰的該些顯示區塊對應的所有該些比較區塊轉換為該筆編碼數據,並產生相鄰的該些顯示區塊的至少一相關資訊,步驟(d)更包含因應於該網頁瀏覽器之請求將該相關資訊傳送至該網頁瀏覽設備,其中該相關資訊包含該些顯示區塊的座標、長度及寬度。The method of claim 6, wherein the step (c) further comprises: if the adjacent blocks corresponding to the display blocks respectively comprise the change block, the image coding module All the comparison blocks corresponding to the adjacent display blocks are converted into the pen-encoded data, and at least one related information of the adjacent display blocks is generated, and step (d) further includes responding to the webpage browsing. The request of the device transmits the related information to the web browsing device, wherein the related information includes the coordinates, length and width of the display blocks. 如申請專利範圍第6項所述之方法,其中步驟(d)包含:(d1)若該變化區塊不存在,則不對該網頁瀏覽器之請求作回應;以及(d2)若該變化區塊存在,則因應於該網頁瀏覽器之請求將該筆編碼數據傳送至該網頁瀏覽器,以使該網頁瀏覽器可依據該筆編碼數據顯示相應於該被控電腦輸出之該影像訊號之影像。The method of claim 6, wherein the step (d) comprises: (d1) not responding to the request of the web browser if the changed block does not exist; and (d2) if the changed block If yes, the pen coded data is transmitted to the web browser according to the request of the web browser, so that the web browser can display the image corresponding to the image signal output by the controlled computer according to the pen code data. 如申請專利範圍第6項所述之方法,其中步驟(d)更包含因應於該網頁瀏覽器之請求將一共用數據信頭傳送至該網頁,使該網頁瀏覽器可依據該共用數據信頭對該筆編碼數據進行解碼,以更新該網頁瀏覽器之該顯示區塊。The method of claim 6, wherein the step (d) further comprises transmitting a shared data header to the webpage in response to the request of the web browser, so that the web browser can follow the shared data header. The pen encoded data is decoded to update the display block of the web browser. 如申請專利範圍第6項所述之方法,其中該筆編碼數據之格式係由JPEG、GIF、PNG及BMP所組成之族群中所選出。The method of claim 6, wherein the format of the encoded data is selected from the group consisting of JPEG, GIF, PNG, and BMP.
TW99133883A 2010-10-05 2010-10-05 Remote management system and the method thereof TWI427531B (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
TW99133883A TWI427531B (en) 2010-10-05 2010-10-05 Remote management system and the method thereof
CN2011103178835A CN102541268A (en) 2010-10-05 2011-10-09 Remote management system and method thereof
CN201710038491.2A CN107066106A (en) 2010-10-05 2011-10-09 Remote management system and method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW99133883A TWI427531B (en) 2010-10-05 2010-10-05 Remote management system and the method thereof

Publications (2)

Publication Number Publication Date
TW201216148A TW201216148A (en) 2012-04-16
TWI427531B true TWI427531B (en) 2014-02-21

Family

ID=46348306

Family Applications (1)

Application Number Title Priority Date Filing Date
TW99133883A TWI427531B (en) 2010-10-05 2010-10-05 Remote management system and the method thereof

Country Status (2)

Country Link
CN (2) CN107066106A (en)
TW (1) TWI427531B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103631548B (en) 2012-08-22 2019-01-08 慧荣科技股份有限公司 Image external device and the method for handling image external device
CN105100639B (en) * 2015-07-20 2017-11-24 京东方科技集团股份有限公司 A kind of display methods and display device
TWI726266B (en) * 2018-12-14 2021-05-01 聰泰科技開發股份有限公司 Remote control method

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200713127A (en) * 2005-09-30 2007-04-01 Aten Int Co Ltd Image transmission mechanism and method for implementing the same
EP2107537A1 (en) * 2008-04-04 2009-10-07 Hutchison Whampoa Three G IP (Bahamas) Limited Video surveillance and home security apparatus using the UMTS network and a method for the management of said apparatus

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FI98163C (en) * 1994-02-08 1997-04-25 Nokia Mobile Phones Ltd Coding system for parametric speech coding
CN100397385C (en) * 2002-08-22 2008-06-25 广达电脑股份有限公司 Method for remote controlling computer and its system
CN101164342B (en) * 2005-03-01 2011-03-02 高通股份有限公司 Region-of-interest coding in video telephony using rho domain bit allocation
US20080278508A1 (en) * 2007-05-11 2008-11-13 Swen Anderson Architecture and Method for Remote Platform Control Management
JP5493471B2 (en) * 2009-05-27 2014-05-14 ソニー株式会社 Information processing apparatus and method
CN101998154B (en) * 2009-08-28 2013-02-27 宏正自动科技股份有限公司 Multi-computer switcher for transmitting image signals to a plurality of far-end control computers and method thereof
CN101820416A (en) * 2010-02-24 2010-09-01 上海引跑信息科技有限公司 Processing method of high-speed shared desktop in netmeeting system

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200713127A (en) * 2005-09-30 2007-04-01 Aten Int Co Ltd Image transmission mechanism and method for implementing the same
EP2107537A1 (en) * 2008-04-04 2009-10-07 Hutchison Whampoa Three G IP (Bahamas) Limited Video surveillance and home security apparatus using the UMTS network and a method for the management of said apparatus

Also Published As

Publication number Publication date
CN107066106A (en) 2017-08-18
CN102541268A (en) 2012-07-04
TW201216148A (en) 2012-04-16

Similar Documents

Publication Publication Date Title
KR101367718B1 (en) Method and apparatus for providing mobile device interoperability
US9665332B2 (en) Display controller, screen transfer device, and screen transfer method
JP5451397B2 (en) An architecture for delivering video content in response to remote interaction
JP6145211B2 (en) Web-based keyboard, video and mouse (KVM) redirection system and method and application thereof
US20130254417A1 (en) System method device for streaming video
KR101644868B1 (en) Inter-terminal image sharing method, terminal device, and communications system
TWI401968B (en) Encoding method of screen frame and electronic apparatus applied therewith
TWI495330B (en) System and method for efficiently streaming digital video
WO2014113684A1 (en) System, apparatus and method for sharing a screen having multiple visual components
TWI427531B (en) Remote management system and the method thereof
KR20140093849A (en) Method and system for web screen streaming based on dom mutation event
WO2011077550A1 (en) Screen relay device
CN103186250A (en) Remote management system and remote management method
WO2016016607A1 (en) Managing display data for display
US20130294498A1 (en) Video encoding system, method and computer readable medium thereof
US20150186095A1 (en) Inter-terminal image sharing method, terminal device, and communications system
CN107318021B (en) Data processing method and system for remote display
US9411760B2 (en) System and method for a thin-client terminal system with a local screen buffer using a serial bus
US20150081770A1 (en) Relay device, relay method and thin client system
CN107318020B (en) Data processing method and system for remote display
GB2559550A (en) Method and system for remote controlling and viewing a computing device
CN113066139B (en) Picture processing method and device, storage medium and electronic equipment
TWI579707B (en) System and method of leveraging gpu resources to enhance performance of an interact-able content browsing service
CN117793156A (en) Remote control kvm roaming system and roaming method
JP6330179B2 (en) Multi-window display device, relay device, control method for multi-window display device, control method for relay device, and control method for information processing device

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees