TWI497400B - Method of auto-recognizing for cursor in monitors - Google Patents

Method of auto-recognizing for cursor in monitors Download PDF

Info

Publication number
TWI497400B
TWI497400B TW103120081A TW103120081A TWI497400B TW I497400 B TWI497400 B TW I497400B TW 103120081 A TW103120081 A TW 103120081A TW 103120081 A TW103120081 A TW 103120081A TW I497400 B TWI497400 B TW I497400B
Authority
TW
Taiwan
Prior art keywords
image
screen
upper edge
cursor
remote management
Prior art date
Application number
TW103120081A
Other languages
Chinese (zh)
Other versions
TW201546698A (en
Inventor
Yi-Li Liu
Yue Zhuo
Original Assignee
Aten Int Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Aten Int Co Ltd filed Critical Aten Int Co Ltd
Priority to TW103120081A priority Critical patent/TWI497400B/en
Application granted granted Critical
Publication of TWI497400B publication Critical patent/TWI497400B/en
Publication of TW201546698A publication Critical patent/TW201546698A/en

Links

Description

Method for automatically recognizing the cursor on the screen

The present invention relates to a method for automatically recognizing a screen on which a cursor is located; in particular, the present invention relates to a method for automatically recognizing a screen on which a cursor is located in a remote system for multiple screens.

The Keyboard-Video-Mouse Switch (KVM Switch) allows users to control multiple target computers with a single keyboard, screen and mouse. This set of keyboards, screens, and mice is connected to multiple target computers via a KVM switch. Through the KVM switch, the signal from the screen and the mouse can be transmitted to one of the selected target computers, and the target computer can also output images to the screen via the KVM switch. This saves space, energy and hardware costs. The KVM switch is suitable for data center, computer room, general personal and factory equipment.

In addition, please refer to the first A picture, a multi-computer switch 15 with a network interface can be called an IP-based KVM switch, which further makes a central control computer 30 (generally The user U of the desktop or laptop can manage a plurality of remotely controlled computers (or target computers) 20 through the network and view the images transmitted by the target computer via the network. This network type KVM switch is a set of keys that are directly connected to the target computer. The disc, the screen and the mouse are captured, and the screen outputted by the target computer is captured and transmitted back to the central control computer 30 via the network. For example, in this way, a user located in the A-zone can remotely manage the server located in the computer room through the network type KVM switch, as if the target computer is directly controlled in the B-ground. Moreover, the number of users of the network type KVM switch is usually more than one. Different users can control the same target computer 20 by the central control computer 30 located at different network locations.

As shown in the first B diagram, there is a problem that the network type KVM switch has a so-called "snap-synchronization", that is, the user of the central control computer 30 will be in its operation screen when operating the target computer ( On the actual screen, 40 sees the situation of two cursors chasing. Because the central control computer 30 itself will generate a cursor (hereinafter referred to as "the first cursor"), and the target computer will also generate another cursor (hereinafter referred to as "second cursor"), when the target computer screen (remote screen) 23 When being captured by the network type KVM switch and then transmitted back to the central control computer, the user will see the "first cursor" 31 and the "second cursor" simultaneously due to the superposition of the far end screen 23 and the near end screen 33. 21, and the two cursors are in different positions. Sometimes the "first cursor" 31 and the "second cursor" 21 may be far apart, because the user of the network type KVM switch is usually more than one, and different users can be located in different networks. The central control computer 30 of the position controls the same target computer 20 in succession. Therefore, for the current user, when switching to a certain target computer 20, the starting position of the "second cursor" 21 stays in the previous use. The last place to leave. That is, the current user cannot determine the starting position of the "second cursor" 21 before starting to operate the target computer 20. Therefore, if the problem of the so-called "snap-synchronization" is not solved, it will cause serious operational troubles to the current user, because the user will not know which cursor to position and click on the operation screen. .

As shown in Figure C, the network type KVM switch has to perform the so-called "snap-synchronization" process in order to solve the above problem of "smooth synchronization". Both the cursor "31" and the "second cursor" 21 are moved to the same position, for example, moved to the upper left corner of the screen (35, 25), and then the "first cursor" 31 is opened for use by the user. However, because the network type KVM switch is only a set of keyboards, screens, and mice for the target computer, the network type KVM switch cannot directly obtain the coordinates of the cursor or the like from the operating system of the target computer. And under the mouse coordinates of some operating systems, because the network type KVM switch does not know where the "second cursor" 21 falls on the screen at any time (including before synchronization), the network type The KVM switch does not know how much movement to give the mouse to move the "Second Cursor" 21 to the upper left corner of the screen. In order to ensure that the "second cursor" 21 can be moved to the upper left corner of the screen, the amount of movement given by the network type KVM switch to the "second cursor" 21 is actually the sum of the screen vertical resolution Yy and the horizontal resolution Yx. , that is, the vector sum of the maximum possible moving distances in the vertical direction and the horizontal direction. However, the current network type KVM switch only supports a single screen. In the architecture where the target computer supports multiple screens, the network type KVM switch does not know which screen the "second cursor" 21 falls on. The network type KVM switch does not know which position on the screen the "second cursor" 21 falls on, so it cannot effectively move the "first cursor" 31 and the "second cursor" 21 both. The same location on a certain screen, that is, the traditional network type KVM switch, cannot automatically perform the so-called "snap sync". Therefore, in order to support the multi-screen architecture of the target computer, it is necessary to propose an effective solution to the above problem of "smooth synchronization".

One of the objects of the present invention is to provide a method for automatically recognizing the cursor on the screen, so that the synchronization between the far-end cursor and the near-end cursor is more efficient.

In one embodiment, the present invention provides a method for automatically recognizing a screen in which a cursor is located in a remote management system supporting multiple screens, comprising the following steps: (A) providing a remote management The remote management system includes a first image input port and a second image input port, wherein the first image input port corresponds to a first screen and the The second image input port corresponds to a second screen; (B) the target computer can output a first image to the first image input port and output a second image to the second image input port, and a cursor is generated on a screen or the second screen; (C) the remote management device can be controlled by a central control computer via the network; (D) the remote management device respectively captures the output of the target computer The first image and the second image are respectively generated in a central control screen of the central control computer to generate a first thumbnail image and a second thumbnail image, wherein the first thumbnail image corresponds to the first image And the second thumbnail image corresponds to the second image; (E) generating a vertical movement amount according to a sum of a vertical resolution of the first image and a vertical resolution of the second image; (F) The end management device makes the cursor of the target computer according to the hanging The amount of movement moves to an upper edge region on the first screen or the second screen; (G) the remote management device respectively captures images of the first screen and the second screen in the upper edge region, Obtaining a first upper edge image and a second upper edge image; (H) moving the cursor horizontally in a first direction by the remote management device; (I) capturing the first screen at the An image of the upper edge region to obtain a third upper edge image; (J) performing image recognition on the first upper edge image and the third upper edge image to identify the third upper edge image relative to Whether there is a change in the first upper edge image.

In one embodiment, the present invention provides a method for automatically recognizing a screen in which a cursor is located in a remote management system supporting multiple screens, comprising the following steps: (A) providing a remote management system, the remote management system including at least a remote management device, the remote management device has a first image input port and a second image input port, wherein the first image input port corresponds to a first screen and the second image input port corresponds to a first a second screen; (B) causing a target computer to output a first image to the first image input port and output a second image to the second image input port, and generate the first image or the second screen a cursor; (C) enabling the remote management device to pass through the network The road is controlled by a central control computer; (D) the remote management device respectively captures the first image and the second image output by the target computer, and respectively generates a control screen in one of the central control computers a first thumbnail image and a second thumbnail image, wherein the first thumbnail image corresponds to the first image and the second thumbnail image corresponds to the second image; (E) according to the first image The sum of the horizontal resolution and the horizontal resolution of the second image generates a horizontal movement amount; (F) the remote management device causes the cursor of the target computer to be in the first screen or the second according to the horizontal movement amount Moving to an upper edge area on the screen; (G) respectively capturing images of the first screen and the second screen in the upper edge area by the remote management device to obtain a first upper edge image and a first a second upper edge image; (H) the remote management device moves the cursor vertically in a first direction by a distance; (I) capturing an image of the first screen in the upper edge region to obtain a third An upper edge image; (J) performing image recognition on the first upper edge image and the third upper edge image to The other third image with respect to the upper edge of the first upper edge of the image if there is a change.

In one embodiment, the present invention provides a method for automatically recognizing a screen in which a cursor is located in a remote management system supporting multiple screens, comprising the following steps: (A) providing a remote management system, the remote management system including at least a remote management device, the remote management device has a first image input port and a second image input port, wherein the first image input port corresponds to a first screen and the second image input port corresponds to a first a second screen; (B) causing a target computer to output a first image to the first image input port and output a second image to the second image input port, and generate the first image or the second screen a cursor; (C) the remote management device can be controlled by a central control computer via the network, so that the control of the central control computer is converted into control of the target computer; (D) the remote end The management device respectively captures the first image and the second image output by the target computer to generate a mapped image in one of the central control computers; (E) according to the resolution of the first image and the Resolution of the second image And generating a movement amount; (F.) To enable the remote management apparatus of the target computer according to the amount of movement of the cursor on the first screen or the second firefly The screen moves to an edge region; (G) the remote management device respectively captures images of the first screen and the second screen to obtain a first edge image and a second edge image; The remote management device moves the cursor horizontally in a first direction by a distance; (1) capturing an image of the first screen in the edge region to obtain a third edge image; (J) The first edge image and the third edge image perform image recognition to identify whether the third edge image has a change with respect to the first edge image. By the method for automatically recognizing the cursor on the screen of the present invention, the screen of the cursor can be known by image recognition, thereby improving the efficiency of the mouse synchronization.

100‧‧‧ Remote Management System

110‧‧‧Central computer

111-1‧‧‧ third screen

111-2‧‧‧ fourth screen

120‧‧‧Target computer

121-1‧‧‧ first screen

121-2‧‧‧ second screen

121-3‧‧‧ third screen

121-4‧‧‧ fourth screen

123‧‧‧Remote screen

125b-1‧‧‧ upper border

125b-2‧‧‧ lower boundary

125b-3‧‧‧left border

125b-4‧‧‧right border

125c-1‧‧‧Top left corner

125c-2‧‧‧Bottom left corner

125c-3‧‧‧top right corner

125c-4‧‧‧Bottom right corner

125u‧‧‧Upper border area

125d‧‧‧Bottom area

125l‧‧‧Left edge area

125r‧‧‧Right edge area

127‧‧‧ cursor

200‧‧‧ Remote management device

210‧‧‧Computer interface

210a‧‧‧Computer Connection埠

220‧‧‧Internet interface

250‧‧‧Image Processing Module

260‧‧‧Central Processing Unit

500‧‧‧Computer Interface Module

510‧‧‧First RS-485 Transceiver

520‧‧‧Second RS-485 transceiver

530‧‧‧Differential drive

540‧‧‧Differential Receiver

600‧‧‧Category

Dx1‧‧‧first horizontal direction

The first A is a schematic diagram of a remote management system having a multi-screen display device; the first B is a schematic diagram of the mouse being out of sync; the first C is a schematic diagram for solving the unsynchronized mouse; FIG. 2 is a schematic diagram of an embodiment of a remote management system having a multi-screen display device according to the present invention; FIG. 2B and FIG. 2C are schematic diagrams showing another embodiment of a remote management system having a multi-screen display device according to the present invention; A-1 to the third A-2 are flowcharts of an embodiment of automatically displaying the cursor on the screen; and the third A-3 to the third A-4 are flowcharts of another embodiment of automatically recognizing the cursor on the screen; FIG. 3B is a schematic diagram of an embodiment of moving a cursor to an edge region; FIG. 3C is a schematic diagram of an embodiment of moving a cursor to an edge region and moving along a first horizontal direction; and the third diagram is for moving a cursor to an edge under a multi-screen system; Schematic diagram of an embodiment of the area; the third to third G diagrams are schematic diagrams of different embodiments for moving the cursor to the edge region under the multi-screen system; the third H-1 to the third H-2 diagram are screens for automatically recognizing the cursor A flow chart of another embodiment.

The invention discloses a remote management system supporting multiple screens. The remote management system includes at least one remote management device. This remote management system enables a central control computer to control a target computer through the network. In a preferred embodiment, the remote management device can be a network type KVM switch, and the network type KVM switch can manage one or more target computers. The remote management device can simulate two or more screens on the same target computer, so that the same target computer can output two or more video signals to the remote management device. Because the remote management system of the present invention supports multiple screens, the remote management system of the present invention can map the image outputted by one target computer to multiple screens to the central control computer at the other end of the network, that is, in the middle control A mapped image is produced on one or more screens of the computer.

The plurality of virtual screens are mainly corresponding to the memory or other buffer storage device of the remote management device for capturing the image signal output by the target computer. And the plurality of virtual screens correspond to one or more screens of the central control computer. For example, when the remote management device is simulated into two screens, the two virtual screens can correspond to a single screen of the central control computer, or Corresponding to two different screens. In addition, in order to perform "mouse synchronization" or other functions, the present invention first finds the screen and location of the target computer cursor. For example, assuming that the remote management system of the present invention can simulate a first screen and a second screen, the remote management system of the present invention can recognize whether the cursor of the target computer falls on the first screen or the second screen. If it is assumed that the cursor is on the first screen, the present invention can recognize the specific position where the cursor falls on the first screen.

Referring to FIG. 2A, the present invention provides a remote management system 100. The remote management system 100 of the present invention includes at least one remote management device 200. One end of the remote management device 200 is coupled to a central control computer 110 via a network, and the other end of the remote management device 200 is It is coupled to a target computer 120 via a suitable interface. In this way, the remote management device 200 as a bridge enables the central control computer 110 to control the target computer 120 via the network, that is, the target computer 120 reacts to the operation command from the central control computer 110. The central control computer 110 has one or more sets of screen and cursor control devices, such as a keyboard and a mouse. In addition, the remote management device 200 can be simulated as one or more sets of screens, keyboards, and mice, or other devices (as shown by the dashed box in FIG. 2A, the remote management device 200 is simulated as a keyboard, a mouse, and has The first screen 121-1 and the second screen 121-2 have multiple screen systems). When a plurality of sets of screens are simulated, the target computer 120 outputs a plurality of sets of image signals to the remote management apparatus 200, and receives a set of keyboard and mouse signals. In addition, one or more sets of screens, keyboards and mice of the central control computer 110 are mapped to one or more sets of screens, keyboards and mice simulated by the remote management device 200 (for example, the third screen of the central control computer 110) 111-1 and the fourth screen 111-2 respectively correspond to the first screen 121-1 and the second screen 121-2) simulated by the remote management device 200. Therefore, via the remote management system 100, the user's operations on the keyboard and mouse are converted to operations on the target computer 120. It should be noted that the number of screens used by the central control computer 110 may be the same as or different from the number of screens simulated by the remote management device 200. The number of screens used by the central control computer 110 can be a single physical screen or the same number as the virtual screen.

Referring to FIG. 2B, the remote management device 200 has a computer interface 210, a network interface 220, and an image processing module 250. The computer interface 210 is used to connect at least one target computer 120. The network interface 220 Then, the network is coupled to a central control computer 110, so that the central control computer 110 and the remote management device 200 can communicate according to an appropriate network communication protocol (for example, a TCP/IP protocol group) to exchange data. The image processing module 250 is mainly used to capture image signals (analog or digits) output by the target computer 120, and perform subsequent image processing. In the image processing process, the steps of color depth adjustment, image coordinate conversion, image compression and encoding may be included. The image processing module 250 may also include restoring the differential image signal to Single-ended video signal, and the function of converting the original video signal into digital image data according to the above steps.

In a preferred embodiment, the computer interface 210 of the remote management device 200 has one or more computer ports 210a connectable to the target computer 120. In a preferred embodiment, each computer port 210a of the remote management device 200 further has an image input port and a keyboard/mouse output port. The image input port is used to connect the image output port of the target computer 120; the keyboard/mouse output port is used to connect the keyboard/mouse input port of the target computer 120. This keyboard/mouse input 埠 or keyboard/mouse output 埠 can be a USB interface, PS/2 interface or any other suitable interface. Moreover, for the remote management device 200, the image input port and the keyboard/mouse output port of each computer port 210a can be integrated into a single connector.

Still referring to FIG. 2B, in another preferred embodiment, the computer port 210a of the computer interface 210 is not directly connected to a target computer via a computer interface module (CIM). 500 is coupled to another target computer 120. In this case, the computer interface 210a of the computer interface 210 has at least one RJ-45 connector, so that the computer interface can pass through the RJ-45 of the CAT-5 Cable 600 and the computer interface module. Connector connection. That is, one end of the five types of cable is connected to the RJ-45 connector of the computer interface, and the other end is connected to the RJ-45 connector of the computer interface module 500. The functions of the computer interface module 500 include an analog keyboard, a screen and a mouse, and processing of the image signal to extend the distance that the image signal can be transmitted. In order to simulate a keyboard and a mouse, the computer interface module 500 has a controller that can communicate according to a keyboard and a mouse-related protocol, such as a USB device controller or a PS/2 controller. To simulate the screen, the computer interface module 500 has a memory for storing EDID, such as an EEPROM.

Referring to FIG. 2C, the computer interface module 500 is used to extend the distance between the remote management device 200 and the target computer 120, for example, up to 1000 inches. This computer The face module 500 has a first RS-485 transceiver (Transceiver) 510 and a differential driver 530. Correspondingly, the computer interface 210 at the end of the remote management device 200 has a second RS-485 transceiver (Transceiver) 520 and a differential receiver 540. The first RS-485 transceiver 510 is configured to receive control signals and data from the remote management device 200, such as a keyboard/mouse signal, according to the RS-485 protocol. The differential driver 530 is configured to convert the single-ended video signals (such as RGB signals and accompanying synchronization signals) output by the target computer 120 into three sets of differential video signals for use by the Category 5 line 600 (or other similar cable). The three pairs of twisted pairs are transmitted to the remote management device 200.

In addition, the differential receiver 540 corresponds to the differential driver 530 for receiving the three sets of differential video signals from the target computer 120 and restoring them to the original single-ended video signal. The second RS-485 transceiver 520 of the computer interface 210 corresponds to the first RS-485 transceiver 510 of the computer interface module 500 for exchanging data with the computer interface module 500 according to the RS-485 protocol, so as to be centrally controlled. The keyboard/mouse signal of the computer 100 is transmitted to the target computer 120. The computer interface module 500 can also be referred to as an adapter (Adapter), a server interface module (SIM), or a computer access module (CAM).

Still referring to FIG. 2C, the remote management device 200 further includes a central processing unit 260, and the second RS-485 transceiver 520 and a differential driver 540 can be part of the aforementioned computer interface 210. The function of the central processing unit 260 includes at least coupling the image processing module 250 to the network interface 220 and coupling the network interface 220 to the second RS-485 transceiver 520. The central processing unit 260 is mainly used to package the digital image data from the image processing module 250 into a network packet and parse the network packet from the central control computer 110 about the keyboard or the mouse, and then the relevant keyboard or The mouse's operational message is transmitted to the corresponding first RS-485 transceiver 510 via the second RS-485 transceiver 520. The central processing unit 260 can also serve as the upper layer of the related network protocol involved in network communication by the network interface 220. If the OSI model is taken as an example, when When the network interface 220 is used as a physical layer and a data link layer, the central processing unit 260 can serve as a network layer, a transport layer, a conference layer, a presentation layer, and an application layer. If the DoD model is used as an example, when the network interface 220 is used as a link layer, the central processing unit 260 can serve as a network layer, a transport layer, and an application layer. The above functions of the central processing unit 260 can be implemented by a controller, an application specific integrated circuit (ASIC) or an FPGA.

When the user of the central control computer 110 operates the target computer 120 via the keyboard/mouse or other control device at the end of the central control computer, the central control computer 110 will control the control signal output by the keyboard/mouse according to the appropriate network. The communication protocol is converted to a network packet for transmission to the remote management device 200 via the network. Moreover, the remote management device 200 can receive the network packet sent by the central control computer 100 via its network interface 220, and then parse the control signal contained in the network packet into a standard format readable by the target computer. For example, a standard USB signal or a PS/2 signal is as if it were directly sent to the target computer 120 by the keyboard/mouse of the central control computer 110. That is, the remote management device 200 can restore the network packet sent by the central control computer 110 to the original control signal and output it to the target computer 120 to further control the target computer 120.

On the other hand, the image signal (for example, VGA signal) output by the target computer 120 in response to the control signal of the central control computer 110 is captured by the image processing module 250 into a plurality of consecutive image frames, and then The image is processed and converted into a network packet, and the network packet is transmitted back to the central control computer 110 via the network and according to an appropriate network communication protocol. This capture may include the process of converting the analog image signal into digital image data. For example, the RGB components in the analog signal are respectively converted into pixel values (Pixel Value) of 0 to 255, and then stored in the memory in binary form. And the above image processing process may also include the steps of image compression or encoding, which is performed before converting the image frame into a network packet.

In addition, in more detail, the image processing module 250 divides the image frame into multiple blocks, and compares all the blocks of the two consecutive image frames before and after to determine which blocks have changed. Which blocks have not changed. In order to reduce the amount of data transmitted over the network, the data of the changed blocks in the image frame will be image compressed and converted into network packets. It should be noted that although only one target computer 120 is shown in the second C diagram, the image processing module 250 may actually include multiple image processing channels, so that multiple channels from different or identical target computers can be processed at one time. Image signal. Moreover, there may be a switching module (not shown) between the computer interface 210 and the image processing module 250, so that one or more target computers among the plurality of target computers can simultaneously perform the above image processing. This switching module may be an architecture composed of a plurality of matrix switching circuits.

When the central control computer 110 restores the network packet received with the image data to an appropriate video signal (which may be the same or different from the source video signal format), the user of the central control computer 110 can be connected to one end of the network. The image output by the target computer 120 is seen, and then the target computer 120 is controlled as if the target computer 120 is directly controlled. This restoration may involve the process of converting digital signals into analog signals and image decompression or decoding.

The invention discloses a method for automatically recognizing a screen where a cursor is located in a remote management system supporting multiple screens, and the application of the multi-screen may include an extended desktop function. This cursor refers to the cursor generated by the target computer (the second cursor described above), which is not the cursor generated by the central control computer (the first cursor described above). The second cursor is also displayed on the screen of the central control computer because the remote management device performs image capture on the target computer. The number of screens in the present invention is not limited, but for convenience of explanation, only two screens will be described below as an example.

Referring to the third A-1 diagram and the third A-2 diagram, the method of the present invention includes at least steps 301 to 312. Step 301 provides a remote management system that allows a target computer to be controlled by a central control computer via the network. The remote management system includes at least one remote management device and a program (generally called a Viewer) executed on the central control computer, which is mainly used for restoring and reorganizing the image related data network packet. The way, the central control computer can display the image corresponding to the target computer on its screen. In more detail, the central control computer and the remote management device are coupled to each other via a network; the remote management device and the target computer are coupled to each other by a non-network network. The remote management device can simulate one or more sets of keyboards, mice, and screens, and the remote management device further provides a network interface to the target computer as a network communication between the target computer and the central control computer. The interface enables the target computer and the central control computer to exchange image and keyboard/mouse related data via the network. That is, the target computer can output an image signal to the central control computer via the remote management system, and the central control computer can output keyboard/mouse related commands to the target computer via the remote management system. However, the remote management device is not connected to the network port of the target computer, but is connected to the image output port of the target computer and the keyboard/mouse input port. That is, the target computer does not exchange image and keyboard/mouse related data with the central control computer through its own network interface card.

In more detail, the remote management device has a first image input port and a second image input port, and the remote management device is simulated as a first screen and a second screen, wherein the first image input port is configured. Corresponding to the first screen and the second image input 埠 corresponds to the second screen. The first image input port and the second image input port correspond to the image processing module, and the main structure of the remote management device is as described in the foregoing second to second C charts. Said.

Step 302 is to connect the remote management device to a target computer, so that the target computer can output a first image to the first image input port and output a second image to the second image input port. The first image has a first resolution and the second image has a second resolution. The first resolution further includes a first vertical resolution and a first horizontal resolution; the second resolution further includes a second vertical resolution and a second horizontal resolution. In more detail, the remote management device converts the first image into a first image data and converts the second image into a second image data according to the foregoing description, and stores the image in the associated memory.

In addition, the target computer generates a cursor on the first screen or the second screen. In the extended desktop application, the cursor can move between the first screen and the second screen, that is, the cursor can be Passing through the boundary of the first screen and then entering the second screen; or, the cursor can pass through the boundary of the second screen and then enter the first screen. In the extended desktop application, one of the first screen and the second screen is a primary screen, and the other is a secondary screen. When using the extended desktop, the user can open an application on the main screen and drag the window representing the application to the secondary screen. When the target computer is turned on next time, the application window will be directly Appears on the secondary screen.

In more detail, step 302 is to connect the first image output of the target computer to the first image input port of the remote management device, and connect the second image output of the target computer to another cable. The second image input port to the remote management device. And this step may further include connecting the keyboard/mouse output of the remote management device to the keyboard/mouse input port of the target computer by cable. In order to extend the distance, the computer interface module may be provided between the remote management device and the target computer, and the target computer is coupled to the remote management device through two different computer interface modules. In actual use, in order to enable the remote management device to distinguish that the plurality of images received by the remote control device are from the same target computer or from different target computers, and different image sources and central control computer-side physical screens (in the central control) The corresponding relationship of the screen, the user may have to set the remote management device to some extent.

Step 303 is to enable the remote management device to be controlled by the central control computer via the network. The user of the central control computer can perform setting and subsequent operations on the remote management device via an operation interface provided by a web browser, and the setting may include setting image quality; the operation includes selecting a target computer and being different. Switch between the target computers. In addition, after selecting a target computer, in addition to the image corresponding to the target computer on the screen of the central control computer, the user of the central control computer will be remotely operated by the keyboard/mouse of the central control computer. End management system Convert to operation on the target computer.

Please refer to the third A-3 diagram and the third A-4 diagram. In more detail, the step 303 further includes step 303-1 to step 303-3. Step 303-1 is to open a web browser (Web Brower) on the central control computer; step 303-2 is to input a network address of the remote management device via the web browser to display a login screen; step 303- 3 is to log in to the remote management device via the login screen to perform subsequent operations on the remote management device. For example, the remote management device is configured (Configuration). When the remote management device is connected to multiple target computers, the user of the central control computer can select one of the target computers for subsequent operation via an appropriate human-machine interface. The human interface contains an on-screen display menu (OSD) formed by a web browser. This screen display menu may list multiple 埠 numbers and 埠 names representing different target computers for selection, and this screen display menu may also The status of these target computers will be displayed, such as On-Line or Off-Line, where the offline status indicates that the target computer is not turned on.

In addition, the central control computer is connected to one of the third screen and the fourth screen of the entity, wherein the third screen corresponds to the first image input port of the remote management device, and the fourth screen corresponds to the remote management. The second image input of the device is 埠. That is, the third screen corresponds to the first screen; the fourth screen corresponds to the second screen. The above correspondence can be specifically realized through the setting of the foregoing (step 302). The following mainly describes such an architecture (multiple virtual screens for multiple physical screens), but in another preferred embodiment, the central control computer can be connected only to a single physical screen (multiple virtual screen pairs) A physical screen). That is, the first image corresponding to the first screen and the second image corresponding to the second screen can be presented on the same physical screen (the central control screen) in a thumbnail or overlapping manner through the remote management system. That is, the remote management system of the present invention can map a plurality of screen output images of a target computer to a central control computer at the other end of the network to generate a mapped image on one or more screens of the central control computer. .

Step 304: the remote management device respectively captures the output of the target computer The first image and the second image are used to store pixel values (Pixel Values) corresponding to the images in the associated memory or other buffer storage device, thereby establishing a continuous image frame. After proper image processing, compression or encoding, the remote management device can transmit the relevant image data of the captured image of the target computer to the central control computer through the network, and then on the third screen and the fourth screen ( Or on a single physical screen). Therefore, the user feels as if the target computer is directly operated.

Please refer to the third A-1 diagram, the third D diagram, and the third E diagram. Step 305 is to generate a vertical movement amount Y according to the sum of the vertical resolution of the first image and the vertical resolution of the second image. This vertical movement amount Y will be the maximum actual moving distance of the cursor in the vertical direction of the first screen and the second screen. That is, if the vertical resolution of the first image is Y1; the vertical resolution of the second image is Y2, the vertical movement amount Y is equal to Y1+Y2. Also, if the number of screens is set to four in this remote management system, the vertical movement amount Y will be Y1+Y2+Y3+Y4. That is, the vertical movement amount Y is equal to Y1+Y2+Y3+...+YN, where N is the number of multi-channel images output by the target computer, that is, the image input provided by the remote management device for the same target computer. The number of ports, that is, the number of screens that the remote management device simulates for the same target computer. Alternatively, in another preferred embodiment, a horizontal movement amount X may be generated based on the sum of the horizontal resolutions of the input images of all the analog screens. That is, X is equal to X1+X2+X3+...+XN. This horizontal movement amount X will be the maximum actual movement amount possible for the cursor in the horizontal direction.

Step 306 is that the remote management device moves the cursor of the target computer to an "upper edge region" or a "lower edge region" on the first screen or the second screen according to the vertical movement amount. In more detail, because the remote management device simulates the target computer as a mouse and other devices in the present invention, the remote management device can actively issue a cursor movement instruction to the target computer, and the cursor movement instruction Content contains this amount of movement, making the target computer cursor According to the vertical movement amount, it moves to a "upper edge area" or a "lower edge area" on a certain screen. The target computer's operating system will change the image according to the cursor movement command (the content of the display memory of the display card will be updated), and then reflect the first or the output of the target computer to the remote management device. The second image signal. Also, regardless of which screen the cursor falls on at the beginning (before the mouse sync), the vertical or horizontal movement amount ensures that the cursor will be moved and stay in the "edge area" of one of the screens.

As shown in the third B diagram, the remote management device generates a cursor 127 in the screen (remote screen) 123 output from the target computer, and moves the cursor 127 to the edge region in accordance with the vertical or horizontal movement amount. In the present invention, the "edge region" may include four regions such as "upper edge region" 125u, "lower edge region" 125d, "right edge region" 125r, and "left edge region" 125l. Taking the vertical direction as an example, since the actual movable distance of the cursor 127 on the screen cannot be greater than the vertical movement amount, moving the cursor 127 according to the vertical movement amount can ensure that the cursor 127 is moved to and stays on a certain screen. "Upper edge area" 125u or "Lower edge area" 125d. Similarly, if the cursor 127 is moved according to the horizontal movement amount, it will be ensured that the cursor 127 will be moved and stay in the "right edge region" 125r or the "left edge region" 125l of one of the screens. The third B diagram also shows the upper left corner 125c-1, the lower left corner 125-2, the upper right corner 125c-3, the lower right corner 125c-4, the upper boundary 125b-1, the lower boundary 125b-2, the left boundary 125b-3, and Right border 125b-4.

Please refer to the third to third G drawings, which illustrate the vertical or horizontal level calculated according to the above description, regardless of the number of multiple screens and the relative positions of each other in the present invention. The amount of movement ensures that the cursor will be moved and stay in the "edge area" of one of the screens.

Taking the third D picture as an example, if the second screen 121-2 is superimposed on the first screen 121-1, and the first cursor 127 falls on the first screen 121-1, according to the above vertical movement amount, The cursor 127 can be moved from the first screen 121-1 to the second screen 121-2 by Y=Y1+Y2. The edge area is 125u. Taking the third E diagram as an example, if the first screen 121-1 and the second screen 121-2 are in a side-by-side relationship, and the first cursor 127 is on the first screen 121-1, according to the above The amount of vertical movement will move the cursor 127 from the first screen 121-1 to its "upper edge region" 125u with Y = Y1 + Y2. Although the amount of movement is large Y is the distance that the cursor can actually move (less than Y1+Y2), the cursor still stays at the "upper edge region" 125u of the first screen 121-1.

Taking the third F picture as an example, if the remote management system supports four screens, respectively, the first screen 121-1, the second screen 121-2, the third screen 121-3, and the fourth screen 121-4, and The relative positions of the four screens are approximately in a matrix shape as shown. Assuming that the cursor 127 is initially on the fourth screen 121-4, the cursor 127 can be moved from the fourth screen 121-4 to the third screen 121 by Y=Y1+Y2+Y3+Y4 according to the vertical movement amount described above. -3 "Upper edge area" 125u. Although the amount of movement is large Y is the distance that the cursor can actually move (less than Y3+Y4), the cursor still stays at the "upper edge region" 125u of the first screen 121-3.

Taking the third G picture as an example, if the remote management system supports four screens, respectively, the first screen 121-1, the second screen 121-2, the third screen 121-3, and the fourth screen 121-4, And the relative positions of the four screens are shown as an irregular arrangement as shown. Assuming that the cursor 127 is initially on the first screen 121-1, the cursor 127 can be moved from the first screen 121-1 to the third screen 121 by Y=Y1+Y2+Y3+Y4 according to the vertical movement amount described above. -3 "Upper edge area" 125u. Although the amount of movement is large Y is the distance that the cursor can actually move (less than Y1+Y2+Y3), the cursor still stays at the "upper edge region" 125u of the third screen 121-3.

On the other hand, since the aspect ratio of the general screen is narrow in the vertical direction and wide in the horizontal direction, the moving distance of the cursor in the vertical direction is usually smaller than the moving distance in the horizontal direction, and the moving in the vertical direction is better. Mobile efficiency. In addition, since in some operating systems, the cursor is hidden or partially hidden after moving to the lower or right boundary of the screen, the present invention is based on the vertical direction and the "upper edge region" as a preferred embodiment. It is to be understood that those skilled in the art will recognize that the invention is not intended to be limited thereto. For an operating system that does not hide the cursor at the lower or right boundary of the screen, the present invention can also move the cursor to the "lower edge region" in the vertical direction in the process of identifying the cursor on the screen; You can move the cursor to the "Right Edge Area" or "Left Edge Area".

Please refer to the third A-1 diagram and the third C diagram at the same time. Step 307 is to capture images of the first screen and the second screen in the "upper edge region" to obtain a first upper edge image. And a second upper edge image. In other words, the remote management device respectively captures the full screen image of the first screen and the second screen, but the remote management device only corresponds to the image data of the “upper edge region” of the first screen and the second screen. Perform subsequent image comparison analysis (image recognition). The width of the "upper edge region" or the "lower edge region" is the horizontal resolution of the first screen relative to the first image, or the horizontal resolution of the second screen relative to the second image, and "on" The height of the edge region or the lower edge region is at least the height of the cursor. In general, the height and width of a cursor is about 32 pixels multiplied by 32 pixels, but in fact the appearance and size of the cursor can be changed through the setting of the operating system, so the present invention is merely illustrative here, not intended This is limited to this. Because the resolution of the first image may be the same or different from the resolution of the second image, the "upper edge region" or "lower edge region" of the first screen and the "upper edge region" or "lower edge" of the second screen Areas may also be the same or different in size.

Please refer to the third A-1 diagram and the third C diagram at the same time. Step 308 is to move the cursor 127 in the "upper edge region" by a distance along a first horizontal direction dx1. The first horizontal direction may be right or left, and the distance is preferably about one cursor width, for example 32 pixels.

Please refer to the third A-1 diagram. Step 309 is to capture the image of the first screen in the "upper edge region" to obtain a third upper edge image. In other words, the remote management device captures the full screen image of the first screen, but the remote management device performs subsequent image comparison analysis (image recognition) only on the image data corresponding to the “upper edge region” of the first screen. . Step 310 is to The first upper edge image and the third upper edge image perform image recognition to identify whether the third upper edge image has a change with respect to the first upper edge image. If it is determined in step 310 that there is a change, it may be determined that the cursor is on the first screen; if it is determined in step 310 that there is no change, it may be determined that the cursor does not fall on the first screen or has other kinds Happening.

Please refer to the third A-2 picture, because in fact, the remote management system does not know whether the cursor is on the first screen or the second screen. Therefore, this step first tries to observe one of the screens (for example, the first screen). Is there a change in the image after step 309? If the observed screen has a change in image, because the change is due to the movement of the cursor, it can be determined that the first screen responds to the cursor movement instruction described above, so step 310 can determine that the cursor is in the first On the screen. If there is no change in the image, it can be judged that the cursor does not fall on the first screen, or the cursor is on the first screen but the image is not changed for other reasons (the cause and response of the situation) The method will be detailed later).

If it is determined in step 310 that there is no change in the images captured twice before and after the first screen, then steps 311 and 312 are performed. Step 311 is to capture an image of the second screen in the "upper edge region" to obtain a fourth upper edge image. Since it has been determined in step 310 that the first screen does not respond to the cursor movement command, the chance of the cursor falling on the second screen is quite large. The manner of extracting the fourth upper edge image from the second screen is the same as the manner of capturing the image of the first screen, and will not be further described herein. Step 312: performing image recognition on the second upper edge image and the fourth upper edge image to determine whether the fourth upper edge image changes with respect to the second upper edge image.

Please refer to the third A-2 diagram and the third diagram B. If it is determined in step 312 that the fourth upper edge image is changed relative to the second upper edge image, it may be determined that the cursor is in the first On the second screen; if both screens are judged to be unchanged in steps 310 and 312, it can be determined that the cursor falls on a corner of the first screen or the second screen (but does not include the upper left corner) 125c-1). That is, after the step 306, the cursor 127 may be moved to the upper screen 125c-3, the lower right corner 125c-4 or the lower left corner 125c-2 of the first screen or the second screen to be hidden by the operating system. The first screen or the second screen does not produce a visual response to step 308. Therefore, in steps 310 and 312, the first or second screen has no change in the two images.

Please refer to the third H-1 diagram and the third H-2 diagram. If any of the above situations are encountered, perform the following steps. First, step 308-1 is performed. Step 308-1 is similar to step 308, but step 308-1 moves the cursor in the "upper edge region" by a distance in a second horizontal direction, and the second horizontal direction is opposite to the first horizontal direction. That is, if step 308 moves the cursor to the right, step 308-1 moves the cursor to the left. Next, step 309-1 and step 310-1 are performed. Step 309-1 is similar to step 309. Step 309-1 captures the image of the first screen in the "upper edge region" to obtain a fifth upper edge image; step 310-1 is similar to step 310. 310-1 performs image recognition on the first upper edge image and the fifth upper edge image to determine whether the fifth upper edge image changes with respect to the first upper edge image.

If it is determined in step 310-1 that there is a change, it may be determined that the cursor is on the first screen; if it is determined in step 310-1 that there is no change, it may be determined that the cursor does not fall on the first screen. That is, the cursor is on the second screen.

Based on the foregoing description, the present invention will recognize whether the cursor generated by the target computer falls on the first screen or the second screen and the position of the cursor on the screen on which it is located before performing the mouse synchronization. Since the present invention can also recognize the position of the cursor on its screen, the present invention will no longer need to give the target computer a maximum value on the diagonal of the screen resolution as in the prior art to ensure that the cursor will move to In the upper left corner of the screen, the present invention will move the cursor of the target computer (the second cursor) to the cursor of the central computer (the first cursor) according to the relative position of the multiple screens to give the target computer an appropriate amount of movement. Location so that The mouse is synchronized, and the position of the cursor of the central control computer is usually not the upper left corner of the screen. Alternatively, the present invention can also move the cursor of the central control computer (the first cursor is moved) to the position of the cursor (second cursor) of the target computer at that time. After the mouse is synchronized, the remote management system releases the right to use the cursor control device to the user of the central control computer, and the user of the central control computer can accurately manipulate the cursor generated by the target computer.

It should be noted that the remote management device of the present invention can also physically connect a group of central control devices, such as a set of screens, keyboards and mice, in a non-network manner. The group control device may be referred to as a near-end central control device of the remote management device; the screen may be referred to as a near-end screen of the remote management device, and the user may also use the remote management device to The target computer operates. According to the above description, the cursor movement of the target computer or the change of the image generated by the central control computer for the operation of the target computer is also displayed on the near-end screen (for example, the process of moving the cursor to the edge region). But this change may be difficult or undetectable because of the speed of the relationship.

Although the technical content of the present invention has been disclosed in the above preferred embodiments, it is not intended to limit the present invention, and any modifications and refinements made by those skilled in the art without departing from the spirit of the present invention are encompassed by the present invention. The scope of protection of the present invention is therefore defined by the scope of the appended claims.

Claims (17)

  1. A method for automatically recognizing a screen in which a cursor is located in a remote management system supporting multiple screens includes at least the following steps: (A) providing a remote management system, the remote management system including at least one remote management device, the remote The end management device has a first image input port and a second image input port, wherein the first image input port corresponds to a first screen and the second image input port corresponds to a second screen; (B) The target computer can output a first image to the first image input port and output a second image to the second image input port, and generate a cursor on the first screen or the second screen; (C) The remote management device can be controlled by a central control computer via the network; (D) the remote management device respectively captures the first image and the second image output by the target computer, and respectively controls the central image The first control image of the computer generates a first thumbnail image and a second thumbnail image, wherein the first thumbnail image corresponds to the first image and the second thumbnail image corresponds to the second image; According to the vertical resolution of the first image And summing the vertical resolution of the second image to generate a vertical movement amount; (F) causing the cursor of the target computer to move on the first screen or the second screen according to the vertical movement amount by the remote management device Up to an upper edge region; (G) capturing, by the remote management device, images of the first screen and the second screen in the upper edge region to obtain a first upper edge image and a second upper edge (H) moving the cursor horizontally in a first direction by the remote management device; (I) capturing an image of the first screen in the upper edge region to obtain a third upper edge image (J) performing image recognition on the first upper edge image and the third upper edge image to identify whether the third upper edge image changes with respect to the first upper edge image.
  2. The method of claim 1, wherein if the step (J) recognizes that the third upper edge image changes relative to the first upper edge image, determining that the cursor is in the first On the screen.
  3. The method of claim 1, wherein if the step (J) recognizes that the third upper edge image does not change relative to the first upper edge image, performing step (K), Step (K) at least: (K-1) capturing an image of the second screen in the upper edge region to obtain a fourth upper edge image; (K-2) the second upper edge image and The fourth upper edge image performs image recognition to identify whether the fourth upper edge image has a change with respect to the second upper edge image.
  4. The method of claim 3, wherein if the step (K-2) recognizes that the fourth upper edge image changes relative to the second upper edge image, determining that the cursor is in the On the second screen.
  5. The method of claim 3, wherein if the step (K-2) recognizes that the fourth upper edge image does not change relative to the second upper edge image, proceeding to step (L) The step (L) includes at least: (L-1) the remote management system to horizontally move the cursor to a second direction by a distance; (L-2) capturing the first screen in the upper edge region Imageing to obtain a fifth upper edge image; (L-3) performing image recognition on the first upper edge image and the fifth upper edge image to identify the fifth upper edge image relative to the image Whether the first upper edge image changes.
  6. The method of claim 5, wherein if the step (L-3) identifies that the fifth upper edge image changes relative to the first upper edge image, determining that the cursor is in the The first screen on.
  7. The method of claim 5, wherein if the step (L-3) recognizes that the fifth upper edge image has no change relative to the first upper edge image, determining that the cursor is in the On the second screen.
  8. A method for automatically recognizing a screen in which a cursor is located in a remote management system supporting multiple screens includes at least the following steps: (A) providing a remote management system, the remote management system including at least one remote management device, the remote The end management device has a first image input port and a second image input port, wherein the first image input port corresponds to a first screen and the second image input port corresponds to a second screen; (B) The target computer can output a first image to the first image input port and output a second image to the second image input port, and generate a cursor on the first screen or the second screen; (C) The remote management device can be controlled by a central control computer via the network; (D) the remote management device respectively captures the first image and the second image output by the target computer, and respectively controls the central image The first control image of the computer generates a first thumbnail image and a second thumbnail image, wherein the first thumbnail image corresponds to the first image and the second thumbnail image corresponds to the second image; According to the level of the first image And summing the horizontal resolution of the second image to generate a horizontal movement amount; (F) causing the cursor of the target computer to move on the first screen or the second screen according to the horizontal movement amount by the remote management device Up to an upper edge region; (G) capturing, by the remote management device, images of the first screen and the second screen in the upper edge region to obtain a first upper edge image and a second upper edge image; (H) using the remote management device to vertically move the cursor to a first direction by a distance; (I) capturing an image of the first screen in the upper edge region to obtain a third upper edge image; J) performing image recognition on the first upper edge image and the third upper edge image to identify whether the third upper edge image has a change with respect to the first upper edge image.
  9. The method of claim 8, wherein if the step (J) recognizes that the third upper edge image changes relative to the first upper edge image, determining that the cursor is in the first On the screen.
  10. The method of claim 8, wherein if the step (J) recognizes that the third upper edge image does not change relative to the first upper edge image, proceeding to step (K), Step (K) at least: (K-1) capturing an image of the second screen in the upper edge region to obtain a fourth upper edge image; (K-2) the second upper edge image and The fourth upper edge image performs image recognition to identify whether the fourth upper edge image has a change with respect to the second upper edge image.
  11. The method of claim 10, wherein if the step (K-2) recognizes that the fourth upper edge image changes relative to the second upper edge image, determining that the cursor is in the On the second screen.
  12. The method of claim 10, wherein if the step (K-2) recognizes that the fourth upper edge image does not change relative to the second upper edge image, proceeding to step (L) The step (L) includes at least: (L-1) the remote management system to vertically move the cursor to a second direction by a distance; (L-2) capturing the first screen in the upper edge region Image to obtain a fifth upper edge image; (L-3) performing image recognition on the first upper edge image and the fifth upper edge image to identify whether the fifth upper edge image changes with respect to the first upper edge image.
  13. The method of claim 12, wherein if the step (L-3) identifies that the fifth upper edge image changes relative to the first upper edge image, determining that the cursor is in the On the first screen.
  14. The method of claim 12, wherein if the step (L-3) recognizes that the fifth upper edge image has no change relative to the first upper edge image, determining that the cursor is in the On the second screen.
  15. A method for automatically recognizing a screen in which a cursor is located in a remote management system supporting multiple screens includes at least the following steps: (A) providing a remote management system, the remote management system including at least one remote management device, the remote The end management device has a first image input port and a second image input port, wherein the first image input port corresponds to a first screen and the second image input port corresponds to a second screen; (B) The target computer can output a first image to the first image input port and output a second image to the second image input port, and generate a cursor on the first screen or the second screen; (C) The remote management device can be controlled by a central control computer via the network, so that the control of the central control computer is converted into control of the target computer; (D) the remote management device respectively captures the target computer Outputting the first image and the second image to generate a mapped image in one of the central control computers; (E) according to the resolution of the first image and the resolution of the second image Generate a movement amount; (F) The remote management apparatus such that the target of the computer according to the amount of movement of the cursor in the first screen Or moving the second screen to an edge region; (G) respectively capturing the images of the first screen and the second screen by the remote management device to obtain a first edge image and a second edge image (H) using the remote management device to move the cursor horizontally in a first direction by a distance; (I) capturing an image of the first screen in the edge region to obtain a third edge image; J) performing image recognition on the first edge image and the third edge image to identify whether the third edge image has a change with respect to the first edge image.
  16. The method of claim 15, wherein if the step (J) recognizes that the third edge image changes relative to the first edge image, determining that the cursor is on the first screen on.
  17. The method of claim 15, wherein if the step (J) recognizes that the third edge image does not change relative to the first edge image, performing step (K), the step ( K) at least: (K-1) capturing an image of the second screen in the edge region to obtain a fourth edge image; (K-2) the second edge image and the fourth edge image Image recognition is performed to identify whether the fourth edge image has a change relative to the second edge image.
TW103120081A 2014-06-10 2014-06-10 Method of auto-recognizing for cursor in monitors TWI497400B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW103120081A TWI497400B (en) 2014-06-10 2014-06-10 Method of auto-recognizing for cursor in monitors

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
TW103120081A TWI497400B (en) 2014-06-10 2014-06-10 Method of auto-recognizing for cursor in monitors
CN201510130127.XA CN105183269B (en) 2014-06-10 2015-03-24 The method of screen where automatic identification vernier

Publications (2)

Publication Number Publication Date
TWI497400B true TWI497400B (en) 2015-08-21
TW201546698A TW201546698A (en) 2015-12-16

Family

ID=54343359

Family Applications (1)

Application Number Title Priority Date Filing Date
TW103120081A TWI497400B (en) 2014-06-10 2014-06-10 Method of auto-recognizing for cursor in monitors

Country Status (2)

Country Link
CN (1) CN105183269B (en)
TW (1) TWI497400B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI660290B (en) * 2017-12-29 2019-05-21 宏正自動科技股份有限公司 Resource sharing device and control method thereof

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI650638B (en) * 2017-08-17 2019-02-11 凌華科技股份有限公司 System module built on a non-intrusive data capture system to simulate machine operation screens

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7441063B2 (en) * 2005-12-14 2008-10-21 Aten International Co., Ltd. KVM system for controlling computers and method thereof
TW200939071A (en) * 2008-03-14 2009-09-16 June On Co Ltd Computer switcher containing consolidated manipulation of bridging framework and multi-screen mouse-navigating type
TW201327208A (en) * 2011-12-30 2013-07-01 Aten Int Co Ltd Remote management system and remote management method

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060288314A1 (en) * 2005-06-15 2006-12-21 Microsoft Corporation Facilitating cursor interaction with display objects
JP5127366B2 (en) * 2007-08-29 2013-01-23 富士通コンポーネント株式会社 Information processing apparatus, KVM switch, server, and control program
CN102117187B (en) * 2009-12-31 2014-05-21 华为技术有限公司 Method, device and system for displaying multi-area screen during remote connection process
WO2014101213A1 (en) * 2012-12-31 2014-07-03 华为技术有限公司 Method, device and system for synchronizing mice

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7441063B2 (en) * 2005-12-14 2008-10-21 Aten International Co., Ltd. KVM system for controlling computers and method thereof
TW200939071A (en) * 2008-03-14 2009-09-16 June On Co Ltd Computer switcher containing consolidated manipulation of bridging framework and multi-screen mouse-navigating type
TW201327208A (en) * 2011-12-30 2013-07-01 Aten Int Co Ltd Remote management system and remote management method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI660290B (en) * 2017-12-29 2019-05-21 宏正自動科技股份有限公司 Resource sharing device and control method thereof

Also Published As

Publication number Publication date
CN105183269A (en) 2015-12-23
TW201546698A (en) 2015-12-16
CN105183269B (en) 2018-03-30

Similar Documents

Publication Publication Date Title
DE60316388T2 (en) Image display system, network interactive image display device, terminal and access control program
JP4882288B2 (en) Display control apparatus, system, and display control method
US6515678B1 (en) Video magnifier for a display of data
US6801663B2 (en) Method and apparatus for producing communication data, method and apparatus for reproducing communication data, and program storage medium
US9088749B2 (en) Method, apparatus and system for mobile terminal to remotely control television
CN103248952B (en) A kind of intelligent terminal and intelligent TV set multi-screen interaction method
US7822901B2 (en) KVM switch for controlling computers and method thereof
US20140223490A1 (en) Apparatus and method for intuitive user interaction between multiple devices
CN102883135B (en) Screen sharing and control method
TWI313432B (en) A kvm switch and a computer switching method
US20110231791A1 (en) Image display system, graphical user interface, and image display method
WO2011032152A1 (en) Method and apparatus for providing application interface portions on peripheral computer devices
CN1364252A (en) Image displaying apparatus and method
WO2010104400A1 (en) Interface unit between video conferencing codec and interactive whiteboard
JP2011258204A (en) Method for selecting object in virtual environment
CN101689099B (en) System and method for driving and receiving data from multiple touch screen devices
US20130128127A1 (en) Remote control method, remote controller, remote control response method and set-top box
US9560314B2 (en) Interactive and shared surfaces
CN105630452A (en) Screen transmission method and electronic devices
JP2013097177A5 (en)
WO2014134107A2 (en) System and method for multi-user control and media streaming to a shared display
CN103440116B (en) A kind of interactive electronic demonstration system
US20170282074A1 (en) Multiple Frame Distributed Rendering of Interactive Content
US20090257730A1 (en) Video server, video client device and video processing method thereof
JP4508570B2 (en) Remote control system and information processing apparatus