CN105183269A - Method for automatically identifying screen where cursor is located - Google Patents
Method for automatically identifying screen where cursor is located Download PDFInfo
- Publication number
- CN105183269A CN105183269A CN201510130127.XA CN201510130127A CN105183269A CN 105183269 A CN105183269 A CN 105183269A CN 201510130127 A CN201510130127 A CN 201510130127A CN 105183269 A CN105183269 A CN 105183269A
- Authority
- CN
- China
- Prior art keywords
- image
- screen
- upper limb
- long
- vernier
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 210000001364 upper extremity Anatomy 0.000 claims description 92
- 230000008859 change Effects 0.000 claims description 21
- 238000012545 processing Methods 0.000 description 26
- 238000010586 diagram Methods 0.000 description 12
- 230000008569 process Effects 0.000 description 12
- 230000001360 synchronised effect Effects 0.000 description 10
- 238000004891 communication Methods 0.000 description 7
- 238000006243 chemical reaction Methods 0.000 description 6
- 230000006835 compression Effects 0.000 description 4
- 238000007906 compression Methods 0.000 description 4
- 238000006073 displacement reaction Methods 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 238000010835 comparative analysis Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 239000011230 binding agent Substances 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Landscapes
- User Interface Of Digital Computer (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The method for automatically identifying the screen where the cursor is located comprises the following steps: generating a vertical movement amount according to the sum of the vertical resolution of the first image and the vertical resolution of the second image; using the remote management device to move the cursor of the target computer to the upper edge region on the first screen or the second screen according to the vertical movement amount; respectively capturing images of the first screen and the second screen in the upper edge area by using a remote management device to obtain a first upper edge image and a second upper edge image; horizontally moving the cursor to a first direction for a distance by using the remote management device; capturing an image of the first screen in the upper edge area to obtain a third upper edge image; and performing image recognition on the first upper edge image and the third upper edge image to identify whether the third upper edge image changes relative to the first upper edge image.
Description
Technical field
The present invention is about the method for a kind of automatic Identification vernier place screen; Specifically, the present invention is about a kind of method for automatic Identification vernier place screen in the remote system of multi-screen.
Background technology
Multi-computer switch (Keyboard-Video-MouseSwitch; KVMSwitch) user is made single group of keyboard, screen and mouse can to carry out management and control multiple stage object computer.This group keyboard, screen and mouse are connected to multiple stage object computer via multi-computer switch.Via multi-computer switch, the signal that screen and mouse send can reach a wherein chosen object computer, and this object computer also can via multi-computer switch image output so far screen.So can save space, the energy and hardware cost.Multi-computer switch is applicable to the board equipment of data center, Computer Facilities, generally individual and plant produced line.
In addition, refer to Figure 1A, one multi-computer switch 15 possessing network interface can be described as network-type multi-computer switch (IP-basedKVMSwitch), and its user U further making to control in one computer 30 (being generally desktop or kneetop computer) can be positioned at by network management multiple stage the picture that long-range controlled computer (or being called object computer) 20 and viewing object computer transmit via network.This network-type multi-computer switch is modeled to one group of keyboard be directly connected with object computer, screen and mouse, and through returning to middle control computer 30 by network after the picture catching that object computer is exported.For example, thus, the user being positioned at first ground is just positioned at server in the middle of second ground machine room by network-type multi-computer switch by telemanagement, and Buddhist of walking back and forth is as second ground directly manipulation object computer.Further, the user of network-type multi-computer switch not only usually, different users successively manipulates same object computer 20 by the computer 30 of controlling being arranged in heterogeneous networks position.
As shown in Figure 1B, there is the problem of a what is called " mouse is asynchronous " in network-type multi-computer switch, that is the user of middle control computer 30 can see the situation that two verniers are chased when Action Target computer on its operation screen (real screen) 40 on using.Because middle control computer 30 itself can produce a vernier (calling in the following text " the first vernier "), and object computer also can produce another one vernier (calling in the following text " the second vernier "), when then the picture (remote pictures) 23 of object computer is passed back middle control computer by the seizure of network-type multi-computer switch time, just user can be caused to see " the first vernier " 31 and " the second vernier " 21 because of remote pictures 23 and the superposition of near-end picture 33, and these two verniers are positioned at the situation of diverse location simultaneously.Sometimes " the first vernier " 31 may be far apart with " the second vernier " 21, because the user of network-type multi-computer switch not only usually as previously mentioned, different users successively manipulates same object computer 20 by the computer 30 of controlling being arranged in heterogeneous networks position, therefore for current user, in time being switched to a certain object computer 20, the reference position of " the second vernier " 21 rests on the position that previous user finally leaves.That is current user also cannot determine the reference position of " the second vernier " 21 before starting Action Target computer 20.Therefore, if do not solve the problem of what is called " mouse is asynchronous ", the puzzlement on precise manipulation will be caused to current user, will with which vernier position on operation screen because user will not know and click.
As shown in Figure 1 C, network-type multi-computer switch is in order to solve the problem of above-mentioned " mouse is asynchronous ", just the process of what is called " mouse is synchronous " will be carried out, that is first " the first vernier " 31 and " the second vernier " 21 all must be moved to same position, such as all move to the upper left corner (35 of screen, 25), and then open " the first vernier " 31 use to user.But because network-type multi-computer switch is one group of keyboard, screen and mouse for object computer, therefore network-type multi-computer switch also cannot directly be obtained the messages such as the coordinate of vernier by the operating system of object computer.And under the mouse coordinates of some operating system, because network-type multi-computer switch at any time (comprise synchronous before) do not know which position dropped at " the second vernier " 21 on screen, so network-type multi-computer switch at this time and do not know the upper left corner that " the second vernier " 21 will could be moved to screen to the amount of movement that mouse is how many.The upper left corner of screen can be moved in order to ensure " the second vernier " 21, it is the sum total of screen vertical resolution Yy and horizontal resolution Yx in fact that network-type multi-computer switch is assigned to the amount of movement of " the second vernier " 21, that is in the vertical direction and the vector of the possible maximum moving distance of horizontal direction close.But, current network-type multi-computer switch only supports single screen, support the framework of multi-screen at object computer under, because network-type multi-computer switch does not only know which platform screen " the second vernier " 21 drops on, network-type multi-computer switch does not know " the second vernier " 21 drops on which position on which platform screen, so " the first vernier " 31 and " the second vernier " 21 also all cannot be moved to the same position on a certain screen by effectively, that is traditional network-type multi-computer switch also cannot carry out so-called " mouse is synchronous " effectively automatically.Therefore, support the framework of multi-screen for object computer, real being necessary of the problem for above-mentioned " mouse is asynchronous " proposes a set of effective settling mode.
Summary of the invention
An object of the present invention is the method providing a kind of automatic Identification vernier place screen, makes the synchronous more efficient of long-range vernier and near-end vernier.
In one embodiment, the invention provides the method for the screen at automatic Identification vernier place in a kind of long-distance management system supporting multi-screen, comprise the following step: (A) provides a long-distance management system, this long-distance management system at least comprises a long-distance management device, this long-distance management device has one first image-input end mouth and one second image-input end mouth, and wherein this first image-input end mouth corresponds to one first screen and this second image-input end mouth and corresponds to one second screen; (B) make exportable one first image of an object computer to this first image-input end mouth and export one second image to this second image-input end mouth, and produce a vernier on this first screen or this second screen; (C) make this long-distance management device can via network controlled in one computer control; (D) capture with this long-distance management device this first image and this second image that this object computer exports respectively, and control in this respectively in of computer and control screen and produce one first contract drawing image and one second contract drawing image, wherein this first contract drawing image corresponds to this first image and this second contract drawing image corresponds to this second image; (E) summation according to the vertical resolution of this first image and the vertical resolution of this second image produces a vertical movement; (F) this vernier of this object computer is made on this first screen or this second screen, to move to a upper edge region according to this vertical movement with this long-distance management device; (G) this first screen and this second screen image in this upper edge region is captured respectively, to obtain one first upper limb image and one second upper limb image with this long-distance management device; (H) this vernier is made to move horizontally a distance to a first direction with this long-distance management device; (I) image of this first screen in this upper edge region is captured, to obtain one the 3rd upper limb image; (J) image identification is carried out to this first upper limb image and the 3rd upper limb image, to identify whether the 3rd upper limb image changes relative to this first upper limb image.
In one embodiment, the invention provides the method for the screen at automatic Identification vernier place in a kind of long-distance management system supporting multi-screen, comprise the following step: (A) provides a long-distance management system, this long-distance management system at least comprises a long-distance management device, this long-distance management device has one first image-input end mouth and one second image-input end mouth, and wherein this first image-input end mouth corresponds to one first screen and this second image-input end mouth and corresponds to one second screen; (B) make exportable one first image of an object computer to this first image-input end mouth and export one second image to this second image-input end mouth, and produce a vernier on this first screen or this second screen; (C) make this long-distance management device can via network controlled in one computer control; (D) capture with this long-distance management device this first image and this second image that this object computer exports respectively, and control in this respectively in of computer and control screen and produce one first contract drawing image and one second contract drawing image, wherein this first contract drawing image corresponds to this first image and this second contract drawing image corresponds to this second image; (E) summation according to the horizontal resolution of this first image and the horizontal resolution of this second image produces the amount of moving horizontally; (F) this vernier of this object computer is made on this first screen or this second screen, to move to a upper edge region according to this amount of moving horizontally with this long-distance management device; (G) this first screen and this second screen image in this upper edge region is captured respectively, to obtain one first upper limb image and one second upper limb image with this long-distance management device; (H) make this vernier to an a first direction vertically mobile distance with this long-distance management device; (I) image of this first screen in this upper edge region is captured, to obtain one the 3rd upper limb image; (J) image identification is carried out to this first upper limb image and the 3rd upper limb image, to identify whether the 3rd upper limb image changes relative to this first upper limb image.
In one embodiment, the invention provides the method for the screen at automatic Identification vernier place in a kind of long-distance management system supporting multi-screen, comprise the following step: (A) provides a long-distance management system, this long-distance management system at least comprises a long-distance management device, this long-distance management device has one first image-input end mouth and one second image-input end mouth, and wherein this first image-input end mouth corresponds to one first screen and this second image-input end mouth and corresponds to one second screen; (B) make exportable one first image of an object computer to this first image-input end mouth and export one second image to this second image-input end mouth, and produce a vernier on this first screen or this second screen; (C) make this long-distance management device can via network controlled in one computer control, and then make to be converted into control to this object computer to the control controlling computer in this; (D) capture with this long-distance management device this first image and this second image that this object computer exports respectively, with control in this computer one in control screen and produce one and map image; (E) summation according to the resolution of this first image and the resolution of this second image produces an amount of movement; (F) this vernier of this object computer is made on this first screen or this second screen, to move to a fringe region according to this amount of movement with this long-distance management device; (G) image of this first screen and this second screen is captured respectively with this long-distance management device, to obtain one first edge image and one second edge image; (H) this vernier is made to move horizontally a distance to a first direction with this long-distance management device; (I) image of this first screen at this fringe region is captured, to obtain one the 3rd edge image; (J) image identification is carried out to this first edge image and the 3rd edge image, to identify whether the 3rd edge image changes relative to this first edge image.By the method for automatic Identification vernier place of the present invention screen, vernier place screen can be learnt by mat image identification, and then improve the synchronous efficiency of mouse.
Accompanying drawing explanation
Figure 1A is the schematic diagram that tradition has the long-distance management system of multiscreen display apparatus;
Figure 1B is the nonsynchronous schematic diagram of mouse;
Fig. 1 C is that tradition solves the nonsynchronous schematic diagram of mouse;
Fig. 2 A the present invention has the embodiment schematic diagram of the long-distance management system of multiscreen display apparatus;
Fig. 2 B and Fig. 2 C the present invention have another embodiment schematic diagram of the long-distance management system of multiscreen display apparatus;
Fig. 3 A-1 to 3A-2 is an embodiment process flow diagram of automatic Identification vernier place screen;
Fig. 3 A-3 to 3A-4 is another embodiment process flow diagram of automatic Identification vernier place screen;
Fig. 3 B is the embodiment schematic diagram of moving cursor to fringe region;
Fig. 3 C is the embodiment schematic diagram along the first horizontal direction movement after moving cursor to fringe region;
Fig. 3 D be under multi-screen system moving cursor to the embodiment schematic diagram of fringe region;
Fig. 3 E to Fig. 3 G be under multi-screen system moving cursor to the different embodiment schematic diagram of fringe region;
Fig. 3 H-1 to 3H-2 is another embodiment process flow diagram of automatic Identification vernier place screen.
[symbol description]
100 long-distance management systems
Computer is controlled in 110
111-1 the 3rd screen
111-2 the 4th screen
120 object computers
121-1 first screen
121-2 second screen
121-3 the 3rd screen
121-4 the 4th screen
123 remote pictures
125b-1 top margin
125b-2 bottom margin
Border, 125b-3 left
Border, 125b-4 right
The 125c-1 upper left corner
The 125c-2 lower left corner
The 125c-3 upper right corner
The 125c-4 lower right corner
125u upper edge region
125d lower edge region
125l left border region
125r right border region
127 verniers
200 long-distance management devices
210 computer interfaceJi Suanjijiekous
210a computer connectivity port
220 network interfaces
250 image processing modules
260 central processing units
500 computer interfaceJi Suanjijiekou modules
510 the one RS-485 transceivers
520 the 2nd RS-485 transceivers
530 differential drives
540 differential receivers
600 category-5 cables
Dx1 first horizontal direction
Embodiment
The present invention discloses a kind of long-distance management system supporting multi-screen.This long-distance management system at least comprises a long-distance management device.This this long-distance management system makes to control computer in one by network control one object computer.In a preferred embodiment, this long-distance management device can be a network-type multi-computer switch, this network-type multi-computer switch ALARA Principle one or multiple stage object computer.This long-distance management device can simulate two or more screens to same object computer, to make same object computer can export the signal of video signal of more than two-way or two-way to this long-distance management device.Because long-distance management system of the present invention supports multi-screen, therefore certain object computer can map in the network other end the image that multiple screen exports and control computer by long-distance management system of the present invention, that is one or more screen controlling computer in this produces one and map image.
This multiple stage virtual screen mainly corresponds in the middle of long-distance management device in order to capture storer or other buffer storage devices of the signal of video signal that object computer exports.Such as, and this multiple stage virtual screen can correspond to one or more screen of middle control computer end, when long-distance management device is modeled to two screens, these two virtual screens may correspond to the single screen to middle control computer, or correspond to two different screens respectively.In addition, in order to carry out " mouse is synchronous " or other functions, first the place screen of the vernier of object computer and position can be found out by the present invention.Such as, suppose that long-distance management system of the present invention can simulate one first screen and one second screen, the vernier that long-distance management system of the present invention can pick out object computer drops on the first screen or the second screen.If suppose, vernier drops on the first screen, and the present invention still identifiable design goes on a tour the particular location of village on the first screen.
Refer to Fig. 2 A, the invention provides a kind of long-distance management system 100, long-distance management system 100 of the present invention at least comprises a long-distance management device 200.One end of this long-distance management device 200 is via controlling computer 110 in network-coupled to, and the other end of this long-distance management device 200 is then be coupled to an object computer 120 via suitable interface.So, the long-distance management device 200 as bridge can make to control in this computer 110 can via this object computer 120 of network control, that is this object computer 120 can produce reaction to the operational order from middle control computer 110.Control computer 110 in this and there is one or many stack screen and cursor control device, such as keyboard and mouse.In addition, this long-distance management device 200 can be modeled to one or many stack screen, keyboard and mouse, or other devices (as Fig. 2 A dotted line frame illustrate, long-distance management device 200 is modeled to keyboard, mouse and has the multi-screen system of the first screen 121-1 and the second screen 121-2).When simulating many stack screen, this object computer 120 can export many group images signal to this long-distance management device 200, and receives one group of keyboard and mouse signal.In addition, one or many stack screen of middle control computer 110, keyboard and mouse can map one or many stack screen that so far long-distance management device 200 simulates, keyboard and mouse (such as, the 3rd screen 111-1 and the 4th screen 111-2 of middle control computer 110 the first screen 121-1 of simulating of corresponding long-distance management device 200 and the second screen 121-2 respectively).Therefore, through long-distance management system 100 thus, user can be converted into the operation for object computer 120 for the operation of keyboard and mouse.It should be noted that middle control computer 110 use the quantity of screen can be identical from the quantity of the screen that long-distance management device 200 is simulated or different.Middle control computer 110 use the quantity of screen can be single entity screen or have identical quantity with virtual screen.
Refer to Fig. 2 B, this long-distance management device 200 has computer interfaceJi Suanjijiekou 210, network interface 220 and an image processing module 250, and wherein computer interfaceJi Suanjijiekou 210 is in order to connect at least one object computer 120; Network interface 220, via controlling computer 110 in network-coupled to, makes middle control computer 110 can carry out communication to exchange data according to suitable network communication protocol (such as ICP/IP protocol group) between long-distance management device 200 therewith.This image processing module 250 mainly in order to capture the signal of video signal (analog or digital) that object computer 120 exports, and carries out follow-up image processing.The adjustment of color depth, the conversion of image coordinate, the step such as image compression and coding may be comprised in image processing process.Image processing module 250 also may comprise differential signal of video signal is reduced to single-ended signal of video signal, and original signal of video signal is converted to the function of digital image data according to above-mentioned steps.
In the middle of a preferred embodiment, the computer interfaceJi Suanjijiekou 210 of this long-distance management device 200 has one or more can the computer connectivity port 210a of linking objective computer 120.In a preferred embodiment, each computer connectivity port 210a of this long-distance management device 200 more can have an image-input end mouth, a keyboard/mouse output port.Wherein image-input end mouth is in order to the image output port of linking objective computer 120; Keyboard/mouse output port is in order to the keyboard/mouse input port of linking objective computer 120.This keyboard/mouse input port or keyboard/mouse output port can be USB interface, PS/2 interface or other any suitable interfaces.Further, for long-distance management device 200, image-input end mouth and the keyboard/mouse output port of each computer connectivity port 210a can be incorporated in the middle of single connector.
Still refer to Fig. 2 B, in a further preferred embodiment, the computer connectivity port 210a of this computer interfaceJi Suanjijiekou 210 is not connected directly to an object computer, and it is via a computer interfaceJi Suanjijiekou module (ComputerInterfaceModule; CIM) 500 another object computer 120 is coupled to.In this case, the computer connectivity port 210a of this computer interfaceJi Suanjijiekou 210 has at least one RJ-45 connector, and this computer interfaceJi Suanjijiekou is connected with the RJ-45 connector of computer interfaceJi Suanjijiekou module by a category-5 cable (CAT-5Cable) 600.That is one end of this category-5 cable is connected to the RJ-45 connector of computer interfaceJi Suanjijiekou, the other end is then connected to the RJ-45 connector of computer interfaceJi Suanjijiekou module 500.The function of this computer interfaceJi Suanjijiekou module 500 comprises simulating keyboard, screen and mouse, and to the process of signal of video signal to extend the transferable distance of signal of video signal.In order to simulate keyboard and mouse, this computer interfaceJi Suanjijiekou module 500 inside has the controller that can carry out communication according to keyboard and mouse related protocol, such as USB device controller or PS/2 controller etc.In order to simulate screen, this computer interfaceJi Suanjijiekou module 500 inside has the storer that can store EDID, such as EEPROM.
Refer to Fig. 2 C, this computer interfaceJi Suanjijiekou module 500, such as can up to 1000 feet in order to extend the distance between long-distance management device 200 and object computer 120.This computer interfaceJi Suanjijiekou module 500 has one the one RS-485 transceiver (Transceiver) 510 and a differential drive (DifferentialDriver) 530.Corresponding, at the computer interfaceJi Suanjijiekou 210 of this end of long-distance management device 200, there is one the 2nd RS-485 transceiver (Transceiver) 520 and a differential receiver (DifferentialReceiver) 540.Wherein, a RS-485 transceiver 510 such as, in order to receive control signal from long-distance management device 200 and data, keyboard/mouse signals according to RS-485 agreement.Differential drive 530 is converted to three groups of differential signal of video signal in order to the single-ended signal of video signal (such as rgb signal and adjoint synchronizing signal) exported by object computer 120, so that by three twisted pair wires in the middle of category-5 cable 600 (or other similar cables) to transferring to long-distance management device 200.
In addition, differential receiver 540 corresponds to foregoing differential driver 530, in order to receive three groups of differential signal of video signal from object computer 120, and is reduced to single-ended signal of video signal originally.2nd RS-485 transceiver 520 of computer interfaceJi Suanjijiekou 210 corresponds to a RS-485 transceiver 510 of computer interfaceJi Suanjijiekou module 500, in order to exchange data, to send the signals such as the keyboard/mouse of middle control computer 100 to object computer 120 according to RS-485 agreement and computer interfaceJi Suanjijiekou module 500.Computer interfaceJi Suanjijiekou module 500 also can be described as converter (Adapter), server interface module (ServerInterfaceModule; Or conputer controlled module (ComputerAccessModule SIM); CAM).
Still refer to Fig. 2 C, this long-distance management device 200 more can comprise a central processing unit 260, and the 2nd RS-485 transceiver 520 and a differential drive 540 can be a part for aforementioned computer interfaceJi Suanjijiekou 210.The function of central processing unit 260 at least comprises image processing module 250 is coupled to network interface 220, and network interface 220 is coupled to the 2nd RS-485 transceiver 520.This central processing unit 260 mainly in order to future self imaging processing module 250 digital image data be packaged into network package and resolve and have network package about keyboard or mouse from middle control computer 110, and then by wherein about the operation message of keyboard or mouse sends a corresponding RS-485 transceiver 510 to via the 2nd RS-485 transceiver 520.This central processing unit 260 more to can be used as when network interface 220 carries out network communication involve the upper strata of associated the Internet protocol.If illustrate for osi model, when this network interface 220 is as physical layer and link (DataLink) layer, this central processing unit 260 just can be used as network layer, transport layer, meeting layer, presentation layer and application layer.If illustrate for DoD model, when this network interface 220 is as binder couse, this central processing unit 260 just can be used as network layer, transport layer and application layer.The above-mentioned functions of central processing unit 260 can change with controller, specific use integrated circuit (ASIC) or FPGA realizes.
The user of central control computer 110 is when middle this end of control computer operates object computer 120 via keyboard/mouse or other control systems, the control signal that keyboard/mouse can export by middle control computer 110 is converted to network package according to suitable network communication protocol, can be sent to long-distance management device 200 via network.And, long-distance management device 200 controls the network package that computer 100 transmits in can receiving via its network interface 220, and then be converted to the readable standard format of object computer after the control signal comprised in the middle of network package being resolved, the usb signal of such as standard or PS/2 signal, Buddhist of walking back and forth directly sends to object computer 120 as the keyboard/mouse by middle control computer 110.That is long-distance management device 200 network package that middle control computer 110 transmits can be reduced to originally control signal after export object computer 120 to, so that and then control objectives computer 120.
On the other hand, object computer 120 according in control computer 110 the signal of video signal (such as VGA signal) that exports of control signal can be become multiple continuous print image frame (Frame) by image processing module 250 acquisition, then after suitable image processing, be converted to network package, and network package is being returned to middle control computer 110 via network and according to suitable network communication protocol.This acquisition may comprise process analog image signal being converted to digital image data, such as, is stored in storer in two-symbol mode after the RGB composition in the middle of simulating signal being converted to respectively the pixel value (PixelValue) of 0 to 255.And above-mentioned image processing process also may comprise the step of image compression or coding, and it carries out before image frame is converted to network package.
In addition, in more detail, image processing module 250 can be further subdivided into multiple block by image frame, and all blocks comparing two the continuous image frames in front and back are to judge which block changes, and which block does not change.In order to reduce the data volume transmitted on network, just the data of vicissitudinous block can be carried out image compression and are converted to network package in the middle of image frame.Although it should be noted that and only show an object computer 120 in fig. 2 c, in fact this image processing module 250 may comprise multiple Image processing channel, once can process the signal of video signal of multichannel from similar and different object computer.And a handover module (not shown) may be had more between computer interfaceJi Suanjijiekou 210 and image processing module 250, so as by select in the middle of multiple stage object computer one or multiple stage object computer carry out above-mentioned image processing simultaneously.This handover module may be the framework be made up of multiple matrix form commutation circuit.
In the middle of control computer 110 by after the network package received about image data is reduced to suitable signal of video signal (it may be identical or different with the video signal format of source terminal), the user of middle control computer 110 just can see by one end of network the image that object computer 120 exports, and and then control this object computer 120, walk back and forth Buddhist as direct control objectives computer 120.This reduction may comprise process digital signal being converted to simulating signal and image decompression or decoding.
The present invention discloses the method for the screen at automatic Identification vernier place in a kind of long-distance management system supporting multi-screen, and the application of this multi-screen may comprise extension table top function.This vernier refers to the vernier (aforesaid second vernier) that object computer produces, the vernier (aforesaid first vernier) that not, control computer produces.This second vernier can because long-distance management device be also displayed on the screen of middle control computer the relation that object computer carries out image capture.The quantity of screen unrestricted in the present invention, but for ease of for the purpose of illustrating, be only described for two screens below.
Refer to Fig. 3 A-1 and Fig. 3 A-2, method of the present invention at least comprises step 301 to step 312.Wherein, step 301 provides a long-distance management system, this long-distance management system make an object computer can via network controlled in one computer control.This long-distance management system at least comprises a long-distance management device and and is executed in a program (being commonly referred to as Viewer) on middle control computer, this program, mainly as the reduction of aforementioned correction of image data network package and restructuring purposes, makes middle control computer can show image corresponding to object computer on its screen.In more detail, mutually couple via network between middle control computer and long-distance management device; Then mutually couple in the mode of non-network network between long-distance management device and object computer.This long-distance management device can be modeled to one or organize keyboard, mouse and screen more, and this long-distance management device more provides a network interface to this object computer, as this object computer and the network communication interface controlled in this between computer, make this object computer to control computer in this can via network exchange and image and the relevant data of keyboard/mouse.That is this object computer can via this long-distance management system output image signal to controlling computer in this, and control computer in this and can export the relevant instruction of keyboard/mouse to this object computer via this long-distance management system.But this long-distance management device is not connected to the network connection port of this object computer, but be connected to image output port and the keyboard/mouse input port of this object computer.That is, this object computer not by itself network interface unit to control computer in this and exchange and image and the relevant data of keyboard/mouse.
In more detail, this long-distance management device has one first image-input end mouth and one second image-input end mouth, and this long-distance management device is modeled to one first screen and one second screen, wherein this first image-input end mouth corresponds to the first screen and this second image-input end mouth and corresponds to this second screen.This first image-input end mouth and one second image-input end mouth all correspond to aforesaid image processing module, and the main frame of the inside of this long-distance management device is as described in the related description of front Fig. 2 A to Fig. 2 C.
This long-distance management device is connected to an object computer by step 302, makes exportable one first image of this object computer to this first image-input end mouth and exports one second image to this second image-input end mouth.Wherein this first image has one first resolution and this second image has one second resolution.This first resolution more comprises one first vertical resolution and one first horizontal resolution; This second resolution more comprises one second vertical resolution and one second horizontal resolution.In more detail, this first video conversion can be one first image data according to aforementioned explanation and be stored in this second video conversion in relevant storer after one second image data by this long-distance management device.
In addition, this object computer can produce a vernier on this first screen or this second screen, under the application of extension table top, this vernier can be vacillated between this first screen and this second screen, that is then this vernier can enter in the middle of this second screen through the border of this first screen; Or then this vernier can enter in the middle of this first screen through the border of this second screen.Under the application of extension table top, one of them of this first screen and this second screen is main screen, and another is secondary screen.When using this extension table top at the beginning, user can open an application program at main screen, then the form representing this application program is towed to secondary screen, when this object computer start next time, the form of this application program just can directly appear on this secondary screen.
In more detail, first image output port of object computer is connected to the first image-input end mouth of this long-distance management device by step 302 with cable, and the second image output port of object computer is connected to the second image-input end mouth of this long-distance management device with another cable.And this step more can comprise the keyboard/mouse input port keyboard/mouse output port of long-distance management device being connected to object computer with cable.In order to extended distance, aforesaid computer interfaceJi Suanjijiekou module may be had between long-distance management device and object computer, and this object computer couples this long-distance management device respectively by two different computer interfaceJi Suanjijiekou modules.In actual use, its many group images received can be differentiated from same object computer or come from different object computers to make this long-distance management device, and different images source and the corresponding relation of middle control computer end entity screen (middle control screen), the setting that user may carry out to a certain degree to this long-distance management device.
Step 303 make this long-distance management device can via network controlled in this computer control.The operation-interface that the user of middle control computer can provide via a web browser sets and follow-up operation this long-distance management device, and its setting can comprise setting of image quality; Its operation comprises selected certain object computer and switches between different object computers.In addition, after selected certain object computer, except can see the image corresponding to object computer on the screen of middle control computer except, the operation of the keyboard/mouse of user's centering of middle control computer control computer also can be typically administered remotely system and be converted to operation for object computer.
Refer to Fig. 3 A-3 and Fig. 3 A-4.In more detail, wherein this step 303 more comprises step 303-1 to step 303-3.Step 303-1 is controlled on computer and is opened a web browser (WebBrower) in this; Picture is logined to show in step 303-2 inputs this long-distance management device network address via this web browser; Step 303-3 logins picture login this long-distance management device, to carry out the follow-up operation to this long-distance management device via this.Such as this long-distance management device is set (Configuration).When this long-distance management device connects multiple stage object computer, the user of middle control computer more can select a wherein object computer to carry out subsequent operation via suitable man-machine interface.Its man-machine interface comprises the screen display menu (OSD) formed by web browser, this screen display menu may list multiple represent different target computer port numbering and port title for you to choose, and this screen display menu also may show the state of these object computers, such as online (On-Line) or off-line (Off-Line), wherein off-line state represents that this object computer is not started shooting.
In addition, control computer in this and be connected to one the 3rd screen and one the 4th screen of entity, wherein the 3rd screen corresponds to the first image-input end mouth of long-distance management device, and the 4th screen corresponds to the second image-input end mouth of long-distance management device.That is the 3rd screen correspond to this first screen; 4th screen corresponds to this second screen.Setting via aforementioned (step 302) can the above-mentioned corresponding relation of specific implementation.Mainly below to be described with this kind of framework (multiple virtual screen is to multiple entity screen), but in a further preferred embodiment, control computer in this and only can be connected to single entity screen (multiple virtual screen is to single entity screen).That is correspond to the first image of aforementioned first screen and be presented on same entity screen (middle control screen) with contract drawing or the mode of overlapping by this long-distance management system corresponding to the second image of the second screen.That is certain object computer can map in the network other end the image that multiple screen exports and controls computer by long-distance management system of the present invention, map image so that one or more screen controlling computer in this to produce one.
Step 304 captures with this long-distance management device this first image and this second image that this object computer exports respectively, to store the pixel value (PixelValue) corresponding to those images in the middle of relevant storer or other buffer storage devices, and then set up continuous print image frame.After suitable image processing, compression or coding, long-distance management device just can be sent object computer to middle control computer by the coherent video data of the picture captured by network, and then in the 3rd screen and the upper display of the 4th screen (or single entities screen).Therefore, user can feel to walk back and forth Buddhist as direct control object computer.
Please refer to Fig. 3 A-1, Fig. 3 D and Fig. 3 E, step 305 produces a vertical movement Y according to the summation of the vertical resolution of this first image and the vertical resolution of this second image, and this vertical movement Y will be vernier in the possible maximum actual displacement of the vertical direction of the first screen and the second screen.That is, if the vertical resolution of this first image is Y1; The vertical resolution of this second image is Y2, then this vertical movement Y equals Y1+Y2.Further, if number of screen is set as four in this long-distance management system, then this vertical movement Y will be Y1+Y2+Y3+Y4.That is, this vertical movement Y equals Y1+Y2+Y3+ ... + YN, the wherein quantity of multipath video that exports for object computer of N, that is the quantity of image-input end mouth that long-distance management device provides for same object computer, that is the quantity of screen that long-distance management device is simulated for same object computer.Or, also can produce the amount of a moving horizontally X according to the summation of the horizontal resolution of the input image of all simulated screen in a further preferred embodiment.That is X equals X1+X2+X3+ ... + XN.This amount of moving horizontally X will be the possible in the horizontal direction maximum actual amount of movement of vernier.
Step 306 makes this vernier of this object computer on this first screen or this second screen, move to one " upper edge region " or one " lower edge region " according to this vertical movement with this long-distance management device.In more detail, because this long-distance management device is modeled to a mouse and other devices to this object computer in the present invention, therefore this long-distance management device initiatively can send a vernier move to object computer, the content of this vernier move comprises this amount of movement, makes the vernier of this object computer on a certain screen, move to one " upper edge region " or one " lower edge region " according to this vertical movement.The change (content of the display-memory of its display card can upgrade to some extent) that the operating system of object computer can produce on image according to this vernier move, and then reaction is exported on the first or second signal of video signal of long-distance management device at object computer.Further, no matter at the beginning (carry out mouse synchronous before) vernier drops on which position of which platform screen, can ensure that vernier can be moved and rest on wherein certain screen " fringe region " according to this horizontal or vertical amount of movement.
As shown in Figure 3 B, in the picture that long-distance management device exports in object computer, (remote pictures) 123 produces vernier 127, and according to horizontal or vertical amount of movement, vernier 127 is moved to fringe region.This " fringe region " can comprise four regions such as " upper edge region " 125u, " lower edge region " 125d, " right border region " 125r and " left border region " 125l in the present invention.For vertical direction, because the actual movable distance of vernier 127 on screen can not be greater than this vertical movement, so carry out moving cursor 127 according to this vertical movement can ensure that vernier 127 can be moved into and rest on a certain screen " upper edge region " 125u or " lower edge region " 125d.In like manner, if carry out moving cursor 127 according to this amount of moving horizontally, can ensure that vernier 127 can be moved and rest on wherein a certain screen " right border region " 125r or " left border region " 125l.Fig. 3 B also demonstrates upper left corner 125c-1, lower left corner 125-2, upper right corner 125c-3, lower right corner 125c-4, top margin 125b-1, bottom margin 125b-2, border, left 125b-3 and border, right 125b-4.
Refer to Fig. 3 D to Fig. 3 G, why it illustrate in the present invention the quantity of no matter multiple screen, and its relative putting position each other how, the horizontal or vertical amount of movement calculated according to above-mentioned explanation can ensure that vernier can be moved and rest on wherein certain screen " fringe region ".
For Fig. 3 D, if the second screen 121-2 superposition is on the first screen 121-1, and vernier 127 drops on the first screen 121-1 at the beginning, vernier 127 can be moved to " upper edge region " 125u of the second screen 121-2 by the first screen 121-1 with Y=Y1+Y2 according to above-mentioned vertical movement.For Fig. 3 E, if the first screen 121-1 and the second screen 121-2 is the relation of left and right adjacent, parallel each other, and vernier 127 drops on the first screen 121-1 at the beginning, vernier 127 can be moved to its " upper edge region " 125u with Y=Y1+Y2 by the first screen 121-1 according to above-mentioned vertical movement.Although the large Y of this amount of movement is in the actual transportable distance (being less than Y1+Y2) of vernier, vernier still can rest on the first screen 121-1 " upper edge region " 125u.
Again for Fig. 3 F, if long-distance management system supports four screens, be respectively the first screen 121-1, the second screen 121-2, the 3rd screen 121-3 and the 4th screen 121-4, and the relative position of these four screens rough one-tenth one matrix shape as shown in the figure.Suppose that vernier 127 drops on the 4th screen 121-4 at the beginning, vernier 127 can be moved to " upper edge region " 125u of the 3rd screen 121-3 according to above-mentioned vertical movement with Y=Y1+Y2+Y3+Y4 by the 4th screen 121-4.Although the large Y of this amount of movement is in the actual transportable distance (being less than Y3+Y4) of vernier, vernier still can rest on the first screen 121-3 " upper edge region " 125u.
Again more for Fig. 3 G, if long-distance management system supports four screens, be respectively the first screen 121-1, the second screen 121-2, the 3rd screen 121-3 and the 4th screen 121-4, and the relative position of these four screens becomes irregular ornaments as shown in the figure.Suppose that vernier 127 drops on the first screen 121-1 at the beginning, vernier 127 can be moved to " upper edge region " 125u of the 3rd screen 121-3 according to above-mentioned vertical movement with Y=Y1+Y2+Y3+Y4 by the first screen 121-1.Although the large Y of this amount of movement is in the actual transportable distance (being less than Y1+Y2+Y3) of vernier, vernier still can rest on the 3rd screen 121-3 " upper edge region " 125u.
On the other hand; because the aspect ratio (AspectRatio) of general screen is all that vertical direction is narrow, horizontal direction is wide; therefore vernier displacement in the vertical direction can be less than the displacement of horizontal direction usually, and movement can obtain and preferably move efficiency in the vertical direction.In addition, because under some operating system, to be hidden after vernier moves to the bottom margin of screen or border, right or part is hidden, therefore below the present invention with vertical direction and " upper edge region " for preferred embodiment is described, but this area have usually know the knowledgeable perceptible be that the present invention is not for as limit.For can not hide for the operating system of vernier at the bottom margin of screen or border, right, vernier, in the process identifying vernier place screen, also can move in " lower edge region " by the present invention in the vertical direction; Also vernier can be moved in " right border region " or " left border region " in the horizontal direction.
Please refer to Fig. 3 A-1 and Fig. 3 C, step 307 captures this first screen and this second screen image in this " upper edge region " respectively, to obtain one first upper limb image and one second upper limb image.Alternatively, long-distance management device captures the full frame image of this first screen and this second screen respectively, but long-distance management device only carries out follow-up image comparative analysis (image recognition) to the image data that the first screen and this second screen correspond to " upper edge region ".The width in this " upper edge region " or " lower edge region " is the horizontal resolution of this first screen relative to this first image, or second screen relative to the horizontal resolution of this second image, and the height of the height in " upper edge region " or " lower edge region " vernier at least for this reason.Generally speaking, the height of a vernier and width are about 32 pixels and are multiplied by 32 pixels, but in fact the outward appearance of vernier and size can change via the setting of operating system, and therefore the present invention only illustrates at this, not for as limit.Because the resolution of the first image may be identical or different from the resolution of the second image, therefore " upper edge region " or " lower edge region " of the first screen and " upper edge region " or " lower edge region " of the second screen also may be identical or different in size.
Please refer to Fig. 3 A-1 and Fig. 3 C, step 308 makes this vernier 127 move a distance along one first horizontal direction dx1 in this " upper edge region ".This first horizontal direction can be right or left, these distance better width being about a vernier, such as 32 pixels.
Refer to Fig. 3 A-1, step 309 captures the image of this first screen in this " upper edge region ", to obtain one the 3rd upper limb image.Alternatively, long-distance management device captures the full frame image of this first screen, but long-distance management device only carries out follow-up image comparative analysis (image recognition) to the image data that the first screen corresponds to " upper edge region ".Step 310 carries out image identification to this first upper limb image and the 3rd upper limb image, to identify whether the 3rd upper limb image changes relative to this first upper limb image.Change if judge in the step 310, then can determine that this vernier drops on this first screen; If judge unchanged in the step 310, then can determine that this vernier not drops on this first screen or has other kind of situation.
Refer to Fig. 3 A-2, because long-distance management system do not know that vernier drops on the first screen or the second screen in fact at the beginning, whether therefore this step first attempts observing wherein a certain screen (such as the first screen) the change produced on image after step 309.If this observed screen has the change on image, because change is started because of the movement in vernier for this reason, therefore can judge that the first screen reacts to some extent for aforesaid vernier move, therefore step 310 can judge that vernier drops on the first screen.If there is no the change on image, can judge that vernier not drops on the first screen, although or vernier drops on the first screen to cause image unchanged (cause the reason of this kind of situation and because of after induction method will be specified in) because of other reasons.
If judge the image of twice acquisition before and after the first screen in the step 310 and unchanged, then perform step 311 and step 312.Wherein step 311 captures the image of this second screen in this " upper edge region ", to obtain one the 4th upper limb image.Because judged that the first screen is reactionless for vernier move in the step 310, therefore the probability to drop on the second screen of vernier is quite large.Because identical with the mode of the image of aforementioned acquisition first screen to the mode of the second screen acquisition the 4th upper limb image, no longer repeated at this.Step 312 carries out image identification to this second upper limb image and the 4th upper limb image, to judge whether the 4th upper limb image changes relative to this second upper limb image.
Please refer to Fig. 3 A-2 and Fig. 3 B, to change generation relative to the second upper limb image if identify the 4th upper limb image in step 312, then can determine that this vernier drops on this second screen; If two screens all judge unchanged in step 310 and step 312, then can determine that this vernier drops on a certain corner regions (but not comprising upper left corner 125c-1) of this first screen or this second screen.That is, this vernier 127 may be moved to upper right corner 125c-3, the lower right corner 125c-4 of this first screen or this second screen or lower left corner 125c-2 and be stashed by operating system after step 306, therefore the first screen or this second screen all can not produce visual reaction for step 308, so all cannot see that in step 310 and step 312 first or second screen has the change on the image of two, front and back.
Refer to Fig. 3 H-1 and Fig. 3 H-2, if run into above such situation, then carry out following steps.First step 308-1 is carried out.Step 308-1 and step 308 similar, but step 308-1 makes this vernier move a distance along one second horizontal direction in this " upper edge region ", and the second horizontal direction is contrary with the first horizontal direction.That is if step 308 makes vernier move towards right, then step 308-1 makes vernier move towards left.Then step 309-1 and step 310-1 is carried out.Step 309-1 and step 309 similar, step 309-1 captures the image of this first screen in this " upper edge region ", to obtain one the 5th upper limb image; Step 310-1 and step 310 similar, step 310-1 carries out image identification to this first upper limb image and the 5th upper limb image, to judge whether the 5th upper limb image changes relative to this first upper limb image.
Change if judge in step 310-1, then can determine that this vernier drops on this first screen; If judge unchanged in step 310-1, then can determine that this vernier not drops on this first screen, that is vernier drops on the second screen.
Known based on aforesaid explanation, carry out mouse synchronous before the present invention can pick out the vernier that object computer produces and drop on the first screen or the second screen, and the position of this vernier on its place screen.Because the present invention also can pick out the position of this vernier on its place screen, therefore the present invention by the maximal value that no longer needs to give as conventional art on object computer resolution of screen diagonal line to guarantee that vernier is bound to move to the upper left corner of screen, the present invention by according to the relative putting position between multi-screen to the suitable amount of movement of object computer one with the position at the vernier (the first vernier) vernier (the second vernier) of object computer being moved to middle control computer place at that time, so that it is synchronous to carry out mouse, and the position controlling the vernier place of computer in this is not the upper left corner of screen usually.Or the present invention also can by the vernier of middle control computer (the first vernier moves) to the position at vernier (the second vernier) place at that time of object computer.After carrying out mouse and be synchronous, the right to use of cursor control device just can discharge to the user of middle control computer by long-distance management system, and the user of middle control computer just accurately can manipulate the vernier that object computer produces.
It should be noted that long-distance management device of the present invention the mode entity of non-network can also connect one group of control device, such as a stack screen, keyboard and mouse.This group control device can be described as the near-end control device of long-distance management device; This screen can be described as the near-end screen of long-distance management device, and user can also be operated this object computer with this near-end control device by long-distance management device.The present invention to move for the vernier of object computer according to above-mentioned explanation or the change on the image that middle control computer produces for the operation of object computer also can be presented at (example is by process vernier being moved to fringe region) on this near-end screen, but this change may make human eye not easily or cannot discover because of the relation of excessive velocities.
Although technology contents of the present invention discloses as above with preferred embodiment; so itself and be not used to limit the present invention; any those skilled in the art; do not depart from of the present invention spirit do a little change and retouching; all should be covered by category of the present invention, therefore protection scope of the present invention is when being as the criterion depending on the accompanying claim person of defining.
Claims (17)
1. the method for screen at automatic Identification vernier place in the long-distance management system supporting multi-screen, at least comprises the following step:
(A) long-distance management system is provided, this long-distance management system at least comprises a long-distance management device, this long-distance management device has one first image-input end mouth and one second image-input end mouth, and wherein this first image-input end mouth corresponds to one first screen and this second image-input end mouth and corresponds to one second screen;
(B) make exportable one first image of an object computer to this first image-input end mouth and export one second image to this second image-input end mouth, and produce a vernier on this first screen or this second screen;
(C) make this long-distance management device can via network controlled in one computer control;
(D) capture with this long-distance management device this first image and this second image that this object computer exports respectively, and control in this respectively in of computer and control screen and produce one first contract drawing image and one second contract drawing image, wherein this first contract drawing image corresponds to this first image and this second contract drawing image corresponds to this second image;
(E) summation according to the vertical resolution of this first image and the vertical resolution of this second image produces a vertical movement;
(F) this vernier of this object computer is made on this first screen or this second screen, to move to a upper edge region according to this vertical movement with this long-distance management device;
(G) this first screen and this second screen image in this upper edge region is captured respectively, to obtain one first upper limb image and one second upper limb image with this long-distance management device;
(H) this vernier is made to move horizontally a distance to a first direction with this long-distance management device;
(I) image of this first screen in this upper edge region is captured, to obtain one the 3rd upper limb image;
(J) image identification is carried out to this first upper limb image and the 3rd upper limb image, to identify whether the 3rd upper limb image changes relative to this first upper limb image.
2. the method for claim 1, is characterized in that, changes, then judge that this vernier drops on this first screen if identify the 3rd upper limb image in this step (J) relative to this first upper limb image.
3. the method for claim 1, is characterized in that, if it is unchanged relative to this first upper limb image to identify the 3rd upper limb image in this step (J), then carry out step (K), this step (K) at least comprises:
(K-1) image of this second screen in this upper edge region is captured, to obtain one the 4th upper limb image;
(K-2) image identification is carried out to this second upper limb image and the 4th upper limb image, to identify whether the 4th upper limb image changes relative to this second upper limb image.
4. method as claimed in claim 3, is characterized in that, change, then judge that this vernier drops on this second screen if identify the 4th upper limb image in this step (K-2) relative to this second upper limb image.
5. method as claimed in claim 3, is characterized in that, if it is unchanged relative to this second upper limb image to identify the 4th upper limb image in this step (K-2), then carry out step (L), this step (L) at least comprises:
(L-1) this vernier is made to move horizontally a distance to a second direction with this long-distance management system;
(L-2) image of this first screen in this upper edge region is captured, to obtain one the 5th upper limb image;
(L-3) image identification is carried out to this first upper limb image and the 5th upper limb image, to identify whether the 5th upper limb image changes relative to this first upper limb image.
6. method as claimed in claim 5, is characterized in that, change, then judge that this vernier drops on this first screen if identify the 5th upper limb image in this step (L-3) relative to this first upper limb image.
7. method as claimed in claim 5, is characterized in that, if it is unchanged relative to this first upper limb image to identify the 5th upper limb image in this step (L-3), then judge that this vernier drops on this second screen.
8. the method for screen at automatic Identification vernier place in the long-distance management system supporting multi-screen, at least comprises the following step:
(A) long-distance management system is provided, this long-distance management system at least comprises a long-distance management device, this long-distance management device has one first image-input end mouth and one second image-input end mouth, and wherein this first image-input end mouth corresponds to one first screen and this second image-input end mouth and corresponds to one second screen;
(B) make exportable one first image of an object computer to this first image-input end mouth and export one second image to this second image-input end mouth, and produce a vernier on this first screen or this second screen;
(C) make this long-distance management device can via network controlled in one computer control;
(D) capture with this long-distance management device this first image and this second image that this object computer exports respectively, and control in this respectively in of computer and control screen and produce one first contract drawing image and one second contract drawing image, wherein this first contract drawing image corresponds to this first image and this second contract drawing image corresponds to this second image;
(E) summation according to the horizontal resolution of this first image and the horizontal resolution of this second image produces the amount of moving horizontally;
(F) this vernier of this object computer is made on this first screen or this second screen, to move to a upper edge region according to this amount of moving horizontally with this long-distance management device;
(G) this first screen and this second screen image in this upper edge region is captured respectively, to obtain one first upper limb image and one second upper limb image with this long-distance management device;
(H) make this vernier to an a first direction vertically mobile distance with this long-distance management device;
(I) image of this first screen in this upper edge region is captured, to obtain one the 3rd upper limb image;
(J) image identification is carried out to this first upper limb image and the 3rd upper limb image, to identify whether the 3rd upper limb image changes relative to this first upper limb image.
9. method as claimed in claim 8, is characterized in that, change, then judge that this vernier drops on this first screen if identify the 3rd upper limb image in this step (J) relative to this first upper limb image.
10. method as claimed in claim 8, is characterized in that, if it is unchanged relative to this first upper limb image to identify the 3rd upper limb image in this step (J), then carry out step (K), this step (K) at least comprises:
(K-1) image of this second screen in this upper edge region is captured, to obtain one the 4th upper limb image;
(K-2) image identification is carried out to this second upper limb image and the 4th upper limb image, to identify whether the 4th upper limb image changes relative to this second upper limb image.
11. methods as claimed in claim 10, is characterized in that, change, then judge that this vernier drops on this second screen if identify the 4th upper limb image in this step (K-2) relative to this second upper limb image.
12. methods as claimed in claim 10, it is characterized in that, if it is unchanged relative to this second upper limb image to identify the 4th upper limb image in this step (K-2), then carry out step (L), this step (L) at least comprises:
(L-1) make this vernier to an a second direction vertically mobile distance with this long-distance management system;
(L-2) image of this first screen in this upper edge region is captured, to obtain one the 5th upper limb image;
(L-3) image identification is carried out to this first upper limb image and the 5th upper limb image, to identify whether the 5th upper limb image changes relative to this first upper limb image.
13. methods as claimed in claim 12, is characterized in that, change, then judge that this vernier drops on this first screen if identify the 5th upper limb image in this step (L-3) relative to this first upper limb image.
14. methods as claimed in claim 12, is characterized in that, if it is unchanged relative to this first upper limb image to identify the 5th upper limb image in this step (L-3), then judge that this vernier drops on this second screen.
The method of the screen at 15. 1 kinds of automatic Identification vernier places in the long-distance management system supporting multi-screen, at least comprises the following step:
(A) long-distance management system is provided, this long-distance management system at least comprises a long-distance management device, this long-distance management device has one first image-input end mouth and one second image-input end mouth, and wherein this first image-input end mouth corresponds to one first screen and this second image-input end mouth and corresponds to one second screen;
(B) make exportable one first image of an object computer to this first image-input end mouth and export one second image to this second image-input end mouth, and produce a vernier on this first screen or this second screen;
(C) make this long-distance management device can via network controlled in one computer control, and then make to be converted into control to this object computer to the control controlling computer in this;
(D) capture with this long-distance management device this first image and this second image that this object computer exports respectively, with control in this computer one in control screen and produce one and map image;
(E) summation according to the resolution of this first image and the resolution of this second image produces an amount of movement;
(F) this vernier of this object computer is made on this first screen or this second screen, to move to a fringe region according to this amount of movement with this long-distance management device;
(G) image of this first screen and this second screen is captured respectively with this long-distance management device, to obtain one first edge image and one second edge image;
(H) this vernier is made to move horizontally a distance to a first direction with this long-distance management device;
(I) image of this first screen at this fringe region is captured, to obtain one the 3rd edge image;
(J) image identification is carried out to this first edge image and the 3rd edge image, to identify whether the 3rd edge image changes relative to this first edge image.
16. methods as claimed in claim 15, is characterized in that, change relative to this first edge image if identify the 3rd edge image in this step (J), then judge that this vernier drops on this first screen.
17. methods as claimed in claim 15, is characterized in that, if it is unchanged relative to this first edge image to identify the 3rd edge image in this step (J), then carry out step (K), this step (K) at least comprises:
(K-1) image of this second screen at this fringe region is captured, to obtain one the 4th edge image;
(K-2) image identification is carried out to this second edge image and the 4th edge image, to identify whether the 4th edge image changes relative to this second edge image.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW103120081 | 2014-06-10 | ||
| TW103120081A TWI497400B (en) | 2014-06-10 | 2014-06-10 | Method of auto-recognizing for cursor in monitors |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105183269A true CN105183269A (en) | 2015-12-23 |
| CN105183269B CN105183269B (en) | 2018-03-30 |
Family
ID=54343359
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510130127.XA Active CN105183269B (en) | 2014-06-10 | 2015-03-24 | Method for automatically identifying screen where cursor is located |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN105183269B (en) |
| TW (1) | TWI497400B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110955340A (en) * | 2018-09-26 | 2020-04-03 | 致伸科技股份有限公司 | Cursor control system and cursor control method |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI650638B (en) * | 2017-08-17 | 2019-02-11 | 凌華科技股份有限公司 | System module built on a non-intrusive data capture system to simulate machine operation screens |
| TWI660290B (en) * | 2017-12-29 | 2019-05-21 | 宏正自動科技股份有限公司 | Resource sharing device and control method thereof |
| CN110968210A (en) * | 2018-09-28 | 2020-04-07 | 宏正自动科技股份有限公司 | Switching device and switching system and applicable method thereof |
| TWI693535B (en) * | 2019-03-11 | 2020-05-11 | 凌華科技股份有限公司 | Mouse cursor image detection comparison and feedback state judgment method |
| TWI731531B (en) * | 2019-12-27 | 2021-06-21 | 宏碁股份有限公司 | Computer system and display controlling method thereof |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060288314A1 (en) * | 2005-06-15 | 2006-12-21 | Microsoft Corporation | Facilitating cursor interaction with display objects |
| CN101059726A (en) * | 2005-12-14 | 2007-10-24 | 宏正自动科技股份有限公司 | Kvm system for controlling computers and method thereof |
| CN101377724A (en) * | 2007-08-29 | 2009-03-04 | 富士通电子零件有限公司 | Information processing apparatus, KVM switch, server, and program |
| TW200939071A (en) * | 2008-03-14 | 2009-09-16 | June On Co Ltd | Computer switcher containing consolidated manipulation of bridging framework and multi-screen mouse-navigating type |
| CN102117187A (en) * | 2009-12-31 | 2011-07-06 | 华为技术有限公司 | Method, device and system for displaying multi-area screen during remote connection process |
| CN103186250A (en) * | 2011-12-30 | 2013-07-03 | 宏正自动科技股份有限公司 | Remote management system and remote management method |
| CN104067202A (en) * | 2012-12-31 | 2014-09-24 | 华为技术有限公司 | Method, device and system for synchronizing mice |
-
2014
- 2014-06-10 TW TW103120081A patent/TWI497400B/en active
-
2015
- 2015-03-24 CN CN201510130127.XA patent/CN105183269B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060288314A1 (en) * | 2005-06-15 | 2006-12-21 | Microsoft Corporation | Facilitating cursor interaction with display objects |
| CN101059726A (en) * | 2005-12-14 | 2007-10-24 | 宏正自动科技股份有限公司 | Kvm system for controlling computers and method thereof |
| CN101377724A (en) * | 2007-08-29 | 2009-03-04 | 富士通电子零件有限公司 | Information processing apparatus, KVM switch, server, and program |
| TW200939071A (en) * | 2008-03-14 | 2009-09-16 | June On Co Ltd | Computer switcher containing consolidated manipulation of bridging framework and multi-screen mouse-navigating type |
| CN102117187A (en) * | 2009-12-31 | 2011-07-06 | 华为技术有限公司 | Method, device and system for displaying multi-area screen during remote connection process |
| CN103186250A (en) * | 2011-12-30 | 2013-07-03 | 宏正自动科技股份有限公司 | Remote management system and remote management method |
| CN104067202A (en) * | 2012-12-31 | 2014-09-24 | 华为技术有限公司 | Method, device and system for synchronizing mice |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110955340A (en) * | 2018-09-26 | 2020-04-03 | 致伸科技股份有限公司 | Cursor control system and cursor control method |
Also Published As
| Publication number | Publication date |
|---|---|
| TW201546698A (en) | 2015-12-16 |
| TWI497400B (en) | 2015-08-21 |
| CN105183269B (en) | 2018-03-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105183269B (en) | Method for automatically identifying screen where cursor is located | |
| CN107340853B (en) | Remote presentation interaction method and system based on virtual reality and gesture recognition | |
| CN111601120A (en) | Wireless screen transmission display system and display method | |
| CN103636197B (en) | Send terminal, image display control method and send system | |
| CN107071551B (en) | Multi-screen interactive screen response method applied to smart television system | |
| CN109343810A (en) | Control switching method, device and KVM switch | |
| CN103731645A (en) | Law enforcement and case handling system based on wireless video transmission technology | |
| CN106612401B (en) | video matrix control device and video matrix control method | |
| KR20220063205A (en) | Augmented reality for setting up an internet connection | |
| US10887195B2 (en) | Computer system, remote control notification method and program | |
| CN103488422A (en) | Method and equipment for controlling terminal displaying interface | |
| CN113014960B (en) | Method, device and storage medium for online video production | |
| CN109976689B (en) | Method and device for rapidly configuring distributed splicing processor by using smart phone | |
| CN111612177A (en) | Interactive semantic based augmented reality intelligent operation and maintenance system | |
| CN110099224B (en) | Pre-monitoring display method, device and system, computer equipment and storage medium | |
| US20130263045A1 (en) | Screen display device and screen display system | |
| CN106134184A (en) | Information terminal, system, control method and record medium | |
| CN103399722B (en) | A kind of Digital Clustering transmission and control system | |
| CN114741015A (en) | Remote control data transmission method and device and electronic equipment | |
| CN101710944A (en) | Method for controlling all-around zoom and focus of device without all-around zoom and focus function | |
| CN105278901B (en) | Remote management method | |
| CN101808221A (en) | Subtitle remote control method and system | |
| CN103747191A (en) | Network interaction high-definition character superimposition system | |
| CN116016812A (en) | Seat management system, plotting processing system and plotting processing method | |
| CN204272298U (en) | Multichannel expanded type multi-screen splicer |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |