CN105183269B - Method for automatically identifying screen where cursor is located - Google Patents
Method for automatically identifying screen where cursor is located Download PDFInfo
- Publication number
- CN105183269B CN105183269B CN201510130127.XA CN201510130127A CN105183269B CN 105183269 B CN105183269 B CN 105183269B CN 201510130127 A CN201510130127 A CN 201510130127A CN 105183269 B CN105183269 B CN 105183269B
- Authority
- CN
- China
- Prior art keywords
- image
- screen
- upper limb
- long
- vernier
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 35
- 210000001364 upper extremity Anatomy 0.000 claims description 94
- 238000013507 mapping Methods 0.000 claims description 4
- 238000012545 processing Methods 0.000 description 26
- 230000008859 change Effects 0.000 description 15
- 238000010586 diagram Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 6
- 210000004556 brain Anatomy 0.000 description 5
- 238000006243 chemical reaction Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 5
- 230000005611 electricity Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 230000006835 compression Effects 0.000 description 4
- 238000007906 compression Methods 0.000 description 4
- 230000001360 synchronised effect Effects 0.000 description 4
- 238000006073 displacement reaction Methods 0.000 description 3
- 238000010835 comparative analysis Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 238000013519 translation Methods 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Landscapes
- User Interface Of Digital Computer (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The method for automatically identifying the screen where the cursor is located comprises the following steps: generating a vertical movement amount according to the sum of the vertical resolution of the first image and the vertical resolution of the second image; using the remote management device to move the cursor of the target computer to the upper edge region on the first screen or the second screen according to the vertical movement amount; respectively capturing images of the first screen and the second screen in the upper edge area by using a remote management device to obtain a first upper edge image and a second upper edge image; horizontally moving the cursor to a first direction for a distance by using the remote management device; capturing an image of the first screen in the upper edge area to obtain a third upper edge image; and performing image recognition on the first upper edge image and the third upper edge image to identify whether the third upper edge image changes relative to the first upper edge image.
Description
Technical field
Method of the present invention on screen where a kind of automatic identification vernier；Specifically, the present invention is used on one kind
The method of screen where recognizing vernier automatically in the remote system of multi-screen.
Background technology
Multi-computer switch (Keyboard-Video-Mouse Switch；KVM Switch) allow user single
One group of keyboard, screen and mouse carry out more object computers of management and control.This group of keyboard, screen and mouse connect via multi-computer switch
At most platform object computer.Via multi-computer switch, signal that screen and mouse are sent can reach wherein one it is chosen
Object computer, and this object computer can also be via multi-computer switch image output so far screen.It can so save
Space, the energy and hardware cost.Multi-computer switch is applied to data center, Computer Facilities, general personal and plant produced
The board equipment of line.
In addition, referring to Figure 1A, a multi-computer switch 15 for possessing network interface can be described as the more computer switchings of network-type
Device (IP-based KVM Switch), it controls computer 30 (generally desktop or laptop computer) in further causing one
User U target positioned at long-range controlled computer (or be object computer) 20 and can be watched by more of network management
The picture that computer transmits via network.This network-type multi-computer switch is modeled to one group of key being directly connected to object computer
Disk, screen and mouse, and will be passed through after the picture catching of object computer output and middle control computer 30 is returned to by network.Citing comes
Say, consequently, it is possible to which the user positioned at first ground can be by network-type multi-computer switch by remote management with being located at second computer room
Central server, Buddhist is walked back and forth as in second directly manipulation object computer.Also, the use of network-type multi-computer switch
Person generally not only one, different users can successively manipulate same mesh by the middle control computer 30 positioned at heterogeneous networks position
Mark computer 20.
As shown in Figure 1B, using upper there is the problem of one so-called " mouse is asynchronous " in network-type multi-computer switch,
That is, the user of middle control computer 30 can see two trips when operating object computer on its operation screen (real screen) 40
Mark situation about chasing.Because middle control computer 30 itself can produce a vernier (calling in the following text " the first vernier "), and object computer also can
Another vernier (calling in the following text " the second vernier ") is produced, when the picture (remote pictures) 23 of object computer is cut by the more computers of network-type
When parallel operation catches and then passed back middle control computer, it will cause to use because of the superposition of remote pictures 23 and near-end picture 33
Person sees " the first vernier " 31 and " the second vernier " 21 simultaneously, and the two verniers are located at the situation of diverse location.Sometimes "
First vernier " 31 may be far apart with " the second vernier " 21, because the user of network-type multi-computer switch as previously described
Generally not only one, different users can successively manipulate same target by the middle control computer 30 positioned at heterogeneous networks position
Computer 20, therefore for current user, when a certain object computer 20 are switched to, " the second vernier " 21 rises
Position rested on previous user and finally positioned away from beginning.That is, current user is before starting to operate object computer 20
And the original position of " the second vernier " 21 can not be determined.Therefore, if do not solved the problems, such as so-called " mouse is asynchronous ", it will right
Current user causes the puzzlement on precise manipulation, because will not know will be with which vernier in operation screen by user
On positioned and clicked.
As shown in Figure 1 C, network-type multi-computer switch just will be carried out to solve the problems, such as above-mentioned " mouse is asynchronous "
The process of so-called " mouse is synchronous ", that is, " the first vernier " 31 and " the second vernier " 21 must be first moved to same position,
Such as the upper left corner (35,25) of screen is moved to, then open " the first vernier " 31 uses to user again.But because net
Network type multi-computer switch is one group of keyboard, screen and mouse for object computer, therefore the more computers of network-type switch
Device simultaneously can not directly be obtained the messages such as the coordinate of vernier by the operating system of object computer.And in the mouse of some operating systems
Under coordinate, because network-type multi-computer switch can to know in " the second vernier " 21 (before including synchronization) at any time
Which position on screen, so network-type multi-computer switch is at this time not aware that the how many amount of movement ability of mouse to be given
" the second vernier " 21 is moved to the upper left corner of screen.In order to ensure " the second vernier " 21 can be moved to the upper left corner of screen,
The amount of movement that network-type multi-computer switch is assigned to " the second vernier " 21 is that screen vertical resolution Yy parses with horizontal in fact
Yx sum total is spent, that is, is closed in the vector of vertical direction and the possible maximum moving distance of horizontal direction.However, current network
Type multi-computer switch only supports single screen, under the framework that object computer supports multi-screen, because the more computers of network-type are cut
Parallel operation does not know which platform screen " the second vernier " 21 falls on not only, and network-type multi-computer switch less knows " the second trip
Mark " 21 falls which position on which platform screen, so it simultaneously can not be effectively by " the first vernier " 31 and " the second vernier "
21 same positions being moved on a certain screen, that is, traditional network-type multi-computer switch and effectively can not enter automatically
Row is so-called " mouse is synchronous ".Therefore, the framework of multi-screen is supported for object computer, for asking for above-mentioned " mouse being asynchronous "
Topic is real to be necessary to propose a set of effective settling mode.
The content of the invention
The purpose of the present invention is a kind of method of screen where providing automatic identification vernier, makes long-range vernier and near-end
The synchronization of vernier is more efficiently.
In one embodiment, the present invention provides a kind of identification vernier institute automatic in the long-distance management system for supporting multi-screen
Screen method, comprise the steps of：(A) long-distance management system is provided, it is remote that the long-distance management system comprises at least one
Thread management device, the long-distance management device have one first image-input end mouth and one second image-input end mouth, wherein this
One image-input end mouth corresponds to one first screen and the second image-input end mouth corresponds to one second screen；(B) mesh is made
Exportable one first image of computer is marked to the first image-input end mouth and exports one second image to second image-input end
Mouthful, and produce a vernier on first screen or second screen；(C) make the long-distance management device can be via network by one
Control computer is controlled；(D) with the long-distance management device capture respectively first image that the object computer exported and this second
Image, and control respectively in this and control screen in one of computer and produce one first thumbnail image and one second thumbnail image, wherein should
First thumbnail image corresponds to first image and second thumbnail image corresponds to second image；(E) according to first shadow
The summation of the vertical resolution of the vertical resolution of picture and second image produces a vertical movement；(F) with the remote management
Device makes the vernier of the object computer be moved to according to the vertical movement on first screen or second screen on one
Edge region；(G) image of first screen and second screen in the upper edge region is captured with the long-distance management device respectively, with
Obtain one first upper limb image and one second upper limb image；(H) vernier is made to a first direction water with the long-distance management device
The dynamic distance of translation；(I) image of first screen in the upper edge region is captured, to obtain one the 3rd upper limb image；(J) to this
First upper limb image and the 3rd upper limb image carry out image identification, to identify the 3rd upper limb image relative to first upper limb
Whether image changes.
In one embodiment, the present invention provides a kind of identification vernier institute automatic in the long-distance management system for supporting multi-screen
Screen method, comprise the steps of：(A) long-distance management system is provided, it is remote that the long-distance management system comprises at least one
Thread management device, the long-distance management device have one first image-input end mouth and one second image-input end mouth, wherein this
One image-input end mouth corresponds to one first screen and the second image-input end mouth corresponds to one second screen；(B) mesh is made
Exportable one first image of computer is marked to the first image-input end mouth and exports one second image to second image-input end
Mouthful, and produce a vernier on first screen or second screen；(C) make the long-distance management device can be via network by one
Control computer is controlled；(D) with the long-distance management device capture respectively first image that the object computer exported and this second
Image, and control respectively in this and control screen in one of computer and produce one first thumbnail image and one second thumbnail image, wherein should
First thumbnail image corresponds to first image and second thumbnail image corresponds to second image；(E) according to first shadow
The summation of the horizontal resolution of picture and the horizontal resolution of second image produces the amount of moving horizontally；(F) with the remote management
Device makes the vernier of the object computer be moved to according to the amount of moving horizontally on first screen or second screen on one
Edge region；(G) image of first screen and second screen in the upper edge region is captured with the long-distance management device respectively, with
Obtain one first upper limb image and one second upper limb image；(H) vernier is made to be hung down to a first direction with the long-distance management device
A distance is moved in translation；(I) image of first screen in the upper edge region is captured, to obtain one the 3rd upper limb image；(J) to this
First upper limb image and the 3rd upper limb image carry out image identification, to identify the 3rd upper limb image relative to first upper limb
Whether image changes.
In one embodiment, the present invention provides a kind of identification vernier institute automatic in the long-distance management system for supporting multi-screen
Screen method, comprise the steps of：(A) long-distance management system is provided, it is remote that the long-distance management system comprises at least one
Thread management device, the long-distance management device have one first image-input end mouth and one second image-input end mouth, wherein this
One image-input end mouth corresponds to one first screen and the second image-input end mouth corresponds to one second screen；(B) mesh is made
Exportable one first image of computer is marked to the first image-input end mouth and exports one second image to second image-input end
Mouthful, and produce a vernier on first screen or second screen；(C) make the long-distance management device can be via network by one
Control computer is controlled, and then makes to be converted into the control for controlling computer in this control to the object computer；(D) with the long-range pipe
Reason device capture first image and second image that the object computer is exported respectively, with this control computer one in control
Screen produces a mapping image；(E) according to first image resolution and second image resolution summation produce one
Amount of movement；(F) made with the long-distance management device vernier of the object computer according to the amount of movement first screen or this
A fringe region is moved on two screens；(G) first screen and second screen are captured with the long-distance management device respectively
Image, to obtain a first edge image and a second edge image；(H) vernier is made to one first with the long-distance management device
Direction moves horizontally a distance；(I) image of first screen in the fringe region is captured, to obtain one the 3rd edge image；
(J) image identification is carried out to the first edge image and the 3rd edge image, to identify the 3rd edge image relative to this
Whether first edge image changes.By the method for screen where the automatic identification vernier of the present invention, can be obtained by image identification
Screen where knowing vernier, and then improve the synchronous efficiency of mouse.
Brief description of the drawings
Figure 1A is the schematic diagram for the long-distance management system that tradition has multiscreen display apparatus；
Figure 1B is the nonsynchronous schematic diagram of mouse；
Fig. 1 C are that tradition solves the nonsynchronous schematic diagram of mouse；
Fig. 2A present invention has the embodiment schematic diagram of the long-distance management system of multiscreen display apparatus；
Fig. 2 B and Fig. 2 the C present invention have another embodiment schematic diagram of the long-distance management system of multiscreen display apparatus；
Fig. 3 A-1 to 3A-2 are an embodiment flow chart of screen where automatic identification vernier；
Fig. 3 A-3 to 3A-4 are another embodiment flow chart of screen where automatic identification vernier；
Fig. 3 B are embodiment schematic diagram of the moving cursor to fringe region；
Fig. 3 C are the embodiment schematic diagram that is moved along first level direction after moving cursor to fringe region；
Fig. 3 D be under multi-screen system moving cursor to fringe region embodiment schematic diagram；
Fig. 3 E to Fig. 3 G be under multi-screen system moving cursor to fringe region different embodiment schematic diagrams；
Fig. 3 H-1 to 3H-2 are another embodiment flow chart of screen where automatic identification vernier.
【Symbol description】
100 long-distance management systems
Computer is controlled in 110
The screens of 111-1 the 3rd
The screens of 111-2 the 4th
120 object computers
The screens of 121-1 first
The screens of 121-2 second
The screens of 121-3 the 3rd
The screens of 121-4 the 4th
123 remote pictures
125b-1 top margins
125b-2 bottom margins
125b-3 lefts border
125b-4 rights border
The 125c-1 upper left corners
The 125c-2 lower left corners
The 125c-3 upper right corner
The 125c-4 lower right corner
125u upper edge regions
125d lower edges region
125l left borders region
125r right borders region
127 verniers
200 long-distance management devices
210 computer interfaces
210a computers connectivity port
220 network interfaces
250 image processing modules
260 central processing units
500 computer interface modules
510 the oneth RS-485 transceivers
520 the 2nd RS-485 transceivers
530 differential drives
540 differential receivers
600 category-5 cables
Dx1 first levels direction
Embodiment
The invention discloses a kind of long-distance management system for supporting multi-screen.This long-distance management system comprises at least a long-range pipe
Manage device.This this long-distance management system controls computer in making one can control an object computer by network.In a preferred embodiment,
This long-distance management device can be a network-type multi-computer switch, and this network-type multi-computer switch can manage one or more targets
Computer.This long-distance management device can simulate two or more screens to same object computer, same to make
Platform object computer can export signal of video signal more than two-way or two-way to this long-distance management device.Because the long-range pipe of the present invention
Reason system supports multi-screen, therefore the image that the long-distance management system of the present invention can export certain object computer to multiple screens
The middle control computer of the network other end is mapped to, that is, produces a mapping image on one or more screens of control computer in this.
This more virtual screens mainly correspond to among long-distance management device capturing the image letter of object computer output
Number memory or other buffer storage devices.And this more virtual screens can be corresponded to one or more screens of middle control computer end
Curtain, for example, when long-distance management device is modeled to two screens, the two virtual screens can be corresponded to the single screen of middle control computer
Curtain, or it is respectively corresponding to two different screens.In addition, in order to carry out " mouse is synchronous " or other functions, present invention head
The place screen of the vernier of object computer and position can first be found out.For example, it is assumed that the long-distance management system of the present invention
One first screen and one second screen, long-distance management system of the invention can be simulated is by the vernier that can pick out object computer
Fall on the first screen or the second screen.If assuming, vernier falls on the first screen, and the present invention still identifies that vernier falls
Particular location on first screen.
Fig. 2A is referred to, the present invention provides a kind of long-distance management system 100, and long-distance management system 100 of the invention is at least
Include a long-distance management device 200.Via computer 110 is controlled in network-coupled to one, this is remote for one end of this long-distance management device 200
The other end of thread management device 200 is then to be coupled to an object computer 120 via appropriate interface.In this way, as the remote of bridge
Thread management device 200 can make it that control computer 110 can be through being network controlled the object computer 120, that is, this object computer 120 in this
Reaction can be produced to the operational order from middle control computer 110.Computer 110 is controlled in this, and there is one or more stack screens and vernier to control
Device, such as keyboard and mouse.In addition, this long-distance management device 200 can be modeled to one or more stack screens, keyboard and mouse, or
It is that (as depicted in Fig. 2A dotted line frames, long-distance management device 200 is modeled to keyboard, mouse and has the first screen other devices
121-1 and the second screen 121-2 multi-screen system).When simulating more stack screens, this object computer 120 can be long-range to this
Managing device 200 exports multigroup signal of video signal, and receives one group of keyboard and mouse signal.In addition, it is middle control computer 110 one or
More stack screens, keyboard and mouse can map one or more stack screens, the keyboard and mouse that so far long-distance management device 200 is simulated
(for example, the 3rd screen 111-1 of middle control computer 110 corresponds to long-distance management device 200 with the 4th screen 111-2 and simulated respectively
The the first screen 121-1 gone out and the second screen 121-2).Therefore, through thus long-distance management system 100, user for keyboard and
The operation of mouse can be converted into the operation for object computer 120.It is worth noting that, middle control computer 110 uses screen
Quantity can be identical or different from the quantity for the screen that long-distance management device 200 is simulated.Middle control computer 110 uses screen
Quantity can be single individual entity screen or there is identical quantity with virtual screen.
Fig. 2 B are referred to, this long-distance management device 200 has at a computer interface 210, a network interface 220 and an image
Module 250, wherein computer interface 210 are managed connecting an at least object computer 120；Network interface 220 is then via network-coupled
Computer 110 is controlled into one so that can be assisted between middle control computer 110 and this long-distance management device 200 according to appropriate network communication
View (such as ICP/IP protocol group) is communicated to exchange data.This image processing module 250 is mainly capturing object computer
The signal of video signal (analog or digital) of 120 outputs, and carry out follow-up image processing.It may be included during image processing
The steps such as the adjustment of color depth, the conversion of image coordinate, image compression and coding.Image processing module 250 may be included also
Differential signal of video signal is reduced to single-ended signal of video signal, and original signal of video signal is converted into digital shadow according to above-mentioned steps
As the function of data.
Among a preferred embodiment, there are the computer interface 210 of this long-distance management device 200 one or more can connect mesh
Mark the computer connectivity port 210a of computer 120.In a preferred embodiment, each computer connection of this long-distance management device 200
Port 210a can more have an image-input end mouth, a keyboard/mouse output port.Wherein image-input end mouth is connecting mesh
Mark the image output port of computer 120；Keyboard/mouse output port to linking objective computer 120 keyboard/mouse input
Mouthful.This keyboard/mouse input port or keyboard/mouse output port can be USB interface, PS/2 interfaces or other any suitably connect
Mouthful.Also, for long-distance management device 200, each computer connectivity port 210a image-input end mouth and keyboard/mouse
Output port can be incorporated among single individual connector.
Referring still to Fig. 2 B, in a further preferred embodiment, the computer connectivity port 210a of this computer interface 210 is not straight
An object computer is connected in succession, and it is via a computer interface module (Computer Interface Module；CIM) 500 coupling
To another object computer 120.In this case, the computer connectivity port 210a of this computer interface 210 has at least one RJ-
45 connectors so that this computer interface can be connected by a category-5 cable (CAT-5Cable) 600 with the RJ-45 of computer interface module
Device connects.That is, one end of this category-5 cable is connected to the RJ-45 connectors of computer interface, the other end is then connected to computer interface mould
The RJ-45 connectors of block 500.The function of this computer interface module 500 includes simulating keyboard, screen and mouse, and to image
The processing of signal is to extend the transferable distance of signal of video signal.In order to simulate keyboard and mouse, in this computer interface module 500
Portion has can be according to the controller that keyboard and mouse related protocol is communicated, such as USB device controller or PS/2 controllers
Deng.In order to simulate screen, this inside of computer interface module 500 has the memory that can store EDID, such as EEPROM.
Fig. 2 C are referred to, this computer interface module 500 is extending between long-distance management device 200 and object computer 120
Distance, such as up to 1000 feet.This computer interface module 500 has one the oneth RS-485 transceivers
(Transceiver) 510 and a differential drive (Differential Driver) 530.Corresponding, in remote management
The computer interface 210 at this end of device 200 then has one the 2nd RS-485 transceivers (Transceiver) 520 and one differential connect
Receive device (Differential Receiver) 540.Wherein, the first RS-485 transceivers 510 are to according to the reception of RS-485 agreements
Control signal and data from long-distance management device 200, such as keyboard/mouse signals.Differential drive 530 is to by target
The single-ended signal of video signal (such as rgb signal and adjoint synchronizing signal) that computer 120 exports is converted to three groups of differential signal of video signal,
Will pass through three twisted pair wires among category-5 cable 600 (or other similar cables) to transmitting to long-distance management device 200.
In addition, differential receiver 540 corresponds to foregoing differential driver 530, to receive three from object computer 120
The differential signal of video signal of group, and it is reduced to the single-ended signal of video signal of script.2nd RS-485 transceivers of computer interface 210
520 correspond to the first RS-485 transceivers 510 of computer interface module 500, to according to RS-485 agreements and computer interface mould
Block 500 exchanges data, to send the signals such as the keyboard/mouse of middle control computer 100 to object computer 120.Computer interface mould
Block 500 is also referred to as converter (Adapter), server interface module (Server Interface Module；SIM) or
Computer control module (Computer Access Module；CAM).
Referring still to Fig. 2 C, this long-distance management device 200 can more include a central processing unit 260, and the 2nd RS-485 is received
Send out the part that the differential drive 540 of device 520 and one can be foregoing computer interface 210.The function of central processing unit 260 is at least wrapped
Containing image processing module 250 is coupled into network interface 220, and network interface 220 is coupled to the 2nd RS-485 transceivers
520.Digital image data of this central processing unit 260 mainly to self imaging processing module in future 250 is packaged into network package
And parsing is related to the network package of keyboard or mouse from middle control computer 110, then again by wherein about keyboard or mouse
Operation message sends corresponding first RS-485 transceivers 510 to via the 2nd RS-485 transceivers 520.This central processing unit
260 involve the upper strata of associated the Internet protocol when more can be as the progress network communication of network interface 220.If by taking osi model as an example
Illustrate, when this network interface 220 is as physical layer and link (Data Link) layer, this central processing unit 260 can be used as net
Network layers, transport layer, meeting layer, presentation layer and application layer.If illustrating by taking DoD models as an example, when this network interface 220 is as company
When tying layer, this central processing unit 260 can be used as Internet, transport layer and application layer.The above-mentioned function of central processing unit 260
It can change and be realized with controller, specific use integrated circuit (ASIC) or FPGA.
The user of central control computer 110 is at middle this end of control computer via keyboard/mouse or other control systems to target
When computer 120 is operated, middle control computer 110 can be by the control signal that keyboard/mouse is exported according to appropriate network communication
Protocol conversion is network package, and long-distance management device 200 is sent in order to via network.Also, long-distance management device 200 can
The network package that control computer 100 is transmitted in being received via its network interface 220, then again by network package included in
The readable reference format of object computer, such as the usb signal of standard or PS/2 signals are converted to after control signal parsing, walks back and forth Buddhist such as
It is general that object computer 120 is directly emitted to the keyboard/mouse by middle control computer 110.That is, long-distance management device 200 can incite somebody to action
The middle network package that transmits of control computer 110 is reduced to after the control signal of script output to object computer 120, so as to so that control
Object computer 120.
On the other hand, object computer 120 controls signal of video signal that the control signal of computer 110 exported (such as VGA in
Signal) it can be captured by image processing module 250 as multiple continuous image frames (Frame), then passing through appropriate image
Network package is converted to after processing, and middle control electricity is returned to by network package via network and according to appropriate network communication protocol
Brain 110.This acquisition may include the process that analog image signal is converted to digital image data, such as by among analog signal
RGB compositions be respectively converted into 0 to 255 pixel value (Pixel Value) after be stored in a manner of two-symbol in memory.
And above-mentioned image processing process may also include the step of image compression or coding, image frame is being converted to network envelope by it
Carried out before bag.
In addition, in more detail, image processing module 250 is understood be further subdivided into multiple blocks by image frame, and before comparison
To judge which block changes, which block does not change all blocks of two continuous image frames afterwards.In order to reduce in net
The data volume transmitted on network, the data of the block changed among image frame just by carry out image compression and can be converted to network envelope
Bag.It is worth noting that, although an object computer 120, actually this image processing module 250 are only shown in fig. 2 c
Multiple Image processing channels may be included, can once to handle signal of video signal of the multichannel from similar and different object computer.
And a handover module (not shown) may be had more between computer interface 210 and image processing module 250, so as to by more
One or more object computers are selected among object computer while carry out above-mentioned image processing.This handover module is probably by multiple
The framework that matrix form switching circuit is formed.
Central control computer 110 will receive the network package that is related to image data and be reduced to appropriate signal of video signal
After (it may be identical or different with the video signal format of source terminal), the user of middle control computer 110 can be by the one of network
The image that object computer 120 is exported is seen at end, and and then control this object computer 120, Buddhist of walking back and forth is such as direct control targe electricity
Brain 120 is general.This reduction, which may include, converts digital signals into analog signal and the process of image decompression or decoding.
The invention discloses a kind of side of the screen where identification vernier automatic in the long-distance management system for supporting multi-screen
Method, the application of this multi-screen may include extension table top function.This vernier refers to (foregoing second of vernier caused by object computer
Vernier), vernier (the first foregoing vernier) caused by not middle control computer.This second vernier can be because long-distance management device pair
The relation that object computer carries out image capture is also shown on the screen of middle control computer.The quantity of screen has no in the present invention
Limitation, but for ease of illustration for the sake of, only illustrated below by taking two screens as an example.
Fig. 3 A-1 and Fig. 3 A-2 are referred to, method of the invention comprises at least step 301 to step 312.Wherein, step
301 provide a long-distance management systems, and this long-distance management system causes an object computer to be controlled via network by control computer in one
System.The long-distance management system comprises at least a long-distance management device and a program being implemented on middle control computer (is commonly referred to as
For Viewer), reduction and restructuring purposes of this program mainly as foregoing correction of image data network package so that middle control computer
The image corresponding to object computer can be shown on its screen.In more detail, passed through between middle control computer and long-distance management device
It is mutually coupled by network；Then it is mutually coupled between long-distance management device and object computer in a manner of non-network network.This is long-range
Managing device can be modeled to one or more groups of keyboards, mouse and screen, and the long-distance management device is more provided the object computer
One network interface, the network communication interface between computer is controlled as the object computer and in this so that in the object computer and this
Controlling computer can be via the network exchange data related to image and keyboard/mouse.That is, the object computer can be via the long-range pipe
Reason system output image signal controls computer into this, and control computer can export keyboard/mouse via the long-distance management system in this
Related instruction is marked to the object computer.But the long-distance management device is not the network connection end for being connected to the object computer
Mouthful, but it is connected to image output port and the keyboard/mouse input port of the object computer.That is, the object computer is not
The data related with image and keyboard/mouse are exchanged to controlling computer in this by the NIC of itself.
In more detail, the long-distance management device has one first image-input end mouth and one second image-input end mouth,
And the long-distance management device is modeled to one first screen and one second screen, wherein the first image-input end mouth corresponds to first
Screen and the second image-input end mouth corresponds to second screen.This first image-input end mouth and one second image-input end
Mouth is corresponded to foregoing image processing module, and the main frame of the inside of the long-distance management device is such as preceding Fig. 2A to figure
Described in 2C related description.
The long-distance management device is connected to an object computer by step 302, makes exportable one first image of the object computer
To the first image-input end mouth and one second image is exported to the second image-input end mouth.Wherein first image has one
First resolution and second image has one second resolution.First resolution further includes one first vertical resolution and one
First level resolution；Second resolution further includes one second vertical resolution and one second horizontal resolution.In more detail
Say, first video conversion can be one first image data and by second image according to preceding description by the long-distance management device
It is stored in after being converted to one second image data in the memory of correlation.
In addition, the object computer can produce a vernier on first screen or second screen, in answering for extension table top
Under, the vernier can vacillate between first screen and second screen, that is, the vernier may pass through the side of first screen
Boundary subsequently into second screen among；Either, the vernier may pass through the border of second screen subsequently into first screen
Among curtain.Under the application of extension table top, one of first screen and second screen are main screen, and another is secondary
Want screen.When using the extension table top at the beginning, user can open an application program in main screen, and then will represent to answer
Secondary screen is towed to the form of program, when object computer start next time, the form of this application program will directly go out
On the present secondary screen.
In more detail, the first image output port of object computer is connected to the remote management by step 302 with cable
First image-input end mouth of device, and that with another cable the second image output port of object computer is connected into this is long-range
Second image-input end mouth of managing device.And this step can be more included the keyboard/mouse output end of long-distance management device
Mouth is connected to the keyboard/mouse input port of object computer with cable.For extended distance, in long-distance management device and target electricity
There may be foregoing computer interface module between brain, and the object computer is distinguished by two different computer interface modules
Couple the long-distance management device.In actual use, in order that the long-distance management device can differentiate its more group image received
From same object computer or come from different object computers, and different images source and middle control computer end entity screen
The corresponding relation of curtain (middle control screen), user may must carry out setting to a certain degree to the long-distance management device.
Step 303 makes the long-distance management device to be controlled via network by control computer in this.The user of middle control computer
The long-distance management device can be set via the operate interface that a web browser is provided and follow-up operation, it sets
Setting of image quality can be included；It operates comprising selected certain object computer and switched between different object computers.Separately
Outside, after certain object computer is selected, in addition to it can see on the screen of middle control computer corresponding to the image of object computer,
The operation of the keyboard/mouse of user's centering control computer of middle control computer can also be typically administered remotely system and be converted to for target electricity
The operation of brain.
Refer to Fig. 3 A-3 and Fig. 3 A-4.In more detail, wherein the step 303 further includes step 303-1 to step
303-3.Step 303-1 is controlled in this opens a web browser (Web Brower) on computer；Step 303-2 is via the webpage
Browser inputs the network address of the long-distance management device to show that one logins picture；Step 303-3 logins picture via this and stepped on
Enter the long-distance management device, to carry out the subsequently operation to the long-distance management device.Such as the long-distance management device is set
Fixed (Configuration).When the long-distance management device connects more object computers, the user of middle control computer more can be via
An appropriate man-machine interface selection wherein object computer carries out subsequent operation.Its man-machine interface is included by web browser institute shape
Into screen display menu (OSD), this screen display menu may list multiple port numberings for representing different target computer
And port name is for selection, and this screen display menu may also can show the state of these object computers, such as online
(On-Line) or offline (Off-Line), wherein off-line state represents this object computer and is not keyed up.
In addition, computer is controlled in this and is connected to one the 3rd screen and one the 4th screen of entity, wherein the 3rd screen pair
Should be in the first image-input end mouth of long-distance management device, the second image that the 4th screen corresponds to long-distance management device inputs
Port.That is, the 3rd screen correspond to first screen；4th screen corresponds to second screen.Via foregoing (step
302) setting can implement above-mentioned corresponding relation.Mainly with such a framework, (multiple virtual screens are to multiple entities below
Screen) illustrate, but in a further preferred embodiment, it is (multiple can be only connected to single individual entity screen for control computer in this
Virtual screen is to single individual entity screen).That is, corresponding to foregoing first screen the first image and corresponding to the second screen
Second image can be presented on same entity screen (middle control screen the long-distance management system in a manner of contract drawing or overlapping
Curtain) on.That is, the image that certain object computer exports to multiple screens can be mapped to network by the long-distance management system of the present invention
The middle control computer of the other end, a mapping image is produced on one or more screens of computer to be controlled in this.
Step 304 captures first image and second shadow that the object computer exported with the long-distance management device respectively
Picture, to store the pixel value (Pixel corresponding to those images among the memory or other buffer storage devices of correlation
Value), and then continuous image frame is established.After appropriate image processing, compression or coding is passed through, long-distance management device
The coherent video data for the picture that object computer is subtracted can be sent to middle control computer by network, and then in the 3rd screen
Shown on curtain and the 4th screen (or single entities screen).Therefore, user can feel to walk back and forth Buddhist as directly operated object computer
Typically.
Please refer to Fig. 3 A-1, Fig. 3 D and Fig. 3 E, step 305 according to first image vertical resolution and this second
The summation of the vertical resolution of image produces a vertical movement Y, and this vertical movement Y would is that vernier in the first screen and the
Maximum actual displacement possible to the vertical direction of two screens.That is, if the vertical resolution of this first image is Y1；
The vertical resolution of this second image is Y2, then this vertical movement Y is equal to Y1+Y2.Also, if in this long-distance management system
Middle that number of screen is set as into four, then this vertical movement Y will be Y1+Y2+Y3+Y4.That is, this vertical movement Y is equal to
The quantity for the multipath video that Y1+Y2+Y3+ ...+YN, wherein N are exported by object computer, that is, long-distance management device is for same
The quantity for the image-input end mouth that platform object computer is provided, that is, long-distance management device is simulated for same object computer
Screen quantity.Either, in a further preferred embodiment also can be according to the level solution of the input image of all simulated screens
The summation of analysis degree produces the amount of a moving horizontally X.That is, X is equal to X1+X2+X3+ ...+XN.This amount of moving horizontally X would is that vernier exists
Maximum actual amount of movement possible to horizontal direction.
Step 306 makes the vernier of the object computer according to the vertical movement in first screen with the long-distance management device
One " upper edge region " or one " lower edge region " are moved on curtain or second screen.In more detail, because in the present invention should
Long-distance management device is modeled to a mouse and other devices to the object computer, therefore the long-distance management device can be actively to target
Computer sends a vernier move, and the content of this vernier move includes this amount of movement, make the vernier of the object computer according to
One " upper edge region " or one " lower edge region " are moved on a certain screen according to the vertical movement.The operating system of object computer
The change on image (it shows that the content of the display-memory of card can update) can be produced according to this vernier move,
And then react and exported in object computer on the first or second signal of video signal to long-distance management device.No matter also, (enter at the beginning
Before row mouse synchronization) vernier falls in which position of which platform screen, can ensure according to this horizontal or vertical amount of movement
Vernier can be moved and stop certain screen " fringe region " wherein.
As shown in Figure 3 B, long-distance management device (remote pictures) 123 in the picture that object computer exports produce vernier
127, and vernier 127 is moved to fringe region according to horizontal or vertical amount of movement.This " fringe region " can wrap in the present invention
Containing four regions such as " upper edge region " 125u, " lower edge region " 125d, " right border region " 125r and " left border region " 125l.To hang down
Nogata is exemplified by, because actual movable distance of the vernier 127 on screen can not possibly be more than this vertical movement, foundation
This vertical movement, which carrys out moving cursor 127, can ensure that vernier 127 can be moved into and rest on a certain screen " upper limb area
Domain " 125u or " lower edge region " 125d.Similarly, if carrying out moving cursor 127 according to this amount of moving horizontally, it will be possible to ensure that vernier
127 can be moved and stop " right border region " 125r of a certain screen wherein or " left border region " 125l.Fig. 3 B are also shown
Go out upper left corner 125c-1, lower left corner 125-2, upper right corner 125c-3, lower right corner 125c-4, top margin 125b-1, bottom margin
125b-2, left border 125b-3 and right border 125b-4.
Refer to Fig. 3 D to Fig. 3 G, its illustrate in the present invention no matter the quantity of multiple screens why, and its that
How is relative putting position between this, can ensure vernier according to the horizontal or vertical amount of movement that described above is calculated
It can be moved and stop " fringe region " of certain screen wherein.
By taking Fig. 3 D as an example, if the second screen 121-2 superpositions, on the first screen 121-1, and vernier 127 falls at the beginning
On first screen 121-1, vernier 127 can be moved with Y=Y1+Y2 by the first screen 121-1 according to above-mentioned vertical movement
Move to the second screen 121-2 " upper edge region " 125u.By taking Fig. 3 E as an example, if the first screen 121-1 and the second screen 121-2 that
This is the relation of left and right adjacent, parallel, and vernier 127 falls on the first screen 121-1 at the beginning, is vertically moved according to above-mentioned
Vernier 127 can be moved to its " upper edge region " 125u by amount with Y=Y1+Y2 by the first screen 121-1.Although this amount of movement is big
Y is in the actual transportable distance (being less than Y1+Y2) of vernier, but vernier still can rest on the first screen 121-1 " upper limbs
Region " 125u.
Again by taking Fig. 3 F as an example, if long-distance management system supports four screens, respectively the first screen 121-1, the second screen
121-2, the 3rd screen 121-3 and the 4th screen 121-4, and the relative position of this four screens is rough into a matrix as shown in the figure
Shape.Assuming that vernier 127 falls on the 4th screen 121-4 at the beginning, according to above-mentioned vertical movement can by vernier 127 with
Y=Y1+Y2+Y3+Y4 is moved to the 3rd screen 121-3 " upper edge region " 125u by the 4th screen 121-4.Although this amount of movement
Big Y in the actual transportable distance (being less than Y3+Y4) of vernier, but vernier still can rest on the first screen 121-3 " on
Edge region " 125u.
Again more by taking Fig. 3 G as an example, if long-distance management system supports four screens, respectively the first screen 121-1, the second screen
Curtain 121-2, the 3rd screen 121-3 and the 4th screen 121-4, and the relative position of this four screens is irregular into one as shown in the figure
Ornaments.Assuming that vernier 127 falls on the first screen 121-1 at the beginning, according to above-mentioned vertical movement can by vernier 127 with
Y=Y1+Y2+Y3+Y4 is moved to the 3rd screen 121-3 " upper edge region " 125u by the first screen 121-1.Although this amount of movement
Big Y is in the actual transportable distance (being less than Y1+Y2+Y3) of vernier, but vernier still can rest on the 3rd screen 121-3
" upper edge region " 125u.
On the other hand, because the aspect ratio (Aspect Ratio) of general screen is all vertically oriented narrow and horizontal direction
Width, therefore vernier will usually be less than the displacement of horizontal direction in the displacement of vertical direction, can in vertical direction movement
Obtain preferably mobile efficiency.In addition, because under some operating systems, when vernier is moved to bottom margin or the right of screen
It can be hidden behind border or part hides, therefore be that preferred embodiment is carried out with vertical direction and " upper edge region " below the present invention
Illustrate, but one skilled in the art it is cognizable be that the present invention is not intended to as limit.For on the lower section side of screen
For boundary or right border will not hide the operating system of vernier, the present invention is being hung down during screen where vernier is identified
Nogata is to vernier can be also moved to " lower edge region "；Vernier can be also moved to " right border region " or " left border in the horizontal direction
Region ".
Please refer to Fig. 3 A-1 and Fig. 3 C, step 307 captures first screen and second screen in the " upper limb respectively
The image in region ", to obtain one first upper limb image and one second upper limb image.Alternatively, long-distance management device is picked respectively
First screen and the full frame image of second screen are taken, but long-distance management device is only to the first screen and second screen pair
Ying Yu " upper edge region " image data carries out follow-up image comparative analysis (image recognition).This " upper edge region " or " lower edge
The width in region " be first screen relative to first image horizontal resolution, or the second screen relative to this second
The horizontal resolution of image, and " upper edge region " or the height in " lower edge region " are at least the height of this vernier.In general, one
The height and width of individual vernier are about that 32 pixels are multiplied by 32 pixels, but the actually outward appearance of vernier and size can be via
The setting of operating system and change, therefore the present invention herein only for example, being not intended to as limit.Because the solution of the first image
The resolution of analysis degree and the second image may be identical or different, thus " upper edge region " of the first screen or " lower edge region " with
" upper edge region " of second screen or " lower edge region " may also be identical or different in size.
Please refer to Fig. 3 A-1 and Fig. 3 C, step 308 makes the vernier 127 in " upper edge region " along a first level
Direction dx1 moves a distance.This first level direction can be right or left, the width of this preferably about one vernier of distance
Degree, such as 32 pixels.
Fig. 3 A-1 are referred to, step 309 captures image of first screen in " upper edge region ", to obtain on one the 3rd
Edge image.Alternatively, long-distance management device captures the full frame image of first screen, but long-distance management device is only to first
The image data that screen corresponds to " upper edge region " carries out follow-up image comparative analysis (image recognition).Step 310 to this
One upper limb image and the 3rd upper limb image carry out image identification, to identify the 3rd upper limb image relative to the first upper limb figure
Seem no change.If judging to change in the step 310, it can determine that the vernier falls on first screen；If in step
Judge unchanged in 310, then can determine that the vernier is not to fall on first screen or have other kind of situation.
Fig. 3 A-2 are referred to, because actually long-distance management system is not aware that vernier is to fall in the first screen also at the beginning
It is on the second screen, therefore this step first attempts whether the wherein a certain screen (such as first screen) of observation has after step 309
Produce the change on image.If the observed screen has the change on image, because this change is started because in the movement of vernier,
Therefore it may determine that the first screen has reacted for foregoing vernier move, therefore step 310 may determine that vernier falls
On the first screen.If without the change on image, will may determine that vernier is not to fall on the first screen, though or vernier
Be so fall on the first screen but because other reasonses and caused by unchanged (the reason for the causing such a situation and will in response to method of image
After being specified in).
If judging the image that is captured twice before and after the first screen and unchanged in the step 310, step 311 and step are performed
Rapid 312.Wherein step 311 captures image of second screen in " upper edge region ", to obtain one the 4th upper limb image.Because
In the step 310 it is determined that the first screen is for vernier move and reactionless, therefore vernier falls on the second screen
Probability is quite big.Because to the mode and the mode of the image of the first screen of foregoing acquisition of the upper limb image of the second screen shot the 4th
It is identical, no longer repeated herein.Step 312 carries out image identification to the second upper limb image and the 4th upper limb image, with
Judge whether the 4th upper limb image changes relative to the second upper limb image.
Please refer to Fig. 3 A-2 and Fig. 3 B, if identifying the 4th upper limb image relative to the second upper limb in step 312
Image changes generation, then can determine that the vernier falls on second screen；If two screens are equal in step 310 and step 312
Judge it is unchanged, then can determine that the vernier fall a certain corner regions of first screen or second screen (but not comprising a left side
Upper angle 125c-1).That is, the vernier 127 may be moved to first screen or the upper right of second screen after step 306
Angle 125c-3, lower right corner 125c-4 or lower left corner 125c-2 and stashed by operating system, therefore the first screen or this
Two screens for step 308 all without visual reaction is produced, so can not see first in step 310 and step 312
Or second screen have change on front and rear two images.
Fig. 3 H-1 and Fig. 3 H-2 are referred to, if running into situation as the above, are followed the steps below.Step is carried out first
308-1.Step 308-1 is similar with step 308, but step 308-1 makes the vernier in " upper edge region " along one second water
Square to a mobile distance, and the second horizontal direction and first level are in opposite direction.That is, if step 308 makes vernier towards the right side
Fang Yidong, then step 308-1 make vernier towards left move.Then step 309-1 and step 310-1 is carried out.Step 309-1 with
Step 309 is similar, and step 309-1 captures image of first screen in " upper edge region ", to obtain one the 5th upper limb image；
Step 310-1 is similar with step 310, and step 310-1 carries out image identification to the first upper limb image and the 5th upper limb image,
To judge whether the 5th upper limb image changes relative to the first upper limb image.
If judging to change in step 310-1, it can determine that the vernier falls on first screen；If in step 310-
Judge unchanged in 1, then can determine that the vernier is not to fall on first screen, that is, vernier falls on the second screen.
Understood based on foregoing explanation, produced by the present invention before carrying out mouse synchronization can pick out object computer
Vernier fall on the first screen or the second screen, and position of this vernier where it on screen.Because the present invention
Position of this vernier where it on screen can be picked out, therefore the present invention will no longer be required to give target electricity such as conventional art
Maximum on one resolution of screen diagonal of brain is bound to be moved to the upper left corner of screen with ensuring vernier, and the present invention will be according to
According to the relative putting position of multi-screen interlude to one appropriate amount of movement of object computer so that by the vernier of object computer, (second swims
Mark) be moved to the vernier (the first vernier) of middle control computer at that time where position, to carry out mouse synchronization, and computer is controlled in this
Vernier where position be not usually screen the upper left corner.Either, the present invention also can be by vernier (the first trip of middle control computer
Mark movement) to object computer vernier (the second vernier) at that time where position.After mouse synchronization is carried out, remote management system
The right to use of cursor control device will be released to the user of middle control computer by system, and the user of middle control computer can be with accurate
Vernier caused by ground manipulation object computer.
It is worth noting that, the present invention long-distance management device can also be non-network mode entity connect one group in control dress
Put, such as a stack screen, keyboard and mouse.This group of control device can be described as the near-end control device of long-distance management device；This screen
Curtain can be described as the near-end screen of long-distance management device, and user can also be by long-distance management device with this near-end control device pair
The object computer is operated.The present invention according to described above for the vernier of object computer it is mobile or it is middle control computer for mesh
Marking the change caused by the operation of computer on image can also show that (example by vernier by being moved to marginal zone on this near-end screen
The process in domain), but this change may make human eye be not easy or can not discover because of the relation of excessive velocities.
Although the technology contents of the present invention are disclosed above with preferred embodiment, so it is not limited to the present invention,
Any those skilled in the art, make a little change and retouching in the spirit for not departing from the present invention, should all be covered by the present invention
Category in, therefore protection scope of the present invention depending on appended claims institute defender when being defined.
Claims (17)
1. a kind of method of the screen where identification vernier automatic in the long-distance management system for supporting multi-screen, is comprised at least down
Row step：
(A) long-distance management system is provided, the long-distance management system comprises at least a long-distance management device, the long-distance management device
With one first image-input end mouth and one second image-input end mouth, wherein the first image-input end mouth corresponds to one first
Screen and the second image-input end mouth corresponds to one second screen；
(B) make exportable one first image of an object computer to the first image-input end mouth and one second image of output to this
Two image-input end mouths, and produce a vernier on first screen or second screen；
(C) long-distance management device is made to be controlled via network by control computer in one；
(D) first image and second image that the object computer exported are captured with the long-distance management device respectively, and point
Controlled not in this and screen one first thumbnail image of generation and one second thumbnail image, wherein the first contract drawing shadow are controlled in one of computer
As corresponding to second image corresponding to first image and second thumbnail image；
(E) produce and one vertically move according to the vertical resolution of first image and the summation of vertical resolution of second image
Amount；
(F) made with the long-distance management device vernier of the object computer according to the vertical movement first screen or this
A upper edge region is moved on two screens；
(G) image of first screen and second screen in the upper edge region is captured with the long-distance management device respectively, with
To one first upper limb image and one second upper limb image；
(H) vernier is made to move horizontally a distance to a first direction with the long-distance management device；
(I) image of first screen in the upper edge region is captured, to obtain one the 3rd upper limb image；
(J) image identification is carried out to the first upper limb image and the 3rd upper limb image, to identify that the 3rd upper limb image is relative
Whether changed in the first upper limb image.
2. the method as described in claim 1, it is characterised in that if identifying that the 3rd upper limb image is relative in the step (J)
Changed in the first upper limb image, then judge that the vernier falls on first screen.
3. the method as described in claim 1, it is characterised in that if identifying that the 3rd upper limb image is relative in the step (J)
In the first upper limb image and unchanged, then step (K) is carried out, the step (K) comprises at least：
(K-1) image of second screen in the upper edge region is captured, to obtain one the 4th upper limb image；
(K-2) image identification is carried out to the second upper limb image and the 4th upper limb image, to identify the 4th upper limb image phase
Whether changed for the second upper limb image.
4. method as claimed in claim 3, it is characterised in that if identifying the 4th upper limb image phase in the step (K-2)
Changed for the second upper limb image, then judge that the vernier falls on second screen.
5. method as claimed in claim 3, it is characterised in that if identifying the 4th upper limb image phase in the step (K-2)
For the second upper limb image and unchanged, then step (L) is carried out, the step (L) comprises at least：
(L-1) vernier is made to move horizontally a distance to a second direction with the long-distance management system；
(L-2) image of first screen in the upper edge region is captured, to obtain one the 5th upper limb image；
(L-3) image identification is carried out to the first upper limb image and the 5th upper limb image, to identify the 5th upper limb image phase
Whether changed for the first upper limb image.
6. method as claimed in claim 5, it is characterised in that if identifying the 5th upper limb image phase in the step (L-3)
Changed for the first upper limb image, then judge that the vernier falls on first screen.
7. method as claimed in claim 5, it is characterised in that if identifying the 5th upper limb image phase in the step (L-3)
It is unchanged for the first upper limb image, then judge that the vernier falls on second screen.
8. a kind of method of the screen where identification vernier automatic in the long-distance management system for supporting multi-screen, is comprised at least down
Row step：
(A) long-distance management system is provided, the long-distance management system comprises at least a long-distance management device, the long-distance management device
With one first image-input end mouth and one second image-input end mouth, wherein the first image-input end mouth corresponds to one first
Screen and the second image-input end mouth corresponds to one second screen；
(B) make exportable one first image of an object computer to the first image-input end mouth and one second image of output to this
Two image-input end mouths, and produce a vernier on first screen or second screen；
(C) long-distance management device is made to be controlled via network by control computer in one；
(D) first image and second image that the object computer exported are captured with the long-distance management device respectively, and point
Controlled not in this and screen one first thumbnail image of generation and one second thumbnail image, wherein the first contract drawing shadow are controlled in one of computer
As corresponding to second image corresponding to first image and second thumbnail image；
(E) produce and one move horizontally according to the horizontal resolution of first image and the summation of horizontal resolution of second image
Amount；
(F) made with the long-distance management device vernier of the object computer according to the amount of moving horizontally first screen or this
A upper edge region is moved on two screens；
(G) image of first screen and second screen in the upper edge region is captured with the long-distance management device respectively, with
To one first upper limb image and one second upper limb image；
(H) vernier is made to vertically move a distance to a first direction with the long-distance management device；
(I) image of first screen in the upper edge region is captured, to obtain one the 3rd upper limb image；
(J) image identification is carried out to the first upper limb image and the 3rd upper limb image, to identify that the 3rd upper limb image is relative
Whether changed in the first upper limb image.
9. method as claimed in claim 8, it is characterised in that if identifying that the 3rd upper limb image is relative in the step (J)
Changed in the first upper limb image, then judge that the vernier falls on first screen.
10. method as claimed in claim 8, it is characterised in that if identifying that the 3rd upper limb image is relative in the step (J)
In the first upper limb image and unchanged, then step (K) is carried out, the step (K) comprises at least：
(K-1) image of second screen in the upper edge region is captured, to obtain one the 4th upper limb image；
(K-2) image identification is carried out to the second upper limb image and the 4th upper limb image, to identify the 4th upper limb image phase
Whether changed for the second upper limb image.
11. method as claimed in claim 10, it is characterised in that if identifying the 4th upper limb image in the step (K-2)
Changed relative to the second upper limb image, then judge that the vernier falls on second screen.
12. method as claimed in claim 10, it is characterised in that if identifying the 4th upper limb image in the step (K-2)
Relative to the second upper limb image and unchanged, then step (L) is carried out, the step (L) comprises at least：
(L-1) vernier is made to vertically move a distance to a second direction with the long-distance management system；
(L-2) image of first screen in the upper edge region is captured, to obtain one the 5th upper limb image；
(L-3) image identification is carried out to the first upper limb image and the 5th upper limb image, to identify the 5th upper limb image phase
Whether changed for the first upper limb image.
13. method as claimed in claim 12, it is characterised in that if identifying the 5th upper limb image in the step (L-3)
Changed relative to the first upper limb image, then judge that the vernier falls on first screen.
14. method as claimed in claim 12, it is characterised in that if identifying the 5th upper limb image in the step (L-3)
It is unchanged relative to the first upper limb image, then judge that the vernier falls on second screen.
15. a kind of method of the screen where identification vernier automatic in the long-distance management system for supporting multi-screen, is comprised at least
The following steps：
(A) long-distance management system is provided, the long-distance management system comprises at least a long-distance management device, the long-distance management device
With one first image-input end mouth and one second image-input end mouth, wherein the first image-input end mouth corresponds to one first
Screen and the second image-input end mouth corresponds to one second screen；
(B) make exportable one first image of an object computer to the first image-input end mouth and one second image of output to this
Two image-input end mouths, and produce a vernier on first screen or second screen；
(C) long-distance management device is controlled via network by control computer in one, and then make the control to controlling computer in this
It is converted into the control to the object computer；
(D) first image and second image that the object computer exported are captured with the long-distance management device respectively, with
Controlled in this and the mapping image of screen generation one is controlled in one of computer；
(E) according to first image resolution and second image resolution summation produce an amount of movement；
(F) make the vernier of the object computer according to the amount of movement in first screen or second screen with the long-distance management device
A fringe region is moved on curtain；
(G) first screen and the image of second screen are captured with the long-distance management device respectively, to obtain a first edge
Image and a second edge image；
(H) vernier is made to move horizontally a distance to a first direction with the long-distance management device；
(I) image of first screen in the fringe region is captured, to obtain one the 3rd edge image；
(J) image identification is carried out to the first edge image and the 3rd edge image, to identify that the 3rd edge image is relative
Whether changed in the first edge image.
16. method as claimed in claim 15, it is characterised in that if identifying the 3rd edge image phase in the step (J)
Changed for the first edge image, then judge that the vernier falls on first screen.
17. method as claimed in claim 15, it is characterised in that if identifying the 3rd edge image phase in the step (J)
For the first edge image and unchanged, then step (K) is carried out, the step (K) comprises at least：
(K-1) image of second screen in the fringe region is captured, to obtain one the 4th edge image；
(K-2) image identification is carried out to the second edge image and the 4th edge image, to identify the 4th edge image phase
Whether changed for the second edge image.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW103120081 | 2014-06-10 | ||
| TW103120081A TWI497400B (en) | 2014-06-10 | 2014-06-10 | Method of auto-recognizing for cursor in monitors |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105183269A CN105183269A (en) | 2015-12-23 |
| CN105183269B true CN105183269B (en) | 2018-03-30 |
Family
ID=54343359
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510130127.XA Active CN105183269B (en) | 2014-06-10 | 2015-03-24 | Method for automatically identifying screen where cursor is located |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN105183269B (en) |
| TW (1) | TWI497400B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI650638B (en) * | 2017-08-17 | 2019-02-11 | 凌華科技股份有限公司 | System module built on a non-intrusive data capture system to simulate machine operation screens |
| TWI660290B (en) * | 2017-12-29 | 2019-05-21 | 宏正自動科技股份有限公司 | Resource sharing device and control method thereof |
| CN110955340B (en) * | 2018-09-26 | 2023-04-07 | 致伸科技股份有限公司 | Cursor control system and cursor control method |
| CN110968210A (en) * | 2018-09-28 | 2020-04-07 | 宏正自动科技股份有限公司 | Switching device and switching system and applicable method thereof |
| TWI693535B (en) * | 2019-03-11 | 2020-05-11 | 凌華科技股份有限公司 | Mouse cursor image detection comparison and feedback state judgment method |
| TWI731531B (en) * | 2019-12-27 | 2021-06-21 | 宏碁股份有限公司 | Computer system and display controlling method thereof |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101059726A (en) * | 2005-12-14 | 2007-10-24 | 宏正自动科技股份有限公司 | Kvm system for controlling computers and method thereof |
| CN101377724A (en) * | 2007-08-29 | 2009-03-04 | 富士通电子零件有限公司 | Information processing apparatus, KVM switch, server, and program |
| TW200939071A (en) * | 2008-03-14 | 2009-09-16 | June On Co Ltd | Computer switcher containing consolidated manipulation of bridging framework and multi-screen mouse-navigating type |
| CN102117187A (en) * | 2009-12-31 | 2011-07-06 | 华为技术有限公司 | Method, device and system for displaying multi-area screen during remote connection process |
| CN103186250A (en) * | 2011-12-30 | 2013-07-03 | 宏正自动科技股份有限公司 | Remote management system and remote management method |
| CN104067202A (en) * | 2012-12-31 | 2014-09-24 | 华为技术有限公司 | Method, device and system for synchronizing mice |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060288314A1 (en) * | 2005-06-15 | 2006-12-21 | Microsoft Corporation | Facilitating cursor interaction with display objects |
-
2014
- 2014-06-10 TW TW103120081A patent/TWI497400B/en active
-
2015
- 2015-03-24 CN CN201510130127.XA patent/CN105183269B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101059726A (en) * | 2005-12-14 | 2007-10-24 | 宏正自动科技股份有限公司 | Kvm system for controlling computers and method thereof |
| CN101377724A (en) * | 2007-08-29 | 2009-03-04 | 富士通电子零件有限公司 | Information processing apparatus, KVM switch, server, and program |
| TW200939071A (en) * | 2008-03-14 | 2009-09-16 | June On Co Ltd | Computer switcher containing consolidated manipulation of bridging framework and multi-screen mouse-navigating type |
| CN102117187A (en) * | 2009-12-31 | 2011-07-06 | 华为技术有限公司 | Method, device and system for displaying multi-area screen during remote connection process |
| CN103186250A (en) * | 2011-12-30 | 2013-07-03 | 宏正自动科技股份有限公司 | Remote management system and remote management method |
| CN104067202A (en) * | 2012-12-31 | 2014-09-24 | 华为技术有限公司 | Method, device and system for synchronizing mice |
Also Published As
| Publication number | Publication date |
|---|---|
| TW201546698A (en) | 2015-12-16 |
| TWI497400B (en) | 2015-08-21 |
| CN105183269A (en) | 2015-12-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105183269B (en) | Method for automatically identifying screen where cursor is located | |
| CN107340853B (en) | Remote presentation interaction method and system based on virtual reality and gesture recognition | |
| CN110266992A (en) | A kind of long-distance video interactive system and method based on augmented reality | |
| CN102142081B (en) | Image processing device, image processing method, and program | |
| US20140257532A1 (en) | Apparatus for constructing device information for control of smart appliances and method thereof | |
| CN107277494A (en) | three-dimensional display system and method | |
| CN103731645A (en) | Law enforcement and case handling system based on wireless video transmission technology | |
| KR20220063205A (en) | Augmented reality for setting up an internet connection | |
| CN110689621B (en) | Method, device and system for displaying three-dimensional models of house before and after decoration on same screen | |
| CN106652590A (en) | Teaching method, teaching recognizer and teaching system | |
| WO2019109828A1 (en) | Ar service processing method, device, server, mobile terminal, and storage medium | |
| CN111459432B (en) | Virtual content display method and device, electronic equipment and storage medium | |
| CN103488422A (en) | Method and equipment for controlling terminal displaying interface | |
| CN111710032B (en) | Method, device, equipment and medium for constructing three-dimensional model of transformer substation | |
| CN106134184A (en) | Information terminal, system, control method and record medium | |
| CN113014960A (en) | Method, device and storage medium for online video production | |
| WO2015008932A1 (en) | Digilog space creator for remote co-work in augmented reality and digilog space creation method using same | |
| CN112379815A (en) | Image capturing method and device, storage medium and electronic equipment | |
| CN114741015A (en) | Remote control data transmission method and device and electronic equipment | |
| CN113066189B (en) | Augmented reality equipment and virtual and real object shielding display method | |
| CN107053184A (en) | Multi-Agent Cooperation processing system and method based on private clound | |
| CN110288207A (en) | It is a kind of that the method and apparatus of scene information on duty is provided | |
| CN108553889A (en) | Dummy model exchange method and device | |
| CN105278901B (en) | Remote management method | |
| CN103279268B (en) | A kind of interactive approach based on controlled terminal list and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |