CN102662467A - Method and device for instruction control in remote assistance process - Google Patents
Method and device for instruction control in remote assistance process Download PDFInfo
- Publication number
- CN102662467A CN102662467A CN2012100867332A CN201210086733A CN102662467A CN 102662467 A CN102662467 A CN 102662467A CN 2012100867332 A CN2012100867332 A CN 2012100867332A CN 201210086733 A CN201210086733 A CN 201210086733A CN 102662467 A CN102662467 A CN 102662467A
- Authority
- CN
- China
- Prior art keywords
- window
- operation mark
- instruction
- destination application
- target operation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 58
- 230000008569 process Effects 0.000 title claims abstract description 29
- 230000004044 response Effects 0.000 claims description 13
- 230000005540 biological transmission Effects 0.000 claims description 12
- 230000008878 coupling Effects 0.000 claims description 6
- 238000010168 coupling process Methods 0.000 claims description 6
- 238000005859 coupling reaction Methods 0.000 claims description 6
- 244000188472 Ilex paraguariensis Species 0.000 claims description 5
- 238000004321 preservation Methods 0.000 claims description 5
- 230000013011 mating Effects 0.000 claims description 4
- 238000004088 simulation Methods 0.000 description 12
- 239000012467 final product Substances 0.000 description 7
- 238000012546 transfer Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 230000008859 change Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000003860 storage Methods 0.000 description 3
- 230000032683 aging Effects 0.000 description 2
- 240000007711 Peperomia pellucida Species 0.000 description 1
- 235000012364 Peperomia pellucida Nutrition 0.000 description 1
- 241000700605 Viruses Species 0.000 description 1
- 230000002155 anti-virotic effect Effects 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000005096 rolling process Methods 0.000 description 1
- 230000035882 stress Effects 0.000 description 1
- 238000010200 validation analysis Methods 0.000 description 1
Images
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a method and a device for instruction control in a remote assistance process. The method includes: when a master control end needs to transmit an instruction of moving a cursor to an operation target to a controlled end, allowing description information related to the operation target to be carried in the instruction; after the controlled end receives the instruction, analyzing the instruction to acquire the operation target description information carried in the instruction; and determining the position of the operation target according to the operation target description information to move the cursor to the position of the operation target according to indication of the instruction. By the aid of the method and the device for instruction control in the remote assistance process, instructions sent to controlled ends in the technician operation simulated remote assistance process can adapt to different screen resolutions of the controlled end, so that effectiveness of the instructions can be guaranteed.
Description
Technical field
The present invention relates to field of computer technology, particularly relate to command control method and device in the remote assistance process.
Background technology
The continuous development of Along with computer technology, computer equipments such as computer have almost become indispensable instrument in people's life.But, for a lot of users, the understanding of computer is only limited to application, but be ignorant of computer is safeguarded, in case computer break down, more at a loss what to do.For this reason; Some service providers provide the remote assistance service for the user; The user is as long as the remote assistance client that the build-in services merchant provides on the computer of oneself; Just can link up with the technician of service provider, the technician can help the common computer user to solve software and system problem, and for example system optimization, system mend upgrading, drive installation, malicious plugins cleaning, virus/wooden horse killing, system-based setting, software download, software are installed, network failure is debugged or the like.
In implementation procedure, the user can set up through remote assistance client and technician and get in touch.Then, the user can select to let the technician take over the operation to computer, and like this, the computer that the technician can long-range adapter user is for the user operates.Yet the slip-stick artist needs to carry out a lot of operations usually when solving certain software or system problem for the user; Therefore; In the prior art, generally needing the slip-stick artist is that the user provides man-to-man service, also is; A slip-stick artist is being after a user has solved certain problem only, could be other user's services.But the number of users in the network is numerous, the situation that numerous users initiates the remote assistance request simultaneously occurs through regular meeting; At this moment, if technician's number is not enough, then can cause user's wait; Increase technician's quantity influences the ageing of remote assistance function, and if can increase human cost.
In order to address the above problem, the inventor has proposed a kind of technology of the technician's of simulation operation, and about this technology, the applicant just applies for as an independent patent separately.In the technology of this simulation technician operation; In technician's side, the user is as long as tell to technician with the mode of dialogue that with the problem that oneself needs to solve the technician just can select the script that solves corresponding problem; By process simulation technician's operation, accomplish assistance work then.Like this, just can reduce technician's workload, make the technician in the identical time, can the remote assistance service be provided, be convenient to improve the ageing of remote assistance function for a plurality of users.
But in the process of simulation technician operation, may have following problem: in the process at remote assistance, need send instruction from technician's side direction user side, being carried out by user side should instruction.In the instruction that technician's side is sent; Relate to the situation that mouse is moved to certain position through regular meeting, under the situation of really being operated by the technician, the technician can see the screen state of user side; And on the user side screen that demonstrates on the display screen of oneself, carry out the operation of rolling mouse by the technician; Technician's side program can sent instruction to user side through catching the shift position of mouse on screen, so that user side is carried out.But; Under the situation of simulation technician operation, the operation of technician's side is carried out by program, but program can't be to the same screen of seeing user side intuitively of human eye; Therefore; How a kind of mode is provided, and calling program can be known need move to mouse where, is to press for the problem that those skilled in the art solve.
Summary of the invention
The invention provides command control method and device in the remote assistance process, can make in the remote assistance process of simulation technician operation when controlled terminal sends instruction, to adapt to the various different screen resolutions of controlled terminal, guarantee the validity of instruction.
The invention provides following scheme:
Command control method in a kind of remote assistance process comprises:
Need, the controlled terminal transmission in said instruction, carry descriptor when moving to the instruction at object run object place with cursor at the main control end about said object run object;
Controlled terminal is resolved said instruction after receiving said instruction, obtains the descriptor of the said object run object that wherein carries;
Confirm the position at said object run object place according to the descriptor of said object run object,, cursor is moved to the position at said object run object place so that according to the indication of said instruction.
Wherein, but said object run object comprises the target operation mark in the destination application window; The descriptor about said object run object of carrying in the said instruction comprises: but the title of said destination application and said target operation mark; Said descriptor according to said object run object confirms that the position at said object run object place comprises:
According to the window handle of each window of working as front opening, get access to the title of each window;
To from said instruction, resolve the title of the destination application that obtains and the title of said each window matees, the successful window of coupling confirmed as the window of destination application;
But in the window of said destination application, search the position of said target operation mark.
Wherein, but said position of in the window of said destination application, searching said target operation mark comprise:
But grasp the literal that shows on each operation mark that comprises in the window of said destination application;
But will from said instruction, resolve the title of the target operation mark that obtains and but literal that said each operation mark shows matees, but but the position of mating operation mark place successfully confirmed as the position of target operation mark.
Wherein, but said position of in the window of said destination application, searching said target operation mark comprise:
But operation mark that inquiry is preserved in advance and the relative position relation between the application window, but obtain the relative position relation between said target operation mark and the said destination application window;
According to the position at the window of said destination application place, but and the relative position relation between said target operation mark and the said destination application window, but confirm the position of said target operation mark.
Wherein, When there are at least two versions in said destination application; But said operation mark and the relative position relation of preserving in advance between the application window is: but be standard operation mark of preserving and the relative position relation between the application window with arbitrary version wherein, and said method also comprises:
But said cursor is moved to after the position of the target operation mark of determining, whether can meet with a response when judging in this position executable operations;
If can not, but then attempting in the presetting range around the position of the said target operation mark of determining, when executable operations, meet with a response.
CCE in a kind of remote assistance process comprises:
Instruction sending unit is used for need when the controlled terminal transmission moves to the instruction at object run object place with cursor, in said instruction, carrying the descriptor about said object run object at the main control end;
The instruction resolution unit is used for controlled terminal after receiving said instruction, and said instruction is resolved, and obtains the descriptor of the said object run object that wherein carries;
Position determination unit is used for confirming according to the descriptor of said object run object the position at said object run object place, so that according to the indication of said instruction, cursor is moved to the position at said object run object place.
Wherein, but said object run object comprises the target operation mark in the destination application window; The descriptor about said object run object of carrying in the said instruction comprises: but the title of said destination application and said target operation mark; Said position determination unit comprises:
Window title is obtained subelement, is used for the window handle according to each window of working as front opening, gets access to the title of each window;
Window is confirmed subelement, is used for the title of the destination application that obtains from said instruction parsing and the title of said each window are mated, and the successful window of coupling is confirmed as the window of destination application;
But subelement is confirmed in the operation mark position, but is used for searching at the window of said destination application the position of said target operation mark.
Wherein, but said operation mark position confirms that subelement comprises:
But the operation mark literal obtains subelement, but is used for grasping the literal that shows on each operation mark that the window of said destination application comprises;
The characters matching subelement; But but be used for and mate with the literal that said each operation mark shows from the title that the target operation mark that obtains is resolved in said instruction, but but the position that the operation mark of mating successfully belongs to confirmed as the position of target operation mark.
Wherein, but said operation mark position confirms that subelement comprises:
Relative position relation inquiry subelement, but be used to inquire about the operation mark of preservation in advance and the relative position relation between the application window, but obtain the relative position relation between said target operation mark and the said destination application window;
Comparer unit, position is used for the position according to the window of said destination application place, but and the relative position relation between said target operation mark and the said destination application window, but confirm the position of said target operation mark.
Wherein, When there are at least two versions in said destination application; But said operation mark and the relative position relation of preserving in advance between the application window is: but be standard operation mark of preserving and the relative position relation between the application window with arbitrary version wherein, and said device also comprises:
Judging unit, but be used for said mouse is moved to after the position of the target operation mark of determining, whether can meet with a response when judging in this position executable operations;
Fault-tolerant debugging unit, if be used for can not, but then around the position of the said target operation mark of determining, attempt in the presetting range, when executable operations, meet with a response.
According to specific embodiment provided by the invention, the invention discloses following technique effect:
Through the present invention; Operate in the process that realizes remote assistance the simulation technician, need when the controlled terminal transmission moves to the instruction at object run object place with cursor, can in instruction, carry descriptor about said object run object at the main control end; Like this; Controlled terminal just can obtain the descriptor of the object run object that wherein carries through instruction is resolved, and confirms the position at object run object place then according to the descriptor of object run object.Thus it is clear that, in implementation procedure, in the instruction that the main control end sends; Be not the position that identifies operand with the absolute coordinates of operand in screen, but the descriptor of operand, therefore; For controlled terminal, just can determine the position of operand through searching the operand that descriptor conforms to; And this descriptor can't change along with different screen resolutions; Therefore, just can adapt to different controlled terminal screen resolutions, guarantee the validity of instruction.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art; To do to introduce simply to the accompanying drawing of required use among the embodiment below; Obviously, the accompanying drawing in describing below only is some embodiments of the present invention, for those of ordinary skills; Under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the process flow diagram of the method that provides of the embodiment of the invention;
Fig. 2 is first schematic representation of apparatus that the embodiment of the invention provides;
Fig. 3 is second schematic representation of apparatus that the embodiment of the invention provides;
Fig. 4 is the 3rd schematic representation of apparatus that the embodiment of the invention provides;
Fig. 5 is the 4th schematic representation of apparatus that the embodiment of the invention provides.
Embodiment
To combine the accompanying drawing in the embodiment of the invention below, the technical scheme in the embodiment of the invention is carried out clear, intactly description, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, the every other embodiment that those of ordinary skills obtained belongs to the scope that the present invention protects.
In order to understand the present invention better; Need to prove that at first in the remote assistance process, technician's side is the equal of the main control end; User side is the equal of a controlled terminal; And the main control end just sends the instruction of keyboard and mouse to long-range controlled terminal computer, and the screen-picture of controlled terminal computer is come through the communication line passback simultaneously.That is to say; Operate at main control end control controlled terminal computer and to carry out on the computer seemingly before eyes; But essence is in long-range computer, to realize, no matter open file, still surf the web, download etc. all is to be stored in the long-range controlled terminal computer.
Wherein, The main control end program is to operate in the computer terminal that help is dealt with problems, and major function is the purpose that reaches the control remote computer through refreshing of the information transmission of the processing of picture, operation keyboard and the mouse of realization demonstration remote computer, incident, picture or the like.Specifically can be divided into:
1) attended operation
Can realize and being connected of controlled terminal through the transfer end.For example, after controlled terminal was connected to the transfer end, the main control end was connected to the transfer end; Select the controlled terminal that to control then; The input password carries out both sides' checking; Finally set up corresponding between main control and the controlled terminal.
2) picture shows
Set up local desktop window, initialization dependent picture information shows after the image information of long-range controlled terminal computing machine sends.
3) event handling
When the demonstration desktop window to this locality carried out various operations (like the input of mouse action, keyboard), program realized the seizure to event message, and was combined into packets of information according to specifying information and sends to long-range controlled terminal computing machine.
4) frame update
When local program receives message that long-range controlled terminal computing machine sends when being frame update, the program reception needs the image information content upgraded, makes up the subregion of realizing picture according to information and local display frame and upgrades operation.
The controlled terminal program is to operate in the computer terminal that need deal with problems, and major function is to reach and main control end assistance purpose through the simulation process of the transmission that realizes local image information, remote message incident, the processing of picture part area update or the like.Specifically can be divided into:
1) attended operation
, needs realize being connected to the main control end when assisting.During concrete the realization, still can carry out transfer through the transfer end, as, controlled terminal can at first be connected to the transfer end, waits for that the main control end is connected to the transfer end; After the main control end has been selected this controlled terminal, require main control end input validation password then, finally set up corresponding between main control and the controlled terminal.
2) Message Processing
Reception is carried out the message of various operations (like mouse action, keyboard input) from long-range main control end to showing desktop window, carries out local simulation and triggering according to the concrete message that receives then.
3) upgrade the zone
When variation that the picture of controlled terminal takes place, generate the update area domain information, be combined into data message and send to the requirement of main control end it carries out corresponding frame updating and shows.
Need to prove in addition, in order to realize simulating technician's operation, at first need be when using traditional mode to carry out remote assistance; Note the technician and carry out the network packet that produces in the process of remote assistance operation; If network data is surrounded by a plurality of, can also note the timestamp of each packet, so that operate corresponding source language with the technician according to analysis generation to said network packet; And the corresponding script of source language, supply the technician to select to use.After the script that has generated multiple source language and correspondence thereof, can demonstrate the title of each source language at the main control end, the technician can identify the implication of each source language according to title.When the technician receives the remote assistance request that the user sends; Can be at first through understanding the problem that the user need solve with the exchanging of user modes such as () for example transferring immediate news, the technician just can be directed against concrete problem then, speak in the corresponding source of the operation that needs when selecting to address this problem; The corresponding script of source language that just can select through operation afterwards; Carry out concrete operation, whole process is identical at controlled terminal with technician's practical operation.
In the process of simulation technician operation; For can being known, calling program need where mouse be moved to; Be to represent through the coordinate of operand in the controlled terminal screen, like this than what be easier to expect; Indication moves to certain coordinate place with mouse in the instruction of main control end, and controlled terminal is carried out according to this instruction and got final product.But, in practical application, can there be following problem:
Coordinate in the screen is relevant with the resolution of screen; Figuratively speaking, can be imagined as entire display screen is a large-scale chessboard, and the expression mode of resolution is exactly the number of all warps and parallel point of crossing; Each point of crossing corresponding a pixel; If with first point of the display screen upper left corner is that initial point is set up coordinate, then coordinate is the position that the point of (0,0) is just represented first pixel place in the upper left corner; Same, other each locations of pixels also can be come out through the coordinate representation in the coordinate system.
The resolution of different controlled terminal screens possibly be different, and same application program is when opening, and the default location of its window on screen also maybe be different, therefore, can't represent various possible situation with unified absolute coordinates.For example, the screen resolution of certain controlled terminal is 800*600, and the screen resolution of another controlled terminal is 1024*768, at this moment; For certain application program, even if when in different computers, opening, its window all is that acquiescence appears at certain fixed position (for example the centermost of screen also is that the center of application window overlaps with the center of screen); When representing the position of certain button in this application window with the coordinate in the screen so, also can be different, for example, for first controlled terminal; Certain button possibly be positioned at (400,300) to be located, and for second controlled terminal; This button but is to appear at (500,400) to locate, or the like.Therefore, when needing controlled terminal that mouse is moved to this button place, if in the program of main control end, using (400,300) or absolute coordinatess such as (500,400) to represent the position of button, obviously all is inappropriate.Only if require controlled terminal when carrying out remote assistance, at first the screen resolution with oneself is provided with as requested, but this can increase controlled terminal user's operation, and if the user do not understand how to be provided with, then can cause remote assistance to realize.
Therefore, in embodiments of the present invention, be not to represent the target position information that mouse need move to, and provided a kind of effective solution with the absolute coordinates of operand on screen.Referring to Fig. 1, the command control method in the remote assistance process that the embodiment of the invention provides can may further comprise the steps:
S101: need when the controlled terminal transmission moves to the instruction at object run object place with cursor, in said instruction, carry descriptor about said object run object at the main control end;
The main control end is when the controlled terminal transmission is carried out the instruction of certain operation to certain operand; Directly in instruction, provide the descriptor of operand; For example, controlled terminal is clicked the Start menu if desired, then directly in instruction, writes the title of this button exactly; But certain operation mark in certain application window of controlled terminal click (also promptly, can receive click commands, and provide certain response if desired; For example, possibly be certain action button or the like, for ease of describing; In embodiments of the present invention, be that example is introduced all with " button "), then can directly in instruction, show; Destination application title, and the target button title that needs click, or the like.
S102: controlled terminal is resolved said instruction after receiving said instruction, obtains the descriptor of the said object run object that wherein carries;
Controlled terminal can at first be resolved instruction after the instruction that receives the main control end, knows just can be searched voluntarily by the position of operand according to this information by after the information of operand.For example; If the operand that comprises in the instruction that receives is certain the target button in certain target program; And provided the title of target program and the target button in the instruction, then at first can grab the title of each window according to the window handle of each window of working as front opening; The target program title in the instruction and the title of each window are compared, and the window that title is complementary is exactly the window of target program.Find after the window of target program; If the button in the target program window is non-owner-draw button; The literal that then can Direct Recognition wherein shows on each button; Button name in the and instruction matees then, just can find the target button, and the operation that then mouse is moved to appointment in this button place execution command gets final product.Certainly, if the button in the target window is an owner-draw button, then can't directly grab the literal that shows on the button; To this situation; Can take following mode to realize: for the owner-draw button in the target program window, though can't grab the literal that shows on the button, generally have following characteristics: the default size of target window is generally fixed; And the position of specific button in window also generally all fixed; For example, certain button in certain window is the lower right at window, apart from x the pixel in window lower edge, apart from the right along y pixel place; Or the like, can preserve this positional information (can preserve) at controlled terminal in advance with the forms such as configuration file of controlled terminal program.Like this; After the instruction that receives the main control end; For the non-owner-draw button in the target program window, because the known position of target window, therefore just can pass through the mode of inquiring position information; Know the position of the target button, then cursor is moved to the operation of indicating in the instruction of this position execution main control end and get final product.
Certainly, need to prove that during to the relative position relation between owner-draw button save button and the application window, this relative position relation is the equal of the relative position relation that the developer sets above-mentioned when making window.Certainly; Actual displayed is on screen the time, and the actual size of window is also relevant with the true resolution of screen, therefore; For controlled terminal; When concerning the position of searching button according to the window that inquires and the position between the button, need to combine actual screen resolution to convert, finally determine the coordinate of button.For example, suppose that certain button of preservation and the relative position relation between the window are: apart from 10 pixels in window lower edge, apart from 15 pixel places, edge, the right; And the window's position of determining is: the apex coordinate in the window lower right corner is (150,100), that is to say that the ordinate of lower edge is 100, the horizontal ordinate 150 on edge, the right, and therefore, the position that can converse button is to locate in (90,135).
Need to prove in addition, generally speaking, possibly have different versions with a application program; In different versions, the position of each icon may be incomplete same in the application window, but generally can not do king-sized variation again; For example; Generally may be like this: in different versions, the button quantity in the window and the position, the pattern (size, the Vehicle that comprise button) that belong to separately be roughly the same, and only the position of button possibly have trickle variation.Concrete as, for certain antivirus software, in each different editions, possibly all can show " scan full hard disk " button, and button generally possibly be red at the middle position of window, or the like.To this situation; For the realization of supporting that button that aforementioned basis is preserved in advance and the position between the window concern to come the confirming button position; Certainly be respectively each version and preserve a cover relative position relation at controlled terminal; Specifically when inquiry, can inquire about relative position relation according to current application version with the corresponding preservation of this version.
But in embodiments of the present invention,, give the implementation that to support fuzzy matching in order to save the storage space of controlled terminal.Concrete; To the situation of a plurality of versions of same application, controlled terminal can be only according to the window design of some versions wherein, preserve the relative position relation between each button and the window; Specifically in the time need searching the position of button according to the button of preserving and the relative position relation between the window; No matter whether whether the version of current application program identical with that version of preserving, can at first search according to the relative position relation of preserving, and (foundation that whether finds of judgement can be: determine after certain coordinate according to the relative position relation of preserving if can directly find; Carry out operations such as corresponding click; Judged whether response, if having then prove the position of correctly having found button), then carry out follow-up operation and get final product.If directly do not find; Then can in the certain limit around certain coordinate of determining according to the relative position relation of preserving, attempt, for example, move several pixels to certain direction at this coordinate; Carrying out operation such as click respectively attempts; If attempt failure, then can also change other direction, till when operations such as execution click, meeting with a response to certain direction.Certainly, can successfully find button positions, then can send information to the technician, get involved processing by the technician at control end if be within the specific limits.That is to say that the embodiment of the invention provides certain fault tolerant mechanism when searching button positions; Like this; Even there are a plurality of versions in application program, also only need to preserve button and the relative position relation between the window, minimizing taking like this in wherein arbitrary version to storage space.
S103: confirm the position at said object run object place according to the descriptor of said object run object,, cursor is moved to the position at said object run object place so that according to the indication of said instruction.
Owing to determined the position of object run object, therefore, directly cursor is moved to corresponding position and get final product according to the indication in the instruction, follow-uply can also carry out operations such as click, input character.
In a word, in embodiments of the present invention, operate in the process that realizes remote assistance the simulation technician; Need, the controlled terminal transmission can in instruction, carry descriptor, like this when moving to the instruction at object run object place with cursor at the main control end about said object run object; Controlled terminal just can obtain the descriptor of the object run object that wherein carries through instruction is resolved, and confirms the position at object run object place then according to the descriptor of object run object; Thus it is clear that, in implementation procedure, in the instruction that the main control end sends; Be not the position that identifies operand with the absolute coordinates of operand in screen, but the descriptor of operand, therefore; For controlled terminal, just can determine the position of operand through searching the operand that descriptor conforms to; And this descriptor can't change along with different screen resolutions; Therefore, just can adapt to different controlled terminal screen resolutions, guarantee the validity of instruction.
Command control method in the remote assistance process that provides with the embodiment of the invention with respect to, the embodiment of the invention also provides the CCE in a kind of remote assistance process, referring to Fig. 2, this device can comprise:
Wherein, but said object run object can comprise the target operation mark in the destination application window; The descriptor about said object run object of carrying in the said instruction comprises: but the title of said destination application and said target operation mark; At this moment, referring to Fig. 3, position determination unit 203 specifically can comprise:
Window title is obtained subelement 2031, is used for the window handle according to each window of working as front opening, gets access to the title of each window;
Window is confirmed subelement 2032, is used for the title of the destination application that obtains from said instruction parsing and the title of said each window are mated, and the successful window of coupling is confirmed as the window of destination application;
But subelement 2033 is confirmed in the operation mark position, but is used for searching at the window of said destination application the position of said target operation mark.
During concrete the realization, referring to Fig. 4, but the operation mark position is confirmed subelement 2033 and can be comprised:
But the operation mark literal obtains subelement 20331, but is used for grasping the literal that shows on each operation mark that the window of said destination application comprises;
Perhaps, referring to Fig. 5, but the operation mark position is confirmed subelement 2033 and also can be comprised:
Relative position relation inquiry subelement 20333, but be used to inquire about the operation mark of preservation in advance and the relative position relation between the application window, but obtain the relative position relation between said target operation mark and the said destination application window;
Comparer unit, position 20334 is used for the position according to the window of said destination application place, but and the relative position relation between said target operation mark and the said destination application window, but confirm the position of said target operation mark.
In addition; When there are at least two versions in said destination application; But said operation mark and the relative position relation of preserving in advance between the application window is: but be standard operation mark of preserving and the relative position relation between the application window with arbitrary version wherein; At this moment, this device can also comprise:
Judging unit, but be used for said cursor is moved to after the position of the target operation mark of determining, whether can meet with a response when judging in this position executable operations;
Fault-tolerant debugging unit, if be used for can not, but then around the position of the said target operation mark of determining, attempt in the presetting range, when executable operations, meet with a response.
In a word, in the CCE in the remote assistance process that the embodiment of the invention provides, operate in the process that realizes remote assistance the simulation technician; Need, the controlled terminal transmission can in instruction, carry descriptor, like this when moving to the instruction at object run object place with cursor at the main control end about said object run object; Controlled terminal just can obtain the descriptor of the object run object that wherein carries through instruction is resolved, and confirms the position at object run object place then according to the descriptor of object run object; Thus it is clear that, in implementation procedure, in the instruction that the main control end sends; Be not the position that identifies operand with the absolute coordinates of operand in screen, but the descriptor of operand, therefore; For controlled terminal, just can determine the position of operand through searching the operand that descriptor conforms to; And this descriptor can't change along with different screen resolutions; Therefore, just can adapt to different controlled terminal screen resolutions, guarantee the validity of instruction.
Description through above embodiment can know, those skilled in the art can be well understood to the present invention and can realize by the mode that software adds essential general hardware platform.Based on such understanding; The part that technical scheme of the present invention contributes to prior art in essence in other words can be come out with the embodied of software product; This computer software product can be stored in the storage medium, like ROM/RAM, magnetic disc, CD etc., comprises that some instructions are with so that a computer equipment (can be a personal computer; Server, the perhaps network equipment etc.) carry out the described method of some part of each embodiment of the present invention or embodiment.
Each embodiment in this instructions all adopts the mode of going forward one by one to describe, and identical similar part is mutually referring to getting final product between each embodiment, and each embodiment stresses all is the difference with other embodiment.Especially, for device or system embodiment, because it is basically similar in appearance to method embodiment, so describe fairly simplely, relevant part gets final product referring to the part explanation of method embodiment.Apparatus and system embodiment described above only is schematic; Wherein said unit as the separating component explanation can or can not be physically to separate also; The parts that show as the unit can be or can not be physical locations also; Promptly can be positioned at a place, perhaps also can be distributed on a plurality of NEs.Can realize the purpose of present embodiment scheme according to the needs selection some or all of module wherein of reality.Those of ordinary skills promptly can understand and implement under the situation of not paying creative work.
More than to command control method and device in the remote assistance process provided by the present invention; Carried out detailed introduction; Used concrete example among this paper principle of the present invention and embodiment are set forth, the explanation of above embodiment just is used for helping to understand method of the present invention and core concept thereof; Simultaneously, for one of ordinary skill in the art, according to thought of the present invention, part all can change on embodiment and range of application.In sum, this description should not be construed as limitation of the present invention.
Claims (10)
1. the command control method in the remote assistance process is characterized in that, comprising:
Need, the controlled terminal transmission in said instruction, carry descriptor when moving to the instruction at object run object place with cursor at the main control end about said object run object;
Controlled terminal is resolved said instruction after receiving said instruction, obtains the descriptor of the said object run object that wherein carries;
Confirm the position at said object run object place according to the descriptor of said object run object,, cursor is moved to the position at said object run object place so that according to the indication of said instruction.
2. method according to claim 1 is characterized in that, but said object run object comprises the target operation mark in the destination application window; The descriptor about said object run object of carrying in the said instruction comprises: but the title of said destination application and said target operation mark; Said descriptor according to said object run object confirms that the position at said object run object place comprises:
According to the window handle of each window of working as front opening, get access to the title of each window;
To from said instruction, resolve the title of the destination application that obtains and the title of said each window matees, the successful window of coupling confirmed as the window of destination application;
But in the window of said destination application, search the position of said target operation mark.
3. method according to claim 2 is characterized in that, but said position of in the window of said destination application, searching said target operation mark comprises:
But grasp the literal that shows on each operation mark that comprises in the window of said destination application;
But will from said instruction, resolve the title of the target operation mark that obtains and but literal that said each operation mark shows matees, but but the position of mating operation mark place successfully confirmed as the position of target operation mark.
4. method according to claim 2 is characterized in that, but said position of in the window of said destination application, searching said target operation mark comprises:
But operation mark that inquiry is preserved in advance and the relative position relation between the application window, but obtain the relative position relation between said target operation mark and the said destination application window;
According to the position at the window of said destination application place, but and the relative position relation between said target operation mark and the said destination application window, but confirm the position of said target operation mark.
5. method according to claim 4; It is characterized in that; When there are at least two versions in said destination application; But said operation mark and the relative position relation of preserving in advance between the application window is: but be standard operation mark of preserving and the relative position relation between the application window with arbitrary version wherein, and said method also comprises:
But said cursor is moved to after the position of the target operation mark of determining, whether can meet with a response when judging in this position executable operations;
If can not, but then attempting in the presetting range around the position of the said target operation mark of determining, when executable operations, meet with a response.
6. the CCE in the remote assistance process is characterized in that, comprising:
Instruction sending unit is used for need when the controlled terminal transmission moves to the instruction at object run object place with cursor, in said instruction, carrying the descriptor about said object run object at the main control end;
The instruction resolution unit is used for controlled terminal after receiving said instruction, and said instruction is resolved, and obtains the descriptor of the said object run object that wherein carries;
Position determination unit is used for confirming according to the descriptor of said object run object the position at said object run object place, so that according to the indication of said instruction, cursor is moved to the position at said object run object place.
7. device according to claim 6 is characterized in that, but said object run object comprises the target operation mark in the destination application window; The descriptor about said object run object of carrying in the said instruction comprises: but the title of said destination application and said target operation mark; Said position determination unit comprises:
Window title is obtained subelement, is used for the window handle according to each window of working as front opening, gets access to the title of each window;
Window is confirmed subelement, is used for the title of the destination application that obtains from said instruction parsing and the title of said each window are mated, and the successful window of coupling is confirmed as the window of destination application;
But subelement is confirmed in the operation mark position, but is used for searching at the window of said destination application the position of said target operation mark.
8. device according to claim 7 is characterized in that, but said operation mark position confirms that subelement comprises:
But the operation mark literal obtains subelement, but is used for grasping the literal that shows on each operation mark that the window of said destination application comprises;
The characters matching subelement; But but be used for and mate with the literal that said each operation mark shows from the title that the target operation mark that obtains is resolved in said instruction, but but the position that the operation mark of mating successfully belongs to confirmed as the position of target operation mark.
9. method according to claim 7 is characterized in that, but said operation mark position confirms that subelement comprises:
Relative position relation inquiry subelement, but be used to inquire about the operation mark of preservation in advance and the relative position relation between the application window, but obtain the relative position relation between said target operation mark and the said destination application window;
Comparer unit, position is used for the position according to the window of said destination application place, but and the relative position relation between said target operation mark and the said destination application window, but confirm the position of said target operation mark.
10. device according to claim 9; It is characterized in that; When there are at least two versions in said destination application; But said operation mark and the relative position relation of preserving in advance between the application window is: but be standard operation mark of preserving and the relative position relation between the application window with arbitrary version wherein, and said device also comprises:
Judging unit, but be used for said mouse is moved to after the position of the target operation mark of determining, whether can meet with a response when judging in this position executable operations;
Fault-tolerant debugging unit, if be used for can not, but then around the position of the said target operation mark of determining, attempt in the presetting range, when executable operations, meet with a response.
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410543213.9A CN104252232B (en) | 2012-03-28 | 2012-03-28 | Command control method and device during remote assistance |
| CN201410543215.8A CN104252384B (en) | 2012-03-28 | 2012-03-28 | Command control method and device during remote assistance |
| CN201210086733.2A CN102662467B (en) | 2012-03-28 | 2012-03-28 | Method and device for instruction control in remote assistance process |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210086733.2A CN102662467B (en) | 2012-03-28 | 2012-03-28 | Method and device for instruction control in remote assistance process |
Related Child Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410543215.8A Division CN104252384B (en) | 2012-03-28 | 2012-03-28 | Command control method and device during remote assistance |
| CN201410543213.9A Division CN104252232B (en) | 2012-03-28 | 2012-03-28 | Command control method and device during remote assistance |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102662467A true CN102662467A (en) | 2012-09-12 |
| CN102662467B CN102662467B (en) | 2014-11-19 |
Family
ID=46771972
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210086733.2A Expired - Fee Related CN102662467B (en) | 2012-03-28 | 2012-03-28 | Method and device for instruction control in remote assistance process |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102662467B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103853470A (en) * | 2012-11-30 | 2014-06-11 | 腾讯科技（深圳）有限公司 | Data processing and displaying method, device and system |
| WO2016078219A1 (en) * | 2014-11-18 | 2016-05-26 | 中兴通讯股份有限公司 | Remote operation method and device for terminal |
| CN108920225A (en) * | 2018-05-03 | 2018-11-30 | 腾讯科技（深圳）有限公司 | Remote assistant control method and device, terminal, storage medium |
| CN109165062A (en) * | 2018-07-24 | 2019-01-08 | 苏宁易购集团股份有限公司 | A kind of terminal remote assists control method and system |
| CN112685109A (en) * | 2020-12-03 | 2021-04-20 | 南京机敏软件科技有限公司 | Method and system for dynamically identifying and recognizing remote application window |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5847752A (en) * | 1994-07-25 | 1998-12-08 | Siemens Aktiengesellschaft | Method for call setup and control of videotelephone communication |
| CN1605191A (en) * | 2001-12-14 | 2005-04-06 | 皇家飞利浦电子股份有限公司 | Remote control system and method for a television receiver |
| CN101316315A (en) * | 2007-05-28 | 2008-12-03 | 深圳Tcl工业研究院有限公司 | Fast focus locating method and device |
| CN102210140A (en) * | 2008-11-11 | 2011-10-05 | 索尼公司 | Techniques for implementing a cursor for televisions |
-
2012
- 2012-03-28 CN CN201210086733.2A patent/CN102662467B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5847752A (en) * | 1994-07-25 | 1998-12-08 | Siemens Aktiengesellschaft | Method for call setup and control of videotelephone communication |
| CN1605191A (en) * | 2001-12-14 | 2005-04-06 | 皇家飞利浦电子股份有限公司 | Remote control system and method for a television receiver |
| CN101316315A (en) * | 2007-05-28 | 2008-12-03 | 深圳Tcl工业研究院有限公司 | Fast focus locating method and device |
| CN102210140A (en) * | 2008-11-11 | 2011-10-05 | 索尼公司 | Techniques for implementing a cursor for televisions |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103853470A (en) * | 2012-11-30 | 2014-06-11 | 腾讯科技（深圳）有限公司 | Data processing and displaying method, device and system |
| WO2016078219A1 (en) * | 2014-11-18 | 2016-05-26 | 中兴通讯股份有限公司 | Remote operation method and device for terminal |
| CN105677450A (en) * | 2014-11-18 | 2016-06-15 | 中兴通讯股份有限公司 | Remote operating method and device for terminal |
| CN108920225A (en) * | 2018-05-03 | 2018-11-30 | 腾讯科技（深圳）有限公司 | Remote assistant control method and device, terminal, storage medium |
| CN109165062A (en) * | 2018-07-24 | 2019-01-08 | 苏宁易购集团股份有限公司 | A kind of terminal remote assists control method and system |
| CN112685109A (en) * | 2020-12-03 | 2021-04-20 | 南京机敏软件科技有限公司 | Method and system for dynamically identifying and recognizing remote application window |
| CN112685109B (en) * | 2020-12-03 | 2021-09-21 | 南京机敏软件科技有限公司 | Method and system for dynamically identifying and recognizing remote application window |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102662467B (en) | 2014-11-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2419863B1 (en) | Method and system for rendering composite view of an application | |
| CN105204875B (en) | The method and system of webpage calling native function | |
| CN105487882A (en) | Application software trial system, method, server and user device | |
| CN102662467B (en) | Method and device for instruction control in remote assistance process | |
| CN101506789A (en) | Techniques for providing accessibility options in remote terminal sessions | |
| CN102662618A (en) | Image processing method and device in remote assistance process | |
| CN107479957A (en) | A kind of switching method of Multiple system, device, equipment and storage medium | |
| CN110011875B (en) | Dial testing method, device, equipment and computer readable storage medium | |
| CN103477322A (en) | Transferring web data between operating system environments | |
| CN111078104B (en) | Redirection method of multi-point touch equipment on cloud desktop and computer equipment | |
| CN103513858A (en) | Remote assistance method and device | |
| CN102664924A (en) | Method and apparatus for information processing during remote assistance process | |
| CN105324753A (en) | Invoking an application from a web page or other application | |
| CN113961463A (en) | Application environment switching method and system, storage medium and electronic equipment | |
| CN104978185A (en) | Icon processing method and device thereof | |
| CN114490383A (en) | Remote debugging system, remote debugging method, computing device and readable medium | |
| CN113709243B (en) | Equipment remote control method and device, electronic equipment and storage medium | |
| US10193737B2 (en) | Method for performing communication between browser and mobile terminal, and browser apparatus | |
| CN104182229A (en) | Callback display method and device and callback method and device | |
| JPWO2006057061A1 (en) | Distributed transaction processing method, apparatus, and program | |
| CN111866557B (en) | Configuration method and device of large-screen display equipment, storage medium and electronic equipment | |
| WO2017096812A1 (en) | Webpage displaying method, mobile terminal, intelligent terminal, computer program, and storage medium | |
| CN104252232A (en) | Command control method and device in remote assistance process | |
| CN112491940B (en) | Request forwarding method and device of proxy server, storage medium and electronic equipment | |
| CN112306591A (en) | Remote debugging method and device based on page |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20141119 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |