CN102043623A - Screen word snatching realization method with word dragging function - Google Patents

Abstract

The invention discloses a screen word snatching realization method with a word dragging function, comprising the following steps: 1. loading a global mouse hook by a SetWindowsHookEx API (Application Programming Interface) function in the dll program of the Windows operating system of computer equipment; 2. when mouse hovering time exceeds dwell time set by a user, after the mouse hook captures mouse dwell information WM_MOUSEHOVER, performing the following operations by the program: redrawing the window; mounting an API hook to intercept an API function; matching position; 3. when the mouse hook captures left mouse button up information WM_LBUTTON UP, performing the following operation by the program: saving content on a clipboard; simulating Ctrl+C operation; obtaining the snatched word content; and restoring the content on the clipboard. Compared with the prior art, the invention is convenient for users to use and guarantees the popularity and the accuracy of word snatching.

Description

A kind of screen word-selecting implementation method of drawing the speech function that has

Technical field

The present invention relates to the speech method of getting on the screen, especially a kind of screen word-selecting implementation method of drawing the speech function that has under Windows operating system.

Background technology

Along with the arriving of information age, Word message miscellaneous is full of on people's computer.Sometimes, in order to obtain the word on the screen, the user have to by duplicate, a series of loaded down with trivial details operations such as stickup obtain this speech, this brings very big inconvenience to the user.People wish and can extract word on the screen by shirtsleeve operation more.So the speech technology of getting on the screen is arisen at the historic moment.The speech method of getting on the existing screen mainly contains two kinds:

The one, screen word-selecting, this method is directly extracted the word of mouse position on the screen by rolling mouse, adopt this method, the mode of operation that the user obtains word is simple, quick, weak point has two, 1. because participle technique is not mature enough, thereby cause the word got not accurate enough, be not inconsistent with user's idea, 2. some application software has adopted some special literal way of outputs (as the picture format that is of pdf reader output), cause the screen word-selecting function to completely lose therein, make troubles for user's use;

The 2nd, draw speech and get speech, being the user draws the word of getting on the screen and obtains word by pulling mouse, compares with screen word-selecting, and this method can be got the word on the screen more accurately, can some screen word-selectings get less than the place get speech, but it is loaded down with trivial details than screen word-selecting to get speech operation.

For overcoming screen word-selecting and draw the deficiency that speech got in speech, we propose to draw speech and get the method that speech and screen word-selecting combine use, get the advantage that both get speech.To draw that speech got in speech and screen word-selecting combines, traditional understanding is irrealizable.Yet our find through research, with screen word-selecting with draw a speech and get speech and combine technically and can realize fully.Because, under Windows operating system, literal great majority on the screen all are by the ExtTextOutW among the dynamic base GDI32.dll, ExtTextOutA, TextOutW, four function outputs of TextOutA, wherein ExtTextOutW and TextOutW are used for the output of Unicode character, and ExtTextOutA and TextOutA are used for the output of ANSI character, therefore, the word of wanting to grasp on the screen only needs by API HOOK technical intercept system calling above api function, and therefrom intercept and capture these function parameters and get final product, this is the universal method that realizes screen word-selecting.The present invention states conventional screen in realization and gets on the basis of speech, has creationaryly incorporated the method that speech got in stroke speech, has realized the combination that speech and screen word-selecting got in stroke speech.

Summary of the invention

The objective of the invention is to: a kind of screen word-selecting implementation method of drawing the speech function that has is provided, can be user-friendly to, can guarantee to get the versatility and the accuracy of speech again.

The technical scheme that the present invention is adopted for the technical solution problem is:

A kind of screen word-selecting implementation method of drawing the speech function that has of the present invention may further comprise the steps:

Step 1: overall mouse hook is installed

In the dll program of computer equipment Windows operating system, utilize the SetWindowsHookEx api function to load overall mouse hook, be used to catch each message of mouse; When the mouse hook captured mouse stop message WM_MOUSEHOVER, program was carried out the screen word-selecting operation, wherein, the residence time of described WM_MOUSEHOVER, can set according to user's custom; When the mouse hook captured left mouse button and upsprings message WM_LBUTTONUP, program was carried out and is drawn a speech and get the speech operation;

Step 2: screen word-selecting

Surpass the residence time that the user sets when the time of mouse-over, after the mouse hook of installation captured mouse stop message WM_MOUSEHOVER, program was carried out following operation,

A. repaint window

Obtain the coordinate data of mouse pointer current location on display by described mouse hook, and these data are saved in the internal memory of computer equipment, according to coordinate data, under mouse position, choose the micro rectangle frame of a 1px * 1px, utilize api function InvalidateRect to send and repaint message, repaint window to this rectangle frame;

B. carry API hook is intercepted and captured api function

When the Windows of computer equipment system receives when repainting message, the operating system of bottom ExtTextOutW, ExtTextOutA, these api functions of TextOutW, TextOutA among the calling system dynamic link library GDI32.dll is immediately carried out literal output, this seasonal program carry API hook, intercept and capture process calling by the API hook to above-mentioned api function, obtain the parameter of this api function, thereby realize seizure output string;

C. location matches

After capturing output string, calculate the coordinate figure on the border of this character string place rectangle frame, then the current mouse coordinates position of storing in the calculator memory and the boundary coordinate of this rectangle frame are compared, if mouse position is in rectangle frame, prove that this character string is exactly the current character string pointed of mouse, directly output gets final product; Otherwise will not export;

Step 3: draw speech and get speech

When the mouse hook captured left mouse button and upsprings message WM_LBUTTONUP, program was carried out following operation,

A. preserve the content on the clipbook

In program, use the OpenClipboard function and open system clipboard, obtain content of text data on the clipbook by the GetClipboardData function again, and it is saved in the internal memory of computing machine, define its variable g_oldString by name, call CloseClipboard functional relationships closed system clipbook again;

B. simulate the Ctrl+C operation

After the content of having preserved on the clipbook, routine call keybd_event function is simulated " Ctrl " and " C " key respectively and is pressed, the operation of promptly once duplicating, and the word content data that mouse is drawn speech replace original content-data on the clipbook;

C. obtain to get the speech content

With above-mentioned step 3 a, use described OpenClipboard function once more and open clipbook, utilize the GetClipboardData function that content of text data wherein are saved in the internal memory of computing machine, so that in application program, use; Call described CloseClipboard functional relationships closed system clipbook again;

D. recover Contents of clipboard

Use described OpenClipboard function and open clipbook, utilize the SetClipboardData function that the g_oldString variate-value that is kept among the step 3 a in the calculator memory is write in the clipbook, be used to recover original content on the clipbook; Call described CloseClipboard functional relationships closed system clipbook at last.

Beneficial effect of the present invention: the present invention has adopted overall mouse hook, and replace and obtain by simulating keyboard operation " Ctrl+C " (replicate run) and get the speech content on the clipbook, realized the combination that speech and screen word-selecting got in stroke speech, but also can in time reply original content-data in the shear plate, compare with the speech method of getting on the existing screen, has following beneficial effect

One, the processing border wall is broken, in most of programs, all can normally get speech (as the picture format of pdf reader output), even in the certain applications program, the screen word-selecting function limitation, but there is stroke speech to get replenishing of speech, still can ensures the normal realization of getting the speech function;

Two, only move the word that just can obtain on the screen by mouse, convenient and swift, save duplicate, troublesome operation such as stickup;

Three, conveniently simultaneously, get the assurance that speech more has accuracy;

Four, two kinds to get the speech mode available, the user can select according to personal habits, hobby.

Description of drawings

Fig. 1 is the implementation method schematic flow sheet of screen word-selecting of the present invention;

Fig. 2 is the implementation method schematic flow sheet that speech got in of the present invention stroke of speech.

Embodiment

As depicted in figs. 1 and 2, a kind of screen word-selecting implementation method of drawing the speech function that has of the present invention, its concrete enforcement may further comprise the steps:

Step 1: overall mouse hook is installed

In the dll program of computer equipment Windows operating system, utilize the SetWindowsHookEx api function to load overall mouse hook.About the detailed directions of SetWindowsHookEx function, all mention in a lot of books, and this is not emphasis of the present invention place, therefore repeat no more here.

The pre-service function that setting captures after the mouse information is GetMsgProc.Need handle following several message of mouse at GetMsgProc:

WINAPI?GetMsgProc(MSG*msg)

{

if(msg-＞message＝＝WM_MOUSEMOVE){

g_ptCurrentPoint.x＝msg-＞pt.x；

G_ptCurrentPoint.y=msg-＞pt.y; // obtain the current coordinate of mouse

}

else?if(msg-＞message＝＝WM_MOUSEHOVER)

ScreeGetWord()；

else?if(msg-＞message＝＝WM_LBUTTONUP)

DrugGetWord()；

}

When the mouse hook captures mouse stop message WM_MOUSEHOVER, can think that mouse is just hovering in getting the speech place, carries out the screen word-selecting operation this moment, wherein, the mouse hook captures the residence time that mouse stops message WM_MOUSEHOVER, can set according to user's custom; When the mouse hook captures left mouse button and upsprings message WM_LBUTTONUP, can think that the user has drawn speech and finished, program is carried out and is drawn a speech and get the speech operation;

Step 2: screen word-selecting

In the process that the mouse hook is installed, the api function of using has SetWindowsHookEx, and when the mouse hook of installing captured mouse stop message WM_MOUSEHOVER, program was carried out following operation,

A. repaint window

Utilize the mouse hook to obtain the current location of mouse, the little rectangle frame of choosing a 1px * 1px then under mouse position is (if rectangle frame is chosen excessive, can cause screen flicker), utilize api function InvalidateRect to send and repaint message to rectangle frame, repaint window;

RECT?rc；

rc.left＝g_ptCurrentPoint.x；

rc.top＝g_ptCurrentPoint.y；

rc.right＝g_ptCurrentPoint.x+1；

rc.bottom＝g_ptCurrentPoint.y+1；

InvalidateRect (g_hwndCurrentWnd ， ﹠amp; Rc, TRUE); // transmission repaints message

B. carry API hook is intercepted and captured api function

In the interception api function, adopt the general rewriting Import Address Table of prior art to realize.Concrete step is as follows:

1) find the base address of gdi32.dll module:

HMODULE?hmodule＝GetModuleHandle(“gdi32.dll”)；

2) obtaining the address of api function, is example with TextOutA:

FARPROC?m_pfnRawProc＝GetProcAddress(hmodule，”TextOutA”)；

3) call the ImageDirectoryEntryToData function and check whether certain application program has input joint (promptly whether needing to load dynamic base).Illustrate that this program do not import joint if return NULL, then do not do any operation and directly return.

4) if the input joint is arranged, ImageDirectoryEntryToData will return the pointer that points to input joint information.Scanning all input joint information, whether wherein have gdi32.dll module, if do not have, then do not do any operation and directly return if checking.

5) if find the gdi32.dll module just can obtain the group address of an IMAGE-THUNK-DATA structure, in this address, comprise incoming symbol information.Scan this group address successively, search the api function address that whether has and will tackle and want the address of mating.

6), then change the entry address of AP prototype function into alternative functions address that we write ourselves with the WriteProcessMemory function if find the address of these api functions.

7) in alternative functions, the parameter that can obtain wherein is that program is used, after using, must call the prototype api function, in order to avoid influence system's operate as normal.With TextOutA is example, and its alternative functions is:

BOOL?WINAPI?Hook_TextOutA(HDC?hdc，intx，int?y，LPCSTR?IpString，int?c)

{

// carry out processing here to IpString

……

// call the prototype api function

int?iResult＝((pfnTextOutA)(PROC)g_TextOutA)(hdc，x，y，IpString，c)；

return?iResult；

}

C. location matches

In the parameter of alternative functions Hook_TextOutA, lpString is the literal of wanting output screen.And x, y are x, the y coordinate figure in the upper left corner of this character string.Utilize the GetTextExtentPoint32W function can obtain the size of single character in the current string, thereby can calculate the rectangle frame coordinate of whole character string.Code is as follows:

if(g_ptCurrentPoint.x＞＝RectWord.left?&&?g_ptCurrentPoint.x＜＝

RectWord.right?&&?g_ptCurrentPoint.y＞＝RectWord.top&&

g_ptCurrentPoint.x＜＝RectWord.bottom)

{

// mouse is in the current string, can export or other operations it

…

}

It more than is the specific implementation process of screen word-selecting.

Step 3: draw speech and get speech

Drawing speech generally has three actions, and promptly left mouse button is pressed, pulled, left button upsprings.Drawing that speech gets in the speech mainly is exactly operation to clipbook.When the mouse hook captured left mouse button and upsprings message WM_LBUTTONUP, program was carried out following operation,

A. preserve the content on the clipbook

Use some system functions and can realize the extraction of Contents of clipboard.

If (OpenClipboard (NULL)) // open clipbook

{

HANDLE hClipboardData=GetClipboardData (CF_TEXT); // obtain content

Char*tempc=(char*) GlobalLock (hClipboardData); // locking

G_oldString=tempc; // preservation content

GlobalUnlock (hClipboardData); // unlock

CloseClipboard()；

}

B. simulate the Ctrl+C operation

Call the keybd_event function and can realize the button simulated operation:

keybd_event(VK_CONTROL，MapVirtualKey(VK_CONTROL，0)，0，0)；

keybd_event(′C′，MapVirtualKey(′C′，0)，0，0)；

keybd_event(′C′，MapVirtualKey(′C′，0)，KEYEVENTF_KEYUP，0)；

keybd_event(VK_CONTROL，MapVirtualKey(VK_CONTROL，0)，

KEYEVENTF_KEYU?P，0)；

C. obtain to get the speech content

Here the same with the operation of the preservation Contents of clipboard of step 3 a, preserve and get the speech content, get speech and finish.

D. recover Contents of clipboard

After opening clipbook with OpenClipboard (), calling system function S etClipboardData () realizes the recovery of Contents of clipboard.

If (OpenClipboard (NULL)) // open clipbook

{

EmptyClipboard (); // empty clipbook

SetClipboardData (g_oldString); // be provided with and be all original content in the clipbook

CloseClipboard()；

}

Above step must be carried out rapidly after receiving mouse WM_LBUTTONUP message, too much all the other operations can not intert in the centre, otherwise recover the Contents of clipboard overlong time, might cause the user to duplicate, paste operation is too fast and situation that Contents of clipboard does not also have enough time to be recovered occurs, paste functionality is affected.

Claims (1)

1. one kind has the screen word-selecting implementation method of drawing the speech function, it is characterized in that may further comprise the steps:

Step 1: overall mouse hook is installed

In the dll program of computer equipment Windows operating system, utilize the SetWindowsHookEx api function to load overall mouse hook, be used to catch each message of mouse; When the mouse hook captured mouse stop message WM_MOUSEHOVER, program was carried out the screen word-selecting operation, wherein, the residence time of described WM_MOUSEHOVER, can set according to user's custom; When the mouse hook captured left mouse button and upsprings message WM_LBUTTONUP, program was carried out and is drawn a speech and get the speech operation;

Step 2: screen word-selecting

Surpass the residence time that the user sets when the time of mouse-over, after the mouse hook of installation captured mouse stop message WM_MOUSEHOVER, program was carried out following operation,

A. repaint window

Obtain the coordinate data of mouse pointer current location on display by described mouse hook, and these data are saved in the internal memory of computer equipment, according to coordinate data, under mouse position, choose the micro rectangle frame of a 1px * 1px, utilize api function InvalidateRect to send and repaint message, repaint window to this rectangle frame;

B. carry API hook is intercepted and captured api function

When the Windows of computer equipment system receives when repainting message, the operating system of bottom ExtTextOutW, ExtTextOutA, these api functions of TextOutW, TextOutA among the calling system dynamic link library GDI32.dll is immediately carried out literal output, this seasonal program carry API hook, intercept and capture process calling by the API hook to above-mentioned api function, obtain the parameter of this api function, thereby realize seizure output string;

C. location matches

After capturing output string, calculate the coordinate figure on the border of this character string place rectangle frame, then the current mouse coordinates position of storing in the calculator memory and the boundary coordinate of this rectangle frame are compared, if mouse position is in rectangle frame, prove that this character string is exactly the current character string pointed of mouse, directly output gets final product; Otherwise will not export;

Step 3: draw speech and get speech

When the mouse hook captured left mouse button and upsprings message WM_LBUTTONUP, program was carried out following operation,

A. preserve the content on the clipbook

In program, use the OpenClipboard function and open system clipboard, obtain content of text data on the clipbook by the GetClipboardData function again, and it is saved in the internal memory of computing machine, define its variable g_oldString by name, call CloseClipboard functional relationships closed system clipbook again;

B. simulate the Ctrl+C operation

After the content of having preserved on the clipbook, routine call keybd_event function is simulated " Ctrl " and " C " key respectively and is pressed, the operation of promptly once duplicating, and the word content data that mouse is drawn speech replace original content-data on the clipbook;

C. obtain to get the speech content

With above-mentioned step 3 a, use described OpenClipboard function once more and open clipbook, utilize the GetClipboardData function that content of text data wherein are saved in the internal memory of computing machine, so that in application program, use; Call described CloseClipboard functional relationships closed system clipbook again;

D. recover Contents of clipboard

Use described OpenClipboard function and open clipbook, utilize the SetClipboardData function that the g_oldString variate-value that is kept among the step 3 a in the calculator memory is write in the clipbook, be used to recover original content on the clipbook; Call described CloseClipboard functional relationships closed system clipbook at last.

Images