CN109800135A - A kind of information processing method and terminal - Google Patents

Abstract

The embodiment of the invention discloses a kind of information processing methods, comprising: when the recording function of target application is activated, in current display interface the first display window of addition, the second display window of the first display window and current display interface is mapping relations；The first touch command is received in the first display window, the first touch command is used to indicate the corresponding feature operation of the first control in triggering current display interface；According to the first touch command, the corresponding first operating area information of the first control is obtained；According to the first operating area information and the mapping relations of the first display window and the second display window, determine that the second operating area information of current display interface, the second operating area information of record are completed until recording；When triggering target application broadcasting recording task, the first control is triggered according to the second operating area information, realizes the corresponding feature operation of the first control.The embodiment of the present invention also provides a kind of terminal simultaneously, for executing above- mentioned information processing method.

Description

A kind of information processing method and terminal

Technical field

The present invention relates to the application processing techniques more particularly to a kind of information processing method and terminal in internet area.

Background technique

As electronic information technology develops rapidly, the type of electronic product is also more and more, and user has also enjoyed science and technology Develop the various conveniences of bring.Present user can realize different application function by various types of electronic equipments, terminal etc. Can, it enjoys as development in science and technology bring is comfortably lived.

Currently, for the terminal for being equipped with application, in order to which user is to common function convenient operation, using perform script Mode carry out the automatic execution of some function in terminal applies.It is detailed, need to set execution some function step in advance Rapid script, for example, set the click location and sequence for realizing some function, then, by the script transmission set or It is arranged in computer end, when being connected to above-mentioned terminal with the computer end, using each operation in computer end parsing script, finally Using Android debugging bridge (ADB, Android Debug Bridge) order mode (i.e. opening universal serial bus (USB, Universal Serial Bus) debugging, then in such a way that data line connects computer) make each operation parsed With at the terminal, to realize that terminal realizes some above-mentioned function automatically.Alternatively, the script that terminal can be set by operation, The realization of application function is carried out to the application that root is crossed in the terminal.Wherein, the application that root has been crossed refers to having The application of high-level permission, the accessible almost all of file in modification terminal.

However, the mode of above-mentioned automatic realization application function is required to carry out the setting of script and be write, and write script Complexity it is higher, be not easy generally to realize；Meanwhile on the basis of the script write, it is also necessary to either will by computer end Terminal carries out root and is just able to achieve, the complicated condition of realization.

Summary of the invention

In order to solve the above technical problems, an embodiment of the present invention is intended to provide a kind of information processing method and terminal, Neng Goubao Card reduces the complexity of realization on the basis of realizing application function automatically.

The technical scheme of the present invention is realized as follows:

The embodiment of the invention provides a kind of information processing methods, comprising:

When the recording function of target application is activated, current display interface add the first display window, described first Display window and the second display window of the current display interface are mapping relations；

The first touch command is received in first display window, first touch command, which is used to indicate described in triggering, to be worked as The corresponding feature operation of the first control on preceding display interface；

According to first touch command, the corresponding first operating area information of first control is obtained；

According to the mapping of the first operating area information and first display window and second display window Relationship determines the second operating area information of the current display interface, records the second operating area information until recording It completes；

When triggering the target application broadcasting recording task, according to the second operating area information triggering described first Control realizes the corresponding feature operation of first control.

The embodiment of the invention provides a kind of terminals, comprising:

Adding unit, for being shown in current display interface addition first when the recording function of target application is activated Second display window of window, first display window and the current display interface is mapping relations；

Receiving unit, for receiving the first touch command in first display window, first touch command is used for It indicates to trigger the corresponding feature operation of the first control in the current display interface；

Acquiring unit, for obtaining corresponding first operating area of first control according to first touch command Information；

Determination unit, for aobvious according to the first operating area information and first display window and described second The mapping relations for showing window determine the second operating area information of the current display interface,

Recording unit is completed for recording the second operating area information until recording；

Trigger unit, for being believed according to second operating area when triggering the target application broadcasting recording task Breath triggers first control, realizes the corresponding feature operation of first control.

The embodiment of the invention also provides a kind of terminals, comprising: processor, receiver, display and storage medium, it is described Receiver, the display and the storage medium are communicated by communication bus with the processor；

The storage medium, for storing executable instruction；

The receiver, for receiving executable instruction；

The processor, for executing the executable instruction stored in storage medium, the executable instruction is configured to hold The above-mentioned information processing method of row；

The display, for showing the information after performing executable instruction.

The embodiment of the invention provides a kind of computer storage mediums, are applied in terminal, are stored with machine instruction, work as institute When stating machine instruction and be executed by one or more processors, the processor executes above-mentioned information processing method.

The embodiment of the invention provides a kind of information processing method and terminals, when the recording function of target application is activated When, in current display interface the first display window of addition, the second display window of the first display window and current display interface is Mapping relations；The first touch command is received in the first display window, the first touch command is used to indicate triggering current display interface On the corresponding feature operation of the first control；According to the first touch command, the corresponding first operating area letter of the first control is obtained Breath；According to the first operating area information and the mapping relations of the first display window and the second display window, current display is determined The second operating area information at interface, the second operating area information of record are completed until recording；When triggering target application plays record When task processed, the first control is triggered according to the second operating area information, realizes the corresponding feature operation of the first control.Using above-mentioned Technic relization scheme, due to terminal can to common target application common operation (trigger the first control realization function Operation) prior recording task is carried out, such terminal when realizing above-mentioned feature operation every time, so that it may directly pass through touching Recording task is put in broadcast, realizes above-mentioned feature operation automatically.Moreover, terminal carries out the mode of recording task in the embodiment of the present invention It can be by monitoring the operating space with the touch control operation of the first display window of the second display window of current display interface mapping Domain information realizes the feature operation of the corresponding operating area information of the second display window of invocation target application, realizes function Operable recording, such implementation is simple and easy, can guarantee that (i.e. the first control is corresponding realizing application function automatically Feature operation) on the basis of, reduce the complexity of realization.

Detailed description of the invention

Fig. 1 is that the terminal in the embodiment of the present invention realizes the framework for carrying out information exchange when application function between server Figure；

Fig. 2 is a kind of flow chart one of information processing method provided in an embodiment of the present invention；

Fig. 3 is the mapping relations knot of illustrative first display window and the second display window provided in an embodiment of the present invention Composition one；

Fig. 4 A is the illustrative interface schematic diagram one for carrying out information processing method provided in an embodiment of the present invention；

Fig. 4 B is the illustrative interface schematic diagram two for carrying out information processing method provided in an embodiment of the present invention；

Fig. 4 C is the illustrative interface schematic diagram three for carrying out information processing method provided in an embodiment of the present invention；

Fig. 5 is the illustrative interface schematic diagram four for carrying out information processing method provided in an embodiment of the present invention；

Fig. 6 is the mapping relations knot of illustrative first display window and the second display window provided in an embodiment of the present invention Composition two；

Fig. 7 is the illustrative interface schematic diagram five for carrying out information processing method provided in an embodiment of the present invention；

Fig. 8 is the illustrative interface schematic diagram six for carrying out information processing method provided in an embodiment of the present invention；

Fig. 9 is a kind of flowchart 2 of information processing method provided in an embodiment of the present invention；

Figure 10 is the illustrative interface schematic diagram seven for carrying out information processing method provided in an embodiment of the present invention；

Figure 11 is the illustrative interface schematic diagram eight for carrying out information processing method provided in an embodiment of the present invention；

Figure 12 is a kind of flow chart 3 of information processing method provided in an embodiment of the present invention；

Figure 13 is the illustrative interface schematic diagram nine for carrying out information processing method provided in an embodiment of the present invention；

Figure 14 is a kind of structural schematic diagram one of terminal provided in an embodiment of the present invention；

Figure 15 is a kind of structural schematic diagram two of terminal provided in an embodiment of the present invention.

Specific embodiment

Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention is described.

Accessible ancillary service: refer to that the AccessibilityService function of providing in android system helps these User operates equipment or terminal simplerly, and developer, which can use these AccessibilityService, makes calling program more It is handy.

ADB: being a client-server end program, and wherein client is the computer for operating, and server end is peace Tall and erect equipment, the full name of the ADB of Android system are Android Debug Bridge, exactly play the role of debugging bridge, utilize ADB The premise of tool is that universal serial bus (USB, Universal Serial Bus) debugging is opened on mobile phone, then passes through number Computer is connected according to line.Carry out operating handset using command mode on computers: restart, into recovery (data backup), enter Fastboot (quick start), pushing files function etc..

Root: referring to system manager's permission of Unix type operating system (including Linux), is similar in Windows system Administrator.Android root authority is accessible and modifies almost all of file (android system text in terminal Part and user file do not include read-only memory mirror image ROM (mirror image used in brush machine)), these things may be manufacturer not The data of modification are ready, because user can delete the application of manufacturer or operator's prepackage by root authority.

Suspended window: it refers in particular to be added on the screen of terminal on Android system by window manager Window Manager and is in View control (i.e. window) on other application.

As shown in Figure 1, to be carried out in the embodiment of the present invention in information processing system framework locating for the terminal of information processing Various hardware entities schematic diagram, include: one or more server 2-1 to 2-n, terminal and network 31, network 31 in Fig. 1 In include router, gateway etc. network entity does not embody in Fig. 1.Terminal 1 passes through cable network or wireless network and clothes Business device 2-1 to 2-n carries out information exchange, so that terminal 1 obtains when realizing some feature operation from server 2-1 to 2-n Access data are taken, realize the data access of feature operation.The type of terminal as shown in Figure 1, include mobile phone (1-1), tablet computer, The types such as PDA (1-2), desktop computer (1-3), PC machine (1-4) or all-in-one machine (1-5).Wherein, various users are installed in terminal 1 Required applied function module, for example have the application of amusement function (such as Video Applications, audio play application, and game application reads Read software and news application), for another example have the application (such as digital map navigation application purchases by group application, camera application) of service function, Furthermore such as setting application etc. system functions, the embodiment of the present invention is with no restriction.

Based on above-mentioned hardware entities shown in FIG. 1, the application function (feature operation) of any one application is realized in terminal When, information exchange can be carried out with the background server of the application, to complete some application function, that is to say, that clothes Device be engaged in as the background server of the application realization application function in terminal, realizes that application function provides data access and place for terminal The information exchange of reason.

The example of above-mentioned Fig. 1 is a system architecture example for realizing the embodiment of the present invention, and the embodiment of the present invention is not It is limited to system structure described in above-mentioned Fig. 1, is based on the system architecture, proposes each embodiment of the present invention.

The embodiment of the invention provides a kind of information processing methods, as shown in Fig. 2, this method may include:

S101, when the recording function of target application is activated, current display interface add the first display window, first Display window and the second display window of current display interface are mapping relations.

It should be noted that terminal realizes that a kind of premise of information processing method provided in an embodiment of the present invention is in terminal It is arranged or is equipped with the plug-in unit for realizing the information processing method in the embodiment of the present invention or application, is properly termed as making by oneself here Justice operation application, the embodiment of the present invention do not limit the form of expression of the application.

In embodiments of the present invention, the process for realizing information processing method is fabricated to self-defining operation application, existed in this way Terminal in the process of processing, can realize above- mentioned information processing method by carrying out operation in self-defining operation application, this Inventive embodiments do not limit the way of realization of information processing method.

It is real that the present invention is carried out so that the information processing method in the embodiment of the present invention is the form of self-defining operation application as an example Apply the explanation of example.

In this way, the terminal in the embodiment of the present invention can be the electronics for being equipped with functional application and self-defining operation application Equipment, for example, mobile phone, plate and computer etc., the embodiment of the present invention is with no restriction.

In self-defining operation application, it is provided with the function button for recording self-defining operation, realizes recording function, is carried out certainly The recording task of defining operation, in this way when user's using terminal carries out self-defining operation, so that it may be recorded by playing Task automatically carries out self-defining operation, and (i.e. feature operation can refer to the function of carrying out to the first control in the embodiment of the present invention Operation) progress.

It should be noted that in embodiments of the present invention, the application that self-defining operation is directed to install in terminal is realized Feature operation, therefore, terminal is accomplished that the recording task of application by self-defining operation application.

In this way, any application for choosing terminal itself to install is target application, so that it may be applied by self-defining operation Recording function realizes realizing for the recording task of self-defining operation.

In embodiments of the present invention, when the recording function of target application is activated, terminal is added in current display interface First display window, since the current display interface of terminal is shown in the second display window, here, which is being detected When the recording function of target application is activated, which adds one and second display window on the second display window The first display window mapped one by one.

It should be noted that in embodiments of the present invention, the first display window can be to be suspended on the second display window Suspended window, and the display area of the display area of first display window and the second display window corresponds, size one It causes, i.e. the first display window and the second display window are mapping relations.

In embodiments of the present invention, the first display window is to be added to end panel by window manager Window Manager The view control (i.e. window) on the second display window on curtain in current display interface.First in the embodiment of the present invention Display window is a full frame, transparent, sightless suspended window, and such terminal is substantially imperceptible more when display It is added to a display window, can completely clearly indicate out current display interface.

Illustratively, the first display window and the second display window are the relationships mapped one by one, and what is embodied at the terminal is First display window is suspended on the second display window, i.e., the mapping of the first display window and the second display window as shown in Figure 3 Relationship.

Illustratively, due to the first display window can be it is full frame, transparent and sightless, (eventually it is assumed that mobile phone 1 End) on current display interface it is as shown in Figure 4 A, by such as Fig. 4 B on the second display window of the current display interface of the mobile phone 1 Shown in mapping relations when add upper first display window, the display effect on mobile phone 1 is as shown in Figure 4 C, the present invention The addition of first display window of embodiment is not influence mobile phone 1 original display effect and clarity.

In embodiments of the present invention, current display interface refers to the content that terminal is currently shown, and current display interface Different contents can be shown with trigger action, but current display interface is all current display content.Due to target application Recording function when be activated, be in self-defining operation application, that is to say, that current display interface is shown now The current recording interface of target application, the content of specific current display interface determine that the present invention is implemented by specifically operating Example is with no restriction.

S102, the first touch command is received in the first display window, the first touch command is used to indicate the current display of triggering The corresponding feature operation of the first control on interface.

Terminal is after current display interface adds the first display window, since first display window is that terminal is being made by oneself The display window that is arranged in justice operation application, then the terminal can listen to touch control operation on first display window or Touch event.Therefore, in embodiments of the present invention, terminal carries out the reality of touch control operation in the first display window to target application The operating area information of the touch control operation in the target application can be got if existing.And user is to the touch-control of target application The realization of operation shows as user and carries out touch control operation to the first control on the first display window by gesture operation, such Words, the touch control operation acted in terminal are generated as touch command, and then, terminal receives the first touch-control in the first display window and refers to It enables, and the first touch command is used to indicate the corresponding feature operation of the first control in triggering current display interface.

In embodiments of the present invention, the first control is any one functionality controls for showing in current display interface, this One control can not limit for diversified forms, the embodiment of the present invention such as function button, function button, functional block or function links System.

In embodiments of the present invention, gesture operation may include the operation such as clicking, sliding or drag, specifically according to triggering The mode of first control determines that the embodiment of the present invention is with no restriction.

It should be noted that in embodiments of the present invention, although the first touch command is acted on the first display window Operation to the first control, but since the first control is the control in current display interface, it is substantially applied to the second display Window just can really to the first control carry out feature operation, therefore, in the embodiment of the present invention on the first display window Received first touch command be generated for the touch control operation of the first control, but terminal can not really respond this One touch command is directly realized by the feature operation to the first control.That is, due in terminal in the embodiment of the present invention One display window and the second display window map one by one, therefore, position and first control of first control in the second display window The position that part is mapped on the first display window is consistent, in this way, the terminal can be for being somebody's turn to do on the first display window The position of first control mapping carries out touch control operation, i.e. terminal receives the first touch command, the first touch-control in the first display window Instruction, which is used to indicate, carries out feature operation to the first control in current display interface, is not really to trigger the first control reality Feature operation is showed.

Illustratively, as shown in fig. 5, it is assumed that terminal is mobile phone 1, the be triggered recording function of news application 2 of mobile phone 1 is opened Dynamic, current display interface is the recording task set interface 3 of news application, shows news application 2 in the recording interface 3 Icon and recording function key 4 click recording function key 4 and have carried out recording interface 5, at this moment, if carrying out to news application 2 The feature operation of opening, then the position that user clicks the icon mapping of the first display window news application 2 is opened to realize Function, such mobile phone 1 have received the open instructions (the first touch command) to news application 2.

S103, according to the first touch command, obtain the corresponding first operating area information of the first control.

After the first display window receives the first touch command, which can monitor terminal according to the first touch command For the first operating area information of the first control effect on the first display window.

In embodiments of the present invention, the first operating area information may include touch area or the effect of the first touch command Region (i.e. first location information of the first control on the first display window), current display interface the first interface information, with And the first operation trace of gesture operation.

It should be noted that due to the first display window in the embodiment of the present invention size and current display interface it is complete Shield in the same size, therefore, the content of current display interface all equal proportions can be mapped on the first display window, in this way, One location information can characterize the first control in the second location information of the second display window, can be using in the first display window Mouthful coordinate information show；First interface information can characterize the affiliated boundary of the first control for webpage information or page info etc. Face；First operation trace characterize gesture operation generate triggering trace, can by triggering initial position, end position, triggering when Between and triggering direction etc. elements constitute, the embodiment of the present invention limits the acquisition form of operation trace.

It is understood that can be obtained by the first display window of addition since terminal passes through self-defining operation application To the corresponding first location information of the first control, the first interface information and the first operation trace, so that it is determined that user wants What the self-defining operation of recording is.

It should be noted that a kind of information processing method provided in an embodiment of the present invention is directed to common target application Corresponding sequence of operations, the feature operation for recording task has been carried out then can be directly by playing recording task Carry out key realization.

S104, according to the mapping relations of the first operating area information and the first display window and the second display window, really Determine the second operating area information of current display interface, the second operating area information of record is completed until recording.

Terminal is according to the first touch command, after obtaining the corresponding first operating area information of the first control, due to the end The mapping relations of end or the first display window and the second display window, therefore, which can be according on the first display window The first operating area information and the first display window and the second display window mapping relations, determine and the first operating space Domain information has the second operating area information in the current display interface of mapping relations, wherein the second operating area information For the operating area information on the second display window.

In embodiments of the present invention, in order to realize the recording function to target application, which, which needs to obtain, realizes target A series of content that function trigger actions, functionality controls and the interface display of the feature operation of application change, and any one mesh Mark is using the monitoring that will not all allow terminal that can arbitrarily carry out above- mentioned information, therefore, one kind provided in an embodiment of the present invention Information processing method is in the same size, transparent and sightless with the display screen of the current display interface of terminal by addition one First display window obtains the first operating area information of the mapping to the first control on the second display window, due to display The mapping relations of window, with regard to be indirectly recorded on the second display window it is practical to the first control operate when second Operating area information.

Illustratively, as shown in fig. 6, being had received on the first display window to the corresponding touch control operation of the first control, the The zone of action (i.e. the first operating area information) a' of one control is based on mapping structure shown in fig. 6, defines the second display Zone of action a (i.e. the second operating area information) on window.

It should be noted that since information processing method provided in an embodiment of the present invention is the function by recording target application The process for playing out recording task again can be operated, therefore, terminal needs to record operating area when carrying out control triggering every time The record of information is completed until recording, and is just known as a recording task.

In embodiments of the present invention, terminal can be realized by self-defining operation application and be grasped to a function of target application The recording task of work, also may be implemented a series of recording task of feature operations to target application, and the embodiment of the present invention is unlimited Make the number of feature operation in a recording task.

But when a recording task of target application is for needing to difference when recording a series of feature operations The page or the different controls at interface carry out triggering again and again and be just able to achieve, and the triggering of the control in each interface or the page It is having time sequence.In this case, terminal needs to believe by obtaining the first operating area of the first display window every time always Breath, so that it is determined that the second operating area information of the second display window of target application and record are until record completion.

In embodiments of the present invention, it records and completes that function key triggering can be completed by recording, specifically recorded Realization at function key is can to record complete functionality controls, record and complete function button or record to complete the performance shape such as icon Formula, the embodiment of the present invention is with no restriction.

It should be noted that terminal currently shows boundary during the self-defining operation to target application is recorded The interface content or content of pages of target application is shown in face, and is provided with recording in current display interface and completes function Key can wanted to terminate to record no matter terminal needs triggering feature operation several times that could complete a recording task in this way When by triggering record complete function key, generate record END instruction, terminate recording function according to the recording END instruction.

Further, terminal is after completing recording task, can be by the way that the upper setting of current display interface is arranged in Having and returns to function key return recording task set interface, the embodiment of the present invention does not limit the implementation of the return function key, this Sample, the terminal can be set from the recording interface of current display interface back to recording task by triggering the return function button It sets in interface, wherein set interface when recording task set interface is the recording task of terminal progress target application is shown The information such as the target application recorded and recording task are shown.

Illustratively, as shown in Figure 7, it is assumed that terminal is mobile phone 1, and target application is news application, triggers mesh in mobile phone 1 When mark is using opening function operation, current display interface shows the news content of news application, is provided with and stops in region 2 Only key 3 (record complete function key), trigger on mobile phone 1 as user this stop key 3 when, terminate to record, i.e. 1 knot of mobile phone Acquisition of the beam to the operating area information of control；Key 4 is returned as shown in fig. 7, being also provided in region 2, works as user When triggering returns to key 4 on mobile phone 1, recording task set interface is returned to from the recording interface 5 of current display interface In.

In embodiments of the present invention, it is provided with task in recording task set interface and is provided with control, terminal is by being somebody's turn to do Task, which is provided with control and can complete the above-mentioned recording task of target application, to be provided with, i.e., terminal has been provided with mesh The self-defining operation of mark application is provided with.

Illustratively, as shown in Figure 8, it is assumed that terminal is mobile phone 1, and recording task set interface 2 is arranged in the recording task Task can be set in interface 2 and be provided with control 3, when user, which triggers the task on mobile phone 1, is provided with control 3, newly The self-defining operation recording task for hearing application (target application) is completed.

S105, when triggering target application and playing recording task, the first control is triggered according to the second operating area information, it is real The existing corresponding feature operation of first control.

Terminal is in the mapping relations according to the first operating area information and the first display window and the second display window, really Determine the second operating area information of current display interface, the second operating area information of record characterizes until when recording completion The terminal realizes the completion of a recording task to target application, then, in embodiments of the present invention, terminal can be direct The recording task recorded is played, to realize the automatic trigger to the self-defining operation of target application.Here, when triggering mesh When marking application plays recording task, the terminal is since it is determined the zone of action (the second operating space of the first control for needing to trigger Domain information), therefore, terminal triggers the first control according to the second operating area information automatic imitation, realizes that the first control is corresponding Feature operation.

It should be noted that in embodiments of the present invention, target application realizes the recording of self-defining operation, recording is generated Task, and recording task is exactly that the function that self-defining operation is realized can be triggered with a key, recording task can pass through recording task Control is triggered, and the specific form of expression embodiment of the present invention is with no restriction.

In embodiments of the present invention, due to the function of target application have hierarchy, to target application it is a series of from When defining operation is recorded, each step self-defining operation all has trigger sequence, that is, the time sequencing triggered, because This, terminal needs terminal according to trigger sequence when recording, in the corresponding page when broadcasting (starts) recording task Or it is sent under webpage and (is started or triggered behaviour to the second operating area information to the trigger event of the second operating area information Make), since the zone of action of first control in current display interface is corresponding region (the secondth area of the second operating area information Domain), therefore, when terminal is according to the second operating area information realization trigger event, it is achieved that the mould to the first control Quasi- triggering, so as to complete the feature operation to the first control.I.e. in embodiments of the present invention, it is touched when by recording task control When sending out target application and playing recording task, the trigger event of the second operating area information is sent according to trigger sequence, is realized to the The simulation of one control triggers, and completes the corresponding feature operation of the first control.

It should be noted that terminal realizes the practical gesture operation of the triggering not instead of user of the first control, eventually End simulation triggering when starting the self-defining operation to the first control of target application.In embodiments of the present invention, It is realized using Accessibility Service (i.e. accessible ancillary service).The process of terminal simulation self-defining operation can Think that terminal is simulated on the first display window and click the corresponding first area of the first operating area information, at this point, terminal passes through The relevant interface of Accessibility goes simulation to trigger second area corresponding with the second operating area information, the second area On corresponded to the first control, thereby realize and triggered in current display interface by the relevant interface of Accessibility The trigger action of first control, to realize the feature operation of first control.

It has been compatible with AccessibilityService in self-defining operation application in embodiments of the present invention, AccessibilityService operates in backstage, and can receive by some events of the operating system sending of terminal (AccessibilityEvent, these events indicate a series of state change of user interface), such as focus change, in input Hold variation // button to be clicked etc., this kind of service request current active window (i.e. current display interface) and can look into Look for content therein.In other words, any variation generated in current display interface can all generate a time, and be notified by system To AccessibilityService.This monitors the every act and every move at interface just as monitor, once interface changes, at once It sounds an alarm.

It should be noted that in embodiments of the present invention, the primary interface of AccessibilityService is class AccessibilityService, AccessibilityService are the subclasses of Service, can inherit this class and realize Its abstract method come monitor one application current display interface elementary state variation, such as focus variation, one is pressed Button is by click etc..When having these variations, the operating system of terminal can exist these Information encapsulations Inside AccessibilityEvent, the onAccessibilityEvent of AccessibilityService is adjusted back (AccessibilityEvent) method realizes onAccessibilityEvent to handle these AccessibilityEvent.Main process may include:

1, creation service class；Service class is write, needs to inherit AccessibilityService class, wherein to realize The two important sides onAccessibilityEvent (AccessibilityEvent event) and onInterruput () Method.Wherein, onAccessibilityEvent (AccessibilityEvent event) is related The call back function of AccessibilityEvent event, operating system are constantly sent out by sendAccessibiliyEvent () Send AccessibilityEvent to herein.

2, statement service；It as other Service service, needs to state in AndroidManifest.xml, removes this Except, which must also configure following two: (1), configuring<intent-filter>, name is fixed android.accessibilityservice.AccessibilityService；(2), BIND_ACCESSIBILITY_ is stated SERVICE permission, so that system can bind the service (requiring after 4.1 versions).

Note: any point configuration error, system all can't detect the service, therefore its fixed configurations is as follows:

3, configuration service class；It is next exactly to need to this after AndroidManifest.xml states the service Service carries out some parameter settings, which can be configured to receive the event of specified type, monitors specified Package retrieves windows content, obtains time of event type etc..There are two types of configuration methods at present: (1), after 4.0 mentioning It has supplied to be configured by<meta-data>label；(2), it is configured by setServiceInfo ().

4, starting service；When finishing the above operation, app can be installed to mobile phone, after installing successfully, in setting -> auxiliary Above-mentioned service can be found in function, which is in closed state, needs manually opened.

In embodiments of the present invention, above-mentioned service is AccessibilityService, is had The application property of can be exemplified of AccessibilityService service is self-defining operation application.

5, event information is obtained；OnAccessibilityEvent (AccessibilityEvent event) is the service Core methed, wherein parameter event encapsulates the information from interface dependent event, for example we can obtain the thing of the event Part type, and then different processing modes is selected according to type is played:

6, windows content is obtained；Only just know that event information be it is inadequate, obtained by event issue the event (thing Part source) information, for example its mono- service of text. is configurable to retrieve in window when Button button is clicked Hold, i.e. acquisition windows content, entire windows content be substantially about AccessibilityWindowInfo and The tree construction of AccessibilityNodeInfo, referred to herein as content tree.

Here windows content can be the operating area information in the embodiment of the present invention.

7, the life cycle serviced；It is appreciated that the life cycle serviced in this only needs to remember following three points: (1), This kind services completely by system administration, and follows the existing seeervice cycle；(2), opening a service can only be arranged by user Middle opening, and close then can only be closed or service in setting by user itself pass through diableSelf () method closing (when So some thirds soften part and can also forcibly close the type service now)；(3), it after the system binding service, can call OnServiceConnected () method, this method can be rewritten, in the operation that can wherein do some initialization.

8, whether detection service opens.(1), judge by service managerZ-HU AccessibilityManager, still This method cannot detect the service that app itself is opened；(2), most system property is all configured in settings, than Such as Wi-Fi, bluetooth state, and these information be mainly stored in the corresponding database of settings (system table and Secure table), equally it can also judge whether related service opens by directly reading setting setting.

It should be noted that want to use AccessibilityService in embodiments of the present invention, it just must be to inspection Survey is to be switched on the server, is just able to achieve simulated operation.

It sees below and uses example step by step:

Example that text conversion is voice is introduced used here as in ApiDemo, after being configured with server category, is needed The configuration statement of AccessibilityService is carried out, specific to need to state in Manifest file:

It should be noted that configuring service class, after starting service, the process flow of event can be with are as follows:

Accessibility is the message that can get control, and since View, backward recursive request is arrived ViewRootImpl, then AccessibilityManagerService higher management is carried out, it is finally sent to AccessibilityService。

Event be it is relevant with View, since View, View realizes one and cries for it The interface of AccessibilityEventSource, AccessibilityEventSource interface contain two functions:

public void sendAccessibilityEvent(int eventType)；And

public void sendAccessibilityEventUnchecked(AccessibilityEvent event)；

The two functions can be used to send AccessibilityEvent, such as when View receives click event, when When the Focus state change of View etc., View calls the two interfaces to open and send AccessibilityEvent.In addition ViewGroup also achieves ViewParent interface, and ViewParent has an interface function RequestSendAccessibilityEvent, in sub- View, sendAccessibilityEvent method is eventually called GetParent () .requestSendAccessibilityEvent, up calls layer by layer, finally exists The sendAccessibilityEvent method binder machine of AccessibilityManager is used inside ViewRootImpl AccessibilityEvent is sent to AccessibilityManagerService by system. AccessibilityManagerService is to initialize in SystemServer, and be added to In ServiceManager.AccessibilityManagerService (installation, unloading) when having packet to change updates AccessibilityService binding, shown in following code:

The AccessibilityService that can unbind when there is new AccessibilityService obtains binding Result IAccessibilityServiceClient (in actually AccessibilityService onBinder return IAccessibilityServiceClientWrapper Proxy), with AccessibilityService communicate it is relevant Information preservation is in AccessibilityManagerService.Service class.When After AccessibilityManagerService receives Event, all Service can be traversed, and pass through Event is sent to AccessibilityService by IAccessibilityServiceClient, thereby realize from AccessibilityEvent event is generated to being sent to AccessibilityService.

Further, as shown in figure 9, before S101, a kind of information processing method provided in an embodiment of the present invention may be used also To include: S106-S107.It is as follows:

S106, the recording task for establishing target application, recording task are realized by recording function.

Terminal is the application realization recording function that itself can be mounted on for any one, that is to say, that the present invention is real Applying the target application in example can have multiple, then being directed to each target application, terminal can establish each target application Recording task, to distinguish the reality of the self-defining operation between the recording function and different target application of multiple target applications It is existing.In this way, that is, terminal adds the first display window in current display interface before the information processing method for realizing target application Before, which needs first to establish the recording task of target application, wherein and recording task is that used recording function is realized, That is be first to establish this task items of recording task here, finally also need to carry out recording task be provided with it is a series of Task setting.

It should be noted that the embodiment of the present invention carrys out description information processing method so that self-defining operation is applied as an example, then When self-defining operation application is activated, which will show task interface, so that user records New recording task is established in the broadcasting of task processed, and the concrete implementation mode embodiment of the present invention is with no restriction.

Here, target application is determined in the application of installation of the terminal on task interface；Terminal triggering increases new events, adds In addition stating the object that target application is the recording task, the foundation of recording task is completed.

It should be noted that showing the control of playable old recording task in embodiments of the present invention, on task interface Part, there are also the control that new recording task is added in instruction, when need to carry out the realization of recording task of new target application when It waits, needs to carry out the addition of target application by the control of addition property recording task, in this way, terminal will be on task interface Which the application of display installation has, and then, user selection can want to carry out the mesh of self-defining operation in the application of installation Mark application, then increases new events by triggering, the target application chosen is carried out to the addition of recording task, so as to complete mesh Mark the foundation of the recording task of application.

S107, triggering recording control corresponding with target application, starting are recorded.

Terminal realized due to recording task by recording function after establishing the recording task of target application, The realization of specific recording task needs to trigger recording corresponding with target application and controls to realize, the triggering in the way space is used (i.e. starting recording function, start to be recorded) is recorded in starting.That is, terminal needs the recording task to target application It is configured, to realize the specific self-defining operation task in recording task, and recording control is exactly that recording task is arranged Start button, recording function are exactly the means for realizing setting recording task.

It should be noted that in embodiments of the present invention, the recording task of target application enters recording after the completion of establishing Task set interface is provided with the recording control of target application, clicks the record in recording task set interface in user When control processed, recording function is just started, starts recorded.

Illustratively, as shown in Figure 10, in the task interface 2 of mobile phone 1 (terminal), have selected installed on mobile phone 1 it is new Hearing using 5 is target application, clicks " increasing new events ", establishes the recording task of news application, jump to record shown in Fig. 10 Task set interface 3 processed carries out the setting of task, and is provided in recording task set interface 3 and records control 4, is establishing After the recording task of good news application, control 4 can be recorded into recording function by clicking, can thus started to target The self-defining operation of application recorded.

Further, as shown in figure 9, after S104, a kind of information processing method provided in an embodiment of the present invention may be used also To include: S108-S109.It is as follows:

S108, the first display window is closed, returns to recording task set interface.

S109, it is completed in recording task set interface setting recording task, the recording task of displaying target application.

Terminal is triggering the first control according to the second operating area information, realize the corresponding feature operation of the first control it Afterwards, since the monitoring of the operating area information for target application of terminal is realized by the first display window, After the recording for the self-defining operation for realizing target application, there is no need to carry out the monitoring of operating area information again, that The terminal can close the first display window, and return to recording task set interface, realize that recording task is completed really Recognize.At this moment it is provided with task in recording task set interface and is provided with control, user can be by triggering or clicking this Business is provided with control and realizes that setting recording task is completed, thus back to the recording task of task interface displaying target application, In this way, user can carry out the broadcasting of self-defining operation by the recording task of the target application of display.

Illustratively, as shown in figure 11, mobile phone 1 (terminal) returns to recording task after the recording for completing recording task Set interface 2 is provided with task in the recording task set interface 2 and is provided with control 3, is provided with control by the task 3 just complete the setting of the recording task of news application 4 (target application), then, task interface 5 are jumped to, in task interface 5 In can show the recording task 6 (such as one key of news application open task dispatching) of news application 4, played for one key of user Realize the feature operation of the first control.

In embodiments of the present invention, due to terminal can to common target application common operation (i.e. trigger first control The feature operation that part is realized) prior recording task is carried out, such terminal when realizing above-mentioned feature operation every time, so that it may Directly to play recording task by triggering, above-mentioned feature operation is realized automatically.Moreover, terminal is recorded in the embodiment of the present invention The mode of task processed can be by monitoring the touch-control with the first display window of the second display window of current display interface mapping The operating area information of operation realizes the function of the corresponding operating area information of the second display window of invocation target application Operation, realizes the recording of feature operation, and such implementation is simple and easy, can guarantee realizing application function (i.e. automatically The corresponding feature operation of first control) on the basis of, reduce the complexity of realization.

The case where being realized for the sequence of operations that self-defining operation is target application, the base realized based on previous embodiment On plinth, the embodiment of the invention provides a kind of information processing methods to be based on Fig. 2, and as shown in figure 12, the process of S104 may include: S201-S203, as follows:

S201, according to the mapping relations of the first operating area information and the first display window and the second display window, really Determine the second operating area information of current display interface, records the second operating area information；

S202, simulation feature operation corresponding with the second operating area information, update current display interface；

S203, current display interface in the updated carry out message processing flow next time and complete until recording.

Terminal is according to the first touch command, after obtaining the corresponding first operating area information of the first control, due to the end The mapping relations of end or the first display window and the second display window, therefore, which can be according on the first display window The first operating area information and the first display window and the second display window mapping relations, determine and the first operating space Domain information has the second operating area information in the current display interface of mapping relations, wherein the second operating area information For the operating area information on the second display window.In this way, terminal passes through the function or service of Accessibility Service It can simulate and touch control operation is carried out to the corresponding second area of the second operating area information, jump to new display interface, That is, current display interface is updated, and since this touch control operation can be terminal for target application First time or non-last time self-defining operation, therefore, terminal may need current display interface in the updated to continue Next time to the self-defining operation of the target application, realize that message processing flow (repeats last information processing next time The process of S102 to S105 in process) completed until recording, just realize in this way for target application it is a series of from The recording of defining operation.

Illustratively, as shown in figure 13, the current display interface of the news application (target application) in mobile phone 1 (terminal) After having carried out the touch control operation for flash report 3 on 2, flash report interface 4 shown in Figure 13, flash report interface 4 here have been jumped to It is exactly updated current display interface, the triggering behaviour to any one flash report child control 5 can be realized in flash report interface 4 Make, realize the determination and recording of the second operating area information on flash report interface 4 again, is triggered until recording and completing control, Until terminating to record.

In embodiments of the present invention, terminal can monitor the operating area letter for target application by the first display window Breath, and the operating area information in target application is got by mapping, and by simulated implementation to the touch-control of target application Operation, terminal may be implemented in this way can record a series of self-defining operation, and then realize subsequent key touch-control A series of realization of self-defining operations of target application reduces the complexity that target application realizes operation automatically.

Under same inventive concept based on previous embodiment, as shown in figure 14, the embodiment of the invention provides a kind of terminal, Include:

Adding unit 10, for being shown in current display interface addition first when the recording function of target application is activated Show window, the second display window of first display window and the current display interface is mapping relations；

Receiving unit 11, for receiving the first touch command in first display window, first touch command is used The corresponding feature operation of the first control in the current display interface is triggered in instruction；

Acquiring unit 12, for obtaining corresponding first operating space of first control according to first touch command Domain information；

Determination unit 13, for according to the first operating area information and first display window and described second The mapping relations of display window determine the second operating area information of the current display interface,

Recording unit 14 is completed for recording the second operating area information until recording；

Trigger unit 15 is used for when triggering the target application broadcasting recording task, according to second operating area Information triggers first control, realizes the corresponding feature operation of first control.

Optionally, the terminal further include: updating unit 16；

The determination unit 13, be specifically used for according to the first operating area information and first display window with The mapping relations of second display window determine the second operating area information of the current display interface,

The recording unit 14, specifically for recording the second operating area information；

The updating unit 16, for simulating corresponding with the second operating area information feature operation, described in update Current display interface；The current display interface in the updated carries out message processing flow next time and completes until recording.

Optionally, the terminal further include: establish unit 17；

It is described to establish unit 17, for described before current display interface adds the first display window, establish the mesh The recording task of application is marked, the recording task is realized by recording function；

Optionally, described to establish unit 17, specifically for determining the target in the application of the installation on task interface Using；Triggering increases new events, adds the object that the target application is the recording task, completes building for the recording task It is vertical.

Optionally, the trigger unit 15 is also used to after the recording task for establishing the target application, touching Recording control corresponding with the target application is sent out, starting is recorded.

Optionally, the terminal further include: closing unit 18 and display unit 19；

The closing unit 18, for it is described according to the first operating area information and first display window with The mapping relations of second display window determine the second operating area information of the current display interface, record described After two operating area information are until record completion, first display window is closed, the task interface is returned；

The display unit 19 is completed for the recording task to be arranged in the task interface, shows that the target is answered The recording task.

Optionally, the trigger unit 15 is specifically used for when triggering the target application broadcasting recording task, according to touching Hair sequence sends the trigger event of the second operating area information, realizes that the simulation to first control triggers, completes institute State the corresponding feature operation of the first control.

As shown in figure 15, the embodiment of the invention also provides a kind of terminals, comprising: processor 110, receiver 111, display Device 112 and storage medium 113, the receiver 111, the display 112 and the storage medium 113 pass through communication bus 114 are communicated with the processor 110；

The storage medium 113, for storing executable instruction；

The receiver 111, for receiving executable instruction；

The processor 110, for executing the executable instruction stored in storage medium 113, the executable instruction is matched It is set to and executes information processing method described in aforementioned any embodiment；

The display 112, for showing the information after performing executable instruction.

It is detailed, the processor 110, for when the recording function of target application is activated, in current display interface Add the first display window, the second display window of first display window and the current display interface is mapping relations；

The receiver 111, for receiving the first touch command, first touch command in first display window It is used to indicate the corresponding feature operation of the first control triggered in the current display interface；

The processor 110 is also used to obtain corresponding first behaviour of first control according to first touch command Make area information；According to reflecting for the first operating area information and first display window and second display window Relationship is penetrated, determines the second operating area information of the current display interface, records the second operating area information until record System is completed；When triggering the target application broadcasting recording task, according to the second operating area information triggering described first Control realizes the corresponding feature operation of first control.

Optionally, the processor 110 is specifically used for according to the first operating area information and first display The mapping relations of window and second display window determine the second operating area information of the current display interface, Record the second operating area information；Feature operation corresponding with the second operating area information is simulated, is worked as described in update Preceding display interface；The current display interface in the updated carries out message processing flow next time and completes until recording.

Optionally, the processor 110, is also used to described before current display interface adds the first display window, builds The recording task of the target application is found, the recording task is realized by recording function；Installation on task interface Application in determine the target application；Triggering increases new events, adds the object that the target application is the recording task, Complete the foundation of the recording task.

Optionally, the processor 110 is also used to after the recording task for establishing the target application, touching Recording control corresponding with the target application is sent out, starting is recorded.

Optionally, the processor 110 is also used to described according to the first operating area information and described first aobvious The mapping relations for showing window Yu second display window determine the second operating area information of the current display interface, note After the second operating area information is recorded until recording completion, first display window is closed, the task interface is returned；

The display 112 is completed for the recording task to be arranged in the task interface, shows the target application The recording task.

Optionally, the processor 110, also particularly useful for when triggering the target application and playing recording task, according to Trigger sequence sends the trigger event of the second operating area information, realizes that the simulation to first control triggers, completes The corresponding feature operation of first control.

It should be noted that the various components in terminal are coupled by communication bus 114 when practical application.It can Understand, communication bus 114 is for realizing the connection communication between these components.Communication bus 114 except include data/address bus in addition to, It further include power bus, control bus and status signal bus in addition.But for the sake of clear explanation, by various buses in Figure 15 All it is designated as communication bus 114.

It is understood that due to terminal can to common target application common operation (trigger the first control reality Existing feature operation) prior recording task is carried out, such terminal when realizing above-mentioned feature operation every time, so that it may straight It connected triggering and plays recording task, and realized above-mentioned feature operation automatically.Moreover, terminal carries out recording times in the embodiment of the present invention The mode of business can be by monitoring the touch control operation with the first display window of the second display window of current display interface mapping Operating area information, realize invocation target application the second display window corresponding operating area information function behaviour Make, realize the recording of feature operation, such implementation is simple and easy, can guarantee realizing application function (i.e. the automatically The corresponding feature operation of one control) on the basis of, reduce the complexity of realization.

The embodiment of the invention provides a kind of computer storage mediums, are applied in terminal, are stored with machine instruction, work as institute When stating machine instruction and be executed by one or more processors, the processor executes in any of the preceding embodiments described Information processing method.

Wherein, computer readable storage medium can be magnetic RAM (ferromagnetic random Access memory, FRAM), read-only memory (Read Only Memory, ROM), programmable read only memory (Programmable Read-Only Memory, PROM), Erasable Programmable Read Only Memory EPROM (Erasable Programmable Read-Only Memory, EPROM), electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, EEPROM), flash memory (Flash Memory), magnetic table The memories such as face memory, CD or CD-ROM (Compact Disc Read-Only Memory, CD-ROM).

It should be understood by those skilled in the art that, the embodiment of the present invention can provide as method, system or computer program Product.Therefore, the shape of hardware embodiment, software implementation or embodiment combining software and hardware aspects can be used in the present invention Formula.Moreover, the present invention, which can be used, can use storage in the computer that one or more wherein includes computer usable program code The form for the computer program product implemented on medium (including but not limited to magnetic disk storage and optical memory etc.).

The present invention be referring to according to the method for the embodiment of the present invention, the process of equipment (system) and computer program product Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates, Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or The function of being specified in multiple boxes.

These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one The step of function of being specified in a box or multiple boxes.

Claims (15)

1. a kind of information processing method characterized by comprising

When the recording function of target application is activated, the first display window, first display are added in current display interface Window and the second display window of the current display interface are mapping relations；

The first touch command is received in first display window, it is described current aobvious that first touch command is used to indicate triggering Show the corresponding feature operation of the first control on interface；

According to first touch command, the corresponding first operating area information of first control is obtained；

According to the first operating area information and the mapping relations of first display window and second display window, The the second operating area information for determining the current display interface records the second operating area information and completes until recording；

When triggering the target application broadcasting recording task, according to the second operating area information triggering first control Part realizes the corresponding feature operation of first control.

2. the method according to claim 1, wherein described according to the first operating area information and described The mapping relations of first display window and second display window determine the second operating area letter of the current display interface Breath records the second operating area information and completes until recording, comprising:

According to the first operating area information and the mapping relations of first display window and second display window, The the second operating area information for determining the current display interface, records the second operating area information；

Feature operation corresponding with the second operating area information is simulated, the current display interface is updated；

The current display interface in the updated carries out message processing flow next time and completes until recording.

3. the method according to claim 1, wherein it is described current display interface add the first display window it Before, the method also includes:

The recording task of the target application is established, the recording task is realized by recording function.

4. according to the method described in claim 3, it is characterized in that, the recording task for establishing the target application, Include:

The target application is determined in the application of installation on task interface；

Triggering increases new events, adds the object that the target application is the recording task, completes building for the recording task It is vertical.

5. the method according to claim 3 or 4, which is characterized in that the recording for establishing the target application is appointed After business, the method also includes:

Recording control corresponding with the target application is triggered, starting is recorded.

6. the method according to claim 1, wherein described according to the first operating area information and described The mapping relations of first display window and second display window determine the second operating area letter of the current display interface Breath, after recording the second operating area information until recording completion, the method also includes:

First display window is closed, the task interface is returned；

The recording task is arranged in the task interface to complete, shows the recording task of the target application.

7. the method according to claim 1, wherein when triggering the target application and playing recording task, institute It states and first control is triggered according to the second operating area information, realize the corresponding feature operation of first control, packet It includes:

When triggering the target application broadcasting recording task, the touching of the second operating area information is sent according to trigger sequence Hair event realizes that the simulation to first control triggers, completes the corresponding feature operation of first control.

8. a kind of terminal characterized by comprising

Adding unit, for adding the first display window in current display interface when the recording function of target application is activated, First display window and the second display window of the current display interface are mapping relations；

Receiving unit, for receiving the first touch command in first display window, first touch command is used to indicate Trigger the corresponding feature operation of the first control in the current display interface；

Acquiring unit, for obtaining the corresponding first operating area information of first control according to first touch command；

Determination unit, for according to the first operating area information and first display window and second display window The mapping relations of mouth, determine the second operating area information of the current display interface,

Recording unit is completed for recording the second operating area information until recording；

Trigger unit, for being touched according to the second operating area information when triggering the target application broadcasting recording task It sends out the first control described, realizes the corresponding feature operation of first control.

9. terminal according to claim 8, which is characterized in that the terminal further include: updating unit；

The determination unit is specifically used for according to the first operating area information and first display window and described the The mapping relations of two display windows determine the second operating area information of the current display interface,

The recording unit, specifically for recording the second operating area information；

The updating unit updates described current aobvious for simulating feature operation corresponding with the second operating area information Show interface；The current display interface in the updated carries out message processing flow next time and completes until recording.

10. terminal according to claim 8, which is characterized in that the terminal further include: establish unit；

It is described to establish unit, for described before current display interface adds the first display window, establish the target application The recording task, the recording task pass through recording function realize；

It is described to establish unit, specifically for determining the target application in the application of the installation on task interface；Triggering increases New events add the object that the target application is the recording task, complete the foundation of the recording task.

11. terminal according to claim 10, which is characterized in that

The trigger unit is also used to after the recording task for establishing the target application, triggering and the target Using corresponding recording control, starting is recorded.

12. terminal according to claim 8, which is characterized in that the terminal further include: closing unit and display unit；

The closing unit, for described according to the first operating area information and first display window and described the The mapping relations of two display windows determine the second operating area information of the current display interface, record second operation After area information is until record completion, first display window is closed, the task interface is returned；

The display unit is completed for the recording task to be arranged in the task interface, shows the institute of the target application State recording task.

13. terminal according to claim 8, which is characterized in that

The trigger unit is specifically used for sending institute according to trigger sequence when triggering the target application broadcasting recording task The trigger event of the second operating area information is stated, realizes that the simulation to first control triggers, completes first control pair The feature operation answered.

14. a kind of terminal characterized by comprising processor, receiver, display and storage medium, the receiver, institute It states display and the storage medium and is communicated by communication bus with the processor；

The storage medium, for storing executable instruction；

The receiver, for receiving executable instruction；

The processor, for executing the executable instruction stored in storage medium, the executable instruction is configured in execution The described in any item information processing methods of the claim 1 to 7 stated；

The display, for showing the information after performing executable instruction.

15. a kind of computer storage medium, which is characterized in that be applied in terminal, machine instruction be stored with, when the machine refers to When order is executed by one or more processors, the processor executes the described in any item letters of claim 1 to 7 Cease processing method.