CN108898106A

CN108898106A - A kind of processing method and electronic equipment

Info

Publication number: CN108898106A
Application number: CN201810700741.9A
Authority: CN
Inventors: 于春飞
Original assignee: Lenovo Beijing Ltd
Current assignee: Lenovo Beijing Ltd
Priority date: 2018-06-29
Filing date: 2018-06-29
Publication date: 2018-11-27

Abstract

The embodiment of the present application discloses a kind of processing method and electronic equipment, wherein processing method includes：Obtain current output data；The current output data is handled, processing result is obtained；If the original output data that the processing result shows that the current output data and target application currently export is unsatisfactory for predetermined condition, at least executes process instruction and implementing result is presented.

Description

Processing method and electronic equipment

Technical Field

The present application relates to identification technologies, and in particular, to a processing method and an electronic device.

Background

Data displayed by electronic devices such as desktop computers, tablet personal computers (PAD), mobile phones and the like may be mixed with maliciously tampered data. On the use level, the data which is maliciously added and tampered cannot be perceived by the user that the data which is maliciously tampered is mixed with the displayed data, and the user cannot feel good experience due to the data.

Disclosure of Invention

In order to solve the existing technical problem, embodiments of the present application provide a processing method and an electronic device.

The technical scheme of the embodiment of the application is realized as follows:

an embodiment of the present application provides a processing method, including:

obtaining current output data;

processing the current output data to obtain a processing result;

and if the processing result shows that the current output data and the current output original output data of the target application do not meet the preset condition, at least executing a processing instruction and presenting an execution result.

An embodiment of the present application provides an electronic device, including:

an acquisition unit for acquiring current output data;

the processing unit is used for processing the current output data to obtain a processing result;

and the execution unit is used for executing at least a processing instruction when the processing result shows that the current output data and the original output data currently output by the target application do not meet the preset condition.

According to the processing method and the electronic device, the obtained current output data are processed, and when the obtained processing result shows that the obtained current output data and the original output data currently output by the target application do not meet the preset condition, the processing instruction is executed and the execution result is presented, and the user can be reminded of the existence of unreasonable data in the current output data and/or the user can directly view the data expected to be output through the presentation of the execution result, so that the user experience is improved, and the usability of the electronic device is enhanced.

Drawings

Fig. 1 is a schematic flow chart of an implementation of a first embodiment of a processing method provided in the present application;

FIG. 2 is a schematic flow chart illustrating an implementation of a second embodiment of the processing method provided in the present application;

FIGS. 3(a) - (c) are schematic diagrams of a first application provided in the embodiments of the present application;

FIGS. 4(a) - (c) are schematic diagrams of applications provided in the embodiments of the present application;

fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

FIG. 6 is a first diagram illustrating a hardware configuration of an electronic device according to an embodiment of the present disclosure;

fig. 7 is a hardware composition schematic diagram of an electronic device according to an embodiment of the present application.

Detailed Description

It should be understood that in order to make the objects, technical solutions and advantages of the present application more clearly and completely, the technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application. In the present application, the embodiments and features of the embodiments may be arbitrarily combined with each other without conflict. The steps illustrated in the flow charts of the figures may be performed in a computer system such as a set of computer-executable instructions. Also, while a logical order is shown in the flowcharts, in some cases, the steps shown or described may be performed in an order different than in the flowcharts.

As will be appreciated by those skilled in the art, the electronic devices involved in the following embodiments of the present application include, but are not limited to: devices with display output capabilities, such as: a computer host or server, etc.; or devices with display functions, such as: smart televisions, all-in-one computers, notebook computers, tablet computers, mobile phones or electronic readers and the like, and also can be wearable devices such as smart glasses or smart watches.

The first embodiment of the processing method provided by the present application is applied to an electronic device, and the electronic device may be a smart television, a mobile phone, a tablet computer, and other devices capable of outputting data. The data output by the electronic device may be video data (image data), audio data, or audio-visual data.

Fig. 1 is a schematic flow chart of an implementation of a first embodiment of a processing method provided in the present application; as shown in fig. 1, the method includes:

step 101: obtaining current output data;

in this step, the current output data may be obtained in real time, may be obtained at a fixed time, and may also be obtained based on a certain trigger instruction, for example, based on an operation of the user when the user has a need (the trigger instruction is generated based on the operation of the user).

Step 102: processing the current output data to obtain a processing result;

step 103: and if the processing result shows that the current output data and the current output original output data of the target application do not meet the preset condition, at least executing a processing instruction and presenting the processing result.

The main body for executing the steps 101-103 is an electronic device.

In step 102, the electronic device analyzes the current output data obtained in step 101 (which may be regarded as a specific processing manner) to obtain an analysis result (processing result), and in step 103, if the analysis result indicates that the obtained current output data and the original output data currently output by the target application do not satisfy the predetermined condition, the electronic device executes the processing instruction and presents the execution result. The execution result obtained by executing the processing instruction can play a role in reminding the user and/or a role in enabling the user to directly watch the data expected to be output, and user experience is improved.

It can be understood that the currently output original output data of the target application is the data which is expected to be output, and the data which is output by the electronic device is known whether the data is mixed with the unreasonable data or not by the following processing procedures: analyzing the current output data, analyzing whether the current output data is matched with the current output original data of the target application, specifically, performing similarity matching on the obtained current output data and the current output original data of the target application, obtaining a similarity matching result, judging whether the matching result is located in a preset similarity range, for example, the similarity range is [ 80%, 90% ] or [ 70%, 100% ], if the similarity matching result obtained through the similarity matching is not located in the preset similarity range (does not meet the preset similarity range), considering that the analysis result indicates that the current output data is not matched with the current output original data of the target application, namely, when the current output data and the current output original data of the target application are determined not to meet the preset condition, considering that the current output data is mixed with unreasonable data, the processing instruction is executed. In the foregoing description, the similarity range is taken as a range value, and it should be understood by those skilled in the art that the similarity range may also be a specific value such as 90% or 100%, that is, whether the matching result reaches 90% or 100% is determined. It should be noted that the values of the similarity degree range mentioned above are only specific examples, and are not limited to all the cases of the embodiments of the present application. The preset similarity range in the embodiment of the application can also be any other reasonable value, and the description is not made.

It can be understood that the unreasonable data in the embodiments of the present application may be obtained by performing malicious tampering, such as modification, deletion, and addition, on at least part of the desired output data based on the desired output data, and the unreasonable data may also be data in which the desired output data of the blocked part cannot be viewed by the user due to the undesired output data being blocked on the desired output data.

In the above scheme, when it is determined that the current output data and the original output data currently output by the target application do not satisfy the predetermined condition, that is, the current output data is mixed with the unreasonable data, at least the processing instruction may be executed. In embodiments of the present application, the processing instructions include hint instructions and/or adjustment instructions.

When the processing instruction is a prompt instruction, the electronic device executes the prompt instruction, which is regarded as prompt data used for prompting that the current output data and the original output data currently output by the target application do not meet the predetermined condition, generated by the electronic device, that is, prompt data used for prompting that the current output data is mixed with unreasonable data is generated to remind a user. The scheme for generating the prompt message when the unreasonable data exists in the output data at least can play a role in reminding the user, and improves the use experience of the user.

In the embodiment of the present application, the manner of generating the prompt data is at least one of the following two ways:

first, the electronic device may generate the reminder data by adding the reminder data based on the current output data. For example, a prompt box (prompt data) pops up on the window of the currently output data, and the prompt box is used for prompting the user that the currently output data is mixed with the unreasonable data. Also, for example, an alarm signal (prompt data) is generated when the current output data is output, and the alarm signal may be output in the form of sound or may be output in the form of a signal light. In view of the output data being output in video, audio or audio-video form, the prompt data and the output data may optionally be in the same or different forms. Wherein, the form is the same case: if the current output data is image data, visual prompting effects such as signal lamp flickering or prompting in the form of image by the prompting data are generated. If the current output data is audio-video data, the prompting effects on the sense of hearing and vision, such as a horn playing prompting sound and signal lamp flickering, are generated simultaneously. In the case of different forms, the output form of the data generating the prompt effect is different from the output form of the currently output data, and specific reference may be made to the opposite description of the case of the same form, which is not described again.

Second, the electronic device may also generate the prompt data by processing the current output data of the first effect into the current output data of the second effect. The first effect may be a display effect that does not prompt that the current output data includes the unreasonable data. The second effect may be a display effect indicating that there is unreasonable data in the currently output data. The current output data or the unreasonable data in the current output data can be output after being identified. For example, the current output data with the unreasonable data or the unreasonable data of the current output data is highlighted or output after being brushed yellow, which belongs to the static output situation. And the highlight part can be output in a flashing mode or the yellow brushing part can be output in a flashing mode, and the dynamic output is achieved. In addition, unreasonable data can be output in the form of animation for the case of dynamic output. In practical application, all other reminding modes for reminding a user that the current output data contains the unreasonable data can be provided.

When the processing instruction is an adjusting instruction, the electronic equipment executes the adjusting instruction to adjust the current output data so that the current output data and the original output data currently output by the target application meet the preset condition, and further enables the current output data to be matched with the original output data currently output by the target application by processing the current output data. For example, the output parameter of the non-legitimate data in the current output data is adjusted to be hidden, such as adjusting the output volume of the audio data to be the lowest (e.g., the output volume is 0) for the case that the non-legitimate data is audio data, or adjusting the transparency of the graphics data to be the most transparent (e.g., the transparency is 0) for the case that the non-legitimate data is image data. For example, the electronic device performs interception of a window for displaying the unreasonable data, so that the unreasonable data is not displayed; or, the electronic device directly restores and displays the expected output data which should be displayed at the position of the unreasonable data, thereby achieving the effect that the user cannot watch the unreasonable data. Neither of the above adjustment procedures is felt by the user, who can see the data desired to be output. The way of adjusting and enabling the user to view the data which should be viewed can greatly improve the use experience of the user.

When the processing instruction is a prompt instruction and an adjustment instruction, for the description of the adjustment instruction, during or after the adjustment process, prompt information can be generated and used to prompt a user that the current output data has unreasonable data but the expected output data is restored, that is, the data watched by the user is the data obtained by restoring the unreasonable data and the expected output data, so that the user is informed to watch the data with confidence.

In an alternative embodiment, the obtaining of the current output data may be: and detecting the application of the current output data, and if the application is the target application, obtaining the current output data. The target application may be an application capable of image, audio and/or audiovisual data output, such as an audio player, a video player or an audiovisual player. It can be understood that: the electronic equipment detects the application of the currently output data, and if the application is detected to be the target application, the currently output data of the application is acquired.

In an optional embodiment, the obtaining current output data may further be: and detecting current output data of the target application, and if the target interaction data exists in the current output data, acquiring the current output data. The target interaction data is data capable of interacting with a user. The target interaction data includes: target input data and/or target output data, generally refers to input and/or output data associated with a privilege. For example, the target output data is data, such as a two-dimensional code image, which is used to influence the usage right of the user's assets/resources after being collected, and after being scanned, the usage right/management right of the user's private data/part of the property data is handed over to other devices/accounts, and actions such as logging in to other devices or paying for other accounts are generated. For example, the target input data is data for collecting user authority information, such as an input box for inputting a user name and a password. And if the current output data of the target application has data which is similar to a two-dimensional code, an input box and the like and can be used for interaction between the user and the electronic equipment, acquiring the current output data.

In the subsequent scheme, if target interaction data carried by the target application is blocked by unreasonable data in the second image layer, unnecessary loss is generated for a user. Taking target interactive data as a two-dimensional code image as an example, the two-dimensional code image is output data carried by a target application, and when a user scans the two-dimensional code image, the two-dimensional code image is convenient for the user to interact with the target application, so that behaviors such as voting, lottery drawing and the like of the target application are realized. If the reasonable two-dimensional code image is blocked by the unreasonable data, inconvenience is brought to interaction between a user and a target application. If the unreasonable data which blocks the reasonable two-dimensional code image is an illegal two-dimensional code, economic loss can be caused after the user scans the illegal two-dimensional code. Taking target interactive data as an input box for inputting a user name and a password as an example, after a user inputs the user name and the password through the input box, the user can perform actions such as account login and purchase. If the reasonable input box is blocked by the unreasonable data, the user can not realize the successful login of the account number and can not execute the user behaviors such as ordering, purchasing and the like.

The above scheme is two acquisition opportunities for the currently output data. In the two cases, the output data obtained has higher possibility of having unreasonable data, so that invalid acquisition and processing of the output data of the electronic equipment can be avoided to a certain extent, and the functional diversity of the electronic equipment is embodied.

A second embodiment of the processing method provided in the present application is described by taking current output data as image data as an example.

FIG. 2 is a schematic flow chart illustrating an implementation of a second embodiment of the processing method provided in the present application; as shown in fig. 2, the method includes:

step 201: obtaining current image data;

step 202: processing the current image data to obtain a processing result;

step 203: and if the processing result shows that the current image data and the original image data currently output by the target application do not meet the preset condition, at least executing the processing instruction and presenting an execution result.

In this embodiment, it is preferable that the current output image is acquired at the two specific acquisition occasions, the current output image is analyzed, and when the analysis result indicates that the current output image and the original image currently output by the target application do not satisfy the predetermined condition, it is determined that unreasonable data exists in the current output image, a prompt instruction and/or an adjustment instruction is/are executed, and an execution result is displayed. The scheme of executing the prompt instruction and/or the adjustment instruction and displaying the execution result after analyzing that the current output image contains the unreasonable data can at least play a role in reminding the user, and the use experience of the user can be remarkably improved.

The non-legitimate data may be image data, text data, or audio data, which is not limited in this respect.

In practical applications, the target application is an application displayed by a currently activated window, and may also be an application occupying the largest proportion of display data to meet the requirement that the electronic device may need more than one application for data output.

As described above, the unreasonable data may also be data that is occluded above the desired output data, so that the user cannot view the occluded part of the desired output data. For the unreasonable data of this case, the processing method further comprises:

if the display data of the target application corresponds to a first layer; and at least judging whether a second layer covering the first layer exists or not. Here, if it is determined that there is a layer that blocks the desired output data, it can be considered that there is unreasonable data in the current output data in addition to the desired output data (of the target application).

In an optional embodiment, for a situation that information such as a two-dimensional code and an input box available for a user to interact with an electronic device exists in a target application, when it is determined that a second layer covering a first layer exists, the following method is further adopted to determine whether a reminding instruction and/or an adjusting instruction needs to be executed: judging whether the position of the content in the second layer and the position of the target interactive data in the target application meet a preset position relationship, and executing at least a processing instruction when the position of the content in the second layer and the position of the target interactive data in the target application meet the preset position relationship; and/or judging whether the type of the content in the second layer is the same as the type of the target interactive data in the target application or not, and at least executing a processing instruction when the type is judged to be the same.

In the above scheme, if the display data applied according to the target is output in the first layer, it is determined whether a second layer covering the first layer exists, that is, whether the unreasonable data exists and whether the unreasonable data appears in a form of covering part of expected output data. And if the second layer covering the first layer exists, the electronic equipment at least executes a prompt instruction to send a prompt for prompting existence of the unreasonable data. In one implementation, a prompt is triggered whenever there is occlusion to alert the user that there is non-legitimate data. The prompting does not distinguish the shielding degree of the second layer to the first layer, and the possibility of missing the prompting can be greatly avoided. However, in practical applications, if the occlusion area of the second layer on the first layer is small, which will not affect the use of the target interaction data of the corresponding target application in the first layer by the user, the prompt is equivalent to an invalid prompt. In order to avoid the electronic device from generating an invalid prompt, in the embodiment of the present application, when a second layer that shields a first layer exists, a shielding area of the second layer with respect to the first layer is estimated, and it is determined that the shielding area meets a predetermined area, for example, a prompt is generated when the shielded area of the first layer reaches 10% or 15% of the entire area of the first layer; or when the shielded area of the first image layer reaches 5% of the area of the display area of the unreasonable data in the second image layer, generating a prompt. The prompt mode can avoid invalid prompt and provide more accurate prompt information for the user.

When it is determined that a second layer covering a first layer exists, it means that a layer covering desired output data exists, and the content in the covered layer may cause economic loss to a user or may not cause economic loss to the user, and needs to be distinguished by the following method: when the occlusion layer exists, whether the position of the unreasonable data in the second layer on the display screen and the position of the two-dimensional code and the input box on the display screen, which are used for interacting with the user and appear in the target application, meet a predetermined occlusion relationship (predetermined position relationship) is continuously judged, that is, whether the unreasonable data in the second layer partially or completely occludes at least part of display data in the target application is judged. Wherein the full occlusion comprises an equal-area occlusion and a larger-area occlusion. And if the occlusion relation is judged to be met, executing a prompt instruction and/or an adjustment instruction for reminding the user that the unreasonable data is data which can cause loss to the user to a great extent. In the embodiment, the prompt can be generated regardless of the occlusion degree as long as the occlusion relation of the unreasonable data to the target interaction data exists. And the user can be prompted when the shielding area reaches a certain degree, so that more accurate prompt information can be provided for the user. For details, reference is made to the foregoing description about the inter-layer shielding area, and no repeated description is given here.

When the second layer covering the first layer is judged to exist, whether the type of the unreasonable data in the second layer is the same as the type of the target interactive data in the target application or not can be continuously judged, if yes, a prompt instruction and/or an adjustment instruction is executed for reminding a user. And if the type of the unreasonable data in the second layer is the same as that of the target interactive data, at least executing a prompt instruction to trigger a prompt so as to remind a user. The prompt is generated when the two types are determined to be different. It should be understood by those skilled in the art that the non-legitimate data in the embodiment of the present application is any data other than the raw output data of the target application, and the non-legitimate data may or may not be data that causes a loss to the user. For example, in practical applications, the situation that the unreasonable data is push information is an advertisement, and if the advertisement appears in the lower right corner of the display screen of the electronic device and the target interaction data appears in the upper left corner of the display screen, the electronic device may not trigger a prompt when the two-dimensional code image appearing in the advertisement and allowing the user to know the content of the specific advertisement is far away from the display position of the two-dimensional code image carried by the target application on the display screen, for example, the distance is not up to 3cm (centimeters). Therefore, in the technical scheme of the embodiment, the electronic equipment ensures that no prompt is generated for the situation that the loss is not caused to the user as far as possible.

Based on the foregoing, the processing method further includes: and when the type of the content in the second layer is judged to be the same as that of the target interactive data, further judging that the distance between the display position of the content in the second layer on the display screen and the display position of the target interactive data does not meet a preset distance condition, at least executing a processing instruction. For example, a distance between two display positions of not 3cm, 5cm or a half length of a diagonal line of the display screen may be regarded as not satisfying the predetermined distance condition. The predetermined distance condition may be any other conceivable reasonable matter, and is not limited to the above.

In the above scheme, whether the data appearing in the second layer is the unreasonable data or not is determined according to the position and/or the type of the content of the second layer, so that the unreasonable data can be accurately judged, and a more accurate basis is provided for the reminding function of the electronic device.

Examples of the present application will be further described with reference to fig. 3(a) to (c) and fig. 4(a) to (c).

In fig. 3(a) - (c) and 4(a) - (c), the electronic device is a smart tv, and the original output data (desired output data) of the target application 1 is the internal environment of the automobile.

The smart television detects the application of the currently output data, and assuming that the smart television performs video playing on the data (expected output data) of the target application 1 currently played by the video player, it is determined that the application of the currently output data is the target application 1, and collects the data played by the video player if the collected data is an image a, as shown in fig. 3 (a). Whether there is any unreasonable data in the image a can be judged by the following method: reading the cached expected output data of the target application 1, in the image a, if the image a is regarded as being output in an output layer, outputting the partial data of the view image a-the expected output data of the target application 1 in the first layer, and judging whether other layers which block the first layer exist, if the other layers which block the first layer exist, the layer which blocks the first layer is regarded as a second layer, as shown in fig. 3(a), and if the second layer is partly blocks the first layer, it is considered that the unreasonable data which appears in the second layer, is in a form of blocking the partial expected output data, such as the two-dimensional code B in fig. 3 (a). And (3) executing the prompt instruction by the smart television to generate a prompt box as shown in (B), wherein the prompt box is used for reminding a user that the two-dimension code B in the data-image A currently output by the smart television is an unreasonable two-dimension code, and reminding the user that the two-dimension code B cannot be scanned by using a mobile phone. The smart television may also execute an adjustment instruction to adjust the transparency of the pattern of the two-dimensional code B to 0, so that the user cannot view the two-dimensional code B, but views data (original output data of the target application 1) that the user is originally expected to view, as shown in fig. 3 (c).

In fig. 3(a) - (c), it can be understood that the image a is a whole output data of the smart television, and includes not only the desired output data (the original output data of the target application 1, output in the first layer) but also the unreasonable data (the two-dimensional code B, output in the second layer) in which the desired output data is blocked.

The smart television detects image output data (video) of the target application 1, and when it is detected that a two-dimensional code image such as a two-dimensional code 1 exists in the image output data of the target application 1, acquires current image output data of the target application 1 to obtain an image a, as shown in fig. 4 (a). The two-dimensional code 1 is target interactive data carried in output data of the target application 1, and is reasonable data, so that a user can scan the two-dimensional code 1 through the mobile phone to vote and participate in activities such as lottery running and the like on a currently played video. Next, the smart television reads the cached expected output data of the target application 1, in the image a, if the image a is seen as being output in the output layer, the partial data of the view image a, namely the expected output data of the target application 1, is output in the first layer, and determines whether there are other layers which obscure the first layer, if it is determined that there are other layers which obscure the first layer, the layer which visually obscures the first layer is the second layer, and the content of the second layer is the two-dimensional code 2.

On the basis of judging that the second layer exists, whether the (display) position of the content (two-dimensional code 2) in the second layer on the display screen and the (display) position of the two-dimensional code 1 appearing in the target application 1 on the display screen meet a predetermined partial occlusion relationship or a complete occlusion relationship is continuously judged, that is, whether the two-dimensional code 2 in the second layer occludes the two-dimensional code 1 in the target application 1 is judged, as shown in fig. 4(a), if the two-dimensional code 2 in the second layer partially occludes the two-dimensional code 1 in the target application 1, a prompt instruction and/or an adjustment instruction is executed for prompting a user.

Or, on the basis of judging that the second layer exists, whether the two-dimensional code 2 in the second layer is the same as the two-dimensional code 1 in the target application or not may be continuously judged. Considering that the content in the second layer and the target interactive data in the target application both belong to the two-dimensional code type, the types are judged to be the same through the judgment, and a prompt instruction and/or an adjustment instruction is executed for reminding a user.

Or, on the basis of determining that the second layer exists, it may further continue to determine whether the (display) position of the content in the second layer on the display screen and the (display) position of the two-dimensional code 1 appearing in the target application 1 on the display screen satisfy a predetermined partial occlusion relationship or a complete occlusion relationship, and determine whether the types of the two-dimensional code 2 in the second layer and the two-dimensional code 1 in the target application are the same. And when the two-dimensional code 2 in the second layer is judged to shield the two-dimensional code 1 in the target application 1 and the two-dimensional code 2 in the second layer and the two-dimensional code in the first layer belong to the same type, executing a prompt instruction and/or an adjustment instruction for reminding a user.

The smart television executes the prompt instruction, generates a prompt box as shown in fig. 4(B), and is used for reminding the user that the two-dimensional code 2 in the data-image a currently output by the smart television is an unreasonable two-dimensional code and reminding the user that the two-dimensional code B cannot be scanned. The smart television may also execute the adjustment instruction to display the content that should be displayed at the position of the two-dimensional code 2 in the expected output data, so that the user cannot view the two-dimensional code 2 but sees the output data of the target application 1, as shown in fig. 4 (c). The smart television can also execute a prompt instruction and an adjustment instruction, display the content which is originally displayed at the position of the two-dimensional code 2 in the expected output data, and prompt the user that the shielded data is restored and no unreasonable data exists.

In the above scheme, when the smart television determines that the current output data contains the unreasonable data and the unreasonable data appears in a form of shielding the expected output data, the smart television executes a prompt instruction and/or an adjustment instruction at least for reminding a user that the unreasonable data exists in the current output data and/or directly restoring the expected output data which should originally appear at the display position of the unreasonable data, so that the user cannot view the unreasonable data and directly view the original output data of the target application 1. The use experience of the user can be greatly improved, and the usability of the equipment product is highlighted.

The present application further provides an embodiment of an electronic device, as shown in fig. 5, the electronic device includes: an acquisition unit 501, a processing unit 502, and an execution unit 503; wherein,

an obtaining unit 501, configured to obtain current output data;

a processing unit 502, configured to process the current output data to obtain a processing result;

an executing unit 503, configured to execute at least a processing instruction when the processing result indicates that the current output data and the original output data currently output by the target application do not satisfy a predetermined condition.

In one embodiment of the present invention,

the processing instructions include at least one of:

a prompt instruction for generating prompt data, wherein the prompt data is at least used for prompting that the current output data and the original output data currently output by the target application do not meet the preset condition;

and adjusting the current output data so that the current output data and the original output data currently output by the target application meet the preset condition.

Wherein, the step of the current output data and the original output data currently output by the target application not meeting the preset condition comprises the following steps: the current output data is not matched with the original output data currently output by the target application;

and is

The generating hint data includes at least one of: adding prompt data based on the current output data; or processing the current output data of the first effect into the current output data of the second effect;

or

The adjusting the current output data comprises: and processing the current output data to enable the current output data to be matched with the original output data currently output by the target application.

The obtaining unit 501 is further configured to:

detecting the application of the current output data, and if the application is the target application, obtaining the current output data; or,

and detecting current output data of the target application, and if the target interaction data exists in the current output data, acquiring the current output data.

In an alternative embodiment of the method according to the invention,

an obtaining unit 501, configured to obtain current image data;

a processing unit 502, configured to process the current image data to obtain a processing result;

an executing unit 503, configured to execute at least the processing instruction and present an execution result if the processing result indicates that the current image data and the original image data currently output by the target application do not satisfy the predetermined condition.

The target application is an application displayed by a currently activated window or an application occupying the largest proportion of display data;

if the display data of the target application corresponds to a first layer; the execution unit 503 is further configured to at least determine whether a second layer that covers the first layer exists.

The executing unit 503 is further configured to, at least when determining whether a second layer that covers the first layer exists, determine whether a position of content in the second layer and a position of target interaction data in the target application satisfy a predetermined position relationship.

The execution unit 503 is further configured to, at least when determining whether a second layer that covers the first layer exists, determine whether the type of the content in the second layer is the same as the type of the target interactive data in the target application.

The execution unit 503 is further configured to perform similarity matching on the current output data and the original output data currently output by the target application; and when the similarity matching result does not meet the preset similarity range, determining that the current output data and the original output data currently output by the target application do not meet the preset condition.

The present application further provides an embodiment of an electronic device, as shown in fig. 6, the electronic device includes: an acquirer 601 and a processor 602; wherein,

an acquirer 601 for acquiring current output data;

a processor 602, configured to process the current output data to obtain a processing result; and when the processing result shows that the current output data and the current output original output data of the target application do not meet the preset condition, at least executing a processing instruction.

In one embodiment of the present invention,

the processing instructions include at least one of:

and is

or

The acquirer 601, further configured to:

In an alternative embodiment of the method according to the invention,

an acquirer 601 configured to acquire current image data;

a processor 602, configured to process the current image data to obtain a processing result; and if the processing result shows that the current image data and the original image data currently output by the target application do not meet the preset condition, at least executing the processing instruction and presenting an execution result.

if the display data of the target application corresponds to a first layer; the processor 602 is further configured to at least determine whether a second layer that covers the first layer exists.

The processor 602 is further configured to, when at least judging whether a second layer that covers the first layer exists, judge whether a position of content in the second layer and a position of target interaction data in the target application satisfy a predetermined position relationship.

The processor 602 is further configured to, when at least judging whether a second layer that covers the first layer exists, judge whether a type of content in the second layer is the same as a type of target interactive data in the target application.

A processor 602, further configured to perform similarity matching on the current output data and the original output data currently output by the target application; and when the similarity matching result does not meet the preset similarity range, determining that the current output data and the original output data currently output by the target application do not meet the preset condition.

The electronic device may also be as shown in fig. 7, and further includes a memory 600 for storing computer-executable instructions that, when executed by the processor 602 from the memory 600, perform at least the following:

obtaining current output data;

processing the current output data to obtain a processing result;

The present application further provides a computer storage medium, where the storage medium stores computer-executable instructions, and when the processor 602 executes the computer-executable instructions, the storage medium is at least used for executing the processing method described in any of the foregoing embodiments. The computer storage medium in this embodiment may be memory 600 as shown in fig. 7, and the memory 600 may be implemented by any type of volatile or non-volatile storage device, or a combination thereof. The nonvolatile Memory may be a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a magnetic Random Access Memory (FRAM), a Flash Memory (Flash Memory), a magnetic surface Memory, an optical Disc, or a Compact Disc Read-Only Memory (CD-ROM); the magnetic surface storage may be disk storage or tape storage. Volatile Memory can be Random Access Memory (RAM), which acts as external cache Memory. By way of illustration and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM, Double Data Synchronous Random Access Memory), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM, Enhanced Synchronous Dynamic Random Access Memory), Synchronous link Dynamic Random Access Memory (SLDRAM, Synchronous Dynamic Random Access Memory), Direct Memory bus (DRmb Access Memory, Random Access Memory). The memory 600 described in embodiments herein is intended to comprise, without being limited to, these and any other suitable types of memory.

The various components in the electronic devices of fig. 6 and 7 are coupled together by a bus system 605. It is understood that the bus system 605 is used to enable communications among the components. The bus system 605 includes a power bus, a control bus, and a status signal bus in addition to a data bus. But for the sake of clarity the various buses are labeled as bus system 605 in figures 6 and 7.

It should be noted that, in order to implement the processing method, the present application also provides the electronic device shown in fig. 5, fig. 6, and fig. 7, because the principle of solving the problem of the electronic device is similar to the processing method, the implementation process and the implementation principle of the electronic device can be described by referring to the implementation process and the implementation principle of the processing method, and repeated details are not described again.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, all functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.

Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: a mobile storage device, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.

Alternatively, the integrated units described above in the present application may be stored in a computer-readable storage medium if they are implemented in the form of software functional modules and sold or used as independent products. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially implemented or portions thereof contributing to the prior art may be embodied in the form of a software product stored in a storage medium, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic or optical disk, or various other media that can store program code.

The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A method of processing, comprising:

obtaining current output data;

processing the current output data to obtain a processing result;

2. The method of claim 1, the processing instructions comprising at least one of:

3. The method of claim 2, wherein the first and second light sources are selected from the group consisting of,

the step of enabling the current output data and the original output data currently output by the target application not to meet the preset condition comprises the following steps of: the current output data is not matched with the original output data currently output by the target application;

and is

or

4. The method of claim 1, the obtaining current output data, comprising:

5. The method of claim 1, the method comprising:

obtaining current image data;

processing the current image data to obtain a processing result;

and if the processing result shows that the current image data and the original image data currently output by the target application do not meet the preset condition, at least executing the processing instruction and presenting an execution result.

6. The method of claim 5, wherein the target application is an application displayed by a currently activated window or an application with the largest proportion of display data;

if the display data of the target application corresponds to a first layer; and at least judging whether a second layer covering the first layer exists or not.

7. The method according to claim 6, when determining whether there is a second layer that occludes the first layer, the method further comprising:

and judging whether the position of the content in the second layer and the position of the target interactive data in the target application meet a preset position relationship.

8. The method according to claim 6, when determining whether there is a second layer that occludes the first layer, the method further comprising:

and judging whether the type of the content in the second layer is the same as the type of the target interactive data in the target application.

9. The method of claim 1, further comprising:

carrying out similarity matching on the current output data and the original output data currently output by the target application;

and when the similarity matching result does not meet the preset similarity range, determining that the current output data and the original output data currently output by the target application do not meet the preset condition.

10. An electronic device, comprising:

an acquisition unit for acquiring current output data;