CN113485662A

CN113485662A - Anti-shake method and electronic device

Info

Publication number: CN113485662A
Application number: CN202110762364.3A
Authority: CN
Inventors: 张世杰
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2021-07-06
Filing date: 2021-07-06
Publication date: 2021-10-08

Abstract

The application discloses an anti-shake method and electronic equipment, and belongs to the field of artificial intelligence. The method comprises the following steps: judging whether the target electronic equipment is in a shaking state or not based on equipment shaking parameter information of the target electronic equipment; if the judgment result is yes, acquiring text information displayed on a screen of the target electronic equipment; determining text jitter parameter information of the text information based on the device jitter parameter information; wherein, the text jitter parameter information and the equipment jitter parameter information have a reverse jitter relation; and adjusting the display parameters of the text information based on the text dithering parameter information, and displaying the text information based on the display parameters.

Description

Anti-shake method and electronic device

Technical Field

The application belongs to the field of artificial intelligence, and particularly relates to an anti-shaking method and electronic equipment.

Background

With the rapid development of the field of artificial intelligence, the functions of internet application in the intelligent terminal are more and more abundant, and become an indispensable part in daily life of people gradually. In the internet application, people can enrich own amateur life through the functions of browsing videos, reading documents and the like.

At present, passengers who use electronic readers such as mobile phones, tablet computers and KINDLE to read documents and novels on subways and buses are often seen, and due to the fact that the bodies of the subways and the buses are shaken in the driving process, screens of equipment are shaken, and therefore the problem that visual fatigue caused by shaking of the equipment and adverse effects on eyes of users are caused in the reading state is caused.

Disclosure of Invention

The embodiment of the application aims to provide an anti-shake method and electronic equipment, and the problem that visual fatigue and adverse effects on eyes are caused by equipment shake when a user reads the electronic equipment can be solved.

In a first aspect, an embodiment of the present application provides an anti-shake method, where the method includes:

judging whether the target electronic equipment is in a shaking state or not based on equipment shaking parameter information of the target electronic equipment;

if so, acquiring text information displayed on a screen of the target electronic equipment;

determining text jitter parameter information of the text information based on the device jitter parameter information; wherein the text jitter parameter information and the device jitter parameter information have a reverse jitter relationship;

and adjusting the display parameters of the text information based on the text dithering parameter information, and displaying the text information based on the display parameters.

In a second aspect, an embodiment of the present application provides an anti-shake apparatus, including:

the jitter state identification module is used for judging whether the target electronic equipment is in a jitter state or not based on equipment jitter parameter information of the target electronic equipment;

the text information acquisition module is used for acquiring the text information displayed on the screen of the target electronic equipment if the judgment result is yes;

the text jitter parameter determining module is used for determining text jitter parameter information of the text information based on the equipment jitter parameter information; wherein the text jitter parameter information and the device jitter parameter information have a reverse jitter relationship;

and the text information adjusting module is used for adjusting the display parameters of the text information based on the text jitter parameter information and displaying the text information based on the display parameters.

In a third aspect, an embodiment of the present application provides an electronic device, including: a processor, a memory and a program or instructions stored on the memory and executable on the processor, which when executed by the processor, implement the steps of the anti-shake method according to the first aspect.

In a fourth aspect, the present application provides a readable storage medium, on which a program or instructions are stored, and when executed by a processor, the program or instructions implement the steps of the anti-shake method according to the first aspect.

In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the anti-shake method according to the first aspect.

In the embodiment of the application, whether the target electronic equipment is in a shaking state is judged based on equipment shaking parameter information of the target electronic equipment, and text information displayed on a screen of the target electronic equipment is automatically acquired aiming at the condition that the target electronic equipment is determined to be in the shaking state; determining text jitter parameter information of the text information based on the equipment jitter parameter information; the text jitter parameter information and the equipment jitter parameter information have a reverse jitter relation; the display parameters of the text information are adjusted based on the text jitter parameter information, the text information is displayed based on the display parameters, namely the display parameters of the text information are adjusted in a reverse jitter mode between the text jitter and the equipment jitter, so that the equipment jitter caused by the environmental jitter is compensated by adjusting the display parameters of the text information, the problems of visual fatigue and adverse effects on eyes caused by the equipment jitter when a user reads the text information are solved, and the use experience of the user when the electronic equipment is in a jitter state is improved.

Drawings

Fig. 1 is a first flowchart of an anti-shake method provided in an embodiment of the present application;

fig. 2 is a second flowchart of an anti-shake method provided in an embodiment of the present application;

fig. 3a is a third schematic flowchart of an anti-shaking method provided in the embodiment of the present application;

FIG. 3b is a graph of displacement versus time in an anti-shake method provided by an embodiment of the present application;

FIG. 3c is a graph of velocity over time in an anti-shake method provided by an embodiment of the present application;

fig. 4 is a fourth flowchart of an anti-shake method provided in the embodiment of the present application;

fig. 5 is a fifth flowchart of an anti-shake method provided in an embodiment of the present application;

fig. 6 is a sixth flowchart of an anti-shake method provided in an embodiment of the present application;

fig. 7 is a schematic diagram of a module composition of an anti-shake apparatus provided in an embodiment of the present application;

fig. 8 is a schematic structural diagram of an electronic device provided in an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described clearly below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments that can be derived by one of ordinary skill in the art from the embodiments given herein are intended to be within the scope of the present disclosure.

The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.

The anti-shake method and the electronic device provided by the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and application scenarios thereof.

Fig. 1 is a first flowchart of an anti-shake method provided in an embodiment of the present application, where the method in fig. 1 can be executed by an electronic device, as shown in fig. 1, the method at least includes the following steps:

s101, judging whether the target electronic equipment is in a shaking state or not based on equipment shaking parameter information of the target electronic equipment;

wherein, the device jitter parameter information may include: at least one of jitter amplitude information, jitter frequency information, jitter displacement information, jitter velocity information, and jitter direction information; when the target electronic equipment is determined to be in a shaking state based on the equipment shaking parameter information of the target electronic equipment, executing the following steps S102 to S104; when the target electronic equipment is determined to be in a non-jitter state or the target electronic equipment is determined to exit from a jitter state based on the equipment jitter parameter information of the target electronic equipment, no processing is performed or a text jitter processing mode exits;

specifically, the device shaking parameter information may be detected by a sensor built in the electronic device, and the sensor built in the electronic device may include: at least one of a gyroscope, a speed sensor, a displacement sensor, a frequency sensor and an acceleration sensor, wherein the gyroscope is used for detecting the shaking direction of the equipment; the speed sensor is used for detecting the real-time speed of the equipment; the displacement sensor is used for detecting real-time displacement of equipment; the frequency sensor is used for detecting the real-time frequency of the equipment; and the acceleration sensor is used for detecting the real-time acceleration of the equipment.

If the judgment result is yes, executing S102 to obtain text information displayed on a screen of the target electronic equipment;

the text information may be text content displayed on an interactive interface of an application program currently running in the foreground of the target electronic device, for example, the application program is a browser application, and correspondingly, the text information is search content information displayed on a webpage, and for example, the application program is a recruitment website application, and correspondingly, the text information is recruitment announcement information displayed on a recruitment website.

S103, determining text jitter parameter information of the text information based on the equipment jitter parameter information; the text jitter parameter information and the equipment jitter parameter information have a reverse jitter relation; the text dither parameter information may include: at least one item of text dithering displacement information, text dithering speed information and text dithering direction information;

in specific implementation, for the determination process of the text jitter parameter information, which device jitter parameter information is selected as reference information may be determined by combining with a device jitter type of the target electronic device, for example, for a case that the device jitter type of the target electronic device is regular jitter, device jitter frequency information and device jitter amplitude information are used as reference information of the determination process of the text jitter parameter, specifically, the text jitter displacement information may be determined based on a signal collected by a built-in sensor of the target electronic device, and then based on the device jitter amplitude information, the device jitter frequency information and an amplitude-frequency-displacement relational expression; determining text shaking speed information based on the equipment shaking amplitude information, the equipment shaking frequency information and the amplitude-frequency-speed relational expression, wherein the shaking displacement direction and the shaking speed direction of the text are opposite to the shaking direction of the equipment; specifically, the method includes directly determining equipment shaking displacement and equipment shaking speed based on signals collected by a built-in sensor of the target electronic equipment, wherein the equipment shaking displacement and the text shaking displacement are set to be equal in size and opposite in direction, and the equipment shaking speed and the text shaking speed are set to be equal in size and opposite in direction.

And S104, adjusting the display parameters of the text information based on the text dithering parameter information, and displaying the text information based on the display parameters.

Specifically, the display parameters of the text information include: at least one of a text displacement parameter, a text speed parameter, and a text direction parameter; when the display parameters of the text information are adjusted, the text shaking displacement is taken as the moving displacement, the text direction parameter is adjusted in the text shaking direction, and the text displacement parameter of the text information is adjusted according to the size of the text shaking displacement; and adjusting text direction parameters in the text shaking direction by taking the text shaking speed as the moving speed, and adjusting the text speed parameters of the text information according to the size of the text shaking speed; the text dithering displacement and speed are the same as the equipment dithering displacement and speed, the directions are opposite, and the text information is displayed based on the text displacement parameter, the text speed parameter and the text direction parameter, namely, the equipment dithering caused by the environmental dithering is compensated by adjusting the display parameter of the text information.

Wherein, the text information that the screen of target electronic equipment demonstrates can be updated through the screenshot and acquire through the word recognition technology, can also directly transfer the text information that present page demonstrates from electronic equipment' S word stock, and to adopting the mode of screenshot, the above-mentioned mode of directly transferring text information from the word stock is more convenient, and is concrete, as shown in fig. 2, the text information that the screen of above-mentioned S102 acquisition target electronic equipment demonstrates specifically includes:

s1021, performing screenshot processing on the current display page of the target electronic equipment to obtain the image information of the current display page;

and S1022, performing character recognition on the page image information by using a preset character recognition technology to obtain text information in the page image information.

Specifically, aiming at the condition of the first screenshot, taking an image obtained by the first screenshot as an image to be recognized, and performing character recognition on the image obtained by the first screenshot to obtain text information in the image obtained by the first screenshot; performing screenshot according to a preset time interval aiming at the condition of non-primary screenshot to obtain a currently displayed image; judging whether the currently displayed image is consistent with the image obtained by the last screenshot; if not, taking the currently displayed image as the image to be identified, and performing character identification on the currently displayed image to obtain text information in the currently displayed image; if so, not triggering the recognition, and keeping the text information in the image obtained by the last screenshot.

Specifically, an OCR module inside the electronic device may recognize an image obtained by capturing a currently displayed page screenshot as text information.

In the embodiment of the application, the screenshot is performed on the page displayed by the target electronic equipment according to the preset time interval and is stored, the stored page images are sequentially compared according to the time sequence, and when the current image is detected to be inconsistent with the last image, character recognition is triggered, so that the real-time updating of the text information in the image is ensured, and the accuracy and timeliness of the text information updating are improved.

Further, considering that there may be regular jitter and irregular jitter in the jitter type of the target electronic device, wherein to increase the determination speed of the text jitter parameter information, different determination methods may be adopted for different jitter types, that is, a determination process of the text jitter parameter information is associated with the jitter type of the device, specifically, as shown in fig. 3a, the determining, in S103, the text jitter parameter information of the text information based on the device jitter parameter information specifically includes:

s1031, determining the equipment shaking type of the target electronic equipment based on the equipment shaking parameter information; the jitter type may be classified as regular jitter or irregular jitter.

S1032 determines text jitter parameter information of the text information based on the device jitter type.

Specifically, when the jitter type of the device is regular jitter, the S1032 determines the text jitter parameter information of the text information based on the device jitter type, and specifically includes:

determining text jitter displacement information, text jitter speed information and text jitter direction information of text information based on equipment jitter amplitude information, equipment jitter frequency information and equipment jitter direction information in equipment jitter parameter information;

and step two, determining the combination of the text dithering displacement information, the text dithering speed information and the text dithering direction information as the text dithering parameter information of the text information.

Specifically, the step one, determining text jitter displacement information, text jitter speed information, and text jitter direction information of the text information based on the device jitter amplitude information, the device jitter frequency information, and the device jitter direction information in the device jitter parameter information, specifically includes:

determining text jitter displacement information of text information according to equipment jitter amplitude information and equipment jitter frequency information in equipment jitter parameter information;

specifically, text jitter displacement information of the text information is determined according to the equipment jitter amplitude information, the equipment jitter frequency information and a first calculation formula; wherein the first calculation formula is S ═ -Acos ((2 pi f) t), a represents the device shake amplitude information, f represents the device shake frequency information, t represents the instantaneous time information, and S represents the text shake displacement information; specifically, the regular jitter is a simple harmonic motion, and the real-time jitter displacement of the text can be calculated by using the first calculation formula after the regular jitter is jittered at a fixed frequency within a period of time; wherein, the negative sign in the first calculation formula indicates that the text shaking displacement and the equipment shaking displacement are opposite in direction.

Determining text jitter speed information of the text information according to equipment jitter amplitude information, equipment jitter frequency information and a second calculation formula in the equipment jitter parameter information;

specifically, text jitter speed information of the text information is determined according to the equipment jitter amplitude information, the equipment jitter frequency information and a second calculation formula; wherein the second calculation formula is V ═ 2 pi f) Asin ((2 pi f) t), a represents device jitter amplitude information, f represents device jitter frequency information, t represents instantaneous time information, and V represents text jitter speed information; the second calculation formula is derived from the first calculation formula, and the real-time jitter speed of the text can be calculated.

Determining the opposite direction of the equipment shaking direction information as the text shaking direction information of the text information;

further, in step S104, based on the text dithering parameter information, adjusting a display parameter of the text information, and displaying the text information based on the display parameter, specifically includes:

determining text direction parameters based on the text dithering direction by taking the text dithering displacement as the moving displacement based on the text dithering displacement information and the text dithering direction information, and adjusting the text displacement parameters of the text information according to the size of the text dithering displacement; determining a text direction parameter based on the text dithering speed and the text dithering direction information, taking the text dithering speed as the moving speed, and adjusting the text speed parameter of the text information according to the text dithering speed; the text dithering displacement and speed are the same as the equipment dithering displacement and speed, the directions are opposite, and the text information is displayed based on the text displacement parameter, the text speed parameter and the text direction parameter.

Specifically, when the jitter type of the device is irregular jitter, the S1032 determines the text jitter parameter information of the text information based on the device jitter type, and specifically includes:

determining text jitter displacement information of the text information according to equipment jitter displacement information in the equipment jitter parameter information;

determining text jitter speed information of the text information according to equipment jitter speed information in the equipment jitter parameter information;

and step four, determining the combination of the text dithering displacement information, the text dithering speed information and the text dithering direction information as the text dithering parameter information of the text information.

Specifically, fig. 3b is a graph of displacement change with time in the anti-shake method provided in the embodiment of the present application, and as shown in fig. 3b, the device shake displacement and the text shake displacement have the same magnitude and opposite directions; fig. 3c is a graph of speed variation with time in the anti-shake method according to the embodiment of the present application, and the device shake speed and the text shake speed are the same in magnitude and opposite in direction as shown in fig. 3 c.

In the embodiment of the application, the text dithering parameters can be determined according to the dithering type of the equipment, wherein the text dithering parameters comprise text dithering displacement information, text dithering speed information and text dithering direction information; when the jitter type of the equipment is regular jitter, the jitter frequency of the equipment is fixed frequency within a period of time, so that the jitter parameter of the text can be calculated by using a simple harmonic motion formula; when the jitter type of the equipment is irregular jitter, the jitter parameters of the text jitter can not be calculated according to a calculation formula due to the real-time change of the equipment jitter frequency, so that the jitter parameters of the text jitter can be determined by detecting the displacement and the speed of the equipment in real time; specifically, the text shaking displacement and the equipment shaking displacement are equal in size and opposite in direction; the text shaking speed is equal to the equipment shaking speed in magnitude and opposite in direction; the display parameters of the text information are adjusted in a reverse shaking mode between the text shaking mode and the equipment shaking mode, so that the equipment shaking caused by the environmental shaking mode is compensated by adjusting the display parameters of the text information, the problem that visual fatigue and adverse effects on eyes are caused by the equipment shaking mode when a user reads the electronic equipment is solved, and the use experience of the user when the electronic equipment is in a shaking state is improved.

Furthermore, in order to improve reading experience of a user, the line spacing and the font size of the text information can be properly adjusted while the text information is subjected to jitter processing, and the line spacing and the font size of the text information can be determined according to the equipment jitter frequency, wherein the line spacing and the equipment jitter frequency of the text information are in direct proportion, and the font size and the equipment jitter frequency of the text information are in direct proportion.

Specifically, as shown in fig. 4, the S1031 determines the device shaking type of the target electronic device based on the device shaking parameter information, and specifically includes:

s10311, judging whether the jitter frequency in the equipment jitter parameter information in the preset time period is a fixed frequency or not;

if the judgment result is yes, executing S10312, and determining that the equipment shaking type of the target electronic equipment is regular shaking;

if the judgment result is no, S10313 is executed to determine that the device shaking type of the target electronic device is irregular shaking.

Specifically, as shown in fig. 5, the S101 determines whether the target electronic device is in a shaking state based on the device shaking parameter information of the target electronic device, and specifically includes:

s1011, judging whether the variation amplitude of the shaking acceleration in the equipment shaking parameter information is larger than a preset acceleration variation threshold value or not;

if the judgment result is yes, the target electronic equipment is determined to be in the shaking state, and S102 to S104 are executed. Specifically, whether the target electronic device is in the shaking state or not is judged by setting an acceleration sensor to detect whether the acceleration change amplitude is larger than a preset acceleration change threshold, and the real-time frequency and the real-time displacement of the device can be detected by a frequency sensor and a displacement sensor inside the electronic device, and whether the target electronic device is in the shaking state or not is judged by the frequency threshold and the displacement threshold.

Further, considering that there may be a case that the set theme of the electronic device includes a dithering font due to user preference, in this case, in order to improve the efficiency of the dithering process of the text information, when determining the text dithering parameter information, the theme dithering parameter information and the device dithering parameter information may be considered together, and based on this, before determining the text dithering parameter information of the text information based on the device dithering parameter information in S103, if it is detected that the personalized font dithering theme has been set by the target electronic device, the method further includes:

determining theme jitter parameter information corresponding to a screen display page based on the personalized font jitter theme of the target electronic equipment;

correspondingly, the step S103 of determining text jitter parameter information of the text information based on the device jitter parameter information specifically includes:

and determining text jitter parameter information of the text information based on the equipment jitter parameter information and the subject jitter parameter information.

Specifically, when the device shaking direction is opposite to the subject shaking direction, the text shaking displacement is the sum of the device shaking displacement and the subject shaking displacement, and the text shaking speed is the sum of the device shaking speed and the subject shaking speed; wherein the text shaking direction is the same as the subject shaking direction; when the equipment shaking direction is the same as the theme shaking direction, the text shaking displacement is the absolute value of the difference between the equipment shaking displacement and the theme shaking displacement, and the text shaking speed is the absolute value of the difference between the equipment shaking speed and the theme shaking speed; and if the equipment shaking displacement is smaller than the theme shaking displacement, the text shaking direction is the same as the equipment shaking direction.

In the embodiment of the application, the situation that the theme of the font has the jitter effect is considered, and in order to keep the jitter effect of the font, when the text jitter parameter information of the text information is determined, the influence of the theme jitter parameter information is also considered in addition to the equipment jitter parameter information, so that the compensation effect is more accurate.

Further, considering that although the content of the page currently displayed on the device screen is text information, there may be a situation that the user does not view the device screen, at this time, the text may not be subjected to the dithering process, and in order to improve the accuracy of the text dithering process and reduce the amount of processing of the device information, therefore, before converting the image into the text form, the reading state of the target user may be identified based on the page image information, and only when the target user is currently in the text reading state, the subsequent text dithering process is triggered to be executed, as shown in fig. 6, S1022 performs the text recognition on the page image information by using a preset text recognition technology, so as to obtain the text information in the page image information, which specifically includes:

s10221, determining whether a target user using the target electronic device is in a text reading state based on the page image information;

if the determination result is yes, S1022 is executed, and the text information in the page image information is obtained by performing character recognition on the page image information by using a preset character recognition technology.

Specifically, the S10221, based on the page image information, determines whether the target user using the target electronic device is in a text reading state, and specifically includes:

carrying out image recognition processing on the page image information by using a pre-trained image recognition model to determine a reading state recognition result of a target user; the image recognition model is obtained by utilizing a machine learning method and training based on a model training sample, wherein the model training sample comprises: an application page image of a text reading application and an application page image of a non-text reading application;

and judging whether a target user using the target electronic equipment is in a text reading state or not based on the text reading state identification result.

Specifically, the image recognition model is trained by taking the application page image of the text reading application as positive sample data and taking the application page image of the non-text reading application as negative sample data; the application page images of the text reading application include but are not limited to page images of a news client, page images of a client and page images of a novel reading end; application page images for non-text reading type applications include, but are not limited to, movie playing page images, MP3 playing page images; training the model by using the sample data to obtain an image recognition model; then, deploying the image recognition model into target equipment, inputting page image information to be recognized into the image recognition model, recognizing whether a target user is in a text reading state by using the image recognition model, wherein an output result of the image recognition model is a text reading state recognition result;

the text reading state recognition result may be a value 1 or 0, where 1 represents that the target user is in a text reading state, and 0 represents that the target user is not in the text reading state, or a probability value or a score for representing that the target user is in the text reading state, for example, if the probability value or the score is greater than a preset threshold, it is determined that the target user is in the text reading state.

Further, considering that although the content of the page currently displayed on the device screen is text information, there may be a situation that the user does not view the device screen, at this time, the text may not be subjected to the dithering process, so as to improve the accuracy of the reading state identification result, further improve the accuracy of the text dithering process, and reduce the device information processing amount, in the image identification process, the reading page identification is included, and the face image identification is included, that is, when the reading state of the target user is identified based on the page image information, the face image information of the target user is considered; the method comprises the following steps of respectively identifying page image information and a user face image by using two image identification models, identifying the page image information and the user face image by using one image identification model, and identifying the page image information and the user face image by using one image identification model, wherein the image identification model can be used as the image identification model based on a multi-task learning neural network model, the image identification model is obtained by training two tasks of reading page identification and face image identification in advance, and then the image identification model is used for identifying the user reading page image and the user face image together to obtain a corresponding reading state identification result, and based on the result, the model training sample further comprises: a first face sample image for characterizing a user viewing a device screen and a second face sample image for characterizing a user not viewing the device screen; namely, when an image recognition mode is trained, not only an application page image but also a face sample image need to be introduced simultaneously;

correspondingly, the image recognition processing is performed on the page image information by using the pre-trained image recognition model to determine the reading state recognition result of the target user, and the method specifically includes:

calling a camera device in the target electronic equipment to acquire face image information of a target user;

and carrying out image recognition processing on the page image information and the face image information by using a pre-trained image recognition model, and determining a reading state recognition result of the target user.

Specifically, when an image recognition model is trained, the image recognition model is trained by using not only an application page image of the text reading application as positive sample data and an application page image of the non-text reading application as negative sample data, but also a first face sample image for representing a user viewing device screen as positive sample data and a second face sample image for representing a user not viewing the device screen as negative sample data; the eyeball deviation degree and/or the face deviation degree of the user in the first human face sample image can represent that an included angle between the sight line direction of the user and a screen of the target electronic equipment is located in a preset angle interval, for example, the image comprises a front face image of the user and the eyeball is located in the middle of the white of the eye; the eyeball deviation degree and/or the face deviation degree of the user in the second face sample image can represent that the included angle between the sight line direction of the user and the screen of the target electronic equipment is not within a preset angle interval; then, training the model by using the sample data to obtain an image recognition model; then, the image recognition model is deployed into target equipment, page image information and face image information to be recognized are input into the image recognition model, whether a target user is in a text reading state or not is recognized by the image recognition model, and an output result of the image recognition model is a reading state recognition result.

In the embodiment of the application, whether the current page of the user is in a text reading state is judged by training the image recognition model, and the image recognition model can also be used for judging whether the user is browsing the current page when the current page of the user is in the text reading state; if the current page of the user is in a text reading state but the user does not browse the screen, the anti-shake function is not started; only when the current page of the user is in a text reading state and the user is browsing the screen, starting the anti-shake function; the image recognition model is obtained through common training based on the two tasks of page recognition and face image recognition in advance, so that the recognition of the reading state is more accurate, and the anti-shake precision is improved.

In addition, an image recognition model is built in advance based on a multi-task learning framework, model parameters corresponding to two associated detection tasks are subjected to iterative training at the same time in the model training process, and because a loss function corresponding to the image recognition model is jointly determined by a loss function corresponding to a text reading page recognition task and a loss function corresponding to a face image recognition task, the two associated detection tasks are mutually supplemented by sharing characteristic information in the model training process, and the prediction effect of each detection task in the trained model is improved; and the pre-trained image recognition model is used for simultaneously recognizing the text reading page and the face image, so that the memory occupation is reduced, the processing speed is increased, the recognition efficiency of the text reading state of the user is improved, and the text information dithering processing efficiency is improved.

Further, in the process of identifying whether the target user is in the text reading state, a pre-trained image identification model may be used, based on the page image information, to identify whether the current foreground running application is a text reading application, and directly extract the face image information, to identify an included angle between the sight direction of the target user and the screen of the target electronic device, and then determine whether the target user is in the state of watching the screen of the device based on the included angle, and further determine whether the target user is in the text reading state, specifically, the determining whether the target user using the target electronic device is in the text reading state based on the reading state identification result specifically includes:

determining whether an application program corresponding to a screen display page of the target electronic equipment is a text reading application or not based on the reading state identification result;

if the judgment result is yes, calling a camera device in the target electronic equipment to acquire the face image information of the target user;

judging whether an included angle between the sight line direction of the target user and a screen of the target electronic equipment is within a preset angle interval or not based on the face image information;

and if so, determining that the target user is in a text reading state.

The anti-shake method in the embodiment of the application comprises the steps of firstly judging whether a target electronic device is in a shake state or not based on device shake parameter information of the target electronic device, and automatically acquiring text information displayed on a screen of the target electronic device under the condition that the target electronic device is determined to be in the shake state; determining text jitter parameter information of the text information based on the equipment jitter parameter information; the text jitter parameter information and the equipment jitter parameter information have a reverse jitter relation; the display parameters of the text information are adjusted based on the text jitter parameter information, the text information is displayed based on the display parameters, namely the display parameters of the text information are adjusted in a reverse jitter mode between the text jitter and the equipment jitter, so that the equipment jitter caused by the environmental jitter is compensated by adjusting the display parameters of the text information, the problems of visual fatigue and adverse effects on eyes caused by the equipment jitter when a user reads the text information are solved, and the use experience of the user when the electronic equipment is in a jitter state is improved.

It should be noted that, in the anti-shake method provided in the embodiment of the present application, the execution main body may be an anti-shake device, or a control module in the anti-shake device for executing the anti-shake method. The embodiment of the present application takes an anti-shake method executed by an anti-shake apparatus as an example, and the anti-shake apparatus provided by the embodiment of the present application is described.

On the basis of the same technical concept, an anti-shake apparatus is further provided in the embodiment of the present application corresponding to the anti-shake method provided in the foregoing embodiment, and fig. 7 is a schematic diagram illustrating a module composition of the anti-shake apparatus provided in the embodiment of the present application, where the anti-shake apparatus is configured to perform the anti-shake method described in fig. 1 to 6, and as shown in fig. 7, the anti-shake apparatus includes:

the jitter state identification module 202 is configured to determine whether a target electronic device is in a jitter state based on device jitter parameter information of the target electronic device;

the text information obtaining module 204 is configured to, if the determination result is yes, obtain text information displayed on a screen of the target electronic device;

a text jitter parameter determining module 206, configured to determine text jitter parameter information of the text information based on the device jitter parameter information; wherein the text jitter parameter information and the device jitter parameter information have a reverse jitter relationship;

a text information adjusting module 208, configured to adjust a display parameter of the text information based on the text jitter parameter information, and display the text information based on the display parameter.

Optionally, the text information obtaining module 204 is specifically configured to:

performing screenshot processing on the current display page of the target electronic equipment to obtain the image information of the current display page;

and performing character recognition on the page image information by using a preset character recognition technology to obtain text information in the page image information.

Optionally, the text jitter parameter determining module 206 is specifically configured to:

determining a device jitter type of the target electronic device based on the device jitter parameter information;

and determining text jitter parameter information of the text information based on the equipment jitter type.

Optionally, the text jitter parameter determining module 206 is further specifically configured to:

if the equipment jitter type is regular jitter, determining text jitter displacement information, text jitter speed information and text jitter direction information of the text information based on equipment jitter amplitude information, equipment jitter frequency information and equipment jitter direction information in the equipment jitter parameter information;

and determining the combination of the text dithering displacement information, the text dithering speed information and the text dithering direction information as the text dithering parameter information of the text information.

determining text jitter displacement information of the text information according to equipment jitter amplitude information, equipment jitter frequency information and a first calculation formula in the equipment jitter parameter information;

determining an opposite direction of the device shaking direction information as text shaking direction information of the text information.

if the equipment jitter type is irregular jitter, determining text jitter displacement information of the text information according to equipment jitter displacement information in the equipment jitter parameter information;

The anti-shake device in the embodiment of the application judges whether the target electronic equipment is in a shake state or not based on equipment shake parameter information of the target electronic equipment, and automatically acquires text information displayed on a screen of the target electronic equipment aiming at the condition that the target electronic equipment is determined to be in the shake state; determining text jitter parameter information of the text information based on the equipment jitter parameter information; the text jitter parameter information and the equipment jitter parameter information have a reverse jitter relation; the display parameters of the text information are adjusted based on the text jitter parameter information, the text information is displayed based on the display parameters, namely the display parameters of the text information are adjusted in a reverse jitter mode between the text jitter and the equipment jitter, so that the equipment jitter caused by the environmental jitter is compensated by adjusting the display parameters of the text information, the problems of visual fatigue and adverse effects on eyes caused by the equipment jitter when a user reads the text information are solved, and the use experience of the user when the electronic equipment is in a jitter state is improved.

The anti-shake apparatus in the embodiment of the present application may be an apparatus, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.

The anti-shake apparatus in the embodiment of the present application may be an apparatus having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.

The anti-shake device provided in the embodiment of the present application can implement each process implemented by the anti-shake method embodiments of fig. 1 to 6, and is not described here again to avoid repetition.

Optionally, as shown in fig. 8, an electronic device is further provided in the embodiment of the present application, and includes a processor 310, a memory 309, and a program or an instruction stored in the memory 309 and capable of being executed on the processor 310, where the program or the instruction is executed by the processor 310 to implement each process of the foregoing anti-shake method embodiment, and can achieve the same technical effect, and no further description is provided here to avoid repetition.

It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.

Fig. 8 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.

The electronic devices include, but are not limited to: radio frequency unit 301, network module 302, audio output unit 303, input unit 304, sensor 305, display unit 306, user input unit 307, interface unit 308, memory 309, processor 310, and power supply 311.

Those skilled in the art will appreciate that the electronic device may further include a power supply 311 (such as a battery) for supplying power to various components, and the power supply 311 may be logically connected to the processor 310 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system. Drawing (A)8The electronic device structures shown in the figures do not constitute limitations of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is not repeated here.

The processor 310 is configured to determine whether a target electronic device is in a shaking state based on device shaking parameter information of the target electronic device;

and carrying out dithering processing on the text information based on the text dithering parameter information so as to display the dithered target text information.

In the embodiment of the application, the display parameters of the text information are adjusted in a reverse shaking mode between the text shaking mode and the equipment shaking mode, so that the equipment shaking caused by the environmental shaking mode is compensated by adjusting the display parameters of the text information, the problems of visual fatigue and adverse effects on eyes of a user caused by the equipment shaking mode in a reading state are solved, and the use experience of the user in a shaking state of the electronic equipment is improved.

The electronic equipment in the embodiment of the application judges whether the target electronic equipment is in a shaking state or not based on equipment shaking parameter information of the target electronic equipment, and automatically acquires text information displayed on a screen of the target electronic equipment aiming at the condition that the target electronic equipment is determined to be in the shaking state; determining text jitter parameter information of the text information based on the equipment jitter parameter information; the text jitter parameter information and the equipment jitter parameter information have a reverse jitter relation; the display parameters of the text information are adjusted based on the text jitter parameter information, the text information is displayed based on the display parameters, namely the display parameters of the text information are adjusted in a reverse jitter mode between the text jitter and the equipment jitter, so that the equipment jitter caused by the environmental jitter is compensated by adjusting the display parameters of the text information, the problems of visual fatigue and adverse effects on eyes caused by the equipment jitter when a user reads the text information are solved, and the use experience of the user when the electronic equipment is in a jitter state is improved.

It should be understood that, in the embodiment of the present application, the radio frequency unit 301 may be used for receiving and sending signals during a message sending and receiving process or a call process, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 310; in addition, the uplink data is transmitted to the base station. In general, radio frequency unit 301 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 301 can also communicate with a network and other devices through a wireless communication system.

The electronic device provides wireless broadband internet access to the user via the network module 302, such as assisting the user in sending and receiving e-mails, browsing web pages, and accessing streaming media.

The audio output unit 303 may convert audio data received by the radio frequency unit 301 or the network module 302 or stored in the memory 309 into an audio signal and output as sound. Also, the audio output unit 303 may also provide audio output related to a specific function performed by the electronic device (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 303 includes a speaker, a buzzer, a receiver, and the like.

The input Unit 304 may include a Graphics Processing Unit (GPU) 3041 and a microphone 3042, and the Graphics processor 3041 processes image data of a still picture or video obtained by an image capturing apparatus (e.g., a camera) in a video capturing mode or an image capturing mode. The display unit 306 may include a display panel 3061, and the display panel 3061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 307 includes a touch panel 3071 and other input devices 3072. The touch panel 3071 is also referred to as a touch screen. The touch panel 3071 may include two parts of a touch detection device and a touch controller. Other input devices 3072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 309 may be used to store software programs as well as various data including, but not limited to, application programs and an operating system. The processor 310 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 310.

The electronic device also includes at least one sensor 305, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that adjusts the brightness of the display panel 3061 according to the brightness of ambient light, and a proximity sensor that turns off the display panel 3061 and/or the backlight when the electronic device is moved to the ear. As one type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of an electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 305 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.

The display unit 306 is used to display information input by the user or information provided to the user. The Display unit 306 may include a Display panel 3061, and the Display panel 3061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 307 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device. Specifically, the user input unit 307 includes a touch panel 3071 and other input devices 3072. The touch panel 3071, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 3071 (e.g., operations by a user on or near the touch panel 3071 using a finger, a stylus, or any suitable object or attachment). The touch panel 3071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 310, and receives and executes commands sent by the processor 310. In addition, the touch panel 3071 may be implemented using various types, such as resistive, capacitive, infrared, and surface acoustic wave. The user input unit 307 may include other input devices 3072 in addition to the touch panel 3071. Specifically, the other input devices 3072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described herein.

Further, the touch panel 3071 may be overlaid on the display panel 3061, and when the touch panel 3071 detects a touch operation on or near the touch panel, the touch operation is transmitted to the processor 310 to determine the type of the touch event, and then the processor 310 provides a corresponding visual output on the display panel 3061 according to the type of the touch event. Although in fig. 8, the touch panel 3071 and the display panel 3061 are implemented as two separate components to implement the input and output functions of the electronic device, in some embodiments, the touch panel 3071 and the display panel 3061 may be integrated to implement the input and output functions of the electronic device, which is not limited herein.

The interface unit 308 is an interface for connecting an external device to the electronic apparatus. For example, the external device may include a wired or wireless headset port, an external power supply 311 (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 308 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the electronic equipment or may be used to transmit data between the electronic equipment and the external device.

The memory 309 may be used to store software programs as well as various data. The memory 309 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 309 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 310 is a control center of the electronic device, connects various parts of the whole electronic device by using various interfaces and lines, performs various functions of the electronic device and processes data by operating or executing software programs and/or modules stored in the memory 309 and calling data stored in the memory 309, thereby performing overall monitoring of the electronic device. Processor 310 may include one or more processing units; preferably, the processor 310 may integrate the application processor 310 and the modem processor 310, wherein the application processor 310 mainly processes an operating system, a user interface, an application program, and the like, and the modem processor 310 mainly processes wireless communication. It is to be understood that the modem processor 310 may not be integrated into the processor 310.

The electronic device may further include a power supply 311 (such as a battery) for supplying power to each component, and preferably, the power supply 311 may be logically connected to the processor 310 through a power supply 311 management system, so that functions of managing charging, discharging, and power consumption are implemented through the power supply 311 management system.

In addition, the electronic device includes some functional modules that are not shown, and are not described in detail herein.

Preferably, an electronic device is further provided in this embodiment of the present application, and includes a processor 310, a memory 309, and a program or an instruction stored in the memory 309 and capable of being executed on the processor 310, where the program or the instruction is executed by the processor 310 to implement each process of the foregoing anti-shake method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not described here again.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by the processor 310, the program or the instruction implements the processes of the foregoing anti-shake method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.

The processor 310 is the processor 310 in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present application.

While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. An anti-shaking method, characterized in that the method comprises:

2. The method of claim 1, wherein the obtaining of the text information presented on the screen of the target electronic device comprises:

3. The method according to claim 1, wherein determining text jitter parameter information of the text information based on the device jitter parameter information comprises:

4. The method according to claim 3, wherein determining text jitter parameter information of the text information based on the device jitter type comprises:

5. The method of claim 4, wherein determining text shaking displacement information, text shaking speed information, and text shaking direction information of the text information based on the device shaking amplitude information, the device shaking frequency information, and the device shaking direction information in the device shaking parameter information comprises:

determining text jitter displacement information of the text information according to equipment jitter amplitude information and equipment jitter frequency information in the equipment jitter parameter information;

determining text jitter speed information of the text information according to equipment jitter amplitude information and equipment jitter frequency information in the equipment jitter parameter information;

6. The method according to claim 3, wherein determining text jitter parameter information of the text information based on the device jitter type comprises:

7. An anti-shake apparatus, the apparatus comprising:

8. The apparatus according to claim 7, wherein the text information obtaining module is specifically configured to:

9. The apparatus of claim 7, wherein the text jitter parameter determining module is specifically configured to:

10. The apparatus of claim 9, wherein the text jitter parameter determination module is further specifically configured to:

11. The apparatus of claim 10, wherein the text jitter parameter determination module is further specifically configured to:

12. The apparatus of claim 9, wherein the text jitter parameter determination module is further specifically configured to:

13. An electronic device, comprising: a processor, a memory and a program or instructions stored on the memory and executable on the processor, which when executed by the processor, implement the steps of the anti-shake method according to any one of claims 1 to 6.

14. A readable storage medium, characterized in that the readable storage medium stores thereon a program or instructions which, when executed by a processor, implement the steps of the anti-shake method according to any one of claims 1 to 6.