CN111131598A

CN111131598A - Method and device for adjusting running state of electronic equipment and electronic equipment

Info

Publication number: CN111131598A
Application number: CN201811290464.5A
Authority: CN
Inventors: 梁自立
Original assignee: Alibaba Group Holding Ltd
Current assignee: Alibaba Group Holding Ltd
Priority date: 2018-10-31
Filing date: 2018-10-31
Publication date: 2020-05-08

Abstract

The invention discloses a method and a device for adjusting the running state of electronic equipment and the electronic equipment, wherein the method comprises the following steps: responding to the operation of a user for setting the client application through the running of the electronic equipment, and starting a camera of the electronic equipment to acquire a user image of the user; acquiring a use parameter representing the use state of the electronic equipment used by the user according to the user image; and adjusting the operation parameters reflecting the operation state of the set client application according to the use parameters. The operation state of the application of the client side can be set in the operation of the electronic equipment in a self-adaptive manner according to the use state of the user, so that the operation effect according with the use state of the user is achieved. The user experience can be improved.

Description

Method and device for adjusting running state of electronic equipment and electronic equipment

Technical Field

The present invention relates to the field of electronic device operation technologies, and in particular, to a method and an apparatus for adjusting an operating state of an electronic device, and an electronic device.

Background

With the rapid development of computer technology and electronic device manufacturing technology, people have become accustomed to running various client applications through electronic devices.

However, in the prior art, the operation state of the electronic device running the client application is usually adjusted manually by the user. Specifically, the operating parameters reflecting the operating state may be adjusted. The operating parameters may include, for example, the size of the video window, the playback volume, etc. However, when the user runs the client application using the electronic device, the running state cannot be automatically adjusted, which may make the user experience poor.

Disclosure of Invention

The invention aims to provide a new technical scheme for adaptively adjusting the running state of electronic equipment.

According to a first aspect of the present invention, there is provided a method for adjusting an operation state of an electronic device, comprising:

responding to the operation of a user for running and setting a client application through electronic equipment, and starting a camera of the electronic equipment to acquire a user image of the user;

acquiring a use parameter representing the use state of the electronic equipment used by the user according to the user image;

and adjusting the operating parameters of the electronic equipment for operating the set client application according to the use parameters.

Optionally, the usage parameters at least include any one or more of the following: the current distance between the user and the electronic equipment, the movement displacement of the user in a preset period, and the use angle of the user using the electronic equipment.

Optionally, the usage parameter includes a current distance between the user and the electronic device;

the step of obtaining the use parameter representing the use state of the electronic equipment used by the user according to the user image comprises the following steps:

determining a current interpupillary distance of the user in the user image;

determining a current distance between the user and the electronic device according to the current interpupillary distance;

alternatively, the first and second electrodes may be,

determining a current head size of the user in the user image;

determining a current distance between the user and the electronic device according to the current head size.

Optionally, the step of adjusting an operation parameter reflecting an operation state of the set client application executed by the electronic device according to the usage parameter includes:

determining the current value of the operating parameter according to the current distance;

and operating the set client application according to the current value of the operating parameter.

Optionally, the usage parameter includes a movement displacement of the user within a preset period;

acquiring a first frame of user image and a last frame of user image which are acquired in the period;

and determining the movement displacement of the user in the period according to the difference value of the interpupillary distance or the head size of the user in the last frame of user image and the first frame of user image.

determining the variation of the operation parameters according to the movement displacement of the user in a preset period;

adjusting the size of the operation parameter according to the variable quantity to obtain an adjusted operation parameter;

and operating the set client application according to the adjusted current value of the operating parameter.

Optionally, the usage parameter includes a usage angle of the user using the electronic device;

and acquiring an included angle between a straight line where the two eyes of the user are located in the user image and a preset axis, and taking the included angle as the use angle.

determining the running direction of the set client application according to the using angle;

and running the set client application according to the running direction.

According to a second aspect of the present invention, there is provided an apparatus for adjusting an operating status of an electronic device, comprising:

the user image acquisition module is used for responding to the operation of a user for setting the client application through the running of the electronic equipment and starting a camera of the electronic equipment to acquire a user image of the user;

the use parameter acquisition module is used for acquiring use parameters representing the use state of the electronic equipment used by the user according to the user image;

and the operation parameter adjusting module is used for adjusting the operation parameters reflecting the operation state of the set client application operated by the electronic equipment according to the use parameters.

the usage parameter obtaining module is further configured to:

determining a current interpupillary distance of the user in the user image;

alternatively, the first and second electrodes may be,

determining a current head size of the user in the user image;

Optionally, the usage parameter adjusting module is further configured to:

the usage parameter obtaining module is further configured to:

Optionally, the operation parameter adjusting module is further configured to:

the usage parameter obtaining module is further configured to:

Optionally, the operation parameter adjusting module is further configured to:

and running the set client application according to the running direction.

According to a third aspect of the present invention, there is provided an electronic apparatus comprising:

the apparatus according to the second aspect of the invention; alternatively, the first and second electrodes may be,

a memory for storing executable instructions for controlling the processor to perform the method according to the first aspect of the invention and a processor.

According to the method and the device for adjusting the running state of the electronic equipment and the electronic equipment, when the electronic equipment runs and sets the client application, the user image is collected, the use parameters representing the use state of the electronic equipment used by the user are obtained according to the user image, and the running parameters reflecting the running state of the client application set by the electronic equipment running are adjusted according to the use parameters. Therefore, the operation state of the application of the client side can be adaptively adjusted and set according to the use state of the user, so that the operation effect according with the use state of the user is achieved. The user experience can be improved.

Other features of the present invention and advantages thereof will become apparent from the following detailed description of exemplary embodiments thereof, which proceeds with reference to the accompanying drawings.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description, serve to explain the principles of the invention.

Fig. 1 is a block diagram showing an example of a hardware configuration of an electronic apparatus that can be used to implement an embodiment of the present invention.

Fig. 2 shows a flowchart of a method for adjusting an operation state of an electronic device according to an embodiment of the invention.

FIG. 3 shows a flow chart of the steps of obtaining usage parameters of an embodiment of the present invention.

FIG. 4 shows a flowchart of the steps of adjusting operating parameters of one embodiment of the present invention.

FIG. 5 shows a flowchart of the steps of adjusting operating parameters of another embodiment of the present invention.

Fig. 6 is a block diagram of an apparatus for adjusting an operation state of an electronic device according to an embodiment of the present invention.

FIG. 7 shows a block diagram of an electronic device of an embodiment of the invention.

Detailed Description

Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that: the relative arrangement of the components and steps, the numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present invention unless specifically stated otherwise.

The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses.

Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.

In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.

It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.

< hardware configuration >

Fig. 1 is a block diagram showing a hardware configuration of an electronic apparatus 1000 that can implement an embodiment of the present invention.

The electronic device 1000 may be a laptop, desktop, cell phone, tablet, etc. As shown in fig. 1, the electronic device 1000 may include a processor 1100, a memory 1200, an interface device 1300, a communication device 1400, a display device 1500, an input device 1600, a speaker 1700, a microphone 1800, and the like. The processor 1100 may be a central processing unit CPU, a microprocessor MCU, or the like. The memory 1200 includes, for example, a ROM (read only memory), a RAM (random access memory), a nonvolatile memory such as a hard disk, and the like. The interface device 1300 includes, for example, a USB interface, a headphone interface, and the like. The communication device 1400 is capable of wired or wireless communication, for example, and may specifically include Wifi communication, bluetooth communication, 2G/3G/4G/5G communication, and the like. The display device 1500 is, for example, a liquid crystal display panel, a touch panel, or the like. The input device 1600 may include, for example, a touch screen, a keyboard, a somatosensory input, and the like. A user can input/output voice information through the speaker 1700 and the microphone 1800.

The electronic device shown in fig. 1 is merely illustrative and is in no way meant to limit the invention, its application, or uses. In an embodiment of the present invention, the memory 1200 of the electronic device 1000 is configured to store instructions for controlling the processor 1100 to operate so as to execute any method for adjusting an operating state of an electronic device according to an embodiment of the present invention. It will be appreciated by those skilled in the art that although a plurality of means are shown for the electronic device 1000 in fig. 1, the present invention may relate to only some of the means therein, e.g. the electronic device 1000 relates to only the processor 1100 and the storage means 1200. The skilled person can design the instructions according to the disclosed solution. How the instructions control the operation of the processor is well known in the art and will not be described in detail herein.

< method >

The general concept of the embodiment of the invention is to provide a new technical scheme for adjusting the running state of the electronic equipment, wherein when the electronic equipment runs and sets the client application, the user image is collected, the use parameter representing the use state of the electronic equipment used by the user is obtained according to the user image, and the running parameter reflecting the running state of the client application set by the electronic equipment running is adjusted according to the use parameter. Therefore, the operation state of the application of the client side can be adaptively adjusted and set according to the use state of the user, so that the operation effect according with the use state of the user is achieved. The user experience can be improved.

In the embodiment, a method for adjusting an operation state of an electronic device is provided. The electronic device may be, for example, any electronic product having a processor and a memory, for example, a mobile phone, a tablet computer, and the like. In one example, the electronic device may be the electronic device 1000 shown in FIG. 1.

In this embodiment, as shown in fig. 2, the method for adjusting the operating state of the electronic device includes: steps S2100-S2300.

In step S2100, in response to an operation of the user to run a set client application through the electronic device, a camera of the electronic device is started to capture a user image of the user.

The setting client application may be any one or more client applications installed in the electronic device that are set in advance. The client application may be, for example, a music playing application, a video playing application, a picture showing application, a news-type application, a literature reading application, an interaction-type application, and/or a game-type application.

The method includes the steps of responding to an operation of a user for running a set client application through electronic equipment, starting a camera of the electronic equipment to collect a user image of the user, specifically, when the user starts the set client application through the electronic equipment, so that the set client application starts to run, starting the camera to collect the user image.

Further, in the process of running and setting the client application by the electronic device, the camera may acquire the user image according to a preset acquisition frequency. The preset acquisition frequency may be preset according to an application scenario. The acquisition frequency may be, for example, 10 times/second, and then the camera may acquire 10 user images every 1 second.

The user image may specifically be an image acquired by the electronic device in the process of running the setting client application, or may also be an image including the user acquired by the setting client application in the process of running the setting client application.

In step S2200, a use parameter representing a use state of the electronic device used by the user is obtained according to the user image.

The user image for acquiring the usage parameter may be one frame or multiple frames. The usage parameters may be used to characterize a usage state of the electronic device by the user.

Further, the usage parameters may include, for example, any one or more of: the distance between the user and the electronic equipment, the movement displacement of the user in a preset period, the use angle of the user using the electronic equipment, and whether the user is using the electronic equipment.

Example 1

In this embodiment, the usage parameter may include a distance between the user and the electronic device. Then, in one example, the step of obtaining a usage parameter representing a usage state of the electronic device used by the user according to the user image may further include:

determining a current head size of a user in the user image; a current distance between the user and the electronic device is determined based on the current head size.

Specifically, at least one template of the head of the user may be stored in the electronic device in advance. The user's head may be determined from the user's image by means of template matching. The user's head may also be recognized from the user's image by face recognition techniques. The current head size of the user is then determined. The current head size has a size that is the user's head identified in the user's image.

The current head size may be a size of the user's head in the user image in a direction of a lateral axis of the electronic device, and/or a size in a direction of a longitudinal axis of the electronic device. The horizontal axis direction may be a direction parallel to a long side of the electronic device, and the vertical axis direction may be a direction perpendicular to the horizontal axis direction. For electronic devices having equal length and width, a direction parallel to any side of the electronic device may be taken as a horizontal axis direction, and a direction perpendicular to the horizontal axis direction may be taken as a vertical axis direction.

Further, the size of the user head in the user image in the transverse axis direction of the electronic device may also be: the number of pixels in the user image with the largest occupied head in the horizontal axis direction is the largest. The current head size may be a size of the user's head in the user image in a direction of a longitudinal axis of the electronic device, and specifically may be: and the number of pixel points which are occupied by the user head in the longitudinal axis direction in the user image is the largest. The current head size may also be the total number of pixel points occupied by the user head in the user image.

The first lookup table reflecting the correspondence between the head size and the distance between the user and the electronic apparatus may be stored in advance in the electronic apparatus. And determining the distance corresponding to the current head size as the current distance between the user and the electronic equipment according to the first lookup table.

It is also possible to store in advance in the electronic apparatus a second comparison table reflecting a correspondence between a distance between the user and the electronic apparatus and a head size range. And determining the distance corresponding to the range to which the current head size belongs as the current distance between the user and the electronic equipment according to the second comparison table.

The first formula for calculating the distance between the user and the electronic device according to the head size may be stored in the electronic device, and the current distance between the user and the electronic device may be obtained according to the current head size and the first formula. The first formula may be, for example, x-a 1 x1+ b1, where x is the distance between the user and the electronic device, x1 is the head size, and a1 and b1 may be fixed values that are empirically preset.

In another example, the step of obtaining the usage parameter representing the usage state of the electronic device used by the user according to the user image may further include:

determining a current interpupillary distance of the user in the user image; and determining the current distance between the user and the electronic equipment according to the current pupil distance.

Specifically, the positions of the pupils of both eyes of the user may be identified from the user image, and then the current interpupillary distance of the user may be determined according to the positions of the pupils of both eyes. For example, the current interpupillary distance may be a specific size, or may be the number of pixel points between the positions of the pupils of both eyes.

The electronic device may be configured to store a third lookup table in advance, the third lookup table reflecting a correspondence between a distance between the user and the electronic device and a pupil distance. And determining the distance corresponding to the current pupil distance as the current distance between the user and the electronic equipment according to the searched third comparison table.

The electronic device may be configured to store a fourth lookup table in advance, the fourth lookup table reflecting a correspondence between a distance between the user and the electronic device and a pupil distance range. And determining the distance corresponding to the range to which the current pupil distance belongs as the current distance between the user and the electronic equipment according to the fourth comparison table.

The electronic device may further store a second formula for calculating the distance between the user and the electronic device according to the pupil distance, and the current distance between the user and the electronic device may be obtained according to the current pupil distance and the second formula. The second formula may be, for example, x-a 2 x2+ b2, where x is the distance between the user and the electronic device, x2 is the interpupillary distance, and a2 and b2 may be fixed values that are set in advance empirically.

In one example, the method further comprises: and responding to the operation of the user for running the set client application through the electronic equipment, and starting an infrared distance sensor of the electronic equipment to detect the distance between the user and the electronic equipment.

And correcting the current distance between the user and the electronic equipment acquired through the user image according to the distance between the user and the electronic equipment detected by the infrared distance sensor.

Example 2

In this embodiment, the usage parameter may include a movement displacement of the user within a preset period. Then, the step of acquiring the usage parameter representing the usage state of the electronic device by the user according to the user image may further include steps S2210-S2220 shown in fig. 3:

step S2210, a first frame of user image and a last frame of user image collected in a preset period are obtained.

The period may be set in advance according to an application scenario. The period may be, for example, 1 s. Then, the first frame user image and the last frame user image may be determined from the user images acquired in the period in order of the acquisition time. The first frame of user image is the user image acquired first in the period, and the last frame of user image is the user image acquired last in the period.

Step S2220 determines the movement displacement of the user in the period according to the difference between the pupil distance of the user in the first frame of user image and the pupil distance of the user in the last frame of user image, or the difference between the head sizes.

In this embodiment, the movement displacement of the user in the period may specifically be a movement displacement of the user in a direction perpendicular to the display interface of the electronic device. The movement displacement may characterize whether the user's movement is in a direction closer to the electronic device or in a direction further away from the electronic device. For example, if the movement displacement is positive, it may indicate that the user moves in a direction close to the electronic device; in the case where the movement displacement is negative, it indicates that the user is moving away from the electronic device. The user can be indicated to move away from the electronic equipment in the case that the movement displacement is positive; in the case where the movement displacement is negative, it indicates that the user is moving in a direction close to the electronic apparatus.

In one example, the movement displacement of the user in the period can be determined according to the difference value of the interpupillary distances of the user in the first frame of image and the last frame of image.

Specifically, the interpupillary distance of the user in the first frame of user image and the interpupillary distance of the user in the last frame of user image may be determined, and the difference between the interpupillary distance of the user in the last frame of user image and the interpupillary distance of the user in the first frame of user image may be calculated as the difference of the interpupillary distances.

The electronic device may be configured to store a fifth lookup table in advance, in which a correspondence between a distance between the user and the electronic device and a difference between pupil distances is reflected. And determining a distance corresponding to the difference value of the interpupillary distances in a preset period according to the fifth comparison table, and taking the distance as the movement displacement of the user in the period.

The electronic device may be configured to store a sixth lookup table in advance, the sixth lookup table reflecting a correspondence between a distance between the user and the electronic device and a difference range of the interpupillary distance. And according to the sixth comparison table, determining the distance corresponding to the range to which the interpupillary distance in the preset period belongs, and taking the distance as the movement displacement of the user in the period.

The electronic device may further store a third formula for calculating the distance between the user and the electronic device according to the difference between the pupil distances, and the movement displacement of the user in the period may be obtained according to the current pupil distance and the third formula. The third formula may be, for example, y — c1 y1+ d1, where y is the movement displacement of the user within the period, y1 is the difference in interpupillary distance, and c1 and d1 may be fixed values that are set in advance empirically.

In another example, the movement displacement of the user in the period may be determined according to the difference between the head sizes of the user in the first frame of user image and the last frame of image.

Specifically, the head size of the user in the first frame of user image and the head size of the user in the last frame of user image may be determined, and the difference between the head size of the user in the last frame of user image and the head size of the user in the first frame of user image may be calculated as the difference of the head sizes.

The head size may be a size of the user's head in a direction of a lateral axis of the electronic device and/or a size in a direction of a longitudinal axis of the electronic device in the corresponding user image. The horizontal axis direction may be a direction parallel to a long side of the electronic device, and the vertical axis direction may be a direction perpendicular to the horizontal axis direction. For electronic devices having equal length and width, a direction parallel to any side of the electronic device may be taken as a horizontal axis direction, and a direction perpendicular to the horizontal axis direction may be taken as a vertical axis direction.

A seventh lookup table reflecting a correspondence between a distance between the user and the electronic apparatus and a difference in the head size may be stored in advance in the electronic apparatus. And according to the seventh comparison table, determining the distance corresponding to the difference value of the head sizes in the preset period as the movement displacement of the user in the period.

An eighth lookup table reflecting a correspondence between a distance between the user and the electronic apparatus and a difference range of the head size may be stored in the electronic apparatus in advance. And according to the eighth comparison table, determining the distance corresponding to the range to which the head size in the preset period belongs, and taking the distance as the movement displacement of the user in the period.

The electronic device may further store a fourth formula for calculating a distance between the user and the electronic device according to the difference between the head sizes, and the movement displacement of the user in the period may be obtained according to the current head size and the fourth formula. The fourth formula may be, for example, y — c2 y2+ d2, where y is the displacement of the user's movement during the cycle, y2 is the difference in head size, and c2 and d2 may be fixed values that are empirically preset.

Example 3

In this embodiment, the usage parameter may include a usage angle of the electronic device used by the user. Then, the step of acquiring a usage parameter representing a usage state of the electronic device by the user according to the user image may further include:

and acquiring an included angle between a straight line where the two eyes of the user are located in the user image and a preset axis as a use angle.

Specifically, the positions of the pupils of the two eyes of the user can be identified from the user image, and then the straight line where the two eyes are located can be determined according to the positions of the pupils of the two eyes.

The predetermined axis may be, for example, parallel to a horizontal axis or a vertical axis of the electronic device. The horizontal axis direction may be a direction parallel to a long side of the electronic device, and the vertical axis direction may be a direction perpendicular to the horizontal axis direction. For electronic devices having equal length and width, a direction parallel to any side of the electronic device may be taken as a horizontal axis direction, and a direction perpendicular to the horizontal axis direction may be taken as a vertical axis direction.

The using angle can be an acute included angle between a straight line where the two eyes are located and a preset axis.

Example 4

In this embodiment, the usage parameter may include whether the user is using the electronic device. Then, the step of acquiring a usage parameter representing a usage state of the electronic device by the user according to the user image may further include:

specifically, whether the user is included in the user image may be identified, and if not, it may be determined that the user does not use the electronic device; if so, the eyes of the user are identified to be closed or open. When the eye closing time length of the user is detected to exceed a preset time length threshold value, the electronic equipment can be determined not to be used by the user, otherwise, the electronic equipment can be determined to be used by the user.

Further, the condition that the eyes of the user in the user image are closed or open can be identified through template matching.

The method comprises the steps of determining that a user does not use the electronic equipment when detecting that the distance between the user and the electronic equipment is larger than a preset distance threshold, and further determining whether the user uses the electronic equipment through a user image when detecting that the distance between the user and the electronic equipment is smaller than or equal to the preset distance threshold.

Step S2300, adjusting an operation parameter reflecting an operation state of the client application set by the operation of the electronic device according to the usage parameter.

The operating state may include, for example, any one or more of: the playing volume, the size of a video window, the size of a picture, the size of a character font and the like. The operating parameter is a specific numerical value reflecting the corresponding operating state.

Further, the operating parameter may correspond to setting the client application. For example, the operation parameter may include setting a volume of audio played in the client application, setting a window size of video played in the client application, setting a size of a picture displayed in the client application, and setting a font size of text displayed in the client application.

For example, in the case that the operation parameter includes setting a volume of playing audio in the client application and a window size of playing video in the client application, step S2300 may be executed to adjust both the volume of playing audio in the client application and the window size of playing video in the client application.

The operation parameters of the electronic equipment operation setting client application are adjusted, so that the operation state of the setting client can be changed.

Specifically, in the case that the operation parameter includes a play volume, if the operation parameter changes, the volume when the client application is set to play audio also changes. In the case where the operating parameter includes the size of a video window, if the operating parameter changes, then the window size for playing the video in the client application is set to change. In the case where the operating parameter includes a picture size, if the operating parameter changes, the setting of the size of the picture displayed in the client application also changes. In the case where the operating parameter includes a font size of text, if the operating parameter changes, then setting the font size of the text displayed in the client application may also change accordingly.

For the above embodiment 1, the usage parameter is the current distance between the user and the electronic device. On this basis, the step of adjusting the operation parameter reflecting the operation state of the operation setting client application of the electronic device according to the usage parameter may include steps S2311-S2312 as shown in fig. 4:

step S2311, a current value of the operating parameter is determined according to a current distance between the user and the electronic device.

Specifically, a ninth lookup table reflecting a correspondence relationship between a distance between the user and the electronic device and a value of the operation parameter may be stored in advance in the electronic device. And determining the value of the operation parameter corresponding to the current distance between the user and the electronic equipment as the current value of the operation parameter according to the ninth comparison table.

A tenth lookup table reflecting a correspondence between a distance range between the user and the electronic device and the value of the operation parameter may be stored in advance in the electronic device. And determining the value of the operation parameter corresponding to the range to which the current distance between the user and the electronic equipment belongs as the current value of the operation parameter according to the searched tenth comparison table.

Step S2312, the set client application is run according to the current values of the running parameters.

The current values of the operating parameters may include: a current value of the playback volume, and/or a current value of the window size of the playback video, and/or a current value of the size of the display picture, and/or a current value of the font size of the display text.

And the operation setting client application is operated according to the current value of the operation parameter, so that the value of the operation parameter of the operation setting client application of the electronic equipment can be the current value.

For the above embodiment 2, the usage parameter is the movement displacement of the user within a preset period. On this basis, the step of adjusting the operation parameter reflecting the operation state of the client application set by the electronic device according to the usage parameter may include steps S2321-S2322 as shown in fig. 5:

step S2321, determining the variation of the operation parameter according to the movement displacement of the user in the preset period.

Specifically, an eleventh lookup table reflecting a correspondence between the movement displacement and the amount of change in the operation parameter may be stored in advance in the electronic device. And determining the variation of the operation parameter corresponding to the movement displacement of the user in the preset period according to the eleventh comparison table.

The twelfth lookup table may be stored in the electronic device in advance, and may reflect a correspondence between a range of the movement displacement and a variation of the operation parameter. And determining the variation of the operation parameter corresponding to the range of the movement displacement of the user in the preset period according to the twelfth lookup table.

The amount of change may be a specific value. The variation may be a positive or negative number, or 0. Then, when the variation is negative, the operating parameter may be made smaller; when the variation is a positive number, the operating parameter may be increased; when the variation is 0, the operation parameter may not need to be adjusted.

The variation may also be a scaling ratio, and then, when the variation is less than 1, the operating parameter may be reduced; when the variation is larger than 1, the operation parameter may be increased; when the variation is 1, the operation parameter may not need to be adjusted.

Step S2322, the size of the operation parameter is adjusted according to the variation, and the adjusted operation parameter is obtained.

In the case where the variation is a specific value, the adjusted operating parameter may be obtained by adding the variation to the operating parameter before adjustment.

In the case where the variation is a scaling ratio, the operation parameter after adjustment may be obtained by multiplying the variation by the operation parameter before adjustment.

Step S2323, the set client application is operated according to the adjusted current value of the operation parameter.

And the client application is set according to the adjusted operation parameters, so that the value of the operation parameters of the client application can be set to be the adjusted value by the electronic equipment.

For the above embodiment 3, the usage parameter is the angle of use of the electronic device by the user. On this basis, the step of adjusting the operation parameter reflecting the operation state of the client application set by the electronic device according to the use parameter may include:

step S2331, determine and set the running direction of the client application according to the use angle.

And in the case that the preset axis is a horizontal axis, if the use angle is smaller than a preset angle threshold value, determining that the running direction is a transverse direction. If the usage angle is greater than a preset angle threshold, the travel direction may be determined to be longitudinal. If the usage angle is equal to the preset angle threshold, it may be determined that the running direction is the running direction before performing step S2331.

In the case where the predetermined axis is the longitudinal axis, if the usage angle is less than the predetermined angle threshold, the running direction is determined to be the longitudinal direction. If the usage angle is greater than a preset angle threshold, the travel direction may be determined to be lateral. If the usage angle is equal to the preset angle threshold, it may be determined that the running direction is the running direction before performing step S2331.

The preset angle threshold may be an empirically set angle value or an angle range. For example, the angle threshold may be 45 ° or 40 ° -50 °.

Step S2332, the client application is set to run according to the running direction.

Specifically, the client application may be set to run horizontally when the running direction is horizontal; and if the running direction is vertical, the setting client application is longitudinally run.

For the above embodiment 4, the usage parameter is whether the user is using the electronic device. On this basis, the step of adjusting the operation parameter reflecting the operation state of the client application set by the electronic device according to the use parameter may include:

in the case where the user is using the electronic device, the operation parameters of the electronic device operation setting client application may be adjusted through the above embodiments 1 to 3.

When the user does not use the electronic device, the setting client application may stop running, or the setting client application may be controlled to pause or stop playing the video, and the screen of the electronic device may also be closed.

According to the embodiment of the invention, when the electronic equipment runs and sets the client application, the user image is collected, the use parameter representing the use state of the electronic equipment used by the user is obtained according to the user image, and the running parameter reflecting the running state of the client application run and set by the electronic equipment is adjusted according to the use parameter. Therefore, the operation state of the application of the client side can be adaptively adjusted and set according to the use state of the user, so that the operation effect according with the use state of the user is achieved. The user experience can be improved.

< apparatus >

In this embodiment, an apparatus 3000 for adjusting an operation state of an electronic device is provided, as shown in fig. 6, and includes a user image capturing module 3100, a usage parameter obtaining module 3200, and an operation parameter adjusting module 3300.

The user image collection module 3100 is configured to start a camera of an electronic device to collect a user image of a user in response to an operation of the user to run a set client application through the electronic device.

The usage parameter obtaining module 3200 is configured to obtain a usage parameter representing a usage state of the electronic device used by the user according to the user image.

The operation parameter adjusting module 3300 is configured to adjust an operation parameter of the client application according to the usage parameter.

The usage parameters may include at least any one or more of: the current distance between the user and the electronic equipment, the movement displacement of the user in a preset period, and the use angle of the user using the electronic equipment.

In one example, the usage parameter may include a current distance between the user and the electronic device; the usage parameter obtaining module 3200 is further configured to: determining a current interpupillary distance of the user in the user image; determining a current distance between the user and the electronic equipment according to the current pupil distance;

alternatively, determining a current head size of the user in the user image; a current distance between the user and the electronic device is determined based on the current head size.

Further, the usage parameter adjustment module 3300 is further configured to: determining the current value of the operation parameter according to the current distance; and running and setting the client application according to the current values of the running parameters.

In one example, the usage parameter may include a movement displacement of the user within a preset period; the usage parameter obtaining module 3200 is further configured to: acquiring a first frame of user image and a last frame of user image which are acquired in a period; and determining the movement displacement of the user in the period according to the difference value of the interpupillary distance of the user in the last frame of user image and the first frame of user image or the difference value of the head size.

Further, the operation parameter adjusting module 3300 is further configured to: determining the variable quantity of the operation parameter according to the movement displacement of the user in a preset period; adjusting the size of the operation parameter according to the variable quantity to obtain an adjusted operation parameter; and running and setting the client application according to the adjusted current value of the running parameter.

In one example, the usage parameters may include a usage angle of the electronic device used by the user; the usage parameter obtaining module 3200 is further configured to: and acquiring an included angle between a straight line where the two eyes of the user are located in the user image and a preset axis as a use angle.

Further, the operation parameter adjusting module 3300 is further configured to: determining and setting the running direction of the client application according to the using angle; and running the set client application according to the running direction.

It will be appreciated by those skilled in the art that the means 3000 for adjusting the operating state of the electronic device can be implemented in various ways. The means 3000 for adjusting the operating state of the electronic device may be implemented, for example, by instructing a configuration processor. For example, the instructions may be stored in ROM and read from ROM into a programmable device when the device is started up to implement the apparatus 3000 for adjusting the operating state of the electronic device. For example, the page loading apparatus 3000 may be cured into a dedicated device (e.g., ASIC). The means 3000 for adjusting the operating state of the electronic device may be divided into units independent of each other, or they may be implemented by being combined together. The means 3000 for adjusting the operating state of the electronic device may be implemented by one of the various implementations described above, or may be implemented by a combination of two or more of the various implementations described above.

In this embodiment, the means 3000 for adjusting the operation state of the electronic device may have various implementation forms, for example, the means 3000 for adjusting the operation state of the electronic device may be any functional module running in a software product or an application providing a network access service, or a peripheral insert, a plug-in, a patch, etc. of the software product or the application, or the software product or the application itself.

< electronic apparatus >

In the embodiment, an electronic device is also provided. In one aspect, the electronic device may include the aforementioned apparatus 3000 for adjusting the operating status of the electronic device.

In another aspect, as shown in fig. 7, an electronic device 4000 may include a memory 4100 and a processor 4100. Memory 4100 is used to store instructions; the instructions are used to control the processor 4200 to perform any one of the methods for adjusting the play status of an electronic device provided in this embodiment.

In this embodiment, the electronic device 4000 may be any electronic device having a corresponding display device 4100, memory 4100 and processor 4200, such as a mobile phone, a tablet computer, a palm computer, a desktop computer, a notebook computer, a workstation, a game machine, and the like. For example, the electronic device 4000 may be a smartphone in which an application providing a network access service is installed.

In this embodiment, the electronic apparatus 4000 may further include other hardware devices, for example, the electronic apparatus 1000 shown in fig. 1.

In the embodiment, when the electronic device runs and sets the client application, the user image is acquired, the use parameter representing the use state of the electronic device used by the user is acquired according to the user image, and the running parameter reflecting the running state of the client application run and set by the electronic device is adjusted according to the use parameter. Therefore, the operation state of the application of the client side can be adaptively adjusted and set according to the use state of the user, so that the operation effect according with the use state of the user is achieved. The user experience can be improved.

The present invention may be a system, method and/or computer program product. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied therewith for causing a processor to implement various aspects of the present invention.

The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.

The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.

The computer program instructions for carrying out operations of the present invention may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, aspects of the present invention are implemented by personalizing an electronic circuit, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA), with state information of computer-readable program instructions, which can execute the computer-readable program instructions.

Aspects of the present invention are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.

These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.

The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. It is well known to those skilled in the art that implementation by hardware, by software, and by a combination of software and hardware are equivalent.

Having described embodiments of the present invention, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen in order to best explain the principles of the embodiments, the practical application, or improvements made to the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the invention is defined by the appended claims.

Claims

1. A method for adjusting the running state of an electronic device comprises the following steps:

and adjusting the operation parameters reflecting the operation state of the set client application operated by the electronic equipment according to the use parameters.

2. The method of claim 1, wherein the usage parameters include at least any one or more of: the current distance between the user and the electronic equipment, the movement displacement of the user in a preset period, and the use angle of the user using the electronic equipment.

3. The method of claim 2, wherein the usage parameter comprises a current distance between the user and the electronic device;

determining a current interpupillary distance of the user in the user image;

alternatively, the first and second electrodes may be,

determining a current head size of the user in the user image;

4. The method of claim 3, wherein the step of adjusting an operating parameter reflecting an operating state of the electronic device for operating the set client application according to the usage parameter comprises:

5. The method of claim 2, wherein the usage parameters include a movement displacement of the user within a preset period;

6. The method of claim 5, wherein the adjusting an operating parameter reflecting an operating state of the electronic device to run the set client application according to the usage parameter comprises:

7. The method of claim 2, wherein the usage parameters include a usage angle of the user using the electronic device;

8. The method of claim 7, wherein the adjusting an operating parameter reflecting an operating state of the electronic device for operating the set client application according to the usage parameter comprises:

and running the set client application according to the running direction.

9. An apparatus for adjusting an operation state of an electronic device, comprising:

10. An electronic device, comprising:

the apparatus of claim 9; alternatively, the first and second electrodes may be,

a memory for storing executable instructions for controlling the processor to perform the method of any one of claims 1-8 and a processor.