WO2021258598A1

WO2021258598A1 - Method for adjusting displayed picture, and smart terminal and readable storage medium

Info

Publication number: WO2021258598A1
Application number: PCT/CN2020/125808
Authority: WO
Inventors: 张人超
Original assignee: 深圳创维－Rgb电子有限公司
Priority date: 2020-06-23
Filing date: 2020-11-02
Publication date: 2021-12-30
Also published as: CN111710314B; CN111710314A

Abstract

A method for adjusting a displayed picture, and a smart terminal (300) and a readable storage medium. The method comprises: acquiring an initial position of each skeleton key point of a target user that is located in front of a smart terminal (300) (S101, S201); when it is detected that the target user moves, determining, on the basis of the distance and angle of each skeleton key point deviating from the initial position, the action posture and movement orientation of the target user (S102, S202); and on the basis of the action posture and the movement orientation, adjusting a displayed picture of the smart terminal, so as to perform display in a corresponding picture display manner (S103). In this way, by means of determining an action posture and a movement orientation when a user moves, and adjusting the smart terminal (300) so as to perform display in a picture display manner that adapts to the movement of the user, the convenience and sense of reality of interaction between the user and the smart terminal (300) can be improved, thereby facilitating an improvement in the user experience.

Description

Method for adjusting display screen, intelligent terminal and readable storage medium

Cross-references to related applications

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on June 23, 2020, with the application number 202010583754X, titled "A display screen adjustment method, smart terminal and readable storage medium", and its entire content Incorporated in this application by reference.

Technical field

This application relates to the field of interactive technology, and in particular to a method for adjusting a display screen, an intelligent terminal, and a readable storage medium.

Background technique

With the rapid development of smart terminal technology, more and more smart terminals are equipped with camera devices. At the same time, applications and games that match the functions of the camera device are installed on smart terminals to achieve interaction with users and enrich their lives. .

At this stage, more are based on the camera that is built into the smart terminal to collect images, and present the collected images to the user, or display different content at a specific time node according to a specific program inside the application. The display of the content depends on The settings of the application, the single display content, and the low user participation, make the user experience a poorer experience when interacting with the smart terminal.

Summary of the invention

In view of this, one of the objectives of this application includes providing a display screen adjustment method, a smart terminal and a readable storage medium, which can adjust the smart terminal to adapt to the user's motion screen display by determining the user's motion posture and motion direction. Display in this way can improve the convenience and realism of the user's interaction with the smart terminal, and help improve the user's sense of experience.

The embodiment of the present application provides a method for adjusting a display screen, which is applied to a smart terminal, and the method for adjusting includes:

Obtain the initial position of each bone key point of the target user in front of the smart terminal;

When the movement of the target user is detected, determine the action posture and movement direction of the target user based on the distance and angle that each bone key point deviates from the initial position;

In combination with the action posture and the movement direction, the display screen of the smart terminal is adjusted to be displayed in a corresponding screen display mode.

In a possible implementation manner, the target user is determined through the following steps:

When it is detected that there is only one user in front of the smart terminal, the user is determined as the target user;

Or, when it is detected that there is more than one user in front of the smart terminal, the user whose position is located in the middle of the plurality of users among the plurality of users is determined as the target user.

In a possible implementation manner, the adjusting the display screen of the smart terminal to display in a corresponding screen display mode in combination with the action posture and the movement direction includes:

Detecting whether the motion posture is consistent with the preset adjustment posture, and whether the motion direction is consistent with the user direction of the target user before the motion;

If the action posture is consistent with the preset adjustment posture and the movement direction is consistent with the user's direction before the target user moves, determining the screen zooming speed of the display screen based on the target user's movement speed;

The display screen is enlarged and displayed according to the screen enlargement speed.

In a possible implementation manner, the determining the screen magnification speed of the display screen based on the movement speed of the target user includes:

Acquiring the movement speed of the target user;

According to the preset speed conversion ratio, the screen zooming speed of the display screen is determined.

In a possible implementation manner, after the detecting whether the action posture is consistent with the preset adjustment posture, and whether the movement direction is consistent with the user direction before the target user moves, the adjustment method further include:

If the action posture is inconsistent with the preset adjustment posture and the movement direction is also inconsistent with the user's direction before the target user moves, based on the movement direction and the user's direction, determine the rotation direction of the target user's rotation ；

It is determined that the display screen is rotated to an adjustment screen in a direction opposite to the rotation direction, and the adjustment screen is displayed.

If the action posture is consistent with the preset adjustment posture and the movement direction is inconsistent with the user's direction before the target user exercises, based on the target user's movement speed, the screen zooming speed of the display screen is determined, and based on Determining the direction of rotation of the target user for the direction of movement and the direction of the user;

While the display screen is zoomed in and displayed at the screen zooming speed, the display screen is adjusted to rotate and display in a direction opposite to the rotation direction.

In a possible implementation manner, the determining the action posture and movement direction of the target user based on the distance and angle of each bone key point deviating from the initial position includes:

Determine the action posture of the target user according to the distance and angle from which the current position of each bone key point deviates from the initial position of the bone key point;

Determine the movement direction of the target user according to the rotation angle of the head node of the target user.

The embodiment of the present application also provides an intelligent terminal, and the intelligent terminal includes:

The position acquisition module is configured to acquire the initial position of each bone key point of the target user in front of the smart terminal;

The movement determination module is configured to determine the movement posture and movement direction of the target user based on the distance and angle from the initial position of each bone key point when the movement of the target user is detected;

The first adjustment module is configured to adjust the display screen of the smart terminal to display in a corresponding screen display mode in combination with the action posture and the movement direction.

In a possible implementation manner, the smart terminal further includes a user determination module, and the user determination module is configured to:

In a possible implementation manner, when the first adjustment module is configured to adjust the display screen of the smart terminal to be displayed in a corresponding screen display mode in combination with the action posture and the movement direction, the first adjustment module An adjustment module is configured as:

Acquiring the movement speed of the target user;

In a possible implementation manner, the smart terminal further includes a second adjustment module, and the second adjustment module is configured to:

In a possible implementation manner, the smart terminal further includes a third adjustment module, and the third adjustment module is configured to:

In a possible implementation manner, the motion determination module is configured to determine the target user's motion posture and motion direction based on the distance and angle of each bone key point from the initial position when the target user motion is detected When the motion determination module is configured to:

The action posture of the target user is determined according to the distance and angle between the current position of each bone key point and the initial position of the bone key point.

An embodiment of the present application also provides an electronic device, including a processor, a memory, and a bus. The memory stores machine-readable instructions executable by the processor. When the electronic device is running, the processor and the bus The memories communicate through a bus, and when the machine-readable instructions are executed by the processor, the steps of the method for adjusting the display screen described above are executed.

The embodiments of the present application also provide a computer-readable storage medium on which a computer program is stored, and when the computer program is run by a processor, the steps of the method for adjusting the display screen as described above are executed.

The method for adjusting the display screen, the smart terminal, and the readable storage medium provided by the embodiments of the present application obtain the initial position of each bone key point of the target user in front of the smart terminal; when the target user's movement is detected, it is based on each bone The distance and angle of the key point deviation from the initial position determine the action posture and movement direction of the target user; combined with the action posture and the movement direction, the display screen of the smart terminal is adjusted to be displayed in a corresponding screen display mode.

In this way, the initial position of each bone key point of the target user located in front of the smart terminal is obtained. After the target movement is determined, the distance and angle of each bone key point of the target user from the corresponding initial position are determined to determine the target user’s Action posture and movement direction, according to the target user's action posture and movement direction, adjust the display screen of the smart terminal to display in the corresponding screen display mode, which can improve the convenience and realism of interaction between the user and the smart terminal, and help improve the user Sense of experience.

In order to make the above objectives, features, and advantages of the present application more comprehensible, preferred embodiments and accompanying drawings are described below in detail.

Description of the drawings

In order to explain the technical solutions of the embodiments of the present application more clearly, the following will briefly introduce the drawings needed in the embodiments. It should be understood that the following drawings only show some embodiments of the present application, and therefore do not It should be regarded as a limitation of the scope. For those of ordinary skill in the art, other related drawings can be obtained based on these drawings without creative work.

FIG. 1 is a flowchart of a method for adjusting a display screen provided by an embodiment of the application;

2 is a flowchart of a method for adjusting a display screen provided by another embodiment of the application;

FIG. 3 is one of the schematic structural diagrams of a smart terminal provided by an embodiment of this application;

FIG. 4 is the second structural diagram of a smart terminal provided by an embodiment of this application;

FIG. 5 is a schematic structural diagram of an electronic device provided by an embodiment of the application.

detailed description

In order to make the purpose, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions in the embodiments of this application will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of this application. Obviously, the described embodiment The implementation manners introduced in this application are only part of the possible implementation manners of this application, rather than all of the implementation manners. The components of the embodiments of the present application generally described and shown in the drawings herein may be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely represents selected embodiments of the application. Based on the embodiments of this application, every other embodiment obtained by those skilled in the art without creative work shall fall within the protection scope of this application.

First, introduce the applicable application scenarios of this application. This application can be applied to the field of interactive technology. With the rapid development of smart terminal technology, more and more smart terminals will be embedded with camera devices to interact with users in front of the smart terminal to improve user experience. For users, creating an immersive feeling during the interaction is one of the links that can enhance the user experience most in interactive applications.

It is found through research that at this stage, smart terminals are more based on the cameras built in the smart terminal to collect images, and present the collected images to the user, or display different information at specific time nodes according to specific programs within the application. The display of content and content relies on the settings of the application. The display content is single and the user's participation is not high, which makes the user experience poorer when interacting with the smart terminal.

Based on the discovery of the above problems, the embodiment of the present application provides a display screen adjustment method. By determining the user's motion posture and motion direction, the smart terminal is adjusted to adapt to the user's motion screen display mode to display, which can improve the user The convenience and realism of interacting with smart terminals help improve user experience.

Please refer to FIG. 1. FIG. 1 is a flowchart of a method for adjusting a display screen provided by an embodiment of the application. As shown in FIG. 1, the method for adjusting the display screen provided by the embodiment of the present application includes:

S101. Acquire the initial position of each bone key point of the target user in front of the smart terminal.

In this step, the initial position of each bone key point of the target user is determined when the target user does not take any action.

Optionally, the skeletal structure of the target user can be acquired through the camera set in the smart terminal, and the initial position of the bone key points can be acquired at the same time.

Among them, the key points of the target user's bones are the key positions in the pre-set bone structure, for example, it can be the target user's ankle joint node, knee joint node, wrist joint node, arm joint node, neck node, head node, etc. .

Optionally, the initial position of each bone key point can be determined by establishing a corresponding coordinate system on the smart terminal. Specifically, the center of the screen of the smart terminal can be used as the origin and the direction parallel to the plane where the smart terminal is located It is the X axis, and the direction perpendicular to the plane where the smart terminal is located is the Y axis to determine the initial coordinates of each bone key point, thereby determining the initial position of each bone key point.

S102: When the movement of the target user is detected, determine the action posture and movement direction of the target user based on the distance and angle of each bone key point from the initial position.

In this step, when it is detected that the target user is moving in front of the smart terminal screen, the current position of each bone key point of the target user is determined again, and it is determined that each bone key point deviates from the corresponding initial position after the target user moves. The distance and angle determine the posture and movement direction of the target user after the target user's movement.

Optionally, the camera built into the smart terminal can be controlled to collect images of the target user at preset time intervals, and the target user is determined to have exercised according to the position of the target user in adjacent images or changes in body movements.

Optionally, the determination of the user's action posture can be determined according to the distance and angle of the current position of each bone key point from the corresponding initial position. For example, when it is determined that the target user’s ankle joint node is compared to the initial position If you raise a certain distance in the vertical direction, you can determine that the user is currently lifting the foot. When the connection between the shoulder joint node of the target user and the connection between the arm joint node and the wrist joint node are determined When the included angle of is reduced from 180° to an acute angle, it can be determined that the target user is currently bending the arm.

Optionally, it is also possible to specifically determine the magnitude of the user's action range. For the above example, determine the distance between the current coordinate position of the ankle joint node and the initial coordinate position of the ankle joint node in the coordinate system established in advance, and Determine the specific height of the target user's foot lift based on the pre-set proportional relationship between the coordinate system position and the actual position.

Optionally, the movement direction of the target user may be determined according to the rotation angle of the head node of the target user, and the movement direction of the target user after the movement is determined according to the direction of the head of the target user before and after the movement.

S103: Adjust the display screen of the smart terminal to display in a corresponding screen display mode in combination with the action posture and the movement direction.

In this step, according to the action posture and motion direction of the target user determined in step S102, based on the preset mapping relationship between the action posture and the screen display mode, and the mapping relationship between the motion direction and the screen display mode, the final The screen display mode of the smart terminal following the movement of the target user.

Optionally, a 3D outdoor scene with the user's perspective is built into the smart terminal, which can provide the user with an immersive feeling of being in the outdoor scene according to the display of the display screen. After determining the target user's action, follow the target user The action adjusts the screen display mode of the smart terminal to make the user feel more immersive.

The display screen adjustment method provided by the embodiment of the present application obtains the initial position of each bone key point of the target user located in front of the smart terminal; when the target user's movement is detected, it is based on the distance of each bone key point from the initial position and The angle determines the action posture and movement direction of the target user; combined with the action posture and the movement direction, the display screen of the smart terminal is adjusted to be displayed in a corresponding screen display mode.

Please refer to FIG. 2. FIG. 2 is a flowchart of a method for adjusting a display screen according to another embodiment of the application. As shown in FIG. 2, the method for adjusting the display screen provided by the embodiment of the present application includes:

S201: Acquire the initial position of each bone key point of the target user located in front of the smart terminal.

S202: When the movement of the target user is detected, determine the action posture and movement direction of the target user based on the distance and angle of each bone key point from the initial position.

S203: Detect whether the motion posture is consistent with a preset adjustment posture, and whether the motion direction is consistent with the user direction of the target user before the motion.

In this step, it is detected whether the action posture determined in step S202 is consistent with the preset adjustment posture, and it is determined whether the motion orientation determined in step S202 is consistent with the user orientation before the target user moves.

Optionally, the aforementioned preset adjustment posture may be an action posture for judging that the target user has performed the action of walking, for example, running, stepping, forward step, etc. may all be preset adjustment postures.

S204: If the motion posture is consistent with the preset adjustment posture and the motion direction is consistent with the user direction before the target user moves, determine the screen zooming speed of the display screen based on the target user's motion speed.

In this step, if it is determined in step S203 that the action posture is consistent with the preset adjustment posture, and the movement direction is consistent with the user's direction before the target user exercises, then it is determined that the user has performed a moving action, but has not performed a steering motion, and the target is acquired The movement speed of the user, and the screen zoom-in speed of the display screen corresponding to the movement speed is determined.

It should be noted that the running posture is consistent with the adjusted posture, not necessarily the exercise posture is exactly the same as the adjusted posture. For example, when the target user is in the stepping posture, the vertical displacement of the knee joints compared to before exercise is not necessarily the same as that before exercise. The vertical displacement indicated in the adjustment posture is exactly the same. As long as it is determined that the target user has made the overall posture of the stepping movement, the running posture can be considered to be consistent with the adjustment posture.

Optionally, the determination of the motion speed of the target user may be to determine the motion speed of the target user according to the frequency of the target user's leg-lifting exercise, and determine the display screen according to the motion speed of the target user and a preset speed conversion ratio. The zooming speed of the screen.

Among them, the preset speed conversion ratio is determined by comprehensive consideration of various factors such as historical user movement speed and human visual data threshold.

S205. Enlarge and display the display image according to the image enlargement speed.

In this step, after the screen zoom-in speed is determined in step S204, the display screen is displayed according to the screen zoom-in speed of the screen.

Optionally, the zoomed display of the screen is also by displaying multiple display images with different zooming effects, and the multiple displayed images are switched and displayed according to the zooming speed of the screen.

Among them, the description of S201 to S202 can refer to the description of S101 to S102, and the same technical effect can be achieved, which is not repeated here.

Optionally, the target user is determined by the following steps: when it is detected that there is only one user in front of the smart terminal, the user is determined as the target user; or when it is detected that there is more than one user in front of the smart terminal , The user whose position is in the middle of multiple users among multiple users is determined as the target user.

In this step, when it is detected that there is only one user in front of the smart terminal, the user is determined as the target user, and the display screen of the smart terminal will be adjusted and displayed according to the movement of the user; when it is detected that there is more than one user in front of the smart terminal For one user, the user located in the middle of multiple users is determined as the target user, and the display screen of the smart terminal will be adjusted and displayed according to the movement of the user in the middle position.

Optionally, when there are multiple users in front of the smart terminal, in addition to determining the target user based on the user's location, the target user can also be determined based on the number of key bone points of each user collected by the built-in camera of the smart terminal. In the process of capturing key points by the camera, due to the limitation of the acquisition angle of view, the number of bone key points collected for each user is also different. The user with the largest number of bone key points collected is determined as the target user.

Optionally, after step S203, the adjustment method further includes: if the action posture is inconsistent with the preset adjustment posture and the movement orientation is also inconsistent with the user orientation of the target user before the exercise, based on the movement Orientation and the direction of the user, determine the rotation direction of the target user's rotation; determine that the display screen rotates to an adjustment screen in a direction opposite to the rotation direction, and display the adjustment screen.

In this step, if the action posture is inconsistent with the preset adjustment posture, and the movement direction is also inconsistent with the user's orientation before the target user's exercise, it is determined that the target user performs the in-situ rotation movement at this time, and the movement direction is compared with the user's before the user's exercise. Orientation, the rotation direction of the target user's rotation is determined, and the display screen is determined to rotate to the adjustment screen in the opposite direction to the rotation direction, and the adjusted adjustment screen is displayed on the smart terminal.

Optionally, during the rotation of the target user, taking the target user itself as a reference, the image screen seen by the target user should move in the direction opposite to the direction of the target user's rotation. Therefore, it is necessary to move the display screen of the smart terminal toward the target user The user turns in the opposite direction.

For example, when it is determined that the target user rotates to the right, the display screen of the smart terminal needs to be controlled to rotate to the left for display.

Optionally, when the screen is rotated and displayed, a scene that does not exist in the original screen may also be displayed to simulate an outdoor scene.

Optionally, after step S203, the adjustment method further includes: if the action posture is consistent with a preset adjustment posture and the movement direction is inconsistent with the user's direction before the target user moves, based on the target user The speed of movement of the display screen is determined, and the direction of rotation of the target user is determined based on the movement direction and the direction of the user; the screen is zoomed in at the screen zooming speed on the display screen While displaying, adjust the display screen to rotate and display in a direction opposite to the rotation direction.

In this step, if the action posture is consistent with the preset adjustment posture, and the movement direction is inconsistent with the user's orientation before the target user exercises, it is determined that the target user is moving and turning at the same time. At this time, according to the target user's movement speed, Determine the zoom speed of the display screen, and at the same time, determine the adjustment screen that the display screen rotates to the opposite direction of the rotation direction according to the rotation direction of the target user. While the display screen is zoomed in and displayed according to the zoom speed of the screen, adjust the direction and rotation of the display screen Rotate the display in the opposite direction.

Optionally, when the target user makes a corresponding action posture, he also makes a turn. At this time, it is necessary to determine the display mode of the smart terminal according to the target user's action speed and rotation direction, and to enlarge the display screen of the smart terminal Display and rotation adjustment can be performed simultaneously.

The display screen adjustment method provided by the embodiment of the present application obtains the initial position of each bone key point of the target user located in front of the smart terminal; when the target user's movement is detected, it is based on the distance of each bone key point from the initial position and Angle, determine the action posture and movement direction of the target user; detect whether the action posture is consistent with the preset adjustment posture, and whether the movement direction is consistent with the user direction before the target user exercise; if the action The posture is consistent with the preset adjustment posture and the movement direction is consistent with the user's direction before the target user moves. Based on the target user's movement speed, the screen zooming speed of the display screen is determined; The picture enlargement speed is used for picture enlargement display.

In this way, the initial position of each bone key point of the target user located in front of the smart terminal is obtained. After the target movement is determined, the distance and angle of each bone key point of the target user from the corresponding initial position are determined to determine the target user’s The action posture and the movement direction, according to the consistency of the target user’s action posture and the preset adjustment posture, and the rotation direction of the target user determined based on the movement direction and the movement direction of the user before the movement, the display screen of the smart terminal is adjusted accordingly The display mode of the screen can improve the convenience and realism of the user's interaction with the smart terminal, and help improve the user's sense of experience.

Please refer to FIG. 3 and FIG. 4. FIG. 3 is one of the schematic structural diagrams of an intelligent terminal provided by an embodiment of the application, and FIG. 4 is the second schematic structural diagram of an intelligent terminal provided by an embodiment of the application. As shown in FIG. 3, the smart terminal 300 includes:

The position obtaining module 310 is configured to obtain the initial position of each bone key point of the target user located in front of the smart terminal.

The movement determination module 320 is configured to determine the movement posture and movement direction of the target user based on the distance and angle of each bone key point from the initial position when the movement of the target user is detected.

The first adjustment module 330 is configured to adjust the display screen of the smart terminal to display in a corresponding screen display mode in combination with the action posture and the movement direction.

Optionally, as shown in FIG. 4, the smart terminal 300 further includes a user determining module 340, and the user determining module 340 is configured to:

Optionally, as shown in FIG. 4, the smart terminal 300 further includes a second adjustment module 350, and the second adjustment module 350 is configured to:

Optionally, as shown in FIG. 4, the smart terminal 300 further includes a third adjustment module 360, and the third adjustment module 360 is configured to:

Optionally, when the first adjustment module 330 is configured to adjust the display screen of the smart terminal to be displayed in a corresponding screen display mode in combination with the action posture and the movement direction, the first adjustment module 330 Configured as:

Acquire the movement speed of the target user.

Optionally, when the motion determination module 320 is configured to determine the target user's motion posture and motion direction based on the distance and angle of each bone key point from the initial position when the target user motion is detected, the motion determination module 320 Configured as:

The smart terminal provided by the embodiment of the present application obtains the initial position of each bone key point of the target user located in front of the smart terminal; when the target user's movement is detected, it is determined based on the distance and angle of each bone key point from the initial position The action posture and movement direction of the target user; combined with the action posture and the movement direction, the display screen of the smart terminal is adjusted to be displayed in a corresponding screen display mode.

Please refer to FIG. 5. FIG. 5 is a schematic structural diagram of an electronic device provided by an embodiment of the application. As shown in FIG. 5, the electronic device 500 includes a processor 510, a memory 520, and a bus 530.

The memory 520 stores machine-readable instructions executable by the processor 510. When the electronic device 500 is running, the processor 510 communicates with the memory 520 through the bus 530, and the machine-readable instructions are When the processor 510 executes, it can execute the steps of the method for adjusting the display screen in the method embodiments shown in FIG. 1 and FIG.

The embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and the computer program can execute the method embodiment shown in FIG. 1 and FIG. 2 when the computer program is run by a processor. For the steps of the method for adjusting the display screen in, for specific implementations, please refer to the method embodiments, which will not be repeated here.

Those skilled in the art can clearly understand that, for the convenience and conciseness of description, the specific working process of the above-described system, device, and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, device, and method can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division, and there may be other divisions in actual implementation. For example, multiple units or components may be combined or It can be integrated into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection of devices or units through some communication interfaces, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

In addition, the functional units in the various embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.

If the function is implemented in the form of a software function unit and sold or used as an independent product, it can be stored in a non-volatile computer readable storage medium executable by a processor. Based on this understanding, the technical solution of this application essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program code .

Finally, it should be noted that the above-mentioned embodiments are only specific implementations of the present application, which are used to illustrate the technical solutions of the present application, but not to limit it. The protection scope of the present application is not limited to this, although referring to the foregoing The examples describe the application in detail, and those of ordinary skill in the art should understand that any person skilled in the art can still modify the technical solutions described in the foregoing examples within the technical scope disclosed in this application. Or it can be easily conceived of changes, or equivalent replacements of some of the technical features; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the application, and shall be covered in this application Within the scope of protection. Therefore, the protection scope of this application shall be subject to the protection scope of the claims.

Industrial applicability

Claims

A method for adjusting a display screen, applied to a smart terminal, characterized in that the adjusting method includes:

Obtain the initial position of each bone key point of the target user in front of the smart terminal;

When the movement of the target user is detected, determine the action posture and movement direction of the target user based on the distance and angle that each bone key point deviates from the initial position;

In combination with the action posture and the movement direction, the display screen of the smart terminal is adjusted to be displayed in a corresponding screen display mode.
The adjustment method according to claim 1, wherein the target user is determined by the following steps:

When it is detected that there is only one user in front of the smart terminal, the user is determined as the target user; or

When it is detected that there is more than one user in front of the smart terminal, the user whose position is located in the middle of the plurality of users among the plurality of users is determined as the target user.
The adjustment method according to claim 1 or 2, wherein the adjusting the display screen of the smart terminal to be displayed in a corresponding screen display mode in combination with the action posture and the movement direction comprises:

Detecting whether the motion posture is consistent with the preset adjustment posture, and whether the motion direction is consistent with the user direction of the target user before the motion;

If the action posture is consistent with the preset adjustment posture and the movement direction is consistent with the user's direction before the target user moves, determining the screen zooming speed of the display screen based on the target user's movement speed;

The display screen is enlarged and displayed according to the screen enlargement speed.
The method according to claim 3, wherein the determining the screen zoom-in speed of the display screen based on the movement speed of the target user comprises:

Acquiring the movement speed of the target user;

According to the preset speed conversion ratio, the screen zooming speed of the display screen is determined.
The adjustment method according to claim 3 or 4, wherein in the detecting whether the action posture is consistent with a preset adjustment posture, and whether the movement direction is consistent with the user direction before the target user moves After that, the adjustment method further includes:

If the action posture is inconsistent with the preset adjustment posture and the movement direction is also inconsistent with the user's direction before the target user moves, based on the movement direction and the user's direction, determine the rotation direction of the target user's rotation ；

It is determined that the display screen is rotated to an adjustment screen in a direction opposite to the rotation direction, and the adjustment screen is displayed.
The adjustment method according to any one of claims 3-5, characterized in that, in the detection of whether the action posture is consistent with the preset adjustment posture, and the movement direction is the same as that of the user before the target user exercises After the orientations are consistent, the adjustment method further includes:

If the action posture is consistent with the preset adjustment posture and the movement direction is inconsistent with the user's direction before the target user exercises, based on the target user's movement speed, the screen zooming speed of the display screen is determined, and based on Determining the direction of rotation of the target user for the direction of movement and the direction of the user;

While the display screen is zoomed in and displayed at the screen zooming speed, the display screen is adjusted to rotate and display in a direction opposite to the rotation direction.
The method according to any one of claims 1 to 6, wherein the determining the action posture and movement direction of the target user based on the distance and angle of each bone key point from the initial position comprises:

Determine the action posture of the target user according to the distance and angle from which the current position of each bone key point deviates from the initial position of the bone key point;

Determine the movement direction of the target user according to the rotation angle of the head node of the target user.
An intelligent terminal, characterized in that, the intelligent terminal includes:

The position acquisition module is configured to acquire the initial position of each bone key point of the target user in front of the smart terminal;

The movement determination module is configured to determine the movement posture and movement direction of the target user based on the distance and angle from the initial position of each bone key point when the movement of the target user is detected;

The first adjustment module is configured to adjust the display screen of the smart terminal to display in a corresponding screen display mode in combination with the action posture and the movement direction.
The smart terminal according to claim 8, wherein the smart terminal further comprises a user determination module, and the user determination module is configured to:

When it is detected that there is only one user in front of the smart terminal, the user is determined as the target user; or

When it is detected that there is more than one user in front of the smart terminal, the user whose position is located in the middle of the plurality of users among the plurality of users is determined as the target user.
The smart terminal according to claim 8 or 9, wherein the first adjustment module is configured to combine the action posture and the movement direction to adjust the display screen of the smart terminal in a corresponding screen display mode When displaying, the first adjustment module is configured to:

Detecting whether the motion posture is consistent with the preset adjustment posture, and whether the motion direction is consistent with the user direction of the target user before the motion;

If the action posture is consistent with the preset adjustment posture and the movement direction is consistent with the user's direction before the target user moves, determining the screen zooming speed of the display screen based on the target user's movement speed;

The display screen is enlarged and displayed according to the screen enlargement speed.
An electronic device, comprising: a processor, a memory, and a bus. The memory stores machine-readable instructions executable by the processor. When the electronic device is running, the processor and the memory are Through the bus communication, when the machine-readable instructions are executed by the processor, the steps of the display screen adjustment method according to any one of claims 1 to 7 are executed.
A computer-readable storage medium, wherein a computer program is stored on the computer-readable storage medium, and the computer program executes the display screen according to any one of claims 1 to 7 when the computer program is run by a processor. The steps of the adjustment method.