CN113721758A

CN113721758A - Fitness guiding method and electronic equipment

Info

Publication number: CN113721758A
Application number: CN202010457000.XA
Authority: CN
Inventors: 马春晖; 黄磊; 陈霄汉; 赵杰; 姜永航
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2020-05-26
Filing date: 2020-05-26
Publication date: 2021-11-30
Anticipated expiration: 2040-05-26
Also published as: WO2021238356A1; CN113721758B

Abstract

The application provides a fitness guidance method and electronic equipment. The method can guide the user to exercise at the preset position so as to shoot the whole body image of the user, give accurate evaluation to exercise actions of the user and improve exercise experience of the user. In the method, electronic equipment detects a first instruction, and the first instruction is used for starting a fitness function; controlling a movable camera on the electronic equipment to change shooting angles so as to obtain at least two images shot by the camera at different shooting angles; the at least two images comprise user images; determining the position information of the user according to the at least two images; when the position information is determined not to be in a preset position, guiding the user to move to the preset position; and starting a fitness process when the user moves to the preset position.

Description

Fitness guiding method and electronic equipment

Technical Field

The application relates to the technical field of terminals, in particular to a body-building guidance method and electronic equipment.

Background

The life rhythm of people in modern society is faster and faster, and the physical and mental health problems become more and more serious. For example, due to heavy living or working stress, a user's exercise time is fragmented and cannot exercise for a long time outdoors or in a gymnasium. How to use fragmented time to build body without going outside or in a gymnasium is a matter of thought.

Currently, devices such as televisions are available on the market that provide fitness instructions to users who may exercise at home. The principle of the method is that a camera on the television can collect user images, recognize action postures in the images and evaluate the action postures. However, the performance of the camera affects the fitness experience, for example, if a common camera is adopted, the whole body information of the user cannot be acquired due to the limited field angle range, correct evaluation cannot be given, and the fitness experience is poor; if the binocular camera is used, the cost is high and the price is expensive.

Disclosure of Invention

The application aims to provide a fitness guidance method and electronic equipment, which are used for guiding a user to exercise and improving fitness experience.

In a first aspect, a fitness guidance method is provided that may be applied to an electronic device. The method comprises the following steps: the electronic equipment detects a first instruction, and the first instruction is used for starting the fitness function; controlling a movable camera on the electronic equipment to change shooting angles so as to obtain at least two images shot by the camera at different shooting angles; the at least two images comprise user images; determining the position information of the user according to the at least two images; when the position information is determined not to be in a preset position, guiding the user to move to the preset position; and starting a fitness process when the user moves to the preset position.

For example, if the user is located too close to the electronic device, the electronic device may not collect a whole body image of the user, and may not accurately evaluate the exercise. In the embodiment of the application, the electronic equipment positions the user through the movable camera, and then guides the user to the preset position for body building, so that the electronic equipment can conveniently acquire the whole body image of the user, and accurate evaluation can be made.

In a possible design, when an electronic device controls a movable camera on the electronic device to change a shooting angle so as to obtain at least two images shot by the camera at different shooting angles, the method specifically includes: acquiring height information of the user; determining a first shooting position and a second shooting position corresponding to the height information in a database; and adjusting the camera to the first shooting position to shoot a first image, adjusting the camera to the second shooting position to shoot a second image.

In the embodiment of the application, the electronic equipment shoots the user images at different visual angles through the movable camera to position the position information of the user, and when the position information of the user is not located at the preset position, the user is guided to move to the preset position for body building, so that the whole body image of the user can be conveniently collected, and accurate evaluation is given to the body building action of the user.

In a possible design, when the electronic device determines the position information of the user according to the at least two images, it may specifically determine a first bone node of the user on a first image of the at least two images, and determine a second bone node of the user on a second image of the at least two images; the second bone node is located at the same position in the human body as the first bone node; determining depth information based on the first and second skeletal nodes, the depth information indicating a distance between the user and the camera; based on the depth information, location information of the user is determined.

In the embodiment of the application, the electronic equipment determines the depth information through the bone nodes in the user image under different visual angles, and then determines the position information of the user according to the depth information, so that the accuracy of positioning the position information of the user is improved.

In a possible design, when the electronic device determines that the position information is not located at a preset position, and guides the user to move to the preset position, a first orientation of the position information relative to the preset position may be determined first; based on the first orientation, directing the user to move to the preset position.

For example, the user is far away from the electronic device, the user image in the collected image is small, the background is large, the user body-building action is not easy to recognize, and the electronic device can prompt the user to move forward to a preset position. When the user is too close to the electronic equipment, the acquired image does not include the whole body image of the user, the body-building action of the user is not easy to recognize, and the electronic equipment can prompt the user to move backwards to a preset position. Therefore, in the embodiment of the application, the electronic equipment can guide the user to move to the preset position for body building, so that the whole body image of the user can be conveniently acquired, and accurate evaluation can be given to the body building action of the user.

In a possible design, when the electronic device guides the user to move to the preset position, the electronic device may specifically guide the user to move to the preset position in a voice broadcasting manner or an image information display manner. It should be noted that voice playing or image information displaying are only two examples of the prompting method, and other prompting methods are also possible, and the embodiment of the present application is not limited.

In one possible design, the electronic device may further determine the age of the user from the user image; and providing a fitness mode corresponding to the age for the user, wherein the fitness mode comprises fitness courses suitable for the age. In the embodiment of the application, the electronic equipment determines the age of the user and recommends the corresponding fitness course for the user. For example, when the user ages, a user recommends a gymnastics, and the like, and when the user ages older, a user recommends yoga, and the like.

In one possible design, the electronic device may also collect image information during the user's exercise; and recognizing the action gesture of the user in the image information, and evaluating the gesture of the user based on the action gesture and a standard action gesture. In the embodiment of the application, the electronic equipment compares the user action gesture in the acquired image with the standard action gesture, so that evaluation is given to the user fitness, and the user fitness experience is improved.

In a second aspect, there is also provided an electronic device comprising: a movable camera; one or more processors; one or more memories. Wherein the one or more memories store one or more computer programs, the one or more computer programs comprising instructions, which when executed by the one or more processors, cause the electronic device to perform the steps of:

detecting a first instruction, wherein the first instruction is used for starting a body-building function; controlling the movable camera to change shooting angles so as to obtain at least two images shot by the camera at different shooting angles; the at least two images comprise user images; determining the position information of the user according to the at least two images; when the position information is determined not to be in a preset position, guiding the user to move to the preset position; and starting a fitness process when the user moves to the preset position.

In one possible design, when the instructions are executed by the one or more processors, the method controls the movable camera to change a shooting angle to obtain at least two images shot by the camera at different shooting angles, and includes: acquiring height information of the user; determining a first shooting position and a second shooting position corresponding to the height information in a database; and adjusting the camera to the first shooting position to shoot a first image, adjusting the camera to the second shooting position to shoot a second image.

In one possible design, the instructions, when executed by the one or more processors, cause determining location information of a user from the at least two images to include: determining a first bone node of the user on a first image of the at least two images and determining a second bone node of the user on a second image of the at least two images; the second bone node is located at the same position in the human body as the first bone node; determining depth information based on the first and second skeletal nodes, the depth information indicating a distance between the user and the camera; based on the depth information, location information of the user is determined.

In one possible design, the instructions, when executed by the one or more processors, cause determining that the location information is not at a preset location, to direct the user to move to the preset location, including: determining a first orientation of the position information relative to the preset position; based on the first orientation, directing the user to move to the preset position.

In one possible design, the instructions, when executed by the one or more processors, cause the electronic device to guide the user to move to the preset position through a voice broadcast mode or an image information display mode.

In one possible design, the instructions, when executed by the one or more processors, cause the electronic device to further perform: judging the age of the user through the user image; and providing a fitness mode corresponding to the age for the user, wherein the fitness mode comprises fitness courses suitable for the age.

In one possible design, the instructions, when executed by the one or more processors, cause the electronic device to further perform: acquiring image information of the user in the fitness process; and recognizing the action gesture of the user in the image information, and evaluating the gesture of the user based on the action gesture and a standard action gesture.

In a third aspect, an electronic device is further provided, including: a module/unit for performing the method of the first aspect or any one of the possible designs of the first aspect; these modules/units may be implemented by hardware, or by hardware executing corresponding software.

In a fourth aspect, a chip is further provided, where the chip is coupled with a memory in an electronic device, so that the chip invokes program instructions stored in the memory when running, thereby implementing the method provided by any one of the possible designs in the first aspect.

In a fifth aspect, a computer-readable storage medium is also provided, which comprises a computer program, which, when run on an electronic device, causes the electronic device to perform the method as provided by any one of the possible designs of the first aspect.

In a sixth aspect, there is also provided a computer program product comprising instructions which, when executed on a computer, cause the computer to perform the method as provided by any one of the possible designs of the first aspect.

In a seventh aspect, there is also provided a graphical user interface on an electronic device, the electronic device having a removable camera, one or more memories, and one or more processors to execute one or more computer programs stored in the one or more memories, the graphical user interface comprising a graphical user interface displayed when the electronic device performs the method of the first aspect.

For the above advantages of the second aspect to the seventh aspect, please refer to any one of the possible design advantages of the first aspect, and details are not repeated here.

Drawings

Fig. 1 is a schematic diagram of an application scenario provided in an embodiment of the present application;

FIG. 2 is a schematic diagram of a process of a fitness guidance method according to an embodiment of the present application;

fig. 3 is a schematic view of a display interface of an electronic device according to an embodiment of the present application;

fig. 4 is a schematic flowchart illustrating a process of determining whether a left foot or a right foot of a movable camera on an electronic device is worn according to an embodiment of the present application;

fig. 5 is a schematic view illustrating adjustment of a shooting angle by a movable camera on an electronic device according to an embodiment of the present disclosure;

fig. 6 is a schematic diagram illustrating an electronic device outputting prompt information according to an embodiment of the present application;

FIG. 7 is a schematic diagram of a human bone node on an image according to an embodiment of the present disclosure;

FIG. 8 is a diagram illustrating an electronic device locating user location information according to an embodiment of the present application;

FIG. 9 is a schematic diagram of a default position provided in accordance with an embodiment of the present application;

fig. 10 is a schematic diagram illustrating an electronic device prompting a user to move to a preset position according to an embodiment of the present application;

fig. 11 is a schematic flowchart illustrating a process of determining different shooting angles of a camera by an electronic device according to an embodiment of the present application;

fig. 12 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application;

fig. 13 is a schematic diagram of another hardware structure of an electronic device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described in detail below with reference to the drawings in the following embodiments of the present application.

The embodiments of the present application relate to at least one, including one or more; wherein a plurality means greater than or equal to two. In addition, it is to be understood that the terms first, second, etc. in the description of the present application are used for distinguishing between the descriptions and not necessarily for describing a sequential or chronological order.

The terminology used in the following examples is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification of this application and the appended claims, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, such as "one or more", unless the context clearly indicates otherwise. It should also be understood that in the embodiments of the present application, "one or more" means one, two, or more than two; "and/or" describes the association relationship of the associated objects, indicating that three relationships may exist; for example, a and/or B, may represent: a alone, both A and B, and B alone, where A, B may be singular or plural. The character "is a relationship generally indicating that the former and latter associated objects are an" or ".

Reference throughout this specification to "one embodiment" or "some embodiments," or the like, means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," or the like, in various places throughout this specification are not necessarily all referring to the same embodiment, but rather "one or more but not all embodiments" unless specifically stated otherwise. The terms "comprising," "including," "having," and variations thereof mean "including, but not limited to," unless expressly specified otherwise.

The body-building guidance method provided by the embodiment of the application can be applied to electronic equipment with a movable camera, such as a mobile phone, a tablet computer, a notebook computer, a desktop computer and the like, and can also be household appliances such as a television and the like. The movable camera can change the shooting angle to shoot the image at different visual angles, through the image location user's at different visual angles position, appointed user moves preset position, so that gather the whole body image of user, give body-building guide suggestion, promote user's body-building and experience, need not to use the binocular camera that the price is expensive moreover, also can save the cost through the image location to user's spatial position at different visual angles.

Fig. 1 is a schematic diagram of an exemplary application scenario provided in an embodiment of the present application. Take the example where the electronic device is a television. Set up the camera on the TV set, this camera can change and shoot the angle, for example the liftable formula camera can rise to different heights, when the liftable formula camera rises to different heights to the realization is followed different shooting angles and is shot the image. The television set has a display screen for displaying image information. The user stands in front of the television, the camera on the television can collect user images, and the user is guided to perform body building by displaying indication information through the display screen based on the user images.

Example 1:

fig. 2 shows a flow chart of a fitness guidance method provided in an embodiment of the present application. As shown in fig. 2, the flow of the method includes:

and S21, the electronic equipment detects a starting instruction for starting the fitness function.

Illustratively, referring to fig. 3, a schematic view of a display screen of an electronic device is shown. As shown in fig. 3(a), icons of a plurality of applications are displayed on the display screen, including, for example: a fitness icon 301, a music icon 302, a food icon 303, a sea shopping icon 304, etc., which may be applications downloaded locally or from the network. The electronic device detects the operation on the fitness icon 301, and displays an interface shown in fig. 3(b), in which various types of fitness courses such as yoga, body shaping, aerobics and the like are displayed, and assuming that aerobics is selected, a display area 305 of the interface as a preview frame can display a course preview of aerobics. When the electronic apparatus detects an operation for the start button 306, an interface shown in fig. 3(c) in which a gymnastics teaching video is displayed.

Taking fig. 3(b) as an example, in step 21, the start instruction may be an instruction generated by the electronic device detecting an operation on the start button 306; alternatively, taking fig. 3(a) as an example, the start instruction may be an instruction generated by the electronic device detecting an operation for the fitness icon 301.

For example, an audio circuit on the electronic device may capture a voice uttered by a user, and generate the start command when the voice is recognized to include a keyword such as "body building" or "start body building". As another example, the display screen of the electronic device is a touch screen, and the touch screen may generate the start instruction when detecting the operation of the fitness icon 301 or the operation of the start button 306 in fig. 3 (b). Of course, there may be other ways, such as receiving an activation command sent by a remote control device, etc., which are not listed here.

And S22, the electronic equipment starts the camera and controls the camera to change the shooting angle so that the camera can shoot images under different angles.

The camera on the electronic device is a movable camera, and taking a lifting camera as an example, a possible implementation manner is that, for example, the camera is arranged on the elastic structure, and when the elastic structure is bounced, the camera extends out of the shell of the electronic device, or when the elastic structure is bounced to different heights, the camera is driven to different heights; alternatively, the camera may be retracted into the housing of the electronic device when the resilient structure is compressed. Of course, other moving cameras besides the lifting camera may be used, which is not limited in the embodiments of the present application.

Therefore, there are various ways to change the shooting angle in step S22, for example, as shown in fig. 4, for example, the camera in fig. 4(a) may be raised to different heights, or the position of the camera in fig. 4(b) is moved left and right, or the angle between the camera in fig. 4(c) and the plane where the display screen of the electronic device is located may be changed, or a combination of the three ways shown in fig. 4 may be used, and the embodiment of the present application is not limited. Hereinafter, the camera is taken as an example to be raised to different heights.

In some embodiments, before step S22, the electronic device may do a preparation task, for example, the electronic device may preliminarily adjust the position of the camera to include all body parts of the user in the image taken by the camera as much as possible, which helps to more accurately locate the position information of the user. For example, referring to fig. 5 (a), when the camera is at the first position, the first image is captured, and the electronic device determines that the first image does not include the foot of the user, the electronic device may adjust the camera to be at the second position, and the field angle of the camera at the second position may be offset by a certain angle with respect to the field angle at the first position, as shown in fig. 5 (b), so that the second image captured by the camera at the second position may include all body parts of the user. In other embodiments, the user may be prompted to move the position assuming that the electronic device adjusts the position of the camera and cannot capture images that can contain all of the body parts of the user at all times. For example, when the camera shoots the user in a top view, the shot image does not include the leg of the user, because the leg of the user may be blocked by the upper body of the user, in which case, the electronic device may prompt the user to move backwards for a certain distance to shoot all body parts of the user. For example, referring to fig. 6, in order to indicate that the electronic device prompts the user to move backward, a prompt message, such as an image message or a text message, such as "please move backward", is displayed on the display screen, or a voice prompt message may be output, and the like, which is not limited in the embodiment of the present application.

S23, the electronic equipment identifies human skeleton nodes in a first image and a second image with different visual angles based on images of different visual angles shot by the camera at different angles; the first image and the second image may be any two images of images at different angles captured by the camera.

Illustratively, see fig. 7, which is a schematic diagram of a human bone node. It is understood that a skeletal joint on a human body may include the skull, shoulder, elbow, carpometacarpal, hip, knee, or ankle, among others. In fig. 7, 15 bone nodes on the human body in the image are identified as an example, and more or fewer bone nodes can be identified in practical application. The electronic device can use the existing human body posture detection algorithm to identify the bone nodes of the human body in the image, and the embodiment of the application is not repeated.

S24, the electronic device determines depth information based on the skeletal nodes of the human body on the first image and the second image, wherein the depth information can represent the distance between the user and the camera.

It should be understood that the first image and the second image are images captured of the same scene by the camera at different camera angles. The first image and the second image contain a common photographic subject, such as a user. The electronic device can determine a first bone node on the first image and a second bone node on the second image corresponding to the first bone node, and then determine a distance from the user to the camera according to the first bone node and the second bone node. For example, the first bone node is a knee joint of the user in the first image, and the second bone node is the knee joint of the user in the second image.

Illustratively, fig. 8 shows a schematic diagram of the electronic device determining depth information. The electronic device acquires a first image at a first location and a second image at a second location. The distance b between the first and second positions is known and the focal distance f is known, assuming that the distance between the user p and the camera is the depth value z. According to the triangle similarity principle, the following results are obtained:

thus, the method can obtain the product,

wherein f and b are known, the value of x1 is the distance between the position of the first bone node of the user in the first image acquired by the camera at the first position and the center of the image, and the value of x2 is the distance between the position of the second bone node of the user in the second image acquired by the camera at the second position and the center of the image.

And S25, the electronic equipment determines the position information of the user according to the depth information.

Referring to fig. 8, the electronic device may determine values of depth values z, x1, x2, etc., which are relative to an image coordinate system, i.e., a coordinate system shown in the figure, and obtain the position information of the user in the world coordinate system through conversion of the image coordinate system and the world coordinate system. The detailed description of the specific conversion process is omitted in this application.

S26, the electronic equipment judges whether the user position is at a preset body-building position; if yes, S28; if not, S27 is executed.

Fig. 9 shows a schematic view of the preset exercising position. The preset exercise position can be preset. The electronic device may determine the orientation of the user location information with respect to the preset exercise position in step S25 and output prompt information to prompt the user to step to the preset exercise position according to the orientation. For example, a distance value, which is a distance between the preset exercise position and the display screen of the electronic device, may be pre-stored in the electronic device. Therefore, one possible implementation manner is that the electronic device determines whether the difference between the depth information z and the distance value is within a preset range, if so, determines that the user is in the preset fitness position, and if not, determines that the user is not in the preset fitness position.

S27, the electronic device guides the user to move to a preset fitness position, and performs S28.

The guiding mode can be various, for example, voice information is output to prompt the user to move according to the direction; or, a prompt message may be displayed on the display screen to prompt the user to move, and the like, which is not limited in the embodiment of the present application.

For example, fig. 10 shows a schematic view of the electronic device guiding the user to move to the preset exercise position through information displayed on the display screen. As shown in fig. 10 (a), the electronic device determines that the user position is not at the preset position, and determines that the preset position is located right in front of the user position, prompting the user to move forward to the preset position. As shown in fig. 10 (b), the electronic device determines that the user position is not at the preset position, determines that the preset position is behind the user position, and prompts the user to move backward to the preset position. As shown in fig. 10 (c), if the electronic device determines that the user position is not at the preset position and determines that the position of the preset position relative to the user position is left front, the electronic device prompts the user to move left front to the preset position. As shown in fig. 10 (d), the electronic device determines that the user position is not at the preset position, and determines that the position of the preset position relative to the user position is right front, and prompts the user to move forward to the preset position.

And S28, the electronic equipment starts to execute the fitness process.

In some embodiments, the electronic device may identify an age of the user through the captured image, and provide the user with a fitness mode corresponding to the age of the user, where the fitness mode includes fitness courses suitable for the age. For example, the electronic device may identify the age of the user through an image, for example, through machine learning, which is not limited in the embodiments of the present application. Assuming that the user recognizes that the user age is a teenager, the user may enter a corresponding fitness mode, and provide a corresponding fitness course such as a body building exercise in this mode, assuming that the user recognizes that the user age is a middle age, the user may enter a corresponding fitness mode, and provide a corresponding fitness course such as yoga in this fitness mode.

In some embodiments, after the electronic device starts to execute the fitness process, image information of the user during the fitness process can be acquired; and recognizing the action gesture of the user in the image information, and evaluating the gesture of the user based on the action gesture and a standard action gesture. For example, the electronic device acquires one frame of image every n seconds, compares the motion posture of the user on the acquired image with a standard motion posture and gives an evaluation, that is, acquires one frame of image every n seconds and evaluates the image. Or, the electronic device compares the action posture of the user on 1 frame or p frames of images (p is less than m) with the standard action posture and gives an evaluation every time m frames of images are acquired, that is, one frame is evaluated every time m frames are acquired, so that the efficiency is improved.

In the above embodiment 1, the electronic apparatus may perform a preparation operation before step S22, and preliminarily adjust the shooting angle of the camera so that the camera can capture the entire body of the user as much as possible. In another embodiment, the electronic device may also adjust the position of the camera in other ways.

Example 2

Fig. 11 is a schematic flowchart of a fitness guidance method according to an embodiment of the present application, where the flowchart shown in fig. 11 may be understood as a flowchart before step S23 in the flowchart shown in fig. 2, and the flowchart of the method includes:

s101, the electronic equipment acquires height information of a user.

There are various ways for the electronic device to obtain the height information of the user.

In the mode 1, a first database is stored in the electronic device, and the first database comprises the corresponding relation between the face image and the height information. A camera on the electronic equipment acquires a face image of a user and judges whether the face image exists in a database or not; and if so, extracting height information corresponding to the face image from the database.

Mode 2, the electronic device can prompt the user to manually enter height information, and the electronic device determines the height of the user according to the height information input by the user.

Of course, in addition to the above-mentioned mode 1 and mode 2, there may be other modes for acquiring the height information of the user, which are not listed here.

S102, a second database is stored in the electronic equipment, the second database comprises the corresponding relation between binocular models and height information of users, and one binocular model comprises a group of positions of the cameras. For example, when the height of the user is X, the binocular model corresponding to the height of the user includes a first shooting position and a second shooting position; and when the height of the user is Y, the binocular model corresponding to the height of the user comprises a third shooting position and a fourth shooting position. Therefore, after the electronic device determines the height information of the user based on S101, the electronic device may traverse the second database to determine a binocular model corresponding to the height information of the user, for example, a binocular model corresponding to height information closest to the height information of the user determined in S101 in all height information in the second database. Assuming that the user height a is determined in step S101, and the electronic device determines that the user height X stored in the second database is closest to the user height a, then a binocular model corresponding to the user height X is determined, for example, the binocular model includes a first shooting position and a second shooting position, then the electronic device adjusts the camera to the first shooting position to shoot a first image, adjusts the camera to the second shooting position to shoot a second image, and further obtains images at different shooting angles (i.e., step S103).

If the electronic device cannot acquire the height information of the user, the height information corresponding to all binocular models in the second database can be averaged to serve as the final height information.

S103, the electronic equipment adjusts the camera to different positions based on the selected binocular model so as to acquire images with different visual angles.

The flow after step S103 can be seen in the flow shown in steps S23-S28 in the embodiment shown in FIG. 2.

The various embodiments of the present application can be combined arbitrarily to achieve different technical effects.

Fig. 12 shows a schematic structural diagram of an electronic device provided in an embodiment of the present application. The electronic apparatus 100 includes: a Radio Frequency (RF) circuit 110, a power supply 120, a processor 130, a memory 140, an input unit 150, a display unit 160, a camera 170, a communication interface 180, and a Wireless Fidelity (WiFi) module 190. Those skilled in the art will appreciate that the configuration of the electronic device shown in fig. 12 does not constitute a limitation of the electronic device, and the electronic device provided in the embodiments of the present application may include more or less components than those shown, or may combine some components, or may be arranged in different components.

The following describes each component of the electronic device 100 in detail with reference to fig. 12:

the RF circuit 110 may be used for receiving and transmitting data during a communication or conversation. Specifically, the RF circuit 110 sends the downlink data of the base station to the processor 130 for processing after receiving the downlink data; and in addition, sending the uplink data to be sent to the base station. Generally, the RF circuit 110 includes, but is not limited to, an antenna, at least one Amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like.

In addition, the RF circuitry 110 may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol, including but not limited to Global System for Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (SMS), and the like.

The WiFi technology belongs to a short-distance wireless transmission technology, and the electronic device 100 may connect to an Access Point (AP) through a WiFi module 190, so as to implement Access to a data network. The WiFi module 190 may be used for receiving and transmitting data during communication.

The electronic device 100 may be physically connected to other devices through the communication interface 180. Optionally, the communication interface 180 is connected to the communication interface of the other device through a cable, so as to implement data transmission between the electronic device 100 and the other device.

In the embodiment of the present application, the electronic device 100 is capable of implementing a communication service to send information to other contacts, so that the electronic device 100 needs to have a data transmission function, that is, the electronic device 100 needs to include a communication module inside. Although fig. 12 shows communication modules such as the RF circuit 110, the WiFi module 190, and the communication interface 180, it is understood that at least one of the above components or other communication modules (such as a bluetooth module) for implementing communication exist in the electronic device 100 for data transmission.

For example, when the electronic device 100 is a mobile phone, the electronic device 100 may include the RF circuit 110 and may further include the WiFi module 190; when the electronic device 100 is a computer, the electronic device 100 may include the communication interface 180 and may further include the WiFi module 190; when the electronic device 100 is a tablet computer, the electronic device 100 may include the WiFi module.

The memory 140 may be used to store software programs and modules. The processor 130 executes various functional applications and data processing of the electronic device 100 by executing software programs and modules stored in the memory 140.

Alternatively, the memory 140 may mainly include a program storage area and a data storage area. The storage program area can store an operating system, various application programs (such as communication application), a face recognition module and the like; the storage data area may store data (such as various multimedia files like pictures, video files, etc., and face information templates) created according to the use of the electronic device, and the like.

Further, the memory 140 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The input unit 150 may be used to receive numeric or character information input by a user and to generate key signal inputs related to user settings and function control of the electronic apparatus 100.

Optionally, the input unit 150 may include a touch panel 151 and other input devices 152.

The touch panel 151, also referred to as a touch screen, may collect a touch operation performed by a user on or near the touch panel 151 (for example, an operation performed by the user on or near the touch panel 151 using any suitable object or accessory such as a finger or a stylus pen), and drive a corresponding connection device according to a preset program. Alternatively, the touch panel 151 may include two parts, i.e., a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 130, and receives and executes commands sent by the processor 130. In addition, the touch panel 151 may be implemented in various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave.

Optionally, the other input devices 152 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

The display unit 160 may be used to display information input by a user or information provided to a user and various menus of the electronic apparatus 100. The display unit 160 is used for presenting an interface to realize human-computer interaction.

The display unit 160 may include a display panel 161. Alternatively, the display panel 161 may be configured in the form of a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), or the like.

Further, the touch panel 151 may cover the display panel 161, and when the touch panel 151 detects a touch operation on or near the touch panel, the touch panel transmits the touch operation to the processor 130 to determine the type of the touch event, and then the processor 130 provides a corresponding visual output on the display panel 161 according to the type of the touch event.

Although in fig. 12, the touch panel 151 and the display panel 161 are implemented as two separate components to implement the input and output functions of the electronic device 100, in some embodiments, the touch panel 151 and the display panel 161 may be integrated to implement the input and output functions of the electronic device 100.

The processor 130 is a control center of the electronic device 100, connects various components using various interfaces and lines, and performs various functions of the electronic device 100 and processes data by running or executing software programs and/or modules stored in the memory 140 and calling data stored in the memory 140, thereby implementing various services based on the electronic device.

Optionally, the processor 130 may include one or more processing units. Optionally, the processor 130 may integrate an application processor and a modem processor, wherein the application processor mainly supports an operating system, a user interface, an application program, and the like, and the modem processor mainly handles wireless communication. It will be appreciated that the modem processor described above may not be integrated into the processor 130.

The camera 170 is configured to implement a shooting function of the electronic device 100, and shoot pictures or videos. The camera 170 may change a shooting angle, for example, a liftable camera capable of being lifted to different heights; or a camera that can be moved left and right, etc.

The electronic device 100 also includes a power source 120 (such as a battery) for powering the various components. Optionally, the power supply 120 may be logically connected to the processor 130 through a power management system, so as to implement functions of managing charging, discharging, power consumption, and the like through the power management system.

Although not shown, the electronic device 100 may further include at least one sensor, an audio circuit, and the like, which are not described in detail herein.

As shown in fig. 13, other embodiments of the present application disclose an electronic device, such as a mobile phone, an ipad, etc. The electronic device may include: a display screen 1307; one or more processors 1302; a plurality of application programs 1308; the various devices described above may be connected by one or more communication buses 1305. The display screen 1307 can be used for displaying a fitness video, an image shot by the electronic equipment and the like.

Wherein the one or more computer programs 1304 are stored in the memory 1303 and configured to be executed by the one or more processors 1302, the one or more computer programs 1304 include instructions that can be used to perform the steps of fig. 2-11 and the corresponding embodiments.

It should be noted that the division of the unit in the embodiment of the present application is schematic, and is only a logic function division, and there may be another division manner in actual implementation. Each functional unit in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. For example, in the above embodiment, the first obtaining unit and the second obtaining unit may be the same unit or different units. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

As used in the above embodiments, the terms "when …" or "after …" may be interpreted to mean "if …" or "after …" or "in response to determination …" or "in response to detection …", depending on the context. Similarly, depending on the context, the phrase "at the time of determination …" or "if (a stated condition or event) is detected" may be interpreted to mean "if the determination …" or "in response to the determination …" or "upon detection (a stated condition or event)" or "in response to detection (a stated condition or event)". In addition, in the above-described embodiments, relational terms such as first and second are used to distinguish one entity from another entity without limiting any actual relationship or order between the entities.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.

It is noted that a portion of this patent application contains material which is subject to copyright protection. The copyright owner reserves the copyright rights whatsoever, except for making copies of the patent files or recorded patent document contents of the patent office.

Claims

1. A fitness guidance method is applied to an electronic device, and comprises the following steps:

detecting a first instruction, wherein the first instruction is used for starting a body-building function;

controlling a movable camera on the electronic equipment to change shooting angles so as to obtain at least two images shot by the camera at different shooting angles; the at least two images comprise user images;

determining the position information of the user according to the at least two images;

when the position information is determined not to be in a preset position, guiding the user to move to the preset position;

and starting a fitness process when the user moves to the preset position.

2. The method of claim 1, wherein controlling a movable camera on the electronic device to change a shooting angle to obtain at least two images taken by the camera at different shooting angles comprises:

acquiring height information of the user;

determining a first shooting position and a second shooting position corresponding to the height information in a database;

and adjusting the camera to the first shooting position to shoot a first image, adjusting the camera to the second shooting position to shoot a second image.

3. The method of claim 1 or 2, wherein determining the location information of the user from the at least two images comprises:

determining a first bone node of the user on a first image of the at least two images and determining a second bone node of the user on a second image of the at least two images; the second bone node is located at the same position in the human body as the first bone node;

determining depth information based on the first and second skeletal nodes, the depth information indicating a distance between the user and the camera;

based on the depth information, location information of the user is determined.

4. The method of any one of claims 1-3, wherein determining that the location information is not at a preset location, directing the user to move to the preset location comprises:

determining a first orientation of the position information relative to the preset position;

based on the first orientation, directing the user to move to the preset position.

5. The method of any one of claims 1-4, wherein said directing the user to move to the preset position comprises:

and guiding the user to move to the preset position through a voice broadcasting mode or an image information display mode.

6. The method of any of claims 1-5, wherein the method further comprises:

judging the age of the user through the user image;

and providing a fitness mode corresponding to the age for the user, wherein the fitness mode comprises fitness courses suitable for the age.

7. The method of any of claims 1-6, further comprising:

acquiring image information of the user in the fitness process;

and recognizing the action gesture of the user in the image information, and evaluating the gesture of the user based on the action gesture and a standard action gesture.

8. An electronic device, comprising:

a movable camera;

one or more processors;

one or more memories; wherein the one or more memories store one or more computer programs, the one or more computer programs comprising instructions, which when executed by the one or more processors, cause the electronic device to perform the steps of:

controlling the movable camera to change shooting angles so as to obtain at least two images shot by the camera at different shooting angles; the at least two images comprise user images;

and starting a fitness process when the user moves to the preset position.

9. The electronic device of claim 8, wherein the instructions, when executed by the one or more processors, cause the moveable camera to change shooting angles to obtain at least two images taken by the camera at different shooting angles, in particular comprising:

acquiring height information of the user;

10. The electronic device of claim 8 or 9, wherein the instructions, when executed by the one or more processors, cause determining location information of a user from the at least two images, in particular comprising:

based on the depth information, location information of the user is determined.

11. The electronic device of any of claims 8-10, wherein the instructions, when executed by the one or more processors, cause guiding the user to move to the preset position comprise:

12. The electronic device of any of claims 8-11, wherein the instructions, when executed by the one or more processors, cause the directing the user to move to the preset position comprise:

13. The electronic device of any of claims 8-12, wherein the instructions, when executed by the one or more processors, cause the electronic device to further perform the steps of:

judging the age of the user through the user image;

14. The electronic device of any of claims 8-13, wherein the instructions, when executed by the one or more processors, cause the electronic device to further perform the steps of:

acquiring image information of the user in the fitness process;

15. A computer-readable storage medium, comprising a computer program which, when run on an electronic device, causes the electronic device to perform the method of any one of claims 1 to 7.