WO2024082908A1

WO2024082908A1 - Body shape measurement and analysis method and electronic device

Info

Publication number: WO2024082908A1
Application number: PCT/CN2023/120169
Authority: WO
Inventors: 张子曰
Original assignee: 华为技术有限公司
Priority date: 2022-10-19
Filing date: 2023-09-20
Publication date: 2024-04-25
Also published as: CN117956058A

Abstract

A body shape measurement and analysis method and an electronic device, for use in accurately measuring and analyzing a body shape state of a user. The method comprises: an electronic device detecting a first operation instruction of a user for initiating body shape measurement; prompting the user to input basic body parameters, and acquiring the basic body parameters input by the user under the prompt; or reading basic body parameters pre-stored by the user; sequentially displaying photographing interfaces used for guiding the user to photograph the body at different angles, and photographing images of the body of the user at the different angles; constructing a three-dimensional (3D) model according to the basic body parameters of the user and the images of the body of the user at the different angles, and obtaining a body shape analysis result of the user according to the 3D model; and displaying the body shape analysis result, the displayed body shape analysis result comprising a first body shape image and various body shape data of the user.

Description

A body shape measurement and analysis method and electronic device

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the priority of the Chinese patent application filed with the Intellectual Property Office of the People's Republic of China on October 19, 2022, with application number 202211282051.9 and invention name "A body shape measurement and analysis method and electronic device", the entire contents of which are incorporated by reference in this application.

Technical Field

The present application relates to the field of electronic technology, and in particular to a body shape measurement and analysis method and an electronic device.

Background technique

At present, with the development of technology, applications and services related to user health are becoming more and more abundant. For example, there are many applications (APPs) related to exercise, fat loss, etc. This innovation and development in applications has created convenient conditions for promoting the physical health of users.

However, such applications generally require users to measure manually and input the measurement results into the relevant APP. For example, in a sports health APP, users input manually measured body circumference information, length information, etc. This method cannot accurately reflect the user's body shape and it is difficult to meet the user's precise control of body shape parameters.

Summary of the invention

The purpose of the present application is to provide a body shape measurement and analysis method and an electronic device for accurately measuring and analyzing the body shape of a user.

In a first aspect, a body measurement and analysis method is provided, which is applied to electronic devices. The method includes: detecting a first operation instruction initiated by a user to measure body shape; prompting the user to input basic body parameters, and obtaining the basic body parameters input by the user under the prompt, or reading the basic body parameters pre-stored by the user; sequentially displaying shooting interfaces for guiding the user to shoot various angles of the body, and shooting and obtaining images of the user's body at various angles; constructing a three-dimensional 3D model based on the basic body parameters of the user and the images of the user's body at various angles, and obtaining the body shape analysis result of the user based on the 3D model; displaying the body shape analysis result, and the displayed body shape analysis result includes the first body shape image of the user and various body shape data. Among them, this application does not limit the execution order of obtaining basic body parameters and shooting various angles of the body.

Through the method provided in the application embodiment, a 3D model is constructed based on the measured body image data and the obtained basic body parameters, and then the user's body parameters can be obtained based on the 3D model, and then the user's body data can be obtained based on the body parameter analysis, and then the body analysis result is generated. Therefore, the method can reduce the complexity of the user's operation of body measurement analysis, and the accuracy of body measurement can be improved through 3D model processing.

In a possible design, the 3D model is constructed based on the basic body parameters of the user and the images of the user's body at various angles, including: inputting the images of the body at various angles into the first model for training to obtain the contour data of the body; and inputting the images of the body at various angles into the second model for training to obtain the skeletal point data of the body; inputting the contour data, the skeletal point data and the basic body parameters into the third model for training to obtain the weight factors corresponding to each body shape parameter; inputting the weight factors of the body shape parameters into the fourth model for training to obtain the 3D model; wherein the fourth model includes various reference body shape parameters, and the various reference body shape parameters are used to multiply with the corresponding weight factors of the body shape parameters to obtain various body shape parameters of the user, and the various body shape parameters of the user are used to obtain the 3D model. The reference body shape parameters may include but are not limited to: size parameters, obesity parameters.

In this design, by constructing a 3D model, the user's body shape can be more accurately obtained based on the 3D model. In this way, the user can obtain a body shape analysis result that is more suitable for his or her body shape.

In a possible design, before sequentially displaying the shooting interfaces for guiding the user to shoot various angles of the body, the method further includes: displaying a first guide interface for device calibration; the first guide interface is used to guide the user to place the electronic device according to preset placement conditions; and detecting that the placement state of the electronic device in the first guide interface meets the preset placement conditions. In a possible scenario, the first guide interface displays a first identifier and a second identifier, and the first identifier and the second identifier have a first relative position relationship; on the first guide interface, it is determined that the first identifier and the second identifier change from having the first relative position relationship to having a second relative position relationship, then it can be determined that the placement state of the electronic device in the first guide interface meets the preset placement conditions; the second relative position relationship is used to indicate that the placement state of the electronic device meets the preset placement conditions. For example, the first identifier may be a flower, the second identifier may be a branch, the first relative position relationship may be a separate flower and branch, and the second relative position relationship may be a branch of a flower including the flower and the branch.

In this design, the current posture and target posture of the electronic device are displayed through different identifiers, so that the current posture of the electronic device can be adjusted to the target posture. In this way, on the one hand, it is convenient for users to place the device more efficiently, and on the other hand, it can also increase the fun of the body measurement process.

In a possible design, after the first operation instruction of the user initiating body measurement is detected, and before the shooting interface for guiding the user to shoot various angles of the body is sequentially displayed, the method further includes: displaying a second guidance interface, the second guidance interface including step instructions for guiding the user to shoot various angles of the body. In this design, by showing the user the guidance step instructions for shooting the body, the user can more effectively perform body measurement.

In a possible design, before sequentially displaying the shooting interface for guiding the user to shoot various angles of the body, the method further includes: displaying a third guide interface for adjusting the volume of the electronic device, detecting that the volume of the electronic device displayed in the third guide interface is adjusted to be greater than or equal to a preset volume value; or determining that the volume of the electronic device is greater than or equal to the preset volume value. In this design, by displaying the interface for adjusting the volume to the user, it is convenient to better guide the user to perform body measurement, thereby improving the efficiency of body measurement.

In a possible design, the basic body parameters also include gender parameters; the user's body image corresponds to the gender parameters. In this design, by obtaining the user's gender parameters, a body image that is more suitable for the user can be displayed to the user, thereby improving the user experience.

Among them, the user's body image can be displayed through 3D animation, which can not only show the user's body shape more accurately, but also enhance the user experience.

In a possible design, the displaying of the body shape analysis result includes: displaying a first interface including the body shape analysis result; wherein the first interface also includes a switch control for switching dates. The electronic device may also display a second interface in response to a second operation instruction for the switch control in the first interface, wherein the second operation instruction is used to select a specified date, and the second interface includes the body shape analysis result obtained on the specified date. In this design, by displaying the switch control, it is convenient for the user to view the body shape status on different dates, thereby making it convenient for the user to perceive changes in body shape.

In a possible design, the first interface also includes a trigger control for triggering manual calibration of the body shape analysis result; the method further includes: in response to a third operation instruction on the trigger control in the first interface, displaying a third interface, the third interface including a calibration control for manually calibrating the body shape analysis result; in response to a fourth operation instruction on the calibration control, updating the first interface; the updated first interface includes a first body shape image and at least one body shape data calibrated based on the fourth operation instruction. In this design, an extended function of manual calibration can be provided to the user, so that a body shape analysis result that better meets the user's requirements can be generated, thereby ensuring the user's experience.

In a possible design, the first interface also includes a card of the first body shape data. The method further includes: in response to a fifth operation instruction on the card of the first body shape data, displaying a fourth interface, the fourth interface including preset information related to the first body shape data; wherein the preset information is information obtained from a preset body shape database and based on the first body shape parameter; the first body shape parameter is any one of the various body shape parameters. In this design, by expanding the detailed information of the body shape data, more detailed body shape data can be provided to the user, so that the user can better understand the body shape status.

In a possible design, the images of the body at various angles include: a front view of the body and a side view of the body.

In a possible design, the body shape analysis result also includes a second body shape image, which is obtained based on preset body shape parameters; wherein the preset body shape parameters may be target weight parameters, target three-dimensional parameters, etc. In this design, the present application can also realize the comparison between the current user body shape image and the predicted user body shape, so that the user can more intuitively obtain the state of body shape change, and the user can carry out a more accurate exercise plan, etc.

In a second aspect, an embodiment of the present application further provides an electronic device, comprising at least one memory and at least one processor; wherein the at least one memory is used to store computer program code, and the computer program code comprises computer instructions; when the computer instructions are executed by the at least one processor, the electronic device executes a method in any possible design of the above-mentioned first aspect.

In a third aspect, an embodiment of the present application further provides a body shape measurement and analysis device, which includes a module/unit for executing the method in any possible design of the first aspect. These modules/units can be implemented by hardware, or by executing corresponding software implementations by hardware.

In a fourth aspect, a computer-readable storage medium is provided, which stores a computer program (also referred to as code or instruction). When these codes or instructions are run on a computer, the computer executes a method in any possible design of the first aspect above.

In a fifth aspect, a computer program product is provided, the computer program product comprising: a computer program (also referred to as code, or instruction), when the computer program is run, the method in any possible design of the above-mentioned first aspect is executed.

In the sixth aspect, a graphical user interface on an electronic device is also provided, the electronic device having a display screen, one or more memories, and one or more processors, the one or more processors being used to execute one or more computer programs stored in the one or more memories, the graphical user interface including the graphical user interface displayed when the electronic device executes any possible design in the first aspect of the above-mentioned embodiment of the present application.

It should be noted that for the beneficial effects of various designs of the electronic devices provided in the second to sixth aspects of the embodiments of the present application, please refer to the beneficial effects of any possible design in the first aspect above, and will not be repeated here.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a schematic diagram of a structure of an electronic device provided in an embodiment of the present application;

FIG2 is a software architecture diagram of an electronic device provided in an embodiment of the present application;

FIG3a is a schematic diagram of an interface for obtaining a user's body shape;

FIG3 b is a schematic diagram of an interface for customizing a health plan;

FIG4 is a schematic diagram of an interface of a body scanning process;

FIG5 is a schematic diagram of a manual calibration interface;

FIG6 is one of the schematic diagrams of the interface for initiating body shape measurement provided in an embodiment of the present application;

FIG7 is a second schematic diagram of an interface for initiating body shape measurement provided in an embodiment of the present application;

FIG8 is a schematic diagram of a process for obtaining a human body mesh model provided in an embodiment of the present application;

FIG9 is a schematic diagram of an interface of a body shape analysis result provided in an embodiment of the present application;

FIG10 is a schematic diagram of a body shape type provided in an embodiment of the present application;

FIG11 is a schematic diagram of an interface for manually calibrating body shape analysis results provided in an embodiment of the present application;

FIG12 is a schematic diagram of one of the interfaces for displaying body shape analysis results provided in an embodiment of the present application;

FIG13 is a second schematic diagram of an interface for displaying body shape analysis results provided in an embodiment of the present application;

FIG. 14 is a third schematic diagram of an interface for displaying body shape analysis results provided in an embodiment of the present application;

FIG15 is a fourth schematic diagram of an interface for displaying body shape analysis results provided in an embodiment of the present application;

FIG16 is one of the interface schematic diagrams of a body shape measurement and analysis method provided in an embodiment of the present application;

FIG17 is a second schematic diagram of an interface of a body shape measurement and analysis method provided in an embodiment of the present application;

FIG18 is a third schematic diagram of an interface of a body shape measurement and analysis method provided in an embodiment of the present application;

FIG19 is a fourth schematic diagram of an interface of a body shape measurement and analysis method provided in an embodiment of the present application;

FIG20 is a schematic diagram of a flow chart of a body shape measurement and analysis method provided in an embodiment of the present application;

FIG21 is a schematic diagram of a body shape measurement process provided by an embodiment of the present application;

FIG22 is a schematic diagram of a process for obtaining body shape analysis results according to an embodiment of the present application;

FIG. 23 is a schematic diagram of a flow chart for displaying body shape analysis results provided in an embodiment of the present application.

Detailed ways

Below, some terms in the embodiments of the present application are explained to facilitate understanding by those skilled in the art.

The at least one involved in the embodiments of the present application includes one or more; wherein, more than one means greater than or equal to two. In addition, it should be understood that in the description of this specification, words such as "first" and "second" are only used for the purpose of distinguishing the description, and cannot be understood as expressing or implying relative importance, nor can they be understood as expressing or implying order. For example, the first electronic device and the second electronic device do not represent the importance of the two or the order of the two, but are only for distinguishing the description. In the embodiments of the present application, "and/or" is only a description of the association relationship, indicating that there can be three relationships. For example, A and/or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character "/" in this article generally indicates that the objects associated before and after are in an "or" relationship.

References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure or characteristic described in conjunction with the embodiment is included in one or more embodiments of this specification. In one embodiment, "in some embodiments", "in some other embodiments", "in yet other embodiments", etc. do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments" unless otherwise specifically emphasized. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized.

The body shape measurement and analysis method provided in the embodiment of the present application is applicable to electronic devices. For example, the electronic device can be an electronic device with an image acquisition device (such as a camera); for example, it can be a portable electronic device such as a mobile phone, a tablet computer, a laptop computer, or a wearable device such as a watch or a bracelet; or it can also be a smart home device such as a television. In short, the embodiment of the present application does not limit the specific type of electronic device.

In some examples, the body shape measurement and analysis method provided in the embodiments of the present application may be a function, service or application provided in an electronic device. The application may be an application provided by the electronic device itself, or an application downloaded from the network. Taking a mobile phone as an example, the mobile phone may include a sports health application, which has a function integrated therein, and the function may perform body shape measurement and analysis on the user through the body shape measurement and analysis method provided in the embodiments of the present application.

The body measurement analysis method provided in the embodiment of the present application can also be applied to a system, which includes a first electronic device and a second electronic device. The first electronic device is connected to the second electronic device, and the embodiment of the present application does not limit the connection method. For example, it can be connected by wired or wireless means, wherein the wireless method may include but is not limited to: wireless fidelity (Wi-Fi), Bluetooth. The first electronic device may be a device for collecting image data, such as a home camera, etc. The first electronic device may send the collected image data to the second electronic device. The second electronic device may execute the body measurement analysis process provided in the embodiment of the present application based on the image data, and the specific process will be described later. Exemplarily, the second electronic device may be any device, for example, it may be a device with strong computing power, such as a mobile phone, a tablet computer, etc. It can be understood that the embodiment of the present application may include multiple steps, wherein the multiple steps may be executed by multiple electronic devices in collaboration, or may be executed by one electronic device alone, and the embodiment of the present application does not limit this. For ease of understanding, the following embodiments are mainly described by taking one device alone as an example.

FIG1 shows a schematic diagram of the structure of an electronic device 100 used in the technical solution of the present application. The electronic device 100 may be a mobile phone, etc. As shown in FIG1 , the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a gravity sensor 180A, a gyroscope sensor 180B, a pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors. Among them, the controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions. A memory may also be set in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a high-speed cache memory. The memory may save instructions or data that the processor 110 has just used or circulated. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated access can be avoided, and the waiting time of the processor 110 can be reduced, thereby improving the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (SIM) interface, and/or a universal serial bus (USB) interface, etc.

The wireless communication function of the electronic device 100 can be realized through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation The invention is implemented by a modem processor and a baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization rate of the antennas. For example, antenna 1 can be reused as a diversity antenna of a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

The mobile communication module 150 can provide solutions for wireless communications including 2G/3G/4G/5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 may receive electromagnetic waves from the antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 may also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be arranged in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be arranged in the same device as at least some of the modules of the processor 110.

The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) and the like applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering processing, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of the signal, amplify the signal, and convert it into electromagnetic waves for radiation through the antenna 2.

In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that electronic device 100 can communicate with the network and other devices through wireless communication technology.

The display screen 194 is used to display the display interface of the application, etc. The display screen 194 includes a display panel. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1. For example, in an embodiment of the present application, real-time collected image data, such as body scan image data, can be displayed on the display screen 194; and measurement analysis results based on the collected image data, such as artificial intelligence (AI) body shape, etc. can also be displayed on the display screen 194.

The electronic device 100100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor, etc. Among them, ISP is used to process the data fed back by camera 193.

The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, and the software code of at least one application program, etc. The data storage area can store data (such as images, videos, etc.) generated during the use of the electronic device 100, etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash memory, etc.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as pictures and videos are saved in the external memory card.

The electronic device 100 can implement audio functions such as voice control instructions, body scanning guidance voice, etc. through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100100 can listen to a guiding voice, or external scenes such as background music through one or more speakers 170A.

The receiver 170B, also called a "earpiece", may be one or more and is used to convert an audio electrical signal into a sound signal. When the electronic device 100100 receives a call or a voice message, the voice can be received by placing the receiver 170B close to the human ear.

The microphone 170C, also called a "microphone" or "microphone", is used to convert sound signals into electrical signals. In the embodiment of the present application, for example, a user can wake up a sports health application through the microphone 170C.

The earphone jack 170D is used to connect a wired earphone.

The gravity sensor 180A can be made of a cantilever displacement device using an elastic sensitive element, and an energy storage spring made of an elastic sensitive element to drive the electrical contact to complete the conversion from gravity changes to electrical signals. In some embodiments, the gravity sensor 180A can be used to determine the electrical The tilt angle of the sub-device 100 relative to the horizontal plane; and, by analyzing the dynamic acceleration through the gravity sensor 180A, the movement mode of the electronic device 100 can be determined and analyzed, for example, it can be applied in some games to enhance the interactive controllability of the electronic device 100.

The gyro sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting. In an embodiment of the present application, the inclination angle of the electronic device 100 can be determined by the gyro sensor 180B, so that a more accurate body scan result can be obtained.

The pressure sensor 180C is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180C can be disposed on the display screen 194 .

The magnetic sensor 180D includes a Hall sensor, and the electronic device 100 can detect the opening and closing of the flip leather case by using the magnetic sensor 180D.

The acceleration sensor 180E can detect the magnitude of acceleration in various directions (generally three axes) of the electronic device 100. When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected.

The distance sensor 180F is used to measure the distance. The electronic device 100 can measure the distance by infrared or laser.

The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100.

The ambient light sensor 180L is used to sense the brightness of the ambient light. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the sensed brightness of the ambient light.

The fingerprint sensor 180H is used to collect fingerprints.

The temperature sensor 180J is used to detect the temperature.

The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.

The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone block of a human vocal part.

The button 190 includes a power button, a volume button, etc. The button 190 can be a mechanical button. It can also be a touch button. The electronic device 100 can receive the button input and generate a key signal input related to the user settings and function control of the electronic device 100. The motor 191 can generate a vibration prompt. The motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. The indicator 192 can be an indicator light, which can be used to indicate the charging status, power changes, messages, missed calls, notifications, etc. The SIM card interface 195 is used to connect the SIM card. The SIM card can be connected to and separated from the electronic device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195.

It is understood that the components shown in FIG1 do not constitute a specific limitation on the electronic device 100. The electronic device 100 in the embodiment of the present application may include more or fewer components than those in FIG1. In addition, the combination/connection relationship between the components in FIG1 may also be adjusted and modified.

The operating system (OS) involved in the embodiment of the present application is the most basic system software running on the electronic device 100. The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes an operating system adopting a layered architecture as an example to illustrate the software system architecture of the electronic device 100.

FIG2 is a block diagram of a software system architecture of an electronic device 100 provided in an embodiment of the present application. As shown in FIG2, the software system architecture of the electronic device 100 can be a layered architecture, for example, the software can be divided into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into five layers, from top to bottom, namely, the application layer, the application framework layer (framework, FWK), the runtime and system library, the kernel layer, and the hardware layer.

The application layer may include a series of application packages. As shown in Figure 2, the application layer may include camera, settings, skin module, user interface (UI), third-party applications, etc. Among them, third-party applications may include wireless local area network (WLAN), music, call, Bluetooth, video, memo, notes, etc.

In the embodiment of the present application, the application layer can be used to implement the presentation of the editing interface. The above editing interface can provide users with editing operations for health apps such as sports health that are focused on in the embodiment of the present application, for example, the body scanning interface involved below.

In a possible implementation, the application can be developed using the Java language and call the application provided by the application framework layer. The application programming interface (API) is used to complete the development of the application framework layer, which is mainly a series of services and management systems of the operating system.

The application framework layer provides an application programming interface and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions. As shown in Figure 2, the application framework layer may include an activity manager, a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, etc.

The activity manager is used to manage the life cycle of each application and provide common navigation back functions, providing an interactive interface for all program windows.

The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc. The content provider is used to store and obtain data and make the data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).

The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

The notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in the status bar, a prompt sound is emitted, the electronic device 100 vibrates, an indicator light flashes, etc.

The runtime includes the core library and the virtual machine. The runtime is responsible for the scheduling and management of the operating system.

The core library consists of two parts: one is the function that the Java language needs to call, and the other is the core library of the operating system. The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection.

The system library can include multiple functional modules, such as surface manager, media framework, three-dimensional graphics processing library (such as OpenGL ES), two-dimensional graphics engine (such as SGL), etc.

The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

The media framework supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media framework can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The three-dimensional graphics processing library is used to implement three-dimensional graphics drawing, image rendering, compositing, and layer processing.

A 2D graphics engine is a drawing engine for 2D drawings.

In some embodiments, the three-dimensional graphics processing library can be used to draw the motion trajectory image of the three-dimensional, and the two-dimensional graphics engine can be used to draw the two-dimensional motion trajectory image. In the embodiment of the present application, based on the collected user image data, the relevant data of the AI body shape can be measured and analyzed. Exemplarily, the relevant data of the AI body shape can be processed by the three-dimensional graphics processing library, so as to obtain the three-dimensional model of the AI body shape.

The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

The hardware layer can include various types of sensors, such as accelerometers, gravity sensors, touch sensors, etc.

Usually, the electronic device 100 can run multiple applications at the same time. In a simpler case, one application can correspond to one process, and in a more complex case, one application can correspond to multiple processes. Each process has a process number (process ID).

It should be understood that the hardware structure of the electronic device 100 can be as shown in Figure 1, and the software system architecture can be as shown in Figure 2, wherein the software programs and/or modules corresponding to the software system architecture in the electronic device 100 can be stored in the internal memory 121, and the processor 110 can run the software programs and applications stored in the internal memory 121 to execute the process of a body shape measurement analysis method provided in an embodiment of the present application.

In order to facilitate understanding of the body shape measurement and analysis method provided by the present application, the implementation process of the method provided by the present application is introduced below in combination with the contents shown in Figures 3a to 19.

In one possible implementation, in some health apps, users can manually input basic body parameters, such as height, weight, gender, etc., into the app; then, the electronic device can generate a virtual body shape based on the basic body parameters. FIG3a is a schematic diagram of an interface for obtaining a user's body shape. Exemplarily, the electronic device displays an interface 31 to the user, in which the user can select a gender parameter; wherein the electronic device can assist the user in selecting the gender parameter by displaying a virtual character image to the user. After obtaining the gender parameter selected by the user, the electronic device can continue to display an interface 32 to the user, in which the user can select an age parameter. After obtaining the age parameter selected by the user, the electronic device can continue to display an interface 33 to the user, in which the user can select a height parameter and a weight parameter; wherein the electronic device can synchronously adjust the current virtual body shape of the virtual character image in response to the height parameter or weight parameter selected by the user. After obtaining the height parameter and weight parameter selected by the user, the electronic device can continue to display an interface 34 to the user, in which the user can select a target weight parameter; and the electronic device can also display a comparison between the user's current virtual body shape and the target virtual body shape in the interface 34 in response to the target weight parameter selected by the user.

In addition, based on the implementation shown in FIG. 3a, the electronic device can also continue to expand the function of customizing a health plan for the user. For example, FIG. 3b is a schematic diagram of an interface for customizing a health plan. Exemplarily, after obtaining the user's current basic physical parameters and target weight parameters, the electronic device can continue to display interface 35 to the user, in which the user can select some daily habits, such as daily activity level, eating habits, and degree of procrastination. After the user makes corresponding selections in interface 35, for example, the selected daily activity level is "occasionally exercise", the selected eating habits are "only eat until not hungry", and the selected degree of procrastination is "occasionally procrastinate"; the electronic device can also continue to display interface 36 to the user, in which the user can plan to select key parts for training, for example, the chest, abdomen, and buttocks can be selected. After obtaining the daily habits and key parts selected by the user, the electronic device can continue to display interface 37 to the user, in which a matching health plan can be displayed, such as one or a combination of an exercise plan and a diet plan, or another example of a fat loss speed plan, etc.; in addition, in interface 37, the user can also manually adjust the health plan. Finally, the electronic device can generate a target health plan, as shown in interface 38, and can be displayed in the home page of the APP and other interfaces.

However, in this implementation, the APP generates a virtual body shape based on the basic parameters manually input by the user. Although this can improve the liveliness of health APPs, the virtual body shape is single and cannot accurately reflect the user's real body shape.

In another possible implementation, in other health apps, body data can be obtained by combining manual recording and body scanning, and body data measurement and analysis can be performed. For example, FIG4 is a schematic diagram of an interface of a body scanning process. Exemplarily, the electronic device can display interface 41 to the user, in which the user can enter height parameters and weight parameters. After obtaining the height parameters and weight parameters entered by the user, the electronic device can continue to display interface 42 to the user, in which the user can adjust the volume of the guide voice. Then, the electronic device can continue to display interfaces 43 to 45 to the user, in which interfaces 43 to 45 can display the guide page of the body scanning process to the user. For example, in interface 43, a guide page on how to dress is displayed; in interface 44, a guide page on how to place the electronic device is displayed; in interface 45, a guide page on how to stand is displayed. After detecting that the user has determined to read the operation instructions of the guide page, the electronic device can continue to display interfaces 46 to 48 to the user, and the basic image data of the body can be collected in interfaces 46 to 48. For example, in interface 46, a calibration prompt for placing the electronic device can be displayed to place the electronic device in a suitable position; in interface 47, the real-time collected frontal body image data and the finally obtained frontal body image frame can be displayed; in interface 48, the real-time collected side body image data and the finally obtained side body image frame can be displayed. It can be seen from this implementation that, on the one hand, the user needs to manually adjust the volume during each acquisition process, which is cumbersome to operate; on the other hand, this implementation only performs unilateral calibration, which may cause inconvenience in image data acquisition.

In addition, based on the implementation shown in FIG. 4 , the electronic device also needs to continue to manually calibrate the detailed parameters of the body. For example, FIG. 5 is a schematic diagram of a manual calibration interface. Exemplarily, after acquiring the front body image frame and the side body image frame, the electronic device can continue to acquire the local part shooting images that need to be manually calibrated according to the preset local acquisition conditions, such as displaying interfaces 49 to 51 to the user. Among them, in interface 49, the user is guided to continue to collect the local shooting image of the front ankle; in interface 50, the user is guided to continue to collect the local shooting image of the back knee; and in interface 51, the user is guided to continue to collect the local shooting image of the right waist. Based on the acquired front body image frame, side body image frame and multiple local shooting image data, the electronic device can generate the user's analysis results, and display the interface containing the data display results to the user, for example, interface 52a displays the data display results for men, and interface 52b displays the data display results for women. Although this implementation method can improve the accuracy of the analysis of body data, it can be seen from FIG. 5 that this implementation method still requires a large number of manual calibration operations, and the data display results obtained by this implementation method are displayed in 2D, which cannot reflect the user's body shape.

In view of this, an embodiment of the present application provides a body shape measurement and analysis method. Based on the collected user data, the method performs deep learning through a deep network model to obtain a human body mesh model; wherein the collected user data may include but is not limited to: basic body parameters, body scan image data. Then, based on the human body mesh model, the user's body shape can be analyzed to output an AI body shape that better reflects the user's real body shape. Therefore, this method can realize the modeling of the user's body shape, which can provide more accurate On the other hand, the AI body measurements can also reduce the complexity of user operations, thereby improving the user experience.

The method provided in the embodiments of the present application can be applied to any APP in any health management scenario, so that users can perform health checks through the corresponding APP; or, it can also be applied to APPs in shopping scenarios, so that users can try on clothes through the corresponding APP and get a better shopping experience; or, it can also be applied to other scenarios that require body measurement. The present application does not limit the specific application scenarios of the method.

Exemplarily, the user can implement the body measurement method provided in the embodiment of the present application through a health APP. Taking a sports health APP as an example, an entrance for triggering body measurement can be configured in multiple display interfaces of the sports health APP, for example, a body measurement entrance can be configured in a weight management interface, a home page interface, an exercise plan interface, etc.; wherein the body measurement entrance can be implemented by, but not limited to, cards, shortcuts, icons, user voice commands, etc.

In another exemplary embodiment, the user may also implement the method provided in this application through a dedicated body measurement APP or other types of APPs, such as camera APPs, shopping APPs, etc.

The following uses the electronic device as a mobile phone and its application in a health management scenario as an example, and describes the technical solution of the present application in conjunction with the accompanying drawings. For example, the body measurement analysis method provided in the embodiment of the present application can be divided into but not limited to the following stages: body measurement initiation stage, body measurement preparation stage, body measurement stage, and body analysis stage. These stages are introduced below:

1. Body measurement initiation stage

Exemplarily, FIG6 is a schematic diagram of an interface for initiating body measurement provided in an embodiment of the present application. Taking the weight management interface included in the sports health APP as an example, as shown in interface 61 in FIG6 , in addition to weight management data such as weight data and weight management tools, the weight management interface may also include a service card 610 for indicating the entrance to body measurement. If the mobile phone detects a user operation on the service card 610 in interface 61, in response to the user operation, an interface about the preparation stage of body measurement, such as interface 62, is displayed. Among them, the user operation on the service card 610 may be, for example, a click operation, a double-click operation, a long press operation, or a voice command, and the embodiment of the present application does not limit the specific implementation method of the user operation.

(II) Preparation stage for body measurement

In order to ensure more accurate body measurement results, it is usually necessary to perform some preparatory work to assist in the body measurement, such as obtaining the user's basic body parameters, displaying the body measurement guidance interface, adjusting the volume, and adjusting the device placement method involved in the following embodiments. By preparing for body measurement, the efficiency and accuracy of body measurement can be improved. Exemplarily, the mobile phone can first obtain some basic body parameters of the user; for example, it can read from pre-stored data or other data sources, or guide the user to input, etc. For example, basic body parameters can be stored in the sports health APP, and the electronic device can be directly reused in the process of body measurement.

In a possible embodiment, the mobile phone may guide the user to click the "manual input" control 620 in the interface 61 to jump to the display interface for manually inputting the weight parameter. The basic body parameters of the user stored in the mobile phone can be manually input by the user. Optionally, the mobile phone may display at least one basic body parameter input interface to the user, and the user may manually input the height parameter and/or weight parameter in the at least one input interface. For example, the mobile phone may instruct the user to input the height parameter in one input interface and instruct the user to input the weight parameter in another input interface, or for example, the mobile phone may also instruct the user to input the height parameter and the weight parameter separately in one input interface.

In another possible embodiment, the mobile phone can also guide the user to click the "measure weight" control 630 in the interface 61 to jump to the display interface for selecting other APPs or connected smart scales to request synchronization of weight parameters, or jump to the display interface for prompting the user to "Please weigh". Optionally, in the display interface after the jump, a synchronization control may be included; wherein the synchronization control is used to request synchronization of weight parameters from an associated weight APP or a connected smart scale. In addition, in addition to obtaining weight parameters from a smart scale, the mobile phone can also obtain other basic body parameters such as height parameters stored by the user from the smart scale. The embodiment of the present application does not limit the source of the basic body parameters of each user stored in the mobile phone. It should be understood that the basic body parameters of the user may include multiple parameters, and the sources of different parameters may be different. For example, the height parameter may be manually entered by the user, and the weight parameter may be obtained through a smart body fat scale.

It should be noted that, although the introduction of the embodiment of the present application is based on first acquiring the basic body parameters of the user, it should be understood that the process of acquiring the basic body parameters and the process of displaying the body measurement guidance interface and the process of adjusting the volume described below belong to different body measurement preparations, and the execution order of these preparations is not limited when the present application is implemented. For example, the body measurement guidance interface can be displayed first, and then the process of acquiring the basic body parameters can be executed.

For example, after obtaining the basic physical parameters of the user based on interface 61, the mobile phone may continue to display the interface shown in FIG. Interface 62 may include step instructions for instructing the user on how to photograph the body; some step instructions may also be introduced in combination with example diagrams, for example, the step instructions and example diagrams of some steps shown in interface 62 may include:

Step 1: Keep your whole body uncovered, wear close-fitting clothing, and tie your hair up.

Step 2: The device is kept at a preset distance from the body; the device height is at a preset height position. For example, the preset record may be 2 meters (m), and the preset height position may be a position near the waist. As shown in interface 62, an example diagram corresponding to step 2 may also be displayed to facilitate the user to more intuitively determine the specific operation of performing body measurement.

Step 3: Place your body in the human-shaped frame and take front and side photos of yourself according to the voice prompts. As shown in interface 62, a sample image corresponding to step 3 may also be displayed.

It should be noted that the mobile phone can display the body measurement guide page according to a preset display mode. Exemplarily, the preset display mode may include but is not limited to the following modes:

Method A: The body measurement guidance interface is displayed when the user performs AI body analysis for the preset number of times. For example, when the user uses the AI body analysis function for the first three times, the body measurement guidance interface is displayed to the user, and starting from the fourth time, the guidance interface is no longer displayed.

Mode B: During the first AI body shape analysis in each preset period, the body shape measurement guidance interface is displayed. For example, during the first AI body shape analysis in each month, the body shape measurement guidance interface is displayed.

Method C: When the mobile phone displays the body measurement guidance interface, it asks the user whether to continue to remind him/her in the future. If the user chooses not to remind him/her again, the body measurement guidance interface will not be displayed next time the user performs AI body analysis.

In this way, by displaying the body measurement guidance interface in a preset display mode, the complexity of the user's multiple AI body analysis operations can be reduced. In addition, when the mobile phone determines not to display the body measurement guidance interface, it can also display a control for viewing the body measurement guidance interface in any interface during the AI body analysis process. In this way, if the user needs to view the body measurement guidance interface again, the user can click the control to display the body measurement guidance interface.

After the mobile phone detects a click operation on the "start shooting" control 640 in the interface 62, in response to the click operation, the next preparation process of the body measurement preparation stage can be performed, for example, the volume adjustment process, which is displayed as the interface 63 in FIG. 6 .

Exemplarily, in interface 63, if the mobile phone detects that the volume is 30%, a volume adjustment progress bar can be displayed in interface 63, and the user can be reminded in text that "the recommended volume is ≥ 50%". Alternatively, the mobile phone can also ask the user "whether to adjust the volume automatically" by displaying a pop-up window. If it is detected that the user selects "yes", in response to the user's selection, the volume of the mobile phone is automatically adjusted to a preset volume value, such as 75%. In addition, although the volume adjustment method displayed in interface 63 is manually adjustable by the user, when the present application is implemented, the mobile phone can also detect the user's preset settings for the AI body shape analysis function. Among them, the preset settings may include an automatic volume adjustment function, in which case the mobile phone can directly adjust the volume to the preset volume value without displaying interface 63 to the user; and the preset volume value can only take effect during the AI body shape analysis process, and the original volume value can be restored after the AI body shape analysis process is detected to be completed. Alternatively, in another possible scenario, if the mobile phone detects that the mobile phone is connected to an audio playback device such as headphones or speakers, it can be defaulted that no volume adjustment is required.

The mobile phone detects the user operation on the "next step" control 650 in the interface 63, and can continue to execute the device calibration process in the body measurement preparation stage, which is displayed as the interface 64 in FIG6. Optionally, the mobile phone can detect the current posture of the mobile phone through sensors such as the gravity sensor 180A and the gyroscope sensor 180B. Then, the mobile phone can display the first logo in the interface 64 according to the current posture of the mobile phone, and display the second logo according to the target posture of the mobile phone; through the relative position relationship between the first logo and the second logo, it is determined that the mobile phone is placed in a suitable posture; it can be understood that if the relative position relationship between the first logo and the second logo is displayed as a preset relationship, it can be determined that the mobile phone is placed in a suitable posture. As shown in the interface 64 in FIG6, the first logo can be displayed as a flower, and the second logo can be displayed as a branch, such as the text prompt in the interface 64 "Placing the device upright for more accurate shooting, please adjust the device angle to make the small flowers complete". It should be understood that the embodiment of the present application does not limit the display mode of the first logo and the second logo. For example, the first logo can also be a small ball and the second logo can be a shark. By adjusting the posture of the device, the small ball falls into the shark's mouth in the interface 64, so that the device can be adjusted to the preset position. In this way, by setting up signs to guide users to adjust the device, the fun can be increased.

In an embodiment of the present application, when the mobile phone performs device calibration, the device calibration can be achieved through 2-axis calibration. Exemplarily, the mobile phone detects the current posture of the mobile phone through sensors such as gravity sensor 180A and gyroscope sensor 180B; then, the pitch angle posture and left-right angle deviation of the current posture relative to the target posture (such as the posture of the mobile phone in a vertical state) are determined. If the mobile phone detects that the current posture of the mobile phone meets the placement conditions, for example, the pitch angle deviation is less than or equal to (≤) the preset pitch angle deviation threshold, and the left-right angle deviation is ≤ the preset left-right angle deviation threshold, then it can be determined that the mobile phone is calibrated within the target posture range; wherein, the preset pitch angle deviation threshold can be 10°, and the preset left-right angle deviation threshold can also be 10°.

In addition, when the user adjusts the placement of the device, the mobile phone can also guide the user to make adjustments through voice commands, such as voice guidance. Guidance instructions may include: "rotate the phone a little to the left", "rotate the phone a little to the right", "rotate the phone a little backward", or "rotate the phone a little forward, etc." It is understood that the phone can generate corresponding voice guidance instructions based on the pitch angle posture and left and right angle deviation of the current posture of the device relative to the target posture.

(III) Body shape measurement stage

Based on the various preparatory work in the body measurement preparation stage, after the required scenarios for various body measurements are determined and set, the body measurement can be entered. Based on the guidance of the device placement adjustment interface 64, the user can be guided to adjust the device position to a device posture that meets the placement conditions, for example, it can be displayed as an interface 64' as shown in Figure 7. In the interface 64', if the mobile phone detects that the current posture of the mobile phone meets the placement conditions, it can automatically jump to the shooting page; in addition, optionally, before jumping to the shooting page, the mobile phone can prompt the user through a pop-up window 660 that the placement of the mobile phone has met the placement conditions.

Exemplarily, in the body measurement stage, the user can be guided to scan the front body image frame (hereinafter referred to as "front view") and the side body image frame (hereinafter referred to as "side view") through multiple shooting pages. As shown in FIG7 , the mobile phone can jump from interface 64' to interface 65a; wherein interface 65a is used to guide the user to take a front view. For example, in interface 65a, a text guide of "place the whole body front view in the human frame" can be included, and a reference outline of the front view can also be included, and a "switch front and rear cameras" control 670 can also be included. In addition, while displaying interface 65a, the user can be guided to stand in the front through voice guidance, for example, the voice guidance instruction can include: "Stand in the front, keep the body in the human frame", "Stand closer to the screen, keep the body in the human frame" or "Stand farther from the screen, keep the body in the human frame". In this way, on the one hand, the user can stand in the front according to the guidance of interface 65a, and on the other hand, the mobile phone can collect image data in real time through camera 193, and display and detect the image data. Optionally, the mobile phone can detect whether the currently collected image data meets the frontal photo shooting requirement by comparing the person in the image data with the frontal photo reference profile in the interface 65a. It should be understood that the frontal photo shooting requirement can be a preset configuration, and the deviation between the portrait profile in the image data and the frontal photo reference profile is less than or equal to a preset deviation threshold.

In another exemplary embodiment, if the mobile phone detects that the requirements for frontal photo shooting are met, it can continue to automatically jump to the display interface for shooting side photos, for example, it can display the interface 65b and interface 65c in Figure 7 to the user in sequence. Among them, interface 65b can be used to prompt the user that the frontal photo is being obtained, and while displaying interface 65b, it can prompt the user that the recognition is in progress through voice prompts, for example, the voice guidance instructions can include: "Recognition in progress, keep the current posture still" and "Voice countdown: 3, 2, 1". Interface 65c can be used to prompt the user that the frontal photo recognition is successful, and while displaying interface 65c, it can prompt the user that the recognition is completed through voice prompts, for example, the voice guidance instructions can include "Front photo recognition is successful". It can be understood that after interface 65c is displayed for a certain preset time, it can automatically jump to interface 67a for shooting side photos.

In addition, during the shooting process, if the mobile phone detects that the mobile phone is unbalanced, the user can be guided to readjust the device, and after the device is adjusted to meet the preset placement conditions, the shooting process can be continued. In a possible scenario, after the mobile phone has taken a frontal photo, the mobile phone is unbalanced during the side photo shooting process, and the interface 66 can be displayed before the display interface 67a. Among them, the interface 66 can display at least one mark for the user to calibrate, such as the first mark indicating the current posture and the second mark indicating the target posture introduced in the above text. In addition, the style of the display mark in the interface 66 can refer to the display method of the interface 64, or the interface 66 can also be displayed in a different manner from the interface 64, for example, the first mark can be a small circle, and the second mark can be a large circle including a cross calibration line. And, when the mobile phone is unbalanced, the user can also be prompted to readjust the device placement angle in combination with a voice prompt, for example, the voice guidance instruction can include "please adjust the device angle so that the dot position is located within the cross circle".

It can be understood that, as shown in FIG. 7 , the mobile phone can jump from interface 65c to interface 67a, or can also jump from interface 66 to interface 67a, which can be determined according to the actual scene. Similar to the frontal photo shooting process, interface 67a is used to guide the user to shoot a side photo. For example, in interface 67a, a text guide of "place the whole body side in the human-shaped frame" can be included, and a side-photo reference outline can also be included, and a "switch front and rear cameras" control 670 can also be included. In addition, while displaying interface 67a, the user can be guided to stand sideways by voice guidance, for example, the voice guidance instruction can include: "Stand sideways, keep the body in the human-shaped frame", "Stand closer to the screen, keep the body in the human-shaped frame" or "Stand farther from the screen, keep the body in the human-shaped frame". In this way, on the one hand, the user can stand sideways according to the guidance of interface 67a, and on the other hand, the mobile phone can collect image data in real time through camera 193, and display and detect the image data. Optionally, the mobile phone can detect whether the currently collected image data meets the side photo shooting requirements by comparing the characters in the image data with the side-photo reference outline in interface 67a. It should be understood that the side view shooting requirement may be a preset configuration, and may be that the deviation between the portrait contour in the image data and the side view reference contour is less than or equal to a preset deviation threshold.

For example, when the mobile phone detects that the side view shooting requirement is met, it can display the interface 67b and the interface 67c shown in FIG7 to the user in sequence. Among them, the interface 67b can be used to prompt the user that the side view is being acquired, and while displaying the interface 67b, the user can be prompted by voice prompts that the recognition is in progress. For example, the voice guidance instruction may include: "Recognition in progress, keep the current posture unchanged" and "voice countdown: 3, 2, 1". Interface 67c may be used to prompt the user that the side view recognition is successful, and while displaying interface 67c, the user may be prompted by voice prompts that the recognition is complete, for example, the voice guidance instruction may include "side view recognition is successful".

(IV) Body shape analysis stage

Exemplarily, FIG8 is a flow chart of obtaining a human body mesh model provided in an embodiment of the present application. In the embodiment of the present application, the mobile phone can obtain the contour data of the body using the portrait segmentation network model 801 according to the front view and the side view; and can also obtain the 2D bone point data using the human body bone point detection model 802 according to the front view and the side view. Then, the mobile phone can use the contour data output by the portrait segmentation network model 801, the 2D bone point data output by the human body bone point detection model 802, and the basic body parameters obtained in the body measurement preparation stage as the input of the body parameter deep network model 803; and, using the body parameter deep network model 803, the weight factors of multiple body parameters can be output. Then, the mobile phone can use the weight factors of multiple body parameters as the input of a human body model (skinned multi-person linear model, SMPL) 804; wherein, the SMPL human body model 804 includes multiple different categories of reference body parameters, for example, including but not limited to: size parameters, obesity parameters. Finally, the mobile phone can process and estimate the weight factor of the body parameter and the reference body parameter through the SMPL human body model 804, and obtain the body parameter of the user; wherein, based on the body parameter of the user, a 3D human body mesh model of the user as shown in FIG8 can be constructed. The body parameter may include but is not limited to: three measurements (chest circumference, waist circumference and hip circumference), limb dimensions (thigh circumference, calf circumference, upper arm circumference and head circumference), and limb length (leg length, wall length and shoulder width).

Exemplarily, the electronic device can further read the user's body parameters based on the 3D human body mesh model, so as to analyze the user's body parameters and obtain the user's body analysis results, so that the body analysis results can be displayed to the user through the display interface. Among them, the body analysis results can be displayed in a variety of ways, for example, the body analysis results can include but are not limited to: AI body loading (loading) image, AI body data. In addition, the body analysis results may include direct results based on the user's body parameters, and may also include indirect results calculated or interpreted based on the user's body parameters. It can be understood that the direct results based on the body parameters can be displayed to the user as AI body data; the indirect results, for example, may include but are not limited to: AI body loading image, other body data in AI body data except body parameters, and may also include AI body result interpretation, and improvement plan for AI body.

For example, FIG9 is a schematic diagram of an interface of a body shape analysis result provided in an embodiment of the present application. In a possible scenario, before obtaining the body shape analysis result, the mobile phone may first display an interface including a reference AI body shape according to the user's gender parameter, for example, interface 68a in FIG9 displays the reference AI body shape corresponding to females, and interface 68b displays the reference AI body shape corresponding to males; and the mobile phone may also prompt the user through text content and/or voice commands that the mobile phone is performing body shape measurement and analysis, such as text content that may be displayed as "measure your body shape" and "please wait, we are analyzing photos and measuring your body shape". Taking the user gender parameter as female as an example, after obtaining the body shape analysis result, the mobile phone may switch to display interface 69 in FIG9. In interface 69, from top to bottom, but not limited to, the loading image of AI body shape, AI body shape data, result interpretation, and improvement plan may be displayed in sequence.

(1) The loading image of the AI body shape can be used to display the user's body shape, so that the user can more intuitively perceive the body shape. Among them, the loading image of the AI body shape can be obtained by adjusting and rendering the reference AI body shape shown in interface 68a based on a 3D human mesh model. For example, the reference AI body shape is adaptively adjusted according to the body shape parameters such as the measurements, limb dimensions, and limb lengths, and the adaptively adjusted reference AI body shape is color rendered to obtain the user's AI body shape. In addition, the loading image of the AI body shape in interface 69.

It should be noted that the embodiments of the present application do not limit the display mode of the reference AI body type, the switching display mode from the reference AI body type to the user AI body type, and the display mode of the user AI body type. For example, the switching display mode from the reference AI body type to the user AI body type may cover the reference AI body type from top to bottom in sequence; for another example, the display mode of the user AI body type may also include a 360° rotation of the user AI body type to achieve an all-round display, etc., and the corresponding display mode may be preset and configured during specific implementation. In addition, the mobile phone may also rotate and display the loading image of the AI body type in response to the user's sliding operation on the loading image of the AI body type.

(2) AI body shape data can be used to display the user's body shape in more detail, so that the user can more accurately obtain the body shape status. In an optional example, as shown in interface 69 in Figure 9, AI body shape data may include body shape parameters, such as waist circumference of 81 cm, chest circumference of 97 cm, hip circumference of 95 cm, upper arm circumference of 30 cm, forearm circumference of 20 cm and thigh circumference of 45 cm; AI body shape data may also include other body shape data indirectly obtained based on body shape parameters, such as a pear-shaped body shape and a waist-to-hip ratio of 0.85. In addition, the mobile phone can indirectly obtain other body shape data by searching for target data matching the body shape parameters from a pre-stored body shape database based on the body shape parameters; taking body shape as an example, the mobile phone searches the pre-stored body shape database based on the user's body shape parameters and finds that the user's target body shape is the pear shape shown in interface 69. The pre-stored body shape database may include but is not limited to the following body shapes: Pear-shaped, symmetrical, apple-shaped, pepper-shaped, triangular, and hourglass-shaped. For example, to facilitate intuitive understanding of each body shape type, FIG10 is a schematic diagram of each body shape type introduced in Table 1 provided in the embodiment of the present application; as can be seen from FIG10, the characteristic of the pear-shaped body shape is that the hip circumference parameter is large.

(3) Result interpretation can be used to display the evaluation of body shape analysis results, so that users can determine the direction of improvement.

Optionally, the pre-stored body shape database may also store result interpretations for various types of body shape data. For example, as shown in interface 69 in FIG9 , the result interpretation corresponding to the pear-shaped body shape may be “The pear-shaped body is mainly composed of peripheral subcutaneous fat, especially fat accumulation in the buttocks and thighs. The formation of the pear-shaped body is related to the large secretion of estrogen, which helps prevent diabetes and is more likely to prolong life.”; the result interpretation corresponding to the waist-to-hip ratio may be “high”; the result interpretation corresponding to the waist circumference may be “high”; and the result interpretations of other types of body shape data shown in interface 69 are not introduced one by one here.

Moreover, the user can also display a more detailed interpretation of the results by performing user operations on the card displayed by the body shape data. Taking the user's operation on the card displayed by the waist-to-hip ratio as an example, the mobile phone responds to the user operation on the waist-to-hip ratio card in interface 69 of FIG. 9 and switches to interface 691; wherein, in interface 691, a more detailed interpretation of the results about the waist-to-hip ratio is displayed, such as the basis for judging the waist-to-hip ratio and the data interpretation, etc. The specific interpretation of the results can be referred to interface 691, which will not be described in detail here. Among them, the user operation on the body shape data display card can be, for example, a click operation, a long press operation, a double-click operation, a gesture operation or a voice command. In addition, in response to the user operation on the waist-to-hip ratio card in interface 69 of FIG. 9, the mobile phone can display it in a pop-up window, a picture-in-picture, or other display modes in addition to switching to the display mode of interface 691.

(4) The improvement plan can be used to more accurately determine the user's improvement direction, allowing the user to manage their body more effectively.

It can be understood that the pre-stored body shape database may store improvement plans for various types of body shape data. For example, a possible improvement plan is shown in the following Table 1:

Table 1 Improvement plan based on body shape data

According to the improvement plan based on body shape data introduced in Table 1, the mobile phone can display the corresponding improvement plan to the user. Exemplarily, as shown in interface 69 in FIG9 , the mobile phone can display a loading image with improvement plan logos, for example, the loading image includes: logos indicating that the exercise parts of the pear-shaped body shape are the abdomen, buttocks and legs, and a logo recommending that the exercise type is mainly aerobic exercise.

(5) Other data. For example, in the interface 69 of FIG. 9 , in addition to the data content described in the above-mentioned embodiment, it may also include but is not limited to the following: a sliding bar 1010 for switching the body shape analysis results of different dates, a control 1011 for manually calibrating the body shape analysis results, and a control 1012 for obtaining a more detailed improvement plan.

5-1) The sliding bar 1010 can be used to switch the display of body shape analysis results of different dates in the interface 69. For example, the body shape analysis results of September 24 are currently displayed in the interface 69. In response to the user's sliding operation on the sliding bar 1010, the mobile phone can also switch to display the body shape analysis results of September 20. It should be understood that the body shape analysis results of September 20 are compared with the body shape analysis results of September 24, and the AI body shape loading, AI body shape data, result interpretation, and improvement plan are switched accordingly.

It can be understood that when the body shape analysis results of the corresponding date are stored in the mobile phone, the user can switch the display by sliding the horizontal bar 1010; if the body shape analysis results of the corresponding date are not stored, the user can be prompted that there is no body shape data for the date by, for example, a pop-up window or a display interface when switching the display. Optionally, in order to facilitate the user to intuitively determine which dates have stored body shape analysis results, different date labels can be indicated to the user through different display states; for example, in interface 69, the display state of the label corresponding to the date with stored body shape analysis results is bold and underlined, and the display state of the label corresponding to the date without stored body shape analysis results is not bold and not underlined.

5-2) Control 1011 can be used to manually calibrate the body shape parameters in the body shape data included in interface 69. In a possible scenario, FIG. 11 is a schematic diagram of an interface for manually calibrating the body shape analysis results provided by an embodiment of the present application. In interface 70 as shown in FIG. 11, the user can manually adjust body shape parameters such as chest circumference, waist circumference, arm circumference, and upper arm circumference. The mobile phone responds to the user in interface 70. The body shape analysis results are updated and displayed as interface 69a in FIG11 after multiple manual calibration operations and save operations are performed. Compared with interface 69 in FIG9 , in interface 69a in FIG11 , the loading image of the user's AI body shape is adaptively adjusted, and the AI body shape data, result interpretation, and improvement plan are updated accordingly. In this way, through the automatic measurement of the mobile phone and the manual calibration of the user, AI body shape measurement analysis can be achieved more accurately.

5-3) Control 1012 can be used to obtain a more detailed improvement plan. The more detailed improvement plan may include, for example, a planned exercise time, a planned exercise cycle, a planned exercise part, and a planned exercise method, etc. The specific implementation method will be described in detail later and will not be described here.

In addition, based on the body shape analysis results obtained in the above embodiments, the embodiments of the present application may also include the following scenarios:

Scene 1, display of body shape analysis results. Exemplarily, the body shape analysis results can have a variety of display scenes. Optionally, it can be displayed after the AI body shape measurement process ends, such as the display scenes of interfaces 61 to 69 in the aforementioned embodiments. Another option is that similar to the display scene of the body shape measurement entrance, the body shape analysis results can also be displayed in multiple display interfaces of the sports health APP, such as the weight management interface, the home page interface, the exercise plan interface, etc. In addition, the body shape analysis results can also be displayed in association with the body shape measurement entrance. For example, in the relevant interface of the body shape measurement entrance, historical body shape analysis results can be included, such as the display shown in interface 69 by sliding the horizontal bar 1010. For another example, in the relevant interface of the body shape analysis results, a body shape measurement entrance can also be included, such as the "AI body shape analysis" control 1203 included in the interface 12b in Figure 12 to be introduced in the following embodiments. In this way, by displaying the body shape analysis results in different display scenes, it is convenient for users to check the body shape analysis results more conveniently.

Based on the scenario where the mobile phone stores multiple AI body measurement results, in the embodiment of the present application, the multiple body analysis results can also be displayed in different display modes. For example, the display mode may include but is not limited to the daily view display, the weekly, monthly and annual view display. The following still takes the display of body analysis results in the weight management interface as an example, which may include the following display modes:

Mode A, daily view display. For example, FIG. 12 is a schematic diagram of an interface for displaying body shape analysis results provided in an embodiment of the present application. In the daily view of the weight management interface, in addition to the weight data and body composition data related to the current date, the body shape analysis results related to the current date may also be included, such as the content displayed by the card 1200 in the interface 12a; wherein the body composition data may be data obtained from the smart body fat scale, and may include body score, BMI, fat rate, bone weight and other data. It should be understood that in the interface 12a, in order to avoid affecting the viewing of other displayed contents in the weight management interface, the body shape analysis results may be displayed in a preset folded state, for example, part of the AI body shape data may be displayed. In addition, the mobile phone may also respond to the user operation of unfolding the body shape analysis results, and display the interface 12b in FIG. 12; wherein, in the interface 12b, the card displaying the body shape analysis results may be in an unfolded state, and may include more detailed analysis results. The specific content included in the body shape analysis results may refer to the introduction to the interface 69, which will not be repeated here. Exemplarily, the user operation for expanding the body shape analysis result may be, for example, a click operation, a long press operation, or a voice command on the control 1201 for displaying more analysis results in the interface 12a.

As shown in interface 12b, the body composition data may also include, but is not limited to, data such as visceral fat level, body shape, and waist-to-hip ratio. Exemplarily, in a scenario where the body composition data and the body shape analysis results include the same type of data, such as the body shape and waist-to-leg ratio included in interface 12, in an embodiment of the present application, the same type of data may also be merged and calibrated so that the same numerical value can be displayed. It can be understood that the implementation methods for obtaining the body composition data and the body shape analysis results are different in the embodiments of the present application. Therefore, if the body composition data and the body shape analysis results include the same type of data, there may be deviations in the numerical results. In this scenario, for the first preset type of data, the numerical results included in the body shape analysis results can be synchronized to the body composition data; and for the second preset type of data, the numerical results included in the body composition data can be synchronized to the body shape analysis results. Among them, the first preset type of data is used to indicate that the confidence of the numerical result obtained based on the AI body shape measurement analysis is greater than the data of the numerical result obtained based on the intelligent body fat scale, such as the waist-to-hip ratio, body shape and other body shape related data; the second preset type of data is used to indicate that the confidence of the numerical result obtained based on the AI body shape measurement analysis is less than or equal to the numerical result obtained based on the intelligent body fat scale, such as the body composition related data such as fat rate and BMI. In addition, in interface 12b, the mobile phone can also indicate to the user that the data is the data of the body composition data and the body shape analysis result combined and calibrated through prompt information in the form of control 1202; for example, in interface 12b, the body shape and waist-to-hip ratio display control 1202 included in both the body composition data and the AI body shape data, after the user clicks the control 1202, a prompt pop-up window 1203 can be displayed, and the content included in the prompt pop-up window can be, for example, "This data is the result of the body shape analysis result and the body composition data combined and calibrated".

It should be understood that in the interface 12a or interface 12b shown in FIG. 12, there is also a switch control for switching between displaying the weight management interface of the previous day and displaying the weight management interface of the next day. The mobile phone can switch to display the weight management interface of other dates in response to the user operation of the switch control. Among them, the weight management interface of each date displays the body composition data and/or body shape analysis results obtained on the corresponding date. It can also be understood that for any date, body composition data or body shape analysis results may be stored. The present application does not limit this; the different display effects under different dates can be found in FIG12, and the present application will not describe this in detail.

Mode B, week, month, and year view display. For example, FIG. 13 is another interface schematic diagram for displaying the body shape analysis results provided in an embodiment of the present application. The difference from mode A is that the display of various data in mode B is determined according to the time window; wherein the time window can be, for example, a week, a month, or a year. With respect to the body shape analysis results that are the focus of the embodiment of the present application, interfaces 13a and 13b of FIG. 13 are introduced using the time window of a week as an example, and the display method of the body shape analysis results can refer to the introduction in mode A; the difference is that each data item of the body shape analysis results displayed in interfaces 13a and 13b of FIG. 13 is the daily average data of the current week (such as September 18-September 24). For example, the loading image of the AI body shape displayed in interface 13b can be calculated based on the daily average body shape parameters, and the AI body shape data, result interpretation, etc. can be displayed based on the daily average data results.

In addition, if the time window is a month, the mobile phone can display interface 13a and interface 13b according to the daily average data, or it can display interface 13a and interface 13b according to the weekly average data; if the time window is a year, the mobile phone can display interface 13a and interface 13b according to the daily average data, or it can display interface 13a and interface 13b according to the weekly average data, or it can display interface 13a and interface 13b according to the monthly average data. This application does not limit this.

In addition, in the embodiment of the present application, when the AI body loading image is displayed, a sliding control 1300 can also be displayed to the user; wherein the sliding control 1300 allows the user to switch to display the AI body images corresponding to different weeks. In this way, it is convenient for the user to intuitively view the changes in body shape.

Based on the display method of the body shape analysis results introduced in method A or method B, in a possible scenario, the user can also perform user operations on the card displaying AI body shape data to display more detailed body shape data. Taking the display method using the daily view introduced in Figure 12 as an example, Figure 14 is another interface schematic diagram for displaying body shape analysis results provided by an embodiment of the present application. Exemplarily, the mobile phone can display interface 12c in response to the user operation of the card displaying the waist-to-hip ratio included in interface 12a; wherein interface 12c includes more detailed data about the waist-to-hip ratio, for example, it can include judgment criteria, data trends for waist-to-hip ratio data determined in combination with historical body shape analysis results, and interpretation of the results obtained for the waist-to-hip ratio data, improvement plans, or ideal waist-to-hip ratio, etc. The present application does not limit the specific content of the more detailed data displayed. In addition, interface 12c and interface 691 introduced in the aforementioned embodiment may be different display modes for body shape analysis results in different display scenarios, and interface 12c and interface 691 may be interchangeable; or, they may be displayed as the same interface in different display scenarios, for example, after the user clicks on the card displaying waist-to-hip ratio in interface 69, interface 12c may also be displayed.

In another possible scenario, similar to the principle that the user can perform user operations on the card displaying AI body shape data, in the embodiment of the present application, a body shape parameter label can also be displayed in the loading image displaying AI body shape to display the predicted AI body shape for a certain body shape parameter. Refer to Figure 15, which is another interface schematic diagram of the display body shape analysis structure provided in the embodiment of the present application. In the interface 15a1 in Figure 15, around the loading image of the AI body shape, a label 1511a for displaying weight data can be included. If the mobile phone detects a user operation on the label 1511a, it can switch to the display of the interface 15b1. Among them, the difference between interface 15b1 and interface 15a1 lies in the different prompt cards 1510 displayed. It can be seen that the prompt card 1510 of interface 15a1 is used to indicate that the current interface displays the current AI body type, while the prompt card 1510 of interface 15b1 is used to indicate that the current interface displays the predicted AI body type, and in interface 15b1, a sliding bar 1512 can also be included. The sliding bar 1512 can be used to select different target weights to achieve the loading image of the AI body type to be adjusted accordingly according to the selected target weight, so that it can be displayed as a predicted AI body type; in addition, in the sliding bar 1512, the user's current weight can also be indicated by a black dot, so that the user can intuitively determine the comparison between the current weight and the target weight. Another optional implementation method of displaying interface 15b1 can also be that the mobile phone responds to the user operation of the "predicted body type" control included in the prompt card 1510 in interface 15a2 of Figure 15.

It can be understood that in interface 15b1 in FIG. 15 , around the loading image of the AI body type, there can also be included a label for displaying the three measurements, such as a label 1511b for displaying the chest measurement data. If the mobile phone detects a user operation on the label 1511b, it can be switched to interface 15c. Wherein, interface 15c is different from interface 15b1 in that the displayed prompt card 1510 is different. It can be seen that the prompt card 1510 of interface 15c is used to indicate that the current interface displays the predicted three measurements, and in interface 15c, there can also be included a sliding bar 1513, which can be used to select different target three measurements, so that the three measurements of the loading image of the AI body type are adjusted accordingly according to the selected target three measurements, so that it can be displayed as the predicted three measurements; in addition, in the sliding bar 1513, the user's current three measurements can also be indicated by a black dot, so that the user can intuitively determine the comparison between the current three measurements and the target three measurements; and different three measurements can correspond to different sliding bars 1513, for example, the sliding bar corresponding to the chest measurement is displayed in interface 15c. Alternatively, the display interface 15c may be implemented by the mobile phone responding to a user operation on a “predicted measurements” control included in the prompt card 1510 in the interface 15b2 of FIG. 15 .

The slidable range of the sliding bar 1512 or the sliding bar 1513 may be pre-configured, and may be a value range obtained based on basic physical parameters of the user, such as a minimum weight and a maximum weight.

Scenario 2: Combination of body measurement analysis and improvement plan. In a possible scenario, FIG. 16 is a schematic diagram of an interface of a body measurement analysis method provided in an embodiment of the present application. Based on the introduction in the aforementioned embodiment, the body analysis result obtained in the embodiment of the present application may include an improvement plan. For example, interface 1601 in FIG. 16 is a display interface of a body analysis result, and interface 1601 includes a "get improvement plan" control 1012; wherein control 1012 can be used to determine a more detailed improvement plan. Exemplarily, the mobile phone displays interface 1602 in response to the user operation of control 1012; wherein interface 1602 includes a more detailed improvement plan, for example, it may include but is not limited to one or a combination of the following plans: "recommend your weight loss parts", "recommend weekly exercise days", "whether other sports courses need to be added to the plan" and "set training day reminder time", and the specific plan content can refer to the content shown in interface 1602.

Optionally, the content displayed in interface 1602 may be a reference improvement plan generated by the mobile phone based on the body shape analysis results and the body shape database, and the mobile phone may also receive the user's modification of any improvement plan. Taking the user modifying the plan of "recommended weight loss parts" as an example, the mobile phone displays interface 1603 in response to the user's operation on the card displaying "recommended weight loss parts"; wherein interface 1603 is used to modify the plan of "recommended weight loss parts", for example, it may include the whole body parts of the human body, and the user may realize the attention or cancellation of the part by the user operation on a certain part. For example, it can be seen from interface 1602 that the automatically generated plan focuses on the abdomen and back. In interface 1603, the user can click the "abdomen" control to cancel the attention on the abdomen. Finally, the mobile phone displays interface 1604 in response to the user operation on interface 1603 for confirming the modification plan; wherein interface 1604 is the final generated user body shape improvement plan, and the specific improvement plan can be referred to as shown in interface 1604, which will not be repeated. Optionally, in addition to displaying the specific improvement plan, interface 1604 may also display content indicating the predicted body shape analysis results, for example, a comparison between the loading image of the current AI body shape and the loading image of the predicted AI body shape, predicted AI body shape data, and predicted results.

In addition, in the embodiment of the present application, in addition to generating an improvement plan based on the weight loss parts in interface 1603, an improvement plan can also be generated based on other factors or in combination with other factors. Other factors may be, for example, exercise type (including but not limited to fat loss, body shaping, and muscle gain).

In another possible scenario, FIG17 is a schematic diagram of an interface of a body shape measurement analysis method provided in an embodiment of the present application. The method provided in the present application can also be applied to an application scenario of assisting in determining or adjusting an improvement plan. For example, the interface 1701 shown in FIG17 is a setting interface for a user to generate an improvement plan, and the interface 1701 may include a "directly generate" control 1711 and an "AI body shape analysis" control 1712. Among them, the control 1711 is used to indicate that an improvement plan can be directly generated based on the setting of the interface 1701, and the control 1712 is used to indicate that in the scenario of generating an improvement plan, the setting of the interface 1701 and the results of the AI body shape measurement analysis can be combined to obtain an improvement plan. It can be understood that by combining the AI body shape measurement analysis, the accuracy of generating an improvement plan can be improved.

Exemplarily, in response to the user operation on the control 1712, the mobile phone can display an interface for starting the AI body shape measurement analysis process, such as the interface 62 introduced in the above embodiment. Through the AI body shape measurement analysis of the interface 62 to the interface 69, the interface 1601 for displaying the body shape analysis result can be obtained. It can be understood that in response to the user operation on the control 1012 on the interface 1601, the mobile phone can generate an improvement plan, or if the mobile phone has a historical improvement plan stored, the improvement plan can be changed. Among them, the implementation process of generating the improvement plan can refer to the content introduced in Figure 16, which will not be repeated here.

Scenario three, setting target body shape. In a possible scenario, FIG. 18 is a schematic diagram of an interface of a body shape measurement and analysis method provided in an embodiment of the present application. As shown in interface 1801 in FIG. 18, in a scenario where a user sets a target weight through a weight management interface, the mobile phone responds to a user operation on a "set target" control 1810 included in interface 1801, and displays interface 1802; wherein interface 1802 is used to indicate a setting interface for a target weight, for example, the setting interface may include but is not limited to the following: weight management type (such as weight loss, weight gain, and weight maintenance), target weight value, and expected completion date. Then, the mobile phone responds to a user operation in interface 1802 for indicating that the setting is completed, and displays interface 1803; wherein interface 1803 may be used to display the weight management progress generated according to the set target weight, and may also include a card 610 for triggering AI body shape measurement and analysis. In response to a user operation on card 610, the mobile phone may execute an AI body shape measurement and analysis process, and the process may refer to the contents shown in interfaces 62 to 67c introduced in the aforementioned embodiment, which will not be repeated here. In this scenario, the mobile phone responds to the event that the side photo collection is completed and continues to display interface 1804; wherein, the difference between interface 1804 and interface 69 in the previous text is that, in the scenario of target weight management, the comparison between the loading image of the current AI body shape and the loading image of the predicted AI body shape can be displayed, and the predicted AI body shape data, the interpretation of the predicted results, and the predicted improvement plan can be displayed. For example, in interface 1802, the estimated completion date is set to October 31, so the loading image of the predicted AI body shape, the predicted AI body shape data, the interpretation of the predicted results, and the predicted improvement plan on October 31 can be included in interface 1804.

In another possible scenario, FIG. 19 is another interface schematic diagram of a body shape measurement and analysis method provided in an embodiment of the present application. Based on the scenario of setting a target weight introduced in the scenario shown in FIG. 18, the target weight can also be managed in this scenario. As shown in interface 1901 in FIG. 19, the mobile phone can display interface 1902 in response to a user operation on a "manage target" control 1910 included in interface 1901. Among them, interface 1902 is used to indicate the progress of weight management obtained according to the target weight, for example, it can include but not be limited to the progress of the target duration, the progress of cumulative weight loss, the curve chart of weight data, and the comparison between the current AI body shape and the predicted AI body shape. It can be understood that by viewing the progress of weight management on different dates, different progress can be seen. For example, as shown in interface 1903, the progress data of weight management dated October 15th is updated accordingly in interface 1903 compared with interface 1902, and the comparison of AI body shape can be the comparison between the latest AI body shape stored in the mobile phone and the predicted AI body shape, for example, the latest AI body shape can be the AI body shape measured on October 15th. Therefore, through the visualization of the progress tracking of AI body shape, it is convenient for users to view the changes in body shape more intuitively, so that they can adjust the current goal or set a new goal in time.

In addition, in the embodiment of the present application, with reference to the scenario of setting the target weight, target body shape parameters may also be set, for example, a target waist circumference, a target chest circumference, a target hip circumference, etc. may be set.

It can be understood that the various scenarios introduced above can also be combined with each other, and the implementation of this application is not limited to the above scenarios.

Through the contents introduced in each scenario in the foregoing embodiments, the method provided in this application can improve the accuracy of body shape measurement, thereby generating more accurate body shape analysis results, which can better fit the user's actual body shape.

For ease of understanding, Figure 20 is a flow chart of the body shape measurement and analysis method provided in an embodiment of the present application. It is a summary of the specific embodiments shown in Figures 6 to 19 above. In the following description, a possible interaction process of the embodiment of the present application is described in conjunction with the user interface.

S2001. The mobile phone detects that the user initiates a body measurement operation instruction.

S2002. The mobile phone determines whether there are basic physical parameters of the user within a preset time limit. If it is determined that there are no basic physical parameters of the user within a preset time limit, S2003' is executed; if it is determined that there are basic physical parameters of the user within a preset time limit, S2003 is continued to be executed. The preset time limit range may be a default configuration, or may be manually set by the user, for example, 30 days. Exemplarily, the basic physical parameters of the user may include, but are not limited to, height parameters, weight parameters, etc.

S2003’, the mobile phone guides the user to input various body parameters, and then executes S2003.

S2003. The mobile phone obtains the basic physical parameters of the user.

S2004. The mobile phone displays a body measurement guidance interface to the user. This step is optional.

S2005. The mobile phone determines whether the volume is greater than or equal to (≥) a preset volume threshold. If so, execute S2006; if not, execute S2006'.

S2006', the mobile phone adjusts the volume to a level greater than or equal to a preset volume threshold, and then executes S2006.

S2006. The mobile phone performs device calibration.

S2007, the mobile phone prompts the user to scan the body image, and obtains multiple body images of the user. The specific implementation process of this step can be referred to as shown in FIG21, which is a schematic diagram of a body measurement process provided by an embodiment of the present application. The body image scanning process of the mobile phone may include the following process:

S20071. The mobile phone detects that a preset measurement condition is met and enters the shooting mode. The preset measurement condition may be that based on S2006, it is determined that the device is calibrated to a device posture that meets the placement condition, and then the mobile phone automatically jumps to the shooting mode.

S20072: The mobile phone detects whether it meets the requirements for front-facing photo shooting. If it is detected that it does not meet the requirements, execute S20073'; if it is detected that it meets the requirements, continue to execute S20073.

S20073', the mobile phone determines the user's movement deviation, performs calibration guidance, and then returns to execute S20072 to determine whether the user can meet the requirements for frontal photo shooting after guiding the user to make standing adjustments.

S20073, the mobile phone detects whether it meets the requirements for side-view photography. If it is detected that it does not meet the requirements, execute S20074'; if it is detected that it meets the requirements, continue to execute S20074.

S20074', the mobile phone determines the user's movement deviation, performs calibration guidance, and then returns to execute S20073 to determine whether the side view shooting requirement can be met after guiding the user to make standing adjustments.

S20074: The mobile phone determines that the recognition is successful and obtains the front and side photos. It can be understood that after the mobile phone obtains the front and side photos, it can continue to process the body shape analysis stage to obtain the body shape analysis result of the user.

Continuing to refer to S2008 of FIG. 20 , the mobile phone can generate a human mesh model based on basic body parameters and multiple body images. As shown in the specific embodiment of FIG. 8 , the mobile phone can obtain contour data through the portrait segmentation network model 801 based on multiple body images, and obtain 2D bone point data through the human bone point detection model 802; then the mobile phone can use the basic body parameters, contour data and 2D bone point data as inputs to the body parameter deep network model 803 to obtain the weight factors of the body parameters; then the mobile phone can input the weight factors of the body parameters into the SMPL human model 804, so as to output the human mesh model.

S2009: The mobile phone outputs the body shape analysis result based on the human body mesh model. The acquisition and display method of the body shape analysis result can refer to the introduction of each scene shown in Figures 9 to 19 above.

For example, a possible implementation process of outputting the body shape analysis result by mobile phone can be seen in FIG. 22 , which is an embodiment of the present application. A schematic diagram of a process for obtaining a body shape analysis result is provided. The process may include the following steps:

S2201. The mobile phone calculates and generates a body shape analysis result of this AI body shape measurement analysis.

S2202: The mobile phone determines whether there is any historical body measurement record locally. If it is determined that there is no historical body measurement record, S2203a is executed; if it is determined that there is, S2203b is continued to be executed.

S2203a, the mobile phone generates the current body shape analysis result. In this scenario, the mobile phone can display the body shape analysis result obtained by the current body shape measurement. For example, assuming that the current body shape measurement is performed on September 24, the body shape analysis result obtained on September 24 can be displayed in the interface 69.

S2203b, the mobile phone generates the current and historical body shape analysis results. Compared with the scenario described in S2203a, in this scenario, the mobile phone can not only display the body shape analysis results obtained from the current body shape measurement, but also display the body shape analysis results obtained from each historical body shape measurement. For example, as shown in interface 69 in FIG9 , the user can slide the horizontal bar 1010 to switch the display of the body shape analysis results obtained from each body shape measurement.

S2204: The mobile phone detects a manual calibration operation. For example, the mobile phone calibration operation may be a user operation on the control 1011 included in the interface 69, and the user operation may be, for example, a click operation, a long press operation, a gesture operation, or a voice command.

S2205: The mobile phone generates a new body shape analysis result in response to the manual calibration operation. For example, the mobile phone can adaptively adjust the loading image of the AI body shape, the display of the AI body shape data, etc. according to the body shape data manually input by the user.

In another exemplary embodiment, as shown in interface 12b of FIG12 , after the mobile phone obtains the body shape analysis result, it can also be integrated with the body composition data. Referring to FIG23 , a schematic diagram of the process of displaying the body shape analysis result provided in an embodiment of the present application can include the following process:

S2301. The mobile phone obtains the body shape analysis result of the current date. Exemplarily, the mobile phone may store the body shape analysis result after each AI body shape measurement analysis. Optionally, the mobile phone may call the stored body shape analysis result in response to the user operation of viewing the weight management interface for display.

S2302: The mobile phone determines whether there is body composition data for the current date. If it is determined that there is no body composition data, S2303a is executed; if it is determined that there is, S2303b is continued.

S2303a. The mobile phone presents the current body shape analysis result. In this scenario, the mobile phone can directly display the body shape analysis result of the current date.

S2303b. The mobile phone combines and calibrates the body composition data and the body shape analysis results, and presents the calibrated body composition data and the body shape analysis results. In specific implementation, the mobile phone can determine the calibration method according to information such as the data type. For example, for body composition-related data such as fat percentage and BMI, the mobile phone can calibrate the body shape analysis results according to the body composition data. For another example, for body shape-related data such as waist-to-hip ratio and body shape, the mobile phone can also calibrate the body composition data according to the body shape analysis results.

Through the content introduced in the above embodiments, the method provided in the embodiments of the present application can obtain a human body mesh model based on the measured body image data and the obtained basic body parameters by using the model processing, so as to analyze and obtain the user's body shape data and generate a body shape analysis result. Therefore, the method can reduce the operation complexity of the user's body shape measurement and analysis, and can improve the accuracy of body shape measurement through model processing.

Based on the above embodiments, the present application also provides an electronic device, which includes multiple functional modules; the multiple functional modules interact with each other to implement the functions performed by the electronic device in each method described in the embodiments of the present application. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on specific implementations. For example, steps 2001 to 2009 performed by the electronic device in the embodiment shown in Figure 20 are executed. Or steps 20071 to 20074 performed by the electronic device in the embodiment shown in Figure 21 are executed. Another example is steps 2201 to 2005 performed by the electronic device in the embodiment shown in Figure 22. Or steps 2301 to 2303a, or steps 2301 to 2303b performed by the electronic device in the embodiment shown in Figure 23 are executed.

Based on the above embodiments, the present application also provides an electronic device, which includes at least one processor and at least one memory, wherein the at least one memory stores computer program instructions, and when the electronic device is running, the at least one processor performs the functions performed by the electronic device in each method described in the embodiments of the present application. For example, steps 2001 to 2009 performed by the electronic device in the embodiment shown in Figure 20 are performed. Or steps 20071 to 20074 performed by the electronic device in the embodiment shown in Figure 21 are performed. For example, steps 2201 to 2005 performed by the electronic device in the embodiment shown in Figure 22 are performed. Or steps 2301 to 2303a, or steps 2301 to 2303b performed by the electronic device in the embodiment shown in Figure 23 are performed.

Based on the above embodiments, the present application also provides a computer program product, which includes: a computer program (also referred to as code, or instruction), when the computer program is run, the methods described in the embodiments of the present application are executed.

Based on the above embodiments, the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program (also referred to as code or instruction). When the code or instruction is executed by a computer, the computer executes the present application. The methods described in the examples.

Based on the above embodiments, the present application further provides a chip, which is used to read a computer program stored in a memory to implement the methods described in the embodiments of the present application.

Based on the above embodiments, the present application provides a chip system, which includes a processor for supporting a computer device to implement the methods described in the embodiments of the present application. In a possible design, the chip system also includes a memory, which is used to store the necessary programs and data of the computer device. The chip system can be composed of a chip, or it can include a chip and other discrete devices. It should be understood by those skilled in the art that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

As used in the above embodiments, the term "when..." or "after..." may be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...", depending on the context. Similarly, the phrase "upon determining..." or "if (the stated condition or event) is detected" may be interpreted to mean "if determining..." or "in response to determining..." or "upon detecting (the stated condition or event)" or "in response to detecting (the stated condition or event)", depending on the context.

The present application is described with reference to the flowchart and/or block diagram of the method, device (system), and computer program product according to the present application. It should be understood that each process and/or box in the flowchart and/or block diagram, as well as the combination of the process and/or box in the flowchart and/or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for implementing the functions specified in one process or multiple processes in the flowchart and/or one box or multiple boxes in the block diagram.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device that implements the functions specified in one or more processes in the flowchart and/or one or more boxes in the block diagram.

These computer program instructions may also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and/or one or more boxes in the block diagram.

Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the protection scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

A body shape measurement and analysis method, characterized in that it is applied to an electronic device, the method comprising:

Detecting a first operation instruction initiated by a user to measure body shape;

Prompting the user to input basic physical parameters, and obtaining the basic physical parameters input by the user under the prompt; or reading the basic physical parameters pre-stored by the user;

sequentially displaying shooting interfaces for guiding the user to shoot images of various angles of the body, and shooting images of the user's body at various angles;

constructing a three-dimensional 3D model according to the basic body parameters of the user and images of the user's body at various angles, and obtaining a body shape analysis result of the user according to the 3D model;

The body shape analysis result is displayed, wherein the displayed body shape analysis result includes a first body shape image and various body shape data of the user.
The method according to claim 1, characterized in that the step of constructing a 3D model based on basic body parameters of the user and images of the user's body at various angles comprises:

Inputting the images of the body at various angles into the first model for training to obtain the contour data of the body; and inputting the images of the body at various angles into the second model for training to obtain the skeleton point data of the body;

Inputting the outline data, the skeleton point data and the basic body parameters into a third model for training to obtain weight factors corresponding to various body shape parameters;

The weight factors of the body shape parameters are input into a fourth model for training to obtain the 3D model; wherein the fourth model includes various reference body shape parameters, and the various reference body shape parameters are used to multiply with the corresponding weight factors of the body shape parameters to obtain various body shape parameters of the user, and the various body shape parameters of the user are used to obtain the 3D model.
The method according to claim 1 or 2, characterized in that before sequentially displaying the shooting interface for guiding the user to shoot various angles of the body, the method further comprises:

Displaying a first guidance interface for device calibration; the first guidance interface is used to guide the user to place the electronic device according to preset placement conditions;

It is detected that the placement state of the electronic device in the first guide interface meets the preset placement condition.
The method according to claim 3, characterized in that the first guide interface displays a first identifier and a second identifier, and the first identifier and the second identifier have a first relative position relationship;

The detecting that the placement state of the electronic device in the first guide interface meets the preset placement condition includes:

On the first guide interface, it is determined that the first identifier and the second identifier are changed from having the first relative position relationship to having a second relative position relationship; the second relative position relationship is used to indicate that the placement state of the electronic device meets the preset placement condition.
The method according to any one of claims 1 to 4, characterized in that after detecting the first operation instruction of the user initiating body measurement and before sequentially displaying the shooting interface for guiding the user to shoot various angles of the body, the method further comprises:

A second guide interface is displayed, wherein the second guide interface includes step instructions for guiding the user to photograph various angles of the body.
The method according to any one of claims 1 to 5, characterized in that before sequentially displaying the shooting interface for guiding the user to shoot various angles of the body, the method further comprises:

displaying a third guide interface for adjusting the volume of the electronic device, and detecting that the volume of the electronic device displayed in the third guide interface is adjusted to be greater than or equal to a preset volume value; or,

Determine whether the volume of the electronic device is greater than or equal to the preset volume value.
The method according to any one of claims 1 to 6, characterized in that displaying the body shape analysis result comprises: displaying a first interface including the body shape analysis result; wherein the first interface also includes a switching control for switching dates;

The method further comprises:

In response to a second operation instruction on the switching control in the first interface, a second interface is displayed, the second operation instruction is used to select a specified date, and the second interface includes a body shape analysis result obtained on the specified date.
The method according to claim 7, characterized in that the first interface further comprises a trigger control for triggering manual calibration of the body shape analysis result;

The method further comprises:

In response to a third operation instruction on the trigger control in the first interface, displaying a third interface, wherein the third interface includes a calibration control for manually calibrating the body shape analysis result;

In response to a fourth operation instruction on the calibration control, the first interface is updated; the updated first interface includes the first body shape image and at least one body shape data after being calibrated based on the fourth operation instruction.
The method according to claim 7 or 8, characterized in that the first interface further includes a card of the first body shape data;

The method further comprises:

In response to a fifth operation instruction on the card of the first body shape data, displaying a fourth interface, wherein the fourth interface includes preset information related to the first body shape data;

The preset information is information obtained from a preset body shape database based on the first body shape parameter; the first body shape parameter is any one of the various body shape parameters.
The method according to any one of claims 1 to 9 is characterized in that the images at various angles of the body include: a front view of the body and a side view of the body.
The method according to any one of claims 1 to 10, characterized in that the body shape analysis result also includes a second body shape image, and the second body shape image is obtained based on preset body shape parameters.
An electronic device, characterized in that it comprises at least one processor, wherein the at least one processor is coupled to at least one memory, and the at least one processor is used to read and execute a computer program stored in the at least one memory so that the method as claimed in any one of claims 1 to 11 is executed.
A computer-readable storage medium, characterized in that instructions are stored in the computer-readable storage medium, and when the instructions are executed on a computer, the computer is caused to execute the method according to any one of claims 1 to 11.
A computer program product comprising instructions, characterized in that when the computer program product is run on a computer, the computer is caused to execute the method according to any one of claims 1 to 11.