KR20230082523A - Apparatus and method for measuring size of part of body - Google Patents

Abstract

According to various embodiments of the present disclosure, the present invention relates to a device and a method for measuring a body size for a subject on the basis of a planar image of the subject and a measured value of a LiDAR sensor. To this end, an electronic device collects depth information in an image on the basis of the image of a subject and preset measurement points, and can identify a plurality of preset reference points for the subject included in the image. The electronic device can acquire coordinate value and depth information on reference measurement points corresponding to the identified reference points among the preset measurement points and auxiliary measurement points located on measurement lines provided by the identified reference points, and acquire a body size of the subject corresponding to each of the measurement lines using the coordinate value and depth information acquired to correspond to the reference measurement points and the auxiliary measurement points. Various other embodiments are possible. Therefore, the freedom of a photographing angle can be provided.

Description

Apparatus and method for measuring body size {APPARATUS AND METHOD FOR MEASURING SIZE OF PART OF BODY}

The present disclosure relates to an apparatus and method for measuring a body size using a light detection and ranging (LiDAR) sensor in an electronic device.

Body shape information of the human body is used in various industrial fields such as clothes, desks, or chairs. For example, the Korean human body standard information database established by the National Agency for Technology and Standards is being used to develop products suitable for Korean body types. Body shape information of the human body is widely used in the medical field. In particular, it is known that body size information such as the waist-hip circumference ratio provides useful information in identifying and predicting obesity-related or cardiovascular diseases. In oriental medicine, when diagnosing Sasang constitution, body type information such as head, neck, chest, waist, and hip circumference along with personality, behavior, and facial shape are used as important indicators to determine constitution.

In a traditional way, the body shape can be measured using a horizontal ruler or a tape measure, but errors may occur depending on the skill of the measurer. Alternatively, body dimensions may be measured based on a two-dimensional image taken by a camera. When measuring a body size based on a 2D image, the electronic device may measure the body size considering a distance between specific positions of the body, such as both shoulders or both waists. However, when measuring the body size based on the 2D image, an error may occur between the body size measured by the electronic device and the actual body size because the distance between the camera and the subject is not considered. In addition, in the case of measuring body dimensions based on a 2D image, there may be a limitation that camera shooting angles for obtaining 2D images of different poses, such as front, side, or back, should match as much as possible.

Body shape information of the human body is widely used in medicine and various industries, but there is a steady demand for simple, accurate and reproducible measurement methods. In particular, the infrastructure and/or platform based on metabus technology, which allows the telecommunications industry to provide various services in power generation or virtual space regardless of speed or location, is a platform for activating non-face-to-face services such as online shopping. based on it. However, in the case of non-face-to-face services, for example, when using online shopping, consumers cannot try on clothes directly, so it may be difficult to recognize the size that suits them for each brand or various types such as shirts, jackets or pants. there is.

One embodiment of the present disclosure may provide an apparatus and method for measuring a body size of a subject based on a planar image of the subject and a measurement value of a lidar sensor.

According to an embodiment of the present disclosure, an electronic device includes a camera module configured to provide an image by photographing, and a camera module configured to provide depth information in the image based on preset data points. Identify reference points in the subject included in the image provided from the configured lidar sensor and the camera module, and among the preset measurement points, reference measurement points corresponding to the identified reference points and the identified reference points and at least one processor configured to obtain a body size of the subject corresponding to each measurement line by using coordinate values and depth information of auxiliary measurement points located on the measurement lines prepared by

According to an embodiment of the present disclosure, a method for measuring a body size in an electronic device includes an operation of collecting an image of a subject, an operation of collecting depth information in the image based on preset measurement points, and an operation of collecting the image An operation of identifying reference points in the subject included in ; coordinate values of reference measurement points corresponding to the identified reference points among the preset measurement points and auxiliary measurement points located on measurement lines prepared by the identified reference points; and An operation of obtaining depth information and an operation of acquiring body dimensions of the subject corresponding to each measurement line using coordinate values and depth information obtained from the reference measurement points and the auxiliary measurement points.

According to an embodiment of the present disclosure, since the electronic device can recognize the distance information between the camera and the subject using the LIDAR sensor, when measuring the body size using this, freedom in the shooting angle can be provided. In addition, it may be possible to measure the body size considering the curvature of the body.

Effects obtainable in the exemplary embodiments of the present disclosure are not limited to the effects mentioned above, and other effects not mentioned are common knowledge in the art to which exemplary embodiments of the present disclosure belong from the following description. can be clearly derived and understood by those who have That is, unintended effects according to the implementation of the exemplary embodiments of the present disclosure may also be derived by those skilled in the art from the exemplary embodiments of the present disclosure.

1 is a diagram illustrating a block configuration of an electronic device in a network environment according to various embodiments of the present disclosure.
2 is a block diagram illustrating a camera module according to various embodiments of the present disclosure.
3 is a block diagram illustrating a lidar sensor included in a sensor module according to various embodiments of the present disclosure.
4 is a diagram illustrating a block configuration of a body size measuring device provided in an electronic device according to an embodiment of the present disclosure.
5 is a diagram illustrating functional blocks of a processor performing body size measurement in the body size measuring device according to an embodiment of the present disclosure.
6 is a diagram illustrating a control flow for measuring a body size in an electronic device according to an embodiment of the present disclosure.
7 is a diagram illustrating an example of estimating a pose for body size measurement in an electronic device according to an embodiment of the present disclosure.
8 is a diagram illustrating an example of identifying a main body position in an electronic device according to an embodiment of the present disclosure.
9 is a diagram illustrating an example of reference measurement points for body size measurement in an electronic device according to an embodiment of the present disclosure.
10 is a diagram illustrating an example of an image in which measurement points from which depth information for body size measurement is to be obtained are masked in an electronic device according to an embodiment of the present disclosure.
11 is a diagram illustrating an example of measurement lines for measuring body size in an electronic device according to an embodiment of the present disclosure.
12 is a diagram illustrating an example of body dimensions measured in an electronic device according to an embodiment of the present disclosure.
13 is a diagram illustrating an example of displaying body dimensions measured in an electronic device according to an embodiment of the present disclosure on a display.
14 is a control flow chart performed for body measurement in an electronic device according to an embodiment of the present disclosure.
In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar elements.

Hereinafter, with reference to the drawings, embodiments of the present disclosure will be described in detail so that those skilled in the art can easily carry out the present disclosure. However, the present disclosure may be embodied in many different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar elements. Also, in the drawings and related descriptions, descriptions of well-known functions and constructions may be omitted for clarity and conciseness.

1 is a diagram illustrating a block configuration of an electronic device 101 in a network environment according to various embodiments of the present disclosure.

Referring to FIG. 1 , in a network environment 100, an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or through a second network 199. It is possible to communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120, a memory 130, an input device 150, an audio output device 155, a display device 160, an audio module 170, a sensor module ( 176), interface 177, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196, or antenna module 197 ) may be included. In some embodiments, in the electronic device 101, at least one of these components (eg, the display device 160 or the camera module 180) may be omitted or one or more other components may be added. In some embodiments, some of these components may be implemented as a single integrated circuit. For example, the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illumination sensor) may be implemented while being embedded in the display device 160 (eg, a display).

The processor 120, for example, executes software (eg, the program 140) to cause at least one other component (eg, hardware or software component) of the electronic device 101 connected to the processor 120. It can control and perform various data processing or calculations. According to one embodiment, as at least part of data processing or operation, the processor 120 transfers commands or data received from other components (eg, sensor module 176 or communication module 190) to volatile memory 132. , process commands or data stored in the volatile memory 132 , and store resultant data in the non-volatile memory 134 . According to one embodiment, the processor 120 includes a main processor 121 (eg, a central processing unit or an application processor), and a secondary processor 123 (eg, a graphic processing unit, an image signal processor) that can operate independently or together with the main processor 121. , sensor hub processor, or communication processor). Additionally or alternatively, the secondary processor 123 may be configured to use less power than the main processor 121 or to be specialized for a designated function. The secondary processor 123 may be implemented separately from or as part of the main processor 121 .

The secondary processor 123 may, for example, take the place of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, running an application). ) state, together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display device 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to one embodiment, the auxiliary processor 123 (eg, an image signal processor or a communication processor) may be implemented as part of other functionally related components (eg, the camera module 180 or the communication module 190). there is.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101 . The data may include, for example, input data or output data for software (eg, program 140) and commands related thereto. The memory 130 may include volatile memory 132 or non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input device 150 may receive a command or data to be used for a component (eg, the processor 120) of the electronic device 101 from an outside of the electronic device 101 (eg, a user). The input device 150 may include, for example, a microphone, mouse, keyboard, or digital pen (eg, a stylus pen).

The sound output device 155 may output sound signals to the outside of the electronic device 101 . The audio output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback, and the receiver can be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display device 160 may visually provide information to the outside of the electronic device 101 (eg, a user). The display device 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the device. According to an embodiment, the display device 160 may include a touch circuitry set to detect a touch or a sensor circuit (eg, a pressure sensor) set to measure the intensity of force generated by the touch. there is.

The audio module 170 may convert sound into an electrical signal or vice versa. According to an embodiment, the audio module 170 acquires sound through the input device 150, the audio output device 155, or an external electronic device connected directly or wirelessly to the electronic device 101 (eg: Sound may be output through the electronic device 102 (eg, a speaker or a headphone).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a bio sensor, It may include a temperature sensor, humidity sensor, illuminance sensor or lidar sensor. For example, the LiDAR sensor is disposed near the camera module 180 in the electronic device 101 and provides depth information (or depth information, hereinafter collectively referred to as “depth information”) of a subject to be photographed by the camera module 180. can be obtained.

The interface 177 may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device 101 to an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 may be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert electrical signals into mechanical stimuli (eg, vibration or motion) or electrical stimuli that a user may perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to one embodiment, the power management module 188 may be implemented as at least part of a power management integrated circuit (PMIC), for example.

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104), or the server 108. It is possible to support the establishment of and communication through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : a local area network (LAN) communication module or a power line communication module). Among these communication modules, the corresponding communication module is a first network 198 (eg, a short-range communication network such as Bluetooth, WiFi direct, or IrDA (infrared data association)) or a second network 199 (eg, a cellular network, the Internet, or It may communicate with an external electronic device via a computer network (eg, a telecommunications network such as a LAN or WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or implemented as a plurality of separate components (eg, multiple chips). The wireless communication module 192 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199. The electronic device 101 may be identified and authenticated.

The antenna module 197 may transmit or receive signals or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include one antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas. In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is selected from among the plurality of antennas by the communication module 190, for example. can be chosen A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module 197 in addition to the radiator.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( e.g. commands or data) can be exchanged with each other.

According to an embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the electronic devices 102 and 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or some of the operations executed in the electronic device 101 may be executed in one or more external devices among the external electronic devices 102, 104, or 108. For example, when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 instead of executing the function or service by itself. Alternatively or additionally, one or more external electronic devices may be requested to perform the function or at least part of the service. One or more external electronic devices receiving the request may execute at least a part of the requested function or service or an additional function or service related to the request, and deliver the execution result to the electronic device 101 . The electronic device 101 may provide the result as at least part of a response to the request as it is or additionally processed. To this end, for example, cloud computing, distributed computing, or client-server computing technology may be used.

2 is a diagram illustrating a block configuration 200 illustrating a camera module 180, according to various embodiments of the present disclosure.

Referring to FIG. 2 , the camera module 180 includes a lens assembly 210, a flash 220, an image sensor 230, an image stabilizer 240, a memory 250 (eg, a buffer memory), or an image signal processor. (260). The camera module 180 may capture an image such as a still image or a moving image at a predetermined angle of view and output an electrical signal corresponding to the captured image. The angle of view of the camera module 180 that determines the shooting range of still images and moving images may be determined by a type of lens that may be classified as wide-angle, standard, or telephoto. The camera module 180 may output an electrical signal for providing a preview of an image to be captured prior to capturing.

The lens assembly 210 may collect light emitted from a subject that is an image capturing target. The lens assembly 210 may include one or more lenses. According to one embodiment, the camera module 180 may include a plurality of lens assemblies 210 . In this case, the camera module 180 may form, for example, a dual camera, a 360-degree camera, or a spherical camera. Some of the plurality of lens assemblies 210 may have the same lens properties (eg, angle of view, focal length, auto focus, f number, or optical zoom), or at least one lens assembly may have the same lens properties as other lens assemblies. may have one or more lens properties different from the lens properties of . The lens assembly 210 may include, for example, a wide-angle lens or a telephoto lens.

The flash 220 may emit light used to enhance light emitted or reflected from a subject. According to one embodiment, the flash 220 may include one or more light emitting diodes (eg, a red-green-blue (RGB) LED, a white LED, an infrared LED, or an ultraviolet LED), or a xenon lamp.

The image sensor 230 may acquire an image corresponding to the subject by converting light emitted or reflected from the subject and transmitted through the lens assembly 210 into an electrical signal. According to an embodiment, the image sensor 230 is, for example, an image sensor selected from among image sensors having different properties, such as an RGB sensor, a black and white (BW) sensor, an IR sensor, or a UV sensor, It may include a plurality of image sensors having a property, or a plurality of image sensors having other properties. Each image sensor included in the image sensor 230 may be implemented using, for example, a charged coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor.

The image stabilizer 240 moves at least one lens or image sensor 230 included in the lens assembly 210 in a specific direction in response to movement of the camera module 180 or the electronic device 101 including the same. Operation characteristics of the image sensor 230 may be controlled (eg, read-out timing is adjusted, etc.). This makes it possible to compensate at least part of the negative effect of the movement on the image being taken. According to an embodiment, the image stabilizer 240 uses a gyro sensor (not shown) or an acceleration sensor (not shown) disposed inside or outside the camera module 180 to control the camera module 180 or the electronic device 101 . ) can detect such movements. The image stabilizer 240 may be implemented as, for example, an optical image stabilizer.

The memory 250 may at least temporarily store at least a portion of an image acquired through the image sensor 230 for a next image processing task. For example, when image acquisition is delayed according to the shutter, or a plurality of images are acquired at high speed, the acquired original image (eg, a Bayer-patterned image or a high-resolution image) is stored in the memory 250 and , a copy image (eg, a low resolution image) corresponding thereto may be previewed through the display device 160 . A copy image may be, for example, a thumbnail. Hereinafter, an image previewed through the display device 160 may be referred to as a “preview image”. A preview image may be created by an electrical signal converted by the image sensor 230 before capturing an actual subject. Thereafter, when a specified condition is satisfied (eg, a user input or a system command), at least a part of the original image stored in the memory 250 may be obtained and processed by the image signal processor 260 , for example. According to one embodiment, the memory 250 may be configured as at least a part of the memory 130 or as a separate memory operated independently of the memory 130 .

The image signal processor 260 may perform one or more image processing on an image acquired through the image sensor 230 or an image stored in the memory 250 . The one or more image processing, for example, depth map generation, 3D modeling, panorama generation, feature point extraction, image synthesis, or image compensation (eg, noise reduction, resolution adjustment, brightness adjustment, blurring ( blurring, sharpening, or softening. Additionally or alternatively, the image signal processor 260 may include at least one of the components included in the camera module 180 (eg, an image sensor). 230) may be controlled (eg, exposure time control, read-out timing control, etc.) The image processed by the image signal processor 260 is stored again in the memory 250 for further processing. or may be provided as an external component of the camera module 180 (eg, the memory 130, the display device 160, the electronic device 102, the electronic device 104, or the server 108). According to an example, the image signal processor 260 may be configured as at least a part of the processor 120 or may be configured as a separate processor that operates independently of the processor 120. The image signal processor 260 may be configured as a processor 120 When configured as a separate processor, at least one image processed by the image signal processor 260 may be displayed through the display device 160 as it is or after additional image processing by the processor 120 .

According to an embodiment, the electronic device 101 may include a plurality of camera modules 180 each having different properties or functions. In this case, for example, at least one of the plurality of camera modules 180 may be a wide-angle camera, and at least the other may be a telephoto camera. Similarly, at least one of the plurality of camera modules 180 may be a front camera, and at least another one may be a rear camera.

3 is a diagram illustrating a block configuration 300 illustrating a lidar sensor included in a sensor module 176 according to various embodiments of the present disclosure.

Referring to FIG. 3 , the lidar sensor 300 according to an embodiment may be included in a 3D image sensor capable of connecting people and objects in a 3D space. The lidar sensor 300 emits light (eg, a laser beam, laser light or laser, hereinafter referred to as “laser”) toward a target object, the facet, and receives information reflected from the target object and returns to the target object. Physical properties such as the distance to the target object and/or the moving speed and direction of the target object, temperature, ambient air material analysis and concentration measurement may be detected. The lidar sensor 300 may be used as a core technology for visual implementation in a 3D space, for example. The lidar sensor 300 may extract relatively high-resolution data compared to sensors based on ultrasonic or radar technology. The radar sensor 300 is mounted in a technical field in which safety is important, such as autonomous driving, or in some electronic devices (eg, the electronic device 101 of FIG. 1) such as a smartphone to implement augmented reality (AR). It can be used as a key technology in the technology field. The radar sensor 300 may be mounted as a lidar scanner together with a camera in the electronic device 101 such as a smart phone. According to one embodiment, the lidar sensor 300 includes a lens assembly 310, a transmitting circuit 320, a receiving circuit 330, a memory 340 (eg, a buffer memory), or a data processing processor 350. can include

The lens assembly 310 may emit laser beams to a subject, which is an image capturing target, at predetermined vertical and horizontal viewing angles, and may collect the reflected laser beams from the subject. The lens assembly 310 may be used to focus a laser beam, change the shape of a laser beam, or correct for spherical aberration or other optical errors in a variety of laser applications, such as beam manipulation. Lens assembly 310 may include one or more lenses. According to one embodiment, the lidar sensor 300 may include a plurality of lens assemblies 310 . Some of the plurality of lens assemblies 310 may have the same properties (eg, radiant angle or intensity due to a vertical field of view and a horizontal field of view), or at least one of the lens assemblies may have one or more properties that are different from the properties of the other lens assemblies. can have The lens assembly 310, for example, the lidar sensor 300 includes, for example, a plano-convex (PCX) lens, a cylindrical lens, an aspheric lens, or a rod lens. can do.

The transmission circuit 320 may generate lasers to be emitted through the lens assembly 310 toward the facet body, which is a target object, at predetermined vertical and horizontal viewing angles. According to one embodiment, the transmitting circuit 320 may fire thousands of lasers per second. The laser emitted by the transmission circuit 320 has characteristics such as monochromaticity, linearity, coherence, high power, or polarization, and can be transmitted far without spreading. The transmitter circuit 320 may include, for example, a gain medium that is a basic material of a laser, a resonator using a pair of mirrors, or a pumping device that converts the gain medium from a ground state to an excited state. As the pumping device, for example, a diode pumped solid state laser (DPSS) is widely used. The laser applied to the transmission circuit 320 may be classified into, for example, a solid laser, a gas laser, a semiconductor laser, a dye laser, a pulse laser, a fiber laser, or a chemical laser according to the shape of a gain medium.

The receiving circuit 330 may detect the laser reflected from the subject and transmitted through the lens assembly 310, convert the detected laser into an electrical signal, and output the converted signal. According to one embodiment, the receiving circuit 330 may detect the laser output through the lens assembly 310 using a multi-array receiving element. For example, the multi-array receiving element may be an avalanche photodiode (APD) multi-array receiving element. The receiving circuit 330 may include a readout integrated circuit (ROIC) that amplifies the optical-electrically converted analog signal.

The lidar stabilizer 340 reacts to the movement of the lidar sensor 300 or the electronic device 101 including the same, and includes at least one lens included in the lens assembly 310, a transmitting circuit 320, or a receiving circuit ( 330) may be moved in a specific direction or operating characteristics of the transmitting circuit 320 or the receiving circuit 330 may be controlled (eg, read-out timing is adjusted, etc.). This makes it possible to compensate for at least a part of the negative influence caused by the movement of the subject being photographed. According to one embodiment, the lidar stabilizer 340 uses a gyro sensor (not shown) or an acceleration sensor (not shown) disposed inside or outside the lidar sensor 300 to activate the lidar sensor 300 or electronic Such movement of the device 101 may be detected. According to one embodiment, the lidar stabilizer 340 may be implemented as, for example, an optical stabilizer.

The memory 350 may at least temporarily store at least a portion of subject information such as depth information acquired through the receiving circuit 330 for a next processing task. For example, the memory 350 detects plane coordinate information (eg, x value and/or y value) of preset measurement points in an image captured by the camera module 180 and corresponding to the coordinate information of the measurement points. stored depth information. Thereafter, when a specified condition is satisfied (eg, a user input or a system command), some or all of the depth information for each measurement point stored in the memory 350 may be obtained and processed by the data processing processor 360 . According to one embodiment, the memory 350 may be configured as at least a part of the memory 130 or as a separate memory operated independently of the memory 130 .

The data processing processor 360 may obtain depth information at each measurement point provided on the subject based on the electrical signal output from the receiving circuit 330 . According to one embodiment, the data processing processor 360 is configured from the time when the laser is emitted through the transmission circuit 320 to the time when the laser reflected from the measurement points of the subject within the measurement range is received through the reception circuit 330. Based on the time difference of , the distance to each measurement point can be estimated. The data processing processor 360 may obtain depth information on a corresponding measurement point based on the distance estimated for each measurement point. The data processing processor 360 may record depth information obtained for each measurement point in the memory 350 . According to one embodiment, the data processing processor 360 is configured as at least a part of a processor included in the electronic device 101 (eg, the processor 120 of FIG. 1 ) or a separate processor 120 and independently operated. It may consist of a processor. For example, when the data processing processor 360 is included in the lidar sensor 300, the data processing processor 360 may provide information about measurement points and/or depth information of the measurement points to the processor 120. As another example, when the data processing processor 360 is configured as at least a part of the processor 120, an electrical signal output from the receiving circuit 330 may be provided to the processor 120. In this case, the processor 120 may obtain depth information at each measurement point provided on the subject based on the electrical signal provided from the lidar sensor 300 .

FIG. 4 is a block diagram of a body size measuring device 400 provided in an electronic device (eg, the electronic device 101 of FIG. 1 ) according to an embodiment of the present disclosure.

Referring to FIG. 4 , the body size measuring device 400 provided in the electronic device 101 according to an embodiment includes a processor 410 (eg, the processor 120 of FIG. 1 ), a camera module 420 (eg, the processor 120 of FIG. 1 ). The camera module 180 of FIG. 1 or 2), the lidar sensor 430 (eg, the lidar sensor included in the sensor module 176 of FIG. 1 or the lidar sensor 300 of FIG. 3), the display ( 440) (eg, the display device 160 of FIG. 1) or a memory 450 (eg, the memory 130).

The body size measuring device 400 collects depth information in the image based on the image of the subject and preset measurement points, and obtains the body size of the subject based on the collected image and depth information on the preset measurement points. can The image of the subject may be, for example, a 2D color image. The preset measurement points are, for example, in order to obtain the angle of view of the camera module 420, that is, depth information of a subject included in an image to be photographed or to be photographed or an object surrounding the subject, the lidar sensor 430 ) may be positions where the laser is to be fired. The preset measurement points may be uniformly distributed in one image, or a relatively large number of measurement points may be distributed in the subject in consideration of the location of the subject. The number of measurement points may vary depending on the performance of the lidar sensor 430 . For example, the number of measurement points capable of receiving a sensing value from the lidar sensor 430 may be approximately 600. After that, it can be used by upscaling to 256 * 192 through a deep learning model.

According to an embodiment, the body size measurement apparatus 400 identifies reference points of a subject included in a photographed image, and among measurement points from which sensing values are collected, reference measurement points corresponding to the identified reference points and the identification Coordinate values and depth information of auxiliary measurement points located on measurement lines prepared by the reference points may be obtained. The reference points may be, for example, important positions that can be references for measuring the size of each target body part in the target body part for which the body number is to be measured. For example, both endpoints of the front, side, or back of the target body part, such as the neck, shoulder, chest, waist, pelvis, hip, or thigh, may be identified as reference points corresponding to the corresponding body part, but are not limited thereto. More than two reference points may be estimated per body part or area. Also, reference points may have different numbers for each body part. The measurement line may be provided for a body part for which a body size is to be measured. The reference measurement points may be measurement points that match locations of reference points identified in the subject among measurement points considered for collecting sensing values. The measurement line may refer to a measurement line used when manually measuring a measurement using a tool such as a tape measure, for example. The measurement line may be provided to connect the reference measurement points. The auxiliary measurement points may be measurement points located on a measurement line among measurement points considered for collecting a sensing value, excluding reference measurement points. According to an embodiment, the body size measurement apparatus 400 may obtain the body size of the subject corresponding to each measurement line by using coordinate values and depth information of the reference measurement points and auxiliary measurement points.

More specifically, the camera module 420 may capture an image such as a still image or a moving image at a predetermined angle of view in response to control of the processor 410 . The camera module 420 may convert light received by photographing into an electrical signal and output the converted electrical signal. The camera module 180 may output an electrical signal for providing a preview of an image to be photographed before actual photographing is performed. The camera module 420 may perform one or more image processes on the captured image and/or the preview image before outputting an electrical signal generated by capturing or previewing. According to an embodiment, the image captured by the camera module 420 is an image corresponding to at least one of the front, left side, right side, or back side of the subject. For example, the camera module 420 may capture the front, side, and back of the subject to measure the body size, and output electrical signals corresponding to the front, side, and back images. In this case, when photographing the front, side, and rear of a subject, it may be desirable to maintain a photographing angle in the camera module 420 and/or a distance between the camera module 420 and the subject as constant as possible.

The lidar sensor 430 may emit a laser including a plurality of laser beams toward a projectile, which is a target object, in consideration of measurement points preset by predetermined vertical viewing angles and horizontal viewing angles. The lidar sensor 430 may detect laser reflected from a subject at measurement points and returned. The lidar sensor 430 may convert the detected laser into an electrical signal and output it. According to an embodiment, the electrical signal output by the lidar sensor 430 may be information about a time difference between a time point at which the laser is transmitted and a time when the laser is received at each measurement point, or depth information.

The processor 410 may receive an image of a subject from the camera module 420 and receive depth information of measurement points from the lidar sensor 430 . The measurement points may be preset in consideration of items such as, for example, the performance of the lidar sensor 430, the angle of view of the camera module 420, the size of the subject, or the position of the subject. The processor 410 may obtain the body size of the subject based on the image provided from the camera module 420 and the depth information of measurement points provided from the lidar sensor 430 .

According to an embodiment, the processor 410 may collect an image including a subject through the camera module 420, and obtain depth information from the image based on preset measurement points through the lidar sensor 430. can be collected The processor 410 identifies the pose of the subject and considers the pose of the subject in order to collect image and depth information, for example, in a situation where the subject is in a pose that is easy to measure the body size. of can be taken. The processor 410 identifies a pose of a subject based on pose estimation technology, compares the identified pose with a preset pose that is easy to measure body size, and if the identified pose is the preset pose, the camera module In order to collect images through 420, it is possible to perform photographing of the subject.

According to an embodiment, the processor 410 may obtain a preview image of a subject through the camera module 420 and output the acquired preview image through the display 440 . The processor 410 may detect an outline of a desired subject from a preview image or an image actually captured, and may identify or prepare key points that are easy to recognize the shape of a subject in the outline image based on the detected outline. can do. The processor 410 may configure a body skeleton line by connecting the main points, and identify a pose of the subject using the body skeleton line. The processor 410 may display on the display 440 an image guiding a pose in which body size measurement is easy. This may help the user to make the subject take the corresponding pose, or help the user to recognize whether the subject is taking the corresponding pose.

According to an embodiment, the processor 410 may identify reference points corresponding to main body positions in subjects included in the collected images. The reference measurement points may be, for example, one or a plurality of measurement points located around the chest, waist, pelvis, hip, or thigh among preset measurement points.

According to an embodiment, the processor 410 includes coordinate values and depth information of reference measurement points corresponding to reference points among measurement points considered for collecting depth information and auxiliary measurement points located on measurement lines prepared by the reference points. can be obtained. The processor 410 may set, for example, measurement points mapped to reference points identified from a subject in an image among measurement points set to measure depth information through the lidar sensor 430 as reference measurement points. The processor 410 may set the rest of the measurement points, excluding the reference measurement points, as auxiliary measurement points among the measurement points located on the measurement line among the measurement points set to measure the depth information through the lidar sensor 430. The measurement line may be provided for a body part for which a body size is to be measured. The measurement line may refer to a measurement line used when manually measuring a measurement using a tool such as a tape measure, for example. The measurement line may be provided by connecting the reference measurement points with the shortest distance. The measurement line may be, for example, a chest circumference line, a waist circumference line, a pelvis circumference line, and a hip circumference line via one or a plurality of measurement points located around the chest, waist, pelvis, hip, or thigh among reference measurement points. , at least one of a right thigh circumference line and a left thigh circumference line, or a plurality of lines. Consequently, the measurement line may be a line connecting at least two reference measurement points and auxiliary measurement points disposed between the at least two reference measurement points with the shortest distance.

According to an embodiment, the processor 410 may obtain coordinate values and depth information of reference measurement points, and may obtain coordinate values and depth information of auxiliary measurement points. The processor 410 may obtain the body size of the subject corresponding to each measurement line by using the coordinate values and depth information obtained from the reference measurement points and the coordinate values and depth information obtained from the auxiliary measurement points. The processor 410 may output, through the display 440, one or a plurality of body measurements among body measurements obtained in correspondence with the measurement lines.

Under the control of the processor 410, the display 440 may display images or information related to body size measurement, such as a preview image of a subject, an image of a subject actually photographed, and information on measured body size. The display 440 may further display a touch-type key pattern so that the user can input information.

The memory 450 may store or read various information under the control of the processor 410 . According to an embodiment, the memory 450 may store an image taken to measure a body size under the control of the processor 410, information required for measuring a body size, and information about the measured body size. . The memory 450 may output recorded information in response to a request of the processor 410 .

FIG. 5 is a diagram of a processor (eg, processor 410 of FIG. 4 ) performing body size measurement in a body size measuring device (eg, body size measuring device 400 of FIG. 4 ) according to an embodiment of the present disclosure. It is a diagram showing functional blocks.

Referring to FIG. 5 , the processor 410 for measuring the body size according to an embodiment includes an input image 551 provided from a camera module (eg, the camera module 420 of FIG. 4 ), a lidar sensor (eg, Depth information 552 provided from the lidar sensor 430 of FIG. 4 or control information provided from an input device (eg, the input device 150 of FIG. 1 ) or a memory (eg, the memory 130 of FIG. 1 ) Based on 553, the body size of the subject included in the input image 551 can be measured, and the measured body size can be output through a display (eg, the display 440 of FIG. 4). According to the embodiment, the processor 410 identifies reference points of a subject included in the input image 551 provided from the camera module 420, and selects the reference points among preset measurement points for obtaining depth information from the lidar sensor 430. Using coordinate values and depth information of reference measurement points corresponding to the identified reference points and auxiliary measurement points located on the measurement lines prepared by the identified reference points, the body size of the subject corresponding to each measurement line is obtained. According to an embodiment, the processor 410 performing the body measurement may include an image processing module 510, a depth information analysis module 530, a body measurement module 520, or a screen configuration module 540. can include

According to an embodiment, the image processing module 510 outputs the input image 551 (eg, a preview image) provided from the camera module 420 through the display 440 through the screen configuration module 540. Signal processing may be performed. The preview image may be an image that is not an image obtained by actual shooting, but an image to show an image that can be obtained by shooting in advance. The preview image is, for example, created in a thumbnail format. The image processing module 510 may determine main points of the subject included in the preview image, and the main points may be positions within the subject that are easy to identify the shape of the subject. The points may be, for example, locations where joints in the body exist, i.e., the main points are near both wrists, near both elbows, near both pelvis, near both knees, near both ankles, both ears, nose or both sides. It can be provided in the eyes.

According to an embodiment, the image processing module 510 may create a skeleton line by connecting some or all of the main points with a solid line, and identify the shape of the subject by the skeleton line. For example, when the subject is a person, the shape of the subject may be a pose the person is taking.

According to an embodiment, the image processing module 510 searches for a subject in a preview image based on a pose estimation technique, determines main points of the subject, and uses a skeleton line created by connecting the determined main points to form the subject. can identify. The image processing module 510 may determine whether the pose identified by the skeletal line coincides with the pose for measuring the body size. A pose for measuring the body size may be set in advance. For example, a preset pose for measuring body size may be a pose in which both arms and legs are spread apart to some extent.

According to an embodiment, the image processing module 510 acquires an input image 551 actually photographed by photographing a subject through the camera module 420, and detects an outline of the subject in the acquired input image 551. And, an original contour image composed of the detected contour line can be generated. The contour line may be an edge line of the subject. A contour detection technique for generating an original contour image from the input image 551 may use, for example, a segmentation technique.

According to an embodiment, the image processing module 510 may generate an interpolated contour image by matching some or all of main points and/or bone lines used to identify a pose of a subject to an original contour image. The interpolated contour image may be an image in which some main points and/or skeleton lines are displayed within the contour. Some or all of the main points and/or the bone line may be adjusted in size and/or position to match the original contour image. This may be performed when the size and/or position of the subject used to identify the pose and the subject used to detect the contour do not completely match.

According to an embodiment, the image processing module 510 determines the height and/or height of major body parts (eg, neck, shoulder, chest, waist, pelvis, hip, thigh) for body measurement in the contour of the subject in the interpolated contour image. Alternatively, reference points considering location may be estimated. The reference points are estimated as both end points of main body parts for body measurement, but are not limited thereto, and more than two reference points may be estimated for each main body part, or a different number of reference points may be estimated for each main body part. Also, the reference points may be estimated from at least one of a front image, a side image, and/or a rear image of the subject.

According to an embodiment, the depth information analysis module 530 may acquire depth information 552 of a subject at preset measurement points through the lidar sensor 430 and analyze the obtained depth information. there is. The depth information may be acquired based on, for example, the lidar sensor 430 radiating a laser beam to preset measurement points and reflecting back information from the measurement points. The depth information may be obtained for each measurement point or only for measurement points disposed on a subject.

According to an embodiment, the depth information analysis module 530 uses measurement points mapped to reference points identified from a subject in the input image 551 among measurement points set to measure depth information through the lidar sensor 430 as references. It can be set by measuring points. The depth information analysis module 530 may set remaining measurement points, excluding reference measurement points, as auxiliary measurement points from measurement points located on the measurement line among measurement points set to measure depth information through the lidar sensor 430. . The measurement line may be provided for a body part for which a body size is to be measured. The measurement line may refer to a measurement line used when manually measuring a measurement using a tool such as a tape measure, for example. The measurement line may be provided by connecting the reference measurement points with the shortest distance. The measurement line may be, for example, a chest circumference line, a waist circumference line, a pelvis circumference line, and a hip circumference line via one or a plurality of measurement points located around the chest, waist, pelvis, hip, or thigh among reference measurement points. , at least one of a right thigh circumference line and a left thigh circumference line, or a plurality of lines. Consequently, the measurement line may be a line connecting at least two reference measurement points and auxiliary measurement points disposed between the at least two reference measurement points with the shortest distance.

According to an embodiment, the body size measurement module 520 may receive an interpolated contour image including information about reference points, main points, and/or skeletal lines from the image processing module 510, and analyze depth information. Information and/or depth information about the reference measurement points and the auxiliary measurement points may be provided from the module 530 . The body size measurement module 520 obtains coordinate values and depth information of reference measurement points corresponding to reference points among measurement points considered for collecting depth information and auxiliary measurement points located on measurement lines prepared by the reference points. can do.

According to an embodiment, the body size measuring module 520 may obtain body measurements for each measurement line. The body size measurement module 520 may determine, for example, coordinate values of reference measurement points and auxiliary measurement points constituting at least one of a front measurement line, a side measurement line, or a rear measurement line capable of measuring a chest circumference among measurement lines. A distance between the reference measurement points and the auxiliary measurement points may be calculated using the and depth values, and a dimension value corresponding to the chest circumference may be obtained by the sum of the calculated distances. For other measurement lines for each major body part, body measurements may be obtained by the same method. The body size measurement module 520 may record body measurements obtained for each major body part corresponding to the subject in a memory (eg, the memory 450 of FIG. 4 ). The body measurements recorded in the memory 450 may be used by the user to purchase clothes or the like without additional measurement of the body measurements.

According to an embodiment, the body size measurement module 520 may obtain coordinate values and depth values of the head and heel of the subject from the image processing module 510 and the depth information analysis module 530 . The body size measuring module 520 may obtain the height of the subject by using coordinate values and depth values at the tip of the head and coordinate values and depth values at the heel.

According to an embodiment, the screen configuration module 540 may configure an output image 561 including body measurements of a subject using body measurements acquired for each measurement line, and display the configured output image 561. (eg, the display 440 of FIG. 4) can be output so that it can be displayed. The screen composition module 540 may process and output the output image 561 in response to the control information 553 .

6 is a diagram illustrating a control flow for measuring a body size in an electronic device (eg, the electronic device 101 of FIG. 1 or the body size measuring device 400 of FIG. 4) according to an embodiment of the present disclosure. am.

Referring to FIG. 6 , in operation 610, the electronic device 400 collects an image including a subject through a camera module (eg, the camera module 180 of FIG. 1 or the camera module 420 of FIG. 4). depth information in the image may be collected based on preset measurement points through a lidar sensor (eg, the lidar sensor 430 of FIG. 4 ).

The electronic device 400 identifies the pose of the subject in order to collect image and depth information in a situation where the subject is in a pose that is easy to measure the body size, and performs photographing of the subject in consideration of the pose of the subject. can do. According to an embodiment, the electronic device 400 identifies a pose of a subject based on a pose estimation technique, compares the identified pose with a preset pose that is easy to measure body size, and determines the identified pose as the preset pose. If it is a set pose, it is possible to perform photographing of the subject in order to collect images through the camera module 420 . The electronic device 400 may obtain a preview image of the subject through the camera module 420 and display the obtained preview image (eg, the display device 160 of FIG. 1 ). Alternatively, it may be output through the display 440 of FIG. 4 . The electronic device 400 may detect an outline of a desired subject from a preview image or an image actually captured, and identify key points that are easy to recognize the shape of the subject in the outline image based on the detected outline, or can be arranged The electronic device 400 may configure a body skeleton line by connecting the main points, and identify a pose of the subject using the body skeleton line. The electronic device 400 may display, through the display 440 , an image guiding a pose in which body size measurement is easy. This may help the user to make the subject take the corresponding pose, or help the user to recognize whether the subject is taking the corresponding pose.

In operation 620, the electronic device 400 may identify reference points corresponding to main body positions in the subject included in the collected image. The reference measurement points may be, for example, one or a plurality of measurement points located around the chest, waist, pelvis, hip, or thigh among preset measurement points.

In operation 630, the electronic device 400 includes reference measurement points corresponding to the identified reference points among measurement points considered for collecting depth information and auxiliary measurement points located on measurement lines prepared by the identified reference points. Coordinate values and depth information of these can be obtained. According to an embodiment, the electronic device 400 may set, among measurement points set to measure depth information through the lidar sensor 430, measurement points mapped to reference points identified from a subject in an image as reference measurement points. . According to an embodiment, the electronic device 400 uses the remaining measurement points, excluding reference measurement points, from among measurement points located on a measurement line among measurement points set to measure depth information through the lidar sensor 430 as auxiliary measurement points. can be set The measurement line may be provided for a body part for which a body size is to be measured. The measurement line may refer to a measurement line used when manually measuring a measurement using a tool such as a tape measure, for example. The measurement line may be provided by connecting the reference measurement points with the shortest distance. The measurement line may be, for example, a chest circumference line, a waist circumference line, a pelvis circumference line, and a hip circumference line via one or a plurality of measurement points located around the chest, waist, pelvis, hip, or thigh among reference measurement points. , at least one of a right thigh circumference line and a left thigh circumference line, or a plurality of lines. Consequently, the measurement line may be a line connecting at least two reference measurement points and auxiliary measurement points disposed between the at least two reference measurement points with the shortest distance.

The electronic device 400, in operation 630, obtains coordinate values and depth information of reference measurement points, obtains coordinate values and depth information of auxiliary measurement points, and obtains coordinate values and depth information and auxiliary information from the reference measurement points. A body size of a subject corresponding to each measurement line may be obtained using coordinate values and depth information obtained from measurement points.

In operation 640, the electronic device 400 may output, through the display 440, one or a plurality of body measurements among body measurements obtained in correspondence with the measurement lines.

In the above operation, although the measurement of the body size using one image has been described, it is not limited thereto, and identification of reference measurement points and auxiliary measurement points in each of the front image, side image, or rear image of one subject. And, based on this, a measurement line may be prepared, and one body size of the prepared measurement line may be measured.

7 illustrates an example of estimating a pose for body size measurement in an electronic device (eg, the electronic device 101 of FIG. 1 or the body size measurement device 400 of FIG. 4) according to an embodiment of the present disclosure. It is an illustrated drawing.

Referring to FIG. 7 , a first image 710 according to an embodiment may be an initial image before a pose estimation operation 730 for estimating a pose for body size measurement is performed, and a second image 720 ) may be an image resulting from the pose estimation operation 730. The first image 710 may be a preview image or an actual captured image. In the case of using a preview image as the first image 710, an additional photographing to obtain an image for measuring the actual body size should be performed, but other operations for measuring the actual body size may be the same.

The first image 710 may include, for example, an icon displaying a photographing state or an icon display 711 indicating whether or not pose identification has been performed, and a subject 713 as a target to measure body size. . In the second image 720, an icon indicating a photographing state or an icon indicating whether a pose has been identified 721, a subject 713, and a main point corresponding to a position of the subject for easy identification of a body pose are displayed. (a1, a2, b1, b2, c1, c2, d1, d2, e1, e2, f1, f2, g1, g2, h, i1, i2)) and the skeleton line 725. According to an embodiment, the first image 710 may be output through a display (eg, the display device 160 of FIG. 1 or the display 440 of FIG. 4 ) in response to a user's request for measurement of a body size. The first image 710 is used to obtain a second image 720, which is a pose estimation image that is easy to identify the shape of the subject 713, that is, the pose the subject 713 is taking, by the pose estimation operation 730. can be used The second image 720 is displayed in a state 721 in which an icon indicating a photographing state or an icon indicating whether pose identification has been made is activated.

According to an embodiment, the main points (a1, a2, b1, b2, c1, c2, d1, d2, e1, e2, f1, f2, g1, g2, h, i1, i2) are the pose estimation operation ( 730, it can be determined from the first image 710. The main points a1, a2, b1, b2, c1, c2, d1, d2, e1, e2, f1, f2, g1, g2, h, i1, i2 are easy to identify the shape of the subject 713. It may be a position within one subject 713 . The main points (a1, a2, b1, b2, c1, c2, d1, d2, e1, e2, f1, f2, g1, g2, h, i1, i2) are, for example, the subject 713 These may be locations where joints in the body exist. That is, the main points (a1, a2, b1, b2, c1, c2, d1, d2, e1, e2, f1, f2, g1, g2, h, i1, i2) are near both wrists (a1, a2) , near both elbows (b1, b2), near both pelvis (c1, c2), near both knees (e1, e2), near both ankles (f1, f2), both ears (g1, g2), nose (h) or It may be provided in both eyes i1 and i2. The skeleton lines 725 displayed in the second image 720 are main points (a1, a2, b1, b2, c1, c2, d1, d2, e1, e2, f1, f2, g1, g2, h, i1 , i2) may be formed to be connected by one or a plurality of solid lines.

FIG. 8 illustrates an example of identifying a main body position in an electronic device (eg, the electronic device 101 of FIG. 1 or the body size measurement device 400 of FIG. 4) according to an embodiment of the present disclosure. it is a drawing

Referring to FIG. 8 , image (a) according to an embodiment may be an original image 810 for measuring body dimensions, and image (b) may be an original image (segmentation) using a segmentation technique 840 ( 810) may be the original contour image 820 representing the shape of the subject, and the image (c) may be an interpolated contour image 830 obtained from the original contour image 820 by performing the matching operation 850. there is. The original image 810 may include a subject 811 taking a pose in which body measurement is easy. The original contour image 820 may include the contour 821 obtained by extracting the edge of the subject 811 included in the original image 810 . The interpolated contour image 830 includes some main points within the contour line 821 included in the original contour image 820 (eg, main points a1, a2, b1, b2, c1, c2, d1, d2, e1, e2, f1, f2)) and/or skeleton lines 831 (eg, skeleton lines 725 in FIG. 7). In the interpolated contour image 830, some or all of the main points (a1, a2, b1, b2, c1, c2, d1, d2, e1, e2, f1, f2) and/or the skeleton line 831 are the original contour It may be resized and/or positioned to match image 820 . This is because the size and/or position of the subject used to identify the pose (the subject 713 in FIG. 7 ) and the subject 811 used for contour detection may not completely match.

9 illustrates an example of reference measurement points for body size measurement in an electronic device (eg, the electronic device 101 of FIG. 1 or the body size measuring device 400 of FIG. 4) according to an embodiment of the present disclosure. it is a drawing

Referring to FIG. 9 , an image (a) according to an exemplary embodiment shows reference points (P11, P12, P21, P22, P31, P32, P41, P42, P51, P52, P61, P62, P71, P72, P81) may be the front image 910 of the subject 911, and image (b) may be the reference points P13, P14, P23, P24, P33, P34, P43, P44, P53 for measuring the body size. . P36 , P45 , P46 , P55 , P56 , P65 , P66 , P75 , P76 , P81 , P9 , P10 ) may be displayed as the rear image 930 of the subject 931 .

According to an embodiment, the image (a), image (b), or image (c) may include main points and bone lines corresponding to a direction (eg, front, side, or back) of the subject. For example, in the image (a) including the front subject 911, the main points (a1, a2, b1, b2, c1, c2, d1, d2, e1, e2, f1, f2) and the skeleton line 913 are included. Main points (a1, b1, c1, d1, e1, f1) and a skeleton line 923 may be displayed in the image (b) including the right side object 921, and the back side object 931 ), main points (a1, a2, b1, b2, c1, c2, d1, d2, e1, e2, f1, f2) and the skeleton line 933 may be displayed.

According to one embodiment, in image (a), image (b), or image (c), both endpoints of main body parts (eg, neck, shoulder, chest, waist, pelvis, hip, thigh) for body measurement are set. Although indicated as reference points, it is not limited thereto, and more than two reference points may be estimated for each main body part, or a different number of reference points may be used for each main body part. For example, in the image (a), image (b), or image (c), the reference points near the neck are indicated as P11, P12, P13, P14, P15, or P16, and the reference points near the shoulder are indicated as P21, P22, P23, Reference points near the chest were marked as P24, P25 or P26, reference points near the chest were marked as P31, P32, P33, P34, P35 or P36, reference points near the waist were marked as P41, P42, P43, P44, P45 or P46, and pelvis Nearby reference points were marked as P51, P52, P53, P54, P55 or P56, reference points near the hip were marked as P61, P62, P63, P64, P65 or P66, reference points near the thigh were marked as P71, P72, P73, It was marked as P74, P75 or P76, and the reference point near the crotch was marked as P81. Reference points for measuring height in image (c) are marked as P9 and P10.

10 is a diagram of measurement points to obtain depth information for body size measurement in an electronic device (eg, the electronic device 101 of FIG. 1 or the body size measuring device 400 of FIG. 4) according to an embodiment of the present disclosure. It is a diagram showing an example of a masked image.

Referring to FIG. 10 , in a masking image 1010 according to an embodiment, a lidar sensor (eg, the lidar sensor 430 of FIG. 4 ) provides depth information to an image including a subject 1020 whose body size is to be measured. It is an image masking measurement points 1030 prepared to measure . The masking image 1010 includes reference points to be considered for measuring the body size (eg, reference points P11, P12, P13, P14, P15, P16, P21, P22, P23, P24, P25, P26, P24, P25, P26, P31, P32, P33, P34, P35, P36, P41, P42, P43, P44, P45, P46, P51, P52, P53, P54, P55, P56, P61, P62, P63, P64, P65, P66, P71, Reference measurement points, which are measurement points corresponding to P72, P73, P74, P75, P76, P81)), and/or auxiliary measurement points, which are measurement points located on measurement lines prepared by the reference points, can be considered. For example, the masking image 1010 is used to calculate location information (eg, x-axis and y-axis coordinate values) and/or depth information (eg, z-axis coordinate values) of reference measurement points and/or auxiliary measurement points. can be used

11 illustrates an example of measurement lines for measuring body size in an electronic device (eg, the electronic device 101 of FIG. 1 or the body size measuring device 400 of FIG. 4) according to an embodiment of the present disclosure. it is a drawing

Referring to FIG. 11 , an image (a) according to an embodiment includes an outline 1100 of a subject on which front measurement lines 1112, 1113, 1114, 1115, 1116, 1117, and 1118 for measuring body dimensions are displayed. It may be a frontal image 1110, and image (b) is a right side image including the contour line 1100 of a subject marked with right side measurement lines 1122, 1123, 1124, 1125, 1126, 1127 and 1128 for measuring body dimensions. (1120), and the image (c) is a rear image (1130) including an outline (1100) of a subject marked with rear measurement lines (1132, 1133, 1134, 1135, 1136, 1137, 1138) for measuring body dimensions. ) can be.

According to an embodiment, the image (a), image (b), or image (c) may include main points and bone lines corresponding to a direction (eg, front, side, or back) of the subject. For example, in the image (a) including the front subject 1141, the main points (a1, a2, b1, b2, c1, c2, d1, d2, e1, e2, f1, f2) and the skeleton line 1111 are included. Main points (a1, b1, c1, d1, e1, f1) and a skeleton line 1121 may be displayed in the image (b) including the right side object 1142, and the back side object 1143 ), main points a1, a2, b1, b2, c1, c2, d1, d2, e1, e2, f1, f2 and the skeleton line 1131 may be displayed.

According to one embodiment, reference points P11, P12, P13, P14, P15 or P16 near the neck and reference points P21, P22, P23, P24 near the shoulder in image (a), image (b) or image (c). , P25 or P26, reference points near the chest P31, P32, P33, P34, P35 or P36, reference points near the waist P41, P42, P43, P44, P45 or P46, reference points near the pelvis P51, P52, P53, P54, P55 or P56, reference points near the hip P61, P62, P63, P64, P65 or P66, reference points near the thigh P71, P72, P73, P74, P75 or P76, reference points near the crotch P81, measure height Reference points P9 and P10 are omitted from the drawing, but may be applied in the same manner as shown in FIG. 9 .

12 is a diagram illustrating an example of body measurements measured by an electronic device (eg, the electronic device 101 of FIG. 1 or the body size measuring device 400 of FIG. 4) according to an embodiment of the present disclosure. .

Referring to FIG. 12 , image (a) according to an embodiment may be a frontal image 1210 including an outline of a subject marked with a frontal height measurement line 1211 for measuring height, which is one of body dimensions. (b) may be a rear image 1220 including an outline of a subject marked with a rear height measurement line 1221 to measure height, which is one of body dimensions. Reference points considered to obtain the front height measurement line 1211 or the back height measurement line 1221 may be the top point of the head (P_top) and the bottom point (P_bottom) where the soles of the feet are located. That is, the front height measurement line 1211 or the back height measurement line 1221 may be a straight line vertically connecting the head end point P_top and the bottom point P_bottom.

According to an embodiment, the image (a) or the image (b) includes main points (eg, main points (a1, a2, b1, b2, a1, a2, b1, b2, c1, c2, d1, d2, e1, e2, f1, f2) and bone lines (eg, bone lines 913 and 933 in FIG. 9 ) and/or reference points that are main positions of the body (eg, reference points in FIG. 9 ). (P11, P12, P13, P14, P15, P16, P21, P22, P23, P24, P25, P26, P31, P32, P33, P34, P35, P36, P41, P42, P43, P44, P45, P46, P51 , P52, P53, P54, P55, P56, P61, P62, P63, P64, P65, P66, P71, P72, P73, P74, P75, P76, P81)) and/or measurement lines (e.g. front of FIG. 11) Measurement lines 1112, 1113, 1114, 1115, 1116, 1117, 1118, 1119 or side measurement lines 1122, 1123, 1124, 1125, 1126, 1127, 1128 or rear measurement lines 1132, 1133, 1134, 1135 . the same could be applied.

FIG. 13 illustrates an example of displaying body measurements measured by an electronic device (eg, the electronic device 101 of FIG. 1 or the body size measuring device 400 of FIG. 4) according to an embodiment of the present disclosure on a display. It is an illustrated drawing.

Referring to FIG. 13 , dimensions of each major body item according to an embodiment may be displayed on a display 1310 provided in an electronic device 1300 . For example, the display 1310 may display an image 1320 of a subject, main body items for the image 1320, or measured dimensional values for each of the main body items. The main body items whose dimensions are displayed on the display 1310 include height 1331, shoulder 1332, chest 1333, waist 1334, pelvis 1335, hip 1336, or thigh 1337. can do.

14 is a control flowchart for body measurement performed by an electronic device (eg, the electronic device 101 of FIG. 1 ) according to an embodiment of the present disclosure.

Referring to FIG. 14 , in operation 1401, the electronic device 101 may determine whether a user's body size measurement request is detected. The user's request for body size measurement may be detected, for example, when the user presses a function key requesting body size measurement or when the user executes an application program for body size measurement.

According to an embodiment, when detecting a body size measurement request, the electronic device 101 activates a camera module (eg, the camera module 180 of FIG. 1 or the camera module 420 of FIG. 4 ) in operation 1403 . to obtain a preview image, and output the obtained preview image through a display (eg, the display device 160 of FIG. 1 ). The preview image may be an image intended to precede an image obtained by photographing, rather than an image obtained by actual photographing. The preview image may be made in a thumbnail format, for example.

According to another embodiment, when the electronic device 101 detects a body size measurement request, in operation 1403, the electronic device 101 photographs a subject through the camera module 420 to acquire an actually photographed image, and displays the obtained image. (eg, the display device 160 of FIG. 1). In the following description, for convenience, it will be described on the premise of a preview image, but the corresponding operation is not necessarily limited to the preview image, and may be equally applied to an image that is actually captured.

According to an embodiment, in operation 1405, the electronic device 101 selects main points (eg, the subject 713 of FIG. 7 , a person included in the image) included in the preview image. Key points (a1, a2, b1, b2, c1, c2, d1, d2, e1, e2, f1, f2, g1, g2, h, i1, i2) can be determined. The main points (a1, a2, b1, b2, c1, c2, d1, d2, e1, e2, f1, f2, g1, g2, h, i1, i2) are within the subject to easily identify the shape of the subject. can be a position in The main points (a1, a2, b1, b2, c1, c2, d1, d2, e1, e2, f1, f2, g1, g2, h, i1, i2) are, for example, the presence of joints in the body may be locations. That is, the main points (a1, a2, b1, b2, c1, c2, d1, d2, e1, e2, f1, f2, g1, g2, h, i1, i2) are near both wrists (a1, a2) , near both elbows (b1, b2), near both pelvis (c1, c2), near both knees (e1, e2), near both ankles (f1, f2), both ears (g1, g2), nose (h) or It may be provided in both eyes i1 and i2.

According to an embodiment, in operation 1407, the electronic device 101 determines the main points (a1, a2, b1, b2, c1, c2, d1, d2, e1, e2, f1, f2, g1, g2, h , i1, and i2) are connected with a solid line to create a skeleton line (eg, the skeleton line 725 of FIG. 7), and the shape of the subject can be identified by the skeleton line. For example, when the subject is a person, the shape of the subject may be a pose the person is taking. The electronic device 101 searches for a subject in a preview image based on, for example, a pose estimation technique (eg, the pose estimation 730 of FIG. 7 ), determines main points of the subject, and determines the main points. The shape of the subject can be identified by the skeleton line made by connecting them.

According to an embodiment, in operation 1409, the electronic device 101 may determine whether the pose identified by the bone line coincides with a pose for body size measurement. A pose for measuring the body size may be set in advance. For example, a preset pose for body size measurement may be a pose in which both arms and legs are spread apart to some extent as shown in FIG. 7 . If the identified pose does not match the pose for body size measurement, the electronic device 101 returns to operation 1403 to newly acquire and output a preview image, and then repeats an operation of determining whether the pose is a measurement pose. can

In the above-described operations 1403 to 1409, it has been described that they are performed for one preview image (eg, the front image of the subject), but the present invention is not limited thereto, and the same applies to at least one of the left image, the right image, and the back image. It may be determined whether or not the pose is a dimension measurement by motion.

According to an embodiment, if the identified pose coincides with the pose for body size measurement, the electronic device 101 may acquire an image including the subject through the camera module 420 in operation 1411, and Depth information of a subject may be obtained through an IDA sensor (eg, the lidar sensor 430 of FIG. 4 ). If a substantially photographed image is used to identify the pose of the subject, the electronic device 101 may use the image used to identify the pose of the subject as it is without acquiring the image by additional photographing. The depth information is, for example, the lidar sensor 430 emits a laser beam to preset measurement points (eg, the measurement points 1030 of FIG. 10 ), and returns information reflected from the measurement points 1030. can be obtained based on In this case, depth information may be obtained for each measurement point or only for measurement points disposed on a subject (eg, the subject 1020 of FIG. 10 ).

According to an embodiment, the electronic device 101, in operation 1413, sets an outline (eg, the image 810 of FIG. 8 ) of a subject (eg, the subject 811 of FIG. 8 ) in an image (eg, the image 810 of FIG. 8 ). The contour line 821) may be detected, and an original contour image (eg, the contour image 820) consisting of the detected contour line 821 may be generated. The contour line may be an edge line of the subject 811 . The contour detection technique (eg, operation 840 of FIG. 8 ) of generating the original contour image 820 from the image 810 may use, for example, a segmentation technique.

According to an embodiment, in operation 1415, the electronic device 101 determines the main points (a1, a2, b1, b2, c1, c2, d1, d2, e1, e2, Matching some or all of f1, f2, g1, g2, h, i1, i2) and/or bone lines (eg, bone line 831 in FIG. 8) to the original contour image (eg, operation 850 in FIG. 8) ) to generate an interpolation contour image (eg, the interpolation contour image 830 of FIG. 8 ). The interpolated contour image 830 includes some main points (a1, a2, b1, b2, c1, c2, d1, d2, e1, e2, f1, f2) and/or skeleton lines 831 within the contour line 821. This may be the displayed image. Some or all of the main points (a1, a2, b1, b2, c1, c2, d1, d2, e1, e2, f1, f2, g1, g2, h, i1, i2) and/or the skeleton line 831 ) may be adjusted in size and/or position to match the original contour image. This may be performed when the size and/or position of the subject 713 used to identify the pose and the subject 811 used to detect the contour do not completely match.

In the above-described operations 1411 to 1415, it has been described that they are performed on one preview image (eg, the front image of the subject, the image 810 of FIG. 8), but is not limited thereto, and the left image, the right image, or the back image. For at least one of the images, an interpolation contour image may be generated by the same operation.

According to an embodiment, in operation 1417, the electronic device 101 selects a subject (eg, subjects 911, 921, and 931 of FIG. 9) from an interpolated contour image (eg, the interpolated contour image 910 of FIG. 9). The height and / or position of the main body parts (eg, neck, shoulder, chest, waist, pelvis, hip, thigh) for body measurement in the contour (eg, contour (913, 923, 933) of FIG. 9) Considered reference points (e.g., the reference points of FIG. P42, P43, P44, P45, P46, P51, P52, P53, P54, P55, P56, P61, P62, P63, P64, P65, P66, P71, P72, P73, P74, P75, P76, P81)) can be estimated In FIG. 9, both endpoints of major body parts (eg, neck, shoulder, chest, waist, pelvis, hip, thigh) for body measurement were estimated as reference points, but it is not limited thereto, and more than two for each major body part Reference points may be estimated, or a different number of reference points may be estimated for each major body part. In addition, the reference points are not only the front image of the subject (eg, the front (a) in FIG. 8), but also the side image (eg, the side (b) in FIG. 8) and/or the rear image (eg, the rear (c) in FIG. 8). can also be estimated.

According to an embodiment, in operation 1419, the electronic device 101 may obtain reference measurement points from interpolated contour images (eg, the front, side, or back contour images 1110, 1120, and 1130 of FIG. 11). The electronic device 101, for example, for the purpose of obtaining depth information, measures points previously set in the lidar sensor 430 (eg, the measurement points 1030 of FIG. 10 ) to an interpolated contour image (eg, a drawing By masking the front, side, or back contour images 1110, 1120, and 1130 of 11, the reference points of the interpolated contour images 910, 920, and 930 (eg, reference points P11 and P12 of FIG. 9) , P13, P14, P15, P16, P21, P22, P23, P24, P25, P26, P31, P32, P33, P34, P35, P36, P41, P42, P43, P44, P45, P46, P51, P52, P53 , P54, P55, P56, P61, P62, P63, P64, P65, P66, P71, P72, P73, P74, P75, P76, P81)), or closest measurement points may be obtained as reference measurement points. . The reference measurement points may be obtained by calculating location information (eg, x-axis and y-axis coordinate values) and/or depth information (eg, z-axis coordinate values) of each reference measurement point.

According to an embodiment, in operation 1421, the electronic device 101 may obtain auxiliary measurement points from interpolated contour images (eg, the front, side, or back contour images 1110, 1120, and 1130 of FIG. 11 ). The electronic device 101 includes, for example, a measurement line connecting two reference measurement points obtained for each major body part (eg, front measurement lines 1112, 1113, 1114, 1115, 1116, 1117, and 1118 of FIG. 11 ). , 1119) or side measurement lines 1122, 1123, 1124, 1125, 1126, 1127, 1128 or rear measurement lines 1132, 1133, 1134, 1135, 1136, 1137, 1138), preset measurement points Among the measurement points (eg, the measurement points 1030 of FIG. 10 ), measurement points arranged on each measurement line may be acquired as corresponding measurement points or auxiliary measurement points corresponding to the corresponding reference measurement points. The auxiliary measurement points may be the same for all measurement lines or may be different for each measurement line. The auxiliary measurement points may be obtained by calculating location information (eg, x-axis and y-axis coordinate values) and/or depth information (eg, z-axis coordinate values) of each auxiliary measurement point.

According to an embodiment, in operation 1423, the electronic device 101 selects measurement lines (eg, front measurement lines 1112, 1113, 1114, 1115, 1116, 1117, 1118, and 1119 of FIG. 11) or side measurement lines ( Body measurements may be obtained for each of 1122, 1123, 1124, 1125, 1126, 1127, and 1128 or the rear measurement lines 1132, 1133, 1134, 1135, 1136, 1137, and 1138. For example, the coordinate values and depth values of the reference measurement points and auxiliary measurement points constituting at least one of the front measurement line 1114, the side measurement line 1124, and the rear measurement line 1134 capable of measuring the chest circumference among the measurement lines. A distance between the reference measurement points and the auxiliary measurement points may be calculated using , and a dimension value corresponding to the chest circumference may be obtained by the sum of the calculated distances. For other measurement lines for each major body part, body measurements may be obtained by the same method. The electronic device 101 may record body measurements obtained for each major body part corresponding to the subject in a memory (eg, the memory 450 of FIG. 4 ). The body measurements recorded in the memory 450 may be used by the user to purchase clothes or the like without additional measurement of the body measurements.

According to an embodiment, in operation 1423, the electronic device 101 acquires the head end (eg, P_top of FIG. 12 ) and the heel (eg P_bottom of FIG. 12 ) of the subject, and the head end (eg, P_bottom of FIG. 12 ). The height of the subject (eg, the length of the height measurement lines 1211 and 1221 in FIG. 9 ) using coordinate values indicating the positions of P_top in FIG. 12 and heels (eg, P_bottom in FIG. 12 ) and depth information. ) can be obtained.

According to an embodiment, in operation 1425, the electronic device 101 may output the body measurements of the subject through the display 440 using the body measurements acquired for each measurement line. An example in which the electronic device 101 outputs the body size of the subject through the display 440 is as shown in FIG. 13 . In FIG. 13 , an image 1320 of a subject and a height 1331, a shoulder 1332, a chest 1333, a waist 1334, a pelvis 1335, and a hip ( 1336) or thighs 1337, an example in which measured dimensions are displayed is shown.

According to an embodiment, in operation 1427, the electronic device 101 may determine whether the user requests a product size. For example, a user may request a product size by manipulating a physical key provided in the electronic device 101 or a key displayed on a display to input product-related information such as a product name, clothing type, or desired fit. When a product size request is received by the user, the electronic device 101, in operation 1429, based on product related information such as the product name, clothing type, or desired fit input by the user and the measured body size of the user It is possible to generate suitable size information for a desired product and output it through the display 440.

Table 1 below shows an example of a data table defining the size of a product that can be suggested in consideration of the body size of the electronic device 101 .

size Bust shoulder width Sleeve Length president XS (85) 116 42 61 74 S (90) 120 44 62 75 M95) 124 46 63 76 L (100) 128 48 64 77 XL (105) 132 50 65 78 XXL (110) 136 52 66 79

In <Table 1>, the unit of numerical value is centimeters (cm), and the total length can be the length from the side neck to the hem.

Electronic devices according to various embodiments disclosed in this document may be devices of various types. The electronic device may include, for example, a display device, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. An electronic device according to an embodiment of the present document is not limited to the aforementioned devices.

Various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. For example, a component expressed in the singular number should be understood as a concept including a plurality of components unless the context clearly means only the singular number. It should be understood that the term 'and/or' as used herein encompasses any and all possible combinations of one or more of the listed items. Terms such as 'include,' 'have,' and 'consist of' used in this disclosure are only intended to designate that the features, components, parts, or combinations thereof described in this disclosure exist, and the use of these terms is not intended to exclude the possibility of the presence or addition of one or more other features, components, parts or combinations thereof. In this document, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A Each of the phrases such as "at least one of , B, or C" may include any one of the items listed together in that phrase, or all possible combinations thereof. Terms such as "first", "second", or "first" or "secondary" may simply be used to distinguish a given component from other corresponding components, and may be used to refer to a given component in another aspect (eg, importance or order) is not limited.

The terms "~unit" or "~module" used in various embodiments of this document may include a unit implemented as hardware, software, or firmware, and may include, for example, logic, logic blocks, components, or circuits. The same terms can be used interchangeably. "~unit" or "~module" may be an integrally constituted component or a minimum unit or part of the component that performs one or more functions. For example, according to one embodiment, “~ unit” or “~ module” may be implemented in the form of an application-specific integrated circuit (ASIC).

The term "if" used in various embodiments of this document is interpreted to mean "when" or "when" or "in response to determining" or "in response to detecting" depending on the context. It can be. Similarly, "if it is determined" or "if is detected" is meant to mean "upon determining" or "in response to determining", or "upon detecting" or "in response to detecting", depending on the context. can be interpreted

A program executed by the body size measuring device 1 described throughout this document may be implemented as a hardware component, a software component, and/or a combination of hardware components and software components. A program can be executed by any system capable of executing computer readable instructions.

Software may include a computer program, code, instructions, or a combination of one or more of the foregoing, which configures a processing device to operate as desired or processes independently or collectively. The device can be commanded. Software may be implemented as a computer program including instructions stored in computer-readable storage media. Computer-readable storage media include, for example, magnetic storage media (eg, ROM (Read-Only Memory), RAM (Random-Access Memory), floppy disk, hard disk, etc.) and optical reading media (eg, CD-ROM) (CD-ROM) and DVD (Digital Versatile Disc). Computer-readable storage media may be distributed among networked computer systems so that computer-readable codes may be stored and executed in a distributed manner. The computer program may be distributed (eg downloaded or uploaded) online, via an application store (eg Play Store™) or directly between two user devices (eg smart phones). In the case of online distribution, at least part of the computer program product may be temporarily stored or temporarily created in a device-readable storage medium such as a manufacturer's server, an application store server, or a relay server's memory.

According to various embodiments, each component (eg, module or program) of the above-described components may include a single object or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. there is. According to various embodiments, one or more components or operations among the aforementioned corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by a corresponding component of the plurality of components prior to the integration. . According to various embodiments, the actions performed by a module, program, or other component are executed sequentially, in parallel, iteratively, or heuristically, or one or more of the actions are executed in a different order, or omitted. or one or more other actions may be added.

Claims (20)

In electronic devices,
A camera module configured to provide an image by shooting;
a lidar sensor configured to provide depth information in the image based on preset data points; and
Reference points are identified in the subject included in the image provided from the camera module, and among the preset measurement points, target points corresponding to the identified reference points and the identified reference points are selected. and at least one processor configured to acquire a body size of the subject corresponding to each measurement line by using coordinate values and depth information of auxiliary measurement points located on the measurement lines prepared by the electronic device. According to claim 1,
The electronic device further comprises a display configured to output one or a plurality of body measurements among body measurements acquired in correspondence with the measurement lines, under the control of the at least one processor. According to claim 1,
the at least one processor,
An electronic device configured to identify a pose of the subject based on a pose estimation technique and, if the identified pose is a preset pose, control the camera module to photograph the subject. According to claim 3,
the at least one processor,
An electronic device configured to identify a pose of the subject in a preview image provided from the camera module. According to claim 3,
the at least one processor,
An electronic device configured to control the display to display an image guiding the preset pose. According to claim 3,
the at least one processor,
The electronic device configured to detect an outline of the subject from the image, and provide key points indicating a body skeleton according to the identified pose within the detected outline. According to claim 1,
The at least one processor,
Setting measurement points mapped to the identified reference points among the preset measurement points as the reference measurement points;
The electronic device of claim 1 , wherein among the preset measurement points, measurement points located on the measurement line, except for the reference measurement points, are set as the auxiliary measurement points. According to claim 1,
The image provided from the camera module includes at least one image of a front image, a side image, or a back image of the subject. According to claim 1,
The at least one processor,
An electronic device, wherein a line connecting at least two reference measurement points and auxiliary measurement points disposed between the at least two reference measurement points is set as a measurement line. According to claim 1,
The reference measurement points are one or a plurality of measurement points located around the chest, waist, pelvis, hip, or thigh among the preset measurement points,
The measurement lines are a chest circumference line, a waist circumference line, a pelvis circumference line, a hip circumference line, and a right thigh via one or a plurality of measurement points located around the chest, waist, pelvis, hip, or thigh among the reference measurement points. An electronic device comprising at least two of a circumference line or a left thigh circumference line. A method for measuring body dimensions in an electronic device,
collecting an image of a subject;
collecting depth information from the image based on preset data points;
identifying reference points in the subject included in the image;
obtaining coordinate values and depth information of reference measurement points corresponding to the identified reference points among the preset measurement points and auxiliary measurement points located on measurement lines prepared by the identified reference points; and
and obtaining a body size of the subject corresponding to each measurement line using coordinate values and depth information obtained from the reference measurement points and the auxiliary measurement points. According to claim 11,
The method further comprises outputting one or a plurality of body measurements from among body measurements acquired in correspondence with the measurement lines. According to claim 11,
identifying a pose of the subject based on a pose estimation technique;
If the identified pose is a preset pose, further comprising an operation of photographing the subject. According to claim 13,
The operation of identifying the pose of the subject,
Characterized in that the operation of identifying the pose of the subject in the preview image of the subject, the method. According to claim 13,
Further comprising an operation of displaying an image guiding the preset pose. According to claim 13,
The operation of identifying the pose of the subject,
detecting an outline of the subject from the image; and
and providing main points indicating a body skeleton according to the identified pose within the detected contour line. According to claim 11,
The operation of obtaining the coordinate value and depth information,
setting measurement points mapped to the identified reference points among the preset measurement points as the reference measurement points; and
and setting, among the preset measurement points, measurement points located on the measurement line, other than the reference measurement points, as the auxiliary measurement points. According to claim 11,
The image includes at least one image of a front image, a side image, or a back image of the subject. According to claim 11,
The method further includes setting a line connecting at least two reference measurement points and auxiliary measurement points disposed between the at least two reference measurement points as a measurement line. According to claim 11,
The reference measurement points are one or a plurality of measurement points located around the chest, waist, pelvis, hip, or thigh among the preset measurement points,
The measurement lines are a chest circumference line, a waist circumference line, a pelvis circumference line, a hip circumference line, and a right thigh via one or a plurality of measurement points located around the chest, waist, pelvis, hip, or thigh among the reference measurement points. At least two of a circumference line or a left thigh circumference line.

Images