KR20220093964A - electronic device and sensor data calibration method of electronic device - Google Patents

Abstract

An electronic device according to various embodiments includes a display, a camera for photographing an external device, a short-range communication module for transmitting and/or receiving an Ultra Wide Band (UWB) signal from the external device, a memory, and a processor operatively connected to the camera, the display, the short-range communication module, and the memory, wherein the processor is set to display an image of the external device, which is obtained using the camera, on the display, measure a distance between the electronic device and the external device based on the UWB signal received through the short-range communication module, when the distance is a reference distance, display a first calibration line on the display, when the first calibration line and the image of the external device are at least partially overlapping, calculate first angle information based on the UWB signal and perform a first calibration based on the first angle information. According to the present invention, users can easily calibrate an Angle of Arrival (AoA) value error.

Description

Electronic device and sensor data calibration method of electronic device

This document relates to an electronic device, and to an electronic device including a sensor capable of measuring an angle of arrival (AoA).

Various electronic devices, such as a smart phone, a tablet PC, a portable multimedia player (PMP), a personal digital assistant (PDA), a laptop personal computer, and a wearable device, have been distributed and In addition, communication technology between electronic devices is also rapidly developing.

UWB (ultra-wideband), a next-generation communication technology, uses a very wide frequency band (3.1 to 10.6 GHz) compared to the existing one, and can transmit large amounts of information with low power. UWB has two important functions: a ranging function that accurately measures the distance between two UWB-equipped electronic devices, and an angle of arrival (AoA) function that accurately determines how many degrees an external device is located from a reference. to be.

When manufacturing an electronic device, an initial error of the sensor may occur, and an AoA calibration value may be input in the process to correct this. However, while using the AoA function under actual user conditions, the AoA calibration value may be erased due to hardware (hardware) or software (software) issues, or an error may occur in the AoA calibration value by applying a case or cover to an electronic device. Since it is realistically difficult to supply all of the calibration equipment in the process to the service center, it may be difficult for the service center or the user to directly correct the error.

Various embodiments of the present invention may provide a method for a user to easily correct an AoA value error by himself or at a service center using a communication and camera application using a UWB signal.

The electronic device according to various embodiments includes a display, a camera for photographing an external device, a short-range communication module for transmitting and/or receiving an ultra wide band (UWB) signal from the external device, a memory and the camera, the display, and the A short-range communication module, comprising a processor operatively connected to the memory, wherein the processor displays the image of the external device acquired using the camera on the display, and receives it through the short-range communication module Based on one UWB signal, the distance between the electronic device and the external device is measured, and when the distance is a reference distance, a first calibration line is displayed on the display, and an image of the first calibration line and the external device is displayed. It may be configured to calculate first angle information based on the UWB signal and perform a first calibration based on the first angle information when at least partially overlap.

A method for self-correcting an error of an electronic device according to various embodiments includes an operation of displaying an image of an external device on a display using a camera, and a UWB signal received through a short-distance communication module, between the electronic device and the external device. An operation of measuring a distance, an operation of displaying a first calibration line on the display when the distance is the reference distance, and an operation of displaying a first calibration line on the display when the first calibration line and an image of the external device overlap at least partially based on the UWB signal It may include an operation of calculating one angle information, and an operation of performing a first calibration based on the first angle information.

According to various embodiments, through the present invention, when AoA calibration is required, a user may perform calibration at a service center or directly. The reference distance can be easily adjusted using a jig box, and the AoA error can be corrected in both cases of portrait mode and landscape mode.

1 is a block diagram of an electronic device in a network environment, according to various embodiments of the present disclosure;
2 is a block diagram of an electronic device according to various embodiments of the present disclosure;
3 illustrates an electronic device, an external device, and a jig box according to various embodiments of the present disclosure.
4A, 4B, 4C, and 4D are diagrams of screens displayed on a display when the first calibration is performed according to various embodiments of the present disclosure.
5A and 5B are diagrams illustrating screens displayed on a display when the second calibration is performed after the first calibration is performed according to various embodiments of the present disclosure.
6A and 6B are diagrams illustrating a method of generating angle information based on a distance between a camera and a short-range communication module according to various embodiments of the present disclosure.
7A and 7B are flowcharts of an AoA self-calibration method according to various embodiments.

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments. Referring to FIG. 1 , in a network environment 100 , an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with at least one of the electronic device 104 and the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input module 150 , a sound output module 155 , a display module 160 , an audio module 170 , and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or an antenna module 197 may be included. In some embodiments, at least one of these components (eg, the connection terminal 178 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components (eg, sensor module 176 , camera module 180 , or antenna module 197 ) are integrated into one component (eg, display module 160 ). can be

The processor 120, for example, executes software (eg, a program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 . According to an embodiment, the processor 120 is the main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit) a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, when the electronic device 101 includes the main processor 121 and the sub-processor 123 , the sub-processor 123 may use less power than the main processor 121 or may be set to be specialized for a specified function. can The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The auxiliary processor 123 is, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to an embodiment, the co-processor 123 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, the camera module 180 or the communication module 190). have. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself on which the artificial intelligence model is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example. The artificial intelligence model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.

The memory 130 may store various data used by at least one component of the electronic device 101 (eg, the processor 120 or the sensor module 176 ). The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used in a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output a sound signal to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. The receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display module 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display module 160 may include, for example, a control circuit for controlling a display, a hologram device, or a projector and a corresponding device. According to an embodiment, the display module 160 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input module 150 , or an external electronic device (eg, a sound output module 155 ) connected directly or wirelessly with the electronic device 101 . A sound may be output through the electronic device 102 (eg, a speaker or headphones).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more designated protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication performance through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a LAN (local area network) communication module, or a power line communication module). A corresponding communication module among these communication modules is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR). NR access technology includes high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency) -latency communications)). The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 includes various technologies for securing performance in a high-frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. It may support technologies such as full dimensional MIMO (FD-MIMO), an array antenna, analog beam-forming, or a large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101 , an external electronic device (eg, the electronic device 104 ), or a network system (eg, the second network 199 ). According to an embodiment, the wireless communication module 192 may include a peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency for realizing URLLC ( Example: downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less).

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) other than the radiator may be additionally formed as a part of the antenna module 197 .

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module comprises a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, bottom side) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, an array antenna) disposed on or adjacent to a second side (eg, top or side) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( eg commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or a part of operations executed in the electronic device 101 may be executed in one or more external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 is to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199 . The electronic device 101 may be applied to an intelligent service (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

The electronic device according to various embodiments disclosed in this document may have various types of devices. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

The various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but it should be understood to include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A , B, or C" each may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish the element from other elements in question, and may refer to elements in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively". When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logic block, component, or circuit. can be used as A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

According to various embodiments of the present document, one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101) may be implemented as software (eg, the program 140) including For example, a processor (eg, processor 120 ) of a device (eg, electronic device 101 ) may call at least one command among one or more commands stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the called at least one command. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not include a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store (eg Play Store™) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly between smartphones (eg: smartphones) and online. In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily created in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, module or program) of the above-described components may include a singular or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. have. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

2 is a block diagram of an electronic device according to various embodiments of the present disclosure;

Referring to FIG. 2 , the electronic device 200 may include a display 240 , a camera 250 , a short-range communication module 220 , a processor 210 and/or a memory 230 , and in various embodiments , some of the illustrated components may be omitted or substituted. The electronic device 200 may further include at least some of the configuration and/or functions of the electronic device of FIG. 1 . At least some of the respective components of the illustrated (or not illustrated) electronic device 200 may be operatively, functionally, and/or electrically connected.

According to various embodiments, the display 240 may display various images under the control of the processor 210 . The display 240 may be implemented as any one of a liquid crystal display (LCD), a light-emitting diode (LED) display, or an organic light-emitting diode (OLED) display. and is not limited thereto. The display 240 may be formed as a touch screen that senses a touch and/or proximity touch (or hovering) input using a part of the user's body (eg, a finger) or an input device (eg, a stylus pen). The display 240 may include at least some of the configuration and/or functions of the display module of FIG. 1 .

According to various embodiments, at least a part of the display 240 may be flexible, and may be implemented as a foldable display or a rollable display.

According to various embodiments, the camera 250 may acquire external image data. The camera 250 may acquire image data using various types of image sensors such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). The camera 250 may include at least some of the configuration and/or functions of the camera module 180 of FIG. 1 . The electronic device 200 may place one or more cameras 250 on the front and/or rear of the housing, and hereinafter, unless otherwise specified, image data including an external device is acquired using the rear camera 250 . it may have been

According to various embodiments, the short-range communication module 220 includes various components including an antenna (not shown), an RF front end (not shown), or a communication processor (not shown) supporting short-range wireless communication with an external device. can do. The short-range communication module 220 may support various short-range wireless communication methods (eg, Bluetooth, bluetooth low energy (BLE), or ultra-wideband (UWB), Wi-Fi), and each wireless communication method It may include independent hardware and/or software configurations to support it. The short-range communication module 220 may include at least some of the configuration and/or functions of the communication module 190 of FIG. 1 . According to an embodiment, the short-range communication module 220 may receive a UWB signal through short-range wireless communication with an external device.

According to various embodiments, memory 230 may include a variety of data, including volatile memory (eg, volatile memory 132 of FIG. 1 ) and/or non-volatile memory (eg, non-volatile memory 134 of FIG. 1 ). can be stored temporarily or permanently. The memory 230 may include at least some of the configuration and/or functions of the memory 130 of FIG. 1 , and may store the program 140 of FIG. 1 .

According to various embodiments, the memory 230 may store various instructions that may be executed by the processor 210 . Such instructions may include control commands such as arithmetic and logical operations, data movement, input/output, and the like, which may be recognized by the processor 210 .

According to various embodiments, the processor 210 is operatively with each component of the electronic device 200 such as the display 240 , the camera 250 , the short-range communication module 220 , and the memory 230 . , functionally, and/or electrically connected to each other, may be a configuration capable of performing operations or data processing related to control and/or communication of each component. The processor 210 may include at least some of the configuration and/or functions of the processor 120 of FIG. 1 .

According to various embodiments, there will be no limitations to the arithmetic and data processing functions that the processor 210 can implement on the electronic device 200, but hereinafter, when the AoA calibration value of the electronic device 200 is erased or an error occurs, Various embodiments for self-correcting the error will be described. Operations of the processor 210 to be described later may be performed by loading instructions stored in the memory 230 .

According to various embodiments, the processor 210 may acquire image data by executing the camera 250 . The camera 250 may include a front or rear camera, and when there are a plurality of rear cameras, at least one of them may be used. The processor 210 may display image data acquired through the camera 250 on the display 240 . For example, when the external device is located within the shooting range of the rear camera, the processor 210 may display an image of the external device acquired through the rear camera on the display 240 .

According to various embodiments, the processor 210 may obtain information about the UWB signal received by the short-range communication module 220 . According to an embodiment, the processor 210 may generate distance information by using the acquired information on the UWB signal. It exchanges UWB signals with an external device and can accurately measure the distance to and from the external device through the ranging function. According to an embodiment, the processor 210 may generate angle information using the received UWB signal. Through the AoA function of UWB, it is possible to determine at what degree the external device is located with respect to the electronic device 200 . AoA is one of the position measurement methods, and is a method of calculating a position by measuring an angle at which a signal is received by an individual receiver of an antenna array. The electronic device 200 may measure AOA using an independent positioning technique, and a composite positioning technique linked to wireless communication technologies such as Wi-Fi, UWB, BLE, or TDoA may be applied. A more detailed distance and angle measurement operation will be described later with reference to FIGS. 6A and 6B .

According to various embodiments, the processor 210 may determine whether the distance between the electronic device 200 and the external device is a reference distance. The reference distance may be set to a specific value for a calibration process to be described later, for example, may be about 250 mm. When the distance between the electronic device 200 and the external device is out of a predetermined range within the reference distance, the processor 210 may display a pop-up message indicating this. For example, if the reference distance is 250 mm and the distance between the electronic device 200 and the external device is 200 mm, a pop-up message stating “Put your phone further away” may be displayed on the display 240 . . As another example, if the distance between the electronic device 200 and the external device is 400 mm, a pop-up message stating “the phone is too far away” may be displayed on the display 240 .

According to various embodiments, when the distance between the electronic device 200 and the external device is the reference distance, the processor 210 may provide the notification 440 in a method including at least one of a notification sound, a vibration, or a message.

According to various embodiments, the processor 210 may perform a self-calibration process of the UWB data in a state where the distance between the electronic device 200 and the external device is the reference distance. For example, the electronic device 200 may perform each calibration process on UWB data in a vertical direction and a horizontal direction.

According to various embodiments, when the distance between the electronic device 200 and the external device is the reference distance, the processor 210 may display the first calibration line on the display 240 . For example, the first calibration line may be displayed in the center of the display 240 in the vertical direction while the display 240 is placed in the vertical direction. According to various embodiments, the processor 210 may display the first calibration line overlapping the image acquired by the camera 250, and the first calibration line may be an image at least partially transparent (or translucent). .

According to various embodiments of the present disclosure, the processor 210 may include a short-distance communication module when, in a first mode in which the electronic device 200 captures an object at a first rotation angle, the first calibration line and the image of the external device at least partially overlap. The first angle information may be generated using the UWB signal received from 220 . For example, when the first calibration line and the image of the external device overlap in the portrait mode, angle information about the AoA value generated in the portrait mode may be generated. The first angle information may be, for example, a value obtained by correcting a phase difference of arrival (PDoA) value measured using a UWB signal and calculating an AoA value from the corrected PDoA value. According to various embodiments, the processor 210 may display a calibration button on the display 240 that can be selected to do the calibration process at the current location. For example, the correction button is not limited to a rectangular shape, may be any other shape, and may be displayed in the form of an area without an outline. According to an embodiment, the calibration button may be separately displayed in color or shade, and a message instructing to perform calibration based on currently received UWB data such as 'Set Cal' may be displayed together.

According to various embodiments, the processor 210 may perform the first calibration in which the generated first angle information is stored in an embedded file system (EFS) area of the terminal when a touch input is received on the calibration button. According to an embodiment, when the first calibration is performed, the processor 210 may display a message window indicating that the first calibration is completed on the display 240 .

According to various embodiments, the processor 210 may display the second calibration line on the display 240 after the first calibration is completed. The user may use the second calibration line to correct the AoA error in the second mode of photographing the object at the second rotation angle at which the electronic device 200 is further rotated from the first rotation angle by a predetermined angle. The second calibration line may be displayed in the center of the display 240 in a direction orthogonal to the first calibration line, for example, in a state in which the display 240 is placed in a vertical direction, in a horizontal direction. For example, when the second calibration for the landscape mode is performed after the first calibration for the portrait mode is completed, the second calibration line may be displayed in a direction orthogonal to the first calibration line. The second calibration line may be displayed in the center of the display 240 or may be displayed at another location. Hereinafter, the operation for the second calibration may be performed similarly to the first calibration, and the description of the technical features described above will be omitted below.

According to various embodiments, the processor 210 may check a distance between the camera 250 and the short-range communication module 220 and further perform a first calibration based on the checked distance. Since the user checks the image of the external device through the camera 250, an error may occur as much as the distance from the short-distance communication module 220, which is an actual reference for AoA measurement. In order to correct this, the processor 210 may store information on the distance between the camera 250 and the short-range communication module 220 in the memory 230 and correct the error based thereon.

According to various embodiments, the processor 210 may store the first angle information and the second angle information in the memory 230 . UWB signal information received in the first mode may be corrected using the first angle information, and UWB signal information received in the second mode may be corrected using the second angle information. For example, in the first mode, when the short-range communication module 220 receives a UWB signal and transmits it to the processor 210, the processor 210 calculates a PDoA value from the corresponding signal and then communicates with the external device and the short-distance communication module ( 220), and the corrected PDoA value is converted into an AoA value to generate the first angle information.

According to various embodiments, the processor 210 may not use the AoA calibration value stored in the memory 230 when a cover or the like is removed from the electronic device 200 according to a user's selection. For example, when the user applies a case to the electronic device 200, an error may occur in the AoA value, but when the case is removed, the error may disappear again. In this case, the correction value stored in the memory 230 may be applied only when the case is applied to the electronic device 200 by detecting attachment or detachment of the case.

3 illustrates an electronic device 300 , an external device 310 , and a jig box 320 according to various embodiments of the present disclosure.

According to various embodiments, the electronic device 300 may perform a calibration process of UWB data while maintaining a predetermined reference distance (eg, about 250 mm) with the external device 310 . According to an embodiment, the jig box 320 may be used to position the electronic device 300 and the external device 310 at a reference distance.

Referring to FIG. 3 , the shape of the jig box 320 is not determined as it is possible to include any regular polyhedron, polygonal prism, or sphere, and may not have a symmetrical shape. For example, a first surface of the jig box 320 may have a groove for fixing the electronic device 300 , and a second surface facing the first surface may have a groove for fixing the external device 310 . there may be In one embodiment, the position of the groove may be fixed to a position capable of performing accurate correction, or may be adjusted by a user.

According to various embodiments, the external device 310 may be an electronic device capable of utilizing a UWB function. The external device 310 may generate a UWB signal through wireless communication with a short-range communication module (eg, the short-range communication module 220 of FIG. 2 ) of the electronic device 300 . For example, when the external device 310 transmits a UWB signal, the transmitter in the short-range communication module may detect and receive the UWB signal.

According to various embodiments, the external device 310 and the jig box 320 may be integrally manufactured. For example, the external device 310 is fixed to the jig box 320 , and there may be a groove in which the electronic device 300 can be positioned on a surface opposite to the surface on which the external device 310 is fixed. In this case, the user can perform the calibration with just a few touches without the need to move the electronic device 300 to match the calibration line or the reference distance. According to one embodiment, when the jig box 320 and the external device 310 are not integrated, there may be a separate device capable of detaching the external device 310, and the external device 310 is put into the box. A retractable door for entry may be present.

4A, 4B, 4C, and 4D are diagrams of screens displayed on a display when the first calibration is performed according to various embodiments of the present disclosure.

Referring to FIG. 4A , when the calibration process is executed, the processor (eg, the processor 210 of FIG. 2 ) operates a camera (eg, the camera 250 of FIG. 2 ) and a short-range communication module (eg, the short-range communication of FIG. 2 ) The module 220) may communicate with an external device (eg, the external device 310 of FIG. 3 ) using a UWB signal. The short-range communication module may receive a UWB signal transmitted from an external device and transmit information about the UWB signal to the processor. The processor may generate angle information and distance information by using the information.

According to various embodiments, the electronic device 400 may perform the calibration process in a state where the distance to the external device is located at the reference distance. To this end, when the distance between the electronic device 400 and the external device is different from the reference distance, the processor displays a pop-up message 420 instructing to adjust the location of the electronic device 400 (eg, the display 240 of FIG. 2 ). ) can be displayed on the For example, when the distance between the electronic device 400 and the external device is closer than the reference distance, a pop-up message 420 instructing to further increase the distance may be displayed.

Referring to FIG. 4B , when the distance between the electronic device 400 and the external device is the reference distance, the processor may display the first calibration line 430 on the display. The thickness of the first calibration line 430 may be set to be less than or equal to a specified value in order to reduce a calibration error. According to an embodiment, the first calibration line 430 may include a specific color and/or shade, and may be transparent (or semi-transparent) so that it can be displayed while being overlapped with an image including an external device. The first calibration line 430 may include a designated phrase (eg, cal line).

According to various embodiments, when the distance between the electronic device 400 and the external device is the reference distance, the processor notifies that the electronic device 400 is located at the reference distance through a method including at least one of a sound, vibration, or animation. can give

According to various embodiments, when the reference distance does not match, the processor may erase the first calibration line 430 and display a pop-up message 420 . For example, if the reference distance is 250 mm, the distance between the electronic device 400 and the external device satisfies 250 mm, and after the first calibration line 430 is displayed on the display, the distance becomes closer to 230 mm, the first The calibration line 430 may disappear and a pop-up message 420 may appear on the display prompting the user to distance themselves further. When the user adjusts the reference distance again, the processor may display the first calibration line 430 on the display.

According to various embodiments, the processor may vertically arrange the first calibration line 430 on one surface of the display for the first mode calibration. According to one embodiment, the first calibration line 430 may be located substantially in the center of the display.

According to various embodiments, the processor may simultaneously display the image of the first calibration line 430 on the image data acquired by the camera. For example, when a watch is placed in front of the rear camera of the electronic device 400 , image data of the watch may be displayed on the display and the first calibration line 430 may be displayed to overlap.

Referring to FIG. 4C , when the image 410 of the external device and the image of the calibration line at least partially overlap with the movement of the electronic device 400 or the external device (eg, the external device 310 of FIG. 3 ), the processor The notification 440 may be given to the user in various ways including at least one of a notification sound, vibration, or animation.

According to various embodiments, when the contour of the image 410 of the external device and the contour of the correction line meet or the image 410 of the external device overlaps the correction line, the image 410 of the external device and the first correction line ( 430) may overlap. In order to reduce the error, the thickness of the calibration line may be set to be less than or equal to a specified value.

According to various embodiments, when the image 410 of the external device and the first calibration line 430 overlap, the processor may also display the calibration button 450 on the display. The calibration button 450 is displayed on the lower center of the drawing, but its location is not determined and may be set by the user. The shape of the button is also not limited to a rectangle. The calibration button 450 may include a designated phrase (eg, Set Cal).

According to various embodiments, when the image 410 of the external device and the calibration line do not overlap due to the movement of the electronic device 400 or the external device, the processor removes the notification 440 such as animation and displays the calibration button 450 may not be displayed.

According to various embodiments, when the distance between the electronic device 400 and the external device is different from the reference distance, the processor may remove the display of the first calibration line 430 and display the pop-up message 420 on the display.

According to various embodiments of the present disclosure, when the first calibration line 430 and the image 410 of the external device overlap, the electronic device 400 includes distance information and angle information between the current electronic device 400 and the external device, and the external device. Calibration information for UWB data may be generated based on distance information and angle information obtained from UWB data received from . As another example, the electronic device 400 may generate calibration information based on selection of the calibration button 450 illustrated in FIG. 4C . Referring to FIG. 4C , the processor may perform the first calibration based on a user input (eg, a touch or click) for the calibration button 450 . For example, the electronic device 400 and the external device are separated by a reference distance, the image 410 of the external device and at least a portion of the image of the first calibration line 430 overlap, and a user input to the calibration button 450 When this is received, the processor may store the angle information when the user input is received as the first angle information in a memory (eg, the memory 230 of FIG. 2 ).

Referring to FIG. 4D , according to various embodiments, after performing the first calibration, the processor may erase the first calibration line 430 and the calibration button 450 on the display and display a completion message 460 . For example, the completion message 460 may be freely positioned on the display, and may be displayed in color or shade. As another example, the completion message 460 may include a phrase (eg, calibration completed). According to an embodiment, the processor may temporarily erase or darken image data acquired by the camera while displaying the completion message 460 .

According to various embodiments, only the first calibration may be a completed calibration work. For example, when the user has a problem only in the AoA value in the first mode, only the first calibration that performs the calibration for the corresponding mode may proceed and stop. However, if there is a problem in using the AoA function in the second mode, calibration in the corresponding mode may be performed once more according to the user's setting.

5A and 5B are diagrams illustrating screens displayed on a display (eg, the display 240 of FIG. 2 ) in operation when the second calibration is performed after the first calibration is performed according to various embodiments of the present disclosure. The operation for the second calibration may be performed similarly to the first calibration, and the description of the technical features described above will be omitted below.

Referring to FIG. 5A , when the distance between the electronic device 500 and the external device (eg, the external device 310 of FIG. 3 ) already satisfies the reference distance when performing the second calibration, the processor (eg, the processor of FIG. 2 ) 210) may directly display the second calibration line 520 on the display without displaying a pop-up message (eg, the pop-up message 420 of FIG. 4 ). For example, when the user performs the second calibration immediately after performing the first calibration or uses a jig box (eg, the jig box 320 of FIG. 3 ), the distance between the electronic device 500 and the external device is the standard Since the distance will be maintained, the processor may display the second calibration line 520 directly on the display without the need to display a pop-up message.

According to various embodiments, the processor may perform the first calibration and display the second calibration line 520 on the display. According to one embodiment, the second calibration line 520 may be marked to be substantially orthogonal to the first calibration line (eg, the first calibration line 430 of FIG. 4 ). For example, when the first calibration line is disposed perpendicular to one surface of the display and calibration for the portrait mode is performed, the second calibration line 520 is disposed parallel to the one surface of the display to perform calibration for the landscape mode can

According to various embodiments, when the image 510 of the external device at least partially overlaps the second calibration line 520 , the processor may display the calibration button 550 on the display. The processor may perform the second calibration based on a user input (eg, touch, click) for the calibration button 550 . When a touch input is received on the calibration button 550 , the processor may store angle information when the input is received as second angle information in a memory (eg, the memory 230 of FIG. 2 ).

According to various embodiments, after performing the second calibration, the processor may display the completion message described with reference to FIG. 4D (eg, the completion message 460 of FIG. 4 ).

6A and 6B are diagrams illustrating a method of generating angle information based on a distance between the camera 620 and the short-range communication module 630 according to various embodiments of the present disclosure.

According to various embodiments, the processor (eg, the processor 210 of FIG. 2 ) receives information about the UWB signal from the short-range communication module 630 (eg, the short-range communication module 220 of FIG. 2 ) and transmits the information The PDoA value may be calculated using the PDoA value, and the PDoA value may be corrected based on the distance between the camera 620 (eg, the camera 250 of FIG. 2 ) and the short-range communication module 630 . Thereafter, the processor may convert the PDoA value into an AoA value for use in a calibration process. Hereinafter, the operation of calculating the PDoA value by using information on the UWB signal, the operation of correcting the PDoA value based on the distance between the camera 620 and the short-range communication module 630 , and the operation of converting the PDoA value into an AoA value to be explained.

) 때문에 오차가 발생할 수 있다. 이를 추가로 보정하기 위하여 카메라(620)와 근거리 통신 모듈(630) 사이의 거리를 이용할 수 있다.FIG. 6A is a diagram illustrating a short-range communication module 630 , a camera 620 , and an external device 610 (eg, the external device 310 of FIG. 3 ) of the electronic device 600 . When performing calibration, the user determines the position of the external device 610 based on the camera 620, but the processor calculates the position based on the short-range communication module 630, so the angle difference (

) may cause errors. In order to further correct this, the distance between the camera 620 and the short-range communication module 630 may be used.

According to various embodiments, the processor may extract the PDoA value by Equation 1 below in order to use the information on the UWB signal received from the short-range communication module 630 in the calibration process.

[Equation 1]

: PDoA 변환 값

: PDoA conversion value

: AoA 각도 측정 값

: AoA angle measurement

: distance value

: distance value

: 신호의 파장 추출 값

: Wavelength extraction value of the signal

는 distance value로 전자 장치(600)의 오차 교정을 위하여 튜닝된 값이며, 각 모델마다 다른 값을 가질 수 있다. 예를 들어, 미국형 모델은 distance value가 18mm, 유럽형 모델은 distance value가 17.4mm로 설정될 수 있다.

는 근거리 통신 모듈(630)과 외부 장치(610)가 이용하는 UWB 신호의 파장에서 추출된 값으로, 예를 들어, 파장 값의 절반일 수 있다. UWB에는 다양한 채널(예를 들어 CH5, CH6, CH8, 또는 CH9 등)을 사용하므로 각 채널의 중심주파수 기준의 파장값을 이용하여 계산할 수 있다. 예를 들어,

=19mm인 경우, 상기 식 1을 이용하면 아래의 식 2내지 식 5와 같이 미국형 모델과 유럽형 모델 각각의 PDoA 변환 값을 계산할 수 있다.According to various embodiments, in Equation 1

is a distance value tuned for error correction of the electronic device 600, and may have a different value for each model. For example, the distance value of the American model may be set to 18mm, and the distance value of the European model may be set to 17.4mm.

is a value extracted from the wavelength of the UWB signal used by the short-range communication module 630 and the external device 610, and may be, for example, half of the wavelength value. Since UWB uses various channels (eg, CH5, CH6, CH8, or CH9, etc.), it can be calculated using the wavelength value based on the center frequency of each channel. for example,

=19mm, using Equation 1 above, the PDoA conversion value of each of the US model and the European model can be calculated as shown in Equations 2 to 5 below.

[Equation 2]

[Equation 3]

[Equation 4]

[Equation 5]

Referring to FIG. 6B , a camera 620 and a short-range communication module 630 may be positioned adjacent to the rear surface of the electronic device 600 . For example, the short-range communication module 630 may include a first antenna 632 , a second antenna 634 , or a third antenna 636 . For example, the first antenna 632 , the second antenna 634 , or the third antenna 636 may include a patch antenna. In an embodiment, in the portrait mode, the perpendicular bisector of a line segment connecting the center of the first antenna 632 and the center of the second antenna 634 may be a reference for measuring AoA. If P is a point where the horizontal line passing through the center of the camera 620 and the vertical bisector meet, an error may occur as much as the distance (x) from the center of the camera 620 to the point P. As another example, in the landscape mode, the vertical bisector of the line segment connecting the center of the first antenna 632 and the center of the third antenna 636 may be a reference for AoA measurement. If Q is a point where the vertical line passing through the center of the camera 620 and the perpendicular bisector meet, an error may occur as much as the distance y from the center of the camera 620 to the point Q. The processor may correct an error corresponding to the distance y. Hereinafter, specific calculations will be described through Equations 6 and 7.

According to various embodiments, the processor may generate angle information using the values calculated in Equations 2 to 5 above. Since the values calculated in Equations 2 to 5 are unique characteristic values of the electronic device 600 , the processor may store the calculated values in a config area of a memory (eg, the memory 230 of FIG. 2 ). For example, the processor converts the information about the UWB signal received from the short-range communication module 630 into PDoA, calls the value stored in the config area to make final correction, and then converts the PDoA value to the AoA value to obtain angle information. can create

, 또는

값을 이용해 상기 측정한 AoA 값을 보정할 수 있다. 식 6 및 식 7에서

값 및

값은

값에 비하여 매우 작은 값일 수 있다.According to various embodiments, the processor includes the UWB signal received from the short-range communication module 630, Equations 6 and 7 below, and stored in the memory.

, or

The measured AoA value may be corrected using the value. In Equation 6 and Equation 7

value and

value is

It may be a very small value compared to the value.

[Equation 6]

[Equation 7]

: 제1모드에서의 카메라 중심 및 제1안테나와 제2안테나 중심의 AoA 차이 값

: AoA difference value between the center of the camera and the center of the first antenna and the center of the second antenna in the first mode

: 제2모드에서의 카메라 중심 및 제1안테나와 제3안테나 중심의 AoA 차이 값

: AoA difference value between the center of the camera and the center of the first and third antennas in the second mode

: 전자 장치(600)와 외부 장치(610)의 거리

: Distance between the electronic device 600 and the external device 610

: 제1모드에서의 오차

: Error in 1st mode

: 제2모드에서의 오차

: Error in 2nd mode

는 x 값,

는 y 값일 수 있다. 예를 들어, 제1모드가 portrait mode, 제2모드가 landscape mode인 경우,

는 x축의 오차값,

는 y축 오차값일 수 있다. 프로세서는 상기 식 6, 식 7 및 메모리에 저장되어 있는

,

값을 이용해 상기 측정한 AoA 값을 보정할 수 있다. 예를 들면, 전자 장치(600)와 외부 장치(610)의 거리가 250mm이고

가 40.49mm,

가 25.23mm인 경우

는

,

는

로 계산할 수 있다. 예컨대, 카메라(620), 외부 장치(610), 근거리 통신 모듈(630)이 이루는 각도는 제1모드에서는

, 제2모드에서는

일 수 있다. 따라서 카메라(620)가 느끼는 각도는 실제 근거리 통신 모듈(630)이 판단하는 각보다 제1모드에서는

틀어지게, 제2모드에서는

틀어지게 판단할 수 있다. 프로세서는 이를 고려하여 오차가 생기는 값만큼 보정하여 최종 AoA 값을 산출할 수 있다. 예를 들어, 계산한 제1모드 AoA 값에서

만큼 빼고, 제2모드 AoA 값에서

만큼 빼서 최종 값을 산출할 수 있다.Referring to Figure 6b,

is the x value,

may be a y value. For example, when the first mode is a portrait mode and the second mode is a landscape mode,

is the error value of the x-axis,

may be a y-axis error value. The processor may have Equation 6, Equation 7 and the memory stored in the memory.

,

The measured AoA value may be corrected using the value. For example, the distance between the electronic device 600 and the external device 610 is 250 mm.

is 40.49mm,

is 25.23mm

Is

,

Is

can be calculated as For example, the angle formed by the camera 620 , the external device 610 , and the short-range communication module 630 is in the first mode.

, in the second mode

can be Therefore, the angle felt by the camera 620 is greater than the angle determined by the actual short-range communication module 630 in the first mode.

Wrong, in the second mode

can be judged wrong. The processor may calculate the final AoA value by taking this into consideration and correcting as much as an error occurs. For example, in the calculated first mode AoA value,

subtracted from the second mode AoA value

The final value can be calculated by subtracting by

According to various embodiments, the calibration process may be performed by aligning the center of the electronic device 600 with the center of the external device 610 without using the illustrated method. For example, when the center of the external device 610 and the center of the electronic device 600 are overlapped and the electronic device 600 is executed, the calibration process may be automatically performed.

7A and 7B are flowcharts of an AoA self-calibration method according to various embodiments.

The illustrated method may be performed by the electronic device described with reference to FIGS. 1 to 6 (eg, the electronic device 200 of FIG. 2 ), and descriptions of technical features described above will be omitted below. .

According to various embodiments, the electronic device may acquire image data by executing a camera (eg, the camera 250 of FIG. 2 ). The camera may use a front or rear camera, and when there are a plurality of rear cameras, at least one of them may be used. The electronic device may display image data acquired through the camera on a display (eg, the display 240 of FIG. 2 ). For example, when an external device (eg, the external device 310 of FIG. 3 ) is located within the shooting range of the rear camera, the electronic device acquires an image of the external device through the rear camera (eg, the image of the external device of FIG. 4 ). image 410) may be displayed on the display.

According to various embodiments, in operation 710 , the electronic device may obtain information about the UWB signal received by the short-range communication module (eg, the short-range communication module 220 of FIG. 2 ). According to an embodiment, the electronic device may generate distance information by using the acquired information on the UWB signal. A UWB signal is exchanged with an external device, and the distance to the external device can be measured through the ranging function. According to an embodiment, the electronic device may generate angle information using the received UWB signal. Through the AoA function of UWB, it is possible to determine what degree the external device is in relation to the electronic device. AoA is one of the position measurement methods, and is a method of calculating a position by measuring an angle at which a signal is received by an individual receiver of an antenna array. The electronic device may measure AoA using an independent positioning technique, and a composite positioning technique in connection with wireless communication technologies such as Wi-Fi, UWB, BLE, or TDoA may be applied.

According to various embodiments, in operation 720, the electronic device may determine whether the distance between the electronic device and the external device is a reference distance. The reference distance may be set to a value specified for the calibration process, for example, about 250 mm. In an embodiment, when the distance between the electronic device and the external device is out of a predetermined range within the reference distance, the electronic device may display a pop-up message indicating this (eg, the pop-up message 420 of FIG. 4 ). For example, when the reference distance is 250 mm and the distance between the electronic device and the external device is 200 mm, a pop-up message stating "Put your phone further away" may be displayed on the display. As another example, if the distance between the electronic device and the external device is about 400 mm, a pop-up message stating “the phone is too far away” may be displayed on the display.

According to various embodiments, in operation 724, when the distance between the electronic device and the external device is the reference distance, the electronic device notifies the electronic device by a method including at least one of a notification sound, a vibration, and a message (eg, a notification 440 of FIG. 4 ). ) can be given.

According to various embodiments, the electronic device may perform the self-calibration process of the UWB data in a state where the distance between the electronic device and the external device is the reference distance. For example, the electronic device may perform respective calibration processes on UWB data in a vertical direction and a horizontal direction.

According to various embodiments, in operation 726, when the distance between the electronic device and the external device is the reference distance, the electronic device may display a first calibration line (eg, the first calibration line 430 of FIG. 4 ) on the display. have. For example, the first calibration line may be displayed in the center of the display in the vertical direction while the display is placed in the vertical direction. According to various embodiments, the electronic device may display the first calibration line overlapping the image acquired by the camera, and the first calibration line may be, for example, an image at least partially transparent (or translucent).

According to various embodiments, in operation 730 , the electronic device may determine whether the image of the external device (eg, the image 410 of the external device of FIG. 4 ) overlaps with the first calibration line. When the image of the external device and the first calibration line do not overlap, the calibration button (eg, the calibration button 450 of FIG. 4 ) may not be displayed until they overlap. In operation 732, when the first calibration line and the image of the external device at least partially overlap, the electronic device may generate first angle information using the UWB signal received from the short-range communication module and display the calibration button on the display . The first angle information may be a value converted into an AoA value after correcting a PDoA value measured using a UWB signal. The correction button is not limited to the illustrated rectangular shape and may be any other shape or may be displayed in the form of an area without an outline. According to an embodiment, the calibration button may be separately displayed in color or shade, and a message instructing to perform calibration based on currently received UWB data such as 'Set Cal' may be displayed together.

According to various embodiments, in operation 740 , the electronic device may perform the first calibration in which the first angle information generated when a touch input is received on the calibration button is stored in the EFS area of the terminal. According to an embodiment, when the first calibration is performed, the electronic device may display a message window indicating that the first calibration has been completed on the display.

According to various embodiments, in operation 750 , the electronic device may display a second calibration line (eg, the second calibration line 520 of FIG. 5 ) on the display after the first calibration is completed. For example, the second calibration line may be displayed in the center of the display in a direction substantially orthogonal to the first calibration line, eg, in a horizontal direction with the display lying in the vertical direction. The second calibration line may be displayed in the center of the display or may be displayed in another location. Hereinafter, the operation for the second calibration may be performed similarly to the first calibration, and the description of the technical features described above will be omitted below.

According to various embodiments, the electronic device may check the distance between the camera and the short-range communication module, and may further perform the first calibration based on the checked distance. Since the user checks the image of the external device through the camera, an error may occur as much as the distance from the short-range communication module, which is the actual standard for AoA measurement. In order to correct this, the electronic device may store information on the distance between the camera and the short-range communication module in a memory (eg, the memory 230 of FIG. 2 ) and correct the error based thereon.

According to various embodiments, the electronic device may store the first angle information and the second angle information in a memory. UWB signal information received in the first mode may be corrected using the first angle information, and UWB signal information received in the second mode may be corrected using the second angle information.

According to various embodiments, the electronic device may not use the AoA calibration value stored in the memory when the cover is removed from the electronic device according to a user's selection. For example, when a user applies a case to an electronic device, an error occurs in the AoA value and requires calibration. However, when the case is removed, the error disappears again, so calibration may not be required. In this case, the correction value stored in the memory may be applied only when the case is applied to the electronic device by detecting the attachment or detachment of the case.

According to various embodiments, the electronic device may perform a calibration process of UWB data while maintaining a predetermined reference distance with the external device. A jig box (eg, the jig box 320 of FIG. 3 ) may be used to position the electronic device and the external device at a reference distance.

According to various embodiments, the shape of the jig box is not determined because anything including a regular polyhedron, a polygonal prism, and a sphere is possible, and may not be a symmetrical shape. For example, a groove for fixing an electronic device may be provided on a first surface of the jig box, and a groove for fixing an external device may be provided on a second surface facing the first surface. The position of the groove may be fixed at a position where accurate correction can be performed, or may be adjusted by the user.

According to various embodiments, the external device may be an electronic device capable of utilizing a UWB function. The external device may generate a UWB signal through wireless communication with a short-range communication module of the electronic device. For example, when an external device transmits a UWB signal, the transmitter in the short-range communication module may detect and receive the UWB signal.

According to various embodiments, the external device and the jig box may be integrally manufactured. For example, the external device is fixed to the jig box, and there may be a groove in which the electronic device can be positioned on a surface opposite to the surface on which the external device is fixed. In this case, the user can perform the calibration with just a few touches without the need to move the electronic device to match the calibration line or the reference distance. According to an embodiment, when the jig box and the external device are not integrated, there may be a separate device for detaching the external device, and there may be an opening/closing door for inserting the external device into the box.

According to various embodiments, when the calibration process is executed, the electronic device may operate a camera and allow the short-distance communication module to communicate with an external device using a UWB signal. The short-range communication module may receive a UWB signal transmitted from an external device and transmit information about the UWB signal to the electronic device. The electronic device may generate angle information and distance information by using the information.

According to various embodiments, the electronic device may perform the calibration process in a state where the distance to the external device is located at the reference distance. To this end, when the distance between the electronic device and the external device is different from the reference distance, the electronic device may display a pop-up message instructing to adjust the location of the electronic device on the display. For example, when the distance between the electronic device and the external device is closer than the reference distance, a message instructing to further increase the distance may be displayed.

According to various embodiments, when the distance between the electronic device and the external device is the reference distance, the electronic device may display the first calibration line on the display. The thickness of the first calibration line may be set to be less than or equal to a specific value in order to reduce a calibration error. According to an embodiment, the first correction line may include a specific color and/or shade, and may be transparent (or translucent) so that it can be displayed while being overlapped with an image including an external device. The first calibration line may include a designated phrase (eg, cal line).

According to various embodiments, when the distance between the electronic device and the external device is the reference distance, the electronic device may notify that the electronic device is located at the reference distance through a method including at least one of a notification sound, vibration, and animation. According to an embodiment, when the reference distance does not match, the electronic device may erase the first calibration line and display the pop-up message again.

According to various embodiments, the electronic device may vertically arrange the first calibration line on one surface of the display for the first mode calibration. According to an embodiment, the first calibration line may be located in the center of the display.

According to various embodiments, the electronic device may simultaneously display the image of the first calibration line on the image data acquired by the camera. For example, when the watch is placed in front of the rear camera of the electronic device, image data of the watch may be displayed on the display and the first calibration line may be overlapped and displayed on the display.

According to various embodiments, when the image of the external device and the image of the calibration line overlap at least partially due to the movement of the electronic device or the external device, the electronic device provides the user with various methods including at least one of a notification sound, vibration, and animation. can give you a notification.

According to various embodiments, when the contour of the image of the external device meets the contour of the correction line or the image of the external device overlaps the correction line, the image of the external device and the first correction line may overlap. In order to reduce the error, the thickness of the calibration line may be set to a specific value or less.

According to various embodiments, when the image of the external device and the first calibration line overlap, the electronic device may also display the calibration button on the display. The calibration button is displayed on the lower center of the drawing, but the location is not fixed and may be set by the user. The shape of the button is also not limited to a rectangle. The calibration button may include a specific phrase (eg, Set Cal).

According to various embodiments, when the image of the external device and the calibration line do not overlap due to the movement of the electronic device or the external device, the electronic device may cancel a notification such as an animation and not display the calibration button on the display.

According to various embodiments, when the distance between the electronic device and the external device is different from the reference distance, the electronic device may remove the display of the first calibration line and display a pop-up message on the display.

According to various embodiments of the present disclosure, when the first calibration line and the image of the external device overlap, the electronic device uses distance and angle information between the current electronic device and the external device, and the distance and angle information obtained from UWB data received from the external device. Based on this, calibration information for UWB data may be generated. Alternatively, the electronic device may generate calibration information based on selection of the calibration button.

According to various embodiments of the present disclosure, the electronic device may perform the first calibration based on a user input (eg, touch, click) for the calibration button. For example, when the electronic device and the external device are separated by a reference distance, the image of the external device overlaps at least a portion of the image of the first calibration line, and a user input is received on the calibration button, the electronic device receives the user input The angle information at the time may be stored in the memory as the first angle information.

According to various embodiments, after performing the first calibration, the electronic device may erase the first calibration line and the calibration button and display a completion message (eg, the completion message 460 of FIG. 4 ) on the display. The completion message can be freely placed on the display and displayed in color or shade. The completion message may include a phrase (eg calibration completed). According to an embodiment, the electronic device may temporarily erase or darken image data acquired by the camera while displaying the completion message.

According to various embodiments, only the first calibration may be a completed calibration work. For example, when the user has a problem only in the AoA value in the first mode, only the first calibration that performs the calibration for the corresponding mode may proceed and stop. However, if there is a problem in using the AoA function in the second mode, calibration in the corresponding mode may be performed once more according to the user's setting.

According to various embodiments, when the distance between the electronic device and the external device already satisfies the reference distance when performing the second calibration, the electronic device may directly display the second calibration line on the display without displaying a pop-up message. For example, when the user performs the second calibration immediately after performing the first calibration or uses a jig box, the distance between the electronic device and the external device maintains the reference distance, so the electronic device can immediately display a pop-up message without displaying a pop-up message. A second calibration line may be displayed on the display.

According to various embodiments, the electronic device may perform the first calibration and display the second calibration line on the display. According to one embodiment, the second calibration line may be marked to be orthogonal to the first calibration line. For example, when the first calibration line is disposed perpendicular to one surface of the display to perform calibration for the first mode, the second calibration line is disposed parallel to one surface of the display to perform calibration for the second mode .

According to various embodiments, when the image of the external device at least partially overlaps the second calibration line, the electronic device may display a calibration button on the display. The electronic device may perform the second calibration based on a user input (eg, touch, click) for the calibration button. When a touch input is received on the calibration button, the electronic device may store angle information when the input is received as second angle information in the memory.

According to various embodiments, after performing the second calibration, the electronic device may display the completion message described with reference to FIG. 4D .

7B illustrates an operation 710 in which the electronic device receives information on a UWB signal from a short-range communication module to generate distance information and angle information. In operation 711, the electronic device may receive information on the UWB signal from the short-range communication module and measure a distance between the electronic device and the external device by using the information. In operation 712, the electronic device may calculate a PDoA value based on the received information on the UWB signal. In operation 713 , the electronic device may correct the PDoA value based on the distance between the external device and the electronic device and the distance between the camera and the short-range communication module. Thereafter, in operation 715 , the electronic device may convert the corrected PDoA value to an AoA value for use in the calibration process and perform calibration. Hereinafter, the operation of calculating the PDoA value using information about the UWB signal, the operation of correcting based on the distance between the external device and the electronic device and the distance between the camera and the short-range communication module, and converting the corrected PDoA value into the AoA value Let me explain the operation.

) 때문에 오차가 발생할 수 있다. 이를 추가로 보정하기 위하여 카메라와 근거리 통신 모듈 사이의 거리를 이용할 수 있다.According to various embodiments, when performing calibration, the user determines the position of the external device based on the camera, but the electronic device calculates the position based on the short-range communication module, so the angle difference (

) may cause errors. In order to further correct this, the distance between the camera and the short-range communication module may be used.

According to various embodiments, a camera and a short-range communication module may be positioned on the rear side of the electronic device. For example, the short-range communication module may include a first antenna, a second antenna, or a third antenna. In portrait mode, the vertical bisector of the line connecting the center of the first antenna and the center of the second antenna can be the standard for AoA measurement. If P is a point where the horizontal line passing through the center of the camera and the vertical bisector meet, an error may occur as much as the distance (x) from the center of the camera to the point P. Similarly, in the landscape mode, the vertical bisector of the line connecting the center of the first antenna and the center of the third antenna may be the standard for AoA measurement. If Q is the point where the vertical line passing through the center of the camera and the perpendicular bisector meet, an error may occur as much as the distance y from the center of the camera to the point Q. The electronic device may correct an error corresponding to the distance y. The electronic device may perform calibration using Equations 1 to 7 described above.

According to various embodiments, since the values calculated in Equations 4 to 7 are unique characteristic values of the electronic device, the electronic device may store the calculated values in advance in the config area of the memory. For example, the electronic device calculates the distance and PDoA value between the electronic device and the external device based on the information about the UWB signal received from the short-range communication module, converts it into AoA, and uses the value already stored in the config area. By calling it, you can generate angle information through final correction.

According to various embodiments, the calibration process may be performed by aligning the center of the electronic device with the center of the external device without using the illustrated method. For example, when the center of the external device and the center of the electronic device are overlapped and the electronic device is executed, the calibration process may be automatically performed.

Claims (20)

In an electronic device,
display;
a camera for photographing an external device;
a short-range communication module for transmitting and/or receiving an ultra wide band (UWB) signal from the external device;
Memory; and
a processor operatively connected to the camera, the display, the short-range communication module, and the memory;
The processor is
Displaying the image of the external device acquired using the camera on the display,
measuring the distance between the electronic device and the external device based on the UWB signal received through the short-range communication module;
When the distance is the reference distance, display a first calibration line on the display,
When the first calibration line and the image of the external device at least partially overlap, calculating first angle information based on the UWB signal,
An electronic device configured to perform a first calibration based on the first angle information.
The method of claim 1,
The processor is
Check the distance between the camera and the short-range communication module,
The electronic device is configured to further perform a first calibration based on the identified distance.
The method of claim 1,
The processor is
After performing the first calibration on the first calibration line,
An electronic device configured to display a second calibration line orthogonal to the first calibration line on the display.
4. The method of claim 3,
The processor is
calculating second angle information based on the UWB signal when the second calibration line and the image of the external device at least partially overlap;
An electronic device configured to perform a second calibration based on the second angle information.
5. The method of claim 4,
The processor is
Check the distance between the camera and the short-range communication module,
The electronic device is configured to further perform a second calibration based on the identified distance.
4. The method of claim 3,
The processor is
an electronic device configured to display a calibration button on a display when the image of the external device and the first calibration line or the image of the external device and the second calibration line overlap at least partially.
7. The method of claim 6,
The processor is
An electronic device configured to perform a first calibration and/or a second calibration when a user receives a touch input on the calibration button.
8. The method of claim 7,
an electronic device configured to store values corrected through the first calibration and the second calibration in the memory.
The method of claim 1,
The processor is
When the distance between the external device and the electronic device is not the reference distance,
An electronic device set up to display pop-up messages.
The method of claim 1,
The processor is
When the distance between the external device and the electronic device is a reference distance,
An electronic device configured to provide a notification by a method including at least one of a vibration, a message, an animation, and a notification sound.
In the error self-correction method of an electronic device,
displaying an image of an external device on a display using a camera;
measuring a distance between the electronic device and the external device based on a UWB signal received through a short-range communication module;
displaying a first calibration line on the display when the distance is a reference distance;
calculating first angle information based on the UWB signal when the first calibration line and the image of the external device at least partially overlap; and
and performing a first calibration based on the first angle information.
12. The method of claim 11,
The operation of performing the first calibration is
checking a distance between the camera and the short-range communication module; and
The method further comprising performing a first calibration based on the identified distance.
12. The method of claim 11,
and after performing the first calibration on the first calibration line, displaying a second calibration line orthogonal to the first calibration line on the display.
14. The method of claim 13,
calculating second angle information based on the UWB signal when the second calibration line and the image of the external device at least partially overlap; and
and performing a second calibration based on the second angle information.
15. The method of claim 14,
The operation of performing the second calibration is
checking a distance between the camera and the short-range communication module; and
The method further comprising performing a second calibration based on the identified distance.
14. The method of claim 13,
and displaying a calibration button on a display when the image of the external device and the first calibration line or the image of the external device and the second calibration line at least partially overlap.
17. The method of claim 16,
and performing a first calibration and/or a second calibration when a user receives a touch input on the calibration button.
18. The method of claim 17,
and storing a value corrected through the first calibration and the second calibration in a memory.
12. The method of claim 11,
and displaying a pop-up message when the distance between the external device and the electronic device is not a reference distance.
12. The method of claim 11,
When the distance between the external device and the electronic device is a reference distance, the method further comprising providing a notification in a method including at least one of vibration, a message, an animation, and a notification sound.

Images