WO2020130267A1

WO2020130267A1 - Electronic device used for provision and maintenance of other electronic device, and control method therefor

Info

Publication number: WO2020130267A1
Application number: PCT/KR2019/009935
Authority: WO
Inventors: 유은경; 김지은; 최혜지
Original assignee: 삼성전자 주식회사
Priority date: 2018-12-19
Filing date: 2019-08-08
Publication date: 2020-06-25
Also published as: KR20200076326A

Abstract

According to various embodiments, an electronic device comprises a communication module, a display, and a processor, wherein the processor can be configured to receive, from a server through the communication module, provision information related to the provision of at least one external electronic device, receive, from a communication device, current state information related to a current provision state of the at least one external electronic device; and output, through the display, a provision guide for the at least one external electronic device, which has been confirmed on the basis of the provision information and current state information, as an augmented reality screen image. Other various embodiments are possible.

Description

Electronic device used for installation and maintenance of other electronic devices and control method thereof

Various embodiments relate to electronic devices used for installation and maintenance of other electronic devices and methods for controlling the same, and more specifically, to installation of other electronic devices, which may be used when installing and maintaining other electronic devices. An electronic device for outputting information and a control method therefor.

Recently, the use of electronic devices such as smart phones, tablet PCs, notebooks, and wearable devices is increasing. In addition, in recent years, various things have been controlled or managed through communication through the activation of Internet of Things (IoT) or Internet of Things (IoT).

In order to use the network using the above-described electronic devices, radio waves may be supplied to the electronic devices using an antenna. In addition, when using a 5G mobile communication system, 5G radio waves have a directional beam shape. Therefore, in order to use the network in an indoor environment, a 5G CPE (customer premises equipment) that receives 5G radio waves from an outdoor 5G antenna and extends 5G radio waves into the home or converts them into Wi-Fi may be used in the home. In addition, a router may be used to use the network in an indoor environment.

In installing and maintaining communication devices such as antennas, 5G CPEs, and routers, the environment around the place where the communication devices are installed may be considered. For example, in the case of an antenna located outdoors, simulation may be preceded by considering the environmental factors in which the antenna is installed. In an existing method of installing and maintaining an antenna, an environmental element around the antenna is identified at a site where the antenna is installed, and a simulation in which the environmental element around the antenna is considered is performed. Thereafter, the simulation results are confirmed by the ground field indicator, and the simulation results are delivered orally to the installer at the top of the pole.

In the above-described method of installing and maintaining the existing antenna, the technician performing the simulation is different from the technician installing and maintaining the antenna in the actual site, so whenever the antenna installation and maintenance is required, the antenna surrounds the site. It is inefficient in terms of manpower utilization to check the environmental factors and perform the simulation. In addition, in the above-described method of installing and maintaining the existing antenna, since the ground field indicator delivers the simulation results to the installer on the pole orally, the efficiency of delivering the simulation results to the installer is low.

According to an electronic device used for installation and maintenance of another electronic device and a control method thereof according to various embodiments, an AR device collects information about an environment around a point where an electronic device is to be installed or is located and transmits it to a server And, after performing the simulation on the server, it is possible to derive information about the proper installation of the electronic device. According to various embodiments, information regarding a suitable installation of the electronic device may be transmitted from the server to the AR device, and output by the AR device.

According to various embodiments, an electronic device includes: a communication module; display; And a processor, wherein the processor comprises: through the communication module, receiving installation information regarding installation of the at least one external electronic device from a server; Receive current state information regarding a current installation state of the at least one external electronic device from the communication device; An installation guide for the at least one external electronic device, identified based on the installation information and the current state information, may be set to be output through the display as an augmented reality screen.

According to various embodiments, a server includes a communication module, and a processor, the processor comprising: receiving, through the communication module, first environmental data collected by the first electronic device from a first electronic device; Performing a first simulation to predict an operation result of at least one external electronic device using the first environment data; The first electronic device transmits first information regarding the installation of the at least one external electronic device, which is derived as a result of the first simulation, to the first electronic device through the communication module. It may be set to output, as an augmented reality screen, an installation guide for the at least one external electronic device, which is identified based on the current state information regarding the current installation state of the device and the first information.

According to various embodiments of the present disclosure, a method of operating an electronic device includes: receiving installation information regarding installation of at least one external electronic device from a server; Receiving current state information regarding a current installation state of the at least one external electronic device from the at least one external electronic device; And outputting an installation guide for the at least one external electronic device, identified based on the installation information and the current state information, as an augmented reality screen.

According to various embodiments, an operation method of a server may include: receiving, from a first electronic device, first environmental data collected by the first electronic device; Performing a first simulation to predict an operation result of at least one external electronic device using the first environment data; And the first information regarding the installation of the at least one external electronic device derived as a result of the first simulation is transmitted to the first electronic device. The first electronic device is currently installed in the at least one external electronic device. And outputting an installation guide for the at least one external electronic device, identified on the basis of the current state information and the first information, as an augmented reality screen.

According to various embodiments, an electronic device used for installation and maintenance of another electronic device and a control method thereof may be provided. Accordingly, since the AR device collects information about the environment around the point where the electronic device is to be installed or is located and transmits it to the server, the intervention of the technician who executes the simulation whenever the installation and maintenance of the electronic device is required must be performed. Since it is not necessary, it is possible to efficiently utilize human resources. Since information regarding the proper installation of the electronic device is output by the AR device, simulation results can be effectively delivered to the installer.

1 illustrates a block diagram of components in accordance with various embodiments.

2A is a block diagram of an exemplary AR device according to various embodiments.

2B illustrates a structure of an exemplary AR device according to various embodiments.

3 illustrates an exemplary block diagram of an AR device according to various embodiments.

4 illustrates an exemplary block diagram of a server according to various embodiments.

5A is a flowchart illustrating an operation of an electronic device according to various embodiments of the present disclosure.

5B illustrates an exemplary screen according to an operation of an electronic device according to various embodiments of the present disclosure.

5C is a flowchart illustrating an operation of an electronic device according to various embodiments of the present disclosure.

6 is a flowchart illustrating an operation of an electronic device according to various embodiments of the present disclosure.

7 is a flowchart illustrating an operation of an electronic device according to various embodiments of the present disclosure.

8 illustrates an exemplary screen according to an operation of an electronic device according to various embodiments of the present disclosure.

9A is a flowchart illustrating an operation of an electronic device according to various embodiments of the present disclosure.

9B is a flowchart illustrating an operation of an electronic device according to various embodiments of the present disclosure.

10 is a flowchart illustrating an operation of an electronic device according to various embodiments of the present disclosure.

11 illustrates an exemplary screen according to an operation of an electronic device according to various embodiments of the present disclosure.

12A illustrates an exemplary screen according to an operation of an electronic device according to various embodiments of the present disclosure.

12B illustrates exemplary screens according to an operation of an electronic device according to various embodiments of the present disclosure.

13A illustrates exemplary screens according to an operation of an electronic device according to various embodiments of the present disclosure.

13B illustrates exemplary screens according to an operation of an electronic device according to various embodiments of the present disclosure.

14A illustrates exemplary screens according to an operation of an electronic device according to various embodiments of the present disclosure.

14B illustrates exemplary screens according to an operation of an electronic device according to various embodiments of the present disclosure.

14C illustrates exemplary screens according to an operation of an electronic device according to various embodiments of the present disclosure.

15A, 15B, and 15C are flowcharts illustrating an operation of an electronic device according to various embodiments of the present disclosure.

1 illustrates a block diagram of components in accordance with various embodiments. Referring to FIG. 1, a server 110, an AR device 120, and an external electronic device 140 may be included in the network environment 100. According to various embodiments, the external electronic device 140 may be various communication devices that relay radio waves, such as an antenna, a CPE, a small cell, and a router. According to various embodiments, the external electronic device 140 may be an IoT hub or an electronic device communicating with the IoT hub. According to various embodiments, the external electronic device 140 may be a speaker. Further, according to various embodiments, the number of external electronic devices 140 may be singular or plural.

According to various embodiments, the server 110 may communicate with the AR device 120 through a telecommunication network such as a cellular network, the Internet, or a computer network (eg, LAN or WAN). According to various embodiments, the server 110 may receive environmental data from the AR device 120 through the communication module 113. According to various embodiments, the server 110 may transmit the external electronic device installation information indicating the installation conditions for optimal installation of the external electronic device 140, calculated based on the environmental data, to the AR device 120. have.

According to various embodiments, the external electronic device 140 may communicate with the AR device 120 through a short-range communication network such as Bluetooth, WiFi direct, or infrared data association (IrDA). According to various embodiments, the external electronic device 140 may communicate with the AR device 120 through a telecommunication network. According to various embodiments, the external electronic device 140 may transmit current state information, which is information about the current installation condition of the external electronic device 140, to the AR device 120 through the communication module 143. According to various embodiments, the external electronic device 140 may perform communication (eg, 2G, 3G, 4G, or 5G communication) with other electronic devices other than the AR device 120 after installation or maintenance is completed. have.

According to various embodiments, the AR device 120 is external for a user of the AR device 120 based on the external electronic device installation information received from the server 110 and the current state information received from the external electronic device 140. Information necessary for installation or maintenance of the electronic device 140 may be displayed.

According to various embodiments, the server 110 may include a processor 111, a memory 112, and a communication module 113. According to various embodiments, the processor 111 may control at least one other component (eg, a hardware or software component) in the server 110 and perform various data processing or operations. According to various embodiments, the processor 111 configures information related to the installation of the external electronic device 140 by performing simulation based on environmental data received from the AR device 120 through the communication module 113. Can.

According to various embodiments, the memory 112 may store various data used by at least one other component (eg, hardware or software component) in the server 110. According to various embodiments, the memory 112 may include volatile memory or nonvolatile memory.

According to various embodiments, the communication module 113 may support establishment of a direct (eg, wired) communication channel or a wireless communication channel between the server 110 and the AR device 120, and performance of communication through the established communication channel. have. The communication module 113 operates independently of the processor 111 (eg, an application processor) and may include one or more communication processors supporting direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 113 includes a wireless communication module (eg, a cellular communication module, a short-range wireless communication module) or a wired communication module (eg, a local area network (LAN) communication module, or a power line communication module). can do.

According to various embodiments, the AR device 120 included in the network environment 100 includes a processor 121, a memory 122, a communication module 123, a display 124, an input interface 125, and a camera 126 ), a GPS module 127, and a sensor module 128. According to various embodiments, the sensor module 128 may include a tilt sensor 129 and a geomagnetic sensor 130.

The processor 121 may control at least one other component (eg, a hardware or software component) in the AR device 120 and may perform various data processing or operations. According to various embodiments, the processor 121 may include a view collected by the camera 126, location information of the AR device 120 obtained by the GPS module 127, and a tilt sensor 129 in the sensor module 128. Environment data may be configured by combining the inclination angle of the AR device 120 obtained by the azimuth angle of the AR device 120 obtained by the geomagnetic sensor 130.

According to various embodiments, the memory 122 may store various data used by at least one other component (eg, hardware or software component) in the AR device 120. According to various embodiments, the memory 122 may include volatile memory or nonvolatile memory. According to various embodiments, the AR device 120 may communicate with other devices (eg, the server 110 and the external electronic device 140) in the network environment 100 through the communication module 123. .

According to various embodiments, the communication module 123 establishes a direct (eg, wired) communication channel or a wireless communication channel between the AR device 120 and the server 110 or the external electronic device 140, and the established communication channel It can support performing communication through. The communication module 123 operates independently of the processor 121 (eg, an application processor) and may include one or more communication processors supporting direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 123 includes a wireless communication module (eg, a cellular communication module, a short-range wireless communication module) or a wired communication module (eg, a local area network (LAN) communication module, or a power line communication module). can do.

According to various embodiments, the display 124 may visually provide information to the outside of the AR device 120 (eg, a user). According to various embodiments, the display 124 may include touch circuitry configured to sense a touch, or sensor circuitry configured to measure the intensity of force generated by the touch (eg, a pressure sensor). .

According to various embodiments, the input interface 125 may detect input from a user operating the AR device 120 and generate a corresponding electrical signal or data value. According to various embodiments, the type of the input interface 125 may be a button, a touch screen, a microphone, and if it is a means for changing an input from a user into an electric signal or a data value, the physical implementation form and the type of input to process Is not limited. According to various embodiments, the input interface 125 may be embedded in the AR device 120. According to various embodiments, the input interface 125 may operate by being detachably coupled to the AR device 120. According to various embodiments, the input interface 125 may include, for example, a mouse, a keyboard, or a digital pen (eg, a stylus pen).

The camera 126 may capture still images and videos. According to one embodiment, the camera 126 may include one or more lenses, image sensors, image signal processors, or flashes.

The GPS module 127 may generate information regarding the location of the AR device 120, for example, an electrical signal or data value corresponding to at least one of the current latitude, longitude, and height of the AR device 120. . According to various embodiments, the tilt sensor 129 included in the sensor module 128 may sense the tilt angle of the AR device 120 and generate a corresponding electric signal or data value. According to various embodiments, the geomagnetic sensor 130 included in the sensor module 128 may sense the azimuth of the AR device 120 and generate a corresponding electrical signal or data value.

According to various embodiments, the external electronic device 140 included in the network environment 100 may be, for example, an antenna for performing 2G, 3G, 4G, or 5G communication. According to various embodiments, the external electronic device 140 may include various devices that relay radio waves, such as, for example, a CPE, a small cell, or a router. According to various embodiments, the external electronic device 140 may be, for example, an IoT hub or an electronic device communicating with the IoT hub. According to various embodiments, the external electronic device 140 may include a processor 141, a memory 142, a communication module 143, a GPS module 144, and a sensor module 145. According to various embodiments, the sensor module 145 may include a tilt sensor 146 and a geomagnetic sensor 147.

The processor 141 may control at least one other component (eg, hardware or software component) in the external electronic device 140 and perform various data processing or calculation. According to various embodiments of the present disclosure, the processor 141 may obtain location information of the external electronic device 140 obtained by the GPS module 144 and external electronic devices 140 obtained by the tilt sensor 146 in the sensor module 145. ) May be combined with an azimuth angle of the external electronic device 140 obtained by the geomagnetic sensor 147 to configure current state information of the external electronic device.

The memory 142 may store various data used by at least one other component (eg, hardware or software component) in the external electronic device 140. According to various embodiments, the memory 142 may include volatile memory or nonvolatile memory. According to various embodiments, the external electronic device 140 may communicate with other devices (eg, the AR device 120) in the network environment 100 through the communication module 143. According to various embodiments, the external electronic device 140 may transmit current state information of the external electronic device to the AR device 120.

According to various embodiments, the communication module 143 establishes a direct (eg, wired) communication channel or a wireless communication channel between the external electronic device 140 and the AR device 120 and performs communication through the established communication channel. I can apply. The communication module 143 operates independently of the processor 141 (eg, an application processor) and may include one or more communication processors supporting direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 143 includes a wireless communication module (eg, a cellular communication module, a short-range wireless communication module) or a wired communication module (eg, a local area network (LAN) communication module, or a power line communication module). can do.

The GPS module 144 generates information regarding the location of the external electronic device 140, for example, an electrical signal or data value corresponding to at least one of the current latitude, longitude, and height of the external electronic device 140. Can. According to various embodiments, the tilt sensor 146 included in the sensor module 145 may sense the tilt angle of the external electronic device 140 and generate a corresponding electric signal or data value. According to various embodiments, the geomagnetic sensor 147 included in the sensor module 145 may sense the azimuth of the external electronic device 140 and generate a corresponding electrical signal or data value.

2A is a block diagram of an electronic device 201 in a network environment 200 according to various embodiments. Referring to FIG. 2A, in the network environment 200, the electronic device 201 communicates with the electronic device 202 through a first network 298 (eg, a short-range wireless communication network), or a second network 299. The electronic device 204 or the server 208 may be communicated through (eg, a remote wireless communication network). According to an embodiment, the electronic device 201 may communicate with the electronic device 204 through the server 208. According to an embodiment, the electronic device 201 includes a processor 220, a memory 230, an input device 250, an audio output device 255, a display device 260, an audio module 270, a sensor module ( 276), interface 277, haptic module 279, camera module 280, power management module 288, battery 289, communication module 290, subscriber identification module 296, or antenna module 297 ). In some embodiments, at least one of the components (for example, the display device 260 or the camera module 280) may be omitted, or one or more other components may be added to the electronic device 201. In some embodiments, some of these components may be implemented as one integrated circuit. For example, the sensor module 276 (eg, fingerprint sensor, iris sensor, or illuminance sensor) may be implemented while embedded in the display device 260 (eg, display).

The processor 220, for example, executes software (eg, the program 240) to execute at least one other component (eg, hardware or software component) of the electronic device 201 connected to the processor 220. It can be controlled and can perform various data processing or operations. According to one embodiment, as at least part of data processing or computation, the processor 220 may receive instructions or data received from other components (eg, sensor module 276 or communication module 290) in volatile memory 232. To be loaded, process instructions or data stored in the volatile memory 232, and store the resulting data in the non-volatile memory 234. According to one embodiment, the processor 220 includes a main processor 221 (eg, a central processing unit or an application processor), and an auxiliary processor 223 (eg, a graphics processing unit, an image signal processor) that can be operated independently or together. , Sensor hub processor, or communication processor). Additionally or alternatively, the coprocessor 223 may be configured to use less power than the main processor 221, or to be specialized for a specified function. The coprocessor 223 may be implemented separately from, or as part of, the main processor 221.

The coprocessor 223 may, for example, replace the main processor 221 while the main processor 221 is in an inactive (eg, sleep) state, or the main processor 221 may be active (eg, execute an application) ) While in the state, along with the main processor 221, at least one of the components of the electronic device 201 (for example, the display device 260, the sensor module 276, or the communication module 290) It can control at least some of the functions or states associated with. According to one embodiment, the coprocessor 223 (eg, image signal processor or communication processor) may be implemented as part of other functionally relevant components (eg, camera module 280 or communication module 290). have.

The memory 230 may store various data used by at least one component of the electronic device 201 (for example, the processor 220 or the sensor module 276). The data may include, for example, software (eg, the program 240) and input data or output data for commands related thereto. The memory 230 may include a volatile memory 232 or a nonvolatile memory 234.

The program 240 may be stored as software in the memory 230, and may include, for example, an operating system 242, middleware 244, or an application 246.

The input device 250 may receive commands or data to be used for components (eg, the processor 220) of the electronic device 201 from outside (eg, a user) of the electronic device 201. The input device 250 may include, for example, a microphone, mouse, keyboard, or digital pen (eg, a stylus pen).

The audio output device 255 may output an audio signal to the outside of the electronic device 201. The audio output device 255 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback, and the receiver can be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from, or as part of, a speaker.

The display device 260 may visually provide information to the outside of the electronic device 201 (for example, a user). The display device 260 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the device. According to an embodiment, the display device 260 may include a touch circuitry configured to sense a touch, or a sensor circuit (eg, a pressure sensor) configured to measure the strength of the force generated by the touch. have.

The audio module 270 may convert sound into an electrical signal, or vice versa. According to an embodiment, the audio module 270 acquires sound through the input device 250, or an external electronic device connected directly or wirelessly to the sound output device 255 or the electronic device 201 (for example, Sound may be output through the electronic device 202 (for example, speakers or headphones).

The sensor module 276 detects an operating state (eg, power or temperature) of the electronic device 201, or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the detected state can do. According to one embodiment, the sensor module 276 includes, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biological sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 277 may support one or more designated protocols that the electronic device 201 can be used to connect directly or wirelessly with an external electronic device (eg, the electronic device 202). According to one embodiment, the interface 277 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 278 may include a connector through which the electronic device 201 is physically connected to an external electronic device (eg, the electronic device 202 ). According to one embodiment, the connection terminal 278 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 279 may convert electrical signals into mechanical stimuli (eg, vibration or movement) or electrical stimuli that the user can perceive through tactile or motor sensations. According to one embodiment, the haptic module 279 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 280 may capture still images and videos. According to one embodiment, the camera module 280 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 288 may manage power supplied to the electronic device 201. According to one embodiment, the power management module 388 may be implemented, for example, as at least part of a power management integrated circuit (PMIC).

The battery 289 may supply power to at least one component of the electronic device 201. According to one embodiment, the battery 289 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 290 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 201 and an external electronic device (eg, the electronic device 202, the electronic device 204, or the server 208). It can support establishing and performing communication through the established communication channel. The communication module 290 is operated independently of the processor 220 (eg, an application processor), and may include one or more communication processors supporting direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 290 is a wireless communication module 292 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 294 (eg : Local area network (LAN) communication module, or power line communication module. Corresponding communication module among these communication modules includes a first network 298 (eg, a short-range communication network such as Bluetooth, WiFi direct, or an infrared data association (IrDA)) or a second network 299 (eg, a cellular network, the Internet, or It can communicate with external electronic devices through a computer network (eg, a telecommunication network such as a LAN or WAN). These various types of communication modules may be integrated into a single component (eg, a single chip), or may be implemented as a plurality of separate components (eg, multiple chips). The wireless communication module 292 uses a subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 296 in a communication network such as the first network 298 or the second network 299. The electronic device 201 may be identified and authenticated.

The antenna module 297 may transmit a signal or power to the outside (eg, an external electronic device) or receive it from the outside. According to one embodiment, the antenna module may include a single antenna including a conductor formed on a substrate (eg, a PCB) or a radiator made of a conductive pattern. According to an embodiment, the antenna module 297 may include a plurality of antennas. In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network 298 or the second network 299, is transmitted from the plurality of antennas by, for example, the communication module 290. Can be selected. The signal or power may be transmitted or received between the communication module 290 and an external electronic device through the at least one selected antenna. According to some embodiments, other components (eg, RFIC) in addition to the radiator may be further formed as part of the antenna module 297.

At least some of the components are connected to each other through a communication method between peripheral devices (for example, a bus, a general purpose input and output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)). Ex: command or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 201 and an external electronic device 204 through a server 208 connected to the second network 299. Each of the

electronic devices

202 and 204 may be the same or a different type of device from the electronic device 201. According to an embodiment, all or some of the operations performed on the electronic device 201 may be performed on one or more external devices of the external

electronic devices

202, 204, or 208. For example, when the electronic device 201 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 201 may execute the function or service itself. In addition or in addition, one or more external electronic devices may be requested to perform at least a portion of the function or the service. The one or more external electronic devices receiving the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and deliver the result of the execution to the electronic device 201. The electronic device 201 may process the result, as it is or additionally, and provide it as at least part of a response to the request. To this end, for example, cloud computing, distributed computing, or client-server computing technology can be used.

2B illustrates a structure of an exemplary AR device according to various embodiments. Referring to FIG. 2B, the AR device 200b may include a pair of display devices 250b and a pair of housings 210b. A pair of display devices 250b may be fixed to a pair of housings 210b in a frame shape. The pair of wearing members 220b from the pair of housings 210b may extend side by side. The AR device 200b may be a head-worn electronic device. It is merely exemplary that the AR device 200b is a wearable electronic device of a head-wearing type, and those skilled in the art will readily understand that there is no limitation in the implementation form of the AR device 200b.

The AR device 200b may include a gap adjusting structure 240b for adjusting the length between the pair of housings, a circuit board 260b and a battery 270b disposed in the wearing member 220b. As another example, the wearing member 220b of the electronic device 101 includes a light output device 280b (eg, a projector), a light refraction module 290b (eg, a prism) or a display module (not shown). can do.

According to various embodiments, the display device 250b may include a display module, a projector or a sensor equipped with a touch circuit, and the display of the display module may be a transparent or translucent display. As another example, the display device 250b may include a window member (eg, a transparent member), and the window member may include a light adjustment member disposed on at least a portion of the window member. . The light-adjusting member may be a translucent glass or a member whose light transmittance can be adjusted as the coloring density is adjusted. As another example, the display device 250b may include a lens including a waveguide, a reflective lens, and the like, and each lens may transmit light output from the output device to the user's eyes. .

According to various embodiments of the present disclosure, the pair of housings 210b is a frame shape that at least partially surrounds the edges of each of the display devices 250b, and a rim having an eyeglass structure including general sunglasses. It can provide a role.

According to various embodiments, a circuit board 260b may be disposed on each of the pair of wearing members 220b, and circuit wiring connecting the circuit boards may be inside or outside the pair of housings 210b. Can be deployed. The pair of wearing members 220b may serve as a temple of a general eyeglass structure. For example, the pair of housings 210b are positioned on the user's face to position the display device 250b correspondingly to the user's eyes, and the pair of wearing members 220b is the amount of each user's head. It can be attached to the user's ear from the side.

According to various embodiments, the pair of wearing members 220b may be utilized in arranging the circuit board 260b, the battery 270b, the light output device 280b, and the light refraction module 290b. For example, each of the pair of wearing members 220b may be provided with a housing structure capable of accommodating the circuit board 260b, the battery 270b, the light output device 280b, or the light refraction module 290b. Can. As another example, the electronic device 101 may include a circuit board 260b, a battery 270b, a light output device 280b, and a light refraction module 290b in a pair of wearing members 220b, respectively. . As another example, in arranging the circuit board 260b, the battery 270b, the light output device 280b, or the light refraction module 290b, various modifications are made in consideration of the weight distribution and the fit of the electronic device 101. Can be.

According to various embodiments, the circuit board 260b may be composed of a plurality, one of which is a communication circuit with a driving circuit of the display device 250b, image information, and the like, and an electronic device 101. It may be provided as a substrate including a communication module for performing. The processor may output an image using a projector.

The processor of the AR device may be implemented at least partially the same as the processor 220b of the electronic device 200b of FIG. 2A. The communication module of the AR device may be implemented at least partially the same as the communication module of the electronic device 200b of FIG. 2A. The communication module of the AR device may transmit and receive data through at least one of the communication module 290b of the electronic device 200b and the first network 298 or the second network 299.

Another one of the circuit boards 260b may be provided as a circuit board on which a communication module and various connectors and sensor modules for providing an interface with a user, a connection to another electronic device or a commercial communication network are mounted. As another example, a microphone and speaker phone for input/output of sound may also be disposed on one of the circuit boards 260b or adjacent to one of the circuit boards 260b. However, the circuit arrangement of the circuit boards 260b and functions thereof are not limited thereto, and may be variously adjusted as necessary.

According to various embodiments, the circuit boards 260b may be respectively disposed on any one of the wearing members 220b. As another example, the sensor module may include a proximity sensor, an illuminance sensor, a gyro sensor, a camera module, a gaze tracker, a geomagnetic sensor, or an accelerometer, and various sensors constituting the sensor module must be connected to the circuit board ( 260b). For example, the camera module may be disposed at an appropriate position on the pair of housings 210b to be close to the user's gaze. The sensor module may detect information about a surrounding environment required to set an optimal use environment while monitoring the use environment of the AR device 200b. For example, the processor may analyze an image of the external landscape acquired through the camera module, and determine a relative position of the electronic device 101 based on the AR device 200b based at least on the analysis result.

According to various embodiments, the battery 270b may be arranged in one or more numbers, and for providing power to the circuit board 260b or the display module, at least one of the pair of wearing members 220b It may be disposed on one or on each of the wearing members 220b.

According to various embodiments, the light output device 280b and the light refraction module 290b may be arranged in plural, and disposed on at least one of the pair of wear members 220b or the wear member 220b Can be placed in each. The light emitted from the light output device 280b may reach the display device 250b through the light refraction module 290b. The AR device 200b using the light output device 280b may be a wave guide type or a reflective mirror type. For example, in the wave guide type, light emitted from a side light output device such as a projector may be reflected by a grating area formed in the display device using a wave guide such as a prism and transmitted to a user's eye. . As another example, in the reflective mirror type, light emitted from the light output device may be directly reflected by the display device in front of the user's eyes to provide visual information to the user's eyes.

According to various embodiments, circuit boards 260b disposed on each of the pair of housings 210b may be connected to each other through circuit wiring (not shown). The circuit wiring may provide a path for transmitting and receiving various control signals and data between circuit boards. The circuit wiring may be configured using a coaxial cable, and may have various other types of transmission line structures such as a flexible printed circuit board (FPCB).

According to various embodiments, the AR device 200b may include an input device including a physical key or a touch pad. For example, input modules such as a power key or a touch pad are devices that require direct contact from a user, and may be exposed outside the AR device 200b.

3 illustrates an exemplary block diagram of an AR device 300 according to various embodiments. Referring to FIG. 3, the AR device 300 may include a software block 310 and a hardware block 390. Here, the software block 310 may operate based on software, and may include a software block, a middleware layer, and a kernel layer. 3 or 4, various units defined in association with a software block may be implemented as, for example, an application operating in the application layer or a manager operating in the middleware layer, but the implementation form thereof is operated Changes may be possible depending on the type of system.

For example, the software block 310 includes a simulation result value management unit 320, a determination unit 330, an antenna management unit 340, a server management unit 350, an environmental element management unit 360, a display unit 370, and operation It may include an operating system (OS) 380. The operating system 380 may include a device driver 381 and a hardware abstraction layer (HAL) 382.

The simulation result value management unit 320 may include a result value storage unit 321 and a result value history management unit 322. The result value storage unit 321 may perform a function of storing information derived as a result of the simulation. The result value history management unit 322 may perform a function of managing the history of information derived as a result of the previously performed simulation.

The determination unit 330 may include an antenna installation value-simulation result value difference determination unit 331, an AR device direction determination unit 332, and an AR device-antenna similarity range determination unit 333. The antenna installation value-simulation result value difference determination unit 331 determines whether or not there is a difference between the information about the preferable installation state of the antenna derived from the simulation result and the current state information about the current antenna installation state, as will be described later. Can perform the function. The AR device direction determining unit 332 may perform a function of determining a direction in the direction that the AR device 300 is facing. The AR device-antenna similarity range determining unit 333 may perform a function of determining whether the AR device 300 is located below a predetermined level from the antenna position.

The antenna management unit 340 may include a network connection unit 341, a data reception unit 342, and a data storage unit 343. The network connection unit 341 may perform a network connection with the antenna. The data receiving unit 342 may perform a function of receiving data from an antenna. According to various embodiments, the data receiving unit 342 may receive current state information regarding a state in which the current antenna is installed, as described later. The data storage unit 343 may perform a function of storing data received from the antenna or data to be transmitted to the antenna.

The server management unit 350 may include a network connection unit 351, a data transmission unit 352, a data reception unit 353, and an account management unit 354. The network connection unit 351 may perform a network connection with a server. The data transmission unit 352 may perform a function of transmitting data to the server. According to various embodiments, the data transmission unit 352 may perform a function of transmitting environmental data collected by the AR device 300 to the server. The data receiving unit 353 may perform a function of receiving data from the server. According to various embodiments, the data receiving unit 353 may perform a function of receiving information regarding a desirable installation state of the antenna from the server. The account management unit 354 may perform a function of managing an account used through the AR device 300.

The environment element management unit 360 may include an environment element recognition unit 361, an environment element storage unit 362, and an environment element input unit 363. As described later, the environmental element recognition unit 361 may perform a function of recognizing an environmental element existing in a surrounding environment of a point where antenna installation is requested. The environmental element storage unit 362 may perform a function of storing the recognized environmental element as described later. According to various embodiments, the environment element storage unit 362 may perform a function of storing at least one of an image of the recognized environment element or information on the attribute of the recognized environment element. The environment element input unit 363 may perform a function of inputting information on the attribute of the environment element, as described later.

The display unit 370 may include an antenna installation value display unit 371, an environmental element display unit 372, and a simulation result value display unit 373. According to various embodiments, the antenna installation value display unit 371 may perform a function of displaying an antenna installation value corresponding to current state information regarding a current antenna installation state, as will be described later. The environmental element display unit 372 may perform a function of displaying the environmental element. According to various embodiments, the environmental element display unit 372 may perform a function of visually displaying the recognized environmental element. The simulation result value display unit 373 may perform a function of displaying various data derived as a result of the simulation. According to various embodiments, the simulation result value display unit 373 may perform a function of visually displaying information regarding a desirable installation state of an antenna derived as a result of the simulation, as will be described later. Although the name of the display unit is used, according to various embodiments, the simulation result value display unit 373 may perform a function of outputting information regarding a desirable installation state of the antenna by voice.

The hardware block 390 of the AR device 300 may include a camera 391, a GPS module 392, a tilt sensor 393, a geomagnetic sensor 394, and a communication module 395. The details of the camera 391, the GPS module 392, the tilt sensor 393, the geomagnetic sensor 394, and the communication module 395 are the same as those described with reference to FIG. 1, and thus are not repeated here. .

Although shown as an antenna in FIG. 3 for convenience, FIG. 3 shows that it can be applied not only to an antenna but also to describe structures of various communication devices relaying radio waves, such as a CPE, a small cell, and a router. Those skilled in the art will readily understand.

4 illustrates an exemplary block diagram of a cloud server according to various embodiments. Referring to FIG. 4, the cloud server 400 may include a software block 410 and hardware 470. The software block 410 may include an antenna simulation management unit 420, an environment element management unit 430, a communication unit 440, an account and AR device management unit 450, and an OS 460. The OS 460 may include a device driver 461 and a hardware abstraction layer (HAL) 462.

The antenna simulation management unit 420 may include a simulation execution unit 421, a result value storage unit 422, and a result value history management unit 423. The simulation execution unit 421 may perform a function of executing simulation to derive information regarding a desirable installation state of the antenna. According to various embodiments, the simulation execution unit 421 may perform a function of executing a simulation based on environmental data received from the AR device. The result value storage unit 422 may perform a function of storing various data derived as a result of the simulation executed by the simulation execution unit 421. Result value history management unit 423 The simulation execution unit 421 may perform a function of managing the history of information derived as a result of a simulation previously performed.

The environment element management unit 430 may include an environment element storage unit 431, an environment element history management unit 432, an existing-new environment element change determination unit 433, and an environment element update execution unit 434. The environment element storage unit 431 may perform a function of storing various data related to at least one environment element included in environment data received from the AR device. According to various embodiments, the environment element storage unit 431 may perform a function of storing an image of at least one environment element and data indicating information on attributes of the at least one environment element. The environmental element history management unit 432 may perform a function of managing the change history of environmental elements. The existing-new environmental element change determination unit 433 may perform a function of comparing the latest environmental data received from the AR device with environmental data previously stored in the environmental element storage unit 431. The environmental element update execution unit 434 may update the data related to the environmental element. According to various embodiments, the environmental element update execution unit 434 previously stores the latest environmental data received from the AR device from the existing-new environmental element change determination unit 433 in the environmental element storage unit 431. When it is determined that it is different from the environmental data, it is possible to perform a function of updating data stored in the environmental element storage unit 431 according to the latest environmental data.

The communication unit 440 may include a network connection unit 441, a data transmission unit 442, and a data reception unit 443. The network connection unit 441 may perform a network connection with the AR device. The data transmission unit 442 may perform a function of transmitting data to the AR device. According to various embodiments, the data transmission unit 442 may perform a function of transmitting information regarding a desirable installation state of the antenna, which is derived as a result of the simulation to the AR device, as described later. The data receiving unit 443 may perform a function of receiving data from the AR device. According to various embodiments, the data receiving unit 443 may receive environmental data collected by the AR device from the AR device.

The account and AR device management unit 450 includes an account registration unit 451, an account storage unit 452, an account deletion unit 453, a device registration unit 454, a device storage unit 455, and a device deletion unit 456. It can contain. The account registration unit 451 may perform a function of registering an account for using a service provided by the cloud server 400. The account storage unit 452 may perform a function of storing various data related to an account for using a service provided by the cloud server 400. The account deletion unit 453 may perform a function of deleting data related to a specific account from the account storage unit 452. According to various embodiments, the account deletion unit 453 deletes data related to a specific account from the account storage unit 452 at the request of the user associated with the account or at the request of the operator of the cloud server 400. You can do The device registration unit 454 may perform a function of registering various data related to the AR device used to receive the service provided by the cloud server 400. According to various embodiments, the device registration unit 454 may perform the function of registering identification information corresponding to the AR device, for example, a PIN number of the AR device. The device storage unit 455 may perform a function of storing various data related to an AR device used to receive a service provided by the cloud server 400. The device deletion unit 456 may perform a function of deleting various data on the AR device used to receive the service provided by the cloud server 400 from the device storage unit 455. According to various embodiments, the device deletion unit 456 deletes data related to a specific AR device from the device storage unit 455 at the request of a user associated with the AR device or at the request of an operator of the cloud server 400. Can perform the function.

The description of the hardware 470 of the cloud server 400 is the same as described above with reference to the server 110 of FIG. 1, and thus is not repeated herein.

In FIG. 4, for convenience, the antenna is indicated as an antenna, but FIG. 4 shows not only an antenna, but also various communication devices that relay radio waves, such as a CPE, a small cell, and a router, an IoT hub, and electronics that communicate with the IoT hub. It will be readily understood by those skilled in the art that it may also be applied to devices or speakers.

5A is a flowchart illustrating an operation of an electronic device according to various embodiments of the present disclosure. According to various embodiments, operation 500a illustrated in FIG. 5A may be performed by a processor (eg, processor 121) included in an AR device (eg, AR device 120 ).

In operation 510a, a processor (eg, processor 121) included in an AR device (eg, AR device 120) is installed in an external electronic device (eg, external electronic device 140). Relevant installation information may be received from a server (eg, server 110). According to various embodiments, the environment data may be data regarding a surrounding environment of a first point where installation of an external electronic device is requested. According to various embodiments, the environment data is collected by a view collected by the camera 126, location information of the AR device 120 obtained by the GPS module 127, and tilt sensor 129 in the sensor module 128. It may be data configured by combining the inclination angle of the acquired AR device 120 and the azimuth angle of the AR device 120 obtained by the geomagnetic sensor 130. According to various embodiments, the installation information may be information regarding an optimal installation condition of the external electronic device 140, as will be described later with reference to 520c and 530c of FIG. 5C. According to various embodiments of the present disclosure, when the external electronic device 140 is a communication device that relays radio waves, such as an antenna, a CPE, a small cell, or a router, the first information is the external electronic device 140 ) May be information regarding installation conditions to optimize coverage. According to various embodiments, when the external electronic device 140 is an IoT hub or an electronic device communicating with an IoT hub, the first information minimizes interference of communication between the IoT hub and one or more IoT devices communicating with the IoT hub. It may be information about installation conditions. According to various embodiments, when the external electronic device 140 is a speaker, the first information may be information regarding an installation condition that widens the distribution of a sweet spot caused by the operation of the speaker.

In operation 520a, the processor 121 may receive current state information regarding the current installation state of the external electronic device 140 from the external electronic device 140. According to various embodiments, the processor 121 may check the current state information by receiving the current state information from the external electronic device 140 through the communication module 123. According to various embodiments, current status information may be received from the external electronic device 140 through the data receiving unit 342 of FIG. 3. According to various embodiments, the current state information of the external electronic device 140 may include at least one of latitude, longitude, height, azimuth angle, and inclination angle at which the external electronic device 140 is installed.

In operation 530a, the processor 121 may output the installation guide for the external electronic device 140, which is identified based on the installation information and the current state information, through the display 124 as an augmented reality screen. According to various embodiments, the installation guide may include objects corresponding to the current state of the external electronic device 140, corresponding to the current state information. According to various embodiments, the installation guide may include augmented reality objects corresponding to a virtual installation state of the external electronic device 140 corresponding to installation information. According to various embodiments, the installation guide may include augmented reality objects indicating a required change in relation to the installation state of the external electronic device 140, which is identified based on the difference between the installation information and the current state information. For example, augmented reality objects representing a change required in relation to the installation state of the external electronic device 140, the amount of change in at least one of a position, azimuth, and inclination angle for the external electronic device 140 to be installed to correspond to the installation information Can represent According to various embodiments, the augmented reality objects representing a required change with respect to the installation state of the external electronic device 140 may be, for example, an arrow-shaped figure or a number.

5B shows a view of the user viewing the display 124 of the AR device 120 when the installation information suggests changing the azimuth and inclination angles of the external electronic device 140. Referring to FIG. 5B, on the screen 510b displayed by the display 124 of the AR device 120, the external electronic device 520b (eg, the external electronic device 140) corresponding to the installation information is identified. Information that can be (550b), orientation (560b, 561b, 562b, 563b), azimuth included in the current state information (530b), inclination angle (540b) included in the current state information, azimuth angle (531b) included in the installation information , And the inclination angle 541b included in the installation information may be displayed using the AR function. According to various embodiments, although not shown, augmented reality objects representing required changes with respect to the installation state of the external electronic device 520b may be displayed on the display 124 as part of the installation guide. For example, the number 2.2, which means that the inclination angle 540b included in the current state information is 2.2 degrees larger than the inclination angle 541b included in the installation information, may be displayed on the display 124. As another example, an arrow indicating that the external electronic device 520b is tilted in a direction to match the inclination angle to the inclination angle 541b included in the installation information may be displayed on the display 124.

5C is a flowchart illustrating an operation of an electronic device according to various embodiments of the present disclosure. According to various embodiments, the operation 500c illustrated in FIG. 5C may be performed in a situation in which an external electronic device is newly installed or in a situation in which maintenance of the previously installed external electronic device is required. According to various embodiments, the operation 500c illustrated in FIG. 5C may be applied to a single or multiple external electronic devices.

In operation 510c, a processor (eg, processor 111) included in the server (eg, the server 110) is transmitted from the first electronic device through the communication module 113, by the first electronic device. The collected first environment data regarding the surrounding environment of the first point at which the installation of the external electronic device is requested may be received. According to various embodiments, operation 510c may be performed by the data receiving unit 443. According to various embodiments, the server 110 may be the cloud server 400 illustrated in FIG. 4. According to various embodiments, the first electronic device may be the AR device 120 described above with reference to FIG. 1 or the AR device 300 described with reference to FIG. 3. According to various embodiments, the first electronic device may be the electronic device 201 described above with reference to FIG. 2A. According to various embodiments, the first electronic device may be the AR device 200b described above with reference to FIG. 2B. According to various embodiments, the first electronic device may cover the electronic device 201 described above with reference to FIG. 2A and the AR device 200b described above with reference to FIG. 2B communicating with the electronic device 201. . When the first electronic device refers to the electronic device 201 and the AR device 200b communicating with the electronic device 201 according to various embodiments of the present disclosure, a description of the operation of the first electronic device will be described later in the description of this specification. Operation performed by one of the electronic device 201 and the AR device 200b communicating with the electronic device 201, or by both the electronic device 201 and the AR device 200b communicating with the electronic device 201 It can be interpreted as a description of.

According to various embodiments, the external electronic device may be the external electronic device 140 described above with reference to FIG. 1. According to various embodiments, when it is required that the external electronic device 140 is newly installed, the first point is not accurately specified as one specific point, but covers a relatively wide range of places where the installation of the external electronic device is requested. can do. According to various embodiments, when maintenance of the previously installed external electronic device 140 is required, the first point may be a point where the external electronic device 140 is previously installed.

According to various embodiments, the first environment data may indicate information about the surrounding environment of the first point. According to various embodiments, the first environmental data may indicate information on environmental elements existing in the surrounding environment of the first point. According to various embodiments, examples of the first environmental data when the external electronic device 140 is an antenna are shown in Table 1.

건물_01Building_01		건물_02Building_02		구조물_01Structure_01
위도Latitude	30.3140089º30.3140089º	위도Latitude	28.3140089º28.3140089º	유형type	간판Sign
경도Hardness	61.2504569º61.2504569º	경도Hardness	61.2504569º61.2504569º	위도Latitude	28.3140089º28.3140089º
너비width	10M10M	너비width	7M7M	경도Hardness	60.2504569º60.2504569º
높이Height	30M30M	높이Height	10M10M	너비width	2M2M
깊이depth	15M15M	깊이depth	5M5M	높이Height	1M1M
외관 재질Appearance material	붉은 벽돌Red brick	외관 재질Appearance material	유리Glass	외관 재질Appearance material	플라스틱plastic

As shown in Table 1 above, the first environmental data includes the type of each environmental element (eg, building, structure) existing in the surrounding environment of the first point, and the type of structure (eg, when the environmental element is a structure) , Signage), serial number to distinguish each environmental element (for example, building_01, building_02), and may include information on the latitude, longitude, width, height, depth, and exterior materials of each environmental element. The first electronic device according to various embodiments may acquire at least one image by photographing a surrounding environment using a camera. The first electronic device analyzes at least one image and obtains first environment data based at least on the analysis result. For example, the first electronic device may check the current location, and obtain first environment data using an image analysis result based on the current location. Alternatively, the first electronic device may transmit an image of the surrounding environment to the server, and in this case, the server may obtain the first environment data by analyzing the received image. According to various embodiments, the server may also receive information on the location of the first electronic device along with the image photographed from the first electronic device, and use an image analysis result based on the location of the first electronic device Thus, the first environment data may be obtained.

In operation 520c, the processor 111 may perform a first simulation to predict an operation result of the external electronic device 140 using the first environment data. According to various embodiments, the first simulation may be performed through the simulation execution unit 421 of FIG. 4. The processor 111 may perform prediction of a plurality of operation results while changing at least one of the location or the placement direction of the external electronic device. For example, when the external electronic device 140 is a communication device relaying radio waves, such as an antenna, a CPE, a small cell, or a router, operation result prediction is performed by the external electronic device 140. It can be a coverage prediction. According to various embodiments, when the external electronic device 140 is an IoT hub or an electronic device communicating with an IoT hub, the operation result prediction is a prediction of the interference amount of communication between the IoT hub and one or more IoT devices communicating with the IoT hub. Can. According to various embodiments, when the external electronic device 140 is a speaker, the operation result prediction may be a prediction of a distribution of a sweet spot caused by the operation of the speaker.

For example, when the external electronic device 140 is an antenna, the processor 111 assumes a case in which the external electronic device is located in the first position and the external electronic device is disposed in the first placement direction. By performing a simulation that radiates an RF wave, coverage data for the surrounding environment can be confirmed. In addition, when the external electronic device is located in the first location, the processor 111 may perform simulations on a plurality of directions different from the first arrangement direction and check a plurality of coverage data. In addition, the processor 1110 may check a plurality of coverage data in the manner described above even after changing the expected position of the external electronic device. The processor 111 may check optimal coverage data among the plurality of checked coverage data. For example, the processor 111 may identify coverage data having the largest area of a region where quality is secured over a certain level as the optimal coverage data, but this is merely exemplary, and the criteria for evaluating the optimal coverage data is limited. none. The processor 111 can check the installation information of the external electronic device corresponding to the optimum coverage data as the optimal installation information. In another example, the processor 111 may check information about the surrounding environment, and based on this, the RF wave emission model. The processor 111 may also check the optimal installation information of the external electronic device based on the radiation model, and those skilled in the art will readily understand that there is no limitation in the method for checking the optimal installation information for a specified environment.

In operation 530c, the processor 111 through the communication module 113, the first information about the installation of the external electronic device 140 derived as a result of the first simulation, for example, the optimum derived through the above-described process The installation information of can be transmitted to the first electronic device 120. According to various embodiments, operation 530c may be performed through the data transmission unit 442 of FIG. 4.

According to various embodiments, when the external electronic device 140 is an antenna, the first information may be information regarding an installation condition of the external electronic device 140 for maximizing the coverage of the external electronic device 140. According to various embodiments, the first information is required to maximize the coverage of the external electronic device 140, the angle at which the external electronic device 140 is installed (eg, an inclination angle, an azimuth angle), and a location (eg For example, at least one of latitude, longitude, and height). According to various embodiments, the first information may indicate that another external electronic device (eg, the external electronic device 140) is newly installed. For example, the first information may have a format as shown in Table 2 below.

안테나_01Antenna_01
위도Latitude	42.3140089º42.3140089º
경도Hardness	71.2504569º71.2504569º
높이Height	2.5M2.5M
방위각azimuth	124º124º
경사각Tilt angle	-4º-4º
Main beam의 커버리지Main beam coverage	건물_01{Front_Red, Side_Left_Yellow, Side_Right_Orange, Back_Green}Building_01{Front_Red, Side_Left_Yellow, Side_Right_Orange, Back_Green}
	건물_02{Front_Red, Side_Left_Yellow, Side_Right_Orange, Back_Green}Building_02{Front_Red, Side_Left_Yellow, Side_Right_Orange, Back_Green}
	구조물_01{Front_Yellow}Structure_01{Front_Yellow}

Table 2 above shows the latitude, longitude, height, azimuth, and inclination angle of antenna_01 for maximizing the coverage of antenna_01, which is the external electronic device 140. According to various embodiments, the first information may include information about expected coverage when applying the installation angle and installation location indicated in the first information. Referring to Table 2, when antenna_01 is an antenna for performing 5G communication, information about the intensity at which the main beam reaches each side of each environment element may be included in the first information. In the example of Table 2, Front may refer to the front of a building or structure, Side_Left to the left side of the building, Side_Right to the right side of the building, and Back to the rear side of the building. In the example of Table 2, it may mean that the intensity of radio waves reaching Red, Orange, Yellow, and Green is strong. It will be understood by those skilled in the art that, according to various embodiments, the method or format for indicating the intensity of radio waves reaching each environmental element is not limited by the method or format shown in Table 2. More details As will be described later, the first electronic device may output the received installation information in various ways, and an installer who possesses or wears the first electronic device may install an external electronic device based on the output result.

6 is a flowchart illustrating an operation of a server according to various embodiments of the present disclosure. In operation 610, a processor (for example, the processor 111) included in the server (for example, the server 110) is configured for providing a first environment for the external environment in which the installation of the external electronic device 140 is requested. 2 Can store environmental data. According to various embodiments, operation 610 may be performed by the environment element storage unit 431 illustrated in FIG. 4.

According to various embodiments, the second environment data for the surrounding environment may be data received by the processor 111 from the first electronic device 120 to be described later through the communication module 113. According to various embodiments, the second environment data may be data received by the processor 111 from an electronic device different from the first electronic device 120 to be described later through the communication module 113. According to various embodiments, when the second environmental data is data received from an electronic device different from the first electronic device 120 to be described later, an electronic device different from the first electronic device 120 is described above with reference to FIG. 2A. The electronic device 201, AR device 200b described above with reference to FIG. 2B, or AR described above with reference to FIG. 2B communicating with the electronic device 201 and electronic device 201 described above with reference to FIG. 2A. It may be at least one of the devices 200b. According to various embodiments, the second environment data may be data collected without using an AR function. The format of the second environment data and the example of the information included in the second environment data are the same as the first environment data described with reference to FIG. 5, and thus are not repeated here.

In operation 620, the processor 111 included in the server 110 may receive the first environment data from the first electronic device (eg, the AR device 120) through the communication module 113. According to various embodiments, operation 620 may be performed through the data receiving unit 343 of FIG. 4.

According to various embodiments, operation 620 may be performed after a relatively long time after operation 610 occurs. In other words, the first environmental data may be the latest environmental data, and the second environmental data may be existing environmental data. For example, operation 610 may be performed when the external electronic device 140 is newly installed, and operation 620 may be performed when maintenance of the installed external electronic device 140 is required. In another example, operation 610 may be performed when maintenance of the external electronic device 140 is required, and operation 620 may be performed to some extent (eg, 1) after maintenance of the external electronic device 140 based on the operation 610. Months, 6 months, and 1 year) may be performed when maintenance of the external electronic device 140 is required again. Since the details described above with respect to operation 510c of FIG. 5C may also be applied to operation 620, the description will not be repeated herein.

In operation 630, the processor 111 included in the server 110 may check whether the first environment data is the same as the second environment data. According to various embodiments, operation 630 may be performed by the existing-new environmental element change determining unit 433 of FIG. 4. For example, when the external electronic device 140 is an antenna, the second environmental data may be as shown in Table 1, and the first environmental data may be as shown in Table 3 below.

건물_01Building_01		건물_02Building_02		구조물_01Structure_01		나무_01Tree_01
위도Latitude	30.3140089º30.3140089º	위도Latitude	28.3140089º28.3140089º	유형type	간판Sign	수종dropsy	은행Bank
경도Hardness	61.2504569º61.2504569º	경도Hardness	61.2504569º61.2504569º	위도Latitude	28.3140089º28.3140089º	위도Latitude	29.3140089º29.3140089º
너비width	10M10M	너비width	7M7M	경도Hardness	60.2504569º60.2504569º	경도Hardness	60.2504569º60.2504569º
높이Height	30M30M	높이Height	10M10M	너비width	2M2M	너비width	1.5M1.5M
깊이depth	15M15M	깊이depth	5M5M	높이Height	1M1M	높이Height	4M4M
외관 재질Appearance material	붉은 벽돌Red brick	외관 재질Appearance material	유리Glass	외관 재질Appearance material	플라스틱plastic

When Table 3 is compared with Table 1, it can be seen that Table 3 further includes information about the tree_01 that does not exist in Table 1. In this case, the processor 111 may confirm that the first environmental data is not the same as the second environmental data.

According to various embodiments, the second environment data may be single data for a single time point. Alternatively, a plurality of second environment data collected at a plurality of time points may be present in the memory 112. According to various embodiments, the plurality of second environment data collected at a plurality of time points may be managed by the environment element history management unit 432.

When it is determined in operation 630 that the first environmental data is the same as the second environmental data, in operation 640, the processor 111, through the communication module 113, based on the simulation result performed based on the second environmental data. The second information regarding the installation of the derived external electronic device 140 may be transmitted to the first electronic device. According to various embodiments, operation 640 may be performed by the data transmission unit 442. According to various embodiments of the present disclosure, when the processor 111 performs a simulation based on the second environment data before performing the operation 630, the second information may be information stored in the memory 112 of the server 110. According to various embodiments of the present disclosure, when the processor 111 does not perform the simulation based on the second environmental data before performing the 630 operation, the processor 111 performs the second simulation by performing the simulation based on the second environmental data at the operation 640. Information can be derived. Details of the simulation based on the second environment data are the same as described above with reference to operation 520c of FIG. 5C. The format of the second information and the content of the information included in the second information are the same as described above with reference to operation 530c of FIG. 5C.

When it is determined in operation 630 that the first environmental data is not the same as the second environmental data, in operation 650, the processor 111 uses the first environmental data to predict an operation result of the external electronic device 140. 1 Simulation can be performed. Details of the first simulation are the same as described above with reference to operation 520c of FIG. 5C.

In operation 660, the processor 111 may transmit the first information derived based on the result of the first simulation to the first electronic device 120 through the communication module 113. The format of the first information and the content of the information included in the first information are the same as described above with reference to operation 530c of FIG. 5C.

According to various embodiments, although not illustrated in FIG. 6, after operation 660 is performed, the processor 111 may further perform an operation of storing the first environment data and the first information in the memory 112. In this case, the first environmental data and the first information stored in the memory 112 are the second environmental data and the second information of the operation 600 illustrated in FIG. 6 in a situation in which the external electronic device 140 is maintained next time. It will be understood by those skilled in the art that the same can be used. According to various embodiments, the operation of storing the first environmental data information in the memory 112 may be performed through the environmental element storage unit 431 or the environmental element history management unit 432 of FIG. 4. According to various embodiments, the operation of storing the first information in the memory 112 may be performed through the result value storage unit 422 or the result value history management unit 423 of FIG. 4.

7 is a flowchart illustrating an operation 700 of an AR device according to various embodiments. In operation 710, a processor (eg, processor 121) included in the electronic device (eg, AR device 120) includes a camera 126 and a sensor module 128 included in the electronic device 120 Through this, environmental data regarding the surrounding environment of the first point at which the installation of the external electronic device 140 is requested may be collected. According to various embodiments, operation 710 may be performed through the environmental element management unit 360 of FIG. 3.

According to various embodiments, the processor 121 may view the view collected by the camera 126 and the location information of the electronic device 120 acquired by the GPS module 127 (eg, the latitude of the electronic device 120) , Hardness, height), environmental data by combining the inclination angle of the electronic device 120 obtained by the tilt sensor 129 in the sensor module 128 and the azimuth angle of the electronic device 120 obtained by the geomagnetic sensor 130 Can be collected. Since various details regarding the first environment data described with reference to operation 510c of FIG. 5C may be applied to environment data according to various embodiments, the description will not be repeated herein.

In operation 720, the processor 121 may transmit environmental data collected in operation 710 to the server 110 through the communication module 123 included in the electronic device 120. According to various embodiments, operation 720 may be performed through the data transmission unit 352 of FIG. 3.

In operation 730, the processor 121 may receive installation information regarding the installation of the external electronic device 140 from the server 110 through the communication module 123 included in the electronic device 120. According to various embodiments, operation 730 may be performed through the data receiving unit 353 of FIG. 3.

According to various embodiments, installation information may be generated as a result of a simulation performed on the server 110. According to various embodiments of the present disclosure, the installation information includes a location, azimuth, and inclination angle at which the external electronic device 140 is installed among first information described with reference to operation 530c of FIG. 5C or second information described with reference to operation 640 of FIG. 6. It may be information about at least one of. For example, referring to Table 2, the installation information may be information about latitude, longitude, height, azimuth, and inclination angle at which the external electronic device 140 is installed. Various details of the first information and the second information of FIG. 6 described with reference to operation 530c of FIG. 5C may be applied to the installation information according to various embodiments, and will not be repeated herein.

In operation 740, the processor 121 may check current state information regarding the current installation state of the external electronic device 140. According to various embodiments, the processor 121 may check the current state information by receiving the current state information from the external electronic device 140 through the communication module 123. According to various embodiments, current status information may be received from the external electronic device 140 through the data receiving unit 342 of FIG. 3. According to various embodiments, the processor 121 may check current status information based on data obtained using the camera 126, the GPS module 127, and the sensor module 128. Specifically, the processor 121 acquires an image of the external electronic device 140 using the camera 126, and uses the GPS module 127 and the sensor module 128 to obtain a camera at the time when the image is acquired ( The position of 126 and the angle of view of camera 126 can be obtained. Thereafter, the processor 121 may determine the position, inclination angle, and azimuth angle of the external electronic device 140 in the image obtained using the camera 126. According to various embodiments, the current state information of the external electronic device 140 may include at least one of latitude, longitude, height, azimuth angle, and inclination angle at which the external electronic device 140 is installed. Table 4 shows examples of current state information according to various embodiments.

안테나_01Antenna_01
위도Latitude	42.3140089º42.3140089º
경도Hardness	71.2504569º71.2504569º
높이Height	2.5M2.5M
방위각azimuth	100º100º
경사각Tilt angle	0º0º

In operation 750, the processor 121 may output an installation guide in response to the installation information and the current state information not matching. According to various embodiments, the processor 121 may check whether installation information and current state information match. For example, when the installation information is shown in Table 2 and the current state information is shown in Table 4, the processor 121 may confirm that the installation information and the current state information do not match. According to various embodiments, the processor 121 may output an installation guide through the display 124. According to various embodiments, details of the installation guide described above with reference to operation 530a of FIG. 5A may be applied in operation 750. According to various embodiments, at least a part of the installation guide may be output through the sound output device 255 of the electronic device 201. According to various embodiments, the processor 121 may output an installation guide through the display 124 and output at least a portion of the installation guide through the sound output device 255. According to various embodiments, sounds varying in frequency, intensity, and height according to the similarity between the current state information and the installation information of the external electronic device 140 in real time may be output through the sound output device 255. have.

According to various embodiments, details of the installation guide described above with reference to FIG. 5 530a may be applied to the installation guide of operation 750. In addition, details of an installation guide to be described later with reference to FIGS. 11A, 11B, 12A, 12B, 13A, and 13B may be applied to the installation guide of operation 750.

Although not shown in FIG. 7, according to various embodiments, the processor 121 determines whether installation information and current state information match, and when it is determined that installation information and current state information match, external electronics The device 140 may output a message indicating that there is no need to change the installed position, inclination angle, or azimuth angle. According to various embodiments, the message may be output through the display 124 of the electronic device 120. According to various embodiments, the message may be output through the audio output device 255 of the electronic device 120.

8 illustrates an exemplary screen according to an operation of an AR device according to various embodiments. Specifically, FIG. 8 shows an AR device 120 when collecting environmental data regarding a surrounding environment of a first point where the installation of the external electronic device 140 is requested from an AR device (eg, AR device 120). An exemplary screen 800 that can be displayed on the display 124 of FIG. According to various embodiments, the screen 800 may include a view of at least a portion of the surrounding environment of the first point captured by the camera 126 of the AR device 120. According to various embodiments, on the display 124 of the AR device 120, the location of at least one

environmental element

811, 812, 813, 814 included in the view for at least a portion of the surrounding environment of the first point Can be displayed. According to various embodiments, one 811 of the at least one

environmental element

811, 812, 813, 814 may be highlighted and displayed in a different manner from other

environmental elements

811, 812, 813. According to various embodiments, the highlighted and displayed environmental element 811 may be an environmental element that is required to check attributes based at least in part on a user input. According to various embodiments, the screen 800 may include a message 830 for requesting user input regarding the attribute of the highlighted environmental element 811 and an attribute input area 820 in which the user input is made. According to various embodiments, the attribute input area 820 may be displayed as translucent superimposed on a view of at least a portion of the surrounding environment of the first point. According to various embodiments, the attribute input area 820 is opaquely displayed, and a view of at least a portion of the surrounding environment of the first point is displayed only in the area 810 of the screen 800 except for the attribute input area 820. Can be. According to various embodiments, a plurality of

candidates

821, 822, 823, 824, 825, and 826 regarding the attribute of the highlighted environment element 811 may be displayed in the attribute input field 820.

9A is a flowchart illustrating an operation of an AR device according to various embodiments of the present disclosure. Specifically, FIG. 9A shows operations 900a performed for environmental data collection, described with reference to FIG. 8. In operation 910, the processor (eg, processor 121) included in the AR device (eg, AR device 120) is installed in an external electronic device (eg, external electronic device 140). The image of the first element in the surrounding environment of the requested first point may be displayed in a different way from other elements in the surrounding environment. According to various embodiments, the display of the operation 910 may be performed through the display 124 displaying the augmented reality screen. In FIG. 8, an example is shown in which the color of the highlight outline displayed around the first element 811 is different from the highlight outline displayed around the

other elements

812, 813, 814, but the first element The method of displaying the image in different ways from other elements is not limited to this.

In operation 920, the processor 121 included in the AR device 120 may display a plurality of candidates (eg, FIG. 8) regarding attributes of the first element (eg, 811 of FIG. 8) through the display 124. 821, 822, 823, 824, 825, and 826).

In operation 930, the processor 121 included in the AR device 120 may include the candidate selected through the input interface in the first environment data by corresponding to the first element. According to various embodiments, for example, when the ginkgo 821 is selected in FIG. 8, the processor 121 may include information that the first element 811 is a ginkgo tree in the first environment data. The details described above with respect to the input interface 125 of FIG. 1 and the input device 250 of FIG. 2 may be applied to the input interface according to various embodiments, and will not be repeated herein.

9B is a flowchart illustrating an operation of an AR device according to various embodiments. Specifically, FIG. 9B shows operations 900b for displaying a candidate for an attribute of an environmental element, related to operation 920 of FIG. 9A. In operation 921, a processor (eg, processor 121) included in the AR device (eg, AR device 120) includes a plurality of

candidates

821, 822, and 1 for attributes of the first element 811. 823, 824, 825, and 826).

According to various embodiments, the AR device 120 may include a model for deriving an attribute of an environmental element from an image of the environmental element. In this case, the processor 121 of the AR device 120 may include the AR device 120 ), the probability of matching for each of the plurality of

candidates

821, 822, 823, 824, 825, and 826 regarding the attribute of the first element 811 can be confirmed.

According to various embodiments, the server 110 may include a model for deriving an attribute of an environmental element from an image of the environmental element, and in this case, the processor 121 of the AR device 120 may include a communication module 123 The image of the first element 811 may be transmitted to the server 110 through the processor 121 of the AR device 120, and then the first element derived using the model from the server 110 ( A plurality of candidates (821, 822, 822) by receiving the probability of matching for each of the plurality of candidates (821, 822, 823, 824, 825, 826) regarding the attribute of 811 through the communication module 123 from the server 110 823, 824, 825, and 826).

According to various embodiments, the second server separate from the server 110 may include a model for deriving an attribute of the environmental element from the image of the environmental element, in this case, the processor 121 of the AR device 120 Can transmit the image of the first element 811 to the second server through the communication module 123, and then, the processor 121 of the AR device 120 is derived using the model from the second server A plurality of candidates 821 by receiving the matching probability for each of the plurality of

candidates

821, 822, 823, 824, 825, and 826 regarding the attribute of the first element 811 from the second server through the

communication module

123 , 822, 823, 824, 825, 826). According to various embodiments, when the second server separate from the server 110 includes a model for deriving the attributes of the environmental elements from the image of the environmental elements, the processor 121 of the AR device 120 may include the server 110 ), the image of the first element 811 can be transmitted, and after the server 110 transmits the image of the first element 811 to the second server, the second server derives the image using the model , The matching probability for each of the plurality of

candidates

821, 822, 823, 824, 825, and 826 regarding the attribute of the first element 811 is transmitted from the second server to the AR device 120 through the server 110 Can be.

According to various embodiments, at least one of the candidate or the image of the first element selected through the input interface identified in operation 930 of FIG. 9A is used to update the model for deriving the attributes of the environment element from the image of the environment element. Can be. Although not shown in FIG. 9A, after operation 930 of FIG. 9A is performed, the processor 121 of the AR device 120 stores at least one of the selected candidate or the first element image through the input interface in the memory 122. It may be stored, transmitted to the server 110 through the communication module 123, or transmitted to the second server through the communication module 123.

In operation 922, the processor 121 of the AR device 120 may display a plurality of candidates related to the attribute of the first element on the display 124 according to the identified match probability. According to various embodiments, the processor 121 may display a plurality of candidates on the display 124 in the order of the candidates having the highest matching probability from the lowest candidate.

According to various embodiments, a method of confirming an attribute of an environmental element when collecting environmental data is not limited to the operations illustrated in FIGS. 9A and 9B. According to various embodiments of the present disclosure, the processor 121 of the AR device 120 checks the probability of matching for each of a plurality of candidates for the attribute of the environment element by using a model included in the AR device 120, and then the plurality of candidates Is displayed on the display 124 or receives input from a user, and the candidate with the highest matching probability can be identified as an attribute of the environment element.

According to various embodiments, when the server 110 includes a model for deriving an attribute of an environmental element from an image of the environmental element, the processor 121 of the AR device 120 may perform a server through the communication module 123. An image of the environmental element may be transmitted to 110. After that, the processor 121 receives the matching probability of each candidate from the server 110 and then identifies the candidate having the highest matching probability as an attribute of the environment element, or what is the candidate having the highest matching probability from the server 110 By receiving information about cognition, a candidate having the highest probability of matching can be identified as an attribute of an environmental element.

According to various embodiments, when a model for deriving the attribute of the environmental element from the image of the environmental element is included in the second server separate from the server 110, the processor 121 of the AR device 120 may include a communication module The image of the environmental element can be transmitted to the second server through 123. After that, the processor 121 receives the matching probability of each candidate from the second server and checks the candidate having the highest matching probability as an attribute of the environment element, or determines which candidate has the highest matching probability from the second server. By receiving information about, the candidate with the highest matching probability can be identified as an attribute of the environmental element.

Further, according to various embodiments, the processor 121 of the AR device 120 checks the probability of matching for each of a plurality of candidates for the attribute of the environment element, and then the probability of matching the candidate with the highest probability of matching is greater than or equal to a reference value The candidate with the highest matching probability can be identified as an attribute of the environmental element. Alternatively, when it is determined that the candidate for the attribute of the environment element cannot be identified or that the candidate having the highest probability of matching is less than the reference value, based on the input from the user as described with reference to FIGS. 8, 9A, and 9B. Operations for checking the properties of the environment element can be performed.

According to various embodiments, when the server 110 includes a model for deriving the attribute of the environmental element from the image of the environmental element, the server 110 receives the image of the environmental element from the AR device 120. After confirming the probability of matching for each of a plurality of candidates for the attribute of the environmental element, if the matching probability of the candidate with the highest matching probability is greater than or equal to a reference value, the AR device 120 provides information on which candidate has the highest matching probability. When the match probability of the candidate having the highest match probability is less than the reference value, the match probability for each of the plurality of candidates may be transmitted to the AR device 120. The AR device 120 checks the candidate having the highest matching probability as an attribute of the environment element when information on what the candidate with the highest matching probability is received, and also receives the matching probability for each of the plurality of candidates As described with reference to FIGS. 8, 9A, and 9B, operations for checking the properties of the environment element may be performed based on input from the user. According to various embodiments, even when a model for deriving the attribute of the environmental element from the image of the environmental element is included in the second server separate from the server 110, similar to the case where the model is included in the server 110 Those skilled in the art will readily understand that the second server and AR device 120 may operate.

10 is a flowchart illustrating an operation of an AR device according to various embodiments of the present disclosure. Specifically, FIG. 10 illustrates detailed operations 1000 of a process in which an AR device outputs installation information after checking installation information and current state information. In operation 1010, a processor (for example, the processor 121) of the AR device (for example, the AR device 120) includes a camera (for example, the camera 126) for an image of the external electronic device 140. It can be confirmed whether it is oriented in the direction of collecting.

According to various embodiments, the processor 121 may include a camera 126 based on information obtained from at least one of the GPS module 127, the tilt sensor 129, and the geomagnetic sensor 130, of the external electronic device 140. It is possible to check whether the image is oriented in the direction in which it is collected. According to various embodiments of the present disclosure, the processor 121 compares the current location of the AR device 120 acquired through the GPS module 127 with the current location of the external electronic device 140 included in the current state information, thereby making the AR device It is possible to determine whether the 120 is located close to a predetermined level or more to the external electronic device 140. In this case, the processor 121 is not oriented in the direction in which the camera 126 collects an image of the external electronic device 140 when the proximity between the AR device 120 and the external electronic device 140 is less than a certain level. I can judge. According to various embodiments, the processor 121 determines the direction in which the camera 126 of the AR device 120 is oriented through the tilt sensor 129 and the geomagnetic sensor 130, and based at least in part on the oriented direction The camera 126 collects an image of the external electronic device 140 by confirming whether the predicted, predicted range of the view of the camera 126 includes the current position of the external electronic device 140 included in the current state information It can be confirmed whether or not it is oriented in a direction.

According to various embodiments of the present disclosure, the processor 121 checks whether an object having a certain level of similarity with an image of the external electronic device 140 exists in the view currently being collected through the camera 126, and then the camera 126. It may be checked whether or not is oriented in the direction in which the image of the external electronic device 140 is collected. According to various embodiments, a model generated based on image data on the outer surface of the device of the external electronic device 140 may be utilized.

According to various embodiments, information for identifying the external electronic device 140 such as a serial number of the external electronic device 140 is displayed on the outer surface of the device of the external electronic device 140, and the external electronic device 140 is displayed. Data about identifiable information may be stored in advance. In this embodiment, if the processor 121 is the information that can identify the external electronic device 140 in the view currently being collected through the camera 126, the camera 126 is the external electronic device 140 It can be confirmed that it is oriented in the direction in which the images are collected. To determine whether the camera 126 is oriented in the direction in which the image of the external electronic device 140 is collected, the various criteria described above may be used in combination.

When it is determined in operation 1020 that the camera 126 is oriented in the direction in which the image of the external electronic device 140 is collected, the processor 121 may output an installation guide on the image. Details of the output of the installation guide are the same as described above with reference to 530a and 5b of FIG. 5a, and will be described later with reference to FIG. 11b.

When it is determined in operation 1030 that the camera 126 is not oriented in the direction in which the image of the external electronic device 140 is collected, the processor 121 displays the expected operation result of the external electronic device 140 corresponding to the installation information. Can be displayed. According to various embodiments, the expected operation result may indicate the expected coverage of the external electronic device 140 corresponding to the installation information. For example, the expected operation result may include information on the coverage of the main beam shown in Table 2. The details of the expected operation result are the same as described above with reference to 520c of FIG. 5C. Details of the display of the expected operation results will be described later with reference to FIGS. 12A and 12B.

11 illustrates an exemplary screen according to an operation of an AR device according to various embodiments. Specifically, FIG. 11 shows a view of a user viewing the display 124 of the AR device 120 when the installation information indicates that the external electronic device 140 is newly installed. Referring to FIG. 11, on a screen 1110 displayed by the display 124 of the AR device 120, an object 1125 indicating an installation location of the external electronic device 140 corresponding to installation information is a screen 1110. It can be displayed on. Accordingly, the user can observe the image 1120 of the external electronic device 140 together with the object 1125 indicating the installation location.

12A and 12B illustrate exemplary screens according to an operation of an AR device according to various embodiments. Specifically, FIGS. 12A and 12B illustrate that an external electronic device (eg, an external electronic device) is an antenna and corresponds to installation information on a display (eg, display 124) of an AR device (eg, AR device 120). For example, a view of the user of the AR device is shown when displaying the expected operation result of the external electronic device 140.

FIG. 12A shows a screen 1210a that displays expected coverage of the external electronic device 140 corresponding to the installation information when the installation information includes information from a single external electronic device 140. Referring to FIG. 12A, on the screen 1210a displayed through the display 124 of the AR device 120, the expected coverage of the external electronic device 140 for each environment element on the image of each environment element is different in color. Can be displayed. Referring to FIG. 12A, it can be seen that the color displayed on the front surface 1230a of the building and the color displayed on the side surface 1220a of the building are different. This means that when the external electronic device 140 is installed to correspond to the installation information, the expected radio wave strength is different from the front surface 1230a and the side surface 1220a of the building. According to various embodiments, the expected coverage of the external electronic device 140 may be a result of visualizing coverage information of the main beam as shown in Table 2. According to various embodiments, the color used to display the expected coverage of the single external electronic device 140 may be an opaque color.

FIG. 12B shows a screen 1210b displaying expected coverage by the plurality of external electronic devices 140 when the installation information includes information of the plurality of external electronic devices 140. Referring to FIG. 12B, on the screen 1210b displayed through the display 124 of the AR device 120, the predicted coverage of a plurality of external electronic devices 140 for each environment element is different on the image of each environment element. It can be displayed in color. Referring to FIG. 12B, it can be seen that the color displayed on the front surface 1230b of the building and the color displayed on the side surface 1220b of the building are different. This means that when a plurality of external electronic devices 140 are installed to correspond to the installation information, the expected radio wave strength is different from the front surface 1230b and the side surface 1220b of the building. According to various embodiments, the color used to display the expected coverage of the plurality of external electronic devices 140 may be an opaque color. According to various embodiments of the present disclosure, the processor 121 of the AR device 120 is based on the location information of the AR device 120 obtained through the GPS module 127, and the AR device among the plurality of external electronic devices 140 ( The coverage of the external electronic device 140 currently installed by the user of 120 may be displayed in a different color or different transparency from the coverage of the other external electronic device 140.

13A and 13B illustrate exemplary screens according to an operation of an AR device according to various embodiments. Specifically, FIGS. 13A and 13B illustrate that an external electronic device (eg, an external electronic device is an antenna) and corresponds to installation information on a display (eg, display 124) of an AR device (eg, AR device 120) ( For example, a view of the user of the AR device is shown when displaying the expected operation result of the external electronic device 140. According to various embodiments of the present disclosure, the processor 121 of the AR device 120 includes the current position of the external electronic device 140 including the current position of the AR device 120 obtained through the GPS module 127 in the current state information. By comparing with, it may be determined whether the AR device 120 is located close to a predetermined level or more to the external electronic device 140. As a result of the determination, when it is determined that the AR device 120 is located close to a predetermined level or more to the external electronic device 140, the processor 121 displays the screen 1310a as shown in FIG. 13A through the display 124. Can be displayed. In FIG. 13A, it can be seen that the location of the external electronic device 1320a is close to the AR screen 1310a, and in this case, the screen 1310a is for each environment element in a view close to the viewpoint of the external electronic device 1320a. An expected operation result of the external electronic device 140 may be displayed.

According to various embodiments of the present disclosure, when it is determined that the AR device 120 is not positioned close to a predetermined level or more by the external electronic device 140 in the processor 121 of the AR device 120, the processor 121 displays the display 124 ), the screen 1310b as shown in FIG. 13B may be displayed. In FIG. 13B, it can be seen that the location of the external electronic device 1320b is relatively far from the AR screen 1310b, and in this case, the AR device (relative to the external electronic device 1320b) is relatively far away from the screen 1310b. In the view of 120), an expected operation result of the external electronic device 140 for each environment element may be displayed. According to various embodiments, when the location of the external electronic device 1320b is relatively far from the AR screen 1310b, the expected operation result of the external electronic device 1320b that is not completely displayed on the screen 1310b may be displayed on the screen 1310b. A symbol 1330 indicating that there is more area to be covered may be displayed. The details regarding the display of the expected operation results have been described above, and thus are not repeated.

14A illustrates an exemplary screen according to an operation of an AR device according to various embodiments. Specifically, FIG. 14A illustrates a screen 1410a displayed on the display of an exemplary AR device when the external electronic device is an indoor communication device and operations according to various embodiments are performed in an indoor environment. According to various embodiments, in the situation of installing or maintaining an indoor communication device such as a 5G CPE or router for using a network in an indoor environment, the above-described operations may be performed. According to various embodiments, in an indoor environment, a user's AR device (eg, AR device 120), an indoor communication device (eg, external electronic device 140), and a network service provider's server (eg, For example, the above-described operations may be performed by the server 110. According to various embodiments, the user's home address may be provided to the network service provider by the user or through the GPS module 127 of the user's AR device, and the user's home address may be identified based on the user's home address. Information about the outdoor antenna can be further considered in the simulation. As in FIG. 14A, a location for installing the indoor communication device 1420a may be displayed on the screen 1410a. According to various embodiments, an azimuth or inclination angle may be further displayed on the screen 1410a in addition to a location for the indoor communication device 1420a to be installed.

14B illustrates an AR device when an external electronic device is

IoT devices

1421b, 1422b, 1423b, and 1424b, that is, in a situation in which

IoT devices

1421b, 1422b, 1423b, and 1424b are arranged. An exemplary screen according to the operation is shown. According to various embodiments, the server (e.g., server 110) communicates between

IoT devices

1421b, 1422b, 1423b, 1424b, particularly the IoT hub 1422b and

other IoT devices

1421b, 1423b, 1424b ) Simulation can be performed to derive information about the installation of

IoT devices

1421b, 1422b, 1423b, 1424b to minimize interference between communications between each other. According to various embodiments, as shown in FIG. 14B, a location for the IoT hub 1422b to be installed may be displayed on the screen 1410b. According to various embodiments, in addition to a location for the

IoT devices

1421b, 1422b, 1423b, and 1424b to be installed on the screen 1410b, an azimuth or inclination angle may be further displayed.

14C illustrates an exemplary screen according to an operation of an AR device when an external electronic device is a plurality of

speakers

1421c and 1422c, that is, a situation in which a plurality of

speakers

1421c and 1422c are arranged according to various embodiments of the present disclosure. do. According to various embodiments, the server (for example, the server 110) includes a plurality of

speakers

1421c and 1422c for widening the distribution of sweet spots caused by the operation of the plurality of speakers 1421c and 1422c. ) Can be performed to derive information about the installation. According to various embodiments, the sweet spot may be defined as an area for a listener to hear the best sound from a plurality of

speakers

1421c and 1422c. According to various embodiments, as shown in FIG. 14C, locations for installing a plurality of

speakers

1421c and 1422c may be displayed on the screen 1410c. According to various embodiments, in addition to a location where the plurality of

speakers

1421c and 1422c are installed on the screen 1410c, an azimuth angle or an inclination angle may be further displayed.

15A, 15B, and 15C illustrate a server (eg, server 110), an AR device (eg, AR device 120), and a communication device (eg, communication device (eg, communication device) according to various embodiments. 140)). 15A to 15C, for convenience, an installation or maintenance situation for maximizing the coverage of the antenna 1501 is assumed, but similar operations may be performed in the above-described embodiment with reference to FIGS. 14A, 14B, and 14C. It will be understood by those skilled in the art.

In operation 1511, the AR device 1502 may execute an application for obtaining information regarding the installation of the antenna 1501 in the installation or maintenance situation of the antenna 1501. In operation 1512, the AR device 1502 may connect the registered account. In operation 1513, the AR device 1502 may request confirmation of the account information from the server 1503. The server 1503 may receive an account information confirmation request in operation 1514, confirm that the account information is registered in operation 1515, transmit the result of the confirmation, and perform a login and connection to the server 1503 in operation 1516. After the login is confirmed, the AR device 1502 may turn on the AR function and the camera in operation 1517.

In operation 1521, the antenna 1501 may sense the location of the antenna 1501 and data regarding the equipment of the antenna 1501 and transmit it to the AR device 1502. In operation 1522, the AR device 1502 may receive data regarding the location of the antenna 1501 and the equipment of the antenna 1501 from the antenna 1501. The AR device 1502 may execute a scan function in operation 1523 and may generate environmental element scan data regarding the environment surrounding the antenna 1501 in operation 1524. In operation 1525, the AR device 1502 may check whether data related to attributes of environmental elements in the image obtained through the scan are automatically recognized or generated in the process of generating data through the scan of operation 1524. If the data related to the attribute of the environment element is not automatically recognized or generated, in operation 1526, the AR device 1502 may check the data input by the user. If the data on the attribute of the environmental element is automatically recognized or generated, in operation 1527, the AR device 1502 may automatically check the data on the attribute of the recognized or generated environmental element and transmit it to the server 1503. . In operation 1528, the location of the antenna 1501 and the data related to the equipment of the antenna 1501 and environment element scan data may be transmitted from the AR device 1502 to the server 1503.

In operation 1530, the server 1503 may receive the location of the antenna 1501 and the data related to the equipment of the antenna 1501 and environment element scan data, and retrieve existing environment data. The server 1503 may check whether the environment element scan data received in operation 1532 differs from the existing environment data by comparing the environment element scan data received in operation 1531 with the existing environment data. If it is determined that the received environmental element scan data is different from the existing environmental data, in operation 1534, the server 1503 may update the existing environmental data with the received environmental element scan data. The server 1503 may perform a simulation based on the updated environment data in operation 1535, and derive a simulation result value in operation 1536. The simulation result value may be transmitted to the AR device 1502 in operation 1537. The AR device 1502 may receive and store the simulation result in operation 1538.

In operation 1541, the antenna 1501 may check the current status information including the height, direction, and tilt at which the antenna 1501 is currently installed, and transmit the current status information to the AR device 1502. The AR device 1502 may receive the current state information from the antenna 1501 in operation 1542 and sense the position and direction of the AR device 1502 in operation 1543. In operation 1551, the AR device 1502 may check whether the AR device 1502 is facing the antenna 1501. When it is determined that the AR device 1502 is not facing the antenna 1501, in operation 1557, the AR device 1502 may check whether the positions of the AR device 1502 and the antenna 1501 are within a similar range. . When it is determined that the positions of the AR device 1502 and the antenna 1501 are within a similar range, the AR device 1502 is in a view of the AR device 1502 in a first-person view close to the antenna 1501 in operation 1558. By mapping to the elements, simulation results can be displayed using color. When it is determined that the positions of the AR device 1502 and the antenna 1501 are not within a similar range, the AR device 1502 displays the simulation result at a third person point of view in operation 1559 as an environment element within the view of the AR device 1502. Can be mapped to and displayed. If it is determined in operation 1551 that the AR device 1502 is facing the antenna 1501, the AR device 1502 calculates the difference between the current state information of the antenna 1501 and the simulation result value in operation 1552, and in operation 1553 It can be confirmed whether there is a difference between the current state information of the antenna 1501 and the simulation result. If it is determined in operation 1553 that there is no difference between the current state information of the antenna 1501 and the simulation result value, in operation 1554, the AR device 1502 may display a message that the antenna 1501 has been properly installed as planned. . If it is determined in operation 1553 that there is a difference between the current state information of the antenna 1501 and the simulation result value, in operation 1555, the AR device 1502 may display the simulation result value and the current state information together as an installation guide. . Thereafter, in operation 1556, the antenna 1501 may check whether an operation for the antenna 1501 according to the installation guide is recognized, or terminate the operations when it is determined that the operation for the antenna 1501 is not recognized. can do. If it is determined in operation 1556 that the operation for the antenna 1501 according to the installation guide is recognized, the antenna 1501 may check the current state information changed in operation 1541.

According to various embodiments, the electronic device 120 may include a communication module 123; Display 124; And a processor 121, wherein the processor 121: receives installation information regarding installation of at least one external electronic device 140 from the server 110 through the communication module 123; Receive current state information regarding a current installation state of the at least one external electronic device 140 from the communication device; The installation guide for the at least one external electronic device 140 identified based on the installation information and the current state information may be set to be output through the display 124 as an augmented reality screen.

According to various embodiments of the present disclosure, the installation guide includes an augmented reality object representing a required change with respect to the installation state of the at least one external electronic device 140, which is identified based on the difference between the installation information and the current state information. It can contain.

According to various embodiments, the electronic device 120 further includes a camera 126 and a sensor module 128, and the environmental data is transmitted through the electronic device (through the camera 126 and the sensor module 128 ). 120), and may be transmitted to the server 110 through the communication module 123.

According to various embodiments, the processor 121 may: via the display 124, image the first element in the surrounding environment captured by the camera 126 different from other elements in the surrounding environment. Denoted by; Display, through the display 124, a plurality of candidates for attributes of the first element; A candidate selected through the input interface among the plurality of candidates may be set to be included in the environment data in correspondence with the first element.

According to various embodiments, the processor 121: checks a probability of matching for each of the plurality of candidates for the attribute of the first element in the surrounding environment, captured by the camera 126; The plurality of candidates may be set according to the match probability.

According to various embodiments, the processor 121 determines whether the camera 126 is oriented in a direction to collect images of the at least one external electronic device 140, and the camera 126 is the Based on the determination that the images of the at least one external electronic device 140 are not oriented in the direction in which the images are collected, augmented reality is predicted as a result of the expected operation of the at least one external electronic device 140 corresponding to the installation information. It may be set to display through the display 124 as a screen.

According to various embodiments, the at least one external electronic device 140 includes at least one antenna, and the installation information includes the at least one external that widens the coverage of the at least one external electronic device 140. The electronic device 140 may include at least one of a position, an inclination angle, and an azimuth angle.

According to various embodiments, the at least one external electronic device 140 includes an IoT hub and one or more IoT devices communicating with the IoT hub, and the installation information includes one or more IoT devices communicating with the IoT hub and the It may include at least one of the position, inclination angle, and azimuth of the at least one external electronic device 140 to minimize the interference of communication between the IoT hub.

According to various embodiments of the present disclosure, the at least one external electronic device 140 includes a plurality of speakers, and the installation information is such that the distribution of the sweet spot caused by the operation of the plurality of speakers is widest. A plurality of speakers may include at least one of a position, an inclination angle, and an azimuth angle.

According to various embodiments, the server 110 includes a communication module 113 and a processor 111, and the processor 111 includes: a first electronic device 120 through the communication module 113 Receiving first environment data collected by the first electronic device 120 from; Performing a first simulation to predict an operation result of at least one external electronic device 140 using the first environment data; Through the communication module 113, first information regarding the installation of the at least one external electronic device 140 derived as a result of the first simulation is transmitted to the first electronic device 120 -the first The electronic device 120 is an installation guide for the at least one external electronic device 140 identified based on the current state information and the first information regarding the current installation state of the at least one external electronic device 140 It can be set to output-as an augmented reality screen.

According to various embodiments, the server 110 further includes a memory 112, and the processor 111 stores the second environmental data in the memory 112 before receiving the first environmental data. And confirming whether the first environment data and the second environment data are the same based on the first environment data being received, and confirming that the first environment data and the second environment data are the same. Based on the at least one external electronic device 140 derived based on a simulation result performed based on the second environment data before transmitting the first information to the first electronic device 120 The first information is transmitted to the first electronic device 120, and the first information is transmitted to the first electronic device 120 based on the determination that the first environment data and the second environment data are different. It can be set to transmit to 120.

According to various embodiments of the present disclosure, an operation method of the electronic device 120 may include: receiving installation information regarding the installation of the at least one external electronic device 140 from the server 110; Receiving current state information regarding a current installation state of the at least one external electronic device 140 from the at least one external electronic device 140; And outputting, as an augmented reality screen, an installation guide for the at least one external electronic device 140 identified based on the installation information and the current state information.

According to various embodiments, the installation guide includes a virtual image representing a required change in relation to the installation state of the at least one external electronic device 140, which is identified based on the difference between the installation information and the current state information can do.

According to various embodiments, the method includes: collecting the environmental data through a camera 126 and a sensor module 128; And transmitting the environment data to the server 110.

According to various embodiments, the method includes: displaying an image of a first element in the surrounding environment captured by the camera 126 in a different way from other elements in the surrounding environment; Displaying a plurality of candidates for attributes of the first element; And including a candidate selected through the input interface among the plurality of candidates in the environment data by corresponding to the first element.

According to various embodiments, the method includes: determining a probability of matching for each of the plurality of candidates for the attribute of the first element in the surrounding environment, captured by the camera 126; And displaying the plurality of candidates according to the match probability.

According to various embodiments, the method may include: determining whether a camera 126 is oriented in a direction to collect images of the at least one external electronic device 140 included in the electronic device 120; And the at least one external electronic device 140 corresponding to the installation information, based on the confirmation that the camera 126 is not oriented in the direction of collecting the image of the at least one external electronic device 140. ) May further include an operation of displaying the expected operation result as the augmented reality screen.

According to various embodiments, an operation method of the server 110 may include: receiving, from the first electronic device 120, first environmental data collected by the first electronic device 120; Performing a first simulation to predict an operation result of at least one external electronic device 140 using the first environment data; And first information regarding the installation of the at least one external electronic device 140 derived as a result of the first simulation to the first electronic device 120. Outputs an installation guide for the at least one external electronic device 140 identified based on the current state information and the first information regarding the current installation state of one external electronic device 140 as an augmented reality screen- It may include an operation.

According to various embodiments, the method may include: storing second environmental data before receiving the first environmental data; Determining whether the first environment data and the second environment data are the same based on the first environment data being received; Based on the determination that the first environment data and the second environment data are the same, a simulation performed based on the second environment data before transmitting the first information to the first electronic device 120 Transmitting second information regarding the installation of the at least one external electronic device 140 derived based on a result to the first electronic device 120; And transmitting the first information to the first electronic device 120 based on the determination that the first environmental data and the second environmental data are different.

It should be understood that various embodiments of the document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, and include various modifications, equivalents, or substitutes of the embodiment. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, "A or B", "at least one of A and B", "at least one of A or B," "A, B or C," "at least one of A, B and C," and "A Each of the phrases such as "at least one of,, B, or C" may include any one of the items listed together in the corresponding phrase of the phrases, or all possible combinations thereof. Terms such as “first”, “second”, or “first” or “second” can be used to simply distinguish a component from other components, and to separate components from other aspects (eg, Importance or order). Any (eg, first) component may be “coupled” or “with or without the term “functionally” or “communically” to another (eg, second) component When referred to as "connected", it means that any of the above components can be directly (eg, wired) to other components, wirelessly, or through a third component.

The term "module" used in this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic blocks, components, or circuits. The module may be an integrally configured component or a minimum unit of the component or a part thereof performing one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document may be stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101). It may be implemented as software (eg, program 140) that includes one or more stored instructions. For example, a processor (e.g., processor 120) of a device (e.g., electronic device 101) can invoke and execute at least one of one or more instructions stored from a storage medium. have. This enables the device to be operated to perform at least one function according to the at least one command called. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The storage medium readable by the device may be provided in the form of a non-transitory storage medium. Here,'non-transitory' only means that the storage medium is a tangible device, and does not include a signal (eg, electromagnetic waves), and this term means that data is permanently stored in the storage medium. There is no distinction between cases and temporary storage.

According to one embodiment, a method according to various embodiments disclosed in this document may be provided as being included in a computer program product. Computer program products can be traded between sellers and buyers as products. The computer program product may be distributed in the form of a device-readable storage medium (eg, compact disc read only memory (CD-ROM)), or through an application store (eg, Play Store ^TM ) or two It can be distributed (eg, downloaded or uploaded) directly and online between user devices (eg, smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored at least temporarily in a storage medium readable by a device such as a memory of a manufacturer's server, an application store's server, or a relay server, or may be temporarily generated.

According to various embodiments, each component (eg, module or program) of the above-described components may include a singular or a plurality of entities. According to various embodiments, one or more components or operations of the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, modules or programs) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components the same or similar to that performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component may be executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be executed in a different order, or omitted Or, one or more other actions can be added.

Claims

In the electronic device,

Communication module;

display; And

Including a processor,

The processor:

Through the communication module, installation information regarding installation of at least one external electronic device is received from a server;

Receive current state information regarding a current installation state of the at least one external electronic device from the communication device;

An electronic device configured to output an installation guide for the at least one external electronic device, identified on the basis of the installation information and the current state information, through the display as an augmented reality screen.
According to claim 1,

The installation guide includes an augmented reality object indicating a required change in relation to the installation state of the at least one external electronic device, which is identified based on a difference between the installation information and the current state information.
According to claim 1,

The electronic device further includes a camera and a sensor module,

The environmental data is collected by the electronic device through the camera and the sensor module, and transmitted to the server through the communication module.
4. The processor of claim 3, wherein:

Through the display, displaying an image of a first element in the surrounding environment captured by the camera in a different way from other elements in the surrounding environment;

Display, through the display, a plurality of candidates for attributes of the first element;

An electronic device configured to include a candidate selected through an input interface among the plurality of candidates in the environment data in correspondence with the first element.
5. The processor of claim 4, wherein:

Confirm a match probability for each of the plurality of candidates for the attribute of the first element in the surrounding environment, captured by the camera;

An electronic device configured to display the plurality of candidates according to the match probability.
The method of claim 1, wherein the processor

Check whether the camera is oriented in a direction to collect images of the at least one external electronic device,

Based on the confirmation that the camera is not oriented in the direction of collecting the image of the at least one external electronic device, an expected operation result of the at least one external electronic device corresponding to the installation information is used as an augmented reality screen. And configured to display through the display.
According to claim 1,

The at least one external electronic device includes at least one antenna,

The installation information includes at least one of a position, an inclination angle, and an azimuth angle of the at least one external electronic device that widens the coverage of the at least one external electronic device.
According to claim 1,

The at least one external electronic device includes an IoT hub and one or more IoT devices communicating with the IoT hub,

The installation information includes at least one of a location, an inclination angle, and an azimuth angle of the at least one external electronic device that minimizes interference of communication between the IoT hub and one or more IoT devices communicating with the IoT hub.
According to claim 1,

The at least one external electronic device includes a plurality of speakers,

The installation information includes at least one of a position, an inclination angle, and an azimuth angle of the plurality of speakers that widen the distribution of a sweet spot caused by the operation of the plurality of speakers.
On the server,

Communication module, and

Including a processor,

The processor:

Receiving first environmental data collected by the first electronic device from the first electronic device through the communication module;

Performing a first simulation to predict an operation result of at least one external electronic device using the first environment data;

Through the communication module, first information regarding the installation of the at least one external electronic device derived as a result of the first simulation is transmitted to the first electronic device-the first electronic device is the at least one external electronic A server configured to output, as an augmented reality screen, an installation guide for the at least one external electronic device, identified based on current state information regarding the current installation state of the device and the first information.
The method of claim 10,

The server further includes a memory,

The processor:

Store the second environmental data in the memory before receiving the first environmental data,

On the basis of receiving the first environment data, it is checked whether the first environment data and the second environment data are the same,

Based on a result of confirming that the first environmental data and the second environmental data are the same, based on a simulation result performed based on the second environmental data before transmitting the first information to the first electronic device And transmits second information regarding the installation of the at least one external electronic device, to the first electronic device.

A server configured to transmit the first information to the first electronic device based on the determination that the first environmental data and the second environmental data are different.
In the operation method of the electronic device:

Receiving installation information regarding installation of at least one external electronic device from a server;

Receiving current state information regarding a current installation state of the at least one external electronic device from the at least one external electronic device; And

And outputting an installation guide for the at least one external electronic device, identified on the basis of the installation information and the current state information, as an augmented reality screen.
The method of claim 12,

The installation guide includes a virtual image representing a required change in relation to the installation state of the at least one external electronic device, which is identified based on the difference between the installation information and the current state information.
The method of claim 12, wherein the method:

Collecting the environmental data through a camera and sensor module; And

And transmitting the environmental data to the server.
In the server operation method, the method includes:

Receiving, from a first electronic device, first environmental data collected by the first electronic device;

Performing a first simulation to predict an operation result of at least one external electronic device using the first environment data; And

The first electronic device transmits first information regarding the installation of the at least one external electronic device derived from the result of the first simulation to the first electronic device. And outputting an installation guide for the at least one external electronic device, identified on the basis of the current state information and the first information, as an augmented reality screen.