KR20220158535A - Electronic device for remote monitoring and method of operating the same - Google Patents

Abstract

According to various embodiments, a first electronic device comprises a communication module and a processor. The processor is configured to: obtain at least one first image by using a first camera arranged to photograph a first space; obtain at least one second image by using a second camera arranged to photograph a second space; identify at least one place in which a first target object is located and at least one timepoint at which the first target object is located at the at least one place, by using a plurality of images including the at least one first image and the at least one second image; determine the order of priority of a plurality of cameras including the first camera and the second camera, on the basis of the at least one timepoint and at least one place corresponding to the first target object; receive a first identifier related to the first target object from a second electronic device through the communication module; identify the present location of the first target object by sequentially searching spaces respectively corresponding to the plurality of cameras by using the plurality of cameras, on the basis of the order of priority, in response to the reception of the first identifier; and transmit, to the second electronic device through the communication module, a first target image including the first target object, wherein the first target image is obtained by using a first target camera corresponding to the present location of the first target object from among the plurality of cameras. Therefore, a user can observe a companion animal located at a distance in real time, regardless of whether a specific camera device disposed in a designated place is selected.

Description

Electronic device for remote monitoring and its operating method {ELECTRONIC DEVICE FOR REMOTE MONITORING AND METHOD OF OPERATING THE SAME}

Various embodiments of the present disclosure relate to an electronic device for remote monitoring and an operating method thereof.

Recently, the population raising companion animals such as dogs and cats is increasing. Accordingly, even when the user is located outside the home, a technology for observing the companion animal using a camera device disposed in the home has been disclosed in order to continuously communicate with the companion animal.

Pets do not stay in one place in the home and can move from place to place. In this case, a process of determining which camera device to use among a plurality of camera devices disposed in the home to observe the companion animal is required.

When a user tries to observe a companion animal using a camera device placed in the home while being located outside the home, the user does not know where the companion animal is located, so it is decided which camera device to use to observe the companion animal. There are aspects that are difficult to do.

According to various embodiments of the present disclosure, an electronic device for remote monitoring providing a service for observing a companion animal selected by a user in real time and an operating method thereof may be provided.

According to various embodiments, a first electronic device includes a communication module and a processor, wherein the processor obtains at least one first image using a first camera disposed to photograph a first space; At least one second image is acquired using a second camera arranged to capture two spaces, and a plurality of images including the at least one first image and the at least one second image are used to obtain the first image. Checking at least one place where the target object is located and at least one viewpoint where the first target object is located at the at least one place, and determining the at least one place corresponding to the first target object and the at least one viewpoint based on the above, priorities of a plurality of cameras including the first camera and the second camera are determined, a first identifier related to the first target object is received from a second electronic device through the communication module, and the In response to receiving the first identifier, the current location of the first target object is identified by sequentially searching each space corresponding to the plurality of cameras using the plurality of cameras based on the priority order, and , A first target image including the first target object, obtained by using a first target camera corresponding to the current position of the first target object among the plurality of cameras, through the communication module 2 can be set to transmit to electronic devices.

According to various embodiments, the second electronic device may include a display; communication module; and a processor, wherein the processor controls the display to display a screen including a plurality of objects, checks a user input for selecting a first object from among the plurality of objects, and based on the user input, A first identifier associated with a first target object corresponding to the first object is transmitted to the first electronic device through the communication module, and a priority determined in advance by the first electronic device in response to receiving the first identifier A first target image including the first target object disposed in the first space, obtained using a first camera arranged to photograph the first space, selected based on The first image obtained by using a second camera received from an electronic device, controlling the display to display the first image, and photographing a second space different from the first camera in the first electronic device. Receive a second target image including the first target object disposed in 2 spaces from the first electronic device through the communication module, and display the second target image instead of the first target image. Can be set to control the display.

According to various embodiments, a method of operating a first electronic device may include obtaining at least one first image using a first camera arranged to capture a first space, and a second image arranged to capture a second space. Obtaining at least one second image using a camera, using a plurality of images including the at least one first image and the at least one second image, at least one place where the first target object is located and checking at least one viewpoint where the first target object is located at the at least one place, based on the at least one place corresponding to the first target object and the at least one viewpoint, the first camera and determining the priority of a plurality of cameras including the second camera, receiving a first identifier related to the first target object from a second electronic device through a communication module, and receiving the first identifier. In response, checking the current location of the first target object by sequentially searching each space corresponding to the plurality of cameras using the plurality of cameras based on the priority, and A first target image including the first target object, obtained by using a first target camera corresponding to the current position of the first target object among cameras, is transmitted to the second electronic device through the communication module. It may include an operation to transmit.

According to various embodiments, by providing an electronic device for remote monitoring and an operating method thereof, a user can observe a companion animal located at a distance in real time, regardless of whether a specific camera device disposed in a designated place is selected. .

In various embodiments, observing a companion animal located at a distance using an electronic device for remote monitoring and an operation method thereof is an example, and those skilled in the art can observe a person or an object located at a distance as another example. I can understand.

1 is a block diagram of an electronic device in a network environment, according to various embodiments.
2 is a block diagram of electronic devices in a network environment for remote monitoring, according to various embodiments.
3 is a diagram for explaining a method of operating a second electronic device according to a comparative example.
4 is a diagram for explaining a method of operating a second electronic device according to various embodiments.
5 is a flowchart illustrating a method of operating electronic devices included in a network environment according to various embodiments.
6 is a diagram for explaining a method of operating a second electronic device according to various embodiments.
7 is a diagram for explaining a method of operating a second electronic device according to various embodiments.
8A is a flowchart illustrating a method of operating a first electronic device according to various embodiments.
8B is a flowchart illustrating a method of operating a first electronic device according to various embodiments.
9 is a flowchart illustrating a method of operating a first electronic device according to various embodiments.
10 is a flowchart illustrating a method of operating a first electronic device according to various embodiments.
11 is a flowchart illustrating a method of operating a second electronic device according to various embodiments.
12 is a diagram for explaining a method of operating a second electronic device according to various embodiments.

1 is a block diagram of an electronic device in a network environment, according to various embodiments. Referring to FIG. 1 , in a network environment 100, an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or through a second network 199. It is possible to communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or the antenna module 197 may be included. In some embodiments, in the electronic device 101, at least one of these components (eg, the connection terminal 178) may be omitted or one or more other components may be added. In some embodiments, some of these components (eg, sensor module 176, camera module 180, or antenna module 197) are integrated into a single component (eg, display module 160). It can be.

The processor 120, for example, executes software (eg, the program 140) to cause at least one other component (eg, hardware or software component) of the electronic device 101 connected to the processor 120. It can control and perform various data processing or calculations. According to one embodiment, as at least part of data processing or operation, the processor 120 transfers instructions or data received from other components (e.g., sensor module 176 or communication module 190) to volatile memory 132. , processing commands or data stored in the volatile memory 132 , and storing resultant data in the non-volatile memory 134 . According to one embodiment, the processor 120 may include a main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit ( NPU: neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, when the electronic device 101 includes the main processor 121 and the auxiliary processor 123, the auxiliary processor 123 may use less power than the main processor 121 or be set to be specialized for a designated function. can The secondary processor 123 may be implemented separately from or as part of the main processor 121 .

The secondary processor 123 may, for example, take the place of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, running an application). ) state, together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to one embodiment, the auxiliary processor 123 (eg, image signal processor or communication processor) may be implemented as part of other functionally related components (eg, camera module 180 or communication module 190). have. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. AI models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself where artificial intelligence is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning or reinforcement learning, but in the above example Not limited. The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the foregoing, but is not limited to the foregoing examples. The artificial intelligence model may include, in addition or alternatively, software structures in addition to hardware structures.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101 . The data may include, for example, input data or output data for software (eg, program 140) and commands related thereto. The memory 130 may include volatile memory 132 or non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used by a component (eg, the processor 120) of the electronic device 101 from the outside of the electronic device 101 (eg, a user). The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. A receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 may visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module 160 may include a touch sensor set to detect a touch or a pressure sensor set to measure the intensity of force generated by the touch.

The audio module 170 may convert sound into an electrical signal or vice versa. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device connected directly or wirelessly to the electronic device 101 (eg: Sound may be output through the electronic device 102 (eg, a speaker or a headphone).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a bio sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device 101 to an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 may be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert electrical signals into mechanical stimuli (eg, vibration or motion) or electrical stimuli that a user may perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to one embodiment, the power management module 188 may be implemented as at least part of a power management integrated circuit (PMIC), for example.

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). Establishment and communication through the established communication channel may be supported. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : a local area network (LAN) communication module or a power line communication module). Among these communication modules, a corresponding communication module is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a telecommunications network such as a computer network (eg, a LAN or a WAN). These various types of communication modules may be integrated as one component (eg, a single chip) or implemented as a plurality of separate components (eg, multiple chips). The wireless communication module 192 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199. The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, NR access technology (new radio access technology). NR access technologies include high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and access of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low latency (URLLC)). -latency communications)) can be supported. The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 uses various technologies for securing performance in a high frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. Technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna may be supported. The wireless communication module 192 may support various requirements defined for the electronic device 101, an external electronic device (eg, the electronic device 104), or a network system (eg, the second network 199). According to one embodiment, the wireless communication module 192 may be used to realize Peak data rate (eg, 20 Gbps or more) for realizing 1eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency (for realizing URLLC). Example: downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) may be supported.

The antenna module 197 may transmit or receive signals or power to the outside (eg, an external electronic device). According to one embodiment, the antenna module 197 may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is selected from the plurality of antennas by the communication module 190, for example. can be chosen A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module 197 in addition to the radiator.

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first surface (eg, a lower surface) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, array antennas) disposed on or adjacent to a second surface (eg, a top surface or a side surface) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( e.g. commands or data) can be exchanged with each other.

According to an embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or part of operations executed in the electronic device 101 may be executed in one or more external electronic devices among the external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 instead of executing the function or service by itself. Alternatively or additionally, one or more external electronic devices may be requested to perform the function or at least part of the service. One or more external electronic devices receiving the request may execute at least a part of the requested function or service or an additional function or service related to the request, and deliver the execution result to the electronic device 101 . The electronic device 101 may provide the result as at least part of a response to the request as it is or additionally processed. To this end, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an internet of things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199 . The electronic device 101 may be applied to intelligent services (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

2 is a block diagram of electronic devices in a network environment for remote monitoring, according to various embodiments.

Referring to FIG. 2 , according to various embodiments, a network environment includes a first electronic device 210, a second electronic device 220, and/or at least one camera (eg, a first camera 230). ), a second camera 240, and/or an Nth camera 250). 2 shows that the number of cameras included in the network environment is three or more, but the number of cameras included in the network environment is not limited. The first electronic device 210 according to an embodiment may be implemented in the form of the electronic device 102, the electronic device 104, the server 108, or the electronic device 101 of FIG. there is no The second electronic device 220 may be implemented in the form of the electronic device 101 of FIG. 1 and is not limited thereto. The first electronic device 210 may include a processor 211 and/or a communication module 212 . The second electronic device 220 may include a processor 221 , a communication module 222 , and/or a display module 229 . The processor 211 and the processor 221 may be implemented in the form of the processor 120 of FIG. 1, and there is no limitation thereto. The communication module 212 and the communication module 222 may be implemented in the form of the communication module 190 of FIG. 1, and there is no limitation thereto. At least one camera (eg, the first camera 230, the second camera 240, and / or the Nth camera 250) is a camera module of the same form as the camera module 180 of FIG. 1 ( (not shown) may be included, and a communication module (not shown) of the same type as the communication module 190 of FIG. 1 may be included.

According to an embodiment, referring to FIG. 2 , at least one camera (eg, a first camera 230 , a second camera 240 , and/or an Nth camera 250 ) is installed in a first electronic device. Although shown as a separate device that exists outside in 210, this is exemplary, and at least one camera (eg, the first camera 230, the second camera 240, and / or Alternatively, all or part of the Nth camera 250 may be included inside the first electronic device 210 or may be implemented as a device separate from the first electronic device 210 .

According to an embodiment, the first electronic device 210 (eg, processor 211) includes at least one camera (eg, first camera 230, second camera 240, and/or Alternatively, an image may be obtained using the Nth camera 250 . For example, when the first electronic device 210 includes at least one camera (eg, 230, 240, and/or 250), the first electronic device 210 includes at least one camera ( For example, an image may be acquired by controlling 230, 240, and/or 250). For another example, when the first electronic device 210 is implemented as a device separate from at least one camera (eg, 230, 240, and/or 250), the first electronic device 210, An image obtained by at least one camera (eg, 230 , 240 , and/or 250 ) may be received through the communication module 212 . Here, an image is a concept that includes not only a still image but also a moving image, and acquiring an image or displaying an image may mean obtaining or displaying an image. Also, acquiring the image or displaying the image may include an operation of obtaining a sound associated with the image or outputting a sound associated with the image. The sound associated with the image may be generated by a microphone device (not shown) included in at least one camera (eg, 230, 240, and/or 250) and/or at least one camera (eg, 230, 240, and/or 250). / or 250) may be obtained using a microphone device (not shown) implemented separately.

According to an embodiment, the second electronic device 220 (eg, the processor 221 ) may obtain an image from the first electronic device 210 using the communication module 222 . For example, the first electronic device 210 transmits an image acquired using at least one camera (eg, 230, 240, and/or 250) to a second electronic device using the communication module 212. It can be transmitted to the electronic device 220 . The second electronic device 220 may display the image obtained from the first electronic device 210 on the display module 229 .

3 is a diagram for explaining a method of operating a second electronic device according to a comparative example. At least some of the operations of the second electronic device 220 according to the comparative example may also be performed by the second electronic device 220 according to various embodiments.

Referring to FIG. 3 , the second electronic device 220 (eg, the processor 221) according to the comparative example includes at least one camera (eg, the first camera 230 and the second camera 240). ), and/or a screen 310 for selecting one of the Nth cameras 250) may be displayed on the display module 229. The second electronic device 220 includes a plurality of objects (eg, text or images) displayed on the screen 310 (eg, at least one camera (eg, 230, 240, and/or 250)). A user input for selecting one object from among each object (for example, text corresponding to the product name of each camera or a preset name corresponding to each camera) indicating the . The second electronic device 220 may transmit, to the first electronic device 210, a signal requesting transmission of an image acquired using a camera corresponding to an object selected from among a plurality of objects displayed on the screen 310. . The first electronic device 210, in response to a request of the second electronic device 220, displays an image acquired using a camera selected from among at least one camera (eg, 230, 240, and/or 250). It can be transmitted to the second electronic device 220 . The second electronic device 220 may display the image received from the first electronic device 210 on the display module 229 . Accordingly, the second electronic device 220 may display an image acquired using the selected camera.

Referring to FIG. 3 , the second electronic device 220 (eg, the processor 221) according to various embodiments of the present disclosure selects at least one camera (eg, the processor 221) displayed on the screen 310 based on priorities. For example, the display order of the first camera 230, the second camera 240, and/or the Nth camera 250 may be determined. For example, the second electronic device 220 may display a camera with the highest priority at the top of the screen 310 and a camera with the lowest priority at the bottom of the screen 310 . The priorities will be discussed later.

4 is a diagram for explaining a method of operating a second electronic device according to various embodiments.

Referring to FIG. 4 , the second electronic device 220 (eg, the processor 221) according to various embodiments displays a screen 410 for selecting one target object from among at least one target object, It can be displayed on the display module 229. A target object may mean a specific companion animal, a specific person, a specific object, or a specific place. For example, referring to FIG. 4 , the user may preset information on three companion animals. Accordingly, the second electronic device 220 includes three preset objects corresponding to three target objects (eg, three companion animals) (eg, images corresponding to each companion animal, and / or text indicating the name or type of each companion animal) may be displayed on the display module 229 . The second electronic device 220 may check a user input for selecting one object from among a plurality of objects set to correspond to a plurality of target objects. The second electronic device 220 is a target object (eg, a drawing corresponding to a photo or text corresponding to "Maltese" in FIG. In step 4, as the user's companion animal, an identifier related to a companion animal whose breed is "Maltese" and whose name is "Golden Lee" (eg, an identifier previously designated as representing the companion animal "Golden Lee"), in a first step. It can be transmitted to the electronic device 210. The identifier represents a specific target object, and there is no limitation in its kind. The first electronic device 210, in response to receiving a specific identifier associated with a specific target object from the second electronic device 220, a plurality of cameras (eg, the first camera 230, the second camera ( 240) and/or the Nth camera 250), an image including a specific target object acquired using at least one camera may be transmitted to the second electronic device 220. The second electronic device 220 may display the image received from the first electronic device 210 on the display module 229 . Accordingly, the second electronic device 220 may display an image including the selected target object.

5 is a flowchart illustrating a method of operating electronic devices included in a network environment according to various embodiments.

Referring to FIG. 5 , in operation 501, according to various embodiments, the first electronic device 210 (eg, the processor 211) includes a plurality of cameras (eg, the first camera 230, At least one image may be acquired using at least one of the second camera 240 and/or the Nth camera 250 . According to various embodiments, at least some of the plurality of cameras (eg, the first camera 230, the second camera 240, and/or the Nth camera 250) are fixed cameras, and are arranged in a position ( For example, it may be arranged to be fixed to one side of a bedroom ceiling and photograph a designated space (eg, a bedroom) at a designated angle (eg, an angle looking down at a floor from one side of a bedroom ceiling at 45 degrees). have. Among the plurality of cameras (eg, the first camera 230, the second camera 240, and/or the Nth camera 250), some of the others are rotational cameras, and are placed in a position (eg, the ceiling of a living room). It is fixed on one side of the screen), but may be arranged to photograph a designated space (eg, a living room) in various directions by rotating. Among the plurality of cameras (eg, the first camera 230, the second camera 240, and/or the N-th camera 250), another part is a movable camera, which is not fixed to a specific location and is used in designated spaces. It can move, and accordingly, various spaces can be photographed from various directions. The types of the plurality of cameras (eg, the first camera 230 , the second camera 240 , and/or the Nth camera 250 ) are examples and are not limited thereto. Acquisition of an image using a specific camera arranged to photograph a specific space may mean acquiring an image obtained by photographing a designated space at a designated angle using a fixed camera, or capturing an image of a designated space at a designated angle using a rotating camera. It may mean acquiring images taken in a direction, or may mean acquiring images taken in a designated space after moving a movable camera to a designated space. For example, the first electronic device 210 may provide a command for moving a specific camera to a specific camera, and may receive an image of a designated space from the specific camera. When there are a plurality of cameras arranged to photograph a specific space, the first electronic device 210 may photograph the specific space using all or some of the plurality of cameras. For example, the first electronic device 210 designates the first space by using the first camera 230 (eg, a fixed camera) arranged to photograph the first space (eg, a bedroom). At least one first image captured at an angle (eg, an image captured at a first viewpoint and/or an image captured at a second viewpoint) may be obtained. For another example, the first electronic device 210 captures the second space (eg, living room) by using the second camera 240 (eg, a rotational camera) disposed to photograph the second space. At least one captured second image (eg, an image captured in a first direction at a first point of view, an image captured in a first direction at a second point of view, an image captured in a second direction at a third point of view, and / or an image captured in a third direction at a fourth viewpoint) may be acquired. For another example, the first electronic device 210 may capture at least one third image of a third space (eg, a kitchen) using the Nth camera 250 (eg, a mobile camera). (For example, an image taken in a direction toward a third space from a first position of the Nth camera 250 at a first viewpoint, and/or a second position of the Nth camera 250 at a second viewpoint. At least one fourth image (eg, a third image taken in a direction toward the third space) is acquired, and a fourth space (eg, a bathroom) is captured using the same N-th camera 250. An image captured in a direction toward the fourth space from the third position of the Nth camera 250 at the viewpoint, and/or a photographed image in the direction toward the fourth space from the fourth position of the Nth camera 250 at the fourth viewpoint. image) can be obtained.

In operation 503, according to various embodiments, the first electronic device 210 may check the location where the target object is located and the time point where the target object is located in the corresponding location. For example, the first electronic device 210 includes at least one camera among a plurality of cameras (eg, the first camera 230, the second camera 240, and/or the Nth camera 250). Using at least one image obtained by using , it is possible to check the location where the target object is located and the time point where the target object is located at the corresponding location. For example, the first electronic device 210 selects a target object as a first image based on the fact that the target object is included in a first image obtained by the first camera 230 capturing a first location at a first viewpoint. Based on the fact that the target object is included in the second image obtained by the second camera 240 that has confirmed that it is located at the first place at the viewpoint and has photographed the second place at the second viewpoint, the target object is selected from the second viewpoint. It can be confirmed that it is located in the second place. Meanwhile, in various embodiments, the first electronic device 210 may measure and/or track the position of at least one target object in real time, and map the real-time measurement and/or tracking result to each of a plurality of viewpoints. may be stored and/or managed. Alternatively, the first electronic device 210 may measure and/or track the location of at least one target object in real time, and may be implemented to manage only the location of at least one target object at a current point of view. According to an embodiment, the first electronic device 210 may perform operation 503 with respect to several target objects. For example, the first electronic device 210 may perform a first image based on the fact that a first target object is included in a first image acquired by the first camera 230 capturing a first place at a first point of view. Based on the fact that the second target object is included in the second image acquired by the second camera 240 that has confirmed that the target object is located at the first place at the first time point and has photographed the second place at the second time point , it can be confirmed that the second target object is located in the second location at the second viewpoint.

There is no limitation on when to perform operation 501 and/or operation 503. For example, operation 501 and/or operation 503 may be performed before operation 511 described below is performed, or operation 501 and/or operation 503 may be performed after operation 511 is performed. For example, performing operation 501 and/or operation 503 before operation 511 is performed may mean generating a history database for the location of the target object. Accordingly, the history database may include information about at least one place where at least one target object is located at at least one viewpoint.

According to an embodiment, the first electronic device 210 includes at least one of a plurality of cameras (eg, the first camera 230, the second camera 240, and/or the Nth camera 250). A history database can be created by using the camera of . For example, the first electronic device 210 may create a history database based on images taken of a designated space at regular time intervals (or at an arbitrary point in time) using a fixed camera. For another example, the first electronic device 210 builds a history database based on images taken from various directions in a designated space at regular time intervals (or at random times) using a rotating camera. can create As another example, the first electronic device 210 captures an image of a first space in a first direction at a first point of view and a second space in a second direction at a second point of view using a mobile camera. A history database can be created based on an image. For example, the first electronic device 210 moves a movable camera to a space that cannot be photographed using a fixed camera and a rotatable camera at a predetermined time to create a history database based on an image captured in the space. may be

In operation 505, according to various embodiments, the first electronic device 210 includes a plurality of cameras (eg, the first camera 230, the second camera 240, and/or the Nth camera 250). ) can be prioritized.

Priority may mean the order of using a plurality of cameras (eg, 230, 240, and/or 250) to search for the current location of the target object, which will be described in operation 513. As will be described later, the current location of the target object can be quickly checked by sequentially using a plurality of cameras (eg, 230, 240, and/or 250) according to the priority order to search the space.

An operation in which the first electronic device 210 determines a priority in operation 505 will be described as follows.

For example, the first electronic device 210 may select a plurality of cameras (eg, 230, 240, and/or 250) based on the performance and/or history database of the plurality of cameras (eg, 230, 240, and/or 250). 230, 240, and/or 250) may be prioritized. The performance of the plurality of cameras (eg, 230, 240, and/or 250) is determined by the type of camera (eg, a fixed, rotating, or movable camera, a rotation range in the case of a rotary camera, and a movement in the case of a fixed camera). radius and movement speed), image quality of the camera, power consumption efficiency of the camera, or remaining battery capacity of the camera. The first electronic device 210 selects a camera to be used to search for a current location of a target object based on performance and/or a history database of a plurality of cameras (eg, 230, 240, and/or 250). You can determine the order of selection (eg, priority). For example, the first electronic device 210 may check a camera capable of photographing the corresponding location based on performance based on the current location of a specific object. For example, the first electronic device 210 may check the current location (or past location, or predicted future location) of a specific object based on the history database. For example, even if an arbitrary camera cannot photograph a specific object at the current location, if it is possible to photograph a specific object after moving, the first electronic device 210 may give a higher priority to the corresponding camera. have. Alternatively, when it is determined that a plurality of cameras can photograph a specific object, the first electronic device 210 sets parameters such as a photographing angle of each of the plurality of cameras for the specific object and a size of the specific object in the photographed image. Priority may be assigned to each camera based on . For example, the first electronic device 210 may include a camera (eg, a space in which a target object is confirmed to be located at a certain point in the past) photographed based on a history database. If there are two or more cameras (fixed or rotatable), the camera with better performance (for example, better image quality or higher remaining battery capacity) is preferentially selected from among the corresponding cameras to determine the target object's resolution. A current location may be searched, and an image including a target object may be acquired using a selected camera. The method of determining the priority by the first electronic device 210 is an example and is not limited thereto.

In operation 507, according to various embodiments, the second electronic device 220 (eg, the processor 221) may display a screen including a plurality of objects on the display module 229. For example, referring to FIG. 4 , the second electronic device 220 has three preset objects (eg, three companion animals) corresponding to three target objects (ie, three companion animals). A corresponding image and/or text indicating the name or type of each companion animal) may be displayed on the display module 229 .

In operation 509, according to various embodiments, the second electronic device 220 may check a user input for selecting a specific object corresponding to a specific target object. For example, referring to FIG. 4 , the second electronic device 220 selects one target object (eg, the user's As a companion animal, by checking a user input selecting an object (eg, a photo or text corresponding to "Maltese" in FIG. , user input for selecting a specific target object can be confirmed.

In operation 511, according to various embodiments, the second electronic device 220 sends the selected target object (eg, the user's companion animal in FIG. An identifier related to a companion animal (eg, an identifier previously designated as indicating a companion animal “Golden Lee”) may be transmitted to the first electronic device 210 .

In operation 513, according to various embodiments, the first electronic device 210, in response to receiving an identifier related to the target object from the second electronic device 220, based on the priority determined in operation 505, a plurality of A plurality of cameras (eg, 230, 240, and/or 230, 240, and/or Alternatively, each space corresponding to 250) may be searched. For example, when the priority is determined in the order of the first camera 230 and the second camera 240, the first electronic device 210 first uses the first camera 230 to select a corresponding space. It may mean that it is possible to search, and it may mean determining whether or not to search for a corresponding space using the second camera 240 according to a search result using the first camera 230 . In this case, when the target object is detected according to the search result of the corresponding space using the first camera 230, the first electronic device 210 does not perform the search using the second camera 240. may not be For another example, the first electronic device 210 may determine whether a target object is included for each image according to a priority order with respect to a plurality of images from each of a plurality of cameras.

According to an embodiment, the first electronic device 210 sequentially operates a plurality of cameras (eg, 230, 240, and/or 250) based on a priority related to a target object corresponding to the received identifier. Each space corresponding to may be searched. For example, a priority related to a first target object may be different from a priority related to a second target object. In response to receiving the first identifier related to the first target object, the first electronic device 210 sequentially installs a plurality of cameras (eg, 230, Each space corresponding to 240 and/or 250) may be searched for.

In operation 515, according to various embodiments, the first electronic device 210 sequentially searches each space corresponding to a plurality of cameras (eg, 230, 240, and/or 250), and thereby the target object. You can check the current location of Determining the current location of the target object using a camera (eg, 230, 240, or 250) is based on an image obtained through the camera (eg, 230, 240, or 250), the target object If it is determined that is included in the obtained image, it means that it is confirmed that the target object is located in a space where the corresponding camera (eg, 230, 240, or 250) shoots. For example, the first electronic device 210 corresponds to each camera in the order of the first camera 230, the second camera 240, and the Nth camera 250 according to the priority related to the target object. space can be explored. The first electronic device 210 may use the second camera 240 as the next step when the current location of the target object is not confirmed using the first camera 230 . The first electronic device 210, based on the current position of the target object being confirmed using the second camera 240, does not proceed to the next Nth camera 250, and the second camera 240 It is possible to perform the next operation (eg, operation 517) using .

In operation 517, according to various embodiments, the first electronic device 210 may obtain a target image including the target object by using a target camera corresponding to the current location of the target object. The target camera may refer to a camera that can photograph (or is currently photographing) a target object. A target image may refer to an image including a target object. For example, in operation 515, when the current location of the target object is confirmed using the second camera 240, the current target object is located in a space corresponding to the second camera 240. In this case, the first The electronic device 210 may obtain an image including the target object using the second camera 240 .

In operation 519, according to various embodiments, the first electronic device 210 selects a camera (eg, 230, 240, and/or 250) corresponding to the current position of the target object among a plurality of cameras (eg, 230, 240, and/or 250). An image (eg, the first target image) including the target object, obtained using the first target camera, may be transmitted to the second electronic device 220 through the communication module 212 .

In operation 521, according to various embodiments, the second electronic device 220 displays an image including a target object (eg, a first target image) received from the first electronic device 210 to a display module ( 229) can be displayed.

In operation 523, according to various embodiments, the first electronic device 210 may check the changed position of the target object. A method for the first electronic device 210 to check the changed position of the target object will be described later.

In operation 525, according to various embodiments, the first electronic device 210 uses a camera (eg, a second target camera) corresponding to the changed position of the target object to display an image (eg, a second target camera) including the target object. For example, the second target image) may be acquired. For example, when the changed position of the target object is confirmed using the first camera 230, the current target object is located in a space corresponding to the first camera 230, and in this case, the first electronic device 210 ) may acquire an image including the target object using the first camera 230 .

In operation 527, according to various embodiments, the first electronic device 210 selects a camera (eg, 230, 240, and/or 250) corresponding to the changed position of the target object among a plurality of cameras (eg, 230, 240, and/or 250). An image (eg, a second target image) obtained using a second target camera) including a target object may be transmitted to the second electronic device 220 through the communication module 212 .

In operation 529, according to various embodiments, the second electronic device 220 replaces the previously displayed image (eg, the first target image or an image not including the target object), and displays the first electronic device 220 . An image (eg, a second target image) including a target object newly received from the device 210 may be displayed on the display module 229 .

6 is a diagram for explaining a method of operating a second electronic device according to various embodiments.

Referring to FIG. 6 , the second electronic device 220 (eg, the processor 221) according to various embodiments displays a screen 610 for receiving information about a target object, a display module 229 can be displayed on For example, the screen 610 for receiving information about the target object includes the name, type, breed, date of birth, gender, weight, neutered status, vaccination history, and /or may include items about past medical history.

According to an embodiment, the second electronic device 220 may configure the screen 410 of FIG. 4 described above based on information about the target object.

According to an embodiment, the second electronic device 220 may transmit information about the target object to the first electronic device 210 .

According to an embodiment, the first electronic device 210 (eg, the processor 211) performs the above-described operation 503 based on the information on the target object received from the second electronic device 220. can do. For example, the first electronic device 210 may include a plurality of cameras (eg, the first camera 230, the second camera 240, and/or the Nth camera) based on information about the target object. It may be confirmed that the target object is included in at least one image acquired using at least one camera of (250)). For example, the first electronic device 210 includes at least one camera among a plurality of cameras (eg, the first camera 230, the second camera 240, and/or the Nth camera 250). Based on the fact that a companion animal of a specific breed is included in at least one image obtained by using , it may be confirmed that a target object corresponding to a specific breed is included in the corresponding image. A method for the first electronic device 210 to confirm that the target object is included in the image based on the target object information is an example, and is not limited thereto. When the first electronic device 210 receives information about a plurality of target objects from the second electronic device 220, the first electronic device 210 uses a plurality of cameras based on the information about the plurality of target objects. (For example, the first camera 230, the second camera 240, and / or the N-th camera 250) all of the plurality of target objects in at least one image obtained using at least one camera Or, those skilled in the art can understand that it can be confirmed that a part is included.

7 is a diagram for explaining a method of operating a second electronic device according to various embodiments.

Referring to FIG. 7 , the second electronic device 220 (eg, the processor 221) according to various embodiments displays a screen 710 for receiving an image of a target object on a display module 229. can be displayed For example, the screen 710 for receiving an image of the target object is an item for allowing the user to select an image of the target object (eg, a companion animal) and/or an item for capturing an image of the target object. can include

According to an embodiment, the second electronic device 220 may configure the screen 410 of FIG. 4 described above based on the input image of the target object.

According to an embodiment, the second electronic device 220 may transmit the image of the target object to the first electronic device 210 .

According to an embodiment, the first electronic device 210 (eg, the processor 211) performs the above-described operation 503 based on the image of the target object received from the second electronic device 220. can For example, the first electronic device 210 performs image learning on the target object based on the image of the target object received from the second electronic device 220 so that an arbitrary image includes the target object. information for confirming existence of the image may be generated and/or stored, and there is no limitation on how the first electronic device 210 performs image learning. For example, the first electronic device 210 determines the result of performing image learning on the target object based on the image of the target object received from the second electronic device 220 and the information received from the second electronic device 220. Based on the information on the target object, the above-described operation 503 may be performed. When the first electronic device 210 receives images of a plurality of target objects from the second electronic device 220, the first electronic device 210 uses a plurality of cameras (eg, For example, all or part of a plurality of target objects in at least one image acquired using at least one camera among the first camera 230, the second camera 240, and/or the Nth camera 250. It can be understood by those skilled in the art that it can be confirmed that is included.

8A is a flowchart illustrating a method of operating a first electronic device according to various embodiments. 8B is a flowchart illustrating a method of operating a first electronic device according to various embodiments.

Referring to FIG. 8A , in operation 801, according to various embodiments, the first electronic device 210 (eg, the processor 211) may check a place designated by the user.

According to an embodiment, in operation 801, the first electronic device 210 uses a camera (eg, the first camera 230) arranged to capture a designated place based on checking the place designated by the user. ) or a movable camera (eg, the Nth camera 240) may be selected to capture a designated place. In this case, the first electronic device 210 provides at least one image obtained by photographing a designated place using a selected camera (eg, the first camera 230 and/or the Nth camera 240). The image may be transmitted to the second electronic device 220 (Operation 841). An operation in which the first electronic device 210 transmits an image obtained by using a selected camera to the second electronic device 220 may be referred to as a streaming operation.

According to an embodiment, in operation 801, the first electronic device 210 may perform operation 803 based on not being able to check a place designated by the user. Alternatively, the first electronic device 210 may perform operation 803 according to settings even when it is possible to check a place designated by the user.

In operation 803, according to various embodiments, the first electronic device 210 may check an object event. The object event is at least one image obtained using at least one camera among a plurality of cameras (eg, the first camera 230, the second camera 240, and/or the Nth camera 250). This may mean a state in which at least one target object is included in . For example, the first electronic device 210 may check an object event based on the history database generated by operations 501 and 503 described above. Operation 803 may mean that the first electronic device 210 checks an object event that has occurred before the present time. At this point, those skilled in the art can understand that this may mean checking an object event based on the above-described operations 501 and 503.

According to an embodiment, in operation 803, the first electronic device 210 performs a streaming operation using a preset camera (eg, a representative camera) based on confirmation that no object event has occurred. may be performed (act 805).

According to an embodiment, in operation 803, the first electronic device 210 may perform operation 807 based on confirming that an object event exists.

In operation 807, according to various embodiments, the first electronic device 210 may compare an interval between a time point at which an object event occurs and a current time point with a threshold value. For example, when an object event occurs two or more times before the current point in time, the first electronic device 210 may compare an interval between the most recent object event occurrence point and the current point in time with a threshold value.

According to an embodiment, in operation 807, the first electronic device 210 may perform operation 825 based on an interval between a time point at which an object event occurred and a current time point equal to or greater than a threshold value.

According to an embodiment, in operation 807, the first electronic device 210 may perform operation 809 based on the fact that an interval between a time point at which an object event occurs and a current time point is less than a threshold value. In this case, for example, the first electronic device 210 may use an object event that has occurred before the present time as a basis for determining the priority of operation 505 described above. For example, a plurality of cameras (eg, the first camera 230, the second camera 240, and/or the first camera 230, the second camera 240, and/or the The priority of the N cameras 250 may be referred to as a first priority.

In operation 809, according to various embodiments, the first electronic device 210 may check tag information related to the target object. The tag information may be a device (eg, a beacon device, an NFC device, or an RFID device) that transmits tag information possessed by the target object (eg, included in a costume worn by a companion animal). It may refer to information transmitted by For example, the first electronic device 210 includes at least one camera among a plurality of cameras (eg, the first camera 230, the second camera 240, and/or the Nth camera 250). A target object obtained through an included tag detection device, another tag detection device (not shown) disposed (or movable) in a designated space, or a tag detection device (not shown) built into the first electronic device 210 You can check tag information related to .

According to an embodiment, in operation 809, the first electronic device 210 may perform operation 811 based on checking tag information related to the target object, and may respond to not checking tag information related to the target object. Based on this, operation 813 may be performed.

In operation 811, according to various embodiments, the first electronic device 210 may detect a target object by searching a space corresponding to the tag information based on the checked tag information. For example, the first electronic device 210 may include at least one camera (eg, a second camera) capable of capturing a space (eg, a living room) corresponding to the identified tag information based on the identified tag information. By using the first camera 230, the second camera 240, and/or the Nth camera 250 sequentially according to the first priority, a corresponding space (eg, living room) may be searched.

According to an embodiment, when a target object is detected by operation 811, the first electronic device 210 may perform a streaming operation using a camera that detects the target object (operation 841). When the target object is not detected by operation 811, the first electronic device 210 may perform operation 813.

In operation 813, according to various embodiments, the first electronic device 210 may check an object event related to the target object. For example, the first electronic device 210 prioritizes a plurality of cameras (eg, the first camera 230, the second camera 240, and/or the Nth camera 250) as the first priority. It is possible to check an object event related to a target object by sequentially searching each space according to .

According to an embodiment, in operation 813, the first electronic device 210 may perform operation 815 based on the confirmation of an object event related to the target object, and the failure to confirm the object event related to the target object. Based on this, operation 817 can be performed.

In operation 815, according to various embodiments, the first electronic device 210 may detect a target object using a camera used to check an object event related to the target object.

According to an embodiment, when a target object is detected by operation 815, the first electronic device 210 may perform a streaming operation using a camera that detects the target object (operation 841). When the target object is not detected by operation 815, the first electronic device 210 may perform operation 817.

In operation 817, according to various embodiments, the first electronic device 210 may check a motion event related to the target object. The motion event may be a camera of at least one of a plurality of cameras (eg, the first camera 230, the second camera 240, and/or the Nth camera 250), or a separate camera capable of detecting motion. This may mean a state in which the motion of an arbitrary object is sensed by a device (not shown) (eg, a passive infrared sensor, a thermal camera device, a radar, or a lidar, but is not limited thereto).

According to an embodiment, in operation 817, the first electronic device 210 may perform operation 819 based on checking the motion event related to the target object, and may be unable to confirm the motion event related to the target object. Based on this, operation 821 may be performed.

In operation 819, according to various embodiments, the first electronic device 210 may detect a target object by searching a space corresponding to the motion event based on the identified motion event. For example, the first electronic device 210 may include at least one camera (eg, a second camera) capable of photographing a space (eg, a living room) corresponding to the identified motion event, based on the identified motion event. By using the first camera 230, the second camera 240, and/or the Nth camera 250 sequentially according to the first priority, a corresponding space (eg, living room) may be searched.

According to an embodiment, when a target object is detected in operation 819, the first electronic device 210 may perform a streaming operation using a camera that has detected the target object (operation 841). When the target object is not detected by operation 819, the first electronic device 210 may perform operation 821.

In operation 821, according to various embodiments, the first electronic device 210 may check a sound event related to the target object. The sound event may be generated by at least one camera among a plurality of cameras (eg, the first camera 230, the second camera 240, and/or the Nth camera 250) or a separate camera capable of detecting sound. This may mean a state in which an arbitrary sound is sensed by a device (not shown) (eg, it may be a microphone device, and there is no limitation thereof).

According to an embodiment, in operation 821, the first electronic device 210 may perform operation 823 based on checking the sound event related to the target object, and may respond to not checking the sound event related to the target object. Based on this, operation 825 may be performed.

In operation 823, according to various embodiments, the first electronic device 210 may detect a target object by searching a space corresponding to the sound event based on the checked sound event. For example, the first electronic device 210 may include at least one camera (eg, the first electronic device 210) capable of capturing a space (eg, a living room) where the identified sound event occurs, based on the identified sound event. The camera 230 , the second camera 240 , and/or the Nth camera 250 may be sequentially used according to the first priority to search for a corresponding space (eg, a living room).

According to an embodiment, when a target object is detected in operation 823, the first electronic device 210 may perform a streaming operation using a camera that has detected the target object (operation 841). When the target object is not detected by operation 823, the first electronic device 210 may perform operation 825.

As described above, according to an embodiment, in operation 807, the first electronic device 210 may perform operation 825 based on the fact that the interval between the object event occurrence time and the current time is greater than or equal to the threshold value. . In this case, for example, the first electronic device 210 may not use an object event that has occurred before the present time as a basis for determining the priority in operation 505 described above. For example, the first electronic device 210 excludes an object event that occurred before the current point in time based on the fact that the interval between the time point at which the object event identified in operation 807 and the current point in time is greater than or equal to the threshold value, and the above-mentioned 505 An operation for determining the priority of operation may be performed. For example, a plurality of cameras (eg, the first camera 230 and the second camera 240 determined by the first electronic device 210 based on other factors except for an object event that occurred before the present time). ), and/or the priority of the Nth camera 250 may be referred to as a second priority.

The operations of FIG. 8B (eg, operations 825, 827, 829, 831, 833, 835, 837, and 839) correspond to operations in FIG. 8A (eg, 809 operation, operation 811, operation 813, operation 815, operation 817, operation 819, operation 821, and operation 823). However, in relation to the operations of FIG. 8B , the first electronic device 210 may use a plurality of cameras (determined based on other factors except for object events that have occurred before the current point in time) For example, each operation may be performed based on the priority (eg, second priority) of the first camera 230, the second camera 240, and/or the Nth camera 250. In relation to the corresponding operations in FIG. 8A, a plurality of cameras (eg, the first camera 230, There may be a difference in that each operation may be performed based on the priority (eg, first priority) of the second camera 240 and/or the Nth camera 250 .

9 is a flowchart illustrating a method of operating a first electronic device according to various embodiments.

Referring to FIG. 9 , in operation 901, according to various embodiments, the first electronic device 210 (eg, the processor 211) detects a first camera (eg, the processor 211) located in an area where a target object is detected. For example, a first image including a target object may be acquired using the first camera 230 .

In operation 903, according to various embodiments, the first electronic device 210 may transmit the first image including the target object to the second electronic device 220. For example, the second electronic device 220 may display the first image received from the first electronic device 210 on the display module 229 .

In operation 905, according to various embodiments, the first electronic device 210 selects at least one second camera (eg, the second camera 240 and/or the second camera 240) located in an area where the target object is not detected. A target object may be searched for using the N camera 250 . For example, the first electronic device 210 performs a streaming operation by performing operation 901 and/or operation 903, and at least one second camera (eg, A target object may be continuously searched for using the second camera 240 and/or the Nth camera 250 .

In operation 907, according to various embodiments, the first electronic device 210 selects at least one second camera (eg, the second camera 240 and/or the second camera 240) located in an area where the target object is not detected. A change in the position of the target object may be detected using the N camera 250 . For example, the first electronic device 210 may use at least one second camera (eg, the second camera 240 and/or the Nth camera 250) to display at least one image. Based on confirming that the target object is included, a change in location of the target object may be detected. Alternatively, the first electronic device 210 may detect that the location of the target object is changed based on the aforementioned tag information, motion event, or sound event.

In operation 909, according to various embodiments, the first electronic device 210, based on detecting that the position of the target object is changed, at least one second camera (for example, For example, the second image including the target object may be acquired using at least one camera among the second camera 240 and/or the Nth camera 250 .

In operation 911, according to various embodiments, the first electronic device 210 may transmit a second image including the target object to the second electronic device 220. For example, the second electronic device 220 may display the second image received from the first electronic device 210 on the display module 229 instead of the previously displayed first image.

10 is a flowchart illustrating a method of operating a first electronic device according to various embodiments.

Referring to FIG. 10 , in operation 1001, according to various embodiments, the first electronic device 210 (eg, the processor 211) may check whether a target object is sensed. According to an embodiment, the first electronic device 210 may perform operation 1003 when detecting the target object, and perform operation 1007 when not detecting the target object.

In operation 1003, the first electronic device 210, according to various embodiments, uses a camera (eg, the first camera 230) located in the area where the target object is detected to obtain an image including the target object. can be obtained. The first electronic device 210 may perform a streaming operation by transmitting an image including a target object to the second electronic device 220 .

In operation 1005, according to various embodiments, the first electronic device 210 may check whether a target object is continuously detected by a camera (eg, the first camera 230) used in operation 1003. According to an embodiment, when a target object is detected by a camera (eg, the first camera 230) used in operation 1003, the first electronic device 210 may continue to perform operation 1003 and , When the target object is no longer detected by the camera (eg, the first camera 230) used in operation 1003, operation 1007 may be performed.

In operation 1007, according to various embodiments, the first electronic device 210 may predict the movement direction of the target object. For example, the first electronic device 210 analyzes at least one image (eg, the first image) obtained by a camera (eg, the first camera 230) used in operation 1003. Thus, the moving direction of the target object can be predicted. Alternatively, the first electronic device 210 may predict the moving direction of the target object by analyzing at least one image (eg, the second image) obtained before the point at which the target object is not detected. For example, the first electronic device 210 may predict the movement direction of the target object based on the movement of the target object included in at least one image (eg, the first image or the second image). can For another example, the first electronic device 210 may predict the movement direction of the target object based on a pre-generated history database. For example, the first electronic device 210 may check a place where the target object often stays based on a pre-generated history database. For example, the first electronic device 210 determines the number of times the target object is located in at least one place where the target object is located prior to the current point in time based on a pre-generated history database. You can check the places where you often stay.

In operation 1009, according to various embodiments, the first electronic device 210 arranges to photograph a location where the target object is predicted to be located based on the movement direction of the target object predicted in operation 1007. It may be checked whether a camera (for example, a fixed camera or a rotational camera) exists. According to an embodiment, the first electronic device 210 may perform operation 1011 when a camera is present at the predicted location, and may perform operation 1015 when the camera does not exist at the predicted location. have.

In operation 1011, according to various embodiments, the first electronic device 210 detects a target object using a corresponding camera, based on the existence of a camera arranged to photograph the target object at a location where the target object is expected to be located. objects can be explored.

In operation 1013, according to various embodiments, the first electronic device 210 may check whether the target object is detected using a camera disposed at a location where the target object is predicted to be located. According to an embodiment, the first electronic device may perform operation 1003 based on the detection of the target object and operation 1007 based on the detection of the target object.

In operation 1015, according to various embodiments, the first electronic device 210 moves the movable camera to the predicted location based on the fact that the camera does not exist in the location where the target object is predicted to be located, thereby detecting the target object. can be explored.

According to an embodiment, while the movable camera moves to the predicted place in operation 1015, the first electronic device 210 may obtain an image of the surroundings using the corresponding camera, and remove the image. 2 may be transmitted to the electronic device 220 . Accordingly, the second electronic device 220 may receive an image not including the target object from the first electronic device 210 and display the corresponding image on the display module 229 .

In operation 1017, according to various embodiments, the first electronic device 210 may check whether the target object is detected using a camera that has moved to a place where the target object is predicted to be located. According to an embodiment, the first electronic device may perform operation 1003 based on the detection of the target object and operation 1007 based on the detection of the target object.

11 is a flowchart illustrating a method of operating a second electronic device according to various embodiments. 11 will be described with reference to FIG. 12 . 12 is a diagram for explaining a method of operating a second electronic device according to various embodiments.

Referring to FIG. 11 , in operation 1101, according to various embodiments, the second electronic device 220 (eg, the processor 221) performs a first processing operation including a target object from the first electronic device 210. An image (eg, 1201 in (a) of FIG. 12 ) may be received and displayed on the display module 229 .

In operation 1103, after displaying the first image including the target object, the second electronic device 220 receives a second image not including the target object from the first electronic device 210 according to various embodiments. and display the second image (eg, 1203 in (b) of FIG. 12) on the display module 229 instead of the first image.

According to an embodiment, the first electronic device 210 may transmit, to the second electronic device 220, an identifier indicating that the target object is currently being searched for, along with a second image that does not include the target object.

In operation 1105, according to various embodiments, the second electronic device 220 may display a virtual object (eg, 1205 of FIG. 12(b) ) indicating that the location of the target object is being searched for. For example, the second electronic device 220 analyzes the image received from the first electronic device 210 and indicates that the location of the target object is being searched for based on the fact that the target object is not included in the corresponding image. A virtual object (eg, 1205 of FIG. 12(b)) may be displayed. For another example, the second electronic device 220, based on receiving an identifier indicating that the target object is being searched for from the first electronic device 210, the virtual object indicating that the location of the target object is being searched (eg, For example, 1205 in (b) of FIG. 12) may be displayed.

In operation 1107, according to various embodiments, the second electronic device 220 displays a virtual object (for example, 1205 in FIG. 12(b) ) indicating that the location of the target object is being searched for. 1 may receive a third image (eg, 1207 of FIG. 12(c) ) including a target object from the electronic device 210 .

In operation 1109, according to various embodiments, the second electronic device 220 indicates that the previously displayed image (eg, the second image not including the target object) and/or the position of the target object is being searched for. Display of the virtual object (eg, 1205 in FIG. 12(b) ) may be stopped, and a third image including the target object may be displayed on the display module 229 .

Those skilled in the art can understand that the various embodiments described in this specification can be organically applied to each other within the applicable range.

According to various embodiments, the first electronic device (eg, the first electronic device 210) includes a communication module (eg, the communication module 212) and a processor (eg, the processor 211). ), wherein the processor acquires at least one first image using a first camera (eg, the first camera 230) arranged to photograph the first space, and photographs the second space At least one second image is acquired using a second camera (eg, the second camera 240) arranged to capture a plurality of second images including the at least one first image and the at least one second image. Using four images, at least one place where a first target object is located and at least one viewpoint where the first target object is located at the at least one place are identified, and the at least one location corresponding to the first target object is determined. A plurality of cameras including the first camera and the second camera (eg, the first camera 230, the second camera 240, and/or Determines the priority of the N camera 250), receives a first identifier related to the first target object from a second electronic device (eg, the second electronic device 220) through the communication module, In response to receiving the first identifier, the current location of the first target object is identified by sequentially searching each space corresponding to the plurality of cameras using the plurality of cameras based on the priority order and a first target image including the first target object obtained by using a first target camera corresponding to the current position of the first target object among the plurality of cameras, through the communication module. It can be set to be transmitted to the second electronic device.

According to various embodiments, the processor may be configured to check performance of the plurality of cameras and determine the priority of the plurality of cameras based on the performance of the plurality of cameras.

According to various embodiments, the performance may include at least one of a camera's view angle adjustment range and a camera's movement capability.

According to various embodiments, the processor may be configured to check a location tag related to the first target object and determine the priority of the plurality of cameras based on the location tag.

According to various embodiments, the processor checks a sound event related to the first target object using at least one camera among the plurality of cameras, and based on the sound event, the processor detects the sound events of the plurality of cameras. It can be set to determine priority.

According to various embodiments, the processor obtains the first target image by using the first target camera and transmits the first target image to the second electronic device, and the processor selects the first target image from among the plurality of cameras. The location of the first target object may be determined by searching each space corresponding to the remaining cameras using the remaining cameras except for the target camera.

According to various embodiments, the processor, after acquiring the first target image using the first target camera, the first target object is not detected using the first target camera, the remaining cameras Based on the detection of the second target object using the second target camera, a second target image including the first target object, obtained using the second target camera, is transmitted through the communication module. It may be set to be transmitted to the second electronic device.

According to various embodiments, the processor, after obtaining the first target image using the first target camera, based on the fact that the first target object is not detected using the first target camera, By predicting the movement direction of the first target object and searching the predicted space using a camera disposed to photograph the space in which the first target object is predicted to be located based on the predicted movement direction, It may be set to check the location of the first target object.

According to various embodiments, the processor moves a movable camera among the plurality of cameras to the predicted space based on the absence of a camera arranged to photograph the predicted space, and uses the movable camera to capture the predicted space. By searching the predicted space, it may be set to check the location of the first target object.

According to various embodiments, the processor obtains an image not including the first target object by using the mobile camera while the mobile camera moves to the predicted space, and captures the first target object. It may be configured to transmit the image not included to the second electronic device using the communication module.

According to various embodiments, the processor is set to move a movable camera among the plurality of cameras to a pre-specified space at a pre-specified time and acquire at least one image of the pre-specified space using the movable camera; The plurality of images may include the at least one image obtained using the mobile camera.

According to various embodiments, the second electronic device (eg, the second electronic device 220) may include a display (eg, the display module 229); a communication module (eg, communication module 222); and a processor (eg, the processor 221), wherein the processor controls the display to display a screen including a plurality of objects and receives a user input for selecting a first object from among the plurality of objects. and, based on the user input, a first identifier associated with a first target object corresponding to the first object is transmitted to the first electronic device (eg, the first electronic device 210) through the communication module. and a first camera (eg, the first camera 230) arranged to photograph a first space selected based on a priority determined in advance in the first electronic device in response to reception of the first identifier. ) to receive a first target image including the first target object disposed in the first space from the first electronic device through the communication module, and to display the first image. In the second space obtained by using a second camera (eg, the second camera 240) arranged to control a display and photograph a second space different from the first camera in the first electronic device. Receives a second target image including the disposed first target object from the first electronic device through the communication module, and controls the display to display the second target image instead of the first target image. can be set to

According to various embodiments, the processor may determine whether the first target object obtained by using a movable camera (eg, the Nth camera 250) different from the second camera in the first electronic device is not included. An image may be received from the first electronic device through the communication module, and the display may be controlled to display the image not including the first target object instead of the second target image.

According to various embodiments, the processor is configured to display a virtual object indicating that the location of the first target object is being searched for while displaying the image not including the first target object obtained using the mobile camera. It can be set to control the display.

According to various embodiments, the processor may be set to stop displaying the virtual object based on receiving an image including the first target object from the first electronic device after displaying the virtual object. can

According to various embodiments, a method of operating a first electronic device (eg, the first electronic device 210) includes a first camera (eg, the first camera 230) arranged to photograph a first space. Obtaining at least one first image using a), acquiring at least one second image using a second camera (eg, the second camera 240) disposed to photograph the second space operation, using a plurality of images including the at least one first image and the at least one second image, at least one place where the first target object is located and the first target object at the at least one place A plurality of cameras including the first camera and the second camera based on an operation of checking at least one located viewpoint, the at least one location corresponding to the first target object, and the at least one viewpoint ( For example, the operation of determining the priority of the first camera 230, the second camera 240, and/or the Nth camera 250, the communication module (eg, the communication module 212) Receiving a first identifier related to the first target object from a second electronic device (eg, the second electronic device 220) through a second electronic device, in response to receiving the first identifier, based on the priority An operation of checking the current location of the first target object by sequentially searching each space corresponding to the plurality of cameras using the plurality of cameras; and transmitting a first target image including the first target object, obtained using a first target camera corresponding to the current location, to the second electronic device through the communication module.

According to various embodiments, the method further includes checking performance of the plurality of cameras, and determining the priority of the plurality of cameras based on the performance of the plurality of cameras, An operation of determining the priority of the plurality of cameras may be included.

According to various embodiments, the performance may include at least one of a camera's view angle adjustment range and a camera's movement capability.

According to various embodiments, the method further includes checking a location tag related to the first target object, and determining the priority of the plurality of cameras based on the location tag. An operation of determining the priority of the plurality of cameras may be included.

According to various embodiments, the method further includes checking a sound event related to the first target object by using at least one camera among the plurality of cameras, and determining the priority of the plurality of cameras. The determining may include determining the priority of the plurality of cameras based on the sound event.

Electronic devices according to various embodiments disclosed in this document may be devices of various types. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. An electronic device according to an embodiment of the present document is not limited to the aforementioned devices.

Various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, like reference numerals may be used for like or related elements. The singular form of a noun corresponding to an item may include one item or a plurality of items, unless the relevant context clearly dictates otherwise. In this document, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A Each of the phrases such as "at least one of , B, or C" may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first", "second", or "first" or "secondary" may simply be used to distinguish a given component from other corresponding components, and may be used to refer to a given component in another aspect (eg, importance or order) is not limited. A (e.g., first) component is said to be “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicatively.” When mentioned, it means that the certain component may be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logical blocks, parts, or circuits. can be used as A module may be an integrally constructed component or a minimal unit of components or a portion thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of this document provide one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101). It may be implemented as software (eg, the program 140) including them. For example, a processor (eg, the processor 120 ) of a device (eg, the electronic device 101 ) may call at least one command among one or more instructions stored from a storage medium and execute it. This enables the device to be operated to perform at least one function according to the at least one command invoked. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' only means that the storage medium is a tangible device and does not contain a signal (e.g. electromagnetic wave), and this term refers to the case where data is stored semi-permanently in the storage medium. It does not discriminate when it is temporarily stored.

According to one embodiment, the method according to various embodiments disclosed in this document may be included and provided in a computer program product. Computer program products may be traded between sellers and buyers as commodities. A computer program product is distributed in the form of a device-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store (eg Play Store ^TM ) or on two user devices ( It can be distributed (eg downloaded or uploaded) online, directly between smart phones. In the case of online distribution, at least part of the computer program product may be temporarily stored or temporarily created in a device-readable storage medium such as a manufacturer's server, an application store server, or a relay server's memory.

According to various embodiments, each component (eg, module or program) of the above-described components may include a single object or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. have. According to various embodiments, one or more components or operations among the aforementioned corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by a corresponding component of the plurality of components prior to the integration. . According to various embodiments, the actions performed by a module, program, or other component are executed sequentially, in parallel, iteratively, or heuristically, or one or more of the actions are executed in a different order, or omitted. or one or more other actions may be added.

Claims (20)

In the first electronic device,
a communication module; and
It includes a processor, the processor comprising:
Acquiring at least one first image using a first camera arranged to capture a first space;
Acquiring at least one second image using a second camera arranged to capture a second space;
At least one place where the first target object is located and at least one place where the first target object is located at the at least one place using a plurality of images including the at least one first image and the at least one second image check one point in time,
determining a priority of a plurality of cameras including the first camera and the second camera based on the at least one place and the at least one viewpoint corresponding to the first target object;
Receiving a first identifier related to the first target object from a second electronic device through the communication module;
In response to receiving the first identifier, the current location of the first target object is identified by sequentially searching each space corresponding to the plurality of cameras using the plurality of cameras based on the priority order do,
A first target image including the first target object obtained by using a first target camera corresponding to the current position of the first target object among the plurality of cameras is transmitted through the communication module to the second target image. A first electronic device configured to transmit to an electronic device.
The method of claim 1, wherein the processor,
Check the performance of the plurality of cameras,
The first electronic device configured to determine the priority of the plurality of cameras based on the performance of the plurality of cameras.
According to claim 2,
The performance includes at least one of a view angle adjustment range of a camera and a movement capability of a camera.
The method of claim 1, wherein the processor,
check a location tag associated with the first target object;
The first electronic device configured to determine the priority of the plurality of cameras based on the location tag.
The method of claim 1, wherein the processor,
Checking a sound event related to the first target object using at least one camera among the plurality of cameras;
The first electronic device configured to determine the priority of the plurality of cameras based on the sound event.
The method of claim 1, wherein the processor,
While obtaining the first target image using the first target camera and transmitting the first target image to the second electronic device, the remaining cameras other than the first target camera among the plurality of cameras are used to obtain the first target image. The first electronic device configured to check the location of the first target object by searching each space corresponding to the remaining cameras.
The method of claim 6, wherein the processor,
After acquiring the first target image using the first target camera,
Based on the fact that the first target object is not detected using the first target camera and the second target object is detected using a second target camera among the remaining cameras,
The first electronic device configured to transmit a second target image including the first target object, obtained using the second target camera, to the second electronic device through the communication module.
The method of claim 1, wherein the processor,
After acquiring the first target image using the first target camera, based on the fact that the first target object is not detected using the first target camera,
Predicting the moving direction of the first target object,
Based on the predicted movement direction, by using a camera arranged to photograph the space where the first target object is predicted to be located, by searching the predicted space, the location of the first target object is set to be confirmed, 1st electronic device.
The method of claim 8, wherein the processor,
Based on the fact that there is no camera arranged to photograph the predicted space, by moving a movable camera among the plurality of cameras to the predicted space and using the movable camera to search the predicted space, the first 1 A first electronic device set to check the location of a target object.
The method of claim 9, wherein the processor,
Obtaining an image not including the first target object using the movable camera while the movable camera moves to the predicted space;
The first electronic device configured to transmit the image not including the first target object to the second electronic device using the communication module.
According to claim 1,
The processor is set to move a movable camera among the plurality of cameras to a pre-specified space at a pre-specified time and acquire at least one image of the pre-specified space using the movable camera;
The plurality of images include the at least one image acquired using the mobile camera, the first electronic device.
In the second electronic device,
display;
communication module; and
It includes a processor, the processor comprising:
Control the display to display a screen including a plurality of objects;
Checking a user input for selecting a first object from among the plurality of objects;
Based on the user input, transmits a first identifier related to a first target object corresponding to the first object to a first electronic device through the communication module;
In response to reception of the first identifier, the first electronic device, which is selected based on a predetermined priority, is acquired using a first camera arranged to photograph a first space, and is disposed in the first space. Receiving a first target image including 1 target object from the first electronic device through the communication module;
Control the display to display the first image;
A second target image including the first target object disposed in the second space obtained by using a second camera arranged to photograph a second space different from the first camera in the first electronic device, receiving from the first electronic device through a communication module;
The second electronic device configured to control the display to display the second target image instead of the first target image.
The method of claim 12, wherein the processor,
receiving an image not including the first target object obtained by using a mobile camera different from the second camera in the first electronic device from the first electronic device through the communication module;
The second electronic device configured to control the display to display the image not including the first target object instead of the second target image.
The method of claim 13, wherein the processor,
A second electronic device configured to control the display to display a virtual object indicating that a location of the first target object is being searched for while displaying the image not including the first target object acquired using the mobile camera. Device.
The method of claim 14, wherein the processor,
After displaying the virtual object, the second electronic device is set to stop displaying the virtual object based on receiving an image including the first target object from the first electronic device.
In the operating method of the first electronic device,
Obtaining at least one first image using a first camera arranged to capture a first space;
Acquiring at least one second image using a second camera arranged to capture a second space;
At least one place where the first target object is located and at least one place where the first target object is located at the at least one place using a plurality of images including the at least one first image and the at least one second image The action of checking one point in time,
determining a priority of a plurality of cameras including the first camera and the second camera based on the at least one place and the at least one viewpoint corresponding to the first target object;
Receiving a first identifier related to the first target object from a second electronic device through a communication module;
In response to receiving the first identifier, the current location of the first target object is identified by sequentially searching each space corresponding to the plurality of cameras using the plurality of cameras based on the priority order action, and
A first target image including the first target object obtained by using a first target camera corresponding to the current position of the first target object among the plurality of cameras is transmitted through the communication module to the second target image. A method comprising transmitting to an electronic device.
17. The method of claim 16,
Further comprising the operation of checking the performance of the plurality of cameras,
The operation of determining the priority of the plurality of cameras,
and determining the priority of the plurality of cameras based on the performance of the plurality of cameras.
18. The method of claim 17,
The method of claim 1 , wherein the performance includes at least one of a camera's angle-of-view adjustment range and a camera's movement capability.
17. The method of claim 16,
Further comprising an operation of checking a location tag related to the first target object,
The operation of determining the priority of the plurality of cameras,
and determining the priority of the plurality of cameras based on the location tag.
17. The method of claim 16,
Further comprising an operation of checking a sound event related to the first target object using at least one camera among the plurality of cameras,
The operation of determining the priority of the plurality of cameras,
and determining the priority of the plurality of cameras based on the sound event.

Images