KR20220149803A - Electronic device and method for sharing information - Google Patents

Abstract

An embodiment of the present disclosure relates to a method by which an electronic device shares information with an external device. The method by which an electronic device shares information with an external device according to an embodiment of the present invention comprises: an operation of displaying a preview image acquired through a camera; an operation of receiving a first input selecting an area of interest in the preview image; an operation of identifying an object related to the area of interest in the preview image based on the first input; an operation of receiving a second input for sharing the image of the object; and an operation of transmitting the image of the object and information related to the object to an external device based on the second input.

Description

Electronic device for sharing information and method of operation thereof

Various embodiments of the present disclosure provide an electronic device for sharing information and an operating method thereof.

Recently, an electronic device may provide a fast autofocus function for a subject by detecting a near subject and a far background through a depth camera. In addition, after the image captured by the camera is stored in the electronic device, it may be shared with an external device as a shareable application such as a messenger application, e-mail, or SNS application.

However, in the case of the current technology, in order to share a photographed image, several steps are required, such as storing the image, executing a sharing application, and selecting a counterpart. In addition, in the case of the current technology, although an autofocus function on the subject is provided through the depth camera, there may be a problem in that only the subject cannot be shared by separating it from the background.

The present disclosure relates to an electronic device for sharing information and an operating method thereof, and more particularly, to an electronic device that separates an object selected by a user within a preview image displayed on the electronic device, and shares information related to the object, and the same It's about how it works.

According to an embodiment of the present disclosure, a method for an electronic device to share information with an external device includes: displaying a preview image acquired through a camera; receiving a first input for selecting a region of interest in the preview image; identifying an object associated with the region of interest in the preview image based on the first input; receiving a second input for sharing an image of the object; and transmitting an image of the object and information related to the object to an external device based on the second input.

An electronic device according to an embodiment of the present disclosure includes a display; camera; a communication unit communicating with an external device; a memory storing one or more instructions; and displaying a preview image obtained through the camera on a display, receiving a first input for selecting a region of interest in the preview image, and based on the first input, identifying an object related to the region of interest in the preview image, the object and a processor that receives a second input for sharing an image of , and transmits an image of the object and information related to the object to an external device based on the second input.

A computer-readable recording medium according to an embodiment of the present disclosure may include: displaying a preview image acquired through a camera; receiving a first input for selecting a region of interest in the preview image; identifying an object associated with the region of interest in a preview image based on a first input; receiving a second input for sharing information related to the object; and a program for transmitting an image of the object and information related to the object to an external device based on the second input.

1 is a diagram illustrating a system for sharing information related to an object according to an embodiment of the present disclosure.
2 is a flowchart illustrating a method for an electronic device to share information related to an object according to an embodiment of the present disclosure.
FIG. 3 is a diagram for describing an operation in which an electronic device moves a focus mark in a preview image when a subject moves, according to an embodiment of the present disclosure;
4 is a diagram for explaining an operation of providing a recommended focus display by an electronic device according to an embodiment of the present disclosure;
5 is a diagram for explaining an operation of receiving a touch input for selecting an ROI by an electronic device according to an embodiment of the present disclosure;
FIG. 6 is a diagram for describing an operation in which an electronic device receives a voice input for selecting a region of interest, according to an embodiment of the present disclosure.
FIG. 7 is a diagram for describing an operation in which an electronic device receives a stylus input for selecting a region of interest, according to an embodiment of the present disclosure;
8 is a diagram for describing an operation of receiving, by an electronic device, a stylus input for selecting a plurality of ROIs, according to an embodiment of the present disclosure;
9 is a diagram for describing an operation of an electronic device identifying an object related to a region of interest in a preview image according to an embodiment of the present disclosure;
10 is a diagram for describing an operation of receiving an input for selecting an unidentifiable object by an electronic device according to an embodiment of the present disclosure;
11 is a diagram for describing an operation of an electronic device displaying an identified object and receiving an input for sharing an image of the object, according to an embodiment of the present disclosure;
12 is a flowchart illustrating a method of providing information on an application supporting a sharing function according to an embodiment of the present disclosure.
13 is a diagram for explaining an operation in which an electronic device provides information on an application that provides a sharing function, according to an embodiment of the present disclosure.
14 is a diagram for describing an operation of an electronic device sharing an image of an object to an external device using a messenger application according to an embodiment of the present disclosure.
15 is a diagram for describing an operation of an electronic device sharing an image of an object to an external device using an application for short-range wireless communication according to an embodiment of the present disclosure.
16 is a diagram for explaining an operation of an electronic device sharing an image and information of a QR code with an external device according to an embodiment of the present disclosure.
17 is a diagram for explaining information related to a QR code according to an embodiment of the present disclosure.
18 is a diagram for explaining an operation of an electronic device sharing an image and information of a document to an external device according to an embodiment of the present disclosure;
19 is a diagram for describing an operation in which an electronic device shares object-related information with an external device according to an embodiment of the present disclosure.
20 is a diagram for explaining an operation of an electronic device sharing information related to an object to an external device by using an augmented reality (AR) technology according to an embodiment of the present disclosure.
21 is a diagram for describing an operation of an electronic device sharing object-related information to an external device by using virtual reality (VR) technology according to an embodiment of the present disclosure.
22 is a diagram for explaining an operation of sharing an object with an external device after an electronic device edits an object according to an embodiment of the present disclosure;
23 is a diagram for describing an operation of an electronic device sharing an object with an editing application according to an embodiment of the present disclosure;
24 and 25 are block diagrams for explaining an electronic device according to an embodiment of the present disclosure.
26 is a diagram for describing a software module stored in a memory according to an embodiment of the present disclosure.

Terms used in the present disclosure will be briefly described, and an embodiment of the present disclosure will be described in detail.

The terms used in the present disclosure are selected as currently widely used general terms as possible while considering the functions in an embodiment of the present disclosure, which may vary depending on the intention or precedent of a person skilled in the art, the emergence of new technology, etc. have. In addition, in a specific case, there is a term arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the corresponding embodiment. Therefore, the terms used in the present disclosure should be defined based on the meaning of the term and the contents of the present disclosure, rather than the simple name of the term.

In the present disclosure, when a part "includes" a certain component, it means that other components may be further included, rather than excluding other components, unless otherwise stated. In addition, terms such as "...unit" and "module" described in the present disclosure mean a unit that processes at least one function or operation, which may be implemented as hardware or software, or a combination of hardware and software. have.

Hereinafter, with reference to the accompanying drawings, embodiments of the present disclosure will be described in detail so that those of ordinary skill in the art to which the present disclosure pertains can easily implement them. However, the present disclosure may be implemented in several different forms and is not limited to the embodiments described herein. And in order to clearly describe the embodiment of the present disclosure in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the present disclosure.

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating a system for sharing information related to an object according to an embodiment of the present disclosure.

Referring to FIG. 1 , an information sharing system according to an embodiment of the present disclosure may include an electronic device 100 and an external device. Here, the external device may include the server device 200 and the external electronic device 300 . However, not all illustrated components are essential components. The information sharing system may be implemented by more elements than the illustrated elements, and the information sharing system may be implemented by fewer elements than that. For example, the information sharing system may be implemented with the electronic device 100 and the server device 200 , may be implemented with the electronic device 100 and the external electronic device 300 , or only with the electronic device 100 . may be implemented. Let's take a look at each configuration.

According to an embodiment of the present disclosure, the electronic device 100 may mean a device that acquires at least one frame of a subject. Hereinafter, for convenience of description, at least one frame of a subject may be expressed as an image or a photo.

According to an embodiment of the present disclosure, the subject may mean an object to be photographed. The subject may be a moving object such as a person, animal, insect, or car, or it may be a non-moving object such as a building, statue, painting, rock, foreign language sign, two-dimensional barcode (eg, QR (Quick Response) code), or document. It may be a plant such as a tree or a flower, or may be a content being reproduced, but is not limited thereto.

The electronic device 100 according to an embodiment of the present disclosure may be implemented in various forms. For example, the electronic device 100 may include a digital camera, a smart phone 160, a laptop computer, a tablet PC, an electronic book terminal, a digital broadcasting terminal, a personal digital assistant (PDA), or a PMP. (Portable Multimedia Player), navigation, MP3 player, etc. may be included, but is not limited thereto.

The electronic device 100 described in the present disclosure may be a wearable device that can be worn by a user. Wearable devices include accessory type devices (eg, watches, rings, bracelets, anklets, necklaces, glasses, contact lenses), head-mounted-devices (HMDs), augmented reality glasses, and augmented reality glasses. Augmented Reality Helmet, Virtual Reality Glass, textile or garment-integrated device (e.g., electronic garment), body-attached device (e.g., skin pad), or bioimplantable device ( eg: an implantable circuit).

Also, according to an embodiment of the present disclosure, the electronic device 100 may be a smart phone 160 including a flexible display. The flexible display is a display that can be bent, and may include at least one of a curved display, a bendable display, a foldable display, and a rollable display, but is limited thereto. not.

Hereinafter, for convenience of description, a case in which the electronic device 100 is a digital camera or a smart phone 160 having a built-in camera will be described as an example.

According to an embodiment of the present disclosure, a user of the electronic device 100 may take a picture of a subject using the electronic device 100 . When taking a picture using the electronic device 100 , a preview image 110 of a subject may be displayed on the display of the electronic device 100 . The preview image 110 may be an image that a user can check in advance before taking a picture through a display.

At this time, even if the user of the electronic device 100 does not capture an image, the user selects a specific subject 120 among the subjects 120 , 130 , and 140 appearing in the preview image 110 , and selects an image of the specific subject 120 . You may want to share 150 with an external device.

In this case, using a general electronic device, a user must go through several steps to share an image of a specific subject from which the background is removed with an external device. First, the user must take a picture including a specific subject (photographing step). Next, the user must perform a task of separating a specific subject from the background by using an additional editing application (editing step). Finally, the user must share the image on which the background separation operation has been performed by running a sharing application (sharing step).

That is, the image 150 of a specific subject 120 is not shared at the same time as the photo is taken, but it takes a long time to share the image 150 because the above steps (shooting step, editing step, sharing step) are required. can In addition, a general user unfamiliar with photo editing may have difficulty in separating a specific subject and a background from a captured image (eg, a captured image), and the result may not be sophisticated.

In order to solve the above problems, the electronic device 100 according to various embodiments of the present disclosure is proposed.

According to an embodiment of the present disclosure, when receiving an input 170 for selecting a specific subject 120 from the preview image 110 from the user, the electronic device 100 selects the specific subject 120 from the preview image 110 . ) is separated from the background to obtain an image 150 of a specific subject 120 . In this case, the image 150 of the specific subject 120 may be a partial area of the preview image 110 . According to an embodiment of the present disclosure, the electronic device 100 may transmit the image 150 of the specific subject 120 to the external device according to a simple user input (eg, drag and drop input). That is, the electronic device 100 may transmit the image 150 of a partial area including the specific subject 120 to the external device, rather than transmitting the entire preview image 110 to the external device. For example, the electronic device 100 may transmit the image 150 of the specific subject 120 to the external electronic device 300 through the server device 200 . Also, the electronic device 100 may directly transmit the image 150 of the specific subject 120 to the external electronic device 300 through short-range wireless communication (eg, WiFi, Bluetooth, UWB, etc.).

According to an embodiment of the present disclosure, the electronic device 100 transmits information related to the specific subject 120 together with the image 150 of the specific subject 120 to the server device 200 or the external electronic device 300 . can

Accordingly, according to an embodiment of the present disclosure, the user only manipulates the preview image 110 displayed on the electronic device 100 by simply operating the image 150 and/or the specific subject 120 in the preview image 110 . Information about the subject 120 may be shared with an external device.

Meanwhile, according to an embodiment of the present disclosure, the electronic device 100 may include an artificial intelligence model for separating a specific subject and a background. According to an embodiment of the present disclosure, the electronic device 100 may directly generate or refine an artificial intelligence model by using the learning data. Also, the electronic device 100 may receive and store the artificial intelligence model learned by the server device 200 from the server device 200 .

The server device 200 may include a communication interface for performing communication with an external device. According to an embodiment of the present disclosure, the server device 200 may communicate with the electronic device 100 or the external electronic device 300 through a communication interface.

The server device 200 may include a server for transmitting and receiving data to and from the electronic device 100 or the external electronic device 300 , a server for providing an application service, a server separately provided for performing embodiments of the present disclosure, etc. However, the present invention is not limited thereto.

The server device 200 may receive an image of an object and information related to the object from the electronic device 100 . The server device 200 may transmit an image of an object received from the electronic device 100 and information related to the object to another server device or to the external electronic device 300 .

The external electronic device 300 may include a communication interface for communicating with an external device. The external electronic device 300 may be another terminal possessed by the user of the electronic device 100 . For example, the external electronic device 300 may be a device connected to the same account as the electronic device 100 . Alternatively, the external electronic device 300 may be an electronic device owned by another person.

The external electronic device 300 according to an embodiment of the present disclosure may be implemented in various forms. For example, the external electronic device 300 may include a digital camera, a smart phone, a laptop computer, a tablet PC, an electronic book terminal, a digital broadcasting terminal, a personal digital assistant (PDA), or a portable computer (PMP). Multimedia Player), navigation, MP3 player, etc., but is not limited thereto. For example, the external electronic device 300 may be a wearable device that can be worn by a user.

The external electronic device 300 may receive an image of an object and information related to the object from the electronic device 100 . According to an embodiment, the external electronic device 300 may receive an image of an object and information related to the object from the electronic device 100 through the server device 200 . According to another embodiment, the external electronic device 300 may directly receive an image of an object and information related to the object from the electronic device 100 through short-range wireless communication (eg, WiFi, Bluetooth, UWB, etc.).

Hereinafter, with reference to FIG. 2 , an operation in which the electronic device 100 shares the object image 150 and/or information related to the object from which the background is separated to the external electronic device 300 will be described in detail.

2 is a flowchart illustrating a method for an electronic device to share information related to an object according to an embodiment of the present disclosure.

In operation S210, the electronic device 100 may display a preview image obtained through a camera. The preview image may be an image that a user can check in advance through a display before taking a photo or a video.

According to an embodiment of the present disclosure, the preview image may include a subject (eg, a person, an animal, a QR code, a document, a foreign language signboard, etc.), a background, and the like.

According to an embodiment of the present disclosure, the preview image may vary according to the angle of view of the camera of the electronic device 100 . The camera may include a general camera, a telephoto camera, a wide-angle camera, and the like. When the camera of the electronic device 100 is a general camera, the electronic device 100 may acquire a preview image using a standard lens. When the camera of the electronic device 100 is a telephoto camera, the electronic device 100 may obtain a preview image using a telephoto lens. When the camera of the electronic device 100 is a wide-angle camera, the electronic device 100 may obtain a preview image using a wide-angle lens.

According to an embodiment of the present disclosure, when the user of the electronic device 100 moves the electronic device 100 , the preview image may be changed. For example, when a user takes pictures of a person and a dog with the electronic device 100 outdoors, the user may move the electronic device 100 from a direction in which a person is photographed to a direction in which the dog is photographed. In this case, the preview image of the electronic device 100 may be changed from a preview image in which a person is displayed to a preview image in which a puppy is displayed.

According to an embodiment of the present disclosure, the preview image may be changed according to the focus of the camera of the electronic device 100 . When the focus is on the subject, the subject in the preview image may be distinct and the background blurred. When the focus is on the background, the background of the preview image is clear and the subject may be blurred.

According to an embodiment of the present disclosure, the electronic device 100 may provide a focus indication in a preview image. For example, when a person, an animal, and a tree are included in the preview image, the electronic device 100 displays a focus on each of the area occupied by the person, the area occupied by the animal, and the area occupied by the tree in the preview image (eg, the subject). If is a person, a circle mark around the face of the person) may be made, or a focus mark may be displayed only on the area occupied by the person. However, the present invention is not limited thereto.

According to an embodiment of the present disclosure, the electronic device 100 may identify the subject in the preview image by using information about the subject provided by the camera application, and may display a focus on the identified subject. For example, the electronic device 100 may identify whether the subject is a human, an animal, a QR code, or a document, and may display a focus on the identified subject.

According to an embodiment of the present disclosure, the electronic device 100 may also display information related to a subject in the preview image.

According to an embodiment of the present disclosure, when the subject in the preview image has a device capable of transmitting information about the subject, information related to the subject may be received from the device and displayed in the preview image. For example, when the user of the electronic device 100 takes a picture of a puppy wearing a smart tag, the electronic device 100 sends a smart tag from the puppy's smart tag through short-range wireless communication (eg, ultra-wideband (UWB)). You can receive information related to the puppy stored in the tag. In this case, the electronic device 100 may display, in a pop-up form, information related to a puppy received from the smart tag together with the puppy image in the preview image.

In operation S220 , the electronic device 100 may receive a first input for selecting an ROI from the preview image.

According to an embodiment of the present disclosure, the region of interest in the preview image may be a region corresponding to a specific subject that the user of the electronic device 100 wants to separate from the background. For example, when a person, an animal, and a tree are included in the preview image, the user of the electronic device 100 may want to separate the person in the preview image from the background. In this case, the region of interest in the preview image may be a region corresponding to a person.

According to an embodiment of the present disclosure, the electronic device 100 may receive a touch input for a preview image as a first input for selecting an ROI. According to an embodiment of the present disclosure, the first input may be an input of touching a specific area within a preview image for a predetermined time (eg, 3 seconds). For example, when the user of the electronic device 100 wants to separate the person in the preview image from the background, the user may touch an area in which the person appears for a predetermined time with his/her hand.

According to an embodiment of the present disclosure, the electronic device 100 may receive a voice input as a first input for selecting an ROI. According to an embodiment of the present disclosure, the first input may be a voice input containing information on a specific subject desired to be separated from the background. For example, when the user of the electronic device 100 desires to separate the person in the preview image from the background, the electronic device 100 may receive a voice input from the user saying “separate only the person!” from the user.

According to an embodiment of the present disclosure, the electronic device 100 may receive a stylus pen input as a first input for selecting an ROI. According to an embodiment of the present disclosure, the first input may be an input for selecting a specific subject using a stylus pen equipped with a gyro sensor. According to an embodiment of the present disclosure, a user may select an area corresponding to a specific subject using a stylus pen within a predetermined distance from the electronic device 100 . For example, when the user of the electronic device 100 desires to separate a person in the preview image from the background, the user selects an area in which the person appears within a predetermined distance from the electronic device 100 with a stylus pen (eg, by hovering). input, air gesture (Air pointer).

In operation S230 , the electronic device 100 may identify an object related to the ROI in the preview image based on the first input.

According to an embodiment of the present disclosure, when receiving a first input for selecting an ROI from a user, the electronic device 100 selects a specific subject overlapping an area of a predetermined ratio (eg, 80%) or more of the ROI as the ROI. It can be identified as an object related to

According to an embodiment of the present disclosure, the electronic device 100 may perform an operation of separating the object identified in the preview image from the background. In this case, according to an embodiment of the present disclosure, the electronic device 100 may separate the object from the background by using the learning network model. Here, the learning network model may be an artificial intelligence (AI) model trained using numerous sample image data containing various backgrounds and poses of the subject. For example, if the identified object is a person, a trained learning network model can accurately separate the person's facial features and hair from the background.

According to an embodiment of the present disclosure, the electronic device 100 may display an identification of an object in a preview image. According to an embodiment of the present disclosure, the electronic device 100 may display an outline indicating an edge region of an object (eg, a person) separated in a preview image with a predetermined color or a predetermined thickness. However, the display method is not limited thereto.

In operation S240 , the electronic device 100 may receive a second input for sharing an image of an object.

According to an embodiment of the present disclosure, the second input may be a touch input. For example, when a user touches an object (or an ROI) for a predetermined time or longer, the electronic device 100 may recognize the object as a second input for sharing an image.

According to an embodiment of the present disclosure, the electronic device 100 may display icons corresponding to each of a plurality of applications on the screen while the user touches an object (or a region of interest). The plurality of applications may be applications supporting the sharing function (hereinafter, for convenience of description, an application supporting the sharing function may be referred to as a sharing application). For example, the plurality of applications may be an SNS application, a messenger application, a browser application, an application for short-range wireless communication, and the like, but is not limited thereto. According to an embodiment of the present disclosure, the icons corresponding to each of the plurality of applications may be displayed to overlap the preview image, or may be displayed in a different area from the preview image. For example, as the object is touched by the user, the electronic device 100 may reduce the preview image and display icons corresponding to each of the plurality of applications in a different area from the reduced preview image.

According to an embodiment of the present disclosure, the electronic device 100 may receive an input that the user drags to an icon corresponding to a specific shared application while touching the object.

According to an embodiment of the present disclosure, when a user drags an object to a specific shared application while touching the object, the size of the object image may be changed. For example, when dragging an object while touching it, the image of the object may be moved while being reduced.

According to an embodiment of the present disclosure, the second input may be a voice input. For example, when receiving a voice for sharing an image of an object from a user (eg, "Please share only people!"), the electronic device 100 may recognize the voice input as the second input.

According to an embodiment of the present disclosure, when receiving a voice input from a user, the electronic device 100 may display icons corresponding to each of a plurality of applications on the screen. A method of displaying icons corresponding to each of a plurality of applications on the screen upon receiving a voice input is the same as the method described in the touch input, and thus a description thereof will be omitted.

According to an embodiment of the present disclosure, the electronic device 100 may receive a voice for selecting a specific sharing application from the user (eg, "Share it as a message application!"). According to an embodiment of the present disclosure, when the electronic device 100 receives a voice for selecting a specific shared application from the user, the object image may be moved to the specific shared application while the size is changed.

According to an embodiment of the present disclosure, the second input may be a stylus input. For example, when a user selects an object (or a region of interest) for a predetermined time or longer using a stylus pen, the electronic device 100 may recognize the object as a second input for sharing an image.

According to an embodiment of the present disclosure, the electronic device 100 may display icons corresponding to each of a plurality of applications on the screen while the user selects an object (or a region of interest) using a stylus pen. A method of displaying icons corresponding to each of a plurality of applications on the screen as the stylus pen input is received is the same as the method described in the touch input, and thus a description thereof will be omitted.

According to an embodiment of the present disclosure, the electronic device 100 may receive an input in which a user drags an object to an icon corresponding to a specific sharing application using a stylus pen.

According to an embodiment of the present disclosure, when a user drags an object to a specific sharing application using a stylus pen, the size of the object image may be changed. For example, when an object is dragged using a stylus pen, the image of the object may be moved while being reduced.

According to an embodiment of the present disclosure, the first input for selecting the region of interest from the preview image and the second input for sharing the object image may be implemented as one operation or as a continuous operation. For example, when the electronic device 100 receives a voice input of 'share only people', the electronic device 100 uses a first voice input of 'share only people' for selecting an ROI. It may be recognized as a second input for sharing the input and the object image. In addition, when the electronic device 100 receives an input of dragging a person to the window of the messenger application while touching the person in the preview image for a predetermined time or longer, the electronic device 100 receives an input of touching the person for a predetermined time or longer as the first input , and a dragging input may be recognized as a second input. In this case, the first input and the second input may be implemented as a continuous operation called touch and drag.

In operation S250 , the electronic device 100 may transmit an image of an object and information related to the object to an external device based on the second input.

According to an embodiment of the present disclosure, the electronic device 100 may transmit an image of an object to an external device through a sharing application selected by a user. The image of the object may be an image cut out of an edge of the object or an image of a predetermined size including the object, but is not limited thereto. The image of the object may be smaller than the preview image.

For example, the electronic device 100 may transmit the object to the external device based on an input of dragging an object to an icon of a specific application among icons of a plurality of applications displayed in response to the second input. . For example, when the user of the electronic device 100 touches and drags the object to the icon corresponding to the messenger application, the image of the object is transmitted to the electronic device (external device) of the counterpart with whom the user is having a conversation using the messenger application. can be

According to an embodiment of the present disclosure, the electronic device 100 may transmit information related to an object together with an image of the object to an external device. The object-related information includes the name of the object, the contact information of the object, the address of the object, the model name of the object, and information of the QR code if the object is a QR code (for example, information containing text such as English, numbers, Korean, etc., and URL (Uniform Resource Locator) address, Wi-Fi password, Mobile Hotspot, setting value, IoT device information, etc.), OCR (optical character reader) data information if the object is a document, translation information, etc., if the object is a foreign language sign can

According to an embodiment of the present disclosure, the electronic device 100 may obtain information related to an object, and transmit the information related to the object together with an image of the object to an external device.

According to an embodiment of the present disclosure, the electronic device 100 may obtain information related to an object by analyzing a preview image. In this case, according to an embodiment of the present disclosure, the electronic device 100 may acquire information related to the object using a learning network model of an artificial intelligence (AI) system. For example, when the object is a QR code, information related to the QR code (eg, phone number, email address, URL information, address information, Wi-Fi password information, Mobile Hotspot setting value information, IoT device information, etc.) is obtained. If the object is a document, the document may be converted into text to obtain text data (OCR data). However, the present invention is not limited thereto.

According to an embodiment of the present disclosure, the electronic device 100 may obtain information related to an object from a device related to the object. For example, when the object is a person, information related to a person (eg, a person's name, a person's address, etc.) may be obtained from a mobile terminal or a wearable device possessed by the object. When the object is a dog, information related to the dog (eg, the dog's owner, the dog's name, the dog's address, etc.) may be obtained from the smart tag connected to the dog.

According to an embodiment of the present disclosure, the electronic device 100 may determine intimacy with the device related to the object, and may acquire information related to the object based on the determined intimacy. According to an embodiment of the present disclosure, a device related to an object may set a private level. The private level may include information related to an accessible (available) object corresponding to each level. For example, the higher the private level, the more sensitive information required to maintain security (eg, cell phone number) may be included. According to an embodiment of the present disclosure, when the intimacy between the electronic device 100 and the device related to the object is high, the private level may be set high. When it is determined that the intimacy with the device related to the object is high, the electronic device 100 may acquire information (eg, mobile phone information) corresponding to a high private level.

According to an embodiment of the present disclosure, the electronic device 100 directly transmits an image of an object and information related to the object to the external electronic device 300 through short-range wireless communication (WiFi, Bluetooth, UWB, etc.) based on the second input. ) can be shared. In this case, the execution screen of the shared application may include an interface screen for short-range wireless communication with an external device.

According to an embodiment of the present disclosure, the electronic device 100 may process an image of an object and information related to the object based on a data format supported by a shared application selected by a user. For example, when the data format supported by the sharing application is a PNG file, the electronic device 100 may process an image of an object and information related to the object in a PNG format and share it.

According to an embodiment of the present disclosure, the electronic device 100 may store the image of the object in the memory of the electronic device 100 at the same time as sharing the image with the external device. In this case, the original preview image from which the background is not removed and the image of the object from which the background is removed may be stored together in the memory of the electronic device 100 , or only the image of the object may be stored in the memory.

FIG. 3 is a diagram for describing an operation in which an electronic device moves a focus mark in a preview image when a subject moves, according to an embodiment of the present disclosure;

Referring to 300 - 1 of FIG. 3 , the electronic device 100 may display a running person on a preview image 310 in a real-time image state or a photographing state obtained from a camera. The preview image may include a subject 330 and a background 320 .

According to an embodiment of the present disclosure, the electronic device 100 may provide the focus indication 340 in the preview image. According to an embodiment of the present disclosure, the electronic device 100 may identify the subject in the preview image by using information about the subject provided by the camera application, and may display the focus 340 on the identified subject. . For example, the electronic device 100 may identify the person 330 in the preview image, and mark the focus 340 on the identified person 330 .

Referring to 300-2 of FIG. 3 , it can be seen that the position of the person 330 in the preview image 310 is changed as the person 330, which is the subject, jumps. In this case, the electronic device 100 may track the location of the person 330 in the preview image 310 , and may display the focus mark 350 on the person 330 whose location has been moved. According to an embodiment, the electronic device 100 may move the focus marks 340 and 350 in the preview image 310 by tracking the movement of the subject.

4 is a diagram for explaining an operation of providing a recommended focus display by an electronic device according to an embodiment of the present disclosure;

Referring to FIG. 4 , the electronic device 100 may display a plurality of subjects 410 , 420 , 430 , and 440 in a preview image 450 in a real-time image state or a photographing state obtained from a camera. The preview image 450 may include a plurality of subjects 410 to 440 and a background.

According to an embodiment of the present disclosure, the camera of the electronic device 100 may recognize subjects in the preview image 450 by executing an intelligent function. For example, the camera of the electronic device 100 detects subjects (eg, the first person 410 , the dog 420 , the second person 430 , and the cat 440 that are separated from the background in the preview image 450 ). )) can be recognized.

According to an embodiment of the present disclosure, the electronic device 100 displays a recommended focus on the subjects 410 to 440 recognized by the camera (eg, a first recommended focus display 460 for the first person 410 ). , a second recommended focus display 470 on the dog 420 , a third recommended focus display 480 on the second person 430 , and a fourth recommended focus display 490 on the cat 440 ). can The user of the electronic device 100 may select an ROI based on the recommended focus indications 460 , 470 , 480 , and 490 . For example, the user may select the face of the first person 410 as the ROI in the preview image 450 by touching the first recommendation focus mark 460 .

FIG. 5 is a diagram for describing an operation in which an electronic device receives a touch input for selecting a region of interest, according to an embodiment of the present disclosure.

Referring to FIG. 5 , the electronic device 100 may receive a touch input 520 for a preview image 510 as a first input for selecting an ROI 530 . In this case, the region of interest 530 may be a region corresponding to the person 540, which is a specific subject that the user of the electronic device 100 wants to separate from the background.

For example, the electronic device 100 may receive a touch input 520 for touching the person 540 for a predetermined time (eg, 3 seconds) from the user. In this case, the electronic device 100 may select a region within a predetermined radius from the position (coordinate) where the touch input 520 is sensed as the region of interest 530 . In FIG. 5 , the region of interest 530 is indicated as a rectangular region including the touch input 520 , but this is only an indication of the range of the region of interest 530 and may not be displayed in the actual preview image 510 . may be

FIG. 6 is a diagram for describing an operation in which an electronic device receives a voice input for selecting a region of interest, according to an embodiment of the present disclosure.

Referring to FIG. 6 , the electronic device 100 may receive a voice input 620 for a preview image 610 as a first input for selecting an ROI 630 . In this case, the region of interest 630 may be a region corresponding to the person 640 , which is a specific subject that the user of the electronic device 100 wants to separate from the background.

According to an embodiment of the present disclosure, the electronic device 100 receives the user's voice input 620 through a microphone, and converts the voice part into computer-readable text using an Automatic Speech Recognition (ASR) model. can In addition, the converted text may be interpreted using a Natural Language Understanding (NLU) model to acquire the user's intention to speak.

For example, the electronic device 100 receives a voice input 620 from the user saying “separate only the person!” and converts the voice “separate only the person!” into computer-readable text using the ASR model. can be converted Then, by analyzing the converted text using the NLU model, it is possible to obtain that the voice input 620 is an intention to select the region of interest 630 . Accordingly, the electronic device 100 may select a region corresponding to “person” included in the voice input as the region of interest 630 . Although the region of interest 630 is indicated as a rectangular region in FIG. 6 , this is only an indication of the range of the region of interest 630 and may not be displayed in the actual preview image 610 .

According to an embodiment of the present disclosure, the ASR model or the NLU model may be an artificial intelligence model, and the artificial intelligence model may be processed by an artificial intelligence dedicated processor designed with a hardware structure specialized for processing the artificial intelligence model. According to an embodiment of the present disclosure, an artificial intelligence model may be created through learning. Here, being made through learning means that a basic artificial intelligence model is learned using a plurality of learning data by a learning algorithm, so that a predefined action rule or artificial intelligence model set to perform a desired characteristic (or purpose) is created it means. The artificial intelligence model may be composed of a plurality of neural network layers. Each of the plurality of neural network layers has a plurality of weight values, and a neural network operation is performed through an operation between an operation result of a previous layer and a plurality of weights.

FIG. 7 is a diagram for describing an operation in which an electronic device receives a stylus input for selecting a region of interest, according to an embodiment of the present disclosure;

Referring to 700 - 1 of FIG. 7 , the electronic device 100 may receive a stylus input for a preview image 710 as a first input for selecting an ROI 730 . In this case, the region of interest 730 may be a region corresponding to the person 740 , which is a specific subject that the user of the electronic device 100 wants to separate from the background.

According to an embodiment of the present disclosure, the user may select the ROI 730 using the stylus pen 101 within a predetermined distance from the electronic device 100 . For example, when the electronic device 100 is a smartphone including a foldable display, the user puts the electronic device 100 on the floor and uses the stylus pen 101 to draw the region of interest 730 . You can choose.

Referring to 700-2 of FIG. 7 , the stylus pen 101 may include a button 102 on the side thereof. Referring to 700-1 of FIG. 7 , when the user of the electronic device 100 points the stylus pen 101 toward the person 740 displayed in the preview image 710 and presses the button 102, a point display 720 ) may appear.

In this case, the electronic device 100 may select a region within a predetermined radius from the point mark 720 in the preview image 710 as the region of interest 730 . In 700-1 of FIG. 7 , the region of interest 730 is indicated as a rectangular region including the point mark 720 , but this is only an indication of the range of the region of interest 730 and is not displayed in the actual preview image 710 . It may not be displayed. Meanwhile, the user may change the position of the point display 720 through a hovering input using the stylus pen 101 . In the present disclosure, the hovering input may refer to an input event in which the stylus pen 101 approaches within a predetermined separation distance from the electronic device 100 .

8 is a diagram for describing an operation of receiving, by an electronic device, a stylus input for selecting a plurality of ROIs, according to an embodiment of the present disclosure;

Referring to FIG. 8 , the electronic device 100 is an area corresponding to specific subjects 803 , 804 , and 806 among a plurality of subjects 802 , 803 , 804 , 805 and 806 displayed in a preview image 801 . A stylus input for selecting a plurality of regions of interest 807 , 808 , and 809 may be received.

According to an embodiment of the present disclosure, the user of the electronic device 100 selects the plurality of subjects 803 , 804 , and 806 among the subjects 802 , 803 , 804 , 805 , and 806 displayed in the preview image 801 . You may want to separate it from the background. In this case, the user may select a plurality of regions of interest 807 , 808 , and 809 using the stylus pen 101 . According to an embodiment, when the user points the stylus pen 101 to the specific subjects 803 , 804 , and 806 and presses the buttons 102 sequentially, the point marks 810 may appear sequentially.

In this case, the electronic device 100 may select a region within a predetermined radius from the point marks 810 in the preview image 801 as the ROIs 807 , 808 , and 809 . 8 , the regions of interest 807 , 808 , 809 are indicated as rectangular regions including the point marks 810 , but this only indicates the extent of the regions of interest 807 , 808 , 809 , It may not be displayed in the actual preview image 801 .

According to an embodiment of the present disclosure, the user of the electronic device 100 may select an unwanted subject while selecting a plurality of subjects. In this case, the user may cancel the selection by pressing the button 102 again for the erroneously selected area using the stylus pen 101 .

9 is a diagram for describing an operation of an electronic device identifying an object related to a region of interest in a preview image according to an embodiment of the present disclosure;

Referring to FIG. 9 , a user of the electronic device 100 may photograph a snowman doll 930 and desire to determine the snowman doll 930 as an object to be separated from a background 920 .

Referring to 900 - 1 of FIG. 9 , the electronic device 100 transmits a snowman doll 930 , which is a specific subject desired to be separated from the background 920 in the preview image 910 for a predetermined time (eg, 3 seconds). ) may receive a touch input 940 to be touched. Although it is described as the touch input 940 in FIG. 9 , it may be a voice input or a stylus input. In this case, the electronic device 100 may select a region within a predetermined radius from the touch input 940 as the region of interest 950 . Also, the electronic device 100 may extend a region adjacent to the ROI 950 to the ROI 950 . According to an embodiment of the present disclosure, the electronic device 100 may classify a region adjacent to the region of interest 950 as an edge region. For example, when the snowman's face is selected as the ROI 950 , the electronic device 100 may extend the ROI to the snowman's hands and torso. In this case, the electronic device 100 may receive a drag input, a multi-touch input, or the like from the user to expand the ROI.

Referring to 900 - 2 of FIG. 9 , the electronic device 100 may determine a ratio of the snowman doll 930 in the ROI 950 . According to an embodiment of the present disclosure, the electronic device 100 identifies the snowman 930 as an object when the proportion of the snowman 930 in the region of interest 950 is greater than or equal to a predetermined ratio (eg, 80%). can do. For example, referring to 900 - 2 of FIG. 9 , the area 960 occupied by the snowman doll 930 in the area of interest 950 may be 83% of the area of interest. In this case, the snowman doll 930 may be identified as an object to be separated from the background.

Referring to 900 - 3 of FIG. 9 , when the electronic device 100 identifies the snowman doll 930 as an object, the electronic device 100 may separate the identified object from the background 920 . In this case, according to an embodiment, the electronic device 100 may separate the object from the background 920 using the learning network model. Here, the learning network model may be an artificial intelligence (AI) model trained using numerous sample image data containing various backgrounds and poses of the subject.

10 is a diagram for describing an operation of receiving an input for selecting an unidentifiable object by an electronic device according to an embodiment of the present disclosure;

Referring to FIG. 10 , the user of the electronic device 100 wants the snowman doll 1030 to be determined as an object to be separated from the background, but may accidentally select a part of the background 1020 that is not related to the snowman doll 1030. .

Referring to 1000 - 1 of FIG. 10 , the electronic device 100 selects a region (eg, a background region) that is not related to a snowman doll 1030 that is a specific subject within a preview image 1010 for a predetermined time (eg, 3 A touch input 1040 that touches by seconds) may be received. Although it is described as a touch input 1040 in FIG. 10 , it may be a voice input or a stylus input. In this case, the electronic device 100 may select a region within a predetermined radius from the touch input 1040 as the region of interest 1050 .

Referring to 1000 - 2 of FIG. 10 , the electronic device 100 may determine a ratio of the snowman doll 1030 in the ROI 1050 . According to an embodiment of the present disclosure, when the proportion (eg, 80%) of the snowman doll 1030 in the region of interest 1050 is less than a predetermined ratio (eg, 80%), the electronic device 100 identifies the snowman doll 1030 as an object. may not For example, referring to 1000 - 2 of FIG. 10 , the area 1060 occupied by the snowman doll 1030 in the area of interest 1050 may be 8% of the area of interest. In this case, the snowman doll 1030 may not be identified as an object. Also, when the portion occupied by the background 1020 in the region of interest 1050 is greater than or equal to 90%, the electronic device 100 may determine that the user has selected an unidentifiable subject.

According to an embodiment of the present disclosure, when the user selects an unidentifiable subject (eg, a background area) in the preview image 1010 , the electronic device 100 determines that there is no identified object. You can notify the user. For example, the phrase “the identified object does not exist” may be displayed in a pop-up form in the preview image 1010 .

11 is a diagram for describing an operation of an electronic device displaying an identified object and receiving an input for sharing an image of the object, according to an embodiment of the present disclosure;

Referring to FIG. 11 , when the user of the electronic device 100 selects the snowman doll 1120 , the snowman doll 1120 may be identified as an object to be separated from the background. The electronic device 100 may make an identification mark 1130 indicating that the snowman doll 1120 is identified as an object in the preview image 1110 . According to an embodiment, the electronic device 100 may display an outline indicating an edge region of the snowman doll 1120 in the preview image 1110 with a predetermined color or a predetermined thickness. However, the display method is not limited thereto.

Referring to FIG. 11 , the electronic device 100 may receive a second input 1140 for sharing an image of a snowman doll 1120 identified as an object. Although shown as a touch input in FIG. 11 , it may be a voice input or a stylus input. For example, when the user touches the snowman doll 1120 having the identification mark 1130 for a predetermined time or longer, the electronic device 100 may recognize the snowman doll 1120 as a second input for sharing the image. have.

12 is a flowchart illustrating a method of providing information on an application supporting a sharing function according to an embodiment of the present disclosure.

Referring to FIG. 12 , step S1210 may be performed after step S240 of FIG. 2 .

In operation S1210, the electronic device 100 may receive a plurality of application information supporting a sharing function.

According to an embodiment of the present disclosure, when receiving a second input for sharing an image of an object, the electronic device 100 may receive a plurality of application information. The plurality of applications may be applications supporting a sharing function (for convenience of description, they may be referred to as shared applications). The application information may be an application name, type, supported data format, and the like.

In operation S1220, the electronic device 100 may display icons corresponding to each of a plurality of applications.

According to an embodiment of the present disclosure, the electronic device 100 may display icons corresponding to each of a plurality of applications (shared applications) on the screen of the electronic device 100 . For example, the sharing application may be an SNS application, a messenger application, a browser application, an application for short-range wireless communication, and the like, but is not limited thereto. According to an embodiment of the present disclosure, the icons corresponding to each of the shared applications may be displayed overlapping the preview image or displayed in a different area from the preview image. For example, upon receiving the second input, the electronic device 100 may reduce the preview image and display icons corresponding to each of the plurality of applications in a different area from the reduced preview image.

In operation S1230, the electronic device 100 may transmit an image of the object and information related to the object to the external device based on an input of dragging the object to one of the displayed icons.

According to an embodiment of the present disclosure, the user of the electronic device 100 may touch and drag an object to an icon of a specific application among icons of a plurality of applications displayed in response to the second input. The electronic device 100 may transmit an image of an object and information related to the object to an external device based on a drag input.

According to an embodiment of the present disclosure, even when the electronic device 100 is a single window, the user of the electronic device 100 easily transmits an image of an object and information related to the object to an external device through a simple user input such as dragging. can be transmitted

Hereinafter, an operation in which the electronic device 100 provides information on an application providing a sharing function will be described in detail with reference to FIG. 13 .

13 is a diagram for explaining an operation in which an electronic device provides information on an application that provides a sharing function, according to an embodiment of the present disclosure.

Referring to FIG. 13 , a user may wish to share an image of the coffee he is drinking with his friend. In this case, the user may launch the camera of the electronic device 100 and cause a preview image including coffee to appear on the display of the electronic device 100 .

Referring to 1300-1 of FIG. 13 , the electronic device 100 may receive a user input 1330 of touching coffee 1320 within a preview image 1310 for a predetermined time or longer. Although it is described that the user input 1330 is a touch input in FIG. 13 , it may be a voice input or a stylus input. According to an embodiment, the electronic device 100 may display an outline indicating that the coffee 1320 is separated from the background. When the area within the displayed outline is touched for a predetermined time or longer, the electronic device 100 may recognize it as the user input 1330 .

Referring to 1300 - 2 of FIG. 13 , the electronic device 100 displays icons corresponding to the first application, the second application, and the third application at the bottom of the preview image 1310 while the user touches the object 1320 . (the first icon 1340 , the second icon 1350 , and the third icon 1360 ) may be displayed. In this case, the first application may be a messenger application, the second application may be an SNS application, and the third application may be an application for short-range wireless communication.

According to an embodiment of the present disclosure, when the electronic device 100 receives the user input 1320 , the brightness of the preview image 1310 may be darkened. In addition, only the coffee image 1370 from which the background is removed may be displayed on the screen with the size reduced. In this case, the user of the electronic device 100 may drag the coffee image 1370 from which the background has been removed to a specific application icon among the first icon 1340 , the second icon 1350 , and the third icon 1360 while touching it. can For example, when the user of the electronic device 100 wants to share an object through a messenger application that is the first application, the user may drag the coffee image 1370 to the first icon 1340 while touching it. .

Referring to 1300 - 3 of FIG. 13 , the electronic device 100 may share an image 1370 using a messenger application. When the user of the electronic device 100 touches and drags the image 1370 to the icon 1340 of the messenger application, the messenger application may be executed. In this case, the coffee image 1370 from which the background is removed may be displayed overlaid on the execution screen 1380 of the messenger application. According to an embodiment of the present disclosure, when the user of the electronic device 100 stops touching the image 1370 on the messenger application execution screen 1380 (eg, a drop event), the image 1370 displays the messenger application. It may be transmitted to the electronic device (external device) of the counterpart with whom the communication is being performed.

According to an embodiment of the present disclosure, the electronic device 100 transmits, together with the coffee image 1370 , information related to the coffee 1320 , such as the name of the coffee and information on connection to a site where coffee can be purchased, to the electronic device of the conversation partner. can In this case, according to an embodiment of the present disclosure, the electronic device 100 may acquire information related to the coffee 1320 using a learning network model of an artificial intelligence (AI) system.

According to an embodiment of the present disclosure, since the user of the electronic device 100 does not need an additional editing process in order to obtain the coffee image 1370 from which the background has been removed, it is more convenient and faster to transfer the image 1370 to the other party's electronic device. It can be transmitted to a device (external device).

14 is a diagram for describing an operation of an electronic device sharing an image of an object to an external device using a messenger application according to an embodiment of the present disclosure.

According to an embodiment of the present disclosure, the electronic device 100 may be a smartphone having a multi-window function. When the electronic device 100 has a multi-window function, the first application execution screen and the second application execution screen may be simultaneously displayed. Hereinafter, a case in which the first application is a camera application and the second application is a messenger application will be described as an example.

Referring to FIG. 14 , a user may want to photograph a friend's image and share the friend's image from which the background is removed through a messenger application. In this case, the user may execute the camera application, which is the first application, with the electronic device 100 , and may cause the preview image 1410 including the friend to appear on the camera application execution screen 1420 of the electronic device 100 .

Referring to 1400-1 of FIG. 14 , the electronic device 100 may simultaneously display a camera execution screen 1420 and a messenger application execution screen 1430 . According to an embodiment of the present disclosure, the electronic device 100 may receive a user input 1450 of touching the friend image 1440 in the preview image 1410 for a predetermined time or longer. Although it is described that the user input 1450 is a touch input in FIG. 14 , it may be a voice input or a stylus input. According to an embodiment of the present disclosure, the electronic device 100 may display an outline indicating that the friend image 1440 is separated from the background. When the area within the displayed outline is touched for a predetermined time or longer, the electronic device 100 may recognize it as the user input 1450 .

Referring to 1400 - 2 of FIG. 14 , when the electronic device 100 receives the user input 1450 , the friend image 1460 from which the background is removed is displayed on the camera execution screen 1420 while the size is reduced. can In this case, the brightness of the preview image 1410 may be darkened. According to an embodiment of the present disclosure, when the user of the electronic device 100 desires to share an object through the messenger application, which is the second application, the user touches the image 1460 and the messenger application execution screen 1430 can be dragged to According to an embodiment of the present disclosure, when the user of the electronic device 100 stops touching the image 1460 on the messenger application execution screen 1430 (eg, a drop event), the image 1460 displays the messenger application. It may be transmitted to the electronic device (external device) of the counterpart with whom the communication is being performed.

15 is a diagram for describing an operation of an electronic device sharing an image of an object to an external device using an application for short-range wireless communication according to an embodiment of the present disclosure.

According to an embodiment of the present disclosure, the electronic device 100 may be a smartphone having a multi-window function. When the electronic device 100 has a multi-window function, the first application execution screen and the second application execution screen may be simultaneously displayed. In FIG. 15 , a case in which the first application is a camera application and the second application is an application for short-range wireless communication will be described as an example.

Referring to FIG. 15 , a user may want to take an image of a first friend and quickly share the image of the first friend from which the background is removed to the electronic device of the second friend using short-range wireless communication. In this case, the user may execute the camera application, which is the first application, with the electronic device 100 , and cause the preview image 1501 including the first friend to appear on the camera application execution screen 1502 of the electronic device 100 . have.

Referring to 1500 - 1 of FIG. 15 , the electronic device 100 may simultaneously display a camera execution screen 1502 and an interface screen 1503 for short-range wireless communication with an external device. According to an embodiment of the present disclosure, the electronic device 100 may receive a user input 1505 of touching the first friend image 1504 in the preview image 1501 for a predetermined time or longer. Although it is described that the user input 1505 is a touch input in FIG. 15 , it may be a voice input or a stylus input. According to an embodiment of the present disclosure, the electronic device 100 may display an outline indicating that the first friend image 1504 is separated from the background. When the area within the displayed outline is touched for a predetermined time or longer, the electronic device 100 may recognize it as the user input 1505 .

Referring to 1500 - 2 of FIG. 15 , when the electronic device 100 receives a user input 1505 , the first friend image 1506 with the background removed is displayed on the camera execution screen 1502 with a reduced size. can be displayed. In this case, the brightness of the preview image 1501 may be darkened. According to an embodiment of the present disclosure, when a user of the electronic device 100 desires to share an object through an application for short-range wireless communication that is a second application, the user touches the image 1506 while touching the image 1506 It can be dragged to the interface screen 1503 for wireless communication.

Referring to 1500-3 of FIG. 15 , on the interface screen 1503 for short-range wireless communication with an external device, a list of a plurality of counterparts with which an image 1506 can be shared is displayed with icons 1507 , 1508 , 1509 , 1510 , 1511) can be shown. In this case, the user of the electronic device 100 may touch and drag the image 1506 to the icon 1507 on which the second friend (eg, “Jacob”) to be shared is displayed.

According to an embodiment of the present disclosure, when the user of the electronic device 100 stops touching the image 1506 on the interface screen 1503 for short-range wireless communication (eg, a drop event), the image 1506 may be directly transmitted to the electronic device 300 of the second friend (eg, “Jacob”) through short-range wireless communication 1512 . Here, the short-range wireless communication 1512 may include WiFi, Bluetooth, UWB, and the like. In this case, WiFi is a technology that enables electronic devices to connect to a wireless LAN (WLAN), and can be used within a certain distance from a place where a wireless access device (AP) is installed. Bluetooth is a technology that enables short-distance data communication between electronic devices, and a user can send and receive digital information at a relatively low speed using Bluetooth. UWB (Ultra-wideband) is a wireless communication technology that can transmit large amounts of information with low power over a very wide band compared to the existing spectrum.

16 is a diagram for explaining an operation of an electronic device sharing an image and information of a QR code with an external device according to an embodiment of the present disclosure.

In FIG. 16 , a case in which the electronic device 100 is a smart phone having a multi-window function will be described as an example.

Referring to FIG. 16 , a user may want to photograph a QR code and share an image of the QR code and information related to the QR code with a friend. In this case, the user may execute the camera application of the electronic device 100 and cause the preview image 1610 including the QR code image to appear on the camera application execution screen 1620 of the electronic device 100 .

Referring to 1600 - 1 of FIG. 16 , the electronic device 100 may receive a user input 1650 for selecting the QR code 1640 in the preview image 1610 of the camera application execution screen 1620 .

Referring to 1600 - 2 of FIG. 16 , in response to a user input 1650 , the electronic device 100 may acquire QR code related information 1670 together with a QR code image 1660 from which the background is removed. In this case, the QR code-related information 1670 may include an email address, URL information, phone number, Wi-Fi password information, Mobile Hotspot setting value information, IoT device information, and the like. According to an embodiment, the electronic device 100 may obtain information 1670 related to the QR code by using a learning network model of an artificial intelligence (AI) system.

Referring to 1600-3 of FIG. 16 , when the electronic device 100 receives a user input 1650 , the image 1660 from which the background of the QR code 1640 is removed is reduced in size on the camera execution screen ( 1620). In addition, information 1670 related to the QR code may also be displayed on the camera execution screen 1620 in a pop-up form together with the image 1660 . According to an embodiment of the present disclosure, when the user of the electronic device 100 wants to share the image 1660 and the information 1670 through the messenger application, the user touches the image 1660 and the information 1670 . It can be dragged to the messenger application execution screen 1630 while holding it.

According to an embodiment of the present disclosure, when the user of the electronic device 100 stops touching the image 1660 and the information 1670 on the messenger application execution screen 1630 (eg, a drop event), the image 1660 ) and the information 1670 may be transmitted to an electronic device (external device) of the counterpart with whom the user is having a conversation using a messenger application.

According to an embodiment of the present disclosure, when URL information is included in the QR code 1640 , the image 1660 and the URL information may be transmitted together to the electronic device of the counterpart. In this case, the counterpart may preview the content contained in the QR code by tapping the received image 1660 on their electronic device. According to an embodiment of the present disclosure, when a Wi-Fi password is included in the QR code 1640 , the other party taps the received image 1660 on his/her electronic device to conveniently access the currently connected AP information and password. can be set. According to an embodiment of the present disclosure, when Mobile Hotspot information is included in the QR code 1640 , the counterpart can easily set the currently set AP information and password by tapping the received image 1660 . According to an embodiment of the present disclosure, when the user's profile information is included in the QR code 1640, the other party taps the received image 1660, such as the user's name, phone number, email, work, birthday, etc. information can be easily set. According to an embodiment of the present disclosure, when the user's health profile information is included in the QR code 1640, the other party taps the received image 1660 to use a health-related social networking service together with the user. You can easily set the type of exercise, the number of exercises, and InBody information. According to an embodiment of the present disclosure, when the QR code 1640 includes Internet of Things (IoT) device-related information, the other party taps the received image 1660, so that the IoT device (eg, a robot cleaner, TV, refrigerator, washing machine, AI speaker, etc.) can be easily set. According to an embodiment of the present disclosure, when cloud URL information is included in the QR code 1640 , the counterpart can easily share a large file from the cloud by tapping the received image 1660 . According to an embodiment of the present disclosure, when the smart phone setting value information is included in the QR code 1640 , the counterpart can easily set the smart phone by tapping the received image 1660 . According to an embodiment of the present disclosure, when the QR code 1640 includes group challenge invitation information for a health-related application, the other party taps the received image 1660 to create group information ( For example, a health trainer group, etc.) can be easily set.

According to an embodiment of the present disclosure, the user of the electronic device 100 simultaneously transmits the image of the QR code and information related to the QR code to the other party's electronic device (external device) without an additional operation of transmitting the information related to the QR code. can be transmitted

Referring to FIG. 17 , the information related to the QR code will be examined a little more.

17 is a diagram for explaining information related to a QR code according to an embodiment of the present disclosure.

In FIG. 17 , a case in which the first user transmits the image of the QR code and information related to the QR code to the second electronic device of the second user through the first electronic device will be described as an example.

Referring to FIG. 17 , information related to the QR code may include phone number information 1710 , email address information 1720 , URL information 1730 , address information 1740 , schedule information 1750 , and the like. However, the present invention is not limited thereto, and the QR code-related information may further include Wi-Fi password information, mobile hotspot information, health-related social networking service use information, Internet of Things (IoT) device-related information, and the like. .

According to an embodiment of the present disclosure, the information related to the QR code may be phone number information 1710 . At this time, when the second user, who has received the image and information of the QR code, taps the image of the QR code on his/her second electronic device, the second electronic device automatically executes the dial application and enters the phone number information 1710 . You can try to connect a call to the included phone number.

According to an embodiment of the present disclosure, the information related to the QR code may be email address information 1720 . At this time, when the second user, who has received the image and information of the QR code, taps the image of the QR code on his/her second electronic device, the second electronic device automatically executes the email application and sends the email address information 1720 to the user. You can send an email to the included email address.

According to an embodiment of the present disclosure, the information related to the QR code may be URL information 1730 . At this time, when the second user who has received the image and information of the QR code taps the image of the QR code on his/her second electronic device, the second electronic device opens the URL included in the URL information 1710 by executing the Internet. can

According to an embodiment of the present disclosure, the information related to the QR code may be address information 1740 . In this case, when the second user, who has received the image and information of the QR code, taps the image of the QR code on his/her second electronic device, the map application can be executed on the second electronic device and the information contained in the address information 1740 is You can run directions by address.

According to an embodiment of the present disclosure, the information related to the QR code may be schedule information 1750 . At this time, when the second user who has received the image and information of the QR code taps the image of the QR code on his/her second electronic device, the calendar application may be executed on the second electronic device, and the information included in the schedule information 1750 may be executed. Schedules can be recorded in the calendar application.

18 is a diagram for explaining an operation of an electronic device sharing an image and information of a document to an external device according to an embodiment of the present disclosure;

In FIG. 18 , a case in which the electronic device 100 is a smart phone having a multi-window function will be described as an example.

Referring to FIG. 18 , a user may wish to share an image (eg, a smartphone manual) of a specific document with a friend. In this case, the user may launch the camera of the electronic device 100 and cause a preview image including a specific document to appear on the display of the electronic device 100 .

Referring to 1800-1 of FIG. 18 , the electronic device 100 may receive a user input 1810 for selecting a document (object) in a preview image. Since the operation of the electronic device 100 receiving the user input 1810 has been described with reference to FIG. 14 , a detailed description thereof will be omitted.

Referring to 1800-2 of FIG. 18 , in response to a user input 1810 for selecting a document, the electronic device 100 may acquire document-related information 1830 together with a document image 1820 from which the background is removed. have. In this case, the document-related information 1830 may be text data obtained by reading a document using optical character recognition (OCR) technology. The OCR technology may be a technology that converts a character-shaped part in an image into a specific character code through a computational operation. According to an embodiment, the electronic device 100 may read a document using a learning network model of an artificial intelligence (AI) system.

Referring to 1800-3 of FIG. 18 , when a user of the electronic device 100 desires to share an image 1820 and information 1830 through a messenger application, the user transmits the image 1820 and information 1830 . While touching, it may be dragged to the messenger application execution screen 1630 .

According to an embodiment of the present disclosure, when the user of the electronic device 100 stops touching the image 1820 and the information 1830 on the messenger application execution screen (eg, a drop event), the image 1820 and the information 1830 may be transmitted to an electronic device (external device) of the counterpart with whom the user is having a conversation using a messenger application.

According to an embodiment of the present disclosure, the user of the electronic device 100 simultaneously transmits the image of the document and the text data to the other party's electronic device (external device) without going through a process of capturing the image of the document and converting it into text data. can be transmitted

19 is a diagram for describing an operation in which an electronic device shares object-related information with an external device according to an embodiment of the present disclosure.

Referring to FIG. 19 , a user may want to photograph a dog wearing a smart tag 1910 and share it with a friend through a messenger application. In this case, the user may execute a camera application of the electronic device 100 and make a puppy wearing the smart tag 1910 appear on the display of the electronic device 100 .

Referring to 1900 - 1 of FIG. 19 , when the user of the electronic device 100 photographs a puppy wearing the smart tag 1910 , the preview image 1920 contains information about the puppy received from the smart tag 1910 . (1940) may be displayed in a pop-up form. The electronic device 100 may receive the information 1940 about the dog from the smart tag 1910 through short-range wireless communication (eg, UWB, Bluetooth, Wi-Fi, etc.).

According to an embodiment of the present disclosure, the electronic device 100 may receive a user input 1950 for selecting a puppy 1930 in the preview image 1920 . For example, the electronic device 100 may receive an input of touching the puppy 1930 for a predetermined time or longer. According to an embodiment of the present disclosure, the electronic device 100 superimposes icons corresponding to a shared application (eg, a messenger application, an SNS application, etc.) on the lower portion of the preview image 1920 upon receiving the user input 1950 . can be displayed.

Referring to 1900 - 2 of FIG. 19 , in response to a user input 1950 , the electronic device 100 may acquire information related to a dog 1970 together with a dog image 1960 from which the background is removed. In this case, the dog-related information 1970 may include the dog's name, the dog's owner, the dog's address, and the like.

Referring to 1900 - 3 of FIG. 19 , the electronic device 100 may share an image 1960 and information 1970 . According to an embodiment of the present disclosure, the user of the electronic device 100 displays the image 1960 and the information 1970 by dragging the image 1960 and the information 1970 to the messenger application icon among the shared application icons while touching them. can share According to another embodiment, when the electronic device 100 receives the user input 1950, the preview screen 1920 of the camera application may be switched to the application execution screen previously executed by the user. In this case, the electronic device 100 may share the image 1960 and the information 1970 as the switched application. For example, when the user of the electronic device 100 is running the messenger application before the camera application is executed, the electronic device 100 transmits the image 1960 and information 1970 to the counterpart with whom the user is talking through the messenger application. can

20 is a diagram for explaining an operation of an electronic device sharing information related to an object to an external device by using an augmented reality (AR) technology according to an embodiment of the present disclosure.

According to an embodiment of the present disclosure, the electronic device 100 may be a smartphone using an application providing augmented reality (AR) technology. However, the present disclosure is not limited thereto, and the electronic device 100 of the present disclosure includes augmented reality glasses in the form of glasses worn on the user's face, and a head mounted display device (HMD) worn on the user's head. It may be a Mounted Display Apparatus, or an Augmented Reality Helmet.

Referring to 2000-1 of FIG. 20 , the user of the electronic device 100 is holding a balloon in which Japanese (“デザ?トの時間である!”) is written using an application providing augmented reality (AR) technology. A doll (2010) can be photographed. In this case, in the preview image 2020, the Japanese (“デザ?トの時間である!”) of the balloons may be translated and displayed in Korean (“dessert time!”).

According to an embodiment of the present disclosure, the user of the electronic device 100 may want to simultaneously share the image 2050 of the doll 2010 and the translation information 2060 for Japanese written on the balloon. According to an embodiment of the present disclosure, the user of the electronic device 100 may receive a user input 2040 for selecting the doll 2030 identified as an object in the preview image 2020 . For example, the electronic device 100 may receive an input of touching the doll 2030 identified as an object for a predetermined time or longer. According to an embodiment of the present disclosure, the electronic device 100 superimposes icons corresponding to a shared application (eg, a messenger application, an SNS application, etc.) on the lower portion of the preview image 2020 upon receiving the user input 2040 . can be displayed.

Referring to 2000-2 of FIG. 20 , in response to a user input 2040 , the electronic device 100 includes a doll image 2050 from which the background has been removed, along with the Japanese language (“デザ?ton”) written in the balloon held by the doll. It is possible to obtain translation information 2060 for TIME である!").

Referring to 2000-3 of FIG. 20 , the electronic device 100 may share an image 2050 and translation information 2060 . Here, the translation information 2060 may be shared in the form of text data. According to an embodiment of the present disclosure, the user of the electronic device 100 touches and drags the image 2050 and the translation information 2060 to the messenger application icon among the shared application icons, and thus the image 2050 and the translation information 2060 ) can be shared as an external device. According to another embodiment, upon receiving the user input 2040 , the electronic device 100 may share the image 2050 and the translation information 2060 to an external device through a messenger application that was running before the camera application. have.

21 is a diagram for describing an operation of an electronic device sharing object-related information to an external device by using virtual reality (VR) technology according to an embodiment of the present disclosure.

Referring to FIG. 21 , the electronic device 100 may be a Head Mounted Display Apparatus (HMD) that provides virtual reality (VR) technology. However, the present invention is not limited thereto, and may be virtual reality glasses in the form of glasses worn on the user's face or a bioimplantable device (eg, an implantable circuit).

Referring to 2100-1 of FIG. 21 , the electronic device 100 may display VR content 2020 for virtual reality. In this case, the user of the electronic device 100 may wish to share an image of a specific character 2030 among displayed VR contents with a friend. According to an embodiment of the present disclosure, the electronic device 100 may receive a user input 2040 for selecting a specific character 2030 on the VR content 2020 . In this case, the electronic device 100 may include at least one sensor for sensing the user's motion, and a specific character 2030 selected by the user based on at least one sensing value obtained from the at least one sensor. ) can be identified.

The user input 2040 for selecting a specific character may be a motion input or a voice input, and may be received by sensors included in the electronic device 100 .

According to an embodiment of the present disclosure, when the electronic device 100 identifies a specific character 2030 , the VR content 2020 may be blurred. In addition, only the specific character image 2050 from which the background is removed may be displayed on the VR content 2020 with the size reduced. According to an embodiment, the electronic device 100 may overlap and display icons (not shown) of shared applications at the bottom of the VR content 2020 . In this case, the user of the electronic device 100 may take a motion of dragging the image 2050 from which the background is removed to the messenger application icon among the icons of the shared applications.

Referring to 2100-2 of FIG. 21 , when the user of the electronic device 100 takes a motion of dragging the image 2050 to the messenger application icon, the messenger application execution screen 2060 is superimposed on the VR content 2020. can be displayed. According to an embodiment, when the user of the electronic device 100 stops the motion of dragging the image 2050 on the messenger application execution screen 2060 (eg, a drop event), the image 2050 uses the messenger application. to be transmitted to the electronic device (external device) of the other party with whom the user is having a conversation.

According to an embodiment of the present disclosure, the user of the electronic device 100 may share an image of a specific object on the VR screen with other users without capturing and editing the VR screen.

22 is a diagram for explaining an operation of sharing an object with an external device after an electronic device edits an object according to an embodiment of the present disclosure;

Referring to FIG. 22 , the electronic device 100 may edit an image of a specific object selected by a user within a preview image. According to an embodiment of the present disclosure, the electronic device 100 may receive an input of touching the friend 2210 for a predetermined time or longer in a preview image including the friend 2210 sitting on a bench. In this case, the electronic device 100 separates the image 2250 of the friend 2210 from the background in the preview image, and an editing application for editing the image 2250 of the friend 2210 (application 1-1) (2240) may be executed. The user of the electronic device 100 may create the edited image 2260 by editing the image 2210 of the friend 2210 displayed on the editing application 2240 . In this case, the editing may include giving an effect to the object, inputting text, creating a GIF file, adding an icon, and the like. For example, a user may say 'You're driving me crazy!' next to an image of a friend 2210. An edited image 2260 may be created by adding the phrase .

According to an embodiment of the present disclosure, the electronic device 100 may share the edited image 2260 with the electronic device of a friend through the messenger application (second application) 2270 . An operation in which the electronic device 100 shares an image through a user's drag input has been described in the description of FIG. 13 , so a description thereof will be omitted.

23 is a diagram for describing an operation of an electronic device sharing an object with an editing application according to an embodiment of the present disclosure;

Referring to FIG. 23 , the electronic device 100 may freely edit the image of a specific object selected by the user using the stylus pen 101 in the preview image 2310 using the editing application 2350 .

According to an embodiment of the present disclosure, the electronic device 100 may receive a user input 2330 for selecting the friend 2320 from the preview image including the friend 2320 sitting on a bench. In this case, the user input 2330 may be an input for selecting the friend 2320 while pressing the first button 102 of the stylus pen 101 . In this case, the electronic device 100 may separate the image 2340 of the friend 2320 from the background in the preview image 2310 .

According to an embodiment of the present disclosure, the user of the electronic device 100 may freely edit the image 2340 using the editing application 2350 . When the user of the electronic device 100 presses the second button 103 of the stylus pen 101 while selecting the friend 2320 , the editing application 2350 may be executed. The user of the electronic device 100 may freely edit the image 2340 using the stylus pen 101 in the editing application 2350 . In this case, the editing may include adding another image around the image 2340 , adding handwriting using the stylus pen 101 , adding an icon, adding a sticker, and the like.

24 and 25 are block diagrams for explaining an electronic device according to an embodiment of the present disclosure.

24 , the electronic device 100 according to an embodiment may include a display 2521 , a camera 2551 , a memory 2560 , and a processor 2510 . However, not all illustrated components are essential components. The electronic device 100 may be implemented by more components than the illustrated components, or the electronic device 100 may be implemented by fewer components.

For example, as shown in FIG. 25 , the electronic device 100 according to an embodiment includes a processor 2510 , an output unit 2520 , a communication unit 2530 , a user input unit 2540 , and an A/V input unit. 2550 and a memory 2560 may be included.

Hereinafter, the components will be described in turn.

The output unit 2520 is for outputting an audio signal, a video signal, or a vibration signal, and may include a display unit 2521 , a sound output unit 2522 , a vibration motor 2523 , and the like.

The sound output unit 2522 outputs audio data received from the communication unit 2530 or stored in the memory 2560 . Also, the sound output unit 2522 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, and a notification sound) performed by the electronic device 100 . The sound output unit 2522 may include a speaker, a buzzer, and the like.

The vibration motor 2523 may output a vibration signal. For example, the vibration motor 2523 may output a vibration signal corresponding to the output of audio data or video data (eg, a call signal reception sound, a message reception sound, etc.). Also, the vibration motor 2523 may output a vibration signal when a touch is input to the touch screen. The vibration motor 2523 may output a vibration signal when a specific subject is identified as an object by receiving a first input from the user.

The output unit 2520 may display a preview image including a subject recognized by the camera 2551 . The output unit 2520 may provide a focus indication in the preview image.

The output unit 2520 may also display information related to the subject in the preview image. For example, when the user of the electronic device 100 takes a picture of a puppy wearing a smart tag, information related to the puppy may be displayed.

The output unit 2520 may provide information on a plurality of applications supporting a sharing function.

The processor 2510 generally controls the overall operation of the electronic device 100 . For example, the processor 2510 executes programs stored in the memory 2560 , and thus the output unit 2520 , the communication unit 2530 , the user input unit 2540 , the A/V input unit 2550 , and the memory 2560 . You have total control over your back.

According to an embodiment, the processor 2510 may include an AI processor for generating a learning network model, but is not limited thereto. According to an embodiment, the AI processor may be implemented as a chip separate from the processor 2510 .

The processor 2510 may display a preview image obtained through the camera on the display. The processor 2510 may identify a subject in the preview image, and may display a focus on the identified subject. The processor 2510 may also display information related to the subject on the preview image.

The processor 2510 may receive a first input for selecting a region of interest in the preview image, and identify an object related to the region of interest in the preview image based on the first input. The processor 2510 may identify a subject that overlaps an area equal to or greater than a predetermined ratio of the area of interest as an object. The processor 2510 may mark an object in the preview image for identification.

The processor 2510 may receive a second input for sharing information related to an object, and transmit an image of the object and information related to the object to an external device based on the second input. The processor 2510 may display icons of a plurality of applications in response to the second input. The processor 2510 may transmit the object to the external device based on an input of dragging the object to the icon of a specific application from among the displayed icons. The processor 2510 may transmit information related to the object together with the image of the object to an external device.

The communication unit 2530 performs communication between the electronic device 100 and the server device 200 , the electronic device 100 and the external electronic device 300 , or the electronic device 100 and a device capable of transmitting information about a subject. It may include one or more components that For example, the communication unit 2530 may include a short-range communication unit 2531 , a mobile communication unit 2532 , and a broadcast receiving unit 2533 .

Short-range wireless communication unit 2531, Bluetooth communication unit, BLE (Bluetooth Low Energy) communication unit, short-range wireless communication unit (Near Field Communication unit), WLAN (Wi-Fi) communication unit, Zigbee (Zigbee) communication unit, infrared ( It may include an IrDA, infrared Data Association) communication unit, a Wi-Fi Direct (WFD) communication unit, an ultra wideband (UWB) communication unit, an Ant+ communication unit, and the like, but is not limited thereto.

The mobile communication unit 2532 transmits/receives wireless signals to and from at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to transmission/reception of a voice call signal, a video call signal, or a text/multimedia message.

The broadcast receiving unit 2533 receives a broadcast signal and/or broadcast related information from the outside through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. According to an embodiment, the electronic device 100 may not include the broadcast receiver 2533 .

According to an embodiment, the communication unit 2530 may transmit an image of an object and information related to the object to the external devices 200 and 300 . The communication unit 2530 may receive information related to an object from an external device (eg, a smart tag). The communication unit 2530 may upload an image of an object to an SNS server or download an image from the SNS server.

The A/V (Audio/Video) input unit 2550 is for inputting an audio signal or a video signal, and may include a camera 2551 , a microphone 2552 , and the like. The camera 2551 may obtain an image frame such as a still image or a moving image through an image sensor in a video call mode or a shooting mode. The image captured through the image sensor may be processed through the processor 2510 or a separate image processing unit (not shown).

The image frame processed by the camera 2551 may be stored in the memory 2560 or transmitted to the outside through the communication unit 2530 .

According to an embodiment, the camera 2551 may be at least one of a general camera, a telephoto camera, and a wide-angle camera, but is not limited thereto.

The microphone 2552 receives an external sound signal and processes it as electrical voice data. For example, the microphone 2552 may receive an acoustic signal from an external device or a speaker. The microphone 2552 may use various noise removal algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 2540 means a means for a user to input data for controlling the electronic device 100 . For example, the user input unit 2540 includes a key pad, a dome switch, and a touch pad (contact capacitive type, pressure resistance film type, infrared sensing method, surface ultrasonic conduction method, integral type). There may be a tension measurement method, a piezo effect method, etc.), a jog wheel, a jog switch, and the like, but is not limited thereto.

The memory 2560 may include a subject recommendation module 2561 , an affinity determination module 2562 , and an object manager module 2563 , and the object manager module 2563 includes an object determination module 2564 , and an object separation module 2565 . ), an object sharing module 2566 .

According to an embodiment, components included in the memory 2563 (eg, a subject recommendation module 2561 , an affinity determination module 2562 , an object determination module 2564 , an object separation module 2565 , and/or The object sharing module 2566) may be included in the processor 2510 as a hardware structure (or a hardware module (eg, circuitry)) in addition or alternatively to a software structure.

The subject recommendation module 2561 may store instructions for recognizing subjects in the preview image 450 by the camera of the electronic device 100 executing an intelligent function, and displaying a recommended focus on the recognized subject. .

The intimacy determination module 2562 is configured to determine a degree of obtaining information based on the intimacy between the electronic device 100 and the object-related device when the electronic device 100 obtains the object-related information from the object-related device. To this end, instructions for determining the intimacy between the electronic device 100 and the device related to the object may be stored.

The object determination module 2564 may store instructions for determining the specific subject as an object when the ratio of the specific subject in the ROI according to the first input is equal to or greater than a predetermined ratio.

The object separation module 2565 may store instructions for separating an object determined in the preview image from a background, and identifying the separated object in the preview image.

The object sharing module 2566 may store an image of an object or instructions for sharing an image of an object and information related to an object in an external device through a sharing application selected by a user.

The memory 2560 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory), and a RAM. (RAM, Random Access Memory) SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk , may include at least one type of storage medium among optical disks.

Functions related to artificial intelligence according to the present disclosure are operated through a processor and a memory. The processor may consist of one or a plurality of processors. In this case, the one or more processors may be a general-purpose processor such as a CPU, an AP, a digital signal processor (DSP), or the like, a graphics-only processor such as a GPU, a VPU (Vision Processing Unit), or an artificial intelligence-only processor such as an NPU. One or a plurality of processors control to process input data according to a predefined operation rule or artificial intelligence model stored in the memory. Alternatively, when one or more processors are AI-only processors, the AI-only processor may be designed with a hardware structure specialized for processing a specific AI model.

The predefined action rule or artificial intelligence model is characterized in that it is created through learning. Here, being made through learning means that a basic artificial intelligence model is learned using a plurality of learning data by a learning algorithm, so that a predefined action rule or artificial intelligence model set to perform a desired characteristic (or purpose) is created means burden. Such learning may be performed in the device itself on which artificial intelligence according to the present disclosure is performed, or may be performed through a separate server and/or system. Examples of the learning algorithm include, but are not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning.

The artificial intelligence model may be composed of a plurality of neural network layers. Each of the plurality of neural network layers has a plurality of weight values, and a neural network operation is performed through an operation between an operation result of a previous layer and a plurality of weights. The plurality of weights of the plurality of neural network layers may be optimized by the learning result of the artificial intelligence model. For example, a plurality of weights may be updated so that a loss value or a cost value obtained from the artificial intelligence model during the learning process is reduced or minimized. The artificial neural network may include a deep neural network (DNN), for example, a Convolutional Neural Network (CNN), a Deep Neural Network (DNN), a Recurrent Neural Network (RNN), a Restricted Boltzmann Machine (RBM), There may be a Deep Belief Network (DBN), a Bidirectional Recurrent Deep Neural Network (BRDNN), or a Deep Q-Networks, but is not limited to the above-described example.

26 is a diagram for describing a software module stored in a memory according to an embodiment of the present disclosure.

Referring to FIG. 26 , the system according to an embodiment of the present disclosure includes an application layer 2610 , a framework layer 2620 , a hardware abstraction layer 2630 , a kernel layer 2640 , and a hardware layer 2650 . can However, the present invention is not limited thereto, and at least some of the illustrated configurations may be changed depending on the platform included in the electronic device 100 .

The application layer 2610 according to an embodiment of the present disclosure may include applications 2611 and a system user interface 2612 .

The framework layer 2620 according to an embodiment of the present disclosure includes a window manager 2621 , an object manager module 2563 , a view system 2622 , an activity manager 2623 , a sensor manager 2624 , and a stylus pen motion detection A manager 2625 may be included.

When a state change of the electronic device 100 is identified through the sensor manager 2624 , the window manager 2621 according to an embodiment may transmit information corresponding to the changed state of the electronic device to the applications 2611 . The view system 2622 according to an embodiment may display at least one layer on the display of the electronic device 100 . The object manager module 2563 according to an embodiment may determine an object among subjects in the preview image, and separate and share the determined object.

The hardware abstraction layer 2630 according to an embodiment of the present disclosure may include an event hub 2631 and a service flinger 2632 . The hardware abstraction layer 2630 according to an embodiment may mean an abstraction layer between a plurality of hardware modules included in the hardware layer and software of the electronic device 100 .

The kernel layer 2640 according to an embodiment of the present disclosure may include a sensor driver 2641 , a Bluetooth controller 2642 , and a display controller 2643 . The kernel layer 2640 according to an embodiment may include various drivers for controlling various hardware modules included in the electronic device 100 .

The hardware layer 2650 according to an embodiment of the present disclosure may include a sensor controller 2651 and a display panel 2642 . The hardware layer 2650 according to an embodiment may identify a state change of the electronic device 100 based on the sensor controller 2651 .

According to an embodiment of the present disclosure, the electronic device 100 may directly transmit the object image from which the background is removed to the external device without going through a process of removing the background by capturing the object after capturing it. In particular, according to an embodiment of the present disclosure, since the electronic device 100 simultaneously transmits an image of an object and information related to the object, an additional operation for transmitting information related to the object may not be required.

The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory storage medium' is a tangible device and only means that it does not contain a signal (eg, electromagnetic wave). It does not distinguish the case where it is stored as For example, the 'non-transitory storage medium' may include a buffer in which data is temporarily stored.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided in a computer program product (computer program product). Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store ^TM ) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly, online between smartphones (eg: smartphones). In the case of online distribution, at least a portion of the computer program product (eg, a downloadable app) is stored at least in a machine-readable storage medium, such as a memory of a manufacturer's server, a server of an application store, or a relay server. It may be temporarily stored or temporarily created.

Although the embodiments of the present disclosure have been described in detail above, the scope of the present disclosure is not limited thereto, and various modifications and improved forms of the present disclosure are also provided by those skilled in the art using the basic concept of the present disclosure as defined in the following claims. belong to the scope of the right.

Claims (20)

A method for an electronic device to share information with an external device, the method comprising:
displaying a preview image acquired through a camera;
receiving a first input for selecting a region of interest in the preview image;
identifying an object associated with the region of interest in the preview image based on the first input;
receiving a second input for sharing an image of the object; and
and transmitting an image of the object and information related to the object to the external device based on the second input. The method of claim 1 , wherein identifying the object related to the region of interest in the preview image comprises:
isolating the object from a background within the preview image. The method of claim 1, wherein the displaying of the preview image comprises:
Displaying the preview image through the execution screen of the first application,
The operation of transmitting the image of the object and information related to the object to the external device includes:
and transmitting the image of the object and information related to the object to the external device through a second application different from the first application. The method of claim 3, wherein transmitting the image of the object and information related to the object to the external device comprises:
and processing an image of the object and information related to the object based on a data format supported by the second application. The method of claim 3, wherein the receiving of the second input comprises:
and receiving an input of dragging the object from the preview image to an execution screen of the second application while touching the object. The method of claim 3, wherein the receiving of the second input comprises:
displaying icons corresponding to each of a plurality of applications supporting a data sharing function as the object is touched in the preview image; and
and dragging the object onto an icon corresponding to the second application from among the icons. 6. The method of claim 5,
The execution screen of the second application includes an interface screen for short-range wireless communication with the external device,
The operation of transmitting the image of the object and information related to the object to the external device includes:
and transmitting the image of the object and information related to the object to another user's mobile device through the short-range wireless communication. The method of claim 1, wherein the method comprises:
The method further comprising receiving information related to the object from a device connected to the object. The method of claim 8, wherein the receiving of the information related to the object comprises:
A method for receiving information related to the object from a device connected to the object through ultra wideband (UWB) communication. According to claim 1, wherein the object,
contains a two-dimensional code;
The transmitting operation is
and transmitting an image of the two-dimensional code and access address information related to the two-dimensional code. display;
camera;
a communication unit communicating with an external device;
a memory storing one or more instructions; and
a processor executing the one or more instructions stored in the memory;
The processor is
displaying a preview image obtained through the camera on the display,
receiving a first input for selecting a region of interest in the preview image;
identify an object associated with the region of interest in the preview image based on the first input;
receiving a second input for sharing an image of the object;
and transmitting the image of the object and information related to the object to the external device based on the second input. The method of claim 11 , wherein the processor comprises:
separating the object from a background in the preview image. The method of claim 11 , wherein the processor comprises:
Displaying the preview image through an execution screen of a first application, and transmitting the image of the object and information related to the object to the external device through a second application different from the first application. 14. The method of claim 13, wherein the processor,
An electronic device that processes an image of the object and information related to the object based on a data format supported by the second application. 14. The method of claim 13, wherein the processor,
receiving, as the second input, an input of dragging the object from the preview image to the execution screen of the second application while touching the object. 14. The method of claim 13, wherein the processor,
As the object is touched in the preview image, icons corresponding to each of a plurality of applications supporting a data sharing function are displayed on the display,
and receiving an input of dragging the object onto an icon corresponding to the second application from among the icons as the second input. 16. The method of claim 15,
The execution screen of the second application includes an interface screen for short-range wireless communication with the external device,
The processor is
An electronic device for transmitting an image of the object and information related to the object to another user's mobile device through the short-range wireless communication. The method of claim 11, wherein the communication unit,
An electronic device that receives information related to the object from a device connected to the object. The method of claim 11, wherein the object,
contains a two-dimensional code;
The processor is
An electronic device for transmitting an image of the two-dimensional code and access address information related to the two-dimensional code. displaying a preview image acquired through a camera;
receiving a first input for selecting a region of interest in the preview image;
identifying an object associated with the region of interest in the preview image based on the first input;
receiving a second input for sharing information related to the object; and
A computer-readable recording medium storing a program for transmitting an image of the object and information related to the object to an external device based on the second input.

Images