WO2022065663A1

WO2022065663A1 - Electronic device and control method thereof

Info

Publication number: WO2022065663A1
Application number: PCT/KR2021/009866
Authority: WO
Inventors: 장성현; 정성욱
Original assignee: 삼성전자(주)
Priority date: 2020-09-25
Filing date: 2021-07-29
Publication date: 2022-03-31
Also published as: KR20220041630A

Abstract

The present invention relates to an electronic device which obtains a user image via a camera, identifies a reference body area of a user in the user image, identifies, on the basis of a screen size of a display to display the user image, the size of the reference body area in the user image to be displayed on the display, and enlarges or reduces the user image to be displayed on the display so that the size of the reference body area corresponds to a reference size.

Description

Electronic device and its control method

This application claims priority based on Korean Patent Application No. 10-2020-0125142 filed with the Korean Intellectual Property Office on September 25, 2020, the disclosure of which is incorporated herein by reference in its entirety.

The present invention relates to an electronic device and a method for controlling the same, and more particularly, to an electronic device for enlarging or reducing a user image and a method for controlling the same.

Recently, electronic devices provide a video call function. The video call function is a function that provides convenience for the user to talk with the other party while viewing the user image or the other party image by displaying the user's image of the user or the other party's image on the screen of the electronic device. In the case of plural counterparts, a multi-party video conference is also possible while viewing the images of the plurality of counterparts.

When performing a video call function, the user in the user image or the counterpart in the counterpart image may not be displayed in a predetermined size. The predetermined size includes the actual body size of the user or the other party. In this case, the electronic device enlarges or reduces the user image or the counterpart image so that the user in the user image or the counterpart in the counterpart image is displayed in the actual body size of the user or the counterpart. Since the user can make a video call while looking at the user or the other party displayed in actual body size, the user can have a more lively conversation and can concentrate more on the conversation.

The electronic device utilizes the reference information in enlarging or reducing the user image or the counterpart image. For example, the reference information may include information about the actual body size of the user or the other party. However, since the body size is different for each user or for each counterpart, convenience and efficiency may be reduced in that reference information must be input one by one or received from the outside.

Therefore, in order to display the user in the user image or the counterpart in the counterpart image in the actual body size of the user or the other party, by excluding unnecessary processes in enlarging or reducing the user image or the counterpart image, convenience and efficiency can be improved. A solution is being requested.

An object of the present invention is to increase convenience and efficiency by excluding unnecessary processes in enlarging or reducing a user image or a counterpart image in order to display the user in the user image or the counterpart in the counterpart image in the actual body size of the user or the counterpart. An object of the present invention is to provide an electronic device capable of improving and a method for controlling the same.

An object of the present invention is to obtain a user image through a camera, identify a reference body region of the user in the user image, and a user image to be displayed on the display based on the screen size of the display on which the user image is to be displayed Electronic including a processor for identifying the size of the reference body region and enlarging or reducing the user image to be displayed on the display so that the size of the reference body region corresponds to a reference size defined based on reference bodies of a plurality of users can be achieved by the device.

The reference body region includes a region corresponding to the user's iris.

The processor obtains the user image from an external device, and performs an operation related to a video call based on the received user image.

The user image includes a plurality of user images, and the processor enlarges or reduces the plurality of user images displayed on the display so that the reference body regions of the plurality of users in the plurality of user images have the same size.

The processor may reduce the user image so that the main region corresponds to the screen size when the main region of the user image corresponding to the reference body region corresponds to the reference size exceeds the screen size of the display.

The user image includes a user region including the reference body region and a background region, and the processor enlarges the user image so that the reference body region corresponds to the reference size while maintaining the size of the background region. or reduce

The processor identifies a position of the reference body region, and moves the user image so that the position of the reference body region corresponds to a reference position defined in the screen of the display.

The processor identifies the degree of participation of the user based on a change in the user area corresponding to the user in the user image, and enlarges or reduces the user image based on the identified degree of participation.

The processor identifies a gaze direction of the user based on a change in a user area corresponding to the user in the user image, and moves the user image according to the identified gaze direction.

The processor adjusts the reference size based on the user's viewing distance, and enlarges or reduces the user image so that the size of the reference body region corresponds to the adjusted reference size.

The processor enlarges or reduces the user image so that a reference body region selected based on a priority among a plurality of reference body regions corresponds to the reference size.

The processor sets the priority based on a user input.

An object of the present invention is to obtain a user image; identifying a reference body region of the user in the user image; identifying the size of the reference body region in the user image to be displayed on the display based on the screen size of the display on which the user image is to be displayed; and enlarging or reducing the user image to be displayed on the display so that the size of the reference body region corresponds to the reference size defined based on the reference body of a plurality of users. .

The obtaining of the user image may include: obtaining the user image from an external device; and performing an operation related to a video call based on the received user image.

The user image includes a plurality of user images, and the step of enlarging or reducing the user image includes a plurality of user images displayed on the display such that the sizes of reference body regions of the plurality of users in the plurality of user images are the same. Including the step of enlarging or reducing the.

The step of enlarging or reducing the user image may include, when a main region of the user image corresponding to the reference body region of the reference size exceeds the screen size of the display, the main region corresponds to the screen size. and reducing the user image.

The user image includes a user region including the reference body region and a background region, and the step of enlarging or reducing the user image includes maintaining the size of the background region, and adjusting the reference body region to the reference size. and enlarging or reducing the user image to correspond to it.

The method may further include identifying a position of the reference body region, wherein the enlarging or reducing the user image includes moving the user image so that the position of the reference body region corresponds to a defined reference position within the screen of the display. including the steps of

An object of the present invention is to provide a computer-readable code, comprising the steps of: acquiring a user image; identifying a reference body region of the user in the user image; identifying the size of the reference body region in the user image to be displayed on the display based on the screen size of the display on which the user image is to be displayed; and enlarging or reducing the user image to be displayed on the display so that the size of the reference body region corresponds to the reference size defined based on the reference body of a plurality of users. It can also be achieved by a recorded recording medium.

According to the present invention, convenience and efficiency are improved by excluding unnecessary processes in enlarging or reducing the user image or the counterpart image in order to display the user in the user image or the counterpart in the counterpart image in the actual body size of the user or the counterpart. It is possible to provide an electronic device capable of performing the operation and a method for controlling the same.

1 illustrates an electronic device according to an embodiment of the present invention.

FIG. 2 shows an example of the configuration of the electronic device of FIG. 1 .

FIG. 3 shows an example of a control method for the electronic device of FIG. 1 .

FIG. 4 shows a specific example of identifying a reference body region in relation to operation S32 of FIG. 3 .

FIG. 5 shows a specific example of identifying the size of a reference body region in relation to operation S33 of FIG. 3 .

6 illustrates an additional example of acquiring a counterpart image in relation to operation S31 of FIG. 3 .

7 illustrates an additional example of acquiring a user image and a counterpart image together with respect to operation S31 of FIG. 3 .

8 illustrates another example of enlarging or reducing a user image and a counterpart image in the case of a vertical display in relation to operation S34.

FIG. 9 shows an additional example of identifying a main region in relation to operation S34 of FIG. 3 .

10 illustrates an example of additionally identifying a background region in addition to the operation of identifying a reference body region in relation to operation S32 of FIG. 3 .

11 shows an example of enlarging or reducing the user image based on the position of the reference body region in addition to the operation of enlarging or reducing the user image based on the size of the reference body region in relation to operation S32 of FIG. 3 do.

12 shows an example of enlarging or reducing the user image based on the user's participation in addition to the operation of enlarging or reducing the user image based on the size of the reference body region in relation to the embodiment of FIG. 3 . do.

13 is an example of enlarging or reducing the user image based on the gaze direction of the user area in addition to the operation of enlarging or reducing the user image based on the size of the reference body region in relation to the embodiment of FIG. show

FIG. 14 shows an example of enlarging or reducing the user image based on the user viewing distance in addition to the operation of enlarging or reducing the user image based on the size of the reference body region in relation to the embodiment of FIG. 3 . .

15 shows an alternative example of selecting a reference body region according to priority in relation to operation S32 of FIG. 3 .

FIG. 16 shows a specific example of setting the priority of a reference body region based on a user input with reference to FIG. 15 .

Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings. In the description of the embodiments below, reference is made to the matters described in the accompanying drawings, and the same reference numbers or symbols presented in each drawing indicate components that perform substantially the same operation. In the present specification, at least one of a plurality of components refers to all of the plurality of components, as well as each one or a combination thereof excluding the rest of the plurality of components.

As shown in FIG. 1 , the electronic device 10 is a set-top that does not include a display 12 as well as an image display device such as a TV, a smart phone, a tablet, a portable media player, a wearable device, a video wall, an electronic picture frame, etc. It is implemented with various types of devices, such as image processing devices such as boxes, household appliances such as refrigerators and washing machines, and information processing devices such as computer bodies. In addition, the electronic device 10 is implemented as an AI speaker, an AI robot, etc. equipped with an artificial intelligence (AI) function. The type of the electronic device 10 is not limited thereto. Hereinafter, for convenience of description, it is assumed that the electronic device 10 is implemented as a TV.

The electronic device 10 may perform a video call function. The video call function displays the user image 3 photographing the user 1 or the counterpart image 9 in FIG. It is a function that provides convenience to talk with the other party 7 while viewing the user area 2 in the user image 3 or the counterpart area (8 in FIG. 6 ) in the counterpart image 9 . The user area 2 includes an area 2 within the user image 3 corresponding to the user 1 , and the counterpart area 8 includes an area 8 within the counterpart image 9 corresponding to the counterpart 7 . includes The user image 3 may be acquired through the camera 13 of the electronic device 10 , and the counterpart image 9 may be acquired from an external device ( 20 in FIG. 6 ).

The electronic device 10 enlarges or reduces the user image 3 . The size of the user area 2 in the user image 3 may exceed or fall short of a predetermined size. Hereinafter, for convenience of description, it is assumed that the predetermined size includes the actual body size of the user 1 . However, since the present invention is not limited thereto, the predetermined size may be variously set.

The electronic device 10 enlarges or reduces the user image 3 so that the size of the user area 2 in the user image 3 corresponds to the body size of the user 1 . The enlargement or reduction of the user image 3 will be described in detail with reference to FIG. 4 and the like. Similarly, the electronic device 10 enlarges or reduces the counterpart image 9 so that the size of the counterpart region 8 in the counterpart image 9 corresponds to the actual body size of the counterpart 7 . This will be described with reference to FIG. 6 and the like.

In this way, the user image 3 or the counterpart image so that the user region 2 in the user image 3 or the counterpart region 8 in the counterpart image 9 is displayed in the body size of the user 1 or the counterpart 7 Since (9) can be enlarged or reduced, it is possible to provide liveliness during a video call, and to create an environment where you can focus more on conversation.

Hereinafter, the configuration of the electronic device 10 will be described in detail with reference to FIG. 2 . Although the present embodiment describes a case where the electronic device 10 is a TV, the electronic device 10 may be implemented as various types of devices, and thus the present embodiment does not limit the configuration of the electronic device 10 . It is also possible that the electronic device 10 is not implemented as a display device such as a TV. In this case, the electronic device 10 may not include components for displaying an image, such as the display 12 . For example, when the electronic device 10 is implemented as a set-top box, the electronic device 10 outputs an image signal to an external TV through the interface unit 11 .

The electronic device 10 includes an interface unit 11 . The interface unit 11 is connected to the external device 20 and the like to transmit and receive data. However, since the present invention is not limited thereto, the interface unit 11 connects to various devices connected through a network.

The interface unit 11 includes a wired interface unit. The wired interface unit includes a connector or port to which an antenna capable of receiving a broadcast signal according to a broadcasting standard such as terrestrial/satellite broadcasting is connected, or a cable capable of receiving a broadcast signal according to the cable broadcasting standard is connected. As another example, the electronic device 10 may have a built-in antenna capable of receiving a broadcast signal. The wired interface unit includes a connector or port according to video and/or audio transmission standards, such as HDMI port, DisplayPort, DVI port, Thunderbolt, Composite video, Component video, Super Video, SCART, etc. includes The wired interface unit includes a connector or port according to a universal data transmission standard such as a USB port. The wired interface unit includes a connector or a port to which an optical cable can be connected according to an optical transmission standard.

The wired interface unit includes an internal audio receiver. The wired interface unit is connected to an external audio device having an audio receiver and includes a connector or a port capable of receiving or inputting an audio signal from the audio device. The wired interface unit is connected to an audio device such as a headset, earphone, or external speaker, and includes a connector or port capable of transmitting or outputting an audio signal to the audio device. The wired interface unit includes a connector or port according to a network transmission standard such as Ethernet. For example, the wired interface unit is implemented as a LAN card connected to a router or a gateway by wire.

The wired interface unit is connected to an external device such as a set-top box, an optical media player, or an external display device, a speaker, a server, etc. in a 1:1 or 1:N (N is a natural number) method through the connector or port, so that the corresponding It receives a video/audio signal from an external device or transmits a video/audio signal to the corresponding external device. The wired interface unit may include a connector or a port for separately transmitting video/audio signals.

The wired interface unit may be embedded in the electronic device 10 , or implemented in the form of a dongle or a module to be detachably attached to the connector of the electronic device 10 .

The interface unit 11 includes a wireless interface unit. The wireless interface unit is implemented in various ways corresponding to the implementation form of the electronic device 10 . For example, the wireless interface unit uses wireless communication such as RF (Radio Frequency), Zigbee, Bluetooth, Wi-Fi, UWB (Ultra-Wideband) and NFC (Near Field Communication) as a communication method. . The wireless interface unit is implemented as a wireless communication module for performing wireless communication with the AP according to the Wi-Fi method or a wireless communication module for performing one-to-one direct wireless communication such as Bluetooth.

The wireless interface unit transmits and receives data packets by wirelessly communicating with the external device 20 on the network. The wireless interface unit includes an IR transmitter and/or an IR receiver capable of transmitting and/or receiving an IR (Infrared) signal according to an infrared communication standard.

The wireless interface unit receives or inputs a remote controller signal from the remote controller or other external device through the IR transmitter and/or the IR receiver, or transmits or outputs a remote controller signal to the remote controller or other external device. As another example, the electronic device 10 transmits/receives a remote controller signal to and from a remote controller or other external device through a wireless interface unit of another method such as Wi-Fi or Bluetooth.

The remote controller includes a smart phone and the like, and a remote controller application is installed on the smart phone or the like. A smartphone or the like performs a function of a remote controller, for example, a function of controlling the electronic device 10 through an installed application. These remote controller applications are installed in various external devices such as AI speakers and AI robots.

When the video/audio signal received through the interface unit 11 is a broadcast signal, the electronic device 10 further includes a tuner for tuning the received broadcast signal for each channel.

The electronic device 10 includes a display 12 . The display 12 includes a display panel capable of displaying an image on a screen. The display panel may have various screen sizes. For example, it may be provided in various forms having different screen sizes, such as a vertical type and a horizontal type. The display panel is provided with a light-receiving structure such as a liquid crystal type or a self-luminous structure such as an OLED type. The display 12 may further include additional components according to the structure of the display panel. For example, if the display panel is a liquid crystal type, the display 12 includes a liquid crystal display panel, a backlight unit for supplying light, and liquid crystal. and a panel driving substrate for driving the liquid crystal of the display panel. However, as described above, the display 12 is omitted when the electronic device 10 is implemented as a set-top box or the like.

The electronic device 10 includes a camera 13 . The camera 13 photographs the front of the electronic device 10 . The user area 2 in the user image 3 may be identified based on the image captured by the camera 13 . However, since the present invention is not limited thereto, the presence or absence of the user area 2 in the user image 3 and the movement of the user 1 may be identified. The camera 13 is implemented as a complementary metal oxide semiconductor (CMOS) or a charge coupled device (CCD) type camera. Since the camera 13 is not limited to the internal camera 13, it includes a camera provided in an external device. In this case, an image signal obtained by the camera from an external device may be received or input through the interface unit 11 .

The electronic device 10 includes a communication unit 15 . The communication unit 15 is connected to the external device 20 and the like to transmit video/audio signals. The communication unit 15 includes at least one of a wired interface unit and a wireless interface according to a design method, and performs at least one function of the wired interface unit and the wireless interface.

The electronic device 10 includes a user input unit 14 . The user input unit 14 includes various types of input interface related circuits provided to be operated by the user 1 in order to receive a user input. The user input unit 14 may be configured in various forms depending on the type of the electronic device 10 , for example, a mechanical or electronic button unit of the electronic device 10 , a touch pad, a touch screen installed on the display 12 , etc. There is this.

The electronic device 10 includes an output unit 16 . The output unit 16 may be implemented as a speaker that outputs audio based on an audio signal. The speaker includes an internal speaker or an external speaker provided in an external device. When audio is output through the external speaker, the audio signal may be transmitted to the external device through the interface unit 11 .

The display 12 , the camera 13 , the user input unit 14 , the communication unit 15 , the output unit 16 , etc. have been described as separate components from the interface unit 11 , but the interface unit 11 according to the design method It can be configured to be included in

The electronic device 10 includes a storage unit 17 . The storage unit 17 stores digitized data. The storage unit 17 includes storage of non-volatile properties capable of preserving data regardless of whether or not power is provided. The storage includes a flash memory, a hard-disc drive (HDD), a solid-state drive (SSD), a read only memory (ROM), and the like.

The storage unit 17 is loaded with data to be processed by the processor 4 , and includes a memory having a volatile property that cannot store data when power is not provided. The memory includes a buffer, a random access memory, and the like.

The electronic device 10 includes a processor 4 . The processor 4 includes one or more hardware processors implemented as a CPU, a chipset, a buffer, a circuit, etc. mounted on a printed circuit board, and may be implemented as a system on chip (SOC) depending on a design method. When the electronic device 10 is implemented as a display device, the processor 4 includes modules corresponding to various processes such as a demultiplexer, a decoder, a scaler, an audio digital signal processor (DSP), and an amplifier. Here, some or all of these modules are implemented as SOC. For example, a module related to image processing such as a demultiplexer, a decoder, and a scaler may be implemented as an image processing SOC, and an audio DSP may be implemented as a chipset separate from the SOC.

The processor 4 identifies the reference body region ( 5 in FIG. 4 ) of the user region 2 in the user image 3 .

The processor 4 determines the size of the reference body region 5 in the user image 3 to be displayed on the display 12 based on the screen size (w in FIG. 5 ) of the display 12 on which the user image 3 is to be displayed. (FIG. 4 a) is identified.

The processor 4 enlarges or reduces the user image 3 to be displayed on the display 12 so that the size a of the reference body region 5 corresponds to the reference size defined based on the reference body of a plurality of users.

Since the configuration of the electronic device 10 is not limited to that shown in FIG. 2 , some of the above-described components may be excluded or include components other than the above-described components according to a design method.

The processor 4 of the electronic device 10 builds an AI system by applying an AI technology using a rule-based or AI algorithm to at least a part of data analysis, processing, and result information generation for the above operations.

The AI system is a computer system that implements human-level intelligence, and the machine learns and judges on its own, and the recognition rate improves the more it is used.

AI technology is composed of elemental technologies that simulate functions such as cognition and judgment of the human brain using at least one of machine learning, a neural network, or a deep learning algorithm.

The element technologies are linguistic understanding technology that recognizes human language/text, visual understanding technology that recognizes objects as if they were human eyes, reasoning/prediction technology that logically infers and predicts by judging information, and uses human experience information as knowledge data. It may include at least one of a knowledge expression technology that is processed with

Linguistic understanding is a technology for recognizing and applying/processing human language/text, and includes natural language processing, machine translation, dialogue system, question and answer, and speech recognition/synthesis. Visual understanding is a technology for recognizing and processing objects like human vision, and includes object recognition, object tracking, image search, human recognition, scene understanding, spatial understanding, image improvement, and the like. Inferential prediction is a technology for logically reasoning and predicting by judging information, and includes knowledge/probability-based reasoning, optimization prediction, preference-based planning, and recommendation. Knowledge expression is a technology that automatically processes human experience information into knowledge data, and includes knowledge construction (data generation/classification) and knowledge management (data utilization).

Hereinafter, an example in which the AI technology using the AI algorithm is implemented by the processor 4 of the electronic device 10 will be described.

The processor 4 performs the functions of the learning unit and the recognition unit together. The learning unit performs a function of generating a learned neural network network, and the recognition unit performs a function of recognizing, inferring, predicting, estimating, and judging data using the learned neural network network.

The learning unit creates or updates the neural network. The learning unit acquires learning data to generate a neural network. For example, the learning unit acquires the learning data from the storage unit 17 or from the outside. The learning data may be data used for learning of the neural network, and the neural network may be trained by using the data obtained by performing the above-described operation as learning data.

The learning unit performs preprocessing on the acquired training data before training the neural network using the training data, or selects data to be used for learning from among a plurality of training data. For example, the learning unit processes the learning data in a preset format, filters, or adds/remove noise to form data suitable for learning. The learning unit generates a neural network set to perform the above-described operation by using the pre-processed learning data.

The learned neural network is composed of a plurality of neural network networks or layers. Nodes of the plurality of neural networks have weights, and the plurality of neural networks are connected to each other so that an output value of one neural network is used as an input value of another neural network. Examples of neural networks include Convolutional Neural Network (CNN), Deep Neural Network (DNN), Recurrent Neural Network (RNN), Restricted Boltzmann Machine (RBM), Deep Belief Network (DBN), Bidirectional Recurrent Deep Neural Network (BRDNN) and Including models such as Deep Q-Networks.

Meanwhile, the recognition unit acquires target data to perform the above-described operation. The target data is acquired from the storage unit 17 or is acquired from the outside. The target data may be data to be recognized by the neural network. The recognition unit performs preprocessing on the acquired target data before applying the target data to the learned neural network, or selects data to be used for recognition from among a plurality of target data. For example, the recognition unit processes target data into a preset format, filters, or adds/remove noise to form data suitable for recognition. The recognition unit obtains an output value output from the neural network by applying the preprocessed target data to the neural network. The recognition unit obtains a probability value or a reliability value together with the output value.

As shown in FIG. 3 , the processor 4 identifies the reference body region 5 of the user region 2 in the user image 3 ( S31 ).

The processor 4 determines the size (a) of the reference body region 5 in the user image 3 to be displayed on the display 12 based on the screen size w of the display 12 on which the user image 3 is to be displayed. is identified (S32).

The processor 4 enlarges or expands the user image 3 to be displayed on the display 12 so that the size (a) of the reference body region 5 corresponds to the reference size (b) defined based on the reference body of a plurality of users. Reduced (S33).

In this way, the processor 4 identifies the size (a) of the reference body region 5 of the user region 2 based on the user image 3, and the size (a) of the reference body region 5 is the reference The user image 3 may be enlarged or reduced to correspond to the size b. Accordingly, since it is not necessary to obtain reference information used in enlarging or reducing the user image 3 from the user or the outside, convenience and efficiency can be improved.

The processor 4 identifies the reference body region 5 of the user region 2 in the user image 3 . The reference body region 5 may include a region 5 corresponding to the iris of the user region 2 . The iris performs the function of controlling the amount of light entering the eyeball. The region 5 corresponding to the iris has a circular or oval shape, and shares an external boundary with the white part of the eyeball externally, and shares an internal boundary with the pupil, the black part of the eyeball, internally. However, since the reference body region 5 is not limited to the region 5 corresponding to the iris, other body regions of the user region 2 may be identified as the reference body region 5 . Various reference body regions 5 will be described in detail with reference to FIG. 15 .

The processor 4 may utilize various image recognition algorithms to identify the reference body region 5 of the user region 2 in the user image 3 . The image recognition algorithm includes, but is not limited to, CNN, Histogram of Oriented Gradient (HOG), etc. as described above.

The processor 4 identifies the size (a) of the reference body region 5 of the user region 2 in the user image 3 . For example, when the reference body region 5 is the region 5 corresponding to the iris, the size (a) of the reference body region 5 is the size (a) of the region 5 corresponding to the iris, and contains the transverse length (a) of the outer boundary of . The transverse length (a) includes the major radius (a) of the outer boundary. However, since the present invention is not limited thereto, the size (a) of the region 5 corresponding to the iris may include a minor radius, which is the vertical length of the outer boundary with the white.

The size a of the reference body region 5 may be identified based on the screen size w of the display 12 . This will be described in more detail with reference to FIG. 5 .

In this way, since the processor 4 can identify the reference body region 5 or the size a of the reference body region 5 of the user region 2 in the user image 3, see FIG. 5 below. As described above, it is possible to provide a condition for enlarging or reducing the user image 3 so that the user area 2 in the user image 3 corresponds to a predetermined size.

The processor 4 identifies the size a of the reference body region 5 of the user region 2 in the user image 3 displayed on the display 12 . The processor 4 may identify the size a of the reference body region 5 in consideration of the screen size w of the display 12 on which the user image 3 is displayed. For example, when the size (a) of the reference body region 5 is the horizontal length (a) of the region 5 corresponding to the iris, the processor 4 determines the width w of the screen on which the user image 3 is displayed. In contrast to , the horizontal length a of the region 5 corresponding to the iris in the user image 3 displayed on the display 12 can be identified. When the width w of the screen is 100 mm, it can be identified that the horizontal length a of the region 5 corresponding to the iris is 6 mm, 12 mm, 18 mm, or the like.

The processor 4 may enlarge or reduce the user image 3 so that the size a of the reference body region 5 corresponds to the reference size b. When the reference size (b) is larger than the size (a) of the reference body region 5 , the user image 3 may be enlarged. On the other hand, when the reference size b is smaller than the size a of the reference body region 5, the user image 3 may be reduced.

The reference size (b) includes a reference size (b) defined based on the reference body of a plurality of users. For example, the reference size (b) is an average size (b) of the iris of a plurality of users, and includes an average horizontal length (b) of the outer boundary of the iris. The transverse length (b) includes the major radius (b) of the outer boundary. However, since the present invention is not limited thereto, the average size b of the iris of a plurality of users may include a minor radius that is an average vertical length of the outer boundary of the iris.

Information about the reference size (b) may be received from the outside. For example, the information about the average horizontal length b of the outer boundary of the iris may be received from a server connected through a network, another display device, or the like. However, since the present invention is not limited thereto, the information regarding the reference size b may be input from the user 1 . Information on the reference size b may be stored in the storage unit 17 in the form of a lookup table.

For convenience of description, it is assumed that the average horizontal length b of the iris of a plurality of users is 12 mm. When the horizontal length (a) of the region 5 corresponding to the iris in the user image 3 is 6 mm, the processor 4 determines that the horizontal length (a) of the region 5 corresponding to the iris 6 mm is the average of the iris. The user image 3 can be magnified twice to correspond to the horizontal length (b) of 12 mm. For example, the horizontal length of the user image 3 may be enlarged twice, and the vertical length of the user image 3 may also be enlarged in proportion to the enlargement of the horizontal length.

On the other hand, when the horizontal length a of the region 5 corresponding to the identified iris in the user image 3 is 18 mm, the processor 4 determines the region 5 corresponding to the identified iris in the user image 3 . ), the user image 3 may be reduced 2/3 times so that the horizontal length (a) of 18 mm corresponds to the average horizontal length (b) of the iris (b) 12 mm. For example, the horizontal length of the user image 3 may be reduced to 2/3 times, and the vertical length of the user image 3 may be reduced in proportion to the reduction in the horizontal length.

If the user image 3 is enlarged or reduced so that the horizontal length (a) of the region 5 corresponding to the identified iris in the user image 3 corresponds to the average horizontal length (b) of the iris 12 mm, the user image ( 3) My user area 2 may be displayed in a predetermined size. The predetermined size includes the actual body size of the user 1 .

In this way, the processor 4 considers the characteristics of the iris with little difference between gender and race, so that the size (a) of the region 5 corresponding to the iris is equal to the average size (b) of the iris of a plurality of users. Since the user image 3 can be enlarged or reduced to correspond to it, convenience and efficiency can be improved in displaying the size of the user area 2 in the user image 3 to correspond to the actual body size of the user 1 . can

A specific example of enlarging or reducing the user image 3 has been described above with reference to FIG. 5 . Hereinafter, an additional recording example of enlarging or reducing the counterpart image 9 will be described with reference to FIG. 6 . However, descriptions overlapping those of the embodiment of FIG. 5 will be omitted, and different parts will be mainly described.

The counterpart image 9 may be received from the external device 20 . The external device 20, like the electronic device 10, is implemented with various types of devices, such as an image display device such as a TV, an image processing device such as a set-top box, a home appliance, and an information processing device. Hereinafter, for convenience of description, it is assumed that the external device 20 is implemented as a smartphone.

During a video call with the electronic device 10 , the external device 20 acquires the counterpart image 9 of the counterpart 7 through the camera 23 . The external device 20 transmits the acquired counterpart image 9 to the electronic device 10 . The processor 4 may display the counterpart image 9 received from the external device 20 on the screen of the display 12 . Similarly, the processor 4 transmits the user image 3 of the user 1 obtained through the camera 13 to the external device 20, so that the external device 20 transmits the user image 3 to the external device. (20) to be displayed on the display (24).

The size of the counterpart area 8 in the counterpart image 9 displayed on the screen of the display 12 may be different from the actual body size of the counterpart 7 . The processor 4 identifies the size (a) of the reference body region 5 of the counterpart region 8 in the counterpart image 9 based on the screen size w of the display 12, and the reference body region 5 ) by enlarging or reducing the counterpart image 9 so that the size (a) corresponds to the reference size (b), the size of the counterpart area 8 in the counterpart image 9 corresponds to the actual body size of the counterpart 7 can be indicated to do so.

In this way, since the processor 4 can enlarge or reduce the counterpart image 9 so that the size (a) of the reference body region 5 in the counterpart image 9 corresponds to the reference size (b), the counterpart image ( 9) Convenience and efficiency can be improved in displaying the size of the counterpart area 8 to correspond to the actual body size of the counterpart 7 .

Although the embodiment of enlarging or reducing the user image 3 or the counterpart image 9 has been described above with reference to FIGS. 5 and 6 , hereinafter, both the user image 3 and the counterpart image 9 are enlarged. Alternatively, an additional example of reduction will be described with reference to FIG. 7 . However, descriptions overlapping those of the embodiments of FIGS. 5 and 6 will be omitted, and different parts will be mainly described.

The processor 4 may display the user image 3 and the counterpart image 9 on the screen of the display 12 . The user image 3 and the counterpart image 9 may be named as a plurality of user images 3 , but for convenience of explanation, the user image 3 and the counterpart image 9 are divided and described.

The processor 4 determines the size (a) of the reference body region 5 of the user region 2 in the user image 3 and the size (a) of the reference body region 5 of the counterpart region 8 in the counterpart image 9 ( a) is identified. The size (a) of the reference body region 5 of the user region 2 in the user image 3 includes the horizontal length a of the region 5 corresponding to the iris of the user region 2, and the counterpart image (9) The size (a) of the reference body region (5) of the counterpart region (8) includes the horizontal length (a) of the region (5) corresponding to the iris of the counterpart region (8).

The processor 4 determines the size (a) of the reference body region 5 of the user region 2 in the user image 3 and the size (a) of the reference body region 5 of the counterpart region 8 in the counterpart image 9 ( In identifying a), the screen size w of the display 12 is taken into account. The screen size (w) includes the width (w) of the screen. For example, when the width w of the screen is 100 mm, the horizontal length (a) of the region 5 corresponding to the iris of the user region 2 is 18 mm, and the region corresponding to the iris of the counterpart region 8 ( 5) can be identified as having a horizontal length (a) of 6 mm.

The processor 4 determines the size (a) of the reference body region 5 of the user region 2 in the user image 3 and the size (a) of the reference body region 5 of the counterpart region 8 in the counterpart image 9 ( At least one of the user image 3 and the counterpart image 9 may be enlarged or reduced so that a) is the same. For example, at least one of the user image 3 and the counterpart image 9 may be enlarged or reduced so that the size a of each reference body region 5 corresponds to the reference size b. The reference size (b) includes a reference size (b) defined based on the reference body of a plurality of users. For example, the reference size (b) includes the average horizontal length (b) of the iris.

Assuming that the average horizontal length b of the iris is 12 mm, the processor 4 determines that the horizontal length (a) of the region 5 corresponding to the iris of the user region 2 (a) 18 mm is the average horizontal length (b) of the iris ) The user image 3 can be reduced by 2/3 times to correspond to 12mm. On the other hand, the processor 4 converts the counterpart image 9 to 2 so that the horizontal length (a) 6 mm of the region 5 corresponding to the iris of the counterpart region 8 corresponds to the average horizontal length (b) 12 mm of the iris. You can double magnify.

As another example, the processor 4 determines that the size (a) of the reference body region 5 of the user region 2 in the user image 3 is the reference body region 5 of the counterpart region 8 in the counterpart image 9. The user image 3 can be enlarged or reduced to correspond to the size (a) of . The reverse is also possible.

In the above, the case in which a single user image 3 and a single counterpart image 9 are displayed has been described, but this is for convenience of explanation, so that a plurality of user images 3 and a plurality of counterpart images 9 are displayed. In this case, at least one of the plurality of user images 3 or the plurality of counterpart images 9 is enlarged or reduced so that the size (a) of each reference body region 5 corresponds to the reference size (b). You may.

In this way, the processor 4 determines the size (a) of the reference body region 5 of the user region 2 in the user image 3 and the reference body region 5 of the counterpart region 8 in the counterpart image 9. Since at least one of the user image 3 and the counterpart image 9 can be enlarged or reduced so that the size (a) of is the same, it is possible to provide an environment capable of improving the vitality during a video call and increasing the concentration.

8 illustrates another example of enlarging or reducing a user image and a counterpart image displayed on the vertical display in relation to operation S34.

Previously, in FIG. 7 and the like, the case where the user image 3 and the counterpart image 9 are displayed on the horizontal display 12 has been described. However, since the shape of the display 12 is not limited, the processor 4 displays the user image 3 and the counterpart image 9 on the display 12 of a different form from the horizontal display 12, when the user image (3) or at least one of the other party image 9 can be enlarged or reduced.

As shown in FIG. 8 , it is assumed that the user image 3 and the counterpart image 9 are displayed on the vertical display 12 . The processor 4 determines the size (a) of the reference body region 5 of the user region 2 in the user image 3 displayed on the vertical display 12 and the criterion of the counterpart region 8 in the counterpart image 9. Identifies the size (a) of the body region (5).

The processor 4 determines the size (a) of the reference body region 5 of the user region 2 in the user image 3 displayed on the vertical display 12 and the criterion of the counterpart region 8 in the counterpart image 9. Even if the size (a) of the body region 5 is different, the size (a) of the reference body region 5 of the user region 2 in the user image 3 and the counterpart region 8 in the counterpart image 9 At least one of the user image 3 and the counterpart image 9 may be enlarged or reduced so that the size (a) of the reference body region 5 corresponds to the reference size (b).

In the above, the vertical display 12 is taken as an example, but this is for convenience of explanation, so the processor 4 displays the user image 3 and the counterpart image 9 on the display 12 having various shapes other than horizontal and vertical types. ) is displayed, at least one of the user image 3 and the counterpart image 9 may be enlarged or reduced. Accordingly, it is possible to provide an environment capable of improving the vitality during video calls and increasing concentration even in various types of displays 12 .

As described above with reference to FIG. 5 , the user image 3 is enlarged so that the size (a) of the reference body region 5 of the user region 2 in the user image 3 corresponds to the reference size (b). Assume the case For example, the user image 3 is enlarged so that the horizontal length (a) of the region 5 corresponding to the iris of the user region 2 corresponds to the reference size (b) of 12 mm.

The processor 4 identifies the main area 6 in the user image 3 . The main area 6 includes an area 6 corresponding to a body part of the user area 2 . The main area 6 may be an area including the reference body area 5 of the user area 2 or an area excluding the reference body area 5 of the user area 2 . For example, the main region 6 includes a region corresponding to at least one of a face, a feature, an upper body, a lower body, and a whole body of the user area 2 . However, for convenience of description, it is assumed that the main region 6 is the region 6 corresponding to the upper body from the shoulder line to the tip of the head.

As the main area 6 , the processor 4 identifies whether the size c of the area 6 corresponding to the upper body of the user area 2 exceeds the screen size h of the display 12 . The size c of the area 6 corresponding to the upper body includes the height c of the area 6 corresponding to the upper body. In this case, the processor 4 identifies whether the height c of the area 6 corresponding to the upper body exceeds the height h of the screen. However, since the present invention is not limited thereto, the processor 4 may identify whether the width c of the region 6 corresponding to the upper body exceeds the width w of the screen.

When the height c of the area 6 corresponding to the upper body exceeds the height h of the screen of the display 12 , the processor 4 determines that the area 6 corresponding to the upper body is the screen of the display 12 . The user image 3 is reduced to correspond to a height d that does not exceed a height h of As an example, the user image 3 may be reduced by 1/2.

The above operation may be equally applied to the counterpart image 9 . That is, when is displayed, as described above, the counterpart image 9 can be reduced so that the size c of the counterpart area 8 does not exceed the screen size h. When both the user image 3 and the counterpart image 9 are displayed, either one may be reduced so as not to exceed the screen size h.

As such, the processor 4 can enlarge or reduce the user image 3 in consideration of the screen size h of the display 12, so that the user image 3 optimized for the screen size h can be displayed. can Accordingly, it is possible to enable a video call optimized for the screen size h of the display 12 .

As shown in FIG. 10 , the processor 4 identifies not only the user area 2 but also the background area 102 in the user image 3 . The background area 102 includes an area corresponding to the background excluding the user area 2 in the user image 3 . For example, it includes areas corresponding to office furniture, wallpaper, foreground, and the like. However, for convenience of explanation, it is assumed that the region corresponding to the blackboard is the background region 102 . The user area 2 and the background area 102 may be identified by various image recognition algorithms as described above.

The processor 4 enlarges the user image 3 so that the size (a) of the reference body region 5 of the user region 2 in the user image 3 corresponds to the reference size (b), and the user image 3 ), the user area 2 within the user image 3 is also enlarged. For example, when the horizontal length (a) of the region 5 corresponding to the iris of the user region 2 is enlarged twice from 6mm to 12mm to correspond to the reference size (b), the user image 3 is magnified twice Not only that, but the user area 2 is also doubled.

Even if the user area 2 is enlarged, the size of the background area 102 may be maintained. For example, the horizontal length (a) of the region 5 corresponding to the iris of the user region 2 is doubled from 6 mm to 12 mm to correspond to the reference size (b), so that the user image 3 and the user region ( 2) Even if the figure is enlarged twice, the size of the area 102 corresponding to the blackboard may be maintained as it is.

Conversely, the horizontal length (a) of the area (5) corresponding to the iris of the user area (2) is reduced 1/2 times from 18 mm to 12 mm to correspond to the reference size (b), so that the user image 3 and the user area Even if (2) is reduced to 1/2 times, the size of the area 102 corresponding to the blackboard may be maintained as it is.

The above operation may be equally applied to the counterpart image 9 . That is, the processor 4 identifies the counterpart region 8 and the background region 102 even in the counterpart image 9 , and maintains the size of the background region 102 despite the enlargement or reduction of the counterpart region 8 . can

In this way, the processor 4 can maintain the size of the background area 102 despite the enlargement or reduction of the user area 2 in the user image 3, so that a video call is performed in a virtual space. can be produced. Accordingly, it is possible to provide a different experience during a video call.

The processor 4 determines the reference body region 5 of the user region 2 in the user image 3 displayed on the display 12 based on the screen size h of the display 12 on which the user image 3 is displayed. Identifies location (e). When the processor 4 identifies the reference body region 3 of the user region 2 in the user image 3 as in operation S32 of FIG. 3 , the position of the reference body region 5 of the user region 2 is (e) can be identified. The screen size (h) of the display 12 includes the height (h) of the screen of the display 12 , and the position (e) of the reference body region 5 is the height (e) to the reference body region 5 . includes

The processor 4 may move the user image 3 so that the position e of the reference body region 5 corresponds to the reference position f. The movement of the user image 3 includes enlarging or reducing the user image 3 . The reference position f includes a reference position f defined based on reference bodies of a plurality of users. When the reference position (f) is higher than the position (e) of the reference body region 5 , the user image 3 may be moved upward. On the other hand, when the reference position f is lower than the position e of the reference body region 5, the user image 3 may be moved downward. Of course, the user image 3 may be moved left and right according to the reference position f.

For convenience of explanation, the reference position (f) and the position (e) of the reference body region (5) are expressed as a ratio of the screen size (h) of the display (12), the reference position (f) of the display (12) It can be 2/3 of the screen size (h). When the position (e) of the reference body region 5 is 1/3 of the screen size (h), the processor 4 determines that the position (e) 1/3 of the reference body region 5 is the reference position (f). ) It is possible to move the user image 3 upward to correspond to the 2/3 point. However, the reference position f may be set in various ways.

In this way, the processor 4 may move the user image 3 so that the position e of the reference body region 5 corresponds to the reference position f. Accordingly, since it is not necessary to obtain reference information used in moving the user image 3 from the user or the outside, convenience and efficiency can be improved.

As shown in FIG. 12 , the processor 4 identifies a change in the user area 2 corresponding to the user 1 in the user image 3 . A change in the user area 2 includes a change in the movement of the user area 2 . The change in movement includes the degree of change in movement, the number of changes in movement, and the like.

The processor 4 may identify the degree of participation of the user 1 based on the change in the user area 2 For example, when the degree of change or the number of changes is greater than or equal to a predetermined threshold, the degree of participation of the user 1 is can be identified as high.

As another example, when a user voice is received from the user 1 , the processor 4 may identify the degree of participation of the user 1 based on the received user voice. The user's voice may be received through the audio receiver. The processor 4 may identify that there is a change in the user area 2 based on the user's voice. When the size or frequency of the user's voice is greater than or equal to a predetermined threshold, it is possible to identify that there is a change in the user area 2 and identify that the user 1 has a high degree of participation.

The processor 4 enlarges the user image 3 so that the user area 2 corresponding to the user 1 identified as having a high degree of participation is enlarged. When the user image 3 is enlarged, as described above with reference to FIG. 5 , the user image 3 may be enlarged so that the size (a) of the reference body region 5 corresponds to the reference size (b). On the other hand, the user area 2 corresponding to the user 1 identified as having a low level of participation is reduced.

As described above with reference to FIG. 10 , in a virtual space separated from the background area 102 , the size of the background area 102 is maintained, and the user area 2 corresponding to the user 1 according to the identified degree of participation. can be enlarged or reduced.

If the user image 3 includes a plurality of user areas 2 corresponding to the plurality of users 1, each of the plurality of user areas 2 in the user image 3 is identified, and the Based on the participation degree of the plurality of users (1) may be identified. At least one user area 2 among the plurality of user areas 2 may be enlarged or reduced according to the identified degree of participation.

When a plurality of counterparts 8 are included in the counterpart image 9, a plurality of counterpart regions 8 corresponding to each of the plurality of counterparts 8 in the counterpart image 9 are identified, and based on each change The degree of participation may be identified, and at least one counterpart area 8 among the plurality of counterpart areas 8 may be enlarged or reduced according to the identified degree of participation.

In this way, the processor 4 can enlarge the user image 3 according to the degree of participation of the user 1 identified based on the change in the user area 2 in the user image 3, so that the video call is lively. It can provide an environment that can improve and enhance concentration.

As shown in FIG. 13 , the processor 4 identifies the gaze direction 130 of the user area 2 in the user image 3 . The gaze direction 130 includes a direction in which the reference body region 3 of the user region 2 faces. The reference body region 3 includes regions corresponding to the iris, face, upper body, lower body, whole body, and the like. When the reference body region 3 is the region 5 corresponding to the iris, the processor 4 performs the reference body region 3 of the user region 2 in the user image 3 as in operation S32 of FIG. 3 . By identifying , the gaze direction 130 of the user area 2 can be identified.

The gaze direction 130 may be identified based on a change in movement of the user area 2 corresponding to the user 1 . The change in the movement of the user area 2 includes the change in the movement of the reference body area 3 . The gaze direction 130 may be identified based on various image recognition algorithms.

For convenience of explanation, in a state in which the gaze direction 130 of the user area 2 is a frontal state, based on a change in the movement of the user area 2, when the gaze direction 130 of the user 1 is identified as being right assume The processor 4 moves the user image 3 to the right according to the gaze direction 130 toward the right. When there is a background area 102 corresponding to the blackboard on the right side of the user image 3 , the background area 102 corresponding to the blackboard may be displayed according to the right movement of the user image 3 . Conversely, when the gaze direction 130 of the user 1 faces the front again, the processor 4 identifies the gaze direction 130 facing the front, and according to the gaze direction 130 facing the front, the user image 3 ) to the left, so that it becomes the original state assumed in the first place.

In this way, since the processor 4 can move the user image 3 according to the gaze direction 130 of the user area 2 identified based on the change of the user area 2 in the user image 3 , the image It is possible to provide an environment that can improve liveliness during a call and increase concentration.

The processor 4 identifies the user viewing distance. The user viewing distance includes a distance between the user 1 and the electronic device 10 . As in operation S32 of FIG. 3 , when the reference body region 5 of the user region 2 is identified, the processor 4 may identify the user viewing distance based on the distance to the reference body region 5 . .

The processor 4 adjusts the reference size b based on the user's viewing distance, and enlarges or enlarges the user image 3 so that the size (a) of the reference body region 5 corresponds to the adjusted reference size (b). reduce As an example, it is assumed that the user image 3 is adjusted so that the size (a) of the reference body region 5 corresponds to the adjusted reference size (b) 12 mm. When the user viewing distance is a rather short first user viewing distance g, a situation in which the user image 3 appears too large to the user 1 may be produced. In consideration of this situation, the processor 4 reduces the user image 3 according to the first user viewing distance g. For example, the processor 4 adjusts the reference size (b) 12mm to the reference size (b) 6mm corresponding to the first user viewing distance (g), and the size (a) 12mm of the reference body region 5 is adjusted The user image (3) can be reduced to correspond to the standard size (b) of 6 mm. However, since this is for convenience of explanation, the reference size b according to the viewing distance g of the first user may be set in various ways.

As another example, when the user viewing distance is a rather long second user viewing distance j, a situation in which the user image 3 appears too small to the user 1 may be produced. In consideration of this situation, the processor 4 enlarges the user image 3 according to the second user viewing distance j. As an example, the processor 4 adjusts the reference size (b) 12mm to the reference size (b) 18mm corresponding to the second user viewing distance (j), and the size (a) 12mm of the reference body region 5 is adjusted The user image (3) can be enlarged to correspond to the reference size (b) 18mm. The reference size b according to the second user viewing distance j may be set in various ways.

In this way, the processor 4 adjusts the reference size b based on the user's viewing distance, and the user image 3 so that the size a of the reference body region 5 corresponds to the adjusted reference size b. can be enlarged or adjusted, so that it is possible to provide an environment capable of enhancing liveliness and concentration during a video call.

Although it has been described above that the reference body region 5 is a single reference body region, the processor 4 may consider a plurality of various reference body regions 5 . For example, not only the area corresponding to the iris but also the area corresponding to the face size, height, etc. may be considered as the reference body area 5 .

When considering the area corresponding to the height as the reference body area 5, it is assumed that the height of 180 cm is set as the reference size (b). The reference size (b) for the key may be input by the user or received from the outside. The processor 4 may identify the size of the area corresponding to the key of the user area 2 in the user image 3 . In this case, the screen size h of the display 12 may be considered. The screen size h of the display 12 includes the height h of the screen of the display 12 .

The processor 4 identifies the size of the area corresponding to the key of the user area 2 in the user image 3 compared to the screen size h of the display 12, and the user area 2 in the user image 3 The user image 3 can be enlarged or reduced so that the size of the area corresponding to the height of the user corresponds to the reference size b of 180 cm.

When considering the area corresponding to the face size as the reference body area 5, it is assumed that the face size 20 cm is set as the reference size b. The processor 4 may identify a region corresponding to the face size of the user region 2 in the user image 3 . The screen size w of the display 12 may be considered, and the screen size w of the display 12 includes the width w of the screen of the display 12 .

The processor 4 identifies an area corresponding to the face size of the user area 2 in the user image 3 compared to the screen size w of the display 12, and The user image 3 may be enlarged or reduced so that the area corresponding to the face size corresponds to the reference size b of 20 cm.

The processor 4 enlarges or reduces the user image 3 according to the reference body region 5 selected based on the priority among the plurality of reference body regions 5 such as regions corresponding to the iris, height, face size, etc. can For example, when the region corresponding to the key is selected as the reference body region 5 of the highest priority, as described above, the processor 4 controls the user in the user image 3 compared to the screen size h of the display 12 . The size of the area corresponding to the height of the area 2 is identified, and the size of the area corresponding to the height of the user area 2 in the user image 3 corresponds to the reference size (b) 180 cm. can be enlarged or reduced.

As such, the processor 4 can adjust the size of the user image 3 in consideration of a plurality of various reference body regions 5 , and thus can adjust the size of the user image 3 adaptively to various situations. In addition, since a plurality of reference body regions 5 according to priorities can be considered, the user image 3 can be adjusted to an optimized size as necessary.

It has been described above that, in adjusting the size of the user image 3 with reference to FIG. 15 , the priority of the plurality of reference body regions 5 may be considered. Hereinafter, an example in which priorities are set according to a user's selection will be described.

As shown in FIG. 16 , the processor 4 displays a user interface 160 indicating a plurality of reference body regions 5 . The user interface 160 includes a menu for selecting a plurality of reference body regions 5 such as iris, height, face size, and the like. When the iris is selected in the user interface 160 according to the user input, the processor 4 identifies a region corresponding to the iris as the reference body region 5, and the size of the reference body region 5 in the user image 3 The user image 3 is enlarged or reduced so that (a) corresponds to the reference size (b).

As described above with reference to FIG. 15 , the user interface 160 includes a menu for setting priorities for a plurality of reference body regions 5 . For example, when the iris is set as the first priority, the height as the third priority, the face size as the second priority, etc. according to the user input, the processor 4 preferentially sets the region corresponding to the iris as the reference body region 5 . identify If it is difficult to set the region corresponding to the iris as the reference body region 5 because the region corresponding to the iris cannot be identified in the user image 3, the processor 4 determines the region corresponding to the next key. can be set as the reference body region 5 .

On the other hand, the size (a) of the region 5 corresponding to the iris has little difference between gender and race, whereas the size (a) of the region 5 corresponding to the height, face size, etc. In consideration of the obvious difference, the user interface 160 includes a menu for inputting a reference size b for a key, a face size, and the like. When the reference size (b) for the key is input as 180 cm according to the user input, the processor 4 determines that the size (a) of the area 5 corresponding to the height of the user area 2 in the user image 3 is The user image 3 can be enlarged or reduced so that the reference size b according to the user input becomes 180 cm.

In this way, since the processor 4 can set priorities to the plurality of reference body regions 5 according to the user input, the user 1 adjusts the user image 3 based on the desired reference body region 5 . can

Various embodiments disclosed in this document are implemented as software including one or more instructions stored in a storage medium readable by a machine such as the electronic device 10 . For example, the processor 4 of the electronic device 10 calls at least one of the one or more instructions stored from the storage medium and executes it. This enables a device such as the electronic device 10 to be operated to perform at least one function according to the called at least one command. The one or more instructions include code generated by a compiler or code executable by an interpreter. The device-readable storage medium is provided in the form of a non-transitory storage medium. Here, the 'non-transitory storage medium' is a tangible device and only means that it does not contain a signal (eg, electromagnetic wave), and this term refers to a case in which data is semi-permanently stored in a storage medium and a case in which data is temporarily stored. case is not distinguished. For example, the 'non-transitory storage medium' includes a buffer in which data is temporarily stored.

For example, the methods according to various embodiments disclosed in this document are included and provided in a computer program product. The computer program product according to the present disclosure includes instructions of software executed by a processor, as mentioned above. Computer program products are traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg, CD-ROM), or via an application store (eg, Play Store™) or between two user devices (eg, smartphones). Direct, online distribution (eg, download or upload). In the case of online distribution, at least a portion of the computer program product (eg, a downloadable app) is stored at least on a machine-readable storage medium, such as a memory of a manufacturer's server, a server of an application store, or a relay server. Temporarily saved or created temporarily.

As mentioned above, although the present invention has been described in detail through preferred embodiments, the present invention is not limited thereto and variously implemented within the scope of the claims.

Claims

In an electronic device,

Acquire user image through camera,

Identifies the reference body region of the user in the user image,

Identifies the size of the reference body region in the user image to be displayed on the display based on the screen size of the display on which the user image is to be displayed,

and a processor for enlarging or reducing the user image to be displayed on the display so that the size of the reference body region corresponds to a reference size defined based on reference bodies of a plurality of users.
According to claim 1,

The reference body region is a region corresponding to the user's iris.
According to claim 1,

The processor is

Obtaining the user image from an external device,

An electronic device that performs an operation related to a video call based on the received user image.
According to claim 1,

The user image includes a plurality of user images,

The processor is configured to enlarge or reduce the plurality of user images displayed on the display so that the sizes of the reference body regions of the plurality of users in the plurality of user images are the same.
According to claim 1,

The processor is configured to reduce the user image so that, when a main region of the user image corresponding to the reference body region corresponds to the reference size exceeds a screen size of the display, the main region corresponds to the screen size .
According to claim 1,

The user image includes a user area including the reference body area and a background area,

The processor enlarges or reduces the user image so that the reference body region corresponds to the reference size while maintaining the size of the background region.
According to claim 1,

The processor is

identifying the location of the reference body region;

An electronic device for moving the user image so that the position of the reference body region corresponds to the reference position defined in the screen of the display.
According to claim 1,

The processor is

Identifies the degree of participation of the user based on a change in the user area corresponding to the user in the user image,

An electronic device for enlarging or reducing the user image based on the identified degree of participation.
According to claim 1,

The processor is

Identifies the gaze direction of the user based on a change in the user area corresponding to the user in the user image,

An electronic device that moves the user image according to the identified gaze direction.
According to claim 1,

The processor is

Adjusting the reference size based on the user viewing distance,

An electronic device for enlarging or reducing the user image so that the size of the reference body region corresponds to the adjusted reference size.
The method of claim 1,

The processor is configured to enlarge or reduce the user image so that a reference body region selected based on a priority from among a plurality of reference body regions corresponds to the reference size.
12. The method of claim 11,

The processor is configured to set the priority based on a user input.
In the control method of an electronic device,

acquiring a user image;

identifying a reference body region of the user in the user image;

identifying the size of the reference body region in the user image to be displayed on the display based on the screen size of the display on which the user image is to be displayed; and

Enlarging or reducing the user image to be displayed on the display so that the size of the reference body region corresponds to a reference size defined based on reference bodies of a plurality of users

A control method of an electronic device comprising a.
14. The method of claim 13,

The reference body region is a region corresponding to the user's iris.
A computer-readable code, comprising: a computer program storing a code for performing a control method of an electronic device;

acquiring a user image;

identifying a reference body region of the user in the user image;

identifying the size of the reference body region in the user image to be displayed on the display based on the screen size of the display on which the user image is to be displayed; and

Enlarging or reducing the user image to be displayed on the display so that the size of the reference body region corresponds to a reference size defined based on reference bodies of a plurality of users

A recording medium on which a computer-readable program is recorded, comprising: