KR102193567B1 - Electronic Apparatus displaying a plurality of images and image processing method thereof - Google Patents

Abstract

The present disclosure provides a display for displaying a plurality of images on one screen, and detecting the number of objects included in each of the plurality of images, and scaling each of the plurality of images based on the number of detected objects. A scaling factor is determined, and the size of at least one of the plurality of images is resized based on the determined scaling factors for each of the plurality of images, and the size is changed based on the The present invention relates to an electronic device including a processor that controls the display to display at least one of a layout and a display order of a plurality of images, and an image processing method thereof.

Description

An electronic device displaying a plurality of images and an image processing method thereof

Embodiments of the present disclosure are related to image processing of an electronic device. More specifically, the present disclosure relates to an electronic device in which the size of each image is changed and displayed according to the number of objects included in each image of a plurality of images, and an image processing method thereof.

Many electronic devices such as smart phones and tablet computers have cameras that can take images. When viewing captured images using an electronic device, the electronic device has a camera capable of capturing images in many electronic devices such as a smart phone and a tablet computer. When viewing captured images using an electronic device, the electronic device displays all the captured images in the same size. When all the captured images are displayed in the same size, the user cannot clearly see images with a lot of information (eg, many people in the image). When thumbnails are shown in a photo album, the thumbnail images are not resized so that the information in each thumbnail image (eg, the number of people in the image) is fully recognized by the user. That is, there is a need for a mechanism that can change the size of images and rearrange and display the images based on information or content displayed in each image.

An object of the embodiments of the present disclosure is to provide a mechanism for managing the display of a plurality of images in an electronic device.

Another object of the embodiments of the present disclosure is to provide a mechanism for detecting the number of objects in an image.

Another object of the embodiments of the present disclosure is that the present invention for each image based on the number of objects in each image is in accordance with the above-described necessity, and an object of the present invention is to display a plurality of images in an electronic device. It is to provide an electronic device and method capable of providing information included in each image more clearly to a user by changing the size of an image and displaying it based on the number of objects included in the image.

An electronic device that performs image processing according to an embodiment of the present invention to achieve the above object includes a display for displaying a plurality of images on one screen and the number of objects included in each of the plurality of images. Is detected, a scaling factor for each of the plurality of images is determined based on the number of detected objects, and at least one of the plurality of images is determined based on the determined scaling factor for each of the plurality of images. Resizing the size of one image and controlling the display to display at least one of a re-layout and a display order of the plurality of images based on the changed image Includes a processor.

Meanwhile, the image processing method in an electronic device according to an embodiment of the present invention includes the steps of recognizing a plurality of images in the electronic device, detecting the number of objects included in each of the plurality of images, and Determining a scaling factor for each of the plurality of images based on the number of detected objects, at least one of the plurality of images based on the determined scaling factor for each of the plurality of images Resizing and changing at least one of the re-layout and display order of the plurality of images based on the resized image to convert the plurality of images into one of the electronic devices. And displaying on the screen.

According to the various embodiments described above, when a plurality of images are displayed on one screen in an electronic device, the present disclosure is provided to a user by changing the size of the image so that the image is displayed larger as the number of objects included in the image increases. Object and content information included in the image can be clearly provided.

1A and 1B are diagrams for explaining a comparison between the prior art and the present invention when displaying a plurality of images in an electronic device (system) according to embodiments of the present disclosure;
2 is a simple block diagram of an electronic device for managing the display of a plurality of images according to embodiments of the present disclosure;
3 is a detailed block diagram of a processor, according to embodiments of the present disclosure;
4 is a flow chart illustrating a method for displaying a plurality of images in an electronic device according to embodiments of the present disclosure;
5 is a flowchart illustrating a method of resizing one or more images according to embodiments of the present disclosure;
6A to 8H are diagrams illustrating a comparison between a prior art for displaying a plurality of images in an electronic device and the present invention according to various embodiments of the present disclosure;
8I and 8J are diagrams illustrating a scenario of displaying a plurality of images when one person leaves a multi-party video conference according to embodiments of the present disclosure;
9 is a diagram illustrating a plurality of tiles, according to embodiments of the present disclosure;
10A and 10B are diagrams showing a comparison between the prior art and the present invention when displaying a plurality of images of an album cover in a music application, according to embodiments of the present disclosure;
11 is a flow chart illustrating a method for selecting one or more images according to embodiments of the present disclosure;
12A and 12B are diagrams showing a comparison between the prior art and the present invention when a plurality of images are displayed on an SNS (Social Networking Site) according to embodiments of the present disclosure;
13 is a flow diagram illustrating a method of cropping one or more images, according to embodiments of the present disclosure;
14A and 14B are diagrams showing a comparison between the prior art and the present invention when displaying a plurality of images according to embodiments of the present disclosure;
15 is a flowchart illustrating a method for managing display of an image in an electronic device according to embodiments of the present disclosure;
16A and 16B are diagrams showing a comparison between the prior art and the present invention when a user operation menu is displayed on an image according to embodiments of the present disclosure;
17A and 17D are diagrams showing a comparison between the prior art and the present invention when a caption of an image is displayed, according to embodiments of the present disclosure;
18A and 18B are diagrams for describing browsing in a wearable device having a caption on an image according to embodiments of the present disclosure;
19 is a diagram illustrating a computing environment implementing a method for displaying a plurality of images in an electronic device according to embodiments of the present disclosure;
And
20 is a flowchart illustrating a method of changing and displaying an image size according to the number of objects included in a plurality of images, according to example embodiments.

The terms used in the present specification will be briefly described, and the present disclosure will be described in detail.

Terms used in the present disclosure have selected general terms currently widely used as possible while taking functions in the present disclosure into consideration, but this may vary according to the intention or precedent of a technician engaged in the art, the emergence of new technologies, and the like. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning of the terms will be described in detail in the description of the corresponding invention. Therefore, the terms used in the present disclosure should be defined based on the meaning of the term and the content throughout the present disclosure, not the name of a simple term.

Since the embodiments of the present disclosure may apply various transformations and may have various embodiments, specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope of the specific embodiment, it is to be understood to include all conversions, equivalents, or substitutes included in the disclosed spirit and technical scope. In describing the embodiments, when it is determined that a detailed description of a related known technology may obscure the subject matter, a detailed description thereof will be omitted.

Terms such as first and second may be used to describe various components, but the components should not be limited by terms. The terms are only used for the purpose of distinguishing one component from another component.

Singular expressions include plural expressions unless the context clearly indicates otherwise. In the present application, terms such as "comprise" or "comprise" are intended to designate the existence of features, numbers, steps, actions, components, parts, or a combination thereof described in the specification, but one or more other It is to be understood that the presence or addition of features, numbers, steps, actions, components, parts, or combinations thereof, does not preclude in advance the possibility of being excluded.

In the present disclosure, a "module" or "unit" performs at least one function or operation, and may be implemented as hardware or software, or a combination of hardware and software. In addition, a plurality of "modules" or a plurality of "units" are integrated into at least one module except for the "module" or "unit" that needs to be implemented with specific hardware and implemented as at least one processor (not shown). Can be.

The term “system” used in the present disclosure may refer to a plurality of “electronic devices” or one “electronic device” according to an embodiment of the present disclosure.

The "control elements" used in the present disclosure may be included in the ""user manipulation menu"" according to an embodiment of the present disclosure.

The "control unit or controller" used in the present disclosure may refer to a "processor" according to an embodiment of the present disclosure.

The "computing environment" used in the present disclosure may refer to an "electronic device" according to an embodiment of the present disclosure.

The “relative scaling factor” used in the present disclosure may refer to “relative scaling” or “scaling factor”.

“Set” used in the present disclosure may refer to an image group consisting of a plurality of images. For example, it may be a gallery application composed of a plurality of images.

Embodiments of the present disclosure are for a method for managing the display of a plurality of images in an electronic device. The method includes detecting the number of objects in each image and determining a relative scaling factor for each image based on the number of objects in each image. The relative scaling factor may be determined by comparing the number of objects in each image among a plurality of images. In addition, the method includes performing one or more operations on at least one image based on a relative scaling factor for each image.

According to an embodiment of the present disclosure, the performing of one or more operations includes changing the size of one or more images based on the relative scaling factor for each image, and resizing images on one screen of the electronic device. It may include the step of displaying.

According to an embodiment of the present disclosure, the performing of one or more operations includes selecting one or more images based on the relative scaling factor for each image and displaying the selected images on one screen of the electronic device. Can include.

According to an embodiment of the present disclosure, performing one or more operations includes cropping one or more images based on the relative scaling factor for each image, and displaying the selected images on one screen of the electronic device. It may include steps. Unlike conventional systems and methods, images can be dynamically selected, resized, reordered, or restructured based on the object within each image and the relative position of the images in each image. The above-described objects (which may refer to data points) may be human faces, buildings, animals, objects, colors, etc. in the image. The relative scaling factor for each image may be determined by comparing the number of objects in each image among a plurality of images for changing the size of each image. When the number of objects and the relative positions of the images in the group consisting of a plurality of images are determined, the system (electronic device) determines the relative size of each image on the preview screen according to the number of objects. For example, an image having more objects may be changed in size to be larger than an image having fewer objects.

According to an embodiment of the present disclosure, images whose size is changed are displayed in a tile shape according to the size of each image. In the present disclosure, a method of displaying tile-shaped images including various steps will be described. The presence of content or information of each image included in the set of images is determined. The number of objects (eg, human face) in each image is detected. In addition, salient regions, contrast, and gradient are detected based on the object in each image. Important metrics are evaluated to determine proportional sizes to aid in human perception. Images can be cropped or subsampled to resize to fit a given layout. In addition, the scaled images may be displayed in a tiled form.

According to an embodiment of the present disclosure, a slide show may be created from a given set of images (a set consisting of a plurality of images). The slide show may be displayed to the user while each image is sequentially delayed. The delay time may be determined by a ratio according to information or content of each image. The duration of the slide show is determined based on the critical metrics evaluated.

In addition, the method determines the size of a group of images such as application icons, album covers, folders, video files icons, etc. to the number of objects in each image and each It can be used to change images based on their relative positions within a plurality of images. For example, an application icon with a large number of faces or objects in the icon may be displayed in a relatively larger size than other icons. Also, in the group consisting of album covers, the size of the album cover may be changed based on the number of faces or objects of people in each album cover. For example, an album cover including a plurality of objects (eg, human faces or information) may be changed in size and displayed as an album cover that is relatively larger than other album covers.

Also, the method according to an embodiment of the present disclosure may be used to change the size of a plurality of images in an application such as an image search, a social network site (SNS) application, a multi-party video conference application, a gallery application, and the like. Since images including a lot of information in the image can be resized to a larger size than images that do not, the user can recognize all information about the images. Therefore, the method according to the present disclosure can improve the user experience.

In addition, embodiments according to the present disclosure provide a method for managing the display of an image in an electronic device. The method includes displaying a plurality of control elements on an image displayed on a screen of the electronic device and detecting the number of objects in the image. In addition, the method may include dynamically moving the position of at least one control element in an area of the image in which the number of objects is detected as zero. Unlike a conventional system (electronic device), when the image control elements are located at a default position of an image, the method according to the present disclosure dynamically positions the image control elements in an area of an image in which the number of objects is zero. Can be moved. Accordingly, when the image control element is moved to an area where an object does not exist on the image, the image can be sufficiently recognized. Further, the method according to the present disclosure may be used to dynamically move the positions of control elements overlaid on an image in applications such as a view field of camera, an image editing application, an image viewer, and the like.

Hereinafter, exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art may easily implement the exemplary embodiments. However, the present disclosure may be implemented in various different forms and is not limited to the exemplary embodiments described herein. In addition, in the drawings, parts not related to the description are omitted in order to clearly describe the present disclosure, and similar reference numerals are attached to similar parts throughout the specification.

1A and 1B are diagrams for explaining a comparison between the prior art and the present invention when displaying a plurality of images in an electronic device according to embodiments of the present disclosure.

The electronic device 100 may be any display device capable of displaying an image. For example, the electronic device 100 may be a mobile phone, a tablet PC, a laptop, a television, a smart phone, a smart watch, or the like. The above-described example is only an example for describing the present disclosure, and is not limited thereto.

1A is a diagram for describing a conventional technique for displaying a plurality of images in the electronic device 100. Referring to FIG. 1A, in an application capable of displaying a plurality of images such as a gallery application, the electronic device 100 may display a plurality of images on one screen. Conventionally, a plurality of images displayed in a gallery all have the same size without considering information or content included in each image.

On the other hand, FIG. 1B is a diagram for describing a display of a plurality of images in the electronic device 100 according to an embodiment of the present disclosure. Referring to FIG. 1B, unlike the prior art, the size of a plurality of images may be changed based on information or content (content) of each image. In an embodiment of the present disclosure, the information or content may include the number of objects in each image. The size of the plurality of images may be changed based on the number of objects in each image, as shown in FIG. 1B.

In FIG. 1B, an image having three objects (eg, three content icons) may be changed in size to be displayed in a larger size. In addition, an image having two objects (eg, two content icons) may be changed in size to be displayed in a smaller size than an image having three objects. In addition, an image having one object (eg, one content icon) may be changed in size to be displayed smaller than an image having two objects. That is, among the plurality of images, the size of each image may be changed according to the number of objects in each image. In FIGS. 1A and 1B, it can be seen that the layout of the plurality of images is the same before and after the size of the images is changed.

As an example of the present disclosure, in order to change the size of each image, a relative scaling factor for each image may be determined. The relative scaling factor may be determined by comparing the number of objects in each image among a plurality of images. After determining the relative scaling factor for each image, the size of the plurality of images may be changed based on the relative scaling factor for each image.

The images illustrated in FIGS. 1A and 1B are only an exemplary embodiment for describing the present disclosure, and are not limited thereto. The size of any image can be changed based on the number of objects present in the image. For example, the size of images such as application icons, album covers, folders, icons of video files, etc. may be changed based on the relative size of each image, the number of objects, and various information contents.

2 is a simple block diagram of an electronic device for managing a display of a plurality of images according to example embodiments of the present disclosure. In an embodiment, the electronic device 100 includes a processor 202, a storage unit 204, and a display 206.

The processor 202 may perform one or more operations for managing the display of a plurality of images in the electronic device 100. In one embodiment, the processor 202 may detect the number of objects in each image. Objects (which may be data points) described in the present disclosure may be human faces, buildings, animals, objects, colors, image entropy, and the like. In one embodiment, the object in the image may have one of the following three distinct characteristics. For example, the three distinct characteristics could be a well-defined closed boundary in space, a shape that differs from the surrounding background, and one that stands out uniquely and prominently within the image. Most of the objects can have several of the above-described characteristics at the same time. In one embodiment, a method of detecting objects in an image is "Alexe, Bogdan, Thomas Deselaers, and Vittorio Ferrari. "What is an object?" Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on. IEEE, 2010" You can refer to. In addition, a method of detecting objects in an image may use another known method or a method developed in the future.

When the image is stored in the storage unit 204, the processor 202 determines the number of objects included in the image before being stored in the storage unit 204, and the number of objects of the determined image is determined in the storage unit ( The storage unit 204 can be controlled to be stored in 204.

According to an embodiment, when images are stored in the electronic device 100, the number of objects in each image may be calculated before the images are stored in the electronic device 100.

When an image is loaded into the electronic device 100 in real time, the processor 202 determines the number of objects included in the image while the image is being loaded, and the number of objects of the determined image is stored together with the image information. It is possible to control the storage unit 204 to be stored in ).

According to an embodiment, when images are dynamically loaded (eg, on a web page), the number of objects in each image may be calculated while the web page is being loaded.

The processor 202 detects objects in each image using at least one of color contrast, edge density, Bayesian integration, and superficial straddling. I can. Since the above-described methods are known techniques, detailed descriptions are omitted in the present disclosure. In addition, the above-described methods are only examples for the present disclosure, and are not limited thereto. The processor 202 may detect objects in each image using other known and to-be-known techniques.

The processor 202 may determine a relative scaling factor in each image based on the number of objects in each image. Also, the processor 202 may perform one or more operations based on the relative scaling factor of each image.

That is, the processor 202 may determine a scaling factor of each image by comparing the number of objects included in each image of a plurality of images.

According to an embodiment, performing one or more operations includes changing the size of one or more images based on a relative scaling factor of each image, and displaying the images whose size has changed on one screen of the electronic device 100. It may include steps.

The processor 202 may control the display 206 to display by reordering at least one of a layout and a display order of a plurality of images based on the changed image.

Also, the processor 202 may change the relative size of the image to a greater extent as the number of objects included in each of the plurality of images increases.

The processor 202 may control the display 206 to selectively display images in which an object included on the image occupies a high ratio among images whose size has been changed among the plurality of images.

That is, the processor 202 may control the display 206 to select and display images that clearly represent an object from among a plurality of images whose size has been changed. For example, if two of the six images each include three people, one of the two images may clearly identify three people, and the other image may not clearly identify three people. . In this case, the processor 202 may control the display 206 to select and display an image in which an object (eg, a person) is clearly identified. In this case, the processor 202 may determine the degree of identification of the object based on the ratio occupied by the object in one image area. However, the above-described example is only an example for describing the present disclosure, and the present disclosure is not limited thereto, and clarity of the object may be determined within an image with the same number of objects through various methods.

According to an embodiment, the processor 202 controls the display 206 to crop one or more images based on a relative scaling factor of each image and display selected images on one screen of the electronic device 100. can do.

The processor 202 determines a region of interest (ROI) of each of the plurality of images, cuts a region containing an object from at least one image of the plurality of images based on the determined ROIs of each of the plurality of images, and The display 206 can be controlled to display an image of.

For example, the ROI may be a sailent region in each image. The salient region detection method is used to detect a salient region in each image. The processor 202 may change the size of cropped images such that a sailent region in the image appears more prominent and larger.

Unlike conventional systems (electronic devices) and methods, based on the object in each image and the relative position of each image, images are dynamically selected, resized, reordered, and The structure can be restructured differently. The scaling factor of each image is determined by comparing the number of objects of each image among a plurality of images for resizing each image.

When the number of objects and relative positions of the objects are determined in the group of images, the processor 202 may determine the relative size in a preview according to the number of objects. For example, the electronic device 100 may allow an image with a large number of objects to have a larger size than an image with a small number of objects.

The processor 202 divides the area in which a plurality of images are displayed into designated n tile shapes, and re-renders the image whose size is changed according to the number of the objects included in each of the plurality of images into each n tile shape (re -rendering) to display the display 206.

When an object is included in the image and a caption describing the image is displayed separately from the image, the processor 202 overlays the caption on the image and displays the image by changing the size of the image. You can control 206.

When one of a plurality of images is selected and a user manipulation menu is displayed overlaid on the selected image, the processor 202 displays the user manipulation menu to be moved from the selected image area to an area where no object is detected and displayed. ) Can be controlled.

For example, the user manipulation menu may be an icon or menu having an editing function that is overlaid on an image. In addition, the user manipulation menu may be an icon or menu that is overlaid on the screen in the shooting standby screen.

Further, the processor 202 controls the display 206 to change and display the size of the user manipulation menu to fit the size of the area where the object is not detected, when moving the user manipulation menu to the image area where the object is not detected. can do.

In addition, according to an embodiment, the processor 202 may detect the number of objects in the image and dynamically move the position of at least one control element to an area of the image where the number of objects is recognized as zero. have. Unlike the conventional system (electronic device 100), when the image control elements are spaced apart from default positions within the image, the method according to the embodiment of the present disclosure does not detect the number of objects in the image (the number of objects is 0). ) You can dynamically move the position of image control elements to the area of the image. If the image control elements are displayed on an area where the object of the image does not exist, the image can be fully recognized by the user. In addition, the method according to an embodiment of the present disclosure may be used to dynamically shift control elements in applications such as a view field of camera, an image editing application, and an image viewer. In addition, various constituent units of the processor 202 for managing the display of images according to an embodiment of the present disclosure are described in FIG. 3.

The storage unit 204 may store a plurality of images. The storage unit 204 may include one or more computer-readable storage media. The storage unit 204 may include a non-volatile storage element. Inactive storage elements may include, for example, a magnetic hard disk, an optical disk, a floppy disk, a flash memory, or Electrically Programmable Memories (EPROM) or Electrically Erasable and Programmable Memories (EEPROM). Further, the storage unit 204 may be a non-transitory storage medium, in some embodiments. The term “non-transitory” may refer to a storage medium that is not implemented in a carrier wave or a propagated signal. However, the term “non-transient” should not be interpreted as the storage unit 204 is non-movable. In some embodiments, the storage unit 204 may store a greater amount of information than the memory. In certain embodiments, the non-transitory storage medium may store data (eg, random access memory (RAM) or cache) that may change over time.

The display 206 may display one or more resized images on one screen of the electronic device 100.

2 illustrates a limited embodiment of the electronic device 100, but this is only an example for describing the present disclosure, and the present disclosure is not limited thereto. The names or labels of each unit included in the block diagram are for explaining the present disclosure and are not limited thereto. Also, the electronic device 100 may include different units or sub-units that communicate with each of the different components. As such, the functions of each unit may be combined into a single unit or distributed to each other in different ways described herein without departing from the scope of the present invention.

3 is a detailed block diagram of a processor for generating a layout of an image according to an embodiment of the present disclosure.

3, the processor 202 may include units such as an individual image analysis unit 302, a display information unit 304, an image size calculation unit 306, and an image set analysis unit 304. I can.

As an example, the individual image analysis unit 302 includes an object detection unit 302a and an object analysis unit 302b. The object detection unit 302a may be configured to detect one or more objects in an image. The object detection unit 302a may use one or more object recognition techniques to detect one or more objects. The object detector 302a may detect coordinates of objects.

As an example, the object analysis unit 302b may be configured to receive coordinates of an object from the object detection unit 302a. In addition, the object analysis unit 302b performs an analysis such as counting the number of objects (indicated by C), the size of the object (indicated by S), and various features of the object (eg, face identification in an object) Can be configured. The object analysis unit 304 may be configured to process the image so that each image generates three outputs including the size of the object, the number of objects, and feature vectors for each object. In an embodiment, the weights w ₁ and w ₂ may be assigned to the count of objects and the size of objects, respectively.

In an embodiment, the display information unit 304 may be configured to provide display parameters such as a screen size. The display information unit 304 may provide display parameters to the image size calculation unit 306 as inputs.

In an embodiment, the image size calculation unit 306 may be configured to calculate the image size using weights w ₁ and w ₂ . The image size calculation unit 306 may be configured to calculate a final image size based on C and S provided from the object analysis unit 302b (provided weight) together with the input provided by the display information unit 304.

Further, in an embodiment, the image set analysis unit 308 includes a recognized object generation unit 308a, a metadata similarity determination unit 308b, and a background similarity analysis unit 308c. The recognized object generation unit 308a may be configured to receive an input from the object analysis unit 302b. In addition, the recognized object generator 308a may be configured to generate a feature vector of an object from an image.

In an embodiment, the metadata similarity determination unit 308b may be configured to extract metadata information (such as location and time) from the image when the image is captured. Metadata information can be used to determine similarity between images. In an embodiment, the metadata information may be a factor while selecting an image to be displayed in the final layout.

In an embodiment, the background similarity determination unit 308c may be configured to analyze backgrounds of images from a set and find similarities between the backgrounds. For example, the backgrounds of both images are ?forest? Or it could be a garden.

The image set analysis unit 308 sums the outputs to which the weights are applied from the recognized object generation unit 308a, the metadata similarity determination unit 308b, and the background similarity determination unit 308c, and ““weighted commonality score” You can calculate a value known as “commonality score)”. The weighted commonality score represents the degree of similarity of one image to other images in the same (image) set, other images in a folder, or other images in album images.

In an embodiment, the user experience (UX) policy preference unit 310 may be configured to apply a user experience policy for determining display of images. Based on the UX policy, the final layout of the images can be determined and displayed.

3 illustrates a limited overview of the processor 202, but is not limited thereto. The names or labels of each unit included in FIG. 3 are for explaining the present disclosure and are not limited thereto. Further, the processor 202 may include different units or sub-units that communicate with each of the different components. As such, the functions of each unit may be combined into a single unit or distributed to each other in different ways described herein without departing from the scope of the present invention.

4 is a flowchart illustrating a method for managing display of a plurality of images in an electronic device according to embodiments of the present disclosure. In one embodiment, in step S402, the method 400 includes detecting the number of objects in each image. The processor 202 may detect the number of objects in each image. In step S404, the method 400 includes determining a relative scaling factor for each image based on the number of objects. The processor 202 may determine a relative scaling factor of each image based on the number of objects. In step S406, the method 400 includes performing one or more operations on the images based on the relative scaling factor of each image. The processor 202 may perform operations on the images based on the relative scaling factor of each image.

Various operations, actions, blocks, steps, etc. in the method 400 may be performed in the order disclosed, may be performed in a different order, or may be performed simultaneously. In addition, in some embodiments, some actions, actions, blocks, steps, functions, etc. may be omitted, added, modified, skipped, or the like within the scope of the present invention. can do.

5 is a flowchart illustrating a method of resizing one or more images according to embodiments of the present disclosure. In one embodiment, in step S502, the method 500 includes detecting an object of each image. The processor 202 may detect the number of objects in each image. In step S504, the method 500 includes determining a relative scaling factor of each image based on the number of objects. The processor 202 may determine a relative scaling factor of each image based on the number of objects.

In step S506, the method 500 may include changing the size of one or more images based on a relative scaling factor of each image. The processor 202 may change the size of one or more images based on the relative scaling factor of each image. In operation S508, the method 500 may include displaying one or more resized images on one screen of the electronic device 100. The processor 202 may control the display 206 to display one or more resized images on the screen of the electronic device 100.

Various operations, actions, blocks, steps, etc. in the method 500 may be performed in the order disclosed, may be performed in a different order, or may be performed simultaneously. In addition, in some embodiments, some actions, actions, blocks, steps, functions, etc. may be omitted, added, modified, skipped, or the like within the scope of the present invention. can do.

6A to 8H are diagrams for explaining a comparison between the prior art for displaying a plurality of images in an electronic device and the present invention according to various embodiments of the present disclosure.

6A and 6B are diagrams illustrating a comparison between the prior art and the present invention when a gallery application of an electronic device displays a plurality of images according to embodiments of the present disclosure. 6A is a diagram illustrating a conventional technology in which a plurality of images are displayed in a gallery application in the electronic device 100. Referring to FIG. 6A, it can be seen that a plurality of images are displayed without taking into account objects (eg, the number of people) included in each image. Unlike the conventional system, FIG. 6B is a diagram illustrating that the sizes of a plurality of images are changed based on the number of people in each image.

Referring to FIG. 6B, it can be seen that an image with a larger number of people is resized to be larger and displayed. For example, an image with the most people may be resized and displayed as the largest, and an image with three people may be resized to be displayed larger than an image with two people. In addition, the image with one person may be changed in size to the smallest and displayed. In addition, among images with two people, an image including the whole body of a person on the image may be resized and displayed to be larger than an image including only the half body of the person. 6B illustrates that differently from FIG. 6A, the size of images is changed according to the number of objects in the image, and the layout and display order of the images are also changed and displayed according to the changed size of the images. However, this is only an example for describing the present disclosure, and the present disclosure is not limited thereto. For example, FIG. 6B shows that, while maintaining the layout of a plurality of images the same as that of FIG. 6A, each image is resized and displayed based on the number of objects in the image.

When the size of the images is changed as shown in FIG. 6B, the user can more clearly identify individual people from the group image (image with multiple people) through the electronic device 100. For example, in FIG. 6A, it may be difficult to identify individual people in an image with the most users. However, in FIG. 6B, the image with the largest number of people is displayed with the largest image size changed, so that the user can sufficiently recognize individual people in the image. That is, according to an embodiment of the present disclosure, by changing the size of an image based on the number of objects in each image in a plurality of images, the electronic device 100 can easily recognize the information or content of each image. It is possible to improve the user experience (UX) by displaying.

7A and 7B are diagrams showing a comparison between the prior art and the present invention when displaying a plurality of images in a collage according to embodiments of the present disclosure. 7A is a diagram illustrating a conventional technique in which a plurality of images are provided in a collage. Referring to FIG. 7A, it can be seen that a plurality of images are displayed without considering objects (eg, the number of people) included in each image. Unlike the conventional system, FIG. 7B is a diagram illustrating that the sizes of a plurality of images are changed based on the number of people in each image. That is, the images in the collage change size according to the number of objects in each image.

Referring to FIG. 7B, the image with the largest number of people is displayed in the largest size. Also, an image with three people is resized and displayed to be smaller than an image with the most people. In addition, an image with one person is resized and displayed to be smaller than an image with two people. That is, as shown in FIG. 7B, the size of each image in the collage is changed according to the number of people in each image.

Also, conventionally, when a collage is displayed in an album application, the electronic device 100 does not show the entire image of each image in the collage preview image, but displays a partial area of the image. However, according to an embodiment of the present disclosure, the electronic device 100 changes the size of the image according to the number of objects included in the image, so that information included in the image in the collage preview image (eg, content information such as a human face, etc.) ) Can be displayed so that the whole is visible. In FIGS. 7A and 7B, the layouts of the plurality of images are illustrated in the same manner, but this is only an exemplary embodiment for describing the present disclosure and is not limited thereto.

8A and 8B are diagrams illustrating a comparison between the prior art and the present invention when displaying a plurality of images in a multi-party video conference, according to embodiments of the present disclosure. 8A is a diagram showing a prior art for displaying people in a multi-party video conference. Referring to FIG. 8A, it can be seen that a plurality of images are displayed without considering the number of objects (eg, the number of people) in each image of a multi-party video conference. Unlike the prior art, FIG. 8B is a diagram for explaining that the size of a plurality of images is changed based on the number of people in each image of a multiparty video conference. FIG. 8 shows that the size of each image is changed according to the number of participants in the video conference.

8C and 8D are diagrams showing another comparison between the prior art and the present invention when displaying a plurality of images on a television showing two channels simultaneously according to embodiments of the present disclosure. FIG. 8C illustrates that when two channels are simultaneously displayed on a television, an image is displayed on a screen window corresponding to each channel at a certain moment. Unlike the prior art, FIG. 8D is a diagram illustrating that a window size of each channel is adjusted based on the number of objects in each window. Referring to FIG. 8D, the size of the window with three players is changed to be larger than the size of the window with one news anchor. That is, when the television shows two channels at the same time, the size of the windows can be dynamically adjusted based on the number of people in each window.

8E and 8F are diagrams illustrating another comparison between the prior art and the present invention in the case of displaying a plurality of images in video surveillance according to embodiments of the present disclosure. 8E is a diagram illustrating a prior art in which a plurality of images are displayed in video security. Conventionally, the number of objects in each image is not considered while a plurality of images are displayed. Unlike the prior art, FIG. 8F is a diagram illustrating that in a plurality of images, each image is changed in size based on the number of objects in each image. Referring to FIG. 8F, in video surveillance, video feeds are sized according to the number of objects.

8G and 8H are diagrams for explaining a comparison between the prior art in which images are displayed as a result of searching for an image on a web page and the present invention according to embodiments of the present disclosure. 8G is a diagram illustrating a conventional technique in which all images retrieved from a web page are displayed in the same size. Unlike the prior art, according to an embodiment of the present disclosure, FIG. 8H is a diagram illustrating that the searched images are displayed by changing their size according to the number of objects in each image. When images are loaded from a web page, the number of objects in each image may be calculated while the images are being loaded. Also, the size of the images may be dynamically changed based on the number of objects in each image, and the images with the changed size may be displayed in a web page.

8I and 8J are diagrams illustrating a scenario of displaying a plurality of images when one person leaves a multi-party video conference according to embodiments of the present disclosure. 8I shows that a multi-party video conference is in progress. During a video conference, one person 801 may leave the video conference. When one person 801 leaves during the video conference, the size of each image in the video conference may be changed based on the number of other people. 8J is a diagram illustrating an image after a person 801 leaves during a recall meeting. When one person 801 leaves the video conference, the images shown in FIG. 8I may be resized as shown in FIG. 8J. In addition, when one or more people join the conference during a video conference, images may be displayed after being changed in size according to the number of objects in the multi-party video conference.

The processor 202 may divide an area in which a plurality of images are displayed into n designated tile shapes. In addition, the processor 202 may control the display 260 to re-render and display an image whose size has been changed according to the number of objects included in each of the plurality of images in n tile shapes.

9 is a diagram illustrating a plurality of tiles according to embodiments of the present disclosure. Referring to FIG. 9, each icon represents a tile shape. Each tile can be changed in size based on the number of objects in each tile. Each of the application icons and folder icons may be images that may have objects such as a human face. Application icons and folders can be changed in size by calculating the number of objects. Application icons and folders may change in size in proportion to the number of objects. For example, an image size of an icon having more objects may be displayed relatively larger than an image size of icons having fewer objects.

10A and 10B are diagrams illustrating a comparison between the prior art and the present invention when displaying a plurality of images of an album cover in a music application according to embodiments of the present disclosure. 10A is a diagram illustrating a prior art showing images of an album cover. Referring to FIG. 10A, images of the album cover are displayed in the same size without considering the number of objects of each image of the album cover. On the other hand, FIG. 10B is a view showing that the size of images of the album cover is changed and displayed, unlike the conventional one. Referring to FIG. 10B, the album icon having the most objects is displayed with the largest size change.

11 is a flowchart illustrating a method for selecting one or more images according to embodiments of the present disclosure. In one embodiment, in step S1102, the method 1100 includes detecting the number of objects in each image. The processor 202 may detect the number of objects in each image. In step S1104, the method 1100 includes determining a relative scaling factor of each image based on the number of objects. The processor 202 may determine a scaling factor of each image based on the number of objects.

In step S1106, the method 1100 includes selecting one or more images based on the relative scaling factor of each image. The processor 202 may select one or more images based on the relative scaling factor of each image. In step S1108, the method 1100 includes displaying one or more resized images on a screen of the electronic device 100. The processor 202 may display one or more resized images on the screen of the electronic device 100.

Various operations, actions, blocks, steps, etc. in the method 1100 may be performed in the order disclosed, may be performed in a different order, or may be performed simultaneously. In addition, in some embodiments, some actions, actions, blocks, steps, functions, etc. may be omitted, added, modified, skipped, or the like within the scope of the present invention. can do.

12A and 12B are diagrams illustrating a comparison between the prior art and the present invention when a plurality of images are displayed in an SNS (Social Networking Site) according to embodiments of the present disclosure. 12A is a diagram illustrating a prior art in which images are displayed in an SNS. Referring to FIG. 12A, it can be seen that a plurality of images are displayed without considering the number of objects (eg, the number of people) in each image, or that a user must manually select an image for display. On the other hand, in FIG. 12B, unlike in the related art, a plurality of images in SNS may be dynamically selected based on the number of people in each image. Referring to FIG. 12B, in an image feed of SNS, images may be dynamically selected according to the number of objects, and the size may be changed and displayed.

13 is a flow diagram illustrating a method of cropping one or more images, according to embodiments of the present disclosure. In one embodiment, in step S1302, the method 1300 includes detecting the number of objects in each image. The processor 202 may detect the number of objects in each image. In step S1304, the method 1300 includes determining a relative scaling factor of each image based on the number of objects. The processor 202 may determine a relative scaling factor of each image based on the number of objects.

In step S1306, the method 1300 includes cropping one or more images based on the relative scaling factor of each image. The processor 202 may crop one or more images based on the relative scaling factor of each image. In step S1308, the method 1300 includes displaying one or more resized images on the screen of the electronic device 100. The processor 202 may display one or more resized images on the screen of the electronic device 100.

With the proposed method 1300, images can be cropped based on the relative scaling factor of each image. In addition, images whose size has been changed after being cut may be displayed on the screen of the electronic device 100. When the images are cropped, the user can sufficiently recognize the image, and the user experience can be increased while viewing the image.

Various operations, actions, blocks, steps, etc. in the method 1300 may be performed in the order disclosed, may be performed in a different order, or may be performed simultaneously. In addition, in some embodiments, some actions, actions, blocks, steps, functions, etc. may be omitted, added, modified, skipped, or the like within the scope of the present invention. can do.

14A and 14B are diagrams illustrating a comparison between the prior art and the present invention when displaying a plurality of images according to embodiments of the present disclosure. 14A is a diagram illustrating a conventional technique in which a plurality of images are displayed. As shown in FIG. 14A, according to an exemplary embodiment of the present disclosure, a cropping step may be performed on a plurality of images. 14B is a diagram illustrating that a cropped image is displayed with its size changed. In one embodiment, as shown in Fig. 14A, a salient region detection method is used to detect a salient region in each image. The images are resized so that the protruding area appears more prominent and larger. For example, the content of the guide plate 1410 of the first image of FIG. 14B has a larger image size than the guide plate 1410 of the fourth image of FIG. 14A, so that information in the image may be easily checked. The building of the second image of FIG. 14B is changed in size and displayed to be more clearly recognizable than the building of the fifth image of FIG. 14A. The bus in the third image of FIG. 14B is visually more clearly shown by cutting and resizing the bus in the third image in FIG. 14A.

15 is a flowchart illustrating a method for managing display of one image in an electronic device according to embodiments of the present disclosure. In one embodiment, in step S1502, method 1500 includes displaying a plurality of control elements on the image. Processor 202 may control the display to display a plurality of control elements on the image. In step S1504, the method 1500 includes detecting the number of objects in the image. The processor 202 may detect the number of objects in the image.

In step S1506, the method 1500 may include dynamically moving the positions of one or more control elements to an image area in which the number of objects on the image is detected as zero. The processor 202 may move the positions of one or more control elements to a region on the image where no object is detected.

In the proposed method 1500, image control elements are displayed on an image area where the number of objects is not detected. That is, unlike in the related art, the image control elements are moved and displayed on the image area to the area where the object is not detected, so that information and objects of the image can be fully recognized.

Various operations, actions, blocks, and steps in the method 1500 may be performed in the order disclosed, may be performed in a different order, or may be performed simultaneously. In addition, in some embodiments, some actions, actions, blocks, steps, functions, etc. may be omitted, added, modified, skipped, or the like within the scope of the present invention. can do.

16A and 16B are diagrams showing a comparison between the prior art and the present invention when control elements are displayed on an image editing application, according to embodiments of the present disclosure. 16A is a diagram showing a prior art in which an image editing application having image control elements is displayed. Referring to FIG. 16A, image control elements are spaced apart at default positions. When the image control elements are displayed on the image apart from the default position, information or objects in the image cannot be sufficiently recognized because the image control elements are displayed overlaid on the image. 16B is a diagram illustrating that, unlike the prior art, image control elements are moved to and displayed in an area of an image in which an object is not detected. Referring to Fig. 16B, image control elements are displayed on an image without an object. That is, in contrast to the prior art, when image control elements are displayed on an area of an image without an object, information and objects in the image can be sufficiently recognized. In a similar way, in a camera view finder application, image control elements can be displayed in an image area where the number of objects is detected as zero.

In this case, the image control elements may include a user manipulation menu or icon for capturing or editing an image. In addition, when the user manipulation menu is displayed in the form of an individual icon rather than a UI in the form of a menu, the electronic device 100 may control the display so that the icon is moved to an area where the number of object detections in the image is 0. have.

17A and 17D are diagrams showing a comparison between the prior art and the present invention when a caption of an image is displayed according to embodiments of the present disclosure.

17A and 17B are diagrams illustrating a comparison between the prior art and the present invention when a caption of an image is displayed on a web page according to embodiments of the present disclosure. 17A is a diagram showing a conventional technique in which a caption 1710 of an image is displayed under an image. On the other hand, unlike the prior art, FIG. 17B is a diagram illustrating that the caption 1710-1 of the image is overlaid on the image. In one embodiment, an appropriate position of a caption (eg, text) to be overlaid on an image is determined as an area where an object of the image is not detected. Also, as the caption is overlaid on the image, the size of the image may be changed to be larger and displayed.

In an embodiment, the processor 202 may determine a suitable font color and size for overlaid on an image. For example, the font color of the caption (caption) may be determined as a color that contrasts with the color of an image serving as a background of the caption. In addition, elements that determine the style of subtitles may be automatically updated or may be determined by a user command.

17C and 17D are diagrams showing another comparison between the prior art and the present invention when a caption of an image is displayed according to embodiments of the present disclosure. 17C is a diagram illustrating a conventional technique in which a caption of an image is displayed under an image. 17D is a diagram illustrating a plurality of images in which a caption of an image is overlaid on an image according to an embodiment of the present disclosure. For example, as shown in FIG. 17D, when there are a plurality of images overlaid with subtitles of an image on one web page, the processor 202 may display images overlaid with a plurality of subtitles in one gallery format. You can control the display. Also, the processor 202 may change the size of an image based on the number of objects in each image among a plurality of images displayed in a gallery form.

18A and 18B are diagrams illustrating an embodiment in which a wearable device searches for a caption on an image according to embodiments of the present disclosure. Referring to FIGS. 18A and 18B, a website related to a caption may be searched with a caption overlaid on an image on the wearable device 100. For example, an image having a caption in a wearable device may be displayed by overlaying the caption on the image. In this case, as the caption is overlaid on the image, the size of the image may be largely changed and displayed. The related content can be automatically retrieved from the website by clicking on the subtitle overlaid on the image.

19 is a diagram illustrating a computing environment implementing a method for managing a display of a plurality of images in an electronic device according to example embodiments of the present disclosure. As shown in FIG. 19, the computing environment of the electronic device 100 includes a processor 1904, an Arithmetic Logic Unit (ALU) 1906, a memory 1910, a storage unit 1912, and a plurality of networking devices 1916. ), and a plurality of input/output (I/O) devices 1914. The processing unit 1908 processes instructions of schemes. The processing unit 1908 receives commands from the processor 1904 for processing instructions. In addition, all logic and arithmetic operations related to the execution of instructions are computed with the aid of ALU 1906.

The entire computing environment of the electronic device 100 may be composed of a number of homogeneous and/or heterogeneous cores, a plurality of different types of CPUs, special media, and other accelerators. The processing unit 1908 serves to process instructions of the scheme. Also, the plurality of processing units 1908 may be located on a single chip or multiple chips.

Schemes including instructions and codes necessary for implementation are stored in memory 1910 or storage 1912 or both. Upon execution, instructions may be fetched from a corresponding memory 1910 or storage 1912 and executed by the processing unit 1908.

In the case of hardware implementation, various network devices 1916 or external I/O devices 1914 may be connected to a computing environment supporting implementation through a communication unit (not shown) and an input/output unit (not shown).

The embodiments disclosed in the present disclosure may be implemented through one or more software programs that execute on at least one hardware device and perform a network management function to control elements. The elements shown in FIGS. 1A to 20 include a block capable of combining one of at least one hardware device or a hardware device and a software module.

20 is a flowchart illustrating a method of changing and displaying an image size according to the number of objects included in a plurality of images, according to example embodiments.

In step S2010, the electronic device 100 recognizes a plurality of images. For example, when a new image is stored in an application that stores a plurality of images, such as a gallery application, the electronic device 100 may recognize the new image.

When the image is an image stored in the electronic device 100, the electronic device 100 may recognize the image before the image is stored in the electronic device 100. When the image is an image uploaded in real time through a web browser such as a website, the electronic device 100 may recognize the image while the image is being uploaded.

In step S2020, the electronic device 100 detects the number of objects included in each image. For example, the electronic device 100 may detect an object (eg, a human face) in the image by executing a program such as a face detector on the recognized image. The electronic device 100 may obtain the number of faces by detecting faces through a bounding box on each of all faces in the image. The electronic device 100 may store the contour box coordinate value and the number of faces as metadata together with the image file. A technology for detecting a face in an image is known, so a detailed description thereof will be omitted.

In operation S2030, the electronic device 100 may determine a scaling factor for each image based on the number of objects in the image. For example, the scaling factor may be to determine the size change ratio of each image. For example, the size change ratio of each image may be a value obtained by dividing the face area on the image by the entire image area.

In addition, the electronic device 100 uses at least one of color contrast, edge density, Bayesian integration, and superficial straddling of each image. It is also possible to determine a scaling factor according to the number of objects in the image. Since the equation for calculating the color contrast, edge density, Bayesian integration, and superficial straddling of an image is a known technique, detailed description is omitted do.

Also, the electronic device 100 may determine a scaling factor using salient regions, contrast, and gradient based on the object in the image.

The electronic device 100 may store information on the determined scaling factor as metadata.

In operation S2040, the electronic device 100 may change the size of at least one image among the plurality of images based on the scaling factor. Since the image size change according to the number of objects in the image has been described in detail in the present disclosure, a description thereof will be omitted here.

In operation S2050, the electronic device 100 changes at least one of a layout and a display order of the image whose size has been changed and displays it on one screen of the electronic device 100. For convenience of description of the present disclosure, it is assumed that each of the four images includes a different number of objects (eg, the number of people). For example, conventionally, in a gallery application, four images of the same size can be displayed on one screen. On the other hand, according to an embodiment of the present disclosure, the four images may be changed to different sizes according to the number of objects included in each image and displayed. In this case, each layout may be changed within a layout displaying four images, or a display order of each may also be changed.

In addition, as the size of the four images is changed, four images may be arranged so that a blank area is formed inside the layout for displaying all four images. In this case, the electronic device 100 may additionally display other images in the blank space and thus may display more than four images. Accordingly, the electronic device 100 may change the size of the image to clearly display the object of each image and display it, or may provide an additional image to the user to provide more information.

As another example, the electronic device 100 may select and display some images in which objects are clearly displayed among the four images. For example, the electronic device 100 may display three images in a layout in which four images can be displayed. Accordingly, the electronic device 100 may improve user experience (UX) by more clearly providing object information included in the image to the user.

In one embodiment of the present disclosure, the processor 202 may be configured with a RAM, a ROM, a graphic processing unit, a main CPU, first to n interfaces, and a bus. In this case, RAM, ROM, graphic processing unit, main CPU, first to n interfaces, etc. may be connected to each other through a bus.

RAM stores O/S and application programs. Specifically, when the electronic device 100 is booted, O/S may be stored in RAM, and various application data selected by the user may be stored in RAM.

The ROM stores an instruction set for booting the system. When the turn-on command is input and power is supplied, the main CPU copies the O/S stored in the memory to RAM according to the instruction stored in the ROM, and executes the O/S to boot the system. When booting is complete, the main CPU copies various application programs stored in the memory to RAM, and executes various operations by executing the application programs copied to the RAM.

The main CPU accesses the memory and performs booting using the O/S stored in the memory. And, the main CPU performs various operations using various programs, contents, data, etc. stored in the memory.

The first to nth interfaces are connected to the various components described above. One of the first to nth interfaces may be a network interface connected to an external device through a network.

A device (eg, modules or electronic device 100) or a method (eg, operations) according to various embodiments may be maintained in, for example, a computer-readable storage media. It may be executed by at least one computer (eg, processor 202) that executes instructions included in at least one of the programs.

When the command is executed by a computer (eg, the processor 202), the at least one computer may perform a function corresponding to the command. In this case, the computer-readable storage medium may be, for example, the memory.

Programs include, for example, hard disks, floppy disks, magnetic media (e.g., magnetic tape), optical media (e.g. CD-ROM (compact disc read only memory), DVD (digital versatile disc)) ), magnetic-optical media (e.g. floptical disk), hardware devices (e.g. read only memory (ROM), random access memory (RAM), or flash memory), etc. It may be included in a computer-readable storage medium.

In this case, the storage medium is generally included as a part of the configuration of the electronic device 100, but may be mounted through a port of the electronic device 100, or an external device located outside the electronic device 100 ( For example, it may be included in the cloud, server, or other electronic device). Also, the program may be divided and stored in a plurality of storage media, and in this case, at least some of the plurality of storage media may be located in an external device of the electronic device 100.

In addition, although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present disclosure claimed in the claims In addition, various modifications are possible by those of ordinary skill in the art, and these modifications should not be individually understood from the technical idea or perspective of the present disclosure.

202: processor
204: storage unit
206: display

Claims (20)

In the electronic device that performs image processing,
A display that displays a plurality of images on one screen; And
Detecting the number of objects included in each of the plurality of images,
Determining a scaling factor for at least one image among the plurality of images based on the number of detected objects,
As the number of the objects included in the at least one image increases based on a scaling factor for the at least one image, the relative size of the at least one image among the plurality of images is significantly changed (resizing),
And a processor configured to control the display to display at least one of a layout and a display order of the plurality of images based on the at least one image whose size has been changed. delete The method of claim 1,
The processor,
An electronic device that controls the display to selectively display images in which the object included on the image occupies a high proportion of the image among the images whose size has been changed among the plurality of images. The method of claim 1,
The processor,
A region of interest (ROI) of each of the plurality of images is determined, a region containing the object is cut from at least one image of the plurality of images based on the determined ROIs of each of the plurality of images, and An electronic device that controls the display to display an image. The method of claim 1,
The processor,
When one of the plurality of images is selected and a user manipulation menu is displayed overlaid on the selected image, the user manipulation menu is moved from the selected image area to an area where the object is not detected, and the display is displayed. Controlling electronic device. The method of claim 1,
The processor,
The area in which the plurality of images are displayed is divided into designated n tile shapes, and the image whose size is changed according to the number of the objects included in each of the plurality of images is re-rendered in each of the n tile shapes (re- An electronic device that controls the display to display through rendering. The method of claim 1,
The processor,
When the object is included in the image and a caption describing the image is displayed separately from the image, the caption is overlaid on the image, and the size of the image is changed and displayed. The electronic device that controls the display. The method of claim 1,
The processor,
An electronic device that determines the scaling factor by comparing the number of the objects included in each image of the plurality of images. The method of claim 1,
The processor,
An electronic device that detects the object using at least one of color contrast, edge density, Bayesian integration, and superficial straddling. The method of claim 1,
It further includes a storage unit,
The processor,
When an image is stored in the storage unit, the number of objects included in the image is determined before being stored in the storage unit, and the determined number of objects of the image is stored in the storage unit together with the image,
When an image is loaded in the electronic device in real time, the number of objects included in the image is determined while the image is being loaded, and the determined number of objects of the image is stored in the storage unit together with the image information. Electronic device. In the image processing method in an electronic device,
Recognizing a plurality of images in the electronic device;
Detecting the number of objects included in each of the plurality of images;
Determining a scaling factor for at least one image among the plurality of images based on the detected number of objects;
Resizing a relative size of the at least one image among the plurality of images as the number of objects included in the at least one image increases based on a scaling factor for the at least one image; And
And displaying the plurality of images on one screen of an electronic device by reordering at least one of a layout and a display order of the plurality of images based on the at least one image whose size has been changed. . delete The method of claim 11,
The displaying step,
A method of selectively displaying images having a high ratio of the object included on the image to the image among the images whose size is changed among the plurality of images. The method of claim 11,
Determining a region of interest (ROI) of each of the plurality of images;
Cutting a region including the object from at least one image of the plurality of images based on the determined ROIs of each of the plurality of images;
Displaying the image of the cropped area; The method further comprising. The method of claim 11,
When one of the plurality of images is selected and the user manipulation menu is displayed overlaid on the selected image, the user manipulation menu is moved from the selected image area to an area where the object is not detected and displayed; How to include more. The method of claim 11,
Dividing an area in which the plurality of images are displayed into designated n-tile shapes;
Re-rendering and displaying the image whose size has been changed according to the number of the objects included in each of the plurality of images in each of the n tile shapes. The method of claim 11,
When the object is included in the image and the caption describing the image is displayed separately from the image, overlaying the caption on the image and changing the size of the image to display How to further include; The method of claim 11,
The step of determining the scaling factor,
A method of determining the scaling factor by comparing the number of the objects included in each image of the plurality of images. The method of claim 11,
The detecting step,
A method of detecting the object using at least one of color contrast, edge density, Bayesian integration, and superficial straddling. The method of claim 11,
When an image is stored in the electronic device, determining the number of objects included in the image before being stored in the electronic device, and storing the determined number of objects in the image together with the image in the electronic device; And
When an image is loaded into the electronic device in real time, the number of objects included in the image is determined while the image is being loaded, and the determined number of objects of the image is stored in the electronic device together with the image information. Step; The method further comprising.

Images