KR20210072498A - Electronic device for changing display of designated area of display and operating method thereof - Google Patents

Abstract

An electronic device according to an embodiment comprises: a display; a camera module configured to be positioned below the display; a memory for storing instructions; and a processor configured to be functionally connected to the display, the camera module, and the memory. By executing the instructions, the processor is configured in that the electronic device identifies a change in the operating state of the camera module while displaying a predetermined image in an area surrounding the camera module among areas of the display, responds to identifying a change in the operating state of the camera module, changes the size of the area surrounding the camera module, and displays the predetermined image in the changed area. Even when the camera module is positioned below the display, the quality of the image acquired by the camera module may not deteriorate.

Description

ELECTRONIC DEVICE FOR CHANGING DISPLAY OF DESIGNATED AREA OF DISPLAY AND OPERATING METHOD THEREOF

Various embodiments relate to an electronic device for changing a display on a designated area of a display, and an operating method thereof.

Electronic devices are developing in a direction in which a bezel of a surface on which a display is positioned is minimized. In order to minimize the bezel of the electronic device, various components (eg, a camera module, a sensor module) that were previously positioned on a surface on which the display is positioned are being changed to be positioned under the display.

When the camera module is disposed under the display, light from the display may be reflected within the electronic device and recognized by the camera module. When the light of the display is recognized by the camera module, the quality of the image acquired by the camera module may be deteriorated.

Accordingly, even when the camera module is disposed under the display, it is necessary to study a method for preventing the quality of the image acquired by the camera module from being deteriorated.

The technical problems to be achieved in this document are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by those of ordinary skill in the art to which the present invention belongs from the description below. There will be.

An electronic device according to various embodiments is configured to be functionally connected to a display, a camera module configured to be positioned under the display, a memory for storing instructions, and the display, the camera module, and the memory a processor configured to: change the operating state of the camera module while the electronic device displays a predetermined image in a region surrounding the camera module among regions of the display by executing the instructions and in response to identifying a change in the operating state of the camera module, change the size of the area surrounding the camera module, and display the predefined image in the changed area.

A method of operating an electronic device according to various embodiments of the present disclosure includes identifying a change in an operating state of the camera module while displaying a predetermined image in a region surrounding a camera module positioned below the display among regions of a display. operation, in response to identifying a change in the operating state of the camera module, changing the size of the area surrounding the camera module, and displaying the predetermined image in the changed area.

The electronic device and the method of operating the same according to various embodiments of the present disclosure may not degrade the quality of an image acquired by the camera module even when the camera module is disposed under the display.

Effects obtainable in the present disclosure are not limited to the above-mentioned effects, and other effects not mentioned may be clearly understood by those of ordinary skill in the art to which the present disclosure belongs from the description below. will be.

1 is a block diagram of an electronic device in a network environment according to various embodiments of the present disclosure;
2 is a block diagram illustrating a program according to various embodiments.
3 is a block diagram illustrating a camera module, according to various embodiments.
4A is a diagram illustrating an electronic device according to an embodiment.
4B is a diagram illustrating at least a portion of a cross-section of an electronic device according to an embodiment.
4C is a diagram illustrating at least a portion of a cross-section of an electronic device according to an embodiment.
5A is a diagram illustrating a change in a circular cutout stroke in an electronic device according to an exemplary embodiment.
5B is a diagram illustrating a change in a 'U'-shaped cutout stroke in an electronic device according to an exemplary embodiment.
5C is a diagram illustrating a change in a 'V'-shaped cutout stroke in an electronic device according to an exemplary embodiment.
5D is a diagram illustrating a change in a planar cutout stroke in an electronic device according to an exemplary embodiment.
5E is a diagram illustrating a change in a rectangular cutout stroke in an electronic device according to an exemplary embodiment.
6 is a flowchart illustrating an operation of changing a cutout stroke in an electronic device according to an embodiment.
7 is a flowchart illustrating an operation of changing a display of a display in an electronic device according to an embodiment.
8 is a flowchart illustrating an operation of thickening a cutout stroke in an electronic device according to an exemplary embodiment.
9 is a flowchart illustrating an operation of thinly changing a cutout stroke in an electronic device according to an exemplary embodiment.
10A is a flowchart illustrating an operation of changing a cutout stroke while acquiring an image in an electronic device, according to an embodiment.
10B is a diagram illustrating an image acquired by an electronic device according to an embodiment.
11 is a flowchart illustrating an operation of thickening a cutout stroke while acquiring an image in an electronic device according to an embodiment.
12 is a flowchart illustrating an operation of thinly changing a cutout stroke while acquiring an image in an electronic device, according to an embodiment.
13 is a flowchart illustrating an operation of changing a display of a display in an electronic device according to an embodiment.

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments. Referring to FIG. 1 , in a network environment 100 , an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input device 150 , a sound output device 155 , a display device 160 , an audio module 170 , and a sensor module ( 176 , interface 177 , haptic module 179 , camera module 180 , power management module 188 , battery 189 , communication module 190 , subscriber identification module 196 , or antenna module 197 . ) may be included. In some embodiments, at least one of these components (eg, the display device 160 or the camera module 180 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components may be implemented as one integrated circuit. For example, the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented while being embedded in the display device 160 (eg, a display).

The processor 120, for example, executes software (eg, the program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be loaded into the volatile memory 132 , process commands or data stored in the volatile memory 132 , and store the resulting data in the nonvolatile memory 134 . According to an embodiment, the processor 120 includes a main processor 121 (eg, a central processing unit or an application processor), and a secondary processor 123 (eg, a graphics processing unit, an image signal processor) that can be operated independently or together with the main processor 121 , a sensor hub processor, or a communication processor). Additionally or alternatively, the auxiliary processor 123 may be configured to use less power than the main processor 121 or to be specialized for a designated function. The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The auxiliary processor 123 may be, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or when the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display device 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to an embodiment, the co-processor 123 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, the camera module 180 or the communication module 190). have.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176 ) of the electronic device 101 . The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input device 150 may receive a command or data to be used by a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input device 150 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (eg, a stylus pen).

The sound output device 155 may output a sound signal to the outside of the electronic device 101 . The sound output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback, and the receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display device 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display device 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the corresponding device. According to an embodiment, the display device 160 may include a touch circuitry configured to sense a touch or a sensor circuit (eg, a pressure sensor) configured to measure the intensity of a force generated by the touch. have.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input device 150 , or an external electronic device (eg, a sound output device 155 ) connected directly or wirelessly with the electronic device 101 . The sound may be output through the electronic device 102 (eg, a speaker or a headphone).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more designated protocols that may be used for the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a local area network (LAN) communication module, or a power line communication module). Among these communication modules, a corresponding communication module is a first network 198 (eg, a short-range communication network such as Bluetooth, WiFi direct, or IrDA (infrared data association)) or a second network 199 (eg, a cellular network, the Internet, or It may communicate with an external electronic device via a computer network (eg, a telecommunication network such as a LAN or WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified and authenticated.

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module may include one antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas. In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, RFIC) other than the radiator may be additionally formed as a part of the antenna module 197 .

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( e.g. commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the electronic devices 102 and 104 may be the same or a different type of the electronic device 101 . According to an embodiment, all or part of the operations executed in the electronic device 101 may be executed in one or more of the external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 needs to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. The one or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this purpose, for example, cloud computing, distributed computing, or client-server computing technology may be used.

2 is a block diagram 200 illustrating a program 140 in accordance with various embodiments. According to an embodiment, the program 140 executes an operating system 142 , middleware 144 , or an application 146 executable in the operating system 142 for controlling one or more resources of the electronic device 101 . may include Operating system 142 may include, for example, Android ^TM , iOS ^TM , Windows ^TM , Symbian ^TM , Tizen ^TM , or Bada ^TM . At least some of the programs 140 are, for example, preloaded into the electronic device 101 at the time of manufacture, or an external electronic device (eg, the electronic device 102 or 104 ), or a server (eg, the electronic device 102 or 104 ) when used by a user ( 108)) or may be updated.

The operating system 142 may control management (eg, allocation or retrieval) of one or more system resources (eg, a process, memory, or power) of the electronic device 101 . The operating system 142 may additionally or alternatively include other hardware devices of the electronic device 101 , for example, the input device 150 , the sound output device 155 , the display device 160 , and the audio module 170 . , sensor module 176 , interface 177 , haptic module 179 , camera module 180 , power management module 188 , battery 189 , communication module 190 , subscriber identification module 196 , or It may include one or more driver programs for driving the antenna module 197 .

The middleware 144 may provide various functions to the application 146 so that functions or information provided from one or more resources of the electronic device 101 may be used by the application 146 . The middleware 144 includes, for example, an application manager 201 , a window manager 203 , a multimedia manager 205 , a resource manager 207 , a power manager 209 , a database manager 211 , and a package manager 213 . ), connectivity manager 215 , notification manager 217 , location manager 219 , graphics manager 221 , security manager 223 , call manager 225 , voice recognition manager 227 , or camera manager (229).

The application manager 201 may manage the life cycle of the application 146 , for example. The window manager 203 may manage one or more GUI resources used in a screen, for example. The multimedia manager 205, for example, identifies one or more formats required for playback of media files, and encodes or decodes a corresponding media file among the media files using a codec suitable for the selected format. can be done The resource manager 207 may manage the space of the source code of the application 146 or the memory of the memory 130 , for example. The power manager 209 may, for example, manage the capacity, temperature, or power of the battery 189 , and determine or provide related information necessary for the operation of the electronic device 101 by using the corresponding information. . According to an embodiment, the power manager 209 may interwork with a basic input/output system (BIOS) (not shown) of the electronic device 101 .

The database manager 211 may create, retrieve, or change a database to be used by the application 146 , for example. The package manager 213 may manage installation or update of an application distributed in the form of a package file, for example. The connectivity manager 215 may manage, for example, a wireless connection or a direct connection between the electronic device 101 and an external electronic device. The notification manager 217 may provide, for example, a function for notifying the user of the occurrence of a specified event (eg, an incoming call, a message, or an alarm). The location manager 219 may manage location information of the electronic device 101 , for example. The graphic manager 221 may manage, for example, one or more graphic effects to be provided to a user or a user interface related thereto.

Security manager 223 may provide, for example, system security or user authentication. The telephony manager 225 may manage, for example, a voice call function or a video call function provided by the electronic device 101 . The voice recognition manager 227, for example, transmits the user's voice data to the server 108, and based at least in part on the voice data, a command corresponding to a function to be performed in the electronic device 101; Alternatively, the converted text data may be received from the server 108 based at least in part on the voice data. According to an embodiment, the middleware 144 may dynamically delete some existing components or add new components. According to an embodiment, at least a portion of the middleware 144 may be included as a part of the operating system 142 or implemented as software separate from the operating system 142 .

In an embodiment, the camera manager 229 may control the power of the camera module 180 (eg, turn-on or turn-off) or a function of the camera module 180 (eg, illuminance measurement, brightness, resolution, or focus). ) can be controlled. In an embodiment, the camera manager 229 may drive the camera module 180 in response to a request from the operating system 142 , the middleware 144 , or the operating system 142 . In an embodiment, the camera manager 229 may control a function of the camera module 180 in response to a request from the operating system 142 , the middleware 144 , or the operating system 142 .

Application 146 includes, for example, home 251 , dialer 253 , SMS/MMS 255 , instant message (IM) 257 , browser 259 , camera 261 , alarm 263 . , contact 265, voice recognition 267, email 269, calendar 271, media player 273, album 275, watch 277, health 279 (such as exercise or blood sugar) measuring biometric information), or environmental information 281 (eg, measuring atmospheric pressure, humidity, or temperature information). According to an embodiment, the application 146 may further include an information exchange application (not shown) capable of supporting information exchange between the electronic device 101 and an external electronic device. The information exchange application may include, for example, a notification relay application configured to transmit specified information (eg, call, message, or alarm) to an external electronic device, or a device management application configured to manage the external electronic device. have. The notification relay application, for example, transmits notification information corresponding to a specified event (eg, mail reception) generated in another application (eg, the email application 269 ) of the electronic device 101 to the external electronic device. can Additionally or alternatively, the notification relay application may receive notification information from the external electronic device and provide it to the user of the electronic device 101 .

The device management application is, for example, a power (eg, turn-on or turn-off) or function (eg, turn-on or turn-off) or function (eg, turn-on or turn-off) of an external electronic device or some component thereof (eg, the display device 160 ) communicating with the electronic device 101 For example, the brightness, resolution, or focus of the display device 160 may be controlled. The device management application may additionally or alternatively support installation, deletion, or update of an application operating in an external electronic device.

3 is a block diagram 300 illustrating a camera module 180, in accordance with various embodiments. Referring to FIG. 3 , the camera module 180 includes a lens assembly 310 , a flash 320 , an image sensor 330 , an image stabilizer 340 , a memory 350 (eg, a buffer memory), or an image signal processor. (360). The lens assembly 310 may collect light emitted from a subject, which is an image to be captured. The lens assembly 310 may include one or more lenses. According to an embodiment, the camera module 180 may include a plurality of lens assemblies 310 . In this case, the camera module 180 may form, for example, a dual camera, a 360 degree camera, or a spherical camera. Some of the plurality of lens assemblies 310 may have the same lens properties (eg, angle of view, focal length, auto focus, f number, or optical zoom), or at least one lens assembly may be a different lens assembly. It may have one or more lens properties different from the lens properties of . The lens assembly 310 may include, for example, a wide-angle lens or a telephoto lens.

The flash 320 may emit light used to enhance light emitted or reflected from the subject. According to an embodiment, the flash 320 may include one or more light emitting diodes (eg, a red-green-blue (RGB) LED, a white LED, an infrared LED, or an ultraviolet LED), or a xenon lamp. can The image sensor 330 may acquire an image corresponding to the subject by converting light emitted or reflected from the subject and transmitted through the lens assembly 310 into an electrical signal. According to an embodiment, the image sensor 330 may include, for example, one image sensor selected from among image sensors having different properties, such as an RGB sensor, a black and white (BW) sensor, an IR sensor, or a UV sensor, the same It may include a plurality of image sensors having a property, or a plurality of image sensors having different properties. Each image sensor included in the image sensor 330 may be implemented using, for example, a charged coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor.

In response to the movement of the camera module 180 or the electronic device 101 including the same, the image stabilizer 340 moves at least one lens or the image sensor 330 included in the lens assembly 310 in a specific direction or Operation characteristics of the image sensor 330 may be controlled (eg, read-out timing may be adjusted, etc.). This makes it possible to compensate for at least some of the negative effects of the movement on the image being taken. According to an embodiment, the image stabilizer 340 is, according to an embodiment, the image stabilizer 340 is a gyro sensor (not shown) or an acceleration sensor (not shown) disposed inside or outside the camera module 180 . Such a movement of the camera module 180 or the electronic device 101 may be detected using . According to an embodiment, the image stabilizer 340 may be implemented as, for example, an optical image stabilizer. The memory 350 may temporarily store at least a portion of the image acquired through the image sensor 330 for a next image processing operation. For example, when image acquisition is delayed according to the shutter or a plurality of images are acquired at high speed, the acquired original image (eg, Bayer-patterned image or high-resolution image) is stored in the memory 350 and , a copy image corresponding thereto (eg, a low-resolution image) may be previewed through the display device 160 . Thereafter, when a specified condition is satisfied (eg, a user input or a system command), at least a portion of the original image stored in the memory 350 may be obtained and processed by, for example, the image signal processor 360 . According to an embodiment, the memory 350 may be configured as at least a part of the memory 130 or as a separate memory operated independently of the memory 130 .

The image signal processor 360 may perform one or more image processing on an image acquired through the image sensor 330 or an image stored in the memory 350 . The one or more image processes may include, for example, depth map generation, three-dimensional modeling, panorama generation, feature point extraction, image synthesis, or image compensation (eg, noise reduction, resolution adjustment, brightness adjustment, blurring ( blurring, sharpening, or softening. Additionally or alternatively, the image signal processor 360 may include at least one of the components included in the camera module 180 (eg, an image sensor). 330), for example, exposure time control, readout timing control, etc. The image processed by the image signal processor 360 is stored back in the memory 350 for further processing. or may be provided as an external component of the camera module 180 (eg, the memory 130, the display device 160, the electronic device 102, the electronic device 104, or the server 108). According to an example, the image signal processor 360 may be configured as at least a part of the processor 120 or a separate processor operated independently of the processor 120. The image signal processor 360 may be configured as the processor 120 and a separate processor, the at least one image processed by the image signal processor 360 may be displayed through the display device 160 as it is or after additional image processing is performed by the processor 120 .

According to an embodiment, the electronic device 101 may include a plurality of camera modules 180 each having different properties or functions. In this case, for example, at least one of the plurality of camera modules 180 may be a wide-angle camera, and at least the other may be a telephoto camera. Similarly, at least one of the plurality of camera modules 180 may be a front camera, and at least the other may be a rear camera.

The electronic device according to various embodiments disclosed in this document may have various types of devices. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

It should be understood that the various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, and “A , B, or C" each may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as “first”, “second”, or “first” or “second” may simply be used to distinguish the component from other components in question, and may refer to components in other aspects (e.g., importance or order) is not limited. that one (eg first) component is “coupled” or “connected” to another (eg, second) component with or without the terms “functionally” or “communicatively” When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

As used herein, the term “module” may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic block, component, or circuit. A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document include one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101). may be implemented as software (eg, the program 140) including For example, the processor (eg, the processor 120 ) of the device (eg, the electronic device 101 ) may call at least one of the one or more instructions stored from the storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the at least one command called. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not include a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided in a computer program product (computer program product). Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store (eg Play Store ^TM ) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly, online between smartphones (eg: smartphones). In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, a module or a program) of the above-described components may include a singular or a plurality of entities. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

4A is a diagram illustrating an electronic device 401 according to an embodiment. In an embodiment, the description of FIG. 4A may refer to FIGS. 1 to 3 . According to an embodiment, the electronic device 401 of FIG. 4A may correspond to the electronic device 101 of FIG. 1 . In an embodiment, the display panel 402 of FIG. 4A may be included in the display device 160 of FIG. 1 .

Referring to FIG. 4A , on the display panel 402 of the electronic device 401 , a camera module (eg, the camera module 180 of FIG. 1 ) may include an area 403 for acquiring an image. In an embodiment, the area 403 for acquiring an image may be an area corresponding to an angle of view of the camera module 180 . In an embodiment, the region 403 for acquiring an image may also be referred to as a region surrounding the camera module 180 .

Referring to FIG. 4A , a cutout stroke 404 may exist around the area 403 for acquiring an image. In an embodiment, the cutout stroke 404 may be an area on the display panel 402 that is set to express a predetermined color (eg, black).

In an embodiment, the electronic device 401 may display a predetermined color and/or a predetermined image in an area of the display panel 402 corresponding to the cutout stroke 404 in advance in the cutout stroke 404 . A specified color can be expressed.

In an embodiment, the electronic device 401 may turn off an area of the display panel 402 corresponding to the cutout stroke 404 to display a color preset in the cutout stroke 404 . can express

In an embodiment, the region surrounding the camera module 180 may include the region 403 and/or the cutout stroke 404 for acquiring an image.

4B is a diagram illustrating at least a portion of a cross-section of an electronic device 401 according to an exemplary embodiment. In an embodiment, FIG. 4B may illustrate a cross-section between S1 and S2 of the electronic device 401 of FIG. 4A . In an embodiment, the display panel 420 of FIG. 4B may be included in the display device 160 of FIG. 1 . In an embodiment, the camera module 180 of FIG. 4B may correspond to the camera module 180 of FIG. 1 . In an embodiment, the description of FIG. 4B may refer to FIGS. 1 to 3 .

In an embodiment, the window 410 may form one surface of the electronic device 101 .

In an embodiment, the display panel 420 may be disposed under the window 410 and include a hole 425 . In one embodiment, the hole 425 may also be referred to as an opening. In an embodiment, the hole 425 may be implemented in a shape surrounding the camera module 180 when the electronic device 101 is viewed from above (a direction from top to bottom in FIG. 4A ). In an embodiment, the hole 425 may be implemented in the form of a circle, an ellipse, a polygon, or a combination thereof. In an embodiment, the display panel 420 may also be referred to as a display.

In an embodiment, the hole 425 may be a region from which the display panel 420 is removed. In an embodiment, the hole 425 may be an area in which the display panel 420 is transparent. In an embodiment, the hole 425 generated by removing the display panel 420 may also be referred to as a punch hole or a through hole. In an embodiment, the hole 425 generated by making the display panel 420 transparent may also be referred to as a glass hole or a transparent hole.

In an embodiment, the camera module 180 is disposed below the display panel 420 and may be viewed through the window 410 . In an embodiment, the camera module 180 may acquire an image by detecting light passing through the window 410 and the hole 425 of the display panel 420 . In an embodiment, an area in which the camera module 180 is directly viewed among the area of the window 410 may be referred to as a camera area 421 . In an embodiment, the camera area 421 may also be referred to as an area covering the camera module 180 .

In an embodiment, when the user looks at the hole area 411 , the camera module 180 may be identified through the transparent window 410 and the hole 425 . In an embodiment, the hole area 411 excluding the camera area 421 may be displayed in a color (eg, black) that is preset to the user. In an embodiment, a black matrix may be disposed between pixels of the display panel 420 so that the hole area 411 excluding the camera area 421 is displayed in a color (eg, black) preset to the user. have. In an embodiment, the black matrix may not be disposed in the camera area 421 .

In an embodiment, the processor 120 of the electronic device 101 is configured to display a predetermined color and/or a predetermined image in an area of the display panel 420 corresponding to the cutout stroke 430 . ) can be controlled. In an embodiment, the preset color may be black. In an embodiment, the predefined image may be an image having a black color.

In an embodiment, the processor 120 of the electronic device 101 controls the display panel 420 to turn off an area of the display panel 420 corresponding to the cutout stroke 430 . can do. In an embodiment, when the area of the display panel 420 corresponding to the cutout stroke 430 is turned off, the area of the display panel 420 corresponding to the cutout stroke 430 is black by the black matrix. can be shown as

In an embodiment, the processor 120 may change the size and/or shape of the cutout stroke 430 according to the operating state of the electronic device 101 . In an embodiment, the processor 120 may change the cutout stroke 430 to be thicker when the camera module 180 is in an image capturing state. In an embodiment, when the camera module 180 is in a turned-off state or an illuminance measurement state, the processor 120 may change the cutout stroke 430 to be thinner.

In an embodiment, the hole area 411 may correspond to the area 403 for acquiring the image of FIG. 4A .

In FIG. 4B , the region corresponding to the cutout stroke 430 and the hole region 411 are exemplified as being separated, but this is only an example. In an embodiment, a region of the hole region 411 excluding the camera region 421 may be included in the region corresponding to the cutout stroke 430 . In an embodiment, when an area of the hole area 411 excluding the camera area 421 is included in the area corresponding to the cutout stroke 430 , the area surrounding the camera module 180 is the cutout stroke 430 . ) and a camera area 421 .

4C is a diagram illustrating at least a portion of a cross-section of an electronic device 401 according to an embodiment. In an embodiment, FIG. 4C may illustrate a cross-section between S1 and S2 of the electronic device 401 of FIG. 4A . In an embodiment, the display panel 420 of FIG. 4C may be included in the display device 160 of FIG. 1 . In an embodiment, the camera module 180 of FIG. 4C may correspond to the camera module 180 of FIG. 1 . In an embodiment, the description of FIG. 4C may refer to FIGS. 1 to 3 . Among the descriptions of FIG. 4C , descriptions that overlap with those of FIG. 4B may be omitted.

In an embodiment, the window 410 may form one surface of the electronic device 101 .

In an embodiment, the display panel 420 may be disposed under the window 410 . In one embodiment, light may pass through the display panel 420 . In an embodiment, light may pass through the display panel 420 through spaces between pixels of the display panel 420 . In an embodiment, light may pass through the display panel 420 through spaces between pixels of the display panel 420 and/or through spaces between black matrices.

In an embodiment, the camera module 180 may be disposed under the display panel 420 . In an embodiment, the camera module 180 may acquire an image by detecting light passing through the window 410 and the display panel 420 . In an embodiment, an area in which the camera module 180 is located among the area of the window 410 may be referred to as a camera area 421 .

In an embodiment, when the display panel 420 is turned off, the camera cover area 412 may be displayed to the user in a preset color (eg, black). In an embodiment, a black matrix may be disposed between the display panel 420 and the camera module 180 so that the camera cover area 412 is displayed in a color (eg, black) preset to the user. In an embodiment, the black matrix may not be disposed in the camera area 421 . In an embodiment, the camera cover area 412 may be an area surrounding the camera module 180 .

In an embodiment, the processor 120 of the electronic device 101 is configured to display a predetermined color and/or a predetermined image in an area of the display panel 420 corresponding to the cutout stroke 430 . ) can be controlled.

In an embodiment, the processor 120 may control the display panel 420 to turn off an area of the display panel 420 corresponding to the cutout stroke 430 . In an embodiment, when the area of the display panel 420 corresponding to the cutout stroke 430 is turned off, the area of the display panel 420 corresponding to the cutout stroke 430 is black by the black matrix. can be shown as

In one embodiment, the processor 120 corresponds to the camera cover area 412 while displaying a predefined color and/or a predefined image in the area of the display panel 420 corresponding to the cutout stroke 430 . The display panel 420 may be controlled to display a predetermined color and/or a predetermined image in an area of the display panel 420 to be displayed. In one embodiment, the processor 120 corresponds to the camera cover area 412 while displaying a predefined color and/or a predefined image in the area of the display panel 420 corresponding to the cutout stroke 430 . It is possible to control the display panel 420 to turn off the area of the display panel 420 .

In an embodiment, the processor 120 turns off the area of the display panel 420 corresponding to the cutout stroke 430 , while the area of the display panel 420 corresponds to the camera cover area 412 . may control the display panel 420 to display a preset color and/or a preset image. In an embodiment, the processor 120 turns off the area of the display panel 420 corresponding to the cutout stroke 430 , while the area of the display panel 420 corresponds to the camera cover area 412 . may be controlled to turn off the display panel 420 .

In an embodiment, the processor 120 may change the size and/or shape of the cutout stroke 430 according to the operating state of the electronic device 101 . In an embodiment, the processor 120 may change the cutout stroke 430 to be thicker when the camera module 180 is in an image capturing state. In an embodiment, when the camera module 180 is in a turned-off state or an illuminance measurement state, the processor 120 may change the cutout stroke 430 to be thinner.

In an embodiment, the camera cover area 412 may correspond to the area 403 for acquiring the image of FIG. 4A .

In FIG. 4C , the region corresponding to the cutout stroke 430 and the region of the camera cover region 412 are exemplified as being separated, but this is only an example. In an embodiment, an area of the camera cover area 412 excluding the camera area 421 may be included in the area corresponding to the cutout stroke 430 . In an embodiment, when the area excluding the camera area 421 of the camera cover area 412 is included in the area corresponding to the cutout stroke 430 , the area surrounding the camera module 180 is the cutout stroke ( It may be divided into an area corresponding to 430 and a camera area 421 .

5A is a diagram illustrating a change in a circular cutout stroke in the electronic device 501 according to an exemplary embodiment.

Referring to FIG. 5A , the camera area 510 may be an area in which a camera module (eg, the camera module 180 of FIG. 1 ) is located. According to an embodiment, the electronic device 501 (eg, the electronic device 101 of FIG. 1 ) may have a structure as shown in FIG. 4A . According to an embodiment, the electronic device 501 may have a structure as shown in FIG. 4B . In an embodiment, the camera area 510 of FIG. 5A may correspond to the camera area 421 and/or the area of the hole 411 of FIG. 4A . In an embodiment, the camera area 510 of FIG. 5A may correspond to the camera area 421 and/or the camera cover area 412 of FIG. 4B .

Referring to FIG. 5A , the cutout strokes 521 and 531 surrounding the camera area 510 may have a circular shape.

In an embodiment, the electronic device 501 may display a cutout stroke corresponding to the operating state of the camera module 180 on the display panel 502 . In an embodiment, when the operating state of the camera module 180 is a turn-off state or an illuminance measurement state, the electronic device 501 may display a cutout stroke 521 on the display panel 502 . . In an embodiment, when the operating state of the camera module 180 is an image capturing state, the electronic device 501 may display a cutout stroke 531 on the display panel 502 .

In an embodiment, when the operating state of the camera module 180 is changed, the electronic device 501 may change the size and/or shape of the cutout stroke. In an embodiment, when the camera module 180 changes from the image capturing state to the turn-off state or the illuminance measurement state, the size of the cutout stroke 531 may be changed to correspond to the cutout stroke 521 . In an embodiment, when the camera module 180 is changed from the turn-off state or the illuminance measurement state to the image capturing state, the size of the cutout stroke 521 may be changed to correspond to the cutout stroke 531 .

In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4B , the electronic device 501 pre-applies to the area of the display panel 502 corresponding to each of the cutout strokes 521 and 531 . A specified color and/or a predefined image may be displayed. In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4B , since the display panel 502 does not exist in the camera area 510 , a predetermined color and/or a predetermined image may not be displayed. can In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4B , the camera module 180 may always be viewed through the camera area 510 .

In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4B , the electronic device 501 turns an area of the display panel 502 corresponding to each of the cutout strokes 521 and 531 . - can be turned off

In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4C , a color and/or a preset color are preset in an area of the display panel 502 corresponding to each of the cutout strokes 521 and 531 . Images can be displayed. In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4C , the area of the display panel 502 corresponding to each of the cutout strokes 521 and 531 may be turned off.

In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4C , a color and/or a preset color are preset in an area of the display panel 502 corresponding to each of the cutout strokes 521 and 531 . When displaying an image, a predetermined color and/or a predetermined image may be displayed on an area of the display panel 502 corresponding to the camera area 510 . In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4C , a color and/or a preset color are preset in an area of the display panel 502 corresponding to each of the cutout strokes 521 and 531 . When displaying an image, an area of the display panel 502 corresponding to the camera area 510 may be turned off.

In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4C , when the area of the display panel 502 corresponding to each of the cutout strokes 521 and 531 is turned off, the camera area A predetermined color and/or a predetermined image may also be displayed on an area of the display panel 502 corresponding to 510 . In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4C , when the area of the display panel 502 corresponding to each of the cutout strokes 521 and 531 is turned off, the camera area A region of the display panel 502 corresponding to 510 may be turned off.

In an embodiment, the turned-off region of the display panel 502 may indicate a predetermined color indicated by the black matrix.

FIG. 5B is a diagram illustrating a change in a 'U'-shaped cutout stroke in the electronic device 501 according to an exemplary embodiment. Among the descriptions of FIG. 5B , descriptions that overlap with those of FIG. 5A may be omitted.

Referring to FIG. 5B , the cutout strokes 523 and 533 surrounding the camera area 510 may have a 'U' shape.

In an embodiment, when the operating state of the camera module 180 is a turn-off state or an illuminance measurement state, the electronic device 501 may display a cutout stroke 523 on the display panel 502 . . In an embodiment, when the operating state of the camera module 180 is an image capturing state, the electronic device 501 may display a cutout stroke 533 on the display panel 502 .

In an embodiment, when the operating state of the camera module 180 is changed, the electronic device 501 may change the size and/or shape of the cutout stroke.

In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4B , the electronic device 501 pre-applies to the area of the display panel 502 corresponding to each of the cutout strokes 523 and 533 . A specified color and/or a predefined image may be displayed. In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4B , the electronic device 501 turns an area of the display panel 502 corresponding to each of the cutout strokes 523 and 533 . - can be turned off

In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4C , a predetermined color and/or a predetermined color and/or a predetermined color in an area of the display panel 502 corresponding to each of the cutout strokes 523 and 533 are specified. Images can be displayed. In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4C , an area of the display panel 502 corresponding to each of the cutout strokes 523 and 533 may be turned off.

In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4C , a predetermined color and/or a predetermined image may be displayed on an area of the display panel 502 corresponding to the camera area 510 . . In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4C , the area of the display panel 502 corresponding to the camera area 510 may be turned off.

In an embodiment, the turned-off region of the display panel 502 may indicate a predetermined color indicated by the black matrix.

FIG. 5C is a diagram illustrating a change in a 'V'-shaped cutout stroke in the electronic device 501 according to an exemplary embodiment. Among the descriptions of FIG. 5C , descriptions that overlap with those of FIG. 5A may be omitted.

Referring to FIG. 5C , the cutout strokes 525 and 535 surrounding the camera area 510 may have a 'V' shape.

In an embodiment, when the operating state of the camera module 180 is a turn-off state or an illuminance measurement state, the electronic device 501 may display a cutout stroke 525 on the display panel 502 . . In an embodiment, when the operating state of the camera module 180 is an image capturing state, the electronic device 501 may display a cutout stroke 535 on the display panel 502 .

In an embodiment, when the operating state of the camera module 180 is changed, the electronic device 501 may change the size and/or shape of the cutout stroke.

According to an embodiment, when the electronic device 501 has a structure as shown in FIG. 4B , the electronic device 501 pre-applies to the area of the display panel 502 corresponding to each of the cutout strokes 525 and 535 . A specified color and/or a predefined image may be displayed. In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4B , the electronic device 501 turns an area of the display panel 502 corresponding to each of the cutout strokes 525 and 535 . - can be turned off

In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4C , a color and/or a preset color are preset in an area of the display panel 502 corresponding to each of the cutout strokes 525 and 535 . Images can be displayed. In an embodiment, when the electronic device 501 has the structure shown in FIG. 4C , the area of the display panel 502 corresponding to each of the cutout strokes 525 and 535 may be turned off.

In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4C , a predetermined color and/or a predetermined image may be displayed on an area of the display panel 502 corresponding to the camera area 510 . . In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4C , the area of the display panel 502 corresponding to the camera area 510 may be turned off.

In an embodiment, the turned-off region of the display panel 502 may indicate a predetermined color indicated by the black matrix.

5D is a diagram illustrating a change in a planar cutout stroke in the electronic device 501 according to an exemplary embodiment. Among the descriptions of FIG. 5D , descriptions that overlap with those of FIG. 5A may be omitted.

Referring to FIG. 5D , the shape of the cutout strokes 527 and 537 surrounding the camera area 510 may be planar. In an embodiment, the cutout strokes 527 and 537 are in an area including the camera area 510 among two areas surrounded by a line parallel to the tangent of the camera area 510 and the display panel 502 . can respond.

In an embodiment, when the operating state of the camera module 180 is a turn-off state or an illuminance measurement state, the electronic device 501 may display a cutout stroke 527 on the display panel 502 . . In an embodiment, when the operating state of the camera module 180 is an image capturing state, the electronic device 501 may display a cutout stroke 537 on the display panel 502 .

In an embodiment, when the operating state of the camera module 180 is changed, the electronic device 501 may change the size and/or shape of the cutout stroke.

In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4B , the electronic device 501 pre-applies to an area of the display panel 502 corresponding to each of the cutout strokes 527 and 537 . A specified color and/or a predefined image may be displayed. In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4B , the electronic device 501 turns an area of the display panel 502 corresponding to each of the cutout strokes 527 and 537 . - can be turned off

In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4C , a color and/or a preset color are preset in the area of the display panel 502 corresponding to each of the cutout strokes 527 and 537 . Images can be displayed. In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4C , an area of the display panel 502 corresponding to each of the cutout strokes 527 and 537 may be turned off.

In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4C , a predetermined color and/or a predetermined image may be displayed on an area of the display panel 502 corresponding to the camera area 510 . . In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4C , the area of the display panel 502 corresponding to the camera area 510 may be turned off.

In an embodiment, the turned-off region of the display panel 502 may indicate a predetermined color indicated by the black matrix.

FIG. 5E is a diagram illustrating a change in a rectangular cutout stroke in the electronic device 501 according to an exemplary embodiment. Among the descriptions of FIG. 5E , descriptions that overlap with those of FIG. 5A may be omitted.

Referring to FIG. 5E , the cutout strokes 529 and 539 surrounding the camera area 510 may have a rectangular shape.

In an embodiment, when the operating state of the camera module 180 is a turn-off state or an illuminance measurement state, the electronic device 501 may display a cutout stroke 529 on the display panel 502 . . In an embodiment, when the operating state of the camera module 180 is an image capturing state, the electronic device 501 may display a cutout stroke 539 on the display panel 502 .

In an embodiment, when the operating state of the camera module 180 is changed, the electronic device 501 may change the size and/or shape of the cutout stroke.

According to an embodiment, when the electronic device 501 has a structure as shown in FIG. 4B , the electronic device 501 pre-applies to the area of the display panel 502 corresponding to each of the cutout strokes 529 and 539 . A specified color and/or a predefined image may be displayed. In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4B , the electronic device 501 turns an area of the display panel 502 corresponding to each of the cutout strokes 529 and 539 . - can be turned off

In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4C , a predetermined color and/or a predetermined color in an area of the display panel 502 corresponding to each of the cutout strokes 529 and 539 are specified. Images can be displayed. In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4C , the area of the display panel 502 corresponding to each of the cutout strokes 529 and 539 may be turned off.

In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4C , a predetermined color and/or a predetermined image may be displayed on an area of the display panel 502 corresponding to the camera area 510 . . In an embodiment, when the electronic device 501 has a structure as shown in FIG. 4C , the area of the display panel 502 corresponding to the camera area 510 may be turned off.

In an embodiment, the turned-off region of the display panel 502 may indicate a predetermined color indicated by the black matrix.

5A to 5E illustrate changes in cutout strokes between the same figures, according to an embodiment, the electronic device 501 may change the cutout strokes to different figures. In an embodiment, the electronic device 501 may change the circular cutout stroke 521 into the rectangular cutout stroke 539 according to the operating state of the camera module 180 .

5A to 5E illustrate one camera area 510 in which the camera module 180 is located at the top center of the display panel 502, but according to an embodiment, the electronic device 501 includes a display panel Other locations at 502 may include a camera area 510 . In an embodiment, the electronic device 501 may include two or more camera areas 510 in which each of the two or more camera modules 180 are located on the display panel 502 . In an embodiment, in the electronic device 501 , at least one camera module 180 is located at a position of an upper right, an upper left, a lower right, a lower middle, a lower left, or a combination thereof of the display panel 502 . and a camera area 510 for

6 is a flowchart illustrating an operation of changing a cutout stroke in the electronic device 101 according to an exemplary embodiment. For the description of FIG. 6 , reference may be made to FIGS. 1 to 3 .

Referring to FIG. 6 , in operation 611 , the window manager 203 may request status information of the camera module 180 from the camera manager 229 . In an embodiment, the state information may be information for indicating a state (eg, an image capturing state, a turn-off state, or an illuminance measurement state) of the camera module 180 .

Referring to FIG. 6 , in operation 613 , the camera manager 229 may transmit status information of the camera module 180 to the window manager 203 .

Referring to FIG. 6 , in operation 615 , the window manager 203 may request cutout stroke information from the memory 130 . In an embodiment, the cutout stroke information may be information for indicating the shape and/or size of the cutout stroke.

Referring to FIG. 6 , in operation 617 , the memory 130 may transmit cutout stroke information to the window manager 203 . In an embodiment, the memory 130 may search for cutout stroke information stored as setting information, and transmit the retrieved cutout stroke information to the window manager 203 .

In an embodiment, operations 611 to 617 may be performed when the electronic device 101 is booted.

Referring to FIG. 6 , in operation 620 , the application 146 may request the camera manager 229 to drive the camera module 180 . In an embodiment, the application 146 may request the camera manager 229 to drive the camera module 180 based on the input. In an embodiment, the application 146 may be an application for providing a function (eg, image capturing, augmented reality) related to the camera module 180 to a user by controlling the camera module 180 . In an embodiment, the application 146 controls the camera module 180 to control (eg, change the brightness of the display panel) based on information (eg, illuminance) acquired through the camera module 180 . can be

Referring to FIG. 6 , in operation 630 , the camera manager 229 may drive the camera module 180 based on a driving request for the camera module 180 .

Referring to FIG. 6 , in operation 640 , the camera manager 229 may transmit a driving notification of the camera module 180 to the window manager 203 . In an embodiment, the driving notification of the camera module 180 may include information on the application 146 using the camera module 180 . In an embodiment, the driving notification of the camera module 180 may include status information of the camera module 180 .

Referring to FIG. 6 , in operation 650 , the window manager 203 may update a cutout stroke. In an embodiment, the window manager 203 may update the cutout stroke based on the driving notification of the camera module 180 .

In an embodiment, the window manager 203 operates a camera module that is being driven based on a camera module capable of capturing an image through a display panel (or a hole in the display panel) among the camera modules of the electronic device 101 is driven. You can update the cutout stroke corresponding to .

In an embodiment, the window manager 203 is configured to correspond to the driving camera module based on the driving of at least one camera module among the camera modules capable of capturing an image through the display panel (or the hole of the display panel). The cutout stroke can be updated.

In an embodiment, the window manager 203 may identify the driving state of the camera module 180 based on the driving notification of the camera module 180 . In an embodiment, the cutout stroke may be updated based on the identified driving state of the camera module 180 . In an embodiment, when the camera module 180 is driven in the image capturing state, the window manager 203 may update the cutout stroke to a cutout stroke corresponding to the image capturing state. In an embodiment, when the camera module 180 is driven in the turn-off state or the illuminance measurement state, the window manager 203 sets a cutout stroke corresponding to the turn-off state or the illuminance measurement state. It can be updated with strokes.

Referring to FIG. 6 , in operation 660 , the application 146 may request the camera manager 229 to terminate driving of the camera module 180 . In an embodiment, the application 146 may request the camera manager 229 to terminate driving of the camera module 180 based on the input. In an embodiment, when the user applies an input for terminating the application 146 , the application 146 may request the camera manager 229 to terminate driving of the camera module 180 .

Referring to FIG. 6 , in operation 670 , the camera manager 229 may end the driving of the camera module 180 based on a request to terminate the driving of the camera module 180 .

Referring to FIG. 6 , in operation 680 , the camera manager 229 may transmit a notification of termination of driving of the camera module 180 to the window manager 203 . In an embodiment, the driving end notification of the camera module 180 may include status information of the camera module 180 .

Referring to FIG. 6 , in operation 690 , the window manager 203 may update a cutout stroke. According to an embodiment, the window manager 203 may update the cutout stroke based on the notification of the end of driving of the camera module 180 .

In an embodiment, the window manager 203 may identify the driving state of the camera module 180 based on the notification of the end of driving of the camera module 180 . In an embodiment, the cutout stroke may be updated based on the identified driving state of the camera module 180 . In an embodiment, when the driving of the camera module 180 is terminated, the window manager 203 may update the cutout stroke to a cutout stroke corresponding to the turn-off.

In an embodiment, the window manager 203 is configured to terminate the driving of a camera module capable of capturing an image through a display panel (or a hole in the display panel) among the camera modules of the electronic device 101 based on the driving end. The cutout stroke corresponding to the camera module may be updated.

In an embodiment, the window manager 203 is configured with a cutout stroke corresponding to the camera module that has been driven, based on the end of driving of all of the camera modules capable of taking an image through the display panel (or the hole of the display panel). can be updated.

7 is a flowchart illustrating an operation of changing a display of a display in the electronic device 101 according to an embodiment. For the description of FIG. 7 , reference may be made to FIGS. 1 to 3 .

Referring to FIG. 7 , in operation 710 , the processor 120 of the electronic device 101 may identify an input. In an embodiment, the processor 120 may identify an input through a touch circuit of the input device 150 and/or the display device 160 .

In an embodiment, the processor 120 may perform a function based on the identified input. For example, the processor 120 may execute the application 146 based on the identified input. For example, the processor 120 may execute a function (eg, image capturing) of the application 146 based on the identified input. For example, the processor 120 may set conditions for executing the function of the application 146 based on the identified input (eg, a timer setting for image capturing, a flash setting).

Referring to FIG. 7 , in operation 720 , the processor 120 may identify whether the operating state of the camera module 180 is changed. In an embodiment, the processor 120 may identify whether the operating state of the camera module 180 is changed as a result of performing a function based on the identified input.

In an embodiment, when the operation state of the camera module 180 is changed ('Yes'), the processor 120 may perform operation 730 . In an embodiment, when the operation state of the camera module 180 is not changed ('No'), the processor 120 may end the operations according to FIG. 7 .

For example, when the operating state of the camera module 180 is changed from an image capturing state, a turn-off state, or an illuminance measuring state, the processor 120 may perform operation 730 . For example, when the operating state of the camera module 180 is not changed from the image capturing state, the processor 120 may end the operations illustrated in FIG. 7 .

Referring to FIG. 7 , in operation 730 , the processor 120 may identify whether the display of the display panel 420 needs to be changed. In an embodiment, when a change in the cutout stroke is required, the processor 120 may identify that the display of the display panel 420 needs to be changed.

In an embodiment, when the operation state is changed from the image capturing state, the turn-off state, or the illuminance measurement state, the processor 120 may identify that the display of the display panel 420 needs to be changed. In an embodiment, when the operating state is changed from the turn-off state or the illuminance measurement state to the image capturing state, the processor 120 may identify that the display of the display panel 420 needs to be changed.

In an embodiment, when the operation state is changed from the turn-off state to the illuminance measurement state, the processor 120 may identify that the display of the display panel 420 does not need to be changed. In an embodiment, when the operating state is changed from the illuminance measurement state to the turn-off state, the processor 120 may identify that the display of the display panel 420 does not need to be changed.

In an embodiment, when it is necessary to change the display of the display panel 420 ('Yes'), the processor 120 may perform operation 740 . In an embodiment, when the display of the display panel 420 does not need to be changed ('No'), the processor 120 may end the operations illustrated in FIG. 7 .

Referring to FIG. 7 , in operation 740 , the processor 120 may change the display of the display panel 420 around the camera module 180 .

In an embodiment, the processor 120 may change the display of the display panel 420 around the camera module 180 by changing the size and/or the shape of the cutout stroke. In one embodiment, the processor 120, by changing the shape of the cutout stroke into one of a circular shape, a 'U' shape, a 'V' shape, a planar shape, a rectangle, or a combination thereof, the camera module ( The display of the display panel 420 around the 180 may be changed.

8 is a flowchart illustrating an operation of thickening a cutout stroke in the electronic device 101 according to an exemplary embodiment. The operations of FIG. 8 may be included in operations 730 and 740 of FIG. 7 .

Referring to FIG. 8 , in operation 810 , the processor 120 may identify whether the operating state of the camera module 180 is changed to the image capturing state. In an embodiment, operation 810 may be performed after operation 720 of FIG. 7 .

In an embodiment, when the operating state of the camera module 180 is changed to the image capturing state ('Yes'), the processor 120 may perform operation 820 . In an embodiment, when the operating state of the camera module 180 is not changed to the image capturing state ('No'), the processor 120 may end the operations illustrated in FIG. 8 .

Referring to FIG. 8 , in operation 820 , the processor 120 may change the cutout stroke to be thicker. In an embodiment, the increased thickness of the cutout stroke may be about 30 pixels.

9 is a flowchart illustrating an operation of thinly changing a cutout stroke in the electronic device 101 according to an exemplary embodiment. The operations of FIG. 9 may be included in operations 730 and 740 of FIG. 7 .

Referring to FIG. 9 , in operation 910 , the processor 120 may identify whether the operating state of the camera module 180 is changed from the image capturing state. In an embodiment, operation 910 may be performed after operation 720 of FIG. 7 .

In an embodiment, when the operating state of the camera module 180 is changed from the image capturing state ('Yes'), the processor 120 may perform operation 920 . In an embodiment, when the operation state of the camera module 180 is not changed from the image capturing state ('No'), the processor 120 may end the operations according to FIG. 9 .

Referring to FIG. 9 , in operation 920 , the processor 120 may change the cutout stroke to be thin. In an embodiment, the reduced thickness of the cutout stroke may be about 30 pixels.

10A is a flowchart illustrating an operation of changing a cutout stroke while acquiring an image in the electronic device 101 according to an embodiment. 10B is a diagram illustrating an image acquired by the electronic device 101 according to an embodiment. For a description of FIGS. 10A and 10B , reference may be made to FIGS. 1 to 3 .

Referring to FIG. 10A , in operation 1010 , the processor 120 may acquire an image 1001 through the camera module 180 . In an embodiment, the camera module 180 may be in the first state while the processor 120 acquires the image 1001 . In an embodiment, the image 1001 may be an original image acquired through the camera module 180 . In an embodiment, the image displayed through the display panel 420 may be a copy image of the image 1001 . In an embodiment, the image displayed through the display panel 420 may be an image having a lower resolution than the image 1001 .

In FIG. 10B, the image is illustrated as being square, but this is only an example. In an embodiment, the image may have a shape corresponding to an aspect ratio of the image sensor 330 of the camera module 180 .

Referring to FIG. 10A , in operation 1020 , the processor 120 may identify whether the characteristics of the predefined regions 1011 , 1013 , 1015 , and 1017 of the image 1001 are changed. In an embodiment, the predefined regions 1011 , 1013 , 1015 , and 1017 of the image 1001 may be located at an edge of the image 1001 .

In an embodiment, the characteristics of the predefined regions 1011 , 1013 , 1015 , and 1017 may include noise, resolution, brightness, or a combination thereof.

In one embodiment, the processor 120 is configured to, when the occurrence of noise in the predefined regions 1011 , 1013 , 1015 , and 1017 of the image 1001 changes, the predefined regions 1011 , 1013 , 1015 , and 1017) can be identified as being changed.

In an embodiment, the processor 120 is configured to, when the resolution is changed in the predefined regions 1011 , 1013 , 1015 , and 1017 of the image 1001 , the predefined regions 1011 , 1013 , 1015 , and 1017 . ) can be identified as changed.

In an embodiment, the processor 120 is configured to, when the brightness changes in the predefined regions 1011 , 1013 , 1015 , and 1017 of the image 1001 , the predefined regions 1011 , 1013 , 1015 , and 1017 . ) can be identified as changed.

Referring to FIG. 10 , in operation 1030 , the processor 120 may change the display of the display panel 420 around the camera module 180 .

In an embodiment, when the characteristics of the predefined regions 1011 , 1013 , 1015 , and 1017 change in a degraded direction, the processor 120 changes the cutout stroke of the periphery of the camera module 180 to be thicker. can In an embodiment, when the generation of noise increases, when the resolution decreases, or when the brightness increases, it may be understood as a case in which a characteristic is changed in a decreasing direction.

In an embodiment, when the characteristics of the predefined regions 1011 , 1013 , 1015 , and 1017 change in a direction to be improved, the processor 120 may change the cutout stroke around the camera module 180 to be thin. can In an embodiment, when the generation of noise decreases, when the resolution increases, or when the brightness decreases, it may be understood as a case in which a characteristic is changed in a direction to be improved.

In an embodiment, the processor 120 may change the display of the display panel 420 around the camera module 180 by changing the thickness in a partial direction of the cutout stroke.

For example, when the characteristic of the image 1001 is changed in a region in the left direction with respect to the center of the image 1001 , the processor 120 determines the cutout stroke in the left direction based on the camera module 180 . The thickness can be changed.

In an embodiment, the processor 120 may change the display of the display panel 420 around the camera module 180 by changing the shape of the cutout stroke. In one embodiment, the processor 120, by changing the shape of the cutout stroke into one of a circular shape, a 'U' shape, a 'V' shape, a planar shape, a rectangle, or a combination thereof, the camera module ( The display of the display panel 420 around the 180 may be changed.

11 is a flowchart illustrating an operation of thickening a cutout stroke while acquiring an image in the electronic device 101 according to an exemplary embodiment. The operations of FIG. 11 may be included in operations 1020 and 1030 of FIG. 10 .

Referring to FIG. 11 , in operation 1110 , the processor 120 may identify whether the brightness of the predefined regions 1011 , 1013 , 1015 , and 1017 of the image 1001 has increased. In an embodiment, operation 1110 may be performed after operation 1010 of FIG. 10 .

In an embodiment, when the brightness of the predefined areas 1011 , 1013 , 1015 , and 1017 of the image 1001 increases (YES), the processor 120 may perform operation 1120 . In one embodiment, if the brightness of the predefined areas 1011 , 1013 , 1015 , and 1017 of the image 1001 does not increase ('No'), the processor 120 terminates the operations according to FIG. 11 . can

Referring to FIG. 11 , in operation 1120 , the processor 120 may change the cutout stroke to be thicker. In an embodiment, the increased thickness of the cutout stroke may be about 30 pixels.

12 is a flowchart illustrating an operation of thinly changing a cutout stroke while acquiring an image in the electronic device 101 according to an embodiment. The operations of FIG. 12 may be included in operations 1020 and 1030 of FIG. 10 .

Referring to FIG. 12 , in operation 1210 , the processor 120 may identify whether the brightness of the predefined regions 1011 , 1013 , 1015 , and 1017 of the image 1001 has decreased. In an embodiment, operation 1210 may be performed after operation 1010 of FIG. 10 .

In an embodiment, when the brightness of the predefined areas 1011 , 1013 , 1015 , and 1017 of the image 1001 is decreased (YES), the processor 120 may perform operation 1220 . In one embodiment, if the brightness of the predefined areas 1011 , 1013 , 1015 , and 1017 of the image 1001 does not decrease ('No'), the processor 120 terminates the operations according to FIG. 12 . can

Referring to FIG. 12 , in operation 1220 , the processor 120 may change the cutout stroke to be thinner. In an embodiment, the reduced thickness of the cutout stroke may be about 30 pixels.

13 is a flowchart illustrating an operation of changing a display of a display in an electronic device according to an embodiment. The description of FIG. 13 may refer to FIGS. 1 to 3 .

Referring to FIG. 13 , in operation 1310 , the processor 120 of the electronic device 101 includes a camera module (eg, the display device 160 of FIG. 1 , the display panel 402 of FIG. 4A ) in the area of the display. While displaying a predetermined image in the region surrounding the 180 (eg, the region including the cutout stroke 404 of FIG. 4A ), a change in the operating state of the camera module 180 may be identified.

According to an embodiment, the predetermined image may be an image for displaying a predetermined color (eg, black).

Referring to FIG. 13 , in operation 1320 , the processor 120 may determine the size of a region surrounding the camera module 180 in response to identifying a change in the operating state of the camera module 180 . In an embodiment, the processor 120 may determine the size of the area surrounding the camera module 180 to correspond to the operating state of the camera module 180 .

Referring to FIG. 13 , in operation 1330 , the processor 120 displays a predetermined image in a changed area among areas of a display (eg, the display device 160 of FIG. 1 and the display panel 402 of FIG. 4A ). can

As described above, in the electronic device 101 and the operating method thereof according to an embodiment, even when the camera module 180 is disposed under the display panel 420 , the quality of the image acquired by the camera module 180 may not lower

In the electronic device 101 and the method of operating the same according to an embodiment, when the camera module 180 is disposed under the display panel 420 and the display panel 420 operates in a flash mode, By increasing the thickness, the quality of the image acquired by the camera module 180 may not be deteriorated. In an embodiment, the flash mode of the display panel 420 may indicate a mode in which a predetermined color (eg, white) is displayed with a predetermined brightness in at least a partial area of the display panel 420 .

In the electronic device 101 and its operating method according to an embodiment, when the camera module 180 is disposed under the display panel 420 and the display panel 420 displays a predetermined object, a cutout stroke By increasing the thickness of , the quality of the image acquired by the camera module 180 may not be degraded. According to an embodiment, the predefined object may be a character indicating a timer.

In the electronic device 101 and its operating method according to an embodiment, when the camera module 180 is disposed under the display panel 420 and the display panel 420 displays the preview image, the brightness of the preview image By increasing the thickness of the cutout stroke based on , the quality of the image acquired by the camera module 180 may not be deteriorated.

As described above, the electronic device 101 according to an embodiment includes a display (eg, the display device 160 of FIG. 1 ), a camera module 180 configured to be positioned below the display; a memory 130 for storing instructions; and a processor 120 configured to be functionally connected to the display, the camera module 180, and the memory 130, wherein the processor 120 executes the instructions, and the electronic device 101 ) identifies a change in the operating state of the camera module 180 while displaying a predetermined image in a region surrounding the camera module 180 among the display regions, and operates the camera module 180 In response to identifying the change of state, it may be configured to change the size of the region surrounding the camera module 180 and display the predefined image in the changed region.

In an embodiment, the processor 120 executes the instructions, and in response to the electronic device 101 identifying that the operating state of the camera module 180 is changed to the image capturing state, the camera module It may be configured to change the size of the region surrounding 180 to increase.

In an embodiment, the processor 120 executes the instructions so that the electronic device 101 detects that the operating state of the camera module 180 is changed from an image capturing state to a state other than the image capturing state. In response to the identification, the size of the area surrounding the camera module 180 may be changed to become smaller.

In an embodiment, the predetermined image may include an image composed of a black color.

In an embodiment, the processor 120 executes the instructions so that the electronic device 101 performs the camera module 180 through the camera module 180 while the operating state of the camera module 180 is an image capturing state. to identify that a characteristic in a predetermined area of the acquired image is changed, and in response to identifying that the characteristic in the predetermined area is changed, change the size of the area surrounding the camera module 180 . can

In an embodiment, the processor 120 executes the instructions, and in response to the electronic device 101 identifying that the characteristic in the predetermined area is degraded, the camera module 180 is Change the size of the surrounding area to increase, and in response to identifying that the characteristic in the predetermined area is improved, change the size of the area surrounding the camera module 180 to become smaller have.

In an embodiment, the feature includes noise, resolution, brightness, or a combination thereof, and the processor 120 executes the instructions so that the electronic device 101 is located in the predetermined area. When at least one of an increase in the noise, a decrease in the resolution, or an increase in the brightness occurs, it is identified that the characteristic in the predetermined area is degraded, and the decrease in the noise in the predetermined area, the resolution and when at least one of an increase in , or a decrease in the brightness occurs, identify that the characteristic in the predetermined area is improved.

In an embodiment, the display is configured to have a hole (eg, the hole 425 in FIG. 4B ), and the camera module 180 is configured to be viewed from the outside through the hole, The region surrounding the camera module 180 may be configured to surround the hole.

In an embodiment, the area surrounding the camera module 180 among the areas of the display includes a first area overlapping the camera module 180 (eg, the camera area 421 in FIG. 4C ) and the second area. It is divided into a second area (eg, the camera cover area 412 of FIG. 4C ) surrounding the first area, and the processor 120 executes the instructions, so that the electronic device 101 is connected to the camera module ( 180), in response to identifying the change in the operating state, change the size of the second region.

In an embodiment, the processor 120 executes the instructions and in response to the electronic device 101 identifying that the operating state of the camera module 180 is an image capturing state, the first area may be configured to turn off.

In an embodiment, the processor 120 executes the instructions and in response to the electronic device 101 identifying that the operating state of the camera module 180 is a state other than the image capturing state, It may be configured to display the predetermined image in the first area.

In an embodiment, the region surrounding the camera module 180 is configured to have one of a circular shape, an oval shape, a polygonal shape, a planar shape, a 'U' shape, a 'V' shape, or a combination thereof. can be

As described above, in the method of operating the electronic device 101 according to an embodiment, the camera module 180 positioned below the display in the area of the display (eg, the display device 160 of FIG. 1 ) is surrounded by identifying a change in the operating state of the camera module 180 while displaying a predetermined image in the region; changing the size of the area surrounding the camera module 180 in response to identifying a change in the operating state of the camera module 180; and displaying the predetermined image on the changed area.

In one embodiment, the operation of changing the size of the area surrounding the camera module 180 is in response to identifying that the operation state of the camera module 180 is changed to the image capturing state, the camera module 180 ) to change the size of the region surrounding it to increase.

In one embodiment, the operation of changing the size of the area surrounding the camera module 180 is to identify that the operating state of the camera module 180 is changed from the image capturing state to a state other than the image capturing state. In response, the operation may include changing the size of the area surrounding the camera module 180 to become smaller.

In one embodiment, while the operating state of the camera module 180 is an image capturing state, identifying that a characteristic in a predetermined area of the image acquired through the camera module 180 is changed; and changing the size of the area surrounding the camera module 180 in response to identifying that the characteristic in the predetermined area is changed.

In an embodiment, the operation of changing the size of the area surrounding the camera module 180 in response to identifying that the characteristic in the predetermined area is changed is that the characteristic in the predetermined area is deteriorated. an operation of changing the size of the area surrounding the camera module 180 to increase in response to identifying it as being and changing the size of the area surrounding the camera module 180 to increase in response to identifying that the characteristic in the predetermined area is improved.

In an embodiment, the feature includes noise, resolution, brightness, or a combination thereof, and when at least one of an increase in the noise, a decrease in the resolution, or an increase in the brightness in the predetermined area occurs , identifying that the characteristic in the predetermined area is degraded; and when at least one of a reduction in the noise, an increase in the resolution, and a decrease in the brightness in the predetermined area occurs, identifying that the characteristic in the predetermined area is improved. .

In an embodiment, the area surrounding the camera module 180 among the areas of the display is divided into a first area overlapping the camera module 180 and a second area surrounding the first area, Changing the size of the region surrounding the camera module 180 may include changing the size of the second region in response to identifying a change in the operating state of the camera module 180 . .

In an embodiment, in response to identifying that the operating state of the camera module 180 is a state other than the image capturing state, the method may further include displaying the predetermined image in the first area.

Methods according to the embodiments described in the claims or specifications of the present disclosure may be implemented in the form of hardware, software, or a combination of hardware and software.

When implemented in software, a computer-readable storage medium storing one or more programs (software modules) may be provided. One or more programs stored in the computer-readable storage medium are configured to be executable by one or more processors in an electronic device (device). The one or more programs include instructions for causing an electronic device to execute methods according to embodiments described in a claim or specification of the present disclosure.

Such programs (software modules, software) include random access memory, non-volatile memory including flash memory, read only memory (ROM), electrically erasable programmable ROM (EEPROM: electrically erasable programmable read only memory), magnetic disc storage device, compact disc ROM (CD-ROM), digital versatile discs (DVDs), or other types of It may be stored in an optical storage device or a magnetic cassette. Alternatively, it may be stored in a memory composed of a combination of some or all thereof. In addition, each configuration memory may be included in plurality.

In addition, the program is transmitted through a communication network consisting of a communication network such as the Internet, an intranet, a local area network (LAN), a wide LAN (WLAN), or a storage area network (SAN), or a combination thereof. It may be stored on an attachable storage device that can be accessed. Such a storage device may be connected to a device implementing an embodiment of the present disclosure through an external port. In addition, a separate storage device on the communication network may be connected to the device implementing the embodiment of the present disclosure.

In the specific embodiments of the present disclosure described above, elements included in the disclosure are expressed in the singular or plural according to the specific embodiments presented. However, the singular or plural expression is appropriately selected for the context presented for convenience of description, and the present disclosure is not limited to the singular or plural element, and even if the element is expressed in plural, it is composed of the singular or singular. Even an expressed component may be composed of a plurality of components.

Meanwhile, although specific embodiments have been described in the detailed description of the present disclosure, various modifications are possible without departing from the scope of the present disclosure. Therefore, the scope of the present disclosure should not be limited to the described embodiments and should be defined by the claims described below as well as the claims and equivalents.

Claims (20)

In an electronic device,
display;
a camera module configured to be positioned below the display;
a memory for storing instructions; and
a processor configured to be functionally connected to the display, the camera module, and the memory, wherein the processor executes the instructions to cause the electronic device to
While displaying a predefined image in a region surrounding the camera module among regions of the display, identify a change in the operating state of the camera module,
in response to identifying a change in the operating state of the camera module, change the size of the area surrounding the camera module;
and display the predetermined image on the changed area.
According to claim 1,
The processor, by executing the instructions, the electronic device,
In response to identifying that the operating state of the camera module is changed to the image capturing state, the electronic device is configured to change the size of the area surrounding the camera module to increase.
According to claim 1,
The processor, by executing the instructions, the electronic device,
and in response to identifying that the operating state of the camera module is changed from the image capturing state to a state other than the image capturing state, change the size of the area surrounding the camera module to become smaller.
According to claim 1,
The predetermined image is an electronic device including an image composed of a black color.
According to claim 1,
The processor, by executing the instructions, the electronic device,
It is identified that, while the operating state of the camera module is an image capturing state, a characteristic in a predetermined area of an image acquired through the camera module is changed,
and in response to identifying that the characteristic in the predefined area changes, change the size of the area surrounding the camera module.
6. The method of claim 5,
The processor, by executing the instructions, the electronic device,
in response to identifying that the characteristic in the predefined area is degraded, changing the size of the area surrounding the camera module to increase;
and in response to identifying that the feature in the predefined area is to be improved, change the size of the area surrounding the camera module to become smaller.
7. The method of claim 6,
The characteristics include noise, resolution, brightness, or a combination thereof,
The processor, by executing the instructions, the electronic device,
When at least one of an increase in the noise, a decrease in the resolution, or an increase in the brightness in the predetermined region occurs, it is determined that the characteristic in the predetermined region is degraded,
and when at least one of a reduction in the noise, an increase in the resolution, or a decrease in the brightness in the predetermined area occurs, identify that the characteristic in the predetermined area is improved.
According to claim 1,
The display is configured to have a hole,
The camera module is configured to be viewed from the outside through the hole,
The area surrounding the camera module among the areas of the display is configured to surround the hole.
According to claim 1,
Among the areas of the display, the area surrounding the camera module is divided into a first area overlapping the camera module and a second area surrounding the first area,
The processor, by executing the instructions, the electronic device,
and in response to identifying a change in the operating state of the camera module, change the size of the second area.
10. The method of claim 9,
The processor, by executing the instructions, the electronic device,
and in response to identifying that the operating state of the camera module is an image capturing state, turn off the first area.
10. The method of claim 9,
The processor, by executing the instructions, the electronic device,
and display the predetermined image in the first area in response to identifying that the operating state of the camera module is a state other than the image capturing state.
According to claim 1,
The region surrounding the camera module is configured to have one of a circular shape, an oval shape, a polygonal shape, a planar shape, a 'U' shape, a 'V' shape, or a combination thereof.
A method of operating an electronic device, comprising:
identifying a change in the operating state of the camera module while displaying a predetermined image in an area surrounding the camera module positioned below the display among areas of the display;
in response to identifying a change in the operating state of the camera module, changing the size of the area surrounding the camera module; and
and displaying the predetermined image in the changed area.
14. The method of claim 13,
Changing the size of the area surrounding the camera module includes:
and in response to identifying that the operating state of the camera module is changed to the image capturing state, changing the size of the area surrounding the camera module to increase.
14. The method of claim 13,
Changing the size of the area surrounding the camera module includes:
and in response to identifying that the operating state of the camera module is changed from the image capturing state to a state other than the image capturing state, changing the size of the area surrounding the camera module to become smaller.
14. The method of claim 13,
identifying that a characteristic in a predetermined area of an image acquired through the camera module is changed while the operating state of the camera module is an image capturing state; and
and in response to identifying that the characteristic in the predefined area changes, changing the size of the area surrounding the camera module.
17. The method of claim 16,
In response to identifying that the characteristic in the predetermined area is changed, changing the size of the area surrounding the camera module includes:
in response to identifying that the characteristic in the predetermined area is degraded, changing the size of the area surrounding the camera module to increase; and
and in response to identifying that the feature in the predefined area is to be improved, changing the size of the area surrounding the camera module to increase.
18. The method of claim 17,
The characteristics include noise, resolution, brightness, or a combination thereof,
identifying that the characteristic in the predetermined area is degraded when at least one of an increase in the noise, a decrease in the resolution, or an increase in the brightness in the predetermined area occurs; and
and when at least one of a reduction in the noise, an increase in the resolution, or a decrease in the brightness occurs in the predetermined area, identifying that the feature in the predetermined area is improved.
14. The method of claim 13,
Among the areas of the display, the area surrounding the camera module is divided into a first area overlapping the camera module and a second area surrounding the first area,
Changing the size of the area surrounding the camera module includes:
and in response to identifying a change in the operating state of the camera module, changing the size of the second area.
20. The method of claim 19,
In response to identifying that the operating state of the camera module is a state other than the image capturing state, displaying the predetermined image in the first area.

Images