KR20200092762A - Electronic device and method for recognizing occlusion of camera thereof - Google Patents

Abstract

According to various embodiments of the present invention, an electronic device comprises: a housing; a first camera and a second camera exposed to the outside of the housing; and at least one deco member being made of a conductive material and surrounding the first camera and the second camera; at least one sensing unit; and a processor electrically connected to the first camera, the second camera, the at least one deco member, and the at least one sensing unit. The processor may be configured to acquire a capacitance value for the at least one deco member made of the conductive material through the at least one sensing unit, determine whether a changed capacitance value exceeds a designated value if a camera function is activated and a change of the acquired capacitance value is sensed, and provide a notification that an object is sensed by at least one camera of the first camera and the second camera if the changed capacitance value exceeds the designated value. Various embodiments other than the various embodiments disclosed in the present invention are possible.

Description

Electronic devices and methods of recognizing the occlusion of cameras using them {ELECTRONIC DEVICE AND METHOD FOR RECOGNIZING OCCLUSION OF CAMERA THEREOF}

Various embodiments of the present invention relate to an electronic device and a method for recognizing the occlusion of a camera using the same.

The electronic device provides a camera function so that an image or video can be generated and stored by photographing a subject. Recently, an electronic device may include a plurality of cameras (eg, dual cameras) capable of acquiring images or images with different angles of view of a subject. For example, the electronic device may acquire an image having a first angle of view obtained from one of the plurality of cameras and an image having a second angle of view of a narrower angle of view than the first angle of view obtained from another camera. The electronic device may display the image having the first angle of view as a preview image, and may not display the image having the second angle of view as a preview image, but may synthesize the image having the first angle of view and store it as a high-quality image. In addition, images obtained from a plurality of cameras having different angles of view may be used for adjusting the brightness, contrast, noise of the image, or for out-focusing.

When photographing an object through the grip of the electronic device, any one of a plurality of cameras may be obscured by an object, for example, a user's finger being approached or touched. If a camera capable of acquiring an image having a second angle of view that is not displayed as a preview image among a plurality of cameras is hidden by an object, the user may not recognize that the camera is hidden because it is not displayed as a preview image. As the camera is obscured by an object, it is not possible to store a high quality image through the synthesis of a plurality of images obtained through a plurality of cameras.

The electronic device according to various embodiments of the present disclosure determines whether an object is detected in at least one camera using at least one of a sensor value and a parameter value for an image when an image of a subject is photographed using a plurality of cameras. Can decide. When an object is detected by the at least one camera, the electronic device may provide a notification that the object is detected by the at least one camera, for example, a notification that the camera is obscured by the object.

An electronic device according to various embodiments of the present disclosure includes: a housing, a first camera and a second camera exposed outside the housing, at least one deco member formed of a conductive material surrounding the first camera and the second camera, And at least one sensing unit, and a processor electrically connected to the first camera, the second camera, the at least one deco member, and the at least one sensing unit, wherein the processor includes the at least one sensing unit. Acquire a capacitance value for at least one deco member formed of the conductive material through, if a camera function is activated, and a change in the acquired capacitance value is detected, determine whether the changed capacitance value exceeds a specified value and , And when the changed capacitance value exceeds the specified value, it may be set to provide a notification that an object is detected in at least one of the first camera and the second camera.

A method of recognizing the occlusion of a camera of an electronic device according to various embodiments of the present invention may include a capacitance value for at least one deco member formed to surround the first camera and the second camera with a conductive material through at least one sensing unit. An acquiring operation, when a camera function is activated, and a change in the acquired capacitance value is detected, determining whether the changed capacitance value exceeds a specified value, and when the changed capacitance value exceeds the specified value, It may include an operation of providing a notification that an object is detected in at least one of the first camera and the second camera.

The electronic device according to various embodiments of the present disclosure may provide a notification for an object when it is detected by at least one camera. Accordingly, the user can intuitively check whether an object is detected in the at least one camera, and remove the object from an image acquired from the at least one camera. As the object sensed by the at least one camera is removed from the acquired image, the electronic device may acquire a high quality image through the plurality of cameras.

1 is a block diagram of an electronic device in a network environment, according to various embodiments.
2 is a block diagram illustrating a camera module, according to various embodiments.
3 is a block diagram illustrating an electronic device according to various embodiments of the present disclosure.
4 is a diagram illustrating a plurality of camera structures according to various embodiments.
5 is a circuit diagram illustrating a method of detecting an object in at least one camera based on a capacitance value according to various embodiments.
6 is a diagram illustrating a plurality of camera structures according to various embodiments.
7 is a circuit diagram illustrating a method of detecting an object in at least one camera based on a capacitance value, according to various embodiments.
8 is a flowchart illustrating a method of detecting an object in at least one camera based on a capacitance value, according to various embodiments.
9 is a diagram for describing a method of sensing an object in at least one camera based on parameter values for an image according to various embodiments.
10 is a diagram for describing a method of sensing an object in at least one camera based on parameter values for an image according to various embodiments.
11 is a diagram for describing a method of detecting an object in at least one camera based on parameter values for an image according to various embodiments.
12 is a flowchart illustrating a method of detecting an object in at least one camera based on parameter values for an image according to various embodiments.
13 is a flowchart illustrating a method of sensing an object in at least one camera based on a capacitance value and a parameter value for an image according to various embodiments.
14 is a diagram illustrating a case in which an object is detected in at least one camera according to various embodiments.
15 is a diagram for describing a method of providing a notification that an object is detected in at least one camera according to various embodiments.

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments.

Referring to FIG. 1, in the network environment 100, the electronic device 101 communicates with the electronic device 102 through the first network 198 (eg, a short-range wireless communication network), or the second network 199. The electronic device 104 or the server 108 may be communicated through (eg, a remote wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108. According to an embodiment, the electronic device 101 includes a processor 120, a memory 130, an input device 150, an audio output device 155, a display device 160, an audio module 170, a sensor module ( 176), interface 177, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196, or antenna module 197 ). In some embodiments, at least one of the components (for example, the display device 160 or the camera module 180) may be omitted or one or more other components may be added to the electronic device 101. In some embodiments, some of these components may be implemented in one integrated circuit. For example, the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented while being embedded in the display device 160 (eg, a display).

The processor 120, for example, executes software (eg, the program 140) to execute at least one other component (eg, hardware or software component) of the electronic device 101 connected to the processor 120. It can be controlled and can perform various data processing or operations. According to one embodiment, as at least part of data processing or computation, the processor 120 may receive instructions or data received from other components (eg, the sensor module 176 or the communication module 190) in the volatile memory 132. Loaded into, process instructions or data stored in volatile memory 132, and store result data in non-volatile memory 134. According to one embodiment, the processor 120 includes a main processor 121 (eg, a central processing unit or an application processor), and an auxiliary processor 123 (eg, a graphics processing unit, an image signal processor) that can be operated independently or together. , Sensor hub processor, or communication processor). Additionally or alternatively, the coprocessor 123 may be set to use less power than the main processor 121, or to be specialized for a specified function. The coprocessor 123 may be implemented separately from the main processor 121 or as a part thereof.

The coprocessor 123 may replace, for example, the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 may be active (eg, execute an application) ) With the main processor 121 while in the state, at least one component of the components of the electronic device 101 (eg, the display device 160, the sensor module 176, or the communication module 190) It can control at least some of the functions or states associated with. According to one embodiment, the coprocessor 123 (eg, image signal processor or communication processor) may be implemented as part of other functionally relevant components (eg, camera module 180 or communication module 190). have.

The memory 130 may store various data used by at least one component of the electronic device 101 (eg, the processor 120 or the sensor module 176). The data may include, for example, input data or output data for software (eg, the program 140) and instructions related thereto. The memory 130 may include a volatile memory 132 or a nonvolatile memory 134.

The program 140 may be stored as software in the memory 130, and may include, for example, an operating system 142, middleware 144, or an application 146.

The input device 150 may receive commands or data to be used for components (eg, the processor 120) of the electronic device 101 from outside (eg, a user) of the electronic device 101. The input device 150 may include, for example, a microphone, mouse, keyboard, or digital pen (eg, a stylus pen).

The audio output device 155 may output an audio signal to the outside of the electronic device 101. The audio output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback, and the receiver can be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from, or as part of, the speaker.

The display device 160 may visually provide information to the outside of the electronic device 101 (eg, a user). The display device 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the device. According to an embodiment, the display device 160 may include a touch circuitry configured to sense a touch, or a sensor circuit (eg, a pressure sensor) configured to measure the strength of the force generated by the touch. have.

The audio module 170 may convert sound into an electrical signal, or vice versa. According to an embodiment, the audio module 170 acquires sound through the input device 150, or an external electronic device (eg, directly or wirelessly connected to the sound output device 155 or the electronic device 101) Sound may be output through the electronic device 102 (eg, a speaker or headphones).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the detected state can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biological sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more designated protocols that can be used for the electronic device 101 to directly or wirelessly connect to an external electronic device (eg, the electronic device 102). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert electrical signals into mechanical stimuli (eg, vibration or movement) or electrical stimuli that the user can perceive through tactile or motor sensations. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and videos. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101. According to one embodiment, the power management module 188 may be implemented, for example, as at least part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101. According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishing and performing communication through the established communication channel. The communication module 190 operates independently of the processor 120 (eg, an application processor) and may include one or more communication processors supporting direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 may include a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg : Local area network (LAN) communication module, or power line communication module. Corresponding communication module among these communication modules includes a first network 198 (eg, a short-range communication network such as Bluetooth, WiFi direct, or infrared data association (IrDA)) or a second network 199 (eg, a cellular network, the Internet, Or, it may communicate with an external electronic device through a computer network (eg, a telecommunication network such as a LAN or WAN). These various types of communication modules may be integrated into a single component (eg, a single chip), or may be implemented as a plurality of separate components (eg, multiple chips). The wireless communication module 192 uses a subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 in a communication network such as the first network 198 or the second network 199. The electronic device 101 can be verified and authenticated.

The antenna module 197 may transmit a signal or power to the outside (eg, an external electronic device) or receive it from the outside. According to an embodiment, the antenna module 197 may include a single antenna including a conductor formed on a substrate (eg, a PCB) or a radiator made of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas. In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network 198 or the second network 199, is transmitted from the plurality of antennas by, for example, the communication module 190. Can be selected. The signal or power may be transmitted or received between the communication module 190 and an external electronic device through the at least one selected antenna. According to some embodiments, other components (eg, RFIC) other than the radiator may be additionally formed as part of the antenna module 197.

At least some of the components are connected to each other through a communication method between peripheral devices (for example, a bus, a general purpose input and output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)). Ex: command or data) can be exchanged with each other.

According to an embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199. Each of the electronic devices 102 and 104 may be the same or a different type of device from the electronic device 101. According to an embodiment, all or some of the operations executed in the electronic device 101 may be performed in one or more external electronic devices of the external electronic devices 102, 104, or 108. For example, when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 instead executes the function or service itself. In addition or in addition, one or more external electronic devices may be requested to perform at least a portion of the function or the service. The one or more external electronic devices receiving the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and deliver the result of the execution to the electronic device 101. The electronic device 101 may process the result, as it is or additionally, and provide it as at least part of a response to the request. To this end, cloud computing, distributed computing, or client-server computing technology can be used, for example.

2 is a block diagram 200 illustrating a camera module 180 according to various embodiments.

Referring to FIG. 2, the camera module 180 includes a lens assembly 210, a flash 220, an image sensor 230, an image stabilizer 240, a memory 250 (eg, a buffer memory), or an image signal processor It may include (260). The lens assembly 210 may collect light emitted from a subject that is an object of image capture. The lens assembly 210 may include one or more lenses. According to an embodiment, the camera module 180 may include a plurality of lens assemblies 210. In this case, the camera module 180 may form, for example, a dual camera, a 360 degree camera, or a spherical camera. Some of the plurality of lens assemblies 210 have the same lens properties (eg, angle of view, focal length, autofocus, f number, or optical zoom), or at least one lens assembly is another lens assembly It may have one or more lens properties different from the lens properties of. The lens assembly 210 may include, for example, a wide-angle lens or a telephoto lens.

The flash 220 may emit light used to enhance light emitted or reflected from the subject. According to an embodiment, the flash 220 may include one or more light emitting diodes (eg, red-green-blue (RGB) LED, white LED, infrared LED, or ultraviolet LED), or xenon lamp. The image sensor 230 may obtain an image corresponding to the subject by converting light emitted from or reflected from the subject and transmitted through the lens assembly 210 into an electrical signal. According to one embodiment, the image sensor 230 is, for example, an RGB sensor, a black and white (BW) sensor, an IR sensor, or an image sensor selected from among image sensors having different attributes, such as a UV sensor, the same It may include a plurality of image sensors having attributes, or a plurality of image sensors having different attributes. Each image sensor included in the image sensor 230 may be implemented using, for example, a charged coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor.

The image stabilizer 240 may move at least one lens or image sensor 230 included in the lens assembly 210 in a specific direction in response to the movement of the camera module 180 or the electronic device 101 including the same. The operating characteristics of the image sensor 230 may be controlled (eg, read-out timing may be adjusted). This makes it possible to compensate for at least some of the negative effects of the motion on the image being shot. According to an embodiment, the image stabilizer 240 uses a gyro sensor (not shown) or an acceleration sensor (not shown) disposed inside or outside the camera module 180 to provide a camera module 180 or an electronic device 101 ) Can detect such movement. According to an embodiment, the image stabilizer 240 may be implemented as, for example, an optical image stabilizer. The memory 250 may temporarily store at least a part of the image acquired through the image sensor 230 for the next image processing operation. For example, when the image acquisition according to the shutter is delayed, or when a plurality of images are acquired at high speed, the acquired original image (eg, a Bayer-patterned image or a high resolution image) is stored in the memory 250 , The corresponding copy image (eg, a low resolution image) may be previewed through the display device 160. Thereafter, when a specified condition is satisfied (eg, a user input or a system command), at least a part of the original image stored in the memory 250 may be obtained and processed, for example, by the image signal processor 260. According to an embodiment, the memory 250 may be configured as at least a part of the memory 130 or a separate memory operated independently of the memory 130.

The image signal processor 260 may perform one or more image processes on an image acquired through the image sensor 230 or an image stored in the memory 250. The one or more image processes include, for example, depth map generation, three-dimensional modeling, panorama generation, feature point extraction, image synthesis, or image compensation (eg, noise reduction, resolution adjustment, brightness adjustment, blurring ( blurring, sharpening, or softening. Additionally or alternatively, the image signal processor 260 controls for at least one of the components included in the camera module 180 (eg, the image sensor 230) (eg, exposure time control, or lead-out timing control) Etc.). The image processed by the image signal processor 260 is stored in the memory 250 again for further processing or external components of the camera module 180 (eg, the memory 130, the display device 160, the electronic device ( 102), the electronic device 104, or the server 108. According to an embodiment, the image signal processor 260 may be configured as at least a part of the processor 120 or a separate processor that operates independently of the processor 120. When the image signal processor 260 is composed of a processor and a separate processor, at least one image processed by the image signal processor 260 is displayed as it is or after additional image processing by the processor 120 It may be displayed through the device 160.

According to an embodiment, the electronic device 101 may include a plurality of camera modules 180 each having different attributes or functions. In this case, for example, at least one of the plurality of camera modules 180 may be a wide-angle camera and at least another may be a telephoto camera. Similarly, at least one of the plurality of camera modules 180 may be a front camera, and at least another one may be a rear camera.

3 is a block diagram 300 illustrating an electronic device according to various embodiments.

Referring to FIG. 3, the electronic device 301 (eg, the electronic device 101 of FIG. 1) includes a wireless communication circuit 310 (eg, the communication module 190 of FIG. 1 ), a memory 320 (eg: The memory 130 of FIG. 1 ), the touch screen display 330 (eg, the display device 160 of FIG. 1 ), the camera 340 (eg, the camera module 180 of FIG. 1 ), the sensing unit 350 (Eg, sensor module 176 of FIG. 1 ), and a processor 360 (eg, processor 120 of FIG. 1 ).

According to one embodiment, the wireless communication circuit 310 (eg, the communication module 190 of FIG. 1) includes an electronic device 301 (eg, the electronic device 101 of FIG. 1) and an external electronic device (eg: Communication between the electronic device 102, the electronic device 104 of FIG. 1, or a server (eg, the server 108 of FIG. 1) may be connected.

According to one embodiment, the memory 320 (eg, the memory 130 of FIG. 1) includes an operation program of the camera 340 and a program according to embodiments of the present invention, and an image captured from the camera 340 You can save them. The memory 320 may store a reference value to determine whether an object (eg, a user's finger) is detected in the camera 340.

According to one embodiment, the touch screen display 330 (eg, the display device 160 of FIG. 1) may be configured as an integral type including a display 331 and a touch panel 333.

According to one embodiment, when the camera function is activated under the control of the processor 360, the touch screen display 330 may display an image received from the camera 340 as a preview image. The touch screen display 330 may display a notification that the object is detected on the camera 340 when it is determined that the object is detected by the camera 340 under the control of the processor 360. For example, the touch screen display 330 displays a pop-up window under the control of the processor 360, or displays a preview image by mixing pixels obtained from one of the at least one camera and pixels obtained from the other camera, or Alternatively, an image obtained from the camera where the object is detected may be displayed as a preview image.

However, the present invention is not limited thereto, and the notification is provided as a sound through a speaker (for example, the sound output device 155 of FIG. 1) under the control of the processor 360, or a haptic module (for example, the haptic module 179 of FIG. 1). )).

According to one embodiment, the camera 340 (eg, the camera module 180 of FIG. 1) transmits the collected image as a preview image to the display 331 so that the user can view the image projected through the camera 340. Can be confirmed. The camera 340 may generate image data by photographing the collected image at the time when the input requesting the photographing occurs in response to an input requesting photographing.

According to an embodiment, the camera 340 may include a first camera 341 and a second camera 343. The shooting using the first camera 341 and the shooting using the second camera 343 may be performed simultaneously. The first camera 341 may take an image indicating a wider range compared to the second camera 343. For example, the first camera 341 may provide a wider angle of view compared to the second camera 343.

According to an embodiment, an image obtained from one of the cameras 340, for example, the first camera 341 may be displayed on the display 331 as a preview image. The image obtained from the other camera, for example, the second camera 343, is not displayed on the display 331 as a preview image, but compared with the image obtained from the one camera, for example, the first camera 341, of high quality. It may contain an image.

In various embodiments of the present invention, it has been described as having two cameras, but is not limited thereto, and the electronic device 301 may have more than two cameras.

According to an embodiment, the sensing unit 350 (eg, the sensor module 176 of FIG. 1) surrounds the first camera 341 and the second camera 343 provided on the rear surface of the electronic device 301. It may be connected to a deco member formed of a conductive material (eg, a metal material). The sensing unit 350 may include a grip sensor and/or a touch integrated circuit (IC). The sensing unit 350 detects an object (eg, a user's finger) on a deco member formed of a conductive material surrounding the first camera 341 and the second camera 343 (eg, by proximity or contact). It is possible to detect a change in the capacitance value. The sensing unit 350 may transmit the sensed changed capacitance value to the processor 360.

According to one embodiment, the processor 360 (eg, the processor 120 of FIG. 1) controls the overall operation of the electronic device 301 and the signal flow between the internal components of the electronic device 301, and processes data. And control the supply of power from the battery to the components.

According to one embodiment, the processor 360 sets the capacitance value for the deco member formed to surround the first camera 341 and the second camera 343 with a conductive material at a specified time interval through the sensing unit 350. Can be obtained. When the function of the camera 340 is activated, the processor 360 may detect a change in the acquired capacitance value.

In another embodiment, when the function of the camera 340 is activated, the processor 360 may acquire a capacitance value for the deco member through the sensing unit 350, and detect a change in the capacitance value based on this.

In one embodiment, the processor 360 may determine whether the changed capacitance value exceeds a specified value, and based on this, determine whether an object (eg, a user's finger) is detected by the camera 340. When it is determined that the object is detected by the camera 340, the processor 360 may provide a notification that the object is detected to the camera 340.

In one embodiment, when it is determined that an object is not detected by the camera 340, the processor 360 may perform a photographing function in response to a user input for performing photographing using the camera.

In an embodiment, when the changed capacitance value obtained through the sensing unit 350 exceeds a specified value, the processor 360 may control at least one parameter value for the first image obtained from the first camera 341. The operation of comparing at least one parameter value for the second image obtained from the 2 camera 343 may be further performed. For example, the at least one parameter value may include at least one of brightness information, contrast information, phase information, or boundary lines extracted from the image. For example, the processor 360 compares parameter values between pixels of the same coordinates of the first image and the second image, or compares parameter values between the same region of the first image and the second image partitioned by a specified number, or the region At least one parameter value for a specified number of pixels may be compared.

In one embodiment, when an object is detected by the camera 340 through the comparison operation, the processor 360 may provide a notification that the object is detected by the camera 340.

4 is a diagram 400 illustrating a plurality of camera structures according to various embodiments.

Referring to FIG. 4, as shown in <410>, the electronic device 401 (eg, the electronic device 301 of FIG. 3) includes a plurality of cameras, such as a first camera 415 (eg, a first camera 415) on the rear surface 430. : The first camera 341 of FIG. 3 and the second camera 420 (eg, the second camera 343 of FIG. 3) may be provided.

In one embodiment, the back surface 430 of the electronic device 401 may be formed of a non-conductive material (eg, glass or plastic material).

In one embodiment, a deco member 425 surrounding the first camera 415 and the second camera 420 may be formed on the rear surface 430 of the electronic device 401. The deco member 425 may be formed of a conductive material (eg, a metal material).

In an embodiment, the first camera 415 and the second camera 420 are covered on the rear surface 430 of the electronic device 401, and the first camera 415 and the second camera 420 are respectively A camera window 435 exposing the lens may be formed. The camera window 435 may be formed of a non-conductive material.

In another embodiment, the camera window 435 may not be formed on the rear surface 430 of the electronic device 401.

In one embodiment, when the camera window 435 is formed on the rear surface 430 of the electronic device 401, the deco member 425 may be formed to surround the camera window 435.

In one embodiment, as shown in <460>, a plurality of cameras, for example, the first camera 415 and the second camera 420 may be provided on the substrate 440. For example, the substrate 440 may include a printed circuit board (PCB), or a flexible printed circuit board (FPCB).

In one embodiment, a contact 445 may be provided on the substrate 440 such that the substrate 440 and the deco member 425 are connected.

In one embodiment, based on a change in capacitance value as an object (eg, a user's finger) approaches the deco member 425 formed of a conductive material surrounding the first camera 415 and the second camera 420 , A processor (for example, the processor 360 of FIG. 3) may determine whether an object, for example, a user's finger is detected, in at least one of the first camera 415 and the second camera 420. For example, the processor includes a sensing unit (eg, a sensing unit 350 in FIG. 3) connected to a deco member 425 formed of a conductive material surrounding the first camera 415 and the second camera 420 (eg, a grip sensor) And/or detecting an object, for example, a user's finger, in at least one camera based on a change in the capacitance value sensed by the touch IC. In this regard, it will be described in detail in FIG. 5.

5 is a circuit diagram 500 illustrating a method of sensing an object in at least one camera based on a capacitance value, according to various embodiments.

Referring to FIG. 5, the electronic device (eg, the electronic device 301 of FIG. 3) includes a sensing unit 520 (eg, the sensing unit 350 of FIG. 3) and a deco member 510 (eg, of FIG. 4) Deco member 425) may include a first capacitor (capacitor) 530 connected between and a second capacitor (capacitor) 540 connected between the sensing unit 520 and the ground.

In one embodiment, the sensing unit 520 may include a grip sensor and/or a touch integrated circuit (IC).

In one embodiment, the first capacitor 530 connected between the sensing unit 520 and the deco member 510 may adjust the sensitivity of the capacitance as the object approaches the deco member 510.

In one embodiment, the second capacitor 540 connected between the sensing unit 520 and the ground may block an electrostatic discharge (ESD) voltage generated from the ground. As the ESD voltage is cut off, it is possible to prevent the ESD voltage generated from the ground from being transmitted to the user. When the ESD function is blocked when the camera function is activated, it is possible to prevent malfunction of the camera function as well as to prevent malfunction of the sensing unit 520 as the ESD voltage is applied to the decor member 510.

In one embodiment, the processor (eg, the processor 360 of FIG. 3) may control the sensing unit 520 and the deco member 510 to be electrically connected. The sensing unit 520 may detect a change in a capacitance value for the decor member 510. The sensing unit 520 may transmit the sensed capacitance change value to the processor.

In one embodiment, the processor, based on the capacitance change value received from the sensing unit 520, at least one camera (eg, the first camera 415 or the second camera 420 of FIG. 4) object ( For example: it is possible to determine whether the user's finger) is detected. For example, if the capacitance change value exceeds a specified value, the processor may determine that an object is detected in the at least one camera. If the capacitance change value does not exceed the specified value (eg, hereinafter), the processor may determine that the object is not detected in the at least one camera.

In one embodiment, if it is determined that the object is detected by the at least one camera, the processor may provide a notification that the object is detected by the at least one camera. Through the provided notification, the user can intuitively confirm that at least one camera is obscured by the object.

6 is a diagram 600 illustrating a plurality of camera structures according to various embodiments.

Referring to FIG. 6, as illustrated in <610>, the electronic device 601 includes a plurality of cameras, for example, a first camera, on the rear surface 645 (eg, the rear surface 430 of the electronic device 401 of FIG. 4 ). 615 (e.g., first camera 341 in FIG. 3, first camera 415 in FIG. 4) and second camera 630 (e.g., second camera 343 in FIG. 3, second in FIG. 4) 2 camera 420).

In one embodiment, the back surface 645 of the electronic device 601 may be formed of a non-conductive material (eg, glass or plastic material).

In one embodiment, a first deco member 620 and a second deco member 635 surrounding each of the first camera 615 and the second camera 630 on the back 645 of the electronic device 601 Can be formed. The first deco member 620 and the second deco member 635 may be formed of a conductive material (eg, a metal material).

In one embodiment, a first camera window 625 covering the first camera 615 may be formed on the rear surface 645 of the electronic device 601 and exposing the lens of the first camera 615. A second camera window 640 that covers the second camera 630 provided on the rear 645 and exposes the lens of the second camera 630 may be formed on the rear 645 of the electronic device 601. Can. The first camera window 625 and the second camera window 640 may be formed of a non-conductive material.

In another embodiment, the first camera window 625 and the second camera window 640 may not be formed on the rear surface 645 of the electronic device 601.

In one embodiment, when the first camera window 625 and the second camera window 640 are formed on the rear surface 645 of the electronic device 601, the first deco member 620 and the second deco member 635 ) Each of the first camera window 625 and the second camera window 640 may be formed to surround each.

In one embodiment, as shown in <670>, a plurality of cameras, for example, the first camera 615 and the second camera 630 may be provided on the substrate 650. In one embodiment, a first contact 655 may be provided on the substrate 650 such that at least a portion of the substrate 650 and the first decor member 620 are connected. A second contact 660 may be provided on the substrate 650 such that at least a portion of the substrate 650 and the second decor member 660 are connected.

In one embodiment, an object (eg, a user) is provided on at least one of the first deco member 620 and the second deco member 635 formed of a conductive material surrounding each of the first camera 615 and the second camera 630. Based on the change in the capacitance value as the finger of the proximity), a processor (for example, the processor 360 of FIG. 3) is an object in at least one camera of the first camera 615 and the second camera 630 For example, it may be determined whether the user's finger is detected. For example, the processor may include a sensing unit (eg, sensing of FIG. 3) connected to the first deco member 620 and the second deco member 635 formed of a conductive material surrounding the first camera 615 and the second camera 630. Based on the change in the capacitance value sensed by the unit 350 (eg, a grip sensor and/or a touch IC), it is possible to determine whether an object, for example, a user's finger is detected, in at least one camera. In this regard, it will be described in detail in FIG. 7.

7 is a circuit diagram 700 for describing a method of sensing an object in at least one camera based on a capacitance value, according to various embodiments.

Referring to FIG. 7, an electronic device (eg, the electronic device 301 of FIG. 3) includes a sensing unit 730 (eg, the sensing unit 350 of FIG. 3) and a first decor member 710 (eg, FIG. It may include a first capacitor (740) connected between the first deco member (620) of (6) and a second capacitor (capacitor) 750 connected between the sensing unit 730 and the ground. The electronic device includes a third capacitor 760 and the sensing unit 730 connected between the sensing unit 730 and the second deco member 720 (eg, the second deco member 635 of FIG. 6 ). It may include a fourth capacitor (capacitor) 770 connected between the ground.

In one embodiment, the first capacitor 740 and the third capacitor 760 adjust the sensitivity of the capacitance as the object approaches the first deco member 710 and/or the second deco member 720 can do.

In one embodiment, the second capacitor 750 and the fourth capacitor 770 may block an electrostatic discharge (ESD) voltage generated from ground. It is possible to prevent the ESD voltage generated from the ground from being transmitted to the user. When the camera function is activated, as the ESD voltage is cut off, not only the malfunction of the camera function is prevented, but also the sensing unit according to which the ESD voltage is applied to the first decor member 710 and/or the second decor member 720 ( 730) can be prevented.

In one embodiment, the processor (eg, the processor 360 of FIG. 3) may control the sensing unit 730 to be electrically connected to the first deco member 710 and the second deco member 720. The sensing unit 730 may detect a change in the capacitance value of the first deco member 710 and/or the second deco member 720. The sensing unit 730 may transmit the sensed capacitance change value to a processor (eg, the processor 360 of FIG. 3 ).

In one embodiment, the processor is a first camera (eg, the first camera 615 of FIG. 6) or a second camera (eg, the second of FIG. 6) based on the capacitance change value received from the sensing unit 730. The camera 630 may determine whether an object (eg, a user's finger) is detected. For example, when the capacitance change value for the first deco member 710 received from the sensing unit 730 exceeds a specified value, the processor detects an object in the first camera included in the first deco member 710. You can decide. Alternatively, when the capacitance change value for the second deco member 720 received from the sensing unit 730 exceeds a specified value, the processor determines that the object is detected by the second camera included in the second deco member 720. Can decide.

In one embodiment, if the value of at least one of the capacitance change value for the first deco member 710 or the capacitance change value for the second deco member 720 does not exceed a specified value (eg, hereinafter), the processor May determine that the object is not detected by the first camera or the second camera.

In one embodiment, if it is determined that the object is detected by the at least one camera, the processor may provide a notification that the object is detected by the at least one camera. Through the provided notification, the user can intuitively confirm that at least one camera is obscured by the object.

In one embodiment, although the first deco member 710 and the second deco member 720 are described as being connected to the sensing unit 730, when a plurality of sensing units are provided, the first deco member is provided in each of the plurality of sensing units. 710 and the second deco member 720 may be connected.

6 and 7 according to an embodiment, as the first deco member 710 enclosing the first camera and the second deco member 720 enclosing the second camera are formed, the user may make the object the first camera. It is possible to accurately check whether it is detected by or in the second camera.

8 is a flow chart 800 for describing a method for sensing an object in at least one camera based on a capacitance value, according to various embodiments.

Referring to FIG. 8, the processor (eg, the processor 360 of FIG. 3) detects a change in the capacitance value obtained through at least one sensing unit (eg, the sensing unit 350 of FIG. 3) in operation 801. can do.

In one embodiment, when the camera function is activated, the processor displays an image obtained from one of at least one camera (eg, first camera 341 and second camera 343 in FIG. 3) as a preview image (Eg, display 331 in FIG. 3). The image obtained from the other camera is not displayed on the display as a preview image, but may include an image with a narrower angle of view compared to the image obtained from the one camera.

5 and 7 according to various embodiments, the processor may include at least one deco member (eg, a deco member 510 of FIG. 5, a first deco member 710 of FIG. 7, and a second deco member 720). )) and a sensing unit (eg, the sensing unit 520 of FIG. 5 and the sensing unit 730 of FIG. 7) can be controlled to be electrically connected. The at least one deco member is made of a conductive material (eg, a metal material), such that the back of the electronic device (eg, the back 430 of the electronic device 401 of FIG. 4 and the back of the electronic device 601 of FIG. 6) (645)) may be formed to surround at least one camera.

In one embodiment, the processor may acquire a capacitance value for at least one deco member formed to surround the at least one camera with a conductive material at a specified time interval through at least one sensing unit. When the camera function is activated, the processor may detect a change in the capacitance value based on the capacitance value obtained through at least one sensing unit. For example, the processor detects an object (eg, a user's finger) on at least one deco member formed to surround the at least one camera with the conductive material through at least one sensing unit (eg, detected by proximity or contact). It is possible to detect a change in the capacitance value.

In one embodiment, it has been described as acquiring a capacitance value for at least one deco member at a specified time interval through at least one sensing unit and detecting a change in the capacitance value when the camera function is activated, but is not limited thereto. For example, in another embodiment, when the camera function is activated, a capacitance value for at least one deco member may be acquired through at least one sensing unit, and based on this, a change in the capacitance value may be detected.

In one embodiment, the processor may determine whether the changed capacitance value exceeds a specified value in operation 803. For example, the processor may determine whether to detect an object in at least one camera based on whether the changed capacitance value exceeds the specified value.

In one embodiment, if it is determined that the object is detected by the at least one camera as the changed capacitance value exceeds the specified value, the processor determines, in operation 805, that the object is detected by the at least one camera. Notifications can be provided. For example, the notification that the object is detected in the at least one camera is displayed as a preview image by mixing a vibration, a pop-up window, a pixel obtained from one of the at least one camera, and a pixel obtained from the other camera, Alternatively, an image obtained from the camera where the object is sensed may be provided as at least one of the display on the display as a preview image. The user can intuitively confirm that the at least one camera is obscured by the object through the notification that the object is detected in the provided at least one camera.

In one embodiment, if it is determined that the object is not detected by the at least one camera as the changed capacitance value does not exceed the specified value, the processor photographs using the at least one camera in operation 807. The photographing function may be performed in response to a user input for performing.

9 is a diagram 900 for describing a method of detecting an object in at least one camera based on parameter values for an image according to various embodiments.

Referring to FIG. 9, a processor (eg, the processor 360 of FIG. 3) may include a first image (eg, a first image obtained from a first camera (eg, the first camera 341 of FIG. 3) as illustrated in <910>) 915) and the second image 955 obtained from the second camera (eg, the second camera 343 in FIG. 3) as shown in <950>, the object of at least one camera, such as the user's It can be determined whether the finger 960 is detected. For example, the processor uses the at least one of brightness information, contrast information, phase information, or boundary lines extracted from each image of the first image 915 and the second image 955 to determine the user's It can be determined whether the finger 960 is detected.

In one embodiment, the user's finger 960 is detected on at least a portion of the second camera while displaying the image 915 obtained from the first camera as a preview image on the display (eg, the display 331 of FIG. 3 ). It is assumed that it has been done.

In one embodiment, as the user's finger 960 approaches or contacts the second camera, the amount of light obtained through the second camera may be small compared to the amount of light obtained through the first camera. As the amount of light obtained through the second camera is smaller than the amount of light obtained through the first camera, the brightness information of the second image 955 obtained from the second camera is the first image 915 obtained from the first camera It may be lower than the brightness information.

In one embodiment, the processor may calculate a difference in brightness information (eg, brightness value) between pixels of the same coordinates of the first image 915 and the second image 955. Based on the calculated difference in brightness information, the processor may determine that the user's finger 960 is sensed (eg, close or in contact) in at least a portion of the second camera.

In one embodiment, it has been described on the assumption that the second camera determines whether the user's finger 960 is detected based on the brightness information, but is not limited thereto, and the difference in contrast value, phase difference, or extracted from the image The second camera may determine whether the user's finger 960 is detected based on the boundary line.

In one embodiment, when determining whether the user's finger 960 is detected by the second camera based on the difference in contrast values, as the user's finger 960 obscures at least a portion of the second camera Contrast because the contrast difference in the second image 955 obtained from the second camera is small compared to the contrast difference of the first image 915 obtained from the first camera in which the user's finger 960 is not detected. May be low. The processor may compare the contrast value for the first image 915 obtained from the first camera and the contrast value for the second image 955 obtained from the second camera. When the difference between the contrast values for the two images 915 and 955 exceeds the specified value through the comparison operation, the processor detects (eg, close or touches) the user's finger 960 on at least a portion of the second camera. You can decide.

In one embodiment, before performing the operation of comparing the contrast values for the first image 915 and the second image 955, the processor may perform the contrast of the subject obtained from each of the first camera and the second camera ( For example, based on the difference between the light and dark areas, the focus on the subject may be automatically adjusted (eg, contrast AF (auto focus)).

In one embodiment, the processor adjusts the contrast AF of the first camera providing the preview image and the contrast AF of the second camera, and then detects whether the user's finger 960 is detected in at least a portion of the second camera Can be. In the operation of adjusting the contrast AF of the first camera and the contrast AF of the second camera, since the contrast difference for each image obtained from each camera may vary according to the AF value (eg, an image for a subject when focus is achieved) Since the contour of the image is high and the contrast is high, and the image is out of focus, the contour of the image may be blurred and the contrast may be lowered).

In one embodiment, it has been described as automatically adjusting the focus on the subject based on the contrast of the subject obtained from each of the first camera and the second camera, but is not limited thereto, and the processor is a subject acquired from the first camera After adjusting the contrast AF for, it is possible to adjust the contrast AF for the subject obtained from the second camera by using the autofocus value of the first camera.

In one embodiment, when the sensing unit (eg, the sensing unit 350 of FIG. 3) includes a phase difference AF sensor, a user's finger is at least a part of the second camera based on the phase difference obtained through the phase difference AF sensor It is possible to detect whether 960 is detected. For example, as the user's finger 960 is detected in at least a portion of the second camera, the phase difference AF value of the second camera may be different from the phase difference AF value of the first camera in which the user's finger 960 is not detected. have. When the difference between the phase difference value of the first camera and the phase difference AF value of the second camera exceeds a specified value, the processor detects (eg, close or touches) the user's finger 960 on at least a portion of the second camera. You can decide.

In an embodiment, when determining whether the user's finger 960 is detected by the second camera based on the boundary line extracted from the image, at least a part of the second camera is blocked by the user's finger 960 Accordingly, the boundary line extracted from the second image 955 obtained from the second camera may be different from the boundary line extracted from the first image 915 obtained from the first camera where the user's finger 960 is not detected. . The processor may determine whether the user's finger 960 is detected in at least a portion of the second camera by comparing the boundary line extracted from the first image 915 with the boundary line extracted from the second image 955. . With reference to the operation of detecting the user's finger 960 in the second camera based on the boundary line extracted from each of the above-described images, it will be described in detail in FIG. 11.

In one embodiment, the at least one camera is used by using at least one of the brightness information, contrast information, phase information, or boundary lines extracted from each image of the first image 915 and the second image 955 described above. It is determined whether the user's finger 960 is detected, and based on this, a notification that the user's finger 960 is detected may be provided by the at least one camera.

10 is a diagram 1000 illustrating a method of sensing an object in at least one camera based on parameter values for an image according to various embodiments.

Referring to FIG. 10, a processor (eg, the processor 360 of FIG. 3) is a first image (eg, a first image obtained from a first camera (eg, the first camera 341 of FIG. 3) as illustrated in <1010>) 1015) and a second image 1055 obtained from a second camera (eg, the second camera 343 in FIG. 3) as shown in <1050>, an object, such as the user's, in at least one camera. It may be determined whether the finger 1060 is detected.

In one embodiment, a user's finger 1060 is detected on at least a portion of the second camera while displaying the image 1015 obtained from the first camera as a preview image on the display (eg, the display 331 of FIG. 3 ). It is assumed that it has been done.

In one embodiment, the processor may divide the first image 1015 and the second image 1055 for each zone to determine whether the user's finger 1060 is detected in at least one camera. In an exemplary embodiment, the number of zones for the partitioned image is assumed to be 9, but is not limited thereto, and the maximum number of pixels of the image sensor embedded in each of the first camera and the second camera (eg, 256) ).

In one embodiment, a parameter value for a specified number (eg, 10) of pixels in each zone of the first image 1015 (eg, first to ninth zones) and each of the first image 1015 It is possible to compare parameter values for a specified number of pixels (for example, 10) in a region (eg, the first to ninth regions) of the second image 1055 corresponding to the region. For example, the parameter value may include at least one of brightness information, contrast information, phase information, or a boundary line extracted from an image.

In one embodiment, the processor may compare brightness information for a specified number of pixels in the first image 1015 (eg, average brightness information) and brightness information for a specified number of pixels in the second image 1055. The brightness information for the specified number of pixels in the second image 1055 is the number of the specified number in the first image 1015 as the user's finger 1060 is detected (eg, close or in contact) with at least a portion of the second camera. It may be lower than the average brightness information for the pixel. If the difference in brightness information for the specified number of pixels in the first image 1015 and the second image 1055 exceeds a specified value, the processor may determine that the user's finger 1060 is detected in at least one camera. have.

In one embodiment, it is described as determining whether an object 1060 is detected in at least one camera based on a difference in brightness information for a specified number of pixels in the first image 1015 and the second image 1055 However, it is not limited to this. For example, the difference and phase of the contrast information for the specified number of pixels in the same manner as determining whether the object 1060 is detected in at least one camera based on the difference in brightness information for the specified number of pixels described above. It is possible to determine whether a user's finger 1060 is detected in at least one camera based on a boundary extracted from a difference or image.

In one embodiment, the processor is configured to compare a user's finger with at least one camera by comparing a parameter value for a specified number of pixels in a first image 1015 and a parameter value for a specified number of pixels in a second image 1055. If it is determined that 1060 is detected, a notification that the object is detected may be provided to the at least one camera.

The processor according to an embodiment may quickly detect an object in at least one camera through an operation of comparing only parameter values for a specified number of pixels in each region of the first image 1015 and the second image 1055 Can.

However, the present invention is not limited thereto, and in another embodiment, the processor corresponds to a parameter value of each zone of the first image 1015 (eg, first zone to ninth zone) and each zone of the first image 1015. The parameter values of the regions of the second image 1055 (eg, the first region to the ninth region) may be compared.

In other embodiments, if the camera is generally covered by an object, all or part of the camera may be covered. When all or part of the camera is covered, the object may be detected in an area in the image, for example, an outer area or a central area among the first to ninth areas. The processor may assign a higher priority to the outer zone or the central zone among the first to ninth zones as a zone for comparing parameter values. For example, the processor may include parameter values of the outer zone (or central zone) of the first image 1015 and the outer zone of the second image 1055 corresponding to the outer zone (or central zone) of the first image 1015. The parameter values of the zone (or central zone) can be compared. By first comparing the parameter values of an area where an object is likely to be detected, an object in at least one camera can be quickly detected.

11 is a diagram 1100 for describing a method of detecting an object in at least one camera based on parameter values for an image according to various embodiments.

Referring to FIG. 11, a processor (for example, the processor 360 of FIG. 3) may include a first image 1115 from a first camera (eg, the first camera 341 of FIG. 3) as illustrated in <1110>. As shown in <1150>, a second image 1155 may be obtained from a second camera (eg, the second camera 343 in FIG. 3). The processor may extract a boundary line from the first image 1115 and the second image 1155.

A method of detecting a border between colors of a subject included in the first image 1115 and the second image 1155 according to an embodiment is a known technique, and a person having ordinary knowledge in the technical field of the present invention Since it is self-evident, the detailed description will be omitted.

In one embodiment, the processor may compare the boundary line extracted from the first image 1115 and the boundary line extracted from the second image 1155. A specific area of the second image 1155 corresponds to a specific area of the second image 1155 as the boundary 1165 is extracted by an object detected by the second camera, for example, the user's finger 1160. The boundary of a specific area of the image 1115 may be different. When an area having different border lines exists through comparison between the first image 1115 and the second image 1155, the processor determines that the user's finger 1160 is detected in at least one camera, and the at least one The camera may provide a notification that the object is detected.

12 is a flowchart 1200 illustrating a method of sensing an object in at least one camera based on parameter values for an image according to various embodiments.

Referring to FIG. 12, in operation 1201, when the camera function is activated, the processor first image (eg, the first image of FIGS. 9 to 11) from the first camera (eg, first camera 341 of FIG. 3) (915, 1015, 1115), and a second image (eg, second image 955, 1055, 1155 of FIGS. 9 to 11) from a second camera (eg, second camera 343 of FIG. 3) )).

In one embodiment, while displaying the first image obtained from the first camera as a preview image on the display (eg, the display 331 of FIG. 3 ), an object (eg, a user's finger (eg, a user's finger (eg, : It will be described on the assumption that the user's fingers 960, 1060, and 1160 in FIGS. 9 to 11 are detected.

In one embodiment, in operation 1203, the processor may compare at least one parameter value for the first image obtained from the first camera and at least one parameter value for the second image obtained from the second camera. For example, the at least one parameter value may include at least one of brightness information, contrast information, phase information, or boundary lines extracted from the image. For example, the processor compares parameter values between pixels of the same coordinates of the first image and the second image, compares parameter values between the same region of the first image and the second image partitioned by the specified number, or a specified number of regions within the region You can compare the parameter values for the pixels of.

In an embodiment, the processor may determine whether an object is detected in at least one camera in operation 1205 through the comparison operation. For example, the processor may generate an object in at least one camera based on at least one of a case in which a difference between brightness information, contrast information, and phase information exceeds a specified value or a boundary line extracted from each image is determined to be different through the comparison. You can decide whether it is detected.

In one embodiment, when an object is detected in at least one camera through the comparison operation, the processor may provide a notification that the object is detected in the at least one camera in operation 1207. The user can intuitively confirm that the at least one camera is obscured by the object through the notification that the object is detected in the provided at least one camera.

In one embodiment, if an object is not detected in at least one camera through the comparison operation, the processor performs a shooting function in operation 1209 in response to a user input for performing shooting using the at least one camera. Can.

In one embodiment, a weight may be assigned to each of the at least one parameter value, and the processor may determine whether an object is detected in at least one camera based on the at least one parameter value having a high weight.

For example, the at least one parameter value includes at least one of brightness information, contrast information, phase information, or a boundary line extracted from the image, and the weight is high in the order of brightness information, contrast information, phase information, and boundary line extracted from the image. It is assumed that it is given. The processor may determine whether an object is detected in at least one camera based on at least one parameter value having high weight, for example, brightness information. The present invention is not limited thereto, and the processor may determine whether an object is detected in at least one camera based on two or more high-weighted parameter values, such as brightness information and contrast information.

13 is a flowchart 1300 for explaining a method of sensing an object in at least one camera based on a capacitance value and a parameter value for an image according to various embodiments.

13 according to various embodiments of the present disclosure is a view for explaining a method of sensing an object in at least one camera using the capacitance value of FIG. 8 and the parameter value of FIG. 12.

According to an embodiment, operations 1301 and 1303 are the same as operations 801 and 803 of FIG. 8 described above, and operations 1305 to 1311 are the same as operations 1201 to 1209 of FIG. 12 described above, and thus detailed description thereof. It will be replaced with the description related to FIGS. 8 and 12 above.

Referring to FIG. 13, the processor (eg, the processor 360 of FIG. 3) detects a change in the capacitance value obtained through at least one sensing unit (eg, the sensing unit 350 of FIG. 3) in operation 1301. can do.

In one embodiment, the processor may determine, in operation 1303, whether the changed capacitance value exceeds a specified value. If the changed capacitance value exceeds the specified value, the processor in operation 1305, the first image (eg, the first camera 341 of FIG. 3) obtained from the first image (eg, the first of FIGS. 9 to 11) At least one parameter value for the first image (915, 1015, 1115) and a second image (eg, the second image from FIGS. 9 to 11) obtained from the second camera (eg, the second camera 343 in FIG. 3) It is possible to compare at least one parameter value for 2 images (955, 1055, 1155).

In one embodiment, through the comparison operation, the processor determines whether an object is detected in at least one camera in operation 1307, and if the object is detected, in operation 1309, the object is detected in the at least one camera. It can provide notification of being.

In one embodiment, if the changed capacitance value of operation 1303 does not exceed a specified value, or if an object is not detected by at least one camera through a comparison operation of operation 1307, the processor uses at least one camera in operation 1311 In response, a photographing function may be performed in response to a user input for performing photographing.

In FIG. 13 according to an embodiment, it may be determined whether or not the changed capacitance value of operation 1303 exceeds a specified value and whether an object is detected in at least one camera more accurately through comparison of parameter values for each image of operation 1305. have.

14 is a diagram 1400 illustrating a case in which an object is detected in at least one camera according to various embodiments.

Referring to FIG. 14, as shown in <1410> and <1450>, an electronic device (eg, the electronic device 301 of FIG. 3) has a first camera 1415 at the rear (eg, the first camera of FIG. 3) (341)) and a second camera 1420 (eg, the second camera 343 in FIG. 3). The electronic device includes at least one deco member 1425 surrounding the first camera 1415 and the second camera 1420 on a rear surface (for example, the deco member 510 of FIG. 5 and the first deco member of FIG. 7 ). (710), the second deco member (720). The at least one deco member 1425 may be formed of a conductive material (eg, a metal material).

In one embodiment, the processor (eg, the processor 360 of FIG. 3) includes a sensing unit (eg, the sensing unit 350 of FIG. 3 ), a sensing unit 520 of FIG. 5, and a sensing unit 730 of FIG. 7. ) And the at least one decor member 1425 can be controlled to be electrically connected. As the sensing unit and the at least one deco member 1425 are electrically connected, the processor detects an object, such as a user's finger 1430, on the at least one deco member 1425, and a capacitance value through the sensing unit. Changes can be detected.

For example, as shown in <1410> and <1450>, as the user's finger 1430 is detected by the second camera 1420, the capacitance value may change, and the processor exceeds the specified capacitance value. If so, the second camera 1420 may provide a notification indicating that the user's finger 1430 is detected.

With respect to the configuration for providing the notification according to an embodiment, it will be described in detail in FIG. 15.

15 is a diagram 1500 illustrating a method of providing a notification that an object is detected in at least one camera according to various embodiments.

In one embodiment, an image obtained from the first camera (eg, the first camera 341 in FIG. 3) is displayed on the display as a preview image, and a second camera (eg, the second camera 343 in FIG. 3) It is assumed that at least a part of the user's finger 1540 is detected.

Referring to FIG. 15, as shown in <1510>, a processor (for example, the processor 360 of FIG. 3) may include a camera (eg, the camera 340 of FIG. 3) on a display (eg, the display 331 of FIG. 3). )) may display a pop-up window 1515 indicating that at least a part of the object has been obscured by, for example, a user's finger. The present invention is not limited thereto, and the processor may output a vibration or sound to provide a notification that at least a part of the camera is obscured by the object.

In one embodiment, as shown in <1530>, the processor displays an image 1535 including the detected user's finger 1540 obtained with a second camera instead of displaying the image obtained from the first camera as a preview image. ) As a preview image. The present invention is not limited thereto, and the processor may display the first image obtained from the first camera and the second image acquired from the second camera on a display at a specified time interval. The first image and the second image may provide a notification that at least a part of the camera is obscured by an object through a blinking visual effect according to the display at the specified time interval.

In one embodiment, as shown in <1550>, the processor mixes the pixel 1555 for the first image obtained from the first camera and the pixel 1560 for the second image obtained from the second camera. You can create a preview image of and display it on the display. As the pixel 1555 for the first image and the pixel 1560 for the second image are mixed and displayed as a preview image, the user's finger is displayed in the pixel 1560 region for the second image where the user's finger is located. Can be.

By providing a notification that an object is detected in the at least one camera described above according to an embodiment, the user can intuitively confirm that the at least one camera is blocked by a finger.

The electronic device according to various embodiments disclosed in the present document may be various types of devices. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

It should be understood that various embodiments of the document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, and include various modifications, equivalents, or substitutes of the embodiment. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and Each of the phrases such as “at least one of A, B, or C” may include any of the items listed together in the corresponding phrase of the phrases, or any possible combination thereof. Terms such as “first”, “second”, or “first” or “second” can be used to simply distinguish a component from other components, and to separate components from other aspects (eg, importance or Order). Any (eg first) component is referred to as a “coupled” or “connected” to another (eg second) component, with or without the term “functionally” or “communically” If mentioned, it means that any of the above components can be connected directly to the other components (eg by wire), wirelessly, or through a third component.

As used herein, the term "module" may include units implemented in hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic blocks, components, or circuits. The module may be an integrally configured component or a minimum unit of the component or a part thereof performing one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present disclosure may include one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101). It may be implemented as software (eg, the program 140) including them. For example, a processor (eg, processor 120) of a device (eg, electronic device 101) may call and execute at least one of one or more commands stored from a storage medium. This enables the device to be operated to perform at least one function according to the at least one command called. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The storage medium readable by the device may be provided in the form of a non-transitory storage medium. Here,'non-transitory' only means that the storage medium is a tangible device, and does not contain a signal (eg, electromagnetic waves), and this term is used when data is stored semi-permanently in a storage medium. It does not distinguish between temporary storage cases.

According to an embodiment, a method according to various embodiments disclosed in this document may be provided as being included in a computer program product. Computer program products can be traded between sellers and buyers as products. The computer program product is distributed in the form of a device-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store (eg Play Store ^TM ) or two user devices ( For example, it can be distributed directly between smartphones) and online (eg, downloaded or uploaded). In the case of online distribution, at least a portion of the computer program product may be stored at least temporarily on a storage medium readable by a device such as a memory of a manufacturer's server, an application store's server, or a relay server, or may be temporarily generated.

According to various embodiments, each component (eg, module or program) of the above-described components may include a singular or a plurality of entities. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, modules or programs) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components the same or similar to that performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component may be executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be executed in a different order, or omitted Or, one or more other actions can be added.

310: wireless communication circuit 320: memory
330: touch screen display 341: first camera
343: second camera 350: sensing unit
360: processor

Claims (18)

In the electronic device,
housing;
A first camera and a second camera exposed outside the housing;
At least one deco member formed of a conductive material surrounding the first camera and the second camera;
At least one sensing unit; And
And a processor electrically connected to the first camera, the second camera, the at least one deco member, and the at least one sensing unit,
The processor,
A capacitance value for at least one deco member formed of the conductive material is obtained through the at least one sensing unit,
When the camera function is activated and a change in the acquired capacitance value is detected, it is determined whether the changed capacitance value exceeds a specified value, and
When the changed capacitance value exceeds the specified value, an electronic device configured to provide a notification that an object is detected in at least one of the first camera and the second camera. According to claim 1,
The processor,
If the changed capacitance value exceeds the specified value, compare at least one parameter value for the first image obtained from the first camera and at least one parameter value for the second image obtained from the second camera, , And
An electronic device configured to provide a notification that the object is detected in the at least one camera based on the comparison result. According to claim 2,
The processor,
Compare at least one parameter value between pixels of the same coordinates of the first image and the second image, or
Compare at least one parameter value between the same region of the first image and the second image partitioned by a specified number, or
An electronic device configured to compare at least one parameter value for a specified number of pixels in each region of the first image and the second image. According to claim 2,
The at least one parameter value includes at least one of brightness information, contrast information, phase information, or a boundary line extracted from the image. The method of claim 4,
The processor,
A weight is given to each of the at least one parameter value, and at least two parameter values for the first image obtained from the first camera and the second camera are obtained based on at least two parameter values having a high weight. An electronic device configured to compare at least two parameter values for the second image. According to claim 1,
Further comprising a display,
The processor,
An electronic device configured to display an image obtained from one of the first camera and the second camera as a preview image on the display, and to obtain a high-quality image from the other camera. The method of claim 6,
The processor,
An image obtained by mixing the notification sound, vibration, a pop-up window, a pixel obtained from the first camera and a pixel obtained from the second camera as a preview image, or an image obtained from the camera where the object is detected An electronic device configured to provide at least one of the displays on the display as a preview image. According to claim 1,
The processor,
If the changed capacitance value is less than or equal to the specified value, an electronic device set to perform a shooting function in response to a user input for performing shooting using the first camera and the second camera. According to claim 1,
The at least one sensing unit, an electronic device including at least one of a grip sensor or a touch integrated circuit (IC). According to claim 1,
The housing is an electronic device formed of a non-conductive material. In the method of recognizing the occlusion of the camera of the electronic device,
Obtaining a capacitance value for at least one deco member formed to surround the first camera and the second camera with a conductive material through at least one sensing unit;
Determining whether the changed capacitance value exceeds a specified value when a camera function is activated and a change in the acquired capacitance value is detected; And
And when the changed capacitance value exceeds the specified value, providing a notification that an object is detected in at least one of the first camera and the second camera. The method of claim 11,
Comparing the at least one parameter value for the first image obtained from the first camera with the at least one parameter value for the second image obtained from the second camera when the changed capacitance value exceeds the specified value The method further comprising an action. The method of claim 12,
Comparing the at least one parameter value,
Comparing at least one parameter value between pixels of the same coordinates of the first image and the second image;
Comparing at least one parameter value between the same region of the first image and the second image partitioned by a specified number; or
And comparing at least one parameter value for a specified number of pixels in each region of the first image and the second image. The method of claim 12,
The at least one parameter value includes at least one of brightness information, contrast information, phase information, or a boundary line extracted from the image. The method of claim 14,
Comparing the at least one parameter value,
Weighting each of the at least one parameter value; And
Based on at least two parameter values having a high weight, at least two parameter values for the first image obtained from the first camera and at least two parameter values for the second image obtained from the second camera A method comprising a comparing operation. The method of claim 11,
The image obtained from one of the first camera and the second camera includes an image displayed on a display as a preview image, and
The image obtained from the other camera of the first camera and the second camera is not displayed on the display and includes a high-quality image. The method of claim 16,
The operation for providing the notification,
Sound, vibration, a pop-up window, an image obtained by mixing a pixel obtained from the first camera and a pixel obtained from the second camera is displayed on the display as a preview image, or an image obtained from the camera where the object is detected is a preview image. And providing the notification using at least one of the indications on the display. The method of claim 11,
And if the changed capacitance value is equal to or less than the specified value, further comprising performing a shooting function in response to a user input for performing shooting using the first camera and the second camera.

Images