KR102530663B1 - Electronic device providing switching between signals output from concurrently operable image sensors - Google Patents

Abstract

The electronic device includes an input interface, a wide-angle sensor, a telephoto sensor, and an output interface. The input interface receives a zoom factor. The wide-angle sensor operates when the zoom magnification is smaller than the first reference magnification. The telephoto sensor operates when the zoom magnification is greater than the second reference magnification smaller than the first reference magnification, and operates together with the wide-angle sensor when the zoom magnification is between the second reference magnification and the first reference magnification. The output interface outputs the first image based on the first signal from the wide-angle sensor when the zoom magnification is smaller than the conversion magnification between the second reference magnification and the first reference magnification, and telephoto when the zoom magnification is greater than the conversion magnification. A second image is output based on the second signal from the sensor.

Description

Electronic device that provides switching between signals output from image sensors capable of simultaneous operation

The present disclosure relates to electronic devices, and more particularly, to configurations and operations of electronic devices for capturing images.

Recently, various types of electronic devices have been widely used. An electronic device performs unique functions according to the operations of electronic circuits included in it. Electronic devices provide services to users as they perform their own functions.

As an example, an image capture device is one example of various electronic devices. An image capture device is used to capture an image intended by a user, including an object and a background. An image capture device includes various electronic circuits to collect light and generate signals related to images, and provides a service for capturing images to a user according to operations of the electronic circuits.

Meanwhile, image capture devices are widely spread and used by many users. Accordingly, it has become necessary to satisfy various requirements of users in relation to the performance and usage of image capturing devices.

For example, in order to increase user satisfaction, it may be required to increase processing performance and operation speed of an image capture device. For example, in order to reduce power consumed by the image capturing device, it may be required to appropriately control an operating method of the image capturing device. As such, in order to satisfy various requirements of users, methods for improving the structure and operation of image capture devices have been proposed.

Embodiments of the present disclosure may provide an electronic device including image sensors capable of simultaneous operation. In embodiments, an electronic device may control operations of image sensors and related circuits to provide a natural transition between output images according to operations of image sensors.

In some embodiments, an electronic device may include an input interface, a wide-angle sensor, a telephoto sensor, and an output interface. The input interface may receive a zoom magnification. The wide-angle sensor may operate when the received zoom magnification is smaller than the first reference magnification. The telephoto sensor may operate when the received zoom magnification is greater than a second reference magnification smaller than the first reference magnification, and operate together with the wide-angle sensor when the received zoom magnification is between the second reference magnification and the first reference magnification. can do. The output interface may output the first image based on the first signal from the wide-angle sensor when the received zoom magnification is smaller than the conversion magnification between the second reference magnification and the first reference magnification, and the received zoom magnification is switched. When the magnification is greater than the magnification, the second image may be output based on the second signal from the telephoto sensor.

In some embodiments, an electronic device may include a first image sensor and a second image sensor. The first image sensor may output a first signal when a first reference condition is satisfied. The second image sensor may output a second signal when a second reference condition different from the first reference condition is satisfied. When both the first reference condition and the second reference condition are satisfied, the first image sensor may output the first signal together with the second image sensor outputting the second signal. When the first reference condition is not satisfied while the first image sensor outputs the first signal, the first image sensor outputs the first signal for a reference time period after the first reference condition is not satisfied, and then outputs the first signal. The first signal may not be output. While the first image sensor does not output the first signal, the second image sensor may output the second signal.

In some embodiments, an electronic device may include a first image sensor and a second image sensor. The first image sensor may operate when a first reference condition is satisfied. The second image sensor may operate when a second reference condition different from the first reference condition is satisfied. When the second reference condition is satisfied while only the first image sensor is operating, the first image sensor may operate while the second image sensor is preparing to operate. After the second image sensor is ready to operate, the first image sensor and the second image sensor may operate together during the contrast time interval.

In some embodiments, an electronic device may include a first image sensor, a second image sensor, and a main processor. The first image sensor may output a first signal when a first reference condition is satisfied. The second image sensor may output a second signal when a second reference condition different from the first reference condition is satisfied, and the first image sensor may output a second signal when both the first reference condition and the second reference condition are satisfied. Along with outputting the first signal, the second signal may be output. The main processor may generate final image data based on the first signal in a first time interval, and may generate final image data based on a second signal in a second time interval following the first time interval. In the first time interval and the second time interval, the first image sensor and the second image sensor may output the first signal and the second signal together.

According to embodiments, switching between signals output from image sensors may be smoothly provided, and accordingly, switching between images output according to operations of the image sensors may be natural and fast. Furthermore, power consumption of image sensors and electronic devices may be reduced. Therefore, the user can feel naturalness without noticing the transition between images, and the user's satisfaction can be improved.

1 is a block diagram showing an exemplary configuration of an electronic device including an electronic circuit constructed and operable according to embodiments.
FIG. 2 is a block diagram showing an exemplary configuration related to the image processing block of FIG. 1 .
FIG. 3 is a conceptual diagram illustrating exemplary operations of the image sensors of FIG. 2 .
FIG. 4 is a conceptual diagram illustrating an exemplary method of inputting zoom magnifications for the image sensors of FIG. 2 through the user interface of FIG. 2 .
FIG. 5 is a timing diagram for explaining exemplary operations of the image sensors of FIG. 2 related to the zoom factor input of FIG. 4 .
FIG. 6 is a flowchart illustrating exemplary operations of the image sensors of FIG. 2 related to inputting a zoom magnification of FIG. 4 .
FIG. 7 is a timing diagram for explaining exemplary operations of the image sensors of FIG. 2 related to the zoom factor input of FIG. 4 .
FIG. 8 is a flowchart illustrating exemplary operations of the image sensors of FIG. 2 related to inputting a zoom magnification of FIG. 4 .
FIG. 9 is a conceptual diagram illustrating an exemplary method of inputting zoom magnifications for the image sensors of FIG. 2 through the user interface of FIG. 2 .
FIG. 10 is a timing diagram for explaining exemplary operations of the image sensors of FIG. 2 related to the zoom magnification input of FIG. 9 .
FIG. 11 is a flowchart illustrating exemplary operations of the image sensors of FIG. 2 related to inputting a zoom magnification of FIG. 9 .
FIG. 12 is a timing diagram for explaining exemplary operations of the image sensors of FIG. 2 related to the zoom magnification input of FIG. 9 .
FIG. 13 is a flowchart illustrating exemplary operations of the image sensors of FIG. 2 related to inputting a zoom magnification of FIG. 9 .
14 is a flowchart illustrating exemplary operations of the image sensors of FIG. 2 .
FIG. 15 is a block diagram showing an exemplary configuration related to the image processing block of FIG. 1 .
FIG. 16 is a timing diagram for explaining exemplary operations of the image sensors of FIG. 15 .

In the following, several embodiments will be described clearly and in detail with reference to the accompanying drawings so that those skilled in the art can easily practice the present disclosure.

1 is a block diagram showing an exemplary configuration of an electronic device 1000 including an electronic circuit constructed and operable according to embodiments.

The electronic device 1000 may include various electronic circuits. For example, the electronic circuits of the electronic device 1000 include an image processing block 1100, a communication block 1200, an audio processing block 1300, a buffer memory 1400, a nonvolatile memory 1500, and a user interface 1600. , a main processor 1800, and a power manager 1900.

The image processing block 1100 may include a lens 1110, an image sensor 1120, and an image signal processor 1130. For example, light may be reflected from an external object intended by the user, and the lens 1110 may receive the reflected light. The image sensor 1120 may generate an electrical signal based on light received through the lens 1110 . The image signal processor 1130 may generate data related to an image of an external object by properly processing an electrical signal generated by the image sensor 1120 .

The image sensor 1120 may generate an electrical signal suitable for representing an external object intended by a user. As an example, the image sensor 1120 may include pixels arranged along rows and columns and capable of converting light into an electrical signal. Characteristics (eg, current intensity, voltage level, etc.) of the electrical signal may vary according to characteristics (eg, intensity) of received light. For example, the image sensor 1120 may be a charge coupled device (CCD) sensor, a complementary metal oxide semiconductor (CMOS) sensor, or the like.

1 shows one lens 1110 and one image sensor 1120 . However, in some embodiments, the image processing block 1100 may include a plurality of lenses and a plurality of image sensors, and FIGS. 2 and 15 show such embodiments. A plurality of image sensors may be provided to have different functions, different performances, and/or different characteristics, and a plurality of lenses may be provided to correspond to the plurality of image sensors, respectively.

The image signal processor 1130 may include hardware circuitry (eg, analog circuitry, logic circuitry, etc.) configured to perform the operations described in this disclosure. Additionally or alternatively, image signal processor 1130 may include one or more processor cores and may execute program code configured to provide the operations described in this disclosure.

1 shows that the image signal processor 1130 is included in the image processing block 1100 . However, in some embodiments, image signal processor 1130 is provided as part of image sensor 1120, provided on a circuit or chip separate from image processing block 1100, and/or main processor 1800. may be provided as part of It will be well understood that the present disclosure may be variously changed or modified without being limited to the illustration of FIG. 1 .

The communication block 1200 may exchange signals with an external device/system through the antenna 1210 . The transceiver 1220 and the modem (modulator/demodulator, 1230) of the communication block 1200 may process exchanged signals according to various communication protocols.

The audio processing block 1300 may process sound information using the audio signal processor 1310 . The audio processing block 1300 may receive audio input through the microphone 1320 or output audio through the speaker 1330 .

The buffer memory 1400 may temporarily store data used for the operation of the electronic device 1000 (eg, data processed or to be processed by the main processor 1800). For example, the buffer memory 1400 may include static random access memory (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), phase-change RAM (PRAM), magneto-resistive RAM (MRAM), and resistive RAM (ReRAM). , FRAM (Ferro-electric RAM), and the like may include volatile/non-volatile memories.

The nonvolatile memory 1500 may store data regardless of power supply. For example, the nonvolatile memory 1500 may include nonvolatile memories such as flash memory, PRAM, MRAM, ReRAM, FRAM, and the like.

The user interface 1600 may mediate communication between a user and the electronic device 1000 . As an example, the user interface 1600 may include an input interface such as a keypad, button, touch screen, touch pad, vision sensor, motion sensor, gyroscope sensor, and the like. For example, the user interface 1600 outputs such as a liquid crystal display (LCD) device, a light emitting diode (LED) display device, an organic LED (OLED) display device, an active matrix OLED (AMOLED) display device, a motor, an LED lamp, and the like. May contain interfaces.

The main processor 1800 may process various operations to control overall operations of the electronic device 1000 . For example, the main processor 1800 may be implemented as a general-purpose processor, a dedicated processor, or an application processor, and may include one or more processor cores.

The power manager 1900 may appropriately convert power received from a battery and/or an external power source. The power manager 1900 may supply the converted power to components of the electronic device 1000 .

However, the exemplary components shown in FIG. 1 are provided to enable a better understanding and are not intended to limit the present disclosure. The electronic device 1000 may not include one or more of the components shown in FIG. 1 or may further include at least one component not shown in FIG. 1 .

FIG. 2 is a block diagram showing an exemplary configuration related to the image processing block 1100 of FIG. 1 . For example, the image processing block 1100 of FIG. 1 may include the image processing block 1100a of FIG. 2 .

The image processing block 1100a may be implemented as a dual sensor structure including two image sensors 1121a and 1122a. The image processing block 1100a may include lenses 1111a and 1112a, image sensors 1121a and 1122a, and an image signal processor 1130. Each of the lenses 1111a and 1112a may correspond to the lens 1110 of FIG. 1 , and each of the image sensors 1121a and 1122a may correspond to the image sensor 1120 of FIG. 1 .

For example, the object 10 may be any object (eg, a person, object, scenery, etc.) intended to be photographed by the user of the electronic device 1000 . In response to a user's request, the image processing block 1100a may generate signals and data related to the image of the object 10 under the control of the main processor 1800 .

Light may be reflected from the object 10 and the reflected light may be received through the lenses 1111a and 1112a. Light collected by the lens 1111a may be provided to a wide angle sensor 1121a, and light collected by the lens 1112a may be provided to a telephoto sensor.

For example, the lens 1111a may receive light at a wider angle than the lens 1112a. The lens 1111a may collect light reflected from a wide area of scenery. On the other hand, the lens 1112a may receive light at a narrower angle than the lens 1111a. However, the lens 1112a may collect light reflected from a distant object.

Accordingly, image sensors 1121a and 1122a may be provided with different functions, different capabilities, and/or different characteristics. For example, the wide-angle sensor 1121a may generate an electrical signal related to a wide area of scenery, and the telephoto sensor 1122a may generate an electrical signal related to a distant object.

Therefore, the image sensors 1121a and 1122a of FIG. 2 may generate electrical signals to flexibly capture an image regardless of the location of the object 10 . As an example, the wide-angle sensor 1121a can generate signal D1 and the telescopic sensor 1122a can generate signal D2. The signals D1 and D2 may be electrical signals related to expressing an image of the object 10 .

In some embodiments, the image processing block 1100a may further include actuators 1141a and 1142a to adjust focal distances of the lenses 1111a and 1112a. The actuator 1141a may move the position of the lens 1111a, and thus the focal length of the lens 1111a may be adjusted. The actuator 1142a may move the position of the lens 1112a, and thus the focal length of the lens 1112a may be adjusted. As an example, the actuators 1141a and 1142a may include a physical device such as a motor.

The image signal processor 1130 may receive signals D1 and D2 generated by the wide-angle sensor 1121a and the telephoto sensor 1122a. The image signal processor 1130 may process the signals D1 and D2. For example, the image signal processor 1130 performs bad pixel correction, demosaic, noise reduction, lens shading correction, gamma correction, and edge enhancement. Various signal processing such as edge enhancement may be performed.

The image signal processor 1130 may perform signal processing on the signals D1 and D2 and output the processed signals D1 and D2 related to the image of the object 10 to the main processor 1800. there is. The main processor 1800 may generate final image data based on signals received from the image signal processor 1130 .

For example, the final image data may be stored in a memory inside the main processor 1800, a buffer memory 1400, and/or a nonvolatile memory 1500. The final image data may represent properties such as shape, color, and motion of the object 10 . The final image data may be used to display an image on an output interface (eg, a display device) of the user interface 1600 . Thus, the output interface can output an image based on signal D1 or an image based on signal D2.

The main processor 1800 may control operations of the image sensors 1121a and 1122a, the image signal processor 1130, and actuators 1141a and 1142a. For example, the main processor 1800 operates the image sensors 1121a and 1122a in response to a user request (eg, button press, screen touch, motion, gesture, etc.) recognized through the user interface 1600 . ), the image signal processor 1130, and operation timings of the actuators 1141a and 1142a may be controlled.

According to the control of the main processor 1800, each of the lenses 1111a and 1112a and the image sensors 1121a and 1122a may or may not be used. For example, when a user intends to capture an image of a landscape of a wide area, final image data may be generated through the lens 1111a and the wide-angle sensor 1121a under the control of the main processor 1800 . On the other hand, when a user intends to capture an image of a distant object, final image data may be generated through the lens 1112a and the telephoto sensor 1122a under the control of the main processor 1800 .

For example, the user may input “zoom-in” or “zoom-out” information to the input interface of the user interface 1600 to capture an image. The zoom-in information may be related to capturing an image of a distant object, and the zoom-out information may be related to capturing an image of a landscape or an object in a wide area.

For example, zoom-in or zoom-out information may include zoom magnification information. The zoom magnification may be a value representing how far away an object is to be photographed or how wide an object is to be photographed. For example, the user may set a zoom condition for capturing an intended image by gradually increasing or decreasing the value of the zoom magnification (eg, stepwise or gradually) or selecting a specific value of the zoom magnification. To this end, the input interface of the user interface 1600 may receive a zoom magnification from the user.

As the zoom magnification is received, the main processor 1800 may provide switching between the operation of the wide-angle sensor 1121a and the operation of the telephoto sensor 1122a. For example, when the zoom factor increases (eg, zoom-in), the telephoto sensor 1122a may operate primarily and a distant object may be captured better. For example, when the zoom magnification decreases (eg, zoom-out), the wide-angle sensor 1121a may mainly operate and an object in a wide area may be captured better. Thus, switching between the operation of the wide-angle sensor 1121a and the operation of the telephoto sensor 1122a may be provided, depending on the user's request.

The light sensor 1121a may output a signal D1 while operating, and may not output a signal D1 while not operating. The telescopic sensor 1122a may output signal D2 while operating, and may not output signal D2 while not operating. Based on the transition between the operation of the wide-angle sensor 1121a and the operation of the telephoto sensor 1122a, a transition between signals D1 and D2 may be provided. Thus, switching between an image based on signal D1 and an image based on signal D2 can also be provided.

On the other hand, when the time required for switching between the operation of the wide-angle sensor 1121a and the operation of the telephoto sensor 1122a becomes longer, switching between the image based on the signal D1 and the image based on the signal D2 this can be slow For example, when the wide-angle sensor 1121a and the telephoto sensor 1122a operate exclusively to reduce power consumed by the wide-angle sensor 1121a and the telephoto sensor 1122a, the switching time may be increased. In this case, image capture may become unnatural and user satisfaction may decrease. However, when the wide-angle sensor 1121a and the telephoto sensor 1122a operate fully together to reduce the switching time, power consumption may increase and user satisfaction may decrease.

Embodiments of the present disclosure may provide an image processing block 1100a and an electronic device 1000 that operate in consideration of both power consumption and user satisfaction. Some embodiments will be further described with reference to FIGS. 3-16 .

The main processor 1800 may execute instruction sets of various program codes. For example, the main processor 1800 may execute command sets such as an application (AP), a camera hardware abstraction layer (HAL), a camera driver (DRV), and an image processing library (LIB). The application (AP) may be executed in response to a user's request, and may be, for example, a camera application, a video production application, and the like.

The camera hardware abstraction layer (HAL) provides hardware abstraction to hide the complex hardware architecture from the user. The camera driver DRV may operate or control hardware components (eg, image sensors 1121a and 1122a and actuators 1141a and 1142a), and an application AP interfaces with the hardware components. can do it can The image processing library LIB may provide various information referred to in performing signal processing on the signals D1 and D2.

As the user inputs the zoom magnification through the input interface of the user interface 1600 , the user interface 1600 may provide information on the zoom magnification MG to the main processor 1800 . The zoom magnification (MG) may be transmitted through a camera hardware abstraction layer (HAL) and a camera driver (DRV). Accordingly, the main processor 1800 may control the sensors 1121a and 1122a and the actuators 1141a and 1142a based on the zoom factor MG.

FIG. 3 is a conceptual diagram illustrating exemplary operations of the image sensors 1121a and 1122a of FIG. 2 . In the descriptions below, “xP” (where P is a real number) may mean a value of a zoom magnification (MG).

The zoom factor MG may have a value between “x1.0” and “xMAX”. “x1.0” may be the minimum zoom magnification allowed in the image processing block 1100a, and “xMAX” may be the maximum zoom magnification allowed in the image processing block 1100a. On the other hand, "xN" may be referred to as a conversion factor, and may be between "x1.0" and "xMAN".

When the zoom magnification MG is smaller than the conversion magnification (eg, between “x1.0” and “xN”), the main processor 1800 determines the final value based on the signal D1 output from the wide-angle sensor 1121a. Image data can be created. Accordingly, the output interface of the user interface 1600 may output an image based on the signal D1.

On the other hand, when the zoom magnification MG is greater than the conversion magnification (eg, between “xN” and “xMAX”), the main processor 1800 determines the final value based on the signal D2 output from the telephoto sensor 1122a. Image data can be created. Thus, the output interface can output an image based on signal D2.

Transitions between signals D1 and D2 and between images may be provided based on a transition magnification. A transition magnification of “xN” can be understood as a transition condition for triggering a transition between signals D1 and D2 and a transition between images. Depending on the transition condition, the main processor 1800 may generate final image data based on one of signals D1 and D2, and the output interface may selectively generate final image data based on signal D1 or D2. Images can be printed.

Meanwhile, in some embodiments, margin sections MM1 and MM2 may be provided from a zoom magnification of “xN”. Accordingly, a magnification section S1 may be provided between a zoom factor of “x1.0” and a zoom factor of “x(N-MM1)”. The magnification section S2 may be provided between a zoom magnification of “x(N-MM1)” and a zoom magnification of “x(N+MM2)” including the margin sections MM1 and MM2. The magnification section S3 may be provided between a zoom factor of “x(N+MM2)” and a zoom factor of “xMAX”. "x(N+MM2)" may be greater than "x(N-MM1)".

For example, only the wide-angle sensor 1121a can operate in the magnification section S1, and only the telephoto sensor 1122a can operate in the magnification section S3. In the magnification period S2, the image sensors 1121a and 1122a may operate together. That is, in the margin sections MM1 and MM2 before and after the conversion magnification of “xN”, both of the image sensors 1121a and 1122a may operate instead of operating only one of the wide-angle sensor 1121a and the telephoto sensor 1122a. there is.

The light-angle sensor 1121a may operate and output a signal D1 when the first reference condition is satisfied. For example, the first reference condition may be satisfied when the zoom magnification MG is smaller than "x(N+MM2)", and the wide-angle sensor 1121a determines that the zoom magnification MG is "x(N+MM2)". "It can work if less than. When the first reference condition is satisfied, the image signal processor 1130 may receive the signal D1.

For example, the wide-angle sensor 1121a may not operate when the zoom magnification MG is greater than “x(N+MM2)”. An operation of the wide-angle sensor 1121a when the zoom factor MG is “x(N+MM2)” may be appropriately designed depending on a designer's intention. A zoom magnification of “x(N+MM2)” may be understood as a reference magnification related to an operation of the wide-angle sensor 1121a.

The telescopic sensor 1122a may operate and output a signal D2 when the second reference condition is satisfied. The second reference condition may be different from the first reference condition. For example, the second reference condition may be satisfied when the zoom magnification MG is greater than "x(N-MM1)", and the telephoto sensor 1122a determines that the zoom magnification MG is "x(N-MM1)". "It can work if greater than . When the second reference condition is satisfied, the image signal processor 1130 may receive the signal D2.

For example, the telephoto sensor 1122a may not operate when the zoom factor MG is smaller than “x(N-MM1)”. An operation of the telephoto sensor 1122a when the zoom magnification MG is "x(N-MM1)" may be appropriately designed depending on a designer's intention. A zoom magnification of “x(N-MM1)” may be understood as a reference magnification related to an operation of the telephoto sensor 1122a.

The main processor 1800 controls the image sensors 1121a and 1122a to operate or not operate, respectively, based on the zoom factor MG received through the user interface 1600. can do. The main processor 1800 may control the operation of the wide-angle sensor 1121a based on the first reference condition. The main processor 1800 may control the operation of the telescopic sensor 1122a based on the second reference condition.

For example, operating the image sensors 1121a and 1122a may mean that the image sensors 1121a and 1122a generate and output signals D1 and D2 while consuming power. For example, the fact that the image sensors 1121a and 1122a do not operate means that the image sensors 1121a and 1122a are turned off without power consumption or in a stand-by state with minimum power consumption. can mean being in As an example, operations of image sensors 1121a and 1122a may be identified in terms of power consumption and/or signal output.

When both the first reference condition and the second reference condition are satisfied (eg, when the zoom magnification MG is between "x(N-MM1)" and "x(N+MM2)", the image sensors 1121a , 1122a) can operate concurrently and output signals D1 and D2. In this case, the image signal processor 1130 may receive both signals D1 and D2. However, the main processor 1800 may generate final image data based on only one of the signals D1 and D2 according to a conversion magnification of “xN”.

The switching condition may be determined while both the first reference condition and the second reference condition are satisfied. As an example, a transition magnification of "xN" may occur while the zoom factor MG is between "x(N-MM1)" and "x(N+MM2)", and the main processor 1800 determines the received zoom factor. Based on the magnification MG, it can be determined whether a switching condition occurs.

The main processor 1800 may determine which of the signals D1 and D2 will be used to generate the final image data based on the received zoom factor MG. Accordingly, the main processor 1800 may provide switching between the signals D1 and D2 according to the switching condition, and may generate final image data selectively based on the signal D1 or the signal D2. .

The magnification section S2 may include magnification sections S21 and S22. In the magnification period S21, the image sensors 1121a and 1122a may operate together. However, as the zoom magnification MG is smaller than the conversion magnification of "xN", the main processor 1800 may generate final image data based only on the signal D1, and the output interface may generate the final image data based on the signal D1. image can be output.

Meanwhile, in the magnification period S22, the image sensors 1121a and 1122a may operate together. However, as the zoom factor MG is greater than the conversion factor of "xN", the main processor 1800 can generate final image data based only on the signal D2, and the output interface is based on the signal D2. image can be output.

For example, when the main processor 1800 determines a switching condition while the main processor 1800 and the output interface operate based on the signal D1 (eg, the zoom factor MG is from a magnification smaller than “xN”). when changing by a factor greater than "xN"), a transition from signal D1 to signal D2 may be provided. Therefore, after conversion, the main processor 1800 can generate final image data based on signal D2, and the output interface can output an image based on signal D2.

On the other hand, when the main processor 1800 determines a switching condition while the main processor 1800 and the output interface operate based on the signal D2 (eg, the zoom magnification MG is “from a magnification greater than “xN” to “ when changing by a factor of less than xN"), a transition from signal D2 to signal D1 can be provided. Therefore, after conversion, the main processor 1800 can generate final image data based on signal D1, and the output interface can output an image based on signal D1. That is, in response to determining the switching condition, switching from one of the signals D1 and D2 to the other of the signals D1 and D2 may be provided.

The margin sections MM1 and MM2 of the magnification section S2 may be provided to quickly convert signals D1 and D2 output from the image sensors 1121a and 1122a. As an example, if the telescopic sensor 1122a operates while outputting the signal D2 in advance while the signal D1 is being used, the transition from the signal D1 to the signal D2 is quickly provided in response to determining the switching condition. It can be. In this case, the transition from the image based on the signal D1 to the image based on the signal D2 can be smooth and natural.

However, power consumption of the electronic device 1000 and the image processing block 1100a may increase when the image sensors 1121a and 1122a operate together throughout the magnification sections S1 , S2 , and S3 . Accordingly, only one of the image sensors 1121a and 1122a may operate in the magnification sections S1 and S3, and power consumption may be reduced. As a result, user satisfaction may be improved.

The operating state of the image sensors 1121a and 1122a may transition between magnification sections S1 , S2 , and S3 according to time. This will be explained with reference to FIGS. 4 to 13 .

Although the first reference condition, the second reference condition, and the switching condition have been described in relation to magnification, these are only some of possible examples and are not intended to limit the present invention. Conditions related to operations of the image sensors may be variously changed or modified depending on functions, performances, and/or characteristics of image sensors included in the electronic device 1000 . However, in order to enable a better understanding, some embodiments will be described based on a first reference condition, a second reference condition, and a conversion condition related to magnification.

FIG. 4 is a conceptual diagram for explaining an exemplary method of inputting a zoom factor MG for the image sensors 1121a and 1122a of FIG. 2 through the user interface 1600 of FIG. 2 .

In some cases, the user 20 may intend to input the zoom factor MG to the user interface 1600 while gradually increasing or decreasing the value of the zoom factor MG. As an example, user 20 may place two fingers on touch screen 1610 of user interface 1600 . Then, the user 20 may take an action of widening or narrowing the distance between the two fingers to gradually adjust the value of the zoom factor MG (pinch zoom-in or pinch zoom-out). .

In another example, the user 20 may use the graphic interface B1 displayed on the display device of the user interface 1600 to adjust the value of the zoom factor MG. The user 20 may gradually adjust the value of the zoom magnification MG by sliding a finger along the slide bar of the graphic interface B1. In another example, the user 20 may press buttons 1620 of the user interface 1600 to gradually increase or decrease the value of the zoom factor MG.

However, the above examples are provided to enable better understanding and are not intended to limit the present invention. It will be well understood that the interface for gradually adjusting the value of the zoom magnification (MG) can be changed or modified in various ways.

FIG. 5 is a timing diagram for explaining exemplary operations of the image sensors 1121a and 1122a of FIG. 2 related to the zoom magnification input of FIG. 4 . FIG. 6 is a flowchart illustrating exemplary operations of the image sensors 1121a and 1122a of FIG. 2 related to inputting a zoom factor of FIG. 4 . 5 and 6 may relate to a case in which the value of the zoom magnification (MG) gradually increases.

In the time interval between times T10 and T11, the zoom magnification MG may be smaller than the reference magnification of “x(N-MM1)”. Only the wide-angle sensor 1121a may operate, and the telephoto sensor 1122a may not operate. The main processor 1800 may generate final image data based on the signal D1, and the output interface may output an image based on the signal D1 (S110 of FIG. 6).

The main processor 1800 may determine whether the zoom factor MG is greater than “x(N-MM1)” (S120 of FIG. 6). When the zoom magnification (MG) satisfies the second reference condition while only the wide-angle sensor 1121a is operating (eg, when it is greater than or equal to “x(N-MM1)”), the main processor 1800 operates the telephoto sensor ( 1122a), a notification (NTF1) may be provided (S125 of FIG. 6).

At time T11, the telescopic sensor 1122a may begin preparing to operate in response to notification NTF1. For example, when the zoom magnification MG changes from a magnification smaller than "x(N-MM1)" to a magnification larger than "x(N-MM1)" while the telephoto sensor 1122a is not operating, the telephoto sensor 1122a ) may operate after preparing to operate during the time interval t1 after the zoom factor MG becomes greater than “x(N-MM1)”. The time interval t1 may be a preparation time interval in which the telescopic sensor 1122a starts to receive power and enters a state required for operation. As wide-angle sensor 1121a operates while telescopic sensor 1122a prepares to operate, main processor 1800 and output interface may use signal D1.

In the time interval between times T11 and T12, the zoom magnification MG may be between a reference magnification of “x(N-MM1)” and a conversion magnification of “xN”. After the telephoto sensor 1122a is ready to operate, the image sensors 1121a and 1122a may operate together in the time interval between times T11+t1 and T12. Before the switching condition is determined, the main processor 1800 may generate final image data based only on the signal D1 without the signal D2, and the output interface may output an image based only on the signal D1. (S130 in FIG. 6).

While the image sensors 1121a and 1122a operate together, the main processor 1800 may determine whether the zoom factor MG is larger than “xN” (S140 of FIG. 6 ). When the zoom factor MG becomes "xN" or more, the main processor 1800 can determine the switching condition, and thus provide switching from signal D1 to signal D2 at time T12 (Fig. 6 S145).

A time interval between times T12 and T13 may follow a time interval between times T11 and T12. In the time interval between times T12 and T13, the zoom magnification (MG) may be between a conversion magnification of “xN” and a reference magnification of “x(N+MM2)”. Image sensors 1121a and 1122a may operate together. In response to the switching condition, the main processor 1800 may generate final image data based only on signal D2 without signal D1, and the output interface may output an image based only on signal D2 ( S150 of FIG. 6).

The main processor 1800 may determine whether the zoom factor MG is larger than “x(N+MM2)” (S160 of FIG. 6). When the zoom magnification MG does not satisfy the first reference condition while the wide-angle sensor 1121a outputs the signal D1 (eg, when it becomes “x (N + MM2)” or more), the main processor ( 1800 may provide a notification NTF2 to the wide-angle sensor 1121a.

In some embodiments, after time T13 has elapsed, the wide-angle sensor 1121a may stop operating immediately in response to notification NTF2. The wide-angle sensor 1121a may not operate after stopping its operation. When the zoom magnification MG changes from a magnification smaller than "xN" to a magnification larger than "xN" while the wide-angle sensor 1121a is operating, the wide-angle sensor 1121a sets the zoom magnification MG to "x(N+MM2"). )" may not work.

Alternatively, in some embodiments, when the zoom magnification MG changes from a magnification smaller than “x(N+MM2)” to a magnification larger than “x(N+MM2)” while the wide-angle sensor 1121a is operating, the wide angle The sensor 1121a may additionally operate during a time interval t2 after the zoom factor MG becomes greater than “x(N+MM2)” (eg, after time T13). Then, after time T13+t2 has elapsed, the wide-angle sensor 1121a may not operate (S165 of FIG. 6). The time interval t2 may be a reference time interval for further operating the wide-angle sensor 1121a in response to the notification NTF2. The main processor 1800 and/or the wide-angle sensor 1121a may use a timer circuit, a counter circuit, and the like to measure the reference time interval t2.

In the time interval between times T13 and T14, the zoom magnification MG may be greater than the reference magnification of “x(N+MM2)”. After time T13 (or T13+t2), only the telephoto sensor 1122a can operate while the wide-angle sensor 1121a does not operate. The main processor 1800 may generate final image data based on the signal D2, and the output interface may output an image based on the signal D2 (S170 of FIG. 6).

As the second reference condition is satisfied before the first reference condition is not satisfied, the image sensors 1121a and 1122a may output signals D1 and D2 together. As the telescopic sensor 1122a outputs signal D2 in advance while operating in the time interval between time T11+t1 and T12, switching from signal D1 to signal D2 in response to a conversion magnification of “xN” occurs. can be delivered quickly. The telescopic sensor 1122a may start operating before the transition to signal D2 is actually provided, and the transition time may be shortened.

In some embodiments, when the reference time period t2 is provided, even if the user suddenly decreases the value of the zoom magnification MG, a sufficient reaction time for switching back to the signal D1 may be provided. Thus, switching between the signals D1 and D2 can be stably provided. The length of the reference time interval t2 may be variously selected (for example, 1 second or 30 frames) to be suitable for stable switching, and may be fixed or variable.

The time interval between times T11+t1 and T13 (or T13+t2) is a provision time interval in which image sensors 1121a and 1122a operate together to provide fast switching between signals D1 and D2. can be For example, the contrast time interval between times T11+t1 and T13+t2 may include a reference time interval t2.

FIG. 7 is a timing diagram for explaining exemplary operations of the image sensors 1121a and 1122a of FIG. 2 related to the zoom factor input of FIG. 4 . FIG. 8 is a flowchart illustrating exemplary operations of the image sensors 1121a and 1122a of FIG. 2 related to inputting a zoom magnification of FIG. 4 . 7 and 8 may relate to a case in which the value of the zoom magnification (MG) gradually decreases, which may be understood as the opposite of the examples of FIGS. 5 and 6 .

In the time interval between times T20 and T21, the zoom magnification MG may be greater than the reference magnification of “x(N+MM2)”, and only the telephoto sensor 1122a may operate. The main processor 1800 may generate final image data based on the signal D2, and the output interface may output an image based on the signal D2 (S210 of FIG. 8).

The main processor 1800 may determine whether the zoom factor MG is smaller than “x(N+MM2)” (S220 of FIG. 8). When the zoom magnification MG satisfies the first reference condition while only the telephoto sensor 1122a is operating (for example, when it is less than or equal to “x(N+MM2)”), the main processor 1800 operates the wide-angle sensor ( 1121a), a notification (NTF3) may be provided (S225 of FIG. 8).

At time T21, the wide-angle sensor 1121a may start preparing to operate in response to the notification NTF3. For example, when the zoom magnification MG changes from a magnification larger than “x(N+MM2)” to a magnification smaller than “x(N+MM2)” while the wide-angle sensor 1121a is not operating, the wide-angle sensor 1121a ) may operate after preparing to operate during the time interval t3 after the zoom factor MG becomes smaller than “x(N+MM2)”. The time interval t3 may be a preparation time interval in which the light sensor 1121a starts to receive power and enters a state required for operation. While the wide angle sensor 1121a is preparing to operate, the main processor 1800 and the output interface may use the signal D2 output from the telescopic sensor 1122a.

In the time interval between times T21 and T22, the zoom magnification MG may be between a reference magnification of “x(N+MM2)” and a conversion magnification of “xN”. After the wide-angle sensor 1121a is ready to operate, the image sensors 1121a and 1122a may operate together in the time interval between times T21+t3 and T22. Before the switching condition is determined, the main processor 1800 may generate final image data based only on the signal D2 without the signal D1, and the output interface may output an image based only on the signal D2. (S230 in FIG. 8).

While the image sensors 1121a and 1122a operate together, the main processor 1800 may determine whether the zoom factor MG is smaller than “xN” (S240 of FIG. 8 ). When the zoom factor MG becomes "xN" or less, the main processor 1800 may determine a switching condition, and thus provide switching from signal D2 to signal D1 at time T22 (Fig. 8, S245).

After the time interval between times T21 and T22 and between times T22 and T23, the zoom magnification (MG) may be between the conversion magnification of “xN” and the reference magnification of “x(N-MM1)”. Image sensors 1121a and 1122a may operate together. In response to the switch condition, the main processor 1800 may generate final image data based only on signal D1 without signal D2, and the output interface may output an image based only on signal D1 ( S250 of FIG. 8).

The main processor 1800 may determine whether the zoom factor MG is smaller than “x(N-MM1)” (S260 of FIG. 8). When the zoom magnification MG does not satisfy the second reference condition while the telephoto sensor 1122a outputs the signal D2 (eg, when it becomes less than or equal to “x(N-MM1)”), the main processor ( 1800 may provide a notification NTF4 to the telescopic sensor 1122a.

In some embodiments, after time T23 has elapsed, telescopic sensor 1122a may not immediately operate in response to notification NTF4. When the zoom factor MG changes from a magnification greater than “xN” to a magnification smaller than “xN” while the telephoto sensor 1122a is operating, the telephoto sensor 1122a determines that the zoom factor MG is “x(N-MM1”). )" may not work.

Alternatively, in some embodiments, when the zoom magnification MG is changed from a magnification greater than “x(N-MM1)” to a magnification smaller than “x(N-MM1)” while the telephoto sensor 1122a is operating, telephoto The sensor 1122a may additionally operate during a time interval t4 after the zoom factor MG becomes smaller than “x(N-MM1)” (eg, after time T23). Then, after time T23+t4 has elapsed, the telescopic sensor 1122a may not operate (S265 in FIG. 8). The time interval t4 may be a reference time interval for further operating the telescopic sensor 1122a in response to the notification NTF4. The main processor 1800 and/or the telescopic sensor 1122a may use a timer circuit or a counter circuit to measure the reference time interval t4.

In the time interval between times T23 and T24, the zoom magnification MG may be smaller than the reference magnification of “x(N-MM1)”. After time T23 (or T23+t4), only the wide-angle sensor 1121a can operate. The main processor 1800 may generate final image data based on the signal D1, and the output interface may output an image based on the signal D1 (S270 of FIG. 8).

As the first reference condition is satisfied before the second reference condition is not satisfied, the image sensors 1121a and 1122a may output signals D1 and D2 together. As the wide-angle sensor 1121a outputs the signal D1 in advance while operating in the time interval between times T21+t3 and T22 before the transition to the signal D1 is actually provided, the signal in response to the transition magnification of "xN" The transition from (D2) to signal (D1) can be provided quickly.

In some embodiments, when the reference time period t4 is provided, even if the user suddenly increases the value of the zoom magnification MG, a sufficient reaction time for switching back to the signal D2 may be provided. The length of the reference time interval t4 may be variously selected to be suitable for stable switching, and may be fixed or variable.

The time interval between times T21+t3 and T23 (or T23+t4) may be a contrast time interval in which image sensors 1121a and 1122a operate together to provide fast switching between signals D1 and D2. . For example, the contrast time interval between times T21+t3 and T23+t4 may include a reference time interval t4.

FIG. 9 is a conceptual diagram for explaining an exemplary method of inputting a zoom factor MG for the image sensors 1121a and 1122a of FIG. 2 through the user interface 1600 of FIG. 2 .

In some cases, the user 20 may intend to directly input a specific value of the zoom factor MG into the user interface 1600 . In this case, instead of gradually increasing or decreasing, the zoom magnification MG may be discontinuously changed to a specific value input (zoom jump).

For example, the user 20 may use the graphic interface B1 to input a specific value of the zoom factor MG. As the user 20 touches a specific position of the slide bar of the graphic interface B1, the value of the zoom magnification MG may jump to a specific value corresponding to the touched specific position.

In another example, the user 20 may use the graphic interface B2 displayed on the display device of the user interface 1600 to change the value of the zoom factor MG. The user 20 may directly input a specific value of the zoom factor MG through the touch screen 1610 or a key/touch pad, and the graphic interface B2 may display the input value.

However, the above examples are provided to enable better understanding and are not intended to limit the present invention. It will be well understood that the interface for directly inputting a specific value of the zoom magnification (MG) can be changed or modified in various ways.

FIG. 10 is a timing diagram for explaining exemplary operations of the image sensors 1121a and 1122a of FIG. 2 related to the zoom magnification input of FIG. 9 . FIG. 11 is a flowchart illustrating exemplary operations of the image sensors 1121a and 1122a of FIG. 2 related to inputting a zoom magnification of FIG. 9 . 10 and 11 may relate to cases in which a specific value of the zoom factor MG is directly input so that the zoom factor MG increases.

In the time interval between times T30 and T31, the zoom magnification MG may be smaller than the reference magnification of “x(N-MM1)”. Only the wide-angle sensor 1121a may operate, and the telephoto sensor 1122a may not operate. The main processor 1800 may generate final image data based on the signal D1, and the output interface may output an image based on the signal D1 (S310 of FIG. 11).

For example, as the user inputs a specific value of the zoom magnification MG, at time T31, the main processor 1800 operates only the wide-angle sensor 1121a while the zoom magnification MG does not satisfy the first reference condition. It is possible to determine whether or not (eg, greater than “x (N + MM2)”) and whether or not the second criterion is satisfied (eg, greater than “x (N-MM1)”) (Fig. 11 S320). In this case, the main processor 1800 may provide a notification NTF5 to the telephoto sensor 1122a (S325 of FIG. 11) and a notification NTF6 to the wide-angle sensor 1121a.

At time T31, the telescopic sensor 1122a may begin preparing to operate in response to notification NTF5. For example, when the zoom magnification MG changes from a magnification smaller than "x(N-MM1)" to a magnification larger than "x(N-MM1)" while the telephoto sensor 1122a is not operating, the telephoto sensor 1122a ) may operate after preparing to operate during the time interval t5 after the zoom factor MG becomes greater than “x(N-MM1)”. The time interval t5 may be a preparation time interval in which the telescopic sensor 1122a starts to receive power and enters a state required for operation.

Although the first reference condition is not satisfied, while the telephoto sensor 1122a is preparing to operate, the wide-angle sensor 1121a may further operate during the time interval t6 after receiving the notification NTF6 (Fig. 11 S330). When the zoom magnification MG changes from a magnification smaller than “x(N+MM2)” to a magnification larger than “x(N+MM2)” while the wide-angle sensor 1121a is operating, the wide-angle sensor 1121a adjusts the zoom magnification After (MG) becomes greater than “x(N+MM2)” (eg, after time T31), an additional operation may be performed during the time interval t6. Then, after the time period t6 has elapsed, the wide-angle sensor 1121a may not operate.

Switching from signal D1 to signal D2 may not be provided while the telescopic sensor 1122a is not ready to operate in time interval t6. Thus, the main processor 1800 and output interface may use signal D1. As the first reference condition is not satisfied and the second reference condition is satisfied, while the wide-angle sensor 1121a outputs the signal D1 during the time interval t6, the telephoto sensor 1122a prepares to operate. After completion, signal D2 can be output.

The time interval t6 is a reference time interval during which the wide-angle sensor 1121a outputs the signal D1 while the telephoto sensor 1122a is not ready to operate (and thus does not output the signal D2 yet). can include The main processor 1800 and/or the light sensor 1121a may use a timer circuit, a counter circuit, and the like to measure the time interval t6.

As the user inputs a specific value of the zoom magnification MG, the main processor 1800 determines that a switching condition has occurred (eg, the zoom magnification MG has changed from a magnification smaller than “xN” to a magnification larger than “xN”). that) can be identified. Accordingly, at time T31+t5, when the telescopic sensor 1122a is ready to operate and then starts outputting the signal D2, the main processor 1800 provides a transition from the signal D1 to the signal D2. It can be (S345 in FIG. 11). When the zoom magnification (MG) jumps to a specific value, the change in the image output from the output interface may be quite large, and therefore, it is highly likely that the user does not feel unnatural.

In some embodiments, the reference time period t6 may be selected so that the light sensor 1121a immediately stops operating after time T31+t5 has elapsed. The wide-angle sensor 1121a may not operate after stopping its operation. When the zoom magnification MG changes from a magnification smaller than "xN" to a magnification larger than "xN" while the wide-angle sensor 1121a is operating, the wide-angle sensor 1121a sets the zoom magnification MG to "x(N+MM2"). )" may not work.

Alternatively, in some embodiments, the reference time interval t6 may be selected so that the wide-angle sensor 1121a additionally operates during the margin time interval t11 after time T31+t5 has elapsed. During the margin time period t11 after the telephoto sensor 1122a is ready to operate, the image sensors 1121a and 1122a may operate together.

However, in response to the switching condition, the main processor 1800 may generate final image data based only on signal D2 without signal D1, and the output interface may output an image based only on signal D2. Yes (S365 in FIG. 11). The wide-angle sensor 1121a may not operate after the margin time period t11 has elapsed.

The margin time interval t11 may be a contrast time interval in which the image sensors 1121a and 1122a operate together even after the transition to the signal D2 is provided. For example, the reference time interval t6 may include the contrast time interval t11. When the contrast time period t11 is provided, even if the user suddenly decreases the value of the zoom magnification MG, sufficient reaction time for switching back to the signal D1 can be provided. Thus, switching between the signals D1 and D2 can be stably provided. The length of the contrast time interval t11 may be variously selected to be suitable for stable switching, and may be fixed or variable.

In the time interval between times T31 and T32, the zoom magnification MG may be greater than the reference magnification of “x(N+MM2)”. After time T31+t5 (or T31+t6), only the telephoto sensor 1122a can operate while the wide-angle sensor 1121a does not operate. The main processor 1800 may generate final image data based on the signal D2, and the output interface may output an image based on the signal D2 (S370 of FIG. 11).

FIG. 12 is a timing diagram for explaining exemplary operations of the image sensors 1121a and 1122a of FIG. 2 related to the zoom magnification input of FIG. 9 . FIG. 13 is a flowchart illustrating exemplary operations of the image sensors 1121a and 1122a of FIG. 2 related to inputting a zoom magnification of FIG. 9 . 12 and 13 may relate to a case where a specific value of the zoom factor MG is directly input so that the zoom factor MG decreases, which can be understood as the opposite of the examples of FIGS. 10 and 11 .

In the time interval between times T40 and T41, the zoom magnification MG may be greater than the reference magnification of “x(N+MM2)”, and only the telephoto sensor 1122a may operate. The main processor 1800 may generate final image data based on the signal D2, and the output interface may output an image based on the signal D2 (S410 of FIG. 13).

For example, at time T41, the user may input a specific value of the zoom magnification (MG). The main processor 1800 determines that the zoom magnification MG does not satisfy the second reference condition while only the telephoto sensor 1122a is operating (eg, smaller than “x(N-MM1)”) and the first It may be determined that the standard condition is met (eg, that it is smaller than “x(N+MM2)”) (S420 of FIG. 13). In this case, the main processor 1800 may provide a notification NTF7 to the wide-angle sensor 1121a (S425 of FIG. 13) and a notification NTF8 to the telephoto sensor 1122a.

At time T41, when the zoom magnification MG changes from a magnification larger than "x(N+MM2)" to a magnification smaller than "x(N+MM2)" while the wide-angle sensor 1121a is not operating, the wide-angle sensor ( 1121a) may operate after preparing to operate during the time interval t7 in response to the notification NTF7 after the zoom factor MG becomes smaller than “x(N+MM2)”. The time interval t7 may be a preparation time interval in which the light sensor 1121a starts to receive power and enters a state required for operation.

Although the second reference condition is not satisfied, while the wide-angle sensor 1121a prepares to operate, the telephoto sensor 1122a may further operate during the time interval t8 after receiving the notification NTF8 (Fig. 13 S430). When the zoom magnification MG changes from a magnification greater than “x(N-MM1)” to a magnification smaller than “x(N-MM1)” while the telephoto sensor 1122a is operating, the telephoto sensor 1122a adjusts the zoom magnification After (MG) becomes smaller than "x(N-MM1)" (eg, after time T41), an additional operation may be performed during the time interval t8. Then, after the time period t8 has elapsed, the telescopic sensor 1122a may not operate.

Switching from signal D2 to signal D1 may not be provided while the light sensor 1121a is not ready to operate in time interval t8. Accordingly, the main processor 1800 and output interface may use signal D2. As the first reference condition is satisfied together with the second reference condition not being met, the wide-angle sensor 1121a prepares to operate while the telephoto sensor 1122a outputs the signal D2 during the time interval t8. After completion, signal D1 can be output.

The time period t8 is a reference time period during which the telephoto sensor 1122a outputs the signal D2 while the wide angle sensor 1121a is not ready to operate (and therefore does not output the signal D1 yet). can include The main processor 1800 and/or the telescopic sensor 1122a may use a timer circuit or a counter circuit to measure the time interval t8.

The main processor 1800 may determine that a switching condition has occurred. Accordingly, at time T41+t7 when the light sensor 1121a is ready to operate and then starts outputting the signal D1, the main processor 1800 provides a transition from the signal D2 to the signal D1. It can (S445 in FIG. 13).

In some embodiments, the reference time interval t8 may be selected so that the telescopic sensor 1122a immediately stops operating after time T41+t7 has elapsed. The telescopic sensor 1122a may not operate after stopping its operation. When the zoom factor MG changes from a magnification greater than “xN” to a magnification smaller than “xN” while the telephoto sensor 1122a is operating, the telephoto sensor 1122a determines that the zoom factor MG is “x(N-MM1”). )" may not work.

Alternatively, in some embodiments, the reference time interval t8 may be selected so that the telescopic sensor 1122a additionally operates during the margin time interval t12 after time T41+t7 has elapsed. During the margin time period t12 after the wide-angle sensor 1121a is ready to operate, the image sensors 1121a and 1122a may operate together.

However, in response to the switching condition, the main processor 1800 may generate final image data based only on signal D1 without signal D2, and the output interface may output an image based only on signal D1. Yes (S465 in FIG. 13). The telescopic sensor 1122a may not operate after the margin time period t12 has elapsed.

The margin time interval t12 may be a contrast time interval in which the image sensors 1121a and 1122a operate together even after the transition to the signal D1 is provided. For example, the reference time interval t8 may include the contrast time interval t12. When the contrast time period t12 is provided, even if the user suddenly increases the value of the zoom magnification MG, a sufficient reaction time for switching back to the signal D2 can be provided. The length of the contrast time interval t12 may be variously selected to be suitable for stable switching, and may be fixed or variable.

In the time interval between times T41 and T42, the zoom magnification MG may be smaller than the reference magnification of “x(N-MM1)”. After time T41+t7 (or T41+t8), only the wide-angle sensor 1121a can operate while the telephoto sensor 1122a does not operate. The main processor 1800 may generate final image data based on the signal D1, and the output interface may output an image based on the signal D1 (S470 of FIG. 13).

The information of the magnifications of "xN", "x(N-MM1)", and "x(N+MM2)" described above and the information of the reference time intervals t2, t4, t6, and t8 are the main processor 1800 ) internal memory, buffer memory 1400, and/or non-volatile memory 1500, or may be stored in other types of memory (e.g., registers), and additionally or alternatively, the main processor 1800 ) can be inserted into the program code executed by

FIG. 14 is a flowchart illustrating exemplary operations of image sensors 1121a and 1122a of FIG. 2 .

In some embodiments, the initial value of the zoom magnification (MG) may be selected as a minimum magnification of “x1.0”. For example, when image capture starts (eg, when the application AP is executed), only the wide-angle sensor 1121a may operate and the signal D1 may be used (S510). When the zoom magnification (MG) is between “x1.0” and “x(N-MM1)” (Yes in S512), only the wide-angle sensor 1121a can operate (S510).

Otherwise (No in S512), a notification may be generated under the control of the main processor 1800 to prepare for the operation of the telescopic sensor 1122a (S516). When the zoom factor MG is between “x(N-MM1)” and “xN” (Yes in S532), the image sensors 1121a and 1122a can operate together, but only the signal D1 can be used. Yes (S530).

Otherwise (No in S532), it may be determined whether the zoom factor MG is smaller than "x(N-MM1)" or larger than "xN" (S534). When the zoom factor MG becomes smaller than “x(N-MM1)”, a notification may be generated according to the control of the main processor 1800 to stop the operation of the telescopic sensor 1122a (S536). In some embodiments, the telescopic sensor 1122a may not operate after additionally operating for a reference time period in response to the notification (S538).

When the zoom factor MG is greater than “xN” and is between “xN” and “x(N+MM2)” (Yes in S552), the image sensors 1121a and 1122a can operate together, and signal D1 ) to the signal D2, only the signal D2 can be used (S550). Otherwise (No in S552), it may be determined whether the zoom magnification (MG) is smaller than "xN" or larger than "x(N+MM2)" (S554). When the zoom factor MG is smaller than “xN”, it may be determined whether the zoom factor MG is between “x(N-MM1)” and “xN” (S532).

When the zoom factor MG becomes greater than “x(N+MM2)”, a notification may be generated according to the control of the main processor 1800 to stop the operation of the wide-angle sensor 1121a (S556). In some embodiments, the wide-angle sensor 1121a may additionally operate for a reference time interval in response to the notification and then not operate (S558).

After that, only the telescopic sensor 1122a can operate, and the signal D2 can be used (S570). If the zoom magnification (MG) is between “x(N+MM2)” and “xMAX” (Yes in S572), only the telephoto sensor 1122a can operate (S570). Otherwise (No in S572), wide angle In order to prepare for the operation of the sensor 1121a, a notification may be generated under the control of the main processor 1800 (S576) Then, the zoom magnification (MG) is “xN” and “x(N+MM2)” It may be determined whether it is between (S552).

In the above descriptions, it has been described that the two image sensors 1121a and 1122a are a wide-angle sensor 1121a and a telephoto sensor 1122a. However, the types of the two image sensors may be variously changed or modified without being limited to the above description. In other embodiments, the two image sensors may be image sensors of a stereo camera for capturing a left image and a right image, or an image sensor for a rear camera and an image sensor for a front camera. In these embodiments, when switching between signals output from image sensors is required, natural switching may be provided as the image sensors operate together before a switching condition occurs.

FIG. 15 is a block diagram showing an exemplary configuration related to the image processing block 1100 of FIG. 1 . For example, the image processing block 1100 of FIG. 1 may include the image processing block 1100b of FIG. 15 .

The image processing block 1100b may be implemented as a multi-sensor structure including three or more image sensors 1121b, 1122b, and 1129b. The image processing block 1100b may include lenses 1111b, 1112b, and 1119b, image sensors 1121b, 1122b, and 1129b, and actuators 1141b, 1142b, and 1149b. As an example, the image sensors 1121b, 1122b, and 1129b may be used to configure an array camera, multiple cameras, and the like.

The lenses 1111b, 1112b, and 1119b may correspond to the lenses 1111a and 1112a of FIG. 2 . The image sensors 1121b, 1122b, and 1129b may correspond to the image sensors 1121a and 1122a of FIG. 2 and output signals D11, D12, and D13 related to the image of the object 10. .

The image signal processor 1130 may perform signal processing on the signals D11, D12, and D13. The main processor 1800 may control the image sensors 1121b, 1122b, and 1129b and the actuators 1141b, 1142b, and 1149b.

As shown in FIG. 15 , embodiments may be employed regardless of the number of image sensors. As an example, if switching between signals D11, D12 and D13 with respect to three image sensors 1121b, 1122b and 1129b is desired, image sensors 1121b, 1122b and 1129b before the switching condition occurs. As these work together, a natural transition can be provided.

FIG. 16 is a timing diagram for explaining exemplary operations of the image sensors 1121b, 1122b, and 1129b of FIG. 15 .

In the time interval between times T50 and T51, only the image sensor 1121b can operate, and signal D11 can be used. At time T51, when the reference condition for operating the image sensor 1122b is met, the image sensor 1122b may prepare for operation during the preparation time period t21 in response to the notification NTF11 and then operate. there is.

At time T52, when the switching condition is determined, switching from signal D11 to signal D12 can be provided, and signal D12 can be used. As the image sensor 1122b outputs the signal D12 in advance before the switching condition occurs, switching from the signal D11 to the signal D12 can be provided quickly and naturally.

At time T53, a reference condition for stopping the operation of the image sensor 1121b may be satisfied. In some embodiments, the image sensor 1121b may additionally operate for the reference time interval t22 in response to the notification NTF12 and then not operate. When the reference time period t22 is provided, switching back to the signal D11 can be quickly provided.

At time T54, when the reference condition for operating the image sensor 1129b is satisfied, the image sensor 1129b may prepare for operation during the preparation time period t23 in response to the notification NTF13 and then operate. there is.

At time T55, when the switching condition is determined, switching from signal D12 to signal D13 can be provided. Thus, in the time interval between times T55 and T57, signal D13 is available. As the image sensor 1129b outputs the signal D13 in advance before the switching condition occurs, switching from the signal D12 to the signal D13 can be provided quickly and naturally.

At time T56, a reference condition for stopping the operation of the image sensor 1122b may be satisfied. In some embodiments, the image sensor 1122b may additionally operate for the reference time interval t24 in response to the notification NTF14 and then not operate. When the reference time interval t24 is provided, switching back to the signal D12 can be quickly provided.

The above descriptions are intended to provide example configurations and acts for implementing the present disclosure. The present disclosure will include not only the embodiments described above, but also implementations that can be obtained by simply changing or modifying the above embodiments. In addition, the present disclosure will also include implementations that can be achieved by easily changing or modifying the above-described embodiments in the future.

1000: electronic device

Claims (20)

an input interface configured to receive a zoom factor;
a wide angle sensor configured to operate when the received zoom magnification is smaller than a first reference magnification;
It operates when the received zoom magnification is greater than a second reference magnification smaller than the first reference magnification, and operates together with the wide-angle sensor when the received zoom magnification is between the second reference magnification and the first reference magnification. A telescopic sensor configured to; and
When the received zoom magnification is smaller than a conversion magnification between the second reference magnification and the first reference magnification, a first image is output based on a first signal from the wide-angle sensor, and the received zoom magnification is the conversion magnification. and an output interface configured to output a second image based on a second signal from the telephoto sensor when the magnification is greater than the magnification. According to claim 1,
When the received zoom magnification is between the second reference magnification and the conversion magnification while the wide-angle sensor and the telephoto sensor operate together, the output interface outputs the first zoom magnification based only on the first signal without the second signal. An electronic device further configured to output an image. According to claim 1,
When the received zoom magnification changes from a magnification smaller than the conversion magnification to a magnification greater than the conversion magnification while the wide-angle sensor operates, the wide-angle sensor does not operate after the received zoom magnification becomes greater than the first reference magnification. Electronic devices that are further configured to avoid. According to claim 1,
When the received zoom magnification changes from a magnification smaller than the first reference magnification to a magnification larger than the first reference magnification while the wide-angle sensor operates, the wide-angle sensor determines that the received zoom magnification is greater than the first reference magnification. An electronic device that is further configured not to operate after operating for a reference time interval after being enlarged. According to claim 1,
The wide-angle sensor is further configured not to operate when the received zoom magnification is greater than the first reference magnification,
When the received zoom magnification changes from a magnification greater than the first reference magnification to a magnification smaller than the first reference magnification while the wide angle sensor is not operating, the wide angle sensor determines that the received zoom magnification is the first reference magnification. An electronic device further configured to operate after being smaller and ready to operate during the preparation time interval. According to claim 5,
and the output interface is further configured to output the second image based only on the second signal without the first signal as the telephoto sensor operates while the wide-angle sensor prepares to operate. According to claim 5,
and after the wide-angle sensor is ready to operate, the wide-angle sensor and the telephoto sensor are further configured to operate together during a contrast time period. a first image sensor configured to output a first signal when a first reference condition is satisfied; and
A second image sensor configured to output a second signal when a second reference condition different from the first reference condition is satisfied;
When both the first reference condition and the second reference condition are satisfied, the first image sensor is further configured to output the first signal together with the second image sensor outputting the second signal,
When the first reference condition is not satisfied while the first image sensor outputs the first signal, the first image sensor outputs the first signal during a reference time interval after the first reference condition is not satisfied. further configured not to output the first signal after outputting a signal;
and wherein the second image sensor outputs the second signal while the first image sensor does not output the first signal. According to claim 8,
When the first reference condition is satisfied, the output first signal is received, and when the second reference condition is satisfied, the output second signal is received, and both the first reference condition and the second reference condition are received. The electronic device further includes an image signal processor configured to receive both the output first signal and the output second signal when is satisfied. According to claim 8,
as the second reference condition is satisfied before the first reference condition is not satisfied, the first image sensor and the second image sensor are further configured to output the first signal and the second signal together;
In order to generate final image data based on only one of the output first signal and the output second signal according to a switching condition determined while both the first reference condition and the second reference condition are satisfied, the The electronic device further comprising a main processor configured to provide a transition between the outputted first signal and the outputted second signal. According to claim 8,
When the first reference condition is not satisfied and the second reference condition is satisfied, the second image sensor prepares to operate while the first image sensor outputs the first signal during the reference time period. further configured to output the second signal after completion;
As the second image sensor outputs the second signal in the reference time interval, the output second signal is used from the output first signal to generate final image data based on the output second signal. An electronic device further comprising a main processor configured to provide a transition to a first image sensor configured to operate when a first reference condition is satisfied; and
A second image sensor configured to operate when a second reference condition different from the first reference condition is satisfied;
When the second reference condition is satisfied while only the first image sensor is operating, the first image sensor is further configured to operate while the second image sensor is preparing to operate,
After the second image sensor is ready to operate, the first image sensor and the second image sensor are further configured to operate together during a contrast time interval;
the first image sensor is further configured to output a first signal during operation;
the second image sensor is further configured to output a second signal during operation;
Switching from the first signal to the second signal is provided according to a switching condition determined while the first image sensor and the second image sensor operate together and output the first signal and the second signal. electronic device. According to claim 12,
If the first reference condition is not satisfied in the contrast time interval, the first image sensor is further configured not to operate after the contrast time interval has elapsed. delete According to claim 12,
Further comprising an output interface configured to output a final image selectively based on the outputted first signal or the outputted second signal,
When the switching condition is determined while the output interface outputs the final image based on one of the output first signal and the output second signal, the output interface outputs the output first signal and the output second signal. The electronic device further configured to output the final image based on the other one of the second signals. According to claim 12,
If the first reference condition is not satisfied after the transition from the first signal to the second signal is provided, the first image sensor determines a first reference time interval after the first reference condition is not satisfied. It is further configured so that it operates during and then does not operate,
The contrast time interval includes the first reference time interval. According to claim 12,
When the second criterion condition is satisfied, the first criterion is not satisfied,
The first image sensor is further configured to operate for a second reference time interval after the first criterion is not satisfied and then not operate;
The second reference time interval includes the contrast time interval. 18. The method of claim 17,
the first image sensor is further configured to output a first signal during operation;
the second image sensor is further configured to output a second signal during operation;
Switching from the first signal to the second signal is not provided while the second image sensor is not ready to operate in the second reference time period. According to claim 18,
The transition from the first signal to the second signal is provided after the second image sensor is ready to operate in the second reference time interval;
and after the transition from the first signal to the second signal is provided, the first image sensor and the second image sensor are further configured to operate together during the contrast time period. a first image sensor configured to output a first signal when a first reference condition is satisfied;
A second signal is output when a second reference condition different from the first reference condition is satisfied, and the first image sensor outputs the first signal when both the first reference condition and the second reference condition are satisfied. a second image sensor configured to output the second signal together with outputting; and
Generating final image data based on the output first signal in a first time interval and generating the final image data based on the output second signal in a second time interval following the first time interval Including the main processor to be,
In the first time interval and the second time interval, the first image sensor and the second image sensor output the first signal and the second signal together;
The main processor outputs the final image data selectively based on the output first signal or the output second signal according to a switching condition determined while both the first reference condition and the second reference condition are satisfied. Electronic device further configured to generate.

Images