KR20160099435A - Method for controlling camera system, electronic apparatus and storage medium - Google Patents

Abstract

According to various embodiments, an operation method of an electronic apparatus comprises: an operation for initializing a camera system; an operation for operating the camera system in a sleep mode if initialization is completed; an operation for allowing the camera system to switch the sleep mode into a normal mode; and an operation for displaying an image outputted from the camera system on a display of the electronic device.

Description

≪ Desc / Clms Page number 1 > METHOD FOR CONTROLLING CAMERA SYSTEM, ELECTRONIC APPARATUS AND STORAGE MEDIUM,

Various embodiments relate to an electronic device and method for controlling a camera system.

Conventional electronic devices include a camera module, which can image-process an image photographed through a camera module, compress the processed image to generate an image file, and store the generated image file in a memory.

The electronic device is provided with a camera module so that the user can enter the camera at a necessary time and take a picture.

The conventional electronic device initializes the camera module at a time point when the user wants to use the camera module due to the problem of the consumed current or the like. Therefore, it takes a long time to enter the camera module, and the user may miss the desired scene.

According to various embodiments, a method of operating an electronic device comprises: performing an initialization of a camera system of the electronic device; Operating the camera system in a sleep mode when the initialization is completed; Switching the camera system from the sleep mode to a normal mode; And displaying an image output from the camera system in the normal mode on a display of the electronic device.

According to various embodiments, an electronic device includes a camera system configured to photograph a subject; A display configured to display a screen; And to initialize the camera system, wherein when the initialization is completed, the camera system is configured to operate in a sleep mode and is configured to switch the camera system from the sleep mode to a normal mode, And a processor configured to display an image output from the camera system on the display.

In various embodiments, the initialization of the camera system is performed prior to the user's camera entry command, and the various settings and sequences of initialization are simplified to allow the user to quickly use the camera system.

1 illustrates a network environment including an electronic device according to various embodiments.
Figure 2 illustrates a camera system in accordance with various embodiments.
3 is a block diagram of a program module according to various embodiments.
4 shows a block diagram of a camera control module of an electronic device according to various embodiments.
5 is a flow diagram illustrating a method of operation of an electronic device according to various embodiments.
6A to 6H are views for explaining a method of operating an electronic device according to various embodiments.
7 is a flow chart illustrating a method of operation of an electronic device according to various embodiments.
8 is a diagram for explaining a method of operating an electronic device according to various embodiments.
9 is a flow chart illustrating a method of operating an electronic device according to various embodiments.
10 is a diagram for explaining a method of operating an electronic device according to various embodiments.
11 is a flow chart illustrating a method of operating an electronic device according to various embodiments.
12 is a diagram for explaining a method of operating an electronic device according to various embodiments.
13 is a flow chart illustrating a method of operation of an electronic device according to various embodiments.
14 and 15 are diagrams for explaining a method of operating an electronic device according to various embodiments.
16 is a flowchart showing an operation method of an electronic device according to various embodiments.
17 is a flow chart illustrating a method of operating an electronic device according to various embodiments.
18 is a flow chart illustrating a method of operation of an electronic device according to various embodiments.
19 is a flow chart illustrating a method of operating an electronic device according to various embodiments.
20 illustrates a camera system in accordance with various embodiments.
21 is a flow chart illustrating a method of operating an electronic device according to various embodiments.
22A to 22C are diagrams for explaining a method of operating an electronic device according to various embodiments.
23 is a flow chart illustrating a method of operating an electronic device according to various embodiments.
24A to 24C are diagrams for explaining a method of operating an electronic device according to various embodiments.
25A to 25C are diagrams for explaining a method of operating an electronic device according to various embodiments.
26 shows a block diagram of an electronic device according to various embodiments.

Hereinafter, various embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood, however, that this disclosure is not intended to limit the present disclosure to the particular embodiments, but includes various modifications, equivalents, and / or alternatives of the embodiments of the present disclosure. In connection with the description of the drawings, like reference numerals may be used for similar components.

In this document, the expressions " having, " " having, " " comprising, " or &Quot;, and does not exclude the presence of additional features.

In this document, the expressions "A or B," "at least one of A or / and B," or "one or more of A and / or B," "A / B, Combinations thereof. For example, "A or B," "at least one of A and B," or "at least one of A or B" includes (1) at least one A, (2) Or (3) at least one A and at least one B all together.

The terms "first," "second," "first," or "second," etc. used in various embodiments may describe various components in any order and / or importance, Lt; / RTI > The representations may be used to distinguish one component from another. For example, the first user equipment and the second user equipment may represent different user equipment, regardless of order or importance. For example, without departing from the scope of the present disclosure, the first component may be referred to as a second component, and similarly, the second component may be named as the first component.

(Or functionally or communicatively) coupled with / to "another component (eg, a second component), or a component (eg, a second component) Quot; connected to ", it is to be understood that any such element may be directly connected to the other element or may be connected through another element (e.g., a third element). On the other hand, when it is mentioned that a component (e.g., a first component) is "directly connected" or "directly connected" to another component (e.g., a second component) It can be understood that there is no other component (e.g., a third component) between other components.

As used herein, the phrase " configured to " (or set) to be " configured according to circumstances may include, for example, having the capacity to, To be designed to, "" adapted to, "" made to, "or" capable of ". The term " configured (or set) to " may not necessarily mean " specifically designed to " Instead, in some situations, the expression " configured to " may mean that the device can " do " with other devices or components. For example, a processor configured (or configured) to perform the phrases " A, B, and C " may be a processor dedicated to performing the operation (e.g., an embedded processor), or one or more software programs To a generic-purpose processor (e.g., a CPU or an application processor) that can perform the corresponding operations.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the scope of the other embodiments. The singular expressions may include plural expressions unless the context clearly dictates otherwise. All terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by one of ordinary skill in the art of the present disclosure. Commonly used predefined terms may be interpreted to have the same or similar meaning as the contextual meanings of the related art and are not to be construed as ideal or overly formal in meaning unless expressly defined in this document . In some cases, the terms defined herein may not be construed to exclude embodiments of the present disclosure.

An electronic device according to various embodiments of the present disclosure can be, for example, a smartphone, a tablet personal computer, a mobile phone, a videophone, an e-book reader reader, a desktop personal computer, a laptop personal computer, a netbook computer, a workstation, a server, a personal digital assistant (PDA), a portable multimedia player (PMP) , Mobile medical devices, cameras, or wearable devices such as smart glasses, head-mounted-devices (HMD), electronic apparel, electronic bracelets, electronic necklaces, (e. g., apps, e-tat, smart mirror, or smart watch).

In some embodiments, the electronic device may be a smart home appliance. Smart home appliances include, for example, televisions, digital video disk players, audio, refrigerators, air conditioners, vacuum cleaners, ovens, microwaves, washing machines, air cleaners, set- (Such as a home automation control panel, a security control panel, a TV box such as Samsung HomeSync ™, Apple TV ™ or Google TV ™), a game console (eg Xbox ™, PlayStation ™) A dictionary, an electronic key, a camcorder, or an electronic frame.

In an alternative embodiment, the electronic device may be any of a variety of medical devices (e.g., various portable medical measurement devices such as a blood glucose meter, a heart rate meter, a blood pressure meter, or a body temperature meter), magnetic resonance angiography (MRA) A global positioning system receiver, an event data recorder (EDR), a flight data recorder (FDR), an automotive infotainment device, a navigation system, a navigation system, Electronic devices (eg marine navigation devices, gyro compass, etc.), avionics, security devices, head units for vehicles, industrial or home robots, ATMs (automatic teller's machines) point of sale or internet of things such as light bulbs, various sensors, electric or gas meters, sprinkler devices, fire alarms, thermostats, street lights, toasters, A water tank, a heater, a boiler, and the like).

According to some embodiments, the electronic device is a piece of furniture or a part of a building / structure, an electronic board, an electronic signature receiving device, a projector, Water, electricity, gas, or radio wave measuring instruments, etc.). In various embodiments, the electronic device may be a combination of one or more of the various devices described above. An electronic device according to some embodiments may be a flexible electronic device. Further, the electronic device according to the embodiment of the present disclosure is not limited to the above-described devices, and may include a new electronic device according to technological advancement.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An electronic apparatus according to various embodiments will now be described with reference to the accompanying drawings. In this document, the term user may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

1 illustrates a network environment including an electronic device according to various embodiments.

Referring to Figure 1, in various embodiments, an electronic device 101 in a network environment 100 is disclosed. The electronic device 101 includes a bus 110, a processor 120, a memory 130, an input / output interface 150, a display 160, a communication interface 170, a sensor unit 175, a camera system 180, And a camera control module 190. In some embodiments, the electronic device 101 may omit at least one of the components or may additionally comprise other components.

The bus 110 may include circuitry, for example, to connect the components 120-190 to one another and to communicate communications (e.g., control messages and / or data) between the components .

The processor 120 may include one or more of a central processing unit (CPU), an application processor (AP), or a communication processor (CP). The processor 120 may perform, for example, operations or data processing related to control and / or communication of at least one other component of the electronic device 101. For example, The processor 120 may be referred to as a controller, or may include the controller as a part thereof or configure the controller.

The memory 130 may include volatile and / or non-volatile memory. The memory 130 may store instructions or data related to at least one other component of the electronic device 101, for example. According to one embodiment, the memory 130 may store software and / or programs 140. The program 140 may include, for example, a kernel 141, a middleware 143, an application programming interface (API) 145, and / or an application program 147 . At least some of the kernel 141, middleware 143, or API 145 may be referred to as an operating system (OS).

The kernel 141 may include system resources used to execute an operation or function implemented in other programs (e.g., middleware 143, API 145, or application program 147) E.g., bus 110, processor 120, or memory 130). The kernel 141 can also control or manage system resources by accessing individual components of the electronic device 101 at the middleware 143, the API 145, or the application program 147 You can provide an interface.

The middleware 143 may perform an intermediary function such that the API 145 or the application program 147 may communicate with the kernel 141 to exchange data. The middleware 143 may also be operable to provide at least one application of the application program 147 with a system resource of the electronic device 101 in association with the work requests received from the application program 147, (E.g., scheduling or load balancing) of a work request using a method such as assigning a priority that can be used to the processor (e.g., bus 110, processor 120, or memory 130) .

The API 145 is an interface for the application 147 to control the functions provided by the kernel 141 or the middleware 143 such as file control, At least one interface or function (e.g., command) for processing, character control, or the like.

The input / output interface 150 may serve as an interface through which commands or data input from, for example, a user or another external device can be transmitted to the other component (s) of the electronic device 101. Further, the input / output interface 150 may output a command or data received from another component (s) of the electronic device 101 to a user or another external device.

The display 160 may be a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, or a microelectromechanical systems (MEMS) electronic paper) display. The display 160 may display various content (e.g., text, images, video, icons, symbols, etc.) to the user, for example. The display 160 may include a touch screen and may receive touch, gesture, proximity, or hovering input using, for example, an electronic pen or a portion of the user's body.

The communication interface 170 is a communication interface for communicating between the electronic device 101 and an external device such as the first external electronic device 102 or the second external electronic device 104 or the server 106 Can be set. For example, the communication interface 170 may perform wired or wireless communication with the external device (e.g., the second external electronic device 104 or the server 106) directly. For example, the communication interface 170 may be connected to the network 162 via wireless or wired communication to communicate with the external device (e.g., the second external electronic device 104 or the server 106) . The communication interface 170 may include a communication processor (CP), and the communication processor may configure one of a plurality of modules constituting the communication interface 170. In one embodiment, the communications processor may be included in the processor 120.

The wireless communication may be, for example, a cellular communication protocol such as long term evolution (LTE), LTE Advanced (LTE-A), Code Division Multiple Access (CDMA), Wideband CDMA (WCDMA) Mobile Telecommunication System), WiBro (Wireless Broadband), or Global System for Mobile Communications (GSM). The wired communication may include at least one of a universal serial bus (USB), a high definition multimedia interface (HDMI), a recommended standard 232 (RS-232), or a plain old telephone service (POTS). The network 162 may be a telecommunications network, e.g., a computer network (e.g., a LAN or WAN), the Internet, or a telephone network, an IP Multimedia Core Network Subsystem (IMS) (Packet Data Network), a 3rd Generation Partnership Project (3GPP) / 3rd Generation Partnership Project 2 (3GPP2) CS switched network, and the like.

Each of the first and second external electronic devices 102 and 104 may be the same or a different kind of device as the electronic device 101. According to one embodiment, the server 106 may include one or more groups of servers. According to various embodiments, all or a portion of the operations performed in the electronic device 101 may be performed in another electronic device or multiple electronic devices (e.g., electronic device 102, 104, or server 106). According to one embodiment, in the event that the electronic device 101 has to perform a function or service automatically or upon request, the electronic device 101 may, instead of executing the function or the service itself, Additionally, at least some of its associated functions may be requested to other devices (e.g., electronic device 102, 104, or server 106). The other electronic device (e.g., electronic device 102, 104, or server 106) may execute the requested function or additional function and forward the result to the electronic device 101. The electronic device 101 can directly or additionally process the received result to provide the requested function or service. For this purpose, for example, cloud computing, distributed computing, or client-server computing technology may be used.

The sensor unit 175 may include at least one sensor for detecting the state of the electronic device 101 or the environmental condition thereof. For example, the sensor unit 175 may be a proximity sensor for detecting whether or not the user accesses the electronic device 101, or an operation of the electronic device 101 (for example, rotation of the electronic device 101) , A motion / orientation sensor for detecting acceleration, deceleration, vibration, etc.), an illuminance sensor for detecting an ambient illuminance, and the like. The motion / orientation sensor may also include at least one of an acceleration sensor, a gravity sensor, a geomagnetic sensor, a gyro sensor, a shock sensor, a GPS module, and a compass sensor. The sensor unit 175 may detect the state of the electronic device 101 and transmit a signal indicating the state of the electronic device 101 to the processor 120. [ For example, the GPS module receives a radio wave from a plurality of GPS satellites (not shown) on the earth orbit, and receives a time of arrival from a GPS satellite (not shown) to the electronic device 101, It is possible to calculate the position of the electronic device 101. [ The compass sensor calculates the posture or orientation of the electronic device 101.

The camera system 180 can photograph a subject and output an image of the photographed subject. The display 160 may display an image input from the camera system.

In one embodiment, the camera system 180 may include only a camera module that outputs an image of a subject.

In one embodiment, the camera system 180 may include a camera module that outputs an image of a subject and an image processing device that performs processing on the image output from the camera module.

In one embodiment, the image processing apparatus includes a first image signal processor (ISP) that performs a first process on the image output from the camera module, and a second image signal processor 2 processing or a second image signal processor for performing the first processing in cooperation with the first image signal processor.

According to one embodiment, the camera control module 190 may perform at least one of the operations (or functions) implemented in the electronic device 101 to enable the electronic device 101 to operate have. For example, the server 106 may include a camera control server module 108 that may support a camera control module 190 implemented in the electronic device 101. For example, the camera control server module 108 may include at least one component of the camera control module 190 to perform at least one of the operations performed by the camera control module 190 (e.g., agency) can do.

The camera control module 190 may be configured to receive information from at least one of the other components (e.g., the processor 120, the memory 130, the input / output interface 150, the communication interface 170, etc.) At least some of which can be processed and used in a variety of ways. For example, the camera control module 190 may communicate with other electronic devices (e.g., electronic device 102, 104, or server 106) using the processor 120, ) Of the electronic device (101). The camera control module 190 may be integrated into the processor 120. According to one embodiment, at least one configuration of the camera control module 190 may be included in the server 106 (e.g., the camera control server module 108) and the camera control module 190 ) May be supported.

Figure 2 illustrates a camera system in accordance with various embodiments.

The camera system 180 may include at least one of a camera module 210 or an image processing device 202.

The camera module 210 can photograph a subject and can output an image of the photographed subject, and can include a lens system 211 and an image sensor 212.

The lens system 211 can form an image of a subject by converging light inputted from the outside. The lens system 211 may include at least one lens, and each lens may be a convex lens, an aspherical lens, or the like. The lens system 211 may have symmetry with respect to an optical axis passing through the center thereof, and the optical axis may be defined as the center axis.

The image sensor 212 may detect an optical image formed by the lens system 211 as a digital image.

The image sensor 212 may include a first input / output unit 214 (or a first input / output circuit), a first memory 216, and a sensing unit 218 (or a sensing circuit). The image sensor 212 may be a charge-coupled device (CCD) image sensor, a complementary metal-oxide semiconductor (CMOS) image sensor, or the like.

The first input / output unit 214 may function as an interface for inputting and / or outputting signals / data to / from an external device (e.g., the processor 120 and the image processing apparatus 202). The first input / output unit 214 may transmit the signal / data input from the external device to the first memory 216 or the sensing unit 218. The first input / output unit 214 may transmit the signal / data input from the first memory 216 or the sensing unit 218 to the external device.

The first memory 216 stores a program (e.g., firmware) for operating the camera module 210, setting information (e.g., a plurality of setting values) of the camera module 210, And an image detected by the image processing apparatus.

The sensing unit 218 may detect an optical image formed by the lens system 211 as a digital image. The sensing unit 218 may include a plurality of pixel units arranged in an M × N matrix structure, and each pixel unit may include a photodiode and a plurality of transistors. The pixel unit accumulates the charge generated by the input light, and the voltage due to the accumulated charge can represent the illuminance of the input light. In the case of processing an image constituting a still image or a moving image, the image output from the sensing unit 218 may be composed of a set of voltages (i.e., pixel values) output from the pixel units, May represent one image frame (i.e., still image). The image frame may be composed of MxN pixels. The sensing unit 218 may operate only the pixels of the interest region among all the pixels of the sensing unit 218 or all of the pixels according to the set value received from the processor 120. [ For example, the sensing unit 218 may operate according to a control signal input from the processor 120 or the image processing apparatus 202.

In one embodiment, the camera module 210 may further include a driving unit for moving the lens system 211 along an optical axis for focus control. For example, the driving unit may operate according to a control signal input from the sensing unit 218, the processor 120, or the image processing apparatus 202.

In one embodiment, the sensing unit 218 may include a controller that controls the overall operation of the camera module 210 and / or the image sensor 212.

The image processing apparatus 202 may process the image output from the camera module. The image processing apparatus 202 may include a first image signal processor (ISP) 220 and a second image signal processor 230.

The first image signal processor 220 may perform a first process on the image output from the camera module 210. [ The first image signal processor 220 includes a second input / output section 224 (or a second input / output circuit), a second memory 226, a first image processing section 228 (or a first image processing circuit) can do.

The second input / output unit 224 is used for signal / data input and / or output with an external device (e.g., processor 120, camera module 210, display 160, second image signal processor 230) And can function as an interface. The second input / output unit 224 may transmit the signal / data input from the external device to the second memory 226 or the first image processing unit 228. The second input / output unit 224 may transmit the signal / data input from the second memory 226 or the first image processing unit 228 to the external device.

The second memory 226 may store a program (e.g., firmware) for operating the first image signal processor 220, setting information (e.g., a plurality of setting values) of the first image signal processor 220, The first image signal processor 220 and / or the second image signal processor 230 may be configured to process images to be processed or processed by the first image signal processor 220 and / Image processing information processed by the image processing apparatus, and the like.

The first image processing unit 228 may perform a first process on the image output from the camera module 210. The first image processing unit 228 may process an image input from the camera module 210 in a frame unit under the control of the processor 120. [ The first image processing unit 228 may output the converted image in accordance with the screen characteristics (size, image quality, resolution, etc.) of the display 160.

For example, the first image processing unit 228 may be configured to perform automatic exposure (AE), auto white balance (AWB), auto focus at least one processing such as autofocus (AF), noise reduction, resizing / scaling, color space conversion (CSC), gamma correction, have.

The second image signal processor 230 may perform a second process on the image output from the camera module 210 independently of the first image signal processor 220 or may perform the second process on the first image signal processor 220 To perform the first process or the second process. The second image signal processor 230 includes a third input / output unit 234 (or a third input / output circuit), a third memory 236, a second image processing unit 238 (or a second image processing circuit) can do.

The third input / output unit 234 is connected to the first input / output unit 234 for signal / data input and / or output with an external device (e.g., the processor 120, the camera module 210, the display 160, And can function as an interface. The third input / output unit 234 may transmit the signal / data input from the external apparatus to the third memory 236 or the second image processing unit 238. The third input / output unit 234 may transmit the signal / data input from the third memory 236 or the second image processing unit 238 to the external device.

The third memory 236 may store a program (e.g., firmware) for operating the second image signal processor 230, setting information (e.g., a plurality of setting values) of the second image signal processor 230, An image to be processed or processed by the second image signal processor 230, image processing information processed by the second image signal processor 230, and the like.

The second image processing unit 228 may perform a second process on the image output from the camera module 210 independently of the first image signal processor 220, The first processing or the second processing can be performed in cooperation with the first processing. The second image processing unit 238 may be configured to receive input from the camera module 210 and / or the first image signal processor 220 under the control of the processor 120 and / or the first image signal processor 220 The image can be processed in frame units. The second image processing unit 238 may output the converted image according to the screen characteristics (size, image quality, resolution, etc.) of the display 160.

For example, the second image processing unit 238 may be configured to perform automatic exposure, auto white balance, auto focus, noise reduction, and the like on images input from the camera module 210 and / or the first image signal processor 220 Reduction, scaling / scaling, color space conversion, gamma correction, and the like.

In one embodiment, the second image processing unit 238 may include a phase detection AF (PAF), a plurality of phase detection AFs At least one processing such as High Dynamic Range Imaging (HDRI) that generates an image having a high dynamic range from the images can be performed.

In one embodiment, the second image processing unit 238 may pass the processed image or information of the processed image to the first image signal processor 220.

In one embodiment, the image output from the first image signal processor 220 and the image output from the second image signal processor 230 may be sequentially, alternately, or concatenated to the display 160 Can be output.

3 is a block diagram 300 of a program module 310 in accordance with various embodiments. According to one embodiment, the program module 310 (e.g., program 140) includes an operating system (OS) that controls resources associated with an electronic device (e.g., electronic device 101) and / And various applications (e.g., application programs 147) running on the operating system. The operating system may be, for example, android, iOS, windows, symbian, tizen, or bada.

The program module 310 may include a kernel 320, a middleware 330, an application programming interface (API) 360, and / or an application 370. At least a portion of the program module 310 may be preloaded on an electronic device or downloaded from a server (e.g., server 106).

The kernel 320 (e.g., the kernel 141 of FIG. 1) may include, for example, a system resource manager 321 or a device driver 323. The system resource manager 321 can perform control, assignment, or recovery of system resources. According to one embodiment, the system resource manager 321 may include a process management unit, a memory management unit, or a file system management unit. The device driver 323 may include, for example, a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, a WiFi driver, an audio driver, or an inter- have.

The middleware 330 may provide the functionality commonly required by the application 370 or provide the functionality of the API 360 to allow the application 370 to efficiently use limited system resources within the electronic device. The various functions can be provided to the application 370. [ According to one embodiment, the middleware 330 (e.g., middleware 143) includes a runtime library 335, an application manager 341, a window manager 342, a multimedia manager 343, a resource manager 344, a power manager 345, a database manager 346, a package manager 347, a connectivity manager 348, a notification manager 349, a location manager 350, a graphic manager 351, or a security manager 352.

The runtime library 335 may include, for example, a library module used by the compiler to add new functionality via a programming language while the application 370 is executing. The runtime library 335 may perform input / output management, memory management, or functions for arithmetic functions.

The application manager 341 can manage a life cycle of at least one application among the applications 370, for example. The window manager 342 can manage GUI resources used in the screen. The multimedia manager 343 can recognize a format required for reproducing various media files and can encode or decode a media file using a codec suitable for the format. The resource manager 344 may manage resources such as a source code, a memory, or a storage space of at least one of the applications 370.

The power manager 345 operates together with a basic input / output system (BIOS), for example, to manage a battery or a power source and provide power information and the like necessary for the operation of the electronic device . The database manager 346 may create, search, or modify a database for use in at least one of the applications 370. The package manager 347 can manage installation or update of an application distributed in the form of a theme package. For example, the theme package may consist of one file or a plurality of files.

The connection manager 348 may manage wireless connections, such as, for example, WIFI or Bluetooth. The notification manager 349 may display or notify events such as arrival messages, appointments, proximity notifications, etc. in a manner that does not interfere with the user. The location manager 350 may manage the location information of the electronic device. The graphic manager 351 may manage a graphic effect to be provided to the user or a user interface related thereto. The security manager 352 may provide security functions necessary for system security or user authentication. According to one embodiment, when the electronic device (e.g., electronic device 101) includes a telephone function, the middleware 330 may include a telephony manager for managing the voice or video call capabilities of the electronic device .

The middleware 330 may include a middleware module that forms a combination of various functions of the above-described components. The middleware 330 may provide a module specialized for each type of operating system to provide a differentiated function. In addition, the middleware 330 may dynamically delete some existing components or add new components.

The API 360 (e.g., API 145) may be provided in a different configuration depending on the operating system, for example, as a set of API programming functions. For example, for Android or iOS, you can provide one API set per platform, and for tizen, you can provide more than two API sets per platform.

The application 370 (e.g., the application program 147) includes a home 371, a dialer 372, an SMS / MMS 373, an instant message 374, a browser 375, A camera 376, an alarm 377, a contact 378, a voice dial 379, an email 380, a calendar 381, a media player 382, an album 383 or a clock 384, May include one or more applications that may provide functions such as health care (e.g., to measure momentum or blood glucose), or to provide environmental information (e.g., provide atmospheric pressure, humidity, or temperature information, etc.) .

According to one embodiment, the application 370 is an application that supports information exchange between the electronic device (e.g., electronic device 101) and an external electronic device (e.g., electronic device 102, 104) Quot; information exchange application "for convenience of explanation). The information exchange application may include, for example, a notification relay application for communicating specific information to the external electronic device, or a device management application for managing the external electronic device .

For example, the notification delivery application may send notification information generated in another application (e.g., SMS / MMS application, email application, health care application, or environmental information application) of the electronic device to an external electronic device (102, 104)). Further, the notification delivery application can receive notification information from, for example, an external electronic device and provide the notification information to the user. The device management application may be used to manage at least one function (e.g., of the external electronic device itself (or some component) of an external electronic device (e.g., electronic device 102, 104) (E.g., call-on / turn-off, or brightness (or resolution) adjustment of the display), management of an application running on the external electronic device or services provided by the external electronic device Installed, deleted, or updated).

According to one embodiment, the application 370 is configured to determine the attributes of the external electronic device (e. G., Electronic devices 102 and 104) (e. G. Applications (eg, health care applications). According to one embodiment, the application 370 may include an application received from an external electronic device (e.g., server 106 or electronic device 102, 104). According to one embodiment, the application 370 may include a preloaded application or a third party application downloadable from a server. The names of the components of the program module 310 according to the illustrated embodiment may vary depending on the type of the operating system.

According to various embodiments, at least some of the program modules 310 may be implemented in software, firmware, hardware, or a combination of at least two of them. At least some of the program modules 310 may be implemented (e.g., executed) by, for example, a processor (e.g., processor 120). At least some of the program modules 310 may include, for example, modules, programs, routines, sets of instructions or processes, etc. to perform one or more functions.

4 shows a block diagram 400 of a camera control module 180 of an electronic device (e.g., electronic device 101) in accordance with various embodiments. Referring to FIG. 4, the camera control module 180 may include at least a part or all of the control module 410 and the display module 420. The camera control module 180 may be provided separately from the processor (e.g., the processor 120), or may be integrated into the processor in whole or in part.

The control module 410 according to various embodiments may perform the initialization necessary to operate the camera system (e.g., the camera system 180) of the electronic device in a normal mode. Upon completion of the initialization, the control module 410 may control the camera system to operate in the sleep mode. The control module 410 may control the camera system to switch from the sleep mode to the normal mode (or wake-up).

In one embodiment, the initialization is performed when a predetermined first condition is satisfied, and the operation of switching to the normal mode may be performed when a preset second condition is satisfied.

The display module 420 according to various embodiments may control the display (e.g., display 160) of the electronic device to display an image output from the camera system in the normal mode.

In one embodiment, the preset first condition is selected from the group consisting of booting of the electronic device, switching of the electronic device from the sleep mode to the normal mode, screen / power on of the display after entering the sleep mode of the electronic device, The execution of an application including graphic elements (or items) (e.g., buttons, icons, menus, menu items) that require the operation of the system, display of a screen containing graphic elements requiring the operation of the camera system, A user's access to a graphical element that requires operation of the camera system, detection of a situation associated with the electronic device consistent with a preset context, or detection of at least one word And detection.

In one embodiment, the preset situation for the electronic device is such that, when the electronic device has been located or reached a preset area / location, when the electronic device has reached a preset time, (E.g., execution of the application (s), etc.) or the current state of the electronic device (e.g. battery state, radio signal reception state, memory state, etc.) have.

In one embodiment, a predetermined situation for the electronic device may be determined based on usage history information of the electronic device (e.g., history of the electronic device operating in the sleep mode at a specific place, etc.).

In one embodiment, the second condition is selected from the group consisting of: detecting a preset situation for the electronic device, executing a camera application, selecting a graphic element requiring operation of the camera system, or requesting operation of the camera system And reception of the second data.

In one embodiment, if the camera system is identified during a boot (or boot-up process) of the electronic device, the control module 410 may perform the initialization. For example, when the electronic device 101 is powered on, the control module 410 may perform device probing operations such as a camera system, a sensor portion (e.g., sensor portion 175), an operating system : OS) can be performed. The control module 410 may perform the initialization in a device check operation or a boot operation thereafter.

In one embodiment, the control module 410 may perform the initialization if the display is screen / power off and the display is powered on after the electronic device is in the sleep mode.

In one embodiment, the control module 410 may perform the initialization when the display module 420 displays a screen including graphical elements requiring operation of the camera system on the display.

In one embodiment, the display module 420 may display on the display a screen that includes graphical elements that require operation of the camera system. The control module 410 may detect the user's access to the graphical element via the display. If the user's access to the graphical element is detected via the display, the control module 410 may perform the initialization.

In one embodiment, the display module 420 may display on the display a screen that includes graphical elements that require operation of the camera system. The control module 410 may detect a hovering input on the display. Wherein the position of the hovering input is included in a display area of the graphic element, or the position of the hovering input is adjacent to a display area of the graphic element, or when the hovering input is moved toward the graphic element, 410 may perform the initialization.

In one embodiment, the control module 410 may detect a context associated with the electronic device. The control module 410 may retrieve information associated with the situation from a database stored in a memory (e.g., memory 130) of the electronic device. If information related to the situation is retrieved from the database, the control module 410 may perform the initialization.

In one embodiment, the control module 410 may be configured to receive input from a user's voice (e.g., voice input via a microphone) or text (e.g., voice) via the input / output interface : A message created through display). If at least one word that matches at least one word preset in the speech or text is detected, the control module 410 may perform the initialization.

In one embodiment, the control module 410 controls the communication interface (e.g., communication interface 170), input / output interface (e.g., input / output interface 150), display (e.g., display 160) (E.g., a voice of the other party in a voice call) or text (e.g., a text message) from an external device via the Internet. If at least one word that matches at least one word preset in the speech or text is detected, the control module 410 may perform the initialization.

In one embodiment, the camera system includes a camera module (e.g., a camera module 210) for outputting an image of a subject, an image processing device (e.g., an image processing device Device 202). ≪ / RTI >

In one embodiment, the image processing apparatus includes a first image signal processor (e.g., a first image signal processor 220) that performs a first process on an image output from the camera module, A second image signal processor (e.g., a second image signal processor) that performs a second process on the processed image independently of the first image signal processor, or that performs the first process or the second process in conjunction with the first image signal processor, And a second image signal processor 230).

In one embodiment, for initialization, the control module 410 may apply power to at least a portion of the camera system. For the initialization, the control module 410 may communicate or store at least one of a program for operation of at least a portion of the camera system or configuration information of the camera system to at least a portion of the camera system. At least a part of the camera system may be changed to a state in which the camera system is operable after the program is executed.

In one embodiment, for the initialization, the control module 410 controls a program (e.g., firmware) for operation of at least a portion of the camera system from the internal memory (s) (e.g., 216, the second memory 226 and / or the third memory 236). For the initialization, the control module 410 may forward the settings of at least a portion of the camera system to at least a portion of the camera system, or may store the internal system memory (s) in the camera system. The program may be configured to apply the settings to at least a portion of the camera system, or to perform generation or correction of image / image association data according to the settings.

In one embodiment, the setting information or the setting values of the camera system include an ISO (International Standardization Organization) setting value, a WB (White Balance) / AWB setting value, a frame rate, A preview resolution setting, a preview format setting value, an automatic exposure (AE) setting value, an autofocus (AF) setting value, a noise reduction setting value, resizing, / Scaling setting value, Color Space Conversion (CSC) setting value, Gamma Correction setting value, PAF setting value, HDRI setting value, and the image processing apparatus processes the image inputted from the camera module And allocation information of a partial area of the memory in order to perform the operation.

In one embodiment, for initialization, the control module 410 may store a program for operation of at least a portion of the camera system in the internal memory (s) of the camera system. For the initialization, the control module 410 may forward one message containing a plurality of settings of at least a portion of the camera system to at least a portion of the camera system or to the internal memory (s) of the camera system have. For example, the control module 410 may transmit one message (or data frame) including a plurality of setting values (or all setting values) for the camera module to the camera module, Can be stored. For example, the control module 410 may forward one message (or data frame) containing a plurality of setting values (or all setting values) for the image processing apparatus to the image processing apparatus, It can be stored in internal memory. For example, the control module 410 may provide a single message (or data frame) containing a plurality of settings (or all settings) for the first image signal processor and / or the second image signal processor 1 image signal processor or in an internal memory of the first image signal processor. For example, the control module 410 may forward one message (or data frame) containing a plurality of settings (or all the settings) for the second image signal processor to the second image signal processor, And stored in the internal memory of the second image signal processor.

In one embodiment, for initialization, the control module 410 may store a program for operation of at least a portion of the camera system in the internal memory (s) of the camera system. For the initialization, without input from an external device, at least a portion of the camera system may obtain settings stored in the internal memory (s) of at least a portion of the camera system. For example, a program for operation of at least a part of the camera system may be configured to automatically acquire the settings stored in a predetermined area of the internal memory.

In one embodiment, for the initialization, the control module 410 may transmit at least one of a program for operating the camera module or setting information of the camera module to the camera module, Can be stored. For the initialization, the control module 410 may transfer at least one of the program for the operation of at least a part of the image processing apparatus or the setting information of at least a part of the image processing apparatus to at least a part of the image processing apparatus, And can be stored in the internal memory of the image processing apparatus.

In one embodiment, for the initialization, the control module 410 may transmit at least one of a program for operating the camera module or setting information of the camera module to the camera module, Can be stored. For the initialization, the control module 410 transfers at least one of the program for the operation of the first image signal processor or the configuration information of the first image signal processor to the first image signal processor, And stored in the internal memory of the image signal processor. For the initialization, the control module 410 may transfer at least one of the program for the operation of the second image signal processor or the configuration information of the second image signal processor to the second image signal processor, And stored in the internal memory of the image signal processor.

In one embodiment, for initialization, the control module 410 may store a program for operation of the camera module in an internal memory of the camera module. For the initialization, the control module 410 may transmit the setting values of the camera module to the camera module or may store the setting values in an internal memory of the camera module. For the initialization, the control module 410 may store a program for operation of at least a part of the image processing apparatus in an internal memory of at least a part of the image processing apparatus. For the initialization, the control module 410 may transfer the settings of at least a part of the image processing apparatus to at least a part of the image processing apparatus or store the setting values in the internal memory of the image processing apparatus.

In one embodiment, the control module 410 may control the camera module to photograph a subject. The control module 410 may control the image processing apparatus to process the image of the subject outputted from the camera module. The display module 420 may control the display to display the processed image.

In one embodiment, the control module 410 may automatically perform the initialization and operation of the camera system in the sleep mode, respectively.

In one embodiment, to operate the camera system in the sleep mode, the control module 410 may provide the camera system with a second power less than the first power provided to the camera system in the normal mode have. For example, the second power may comprise a minimum power for maintaining data stored in an internal memory of the camera system and a minimum power for signal input from an external device. For example, when the power is not applied to the sensing unit (e.g., the sensing unit 218) and / or the image processing unit (e.g., the first image processing unit 228 and the second image processing unit 238) . For example, in the normal mode, the camera system may be in a state capable of performing image capture and image processing, and in the sleep mode, the camera system performs at least one of image capture and image processing It can be in a state that can not be done.

In one embodiment, to transition the camera system from the sleep mode to the normal mode, the control module 410 may provide the first power to the camera system.

In one embodiment, the control module 410 may be configured to switch between normal mode and sleep mode for at least one component of the camera system to at least one of screen / power on and screen / power Can be synchronized to the switching between off and on. For example, when at least one component of the electronic device is in a screen / power-on state, the control module 410 may operate at least one component of the camera system in a normal mode. When at least one component of the electronic device is in a screen / power off state, the control module 410 may operate at least one component of the camera system in a sleep mode.

In one embodiment, the control module 410 may synchronize the switching between the normal mode and the sleep mode for the camera module of the camera system to the switching between the screen / power on and display / power off for the display of the electronic device have.

In one embodiment, the control module 410 may synchronize switching between normal mode and sleep mode for at least one component of the camera system to switching between execution and termination for at least one application of the electronic device have. For example, when at least one application of the electronic device is running, the control module 410 may operate at least one component of the camera system in a normal mode. When at least one application of the electronic device is in an end state, the control module 410 may operate at least one component of the camera system in a sleep mode.

In one embodiment, the control module 410 may synchronize the switching between the normal mode and the sleep mode for the second image signal processor to the switching between execution and termination for the camera application of the electronic device.

In one embodiment, the control module 410 is adapted to switch between normal mode and sleep mode for at least one component of the camera system to switch between normal mode and sleep mode for at least one component of the electronic device You can synchronize. For example, when at least one component of the electronic device is operating in a normal mode, the control module 410 may operate at least one component of the camera system in a normal mode. When at least one component of the electronic device is operating in a sleep mode, the control module 410 may operate at least one component of the camera system in a sleep mode.

In one embodiment, the control module 410 may synchronize the switching between the normal mode and the sleep mode for the first image signal processor to the switching between the normal mode and the sleep mode for the processor.

In one embodiment, the control module 410 may perform initialization of the camera system. When the initialization is completed, the control module 410 may operate at least one of the first camera module and the second camera module of the camera system in a normal mode. The display module 420 may control the display to display an image output from one of the first camera module and the second camera module.

In one embodiment, when the initialization is completed, the control module 410 may simultaneously operate the first camera module and the second camera module in a normal mode.

In one embodiment, the control module 410 may perform initialization of the camera system if the preset first condition is met.

In one embodiment, once the initialization is complete, the control module 410 may operate the camera system in a sleep mode. The control module 410 may switch the camera system from the sleep mode to the normal mode.

In one embodiment, the camera system comprises: a first camera module for outputting a first image of a first subject located in front of the electronic device; a second camera module for outputting a second image of a second subject located behind the electronic device The second camera module, and the image processing device that performs processing on the first image and / or the second image.

In one embodiment, the image processing apparatus may include a first image signal processor that performs a first process on the first image and a second image signal processor that performs a second process on the second image have.

In one embodiment, when the initialization is completed, the control module 410 may simultaneously operate the first camera module and the second camera module in a normal mode. The control module 410 may perform a first process on the first image output from the first camera module. The control module 410 may perform a second process on the second image output from the second camera module. The display module 420 may display the display to display the first processed first image or the second processed second image.

In one embodiment, in response to the input, the display module 420 may cease displaying the image output from the first one of the first camera module and the second camera module, And to display the image output from the other one of the second camera modules.

In one embodiment, the control module 410 is configured to operate the one of the first camera module and the second camera module in the normal mode, while the other one of the first camera module and the second camera module Can be operated in the sleep mode.

In one embodiment, the control module 410 is configured to operate one of the first image signal processor and the second image signal processor, corresponding to the one of the first camera module and the second camera module, While the other of the first image signal processor and the second image signal processor corresponding to the other one of the first camera module and the second camera module is operated in the sleep mode. The display module 420 may control the display to display an image output from the one of the first image signal processor and the second image signal processor (i.e., an image signal processor operating in a normal mode).

In one embodiment, the control module 410 may operate the other one of the first camera module and the second camera module in a sleep mode. In response to the input, the control module 410 may operate the one of the first camera module and the second camera module in the sleep mode. The control module 410 may switch the other one of the first camera module and the second camera module from the sleep mode to the normal mode. The display module 420 may control the display to display an image output from the other one of the first camera module and the second camera module.

According to various embodiments, the control module 410 may operate the one of the first camera module and the second camera module in the sleep mode using a preset switching API (application programming interface) And switching the other one of the first camera module and the second camera module from the sleep mode to the normal mode.

5 is a flow diagram illustrating a method of operation of an electronic device according to various embodiments. The method of operation of the electronic device may include 510 to 540 operations. The method of operation of the electronic device may be performed by an electronic device (e.g., electronic device 101), a processor of the electronic device (e.g., processor 120), or a camera control module (e.g., camera control module 190) .

In operation 510, the electronic device may perform the initialization necessary to operate the camera system (e.g., camera system 180) in a normal mode. In one embodiment, the electronic device can perform the initialization if a predetermined first condition is satisfied.

In one embodiment, the predetermined first condition is selected from the group consisting of the booting of the electronic device, the switching of the electronic device from the sleep mode to the normal mode, the switching of the display (e.g., display 160) (E.g., buttons, icons, menus, menu items) that require the operation of the camera system, a graphical element that requires the operation of the camera system A user's access to the camera system, a user's access to a graphical element that requires operation of the camera system, detection of a situation associated with the electronic device consistent with a predetermined context, , Or detection of at least one word that matches at least one preset word.

In one embodiment, the preset situation for the electronic device is such that, when the electronic device has been located or reached a preset area / location, when the electronic device has reached a preset time, (E.g., execution of the application (s), etc.) or the current state of the electronic device (e.g. battery state, radio signal reception state, memory state, etc.) have.

In one embodiment, a predetermined situation for the electronic device may be determined based on usage history information of the electronic device (e.g., history of the electronic device operating in the sleep mode at a specific place, etc.).

In one embodiment, the camera system includes a camera module (e.g., a camera module 210) for outputting an image of a subject, an image processing device (e.g., an image processing device Device 202). ≪ / RTI >

In one embodiment, the image processing apparatus includes a first image signal processor (e.g., a first image signal processor 220) that performs a first process on an image output from the camera module, A second image signal processor (e.g., a second image signal processor) that performs a second process on the processed image independently of the first image signal processor, or that performs the first process or the second process in conjunction with the first image signal processor, And a second image signal processor 230).

In one embodiment, for initialization, the electronic device may apply power to at least a portion of the camera system. For the initialization, the electronic device may communicate or store at least one of a program for operation of at least a portion of the camera system or configuration information of the camera system to at least a portion of the camera system. At least a part of the camera system may be changed to a state in which the camera system is operable after the program is executed.

In one embodiment, for the initialization, the electronic device sends a program (e.g., firmware) for operation of at least a portion of the camera system to the internal memory (s) (e.g., first memory 216, The second memory 226 and / or the third memory 236). For the initialization, the electronic device may communicate settings of at least a portion of the camera system to at least a portion of the camera system, or may store the camera system's internal memory (s). The program may be configured to apply the settings to at least a portion of the camera system, or to perform generation or correction of image / image association data according to the settings.

In one embodiment, the setting information or the setting values of the camera system include an ISO (International Standardization Organization) setting value, a WB (White Balance) / AWB setting value, a frame rate, A preview resolution setting, a preview format setting value, an automatic exposure (AE) setting value, an autofocus (AF) setting value, a noise reduction setting value, resizing, / Scaling setting value, Color Space Conversion (CSC) setting value, Gamma Correction setting value, PAF setting value, HDRI setting value, and the image processing apparatus processes the image inputted from the camera module And allocation information of a partial area of the memory in order to perform the operation.

In one embodiment, for the initialization, the electronic device may forward a message containing a plurality of settings of at least a portion of the camera system to at least a portion of the camera system, or may store the message in the internal memory (s) of the camera system have. For example, the electronic device may forward one message (or data frame) containing a plurality of settings (or all of the settings) for the camera module to the camera module or store it in an internal memory of the camera module . For example, the electronic device may send one message (or data frame) containing a plurality of setting values (or all setting values) for the image processing apparatus to the image processing apparatus, Can be stored. For example, the electronic device may send one message (or data frame) containing a plurality of settings (or all settings) for the first image signal processor and / or the second image signal processor to the first image signal Or may be stored in the internal memory of the first image signal processor. For example, the electronic device may forward one message (or data frame) containing a plurality of settings (or all settings) for the second image signal processor to the second image signal processor, Can be stored in the internal memory of the signal processor.

In one embodiment, for initialization, without input from an external device, at least a portion of the camera system may obtain settings stored in the internal memory (s) of at least a portion of the camera system. For example, a program for operation of at least a part of the camera system may be configured to automatically acquire the settings stored in a predetermined area of the internal memory.

In one embodiment, for the initialization, the electronic device may transmit at least one of a program for operation of the camera module or setting information of the camera module to the camera module or store the camera module in the internal memory . For the initialization, the electronic device transmits at least one of a program for the operation of at least a part of the image processing apparatus or at least a part of the configuration information of the image processing apparatus to at least a part of the image processing apparatus, Lt; / RTI >

In one embodiment, for the initialization, the electronic device may transmit at least one of a program for operation of the camera module or setting information of the camera module to the camera module or store the camera module in the internal memory . For the initialization, the electronic device transfers at least one of a program for operation of the first image signal processor or setting information of the first image signal processor to the first image signal processor, Lt; / RTI > Wherein the electronic device is configured to transfer at least one of a program for operation of the second image signal processor or configuration information of the second image signal processor to the second image signal processor, Lt; / RTI >

In one embodiment, for initialization, the electronic device may store a program for operation of the camera module in an internal memory of the camera module. For the initialization, the electronic device may transmit the setting values of the camera module to the camera module or may store the setting values in an internal memory of the camera module. For the initialization, the electronic device may store a program for operation of at least a part of the image processing apparatus in an internal memory of at least a part of the image processing apparatus. For the initialization, the electronic device may transmit the setting values of at least a part of the image processing apparatus to at least a part of the image processing apparatus or store the setting values in the internal memory of the image processing apparatus.

In operation 520, upon completion of the initialization, the electronic device may operate the camera system in a sleep mode.

In one embodiment, the electronic device can automatically perform the initialization and operation of the camera system in the sleep mode, respectively.

In one embodiment, to operate the camera system in the sleep mode, the electronic device may provide the camera system with a second power less than a first power provided to the camera system in the normal mode. For example, the second power may comprise a minimum power for maintaining data stored in an internal memory of the camera system and a minimum power for signal input from an external device. For example, when the power is not applied to the sensing unit (e.g., the sensing unit 218) and / or the image processing unit (e.g., the first image processing unit 228 and the second image processing unit 238) . For example, in the normal mode, the camera system may be in a state capable of performing image capture and image processing, and in the sleep mode, the camera system performs at least one of image capture and image processing It can be in a state that can not be done.

In operation 530, the electronic device may switch (or wake-up) the camera system from the sleep mode to the normal mode.

In one embodiment, the transition to the normal mode may be performed if a predetermined second condition is met.

In one embodiment, the second condition is selected from the group consisting of: detecting a preset situation for the electronic device, executing a camera application, selecting a graphic element requiring operation of the camera system, or requesting operation of the camera system And reception of the second data.

In one embodiment, to transition the camera system from the sleep mode to the normal mode, the electronic device may provide the first power to the camera system.

In operation 540, the electronic device may display an image output from the camera system in the normal mode through the display of the electronic device.

In one embodiment, the image output from the camera system may be a live preview image.

6A to 6H are views for explaining a method of operating an electronic device according to various embodiments.

6A, a memory (e.g., memory 130) of the electronic device 601 (e.g., the electronic device 101) may store a camera application, a voice recognition application, and the like. The electronic device 601 displays a screen 610 (e.g., a home screen) containing executable icons mapped to applications such as a camera application, a voice recognition application, etc. on the display 606 (e.g., the display 160) Can be displayed.

For example, the electronic device 601 may detect an input of a user 611 that selects a camera icon 612. Prior to the input, the electronic device may perform the initialization necessary to operate the camera system (e.g., camera system 180) in the normal mode. When the initialization is completed, the electronic device can operate the camera system in the sleep mode. The electronic device 601 may switch the camera system from the sleep mode to the normal mode in response to the input. The electronic device 601 may execute the camera application in response to the input.

In one embodiment, the electronic device 601 is connected via the input / output interface (e.g., the input / output interface 150), the communication interface (e.g., the communication interface 170) It is possible to detect an input that requires the execution of the camera application. The input may be one of various types of information input into the electronic device 601 such as the user's gesture, voice, and bio-signal.

6A, a camera application screen 620 (or a camera application window) may be displayed on the display 606 of the electronic device 601 as the camera application is executed. The camera application screen 620 displays a first menu bar 630 including a configuration menu and the like, a second menu bar 650 including a photographing button 652, and a live preview image 640 . For example, the live preview image 640 may include the appearance of a child as a subject. The electronic device 601 controls the camera system to output a live preview image 640 (e.g., a real time video) having a relatively low resolution (or a small number of pixels) and / or a small size as the camera application is executed can do. The live preview image 640 is not permanently stored in the memory and the live preview image 640 may be temporarily stored for display or the like on the display 606 and then automatically deleted.

In one embodiment, the electronic device 601 can detect the selection of the photographing button 652 by the user (or input of the photographing instruction). The electronic device 601 may be configured to output a relatively high resolution (or a large number of pixels) and / or a large size image (e.g., still image, video) in response to the selection of the shooting button 652, Can be controlled. The electronic device 601 may store the high resolution and / or large size image (or an image photographed according to user input) in the memory, or display it on the display 606 together. The photographed image according to the user input is permanently stored in the memory and can then be deleted according to user input.

6B, the electronic device 601 displays a screen 610 (e.g., a home screen) containing executable icons mapped to applications such as a camera application, a voice recognition application, (E.g., display 160).

In one embodiment, the electronic device 601 is in a state where the display 606 is powered off / on, or when the electronic device 601 enters a sleep mode (including power / screen off of the display 606) , And can detect the user's selection of any button or key included in the input / output interface (input / output interface 150).

In one embodiment, the electronic device 601 may select a user for an arbitrary button or key included in the input / output interface (input / output interface 150) on an arbitrary screen such as an application screen, a lock screen, Can be detected. For example, the button (s) may be formed on the front, side, or rear of the electronic device 601, and the button (s) may include a power button, a volume button Decrease button), a menu button, a home button / key 602, a return button, and a search button.

For example, the electronic device 601 may detect an input (e.g., double click, long click / press) of the user 611 selecting the home button (or home key) Prior to the input, the electronic device may perform the initialization necessary to operate the camera system (e.g., camera system 180) in the normal mode. When the initialization is completed, the electronic device can operate the camera system in the sleep mode. The electronic device 601 may switch the camera system from the sleep mode to the normal mode in response to the input. The electronic device 601 may execute the camera application (or an application associated with the camera system) in response to the input.

For example, the input of the user 611 may include a click that is a gesture that short or lightly presses or knocks the button, a double click that gestures a quick double or tapping of the button, a long press, a short press in which a button is short-pressed, and the like.

For example, the input of the user 611 may be a touch, a long touch, a tap, a double tap, a click, a double click, a flick, Drag & drop, swipe, multi swipes, pinches, shake, and so on), drag and drop (or touch and move), drag and drop, And at least one of rotation and rotation.

For example, the touch is a gesture for placing a user's input unit (e.g., a finger, pen, etc.) over the display 606 (or button) and the long touch (or touch & (Or button) is a gesture that taps the display 606 (or a button), the tab is a gesture that taps the display 606 (or button) briefly and the double tap A flick is a gesture (e.g., a scroll) that is quickly moved and released by placing a user input unit on the display 606 and a drag is a gesture (e.g., a scroll) (E.g., a button, an icon, a menu item, a menu item), and the drag and drop is a gesture for moving the graphic element while touching the display 606 and then releasing the display 606 My And a swipe is a gesture that moves the user input unit over the display 606 (or the button) a certain distance while touching at least two user input units on the display 606 And a pinch is a gesture that moves at least two user input units in different directions while touched on the display 606. FIG.

6B, the camera application screen 620 (or the camera application window) may be displayed on the display 606 of the electronic device 601 as the camera application is executed. The camera application screen 620 displays a first menu bar 630 including a configuration menu and the like, a second menu bar 650 including a photographing button 652, and a live preview image 640 . For example, the live preview image 640 may include the appearance of a child as a subject. The electronic device 601 controls the camera system to output a live preview image 640 (e.g., a real time video) having a relatively low resolution (or a small number of pixels) and / or a small size as the camera application is executed can do. The live preview image 640 is not permanently stored in the memory and the live preview image 640 may be temporarily stored for display or the like on the display 606 and then automatically deleted.

In one embodiment, the electronic device 601 can detect the selection of the photographing button 652 by the user (or input of the photographing instruction). The electronic device 601 may be configured to output a relatively high resolution (or a large number of pixels) and / or a large size image (e.g., still image, video) in response to the selection of the shooting button 652, Can be controlled. The electronic device 601 may store the high resolution and / or large size image (or an image photographed according to user input) in the memory, or display it on the display 606 together. The photographed image according to the user input is permanently stored in the memory and can then be deleted according to user input.

In one embodiment, the electronic device 601 includes a user 611 (not shown) for selecting a home button (or home key) 602, without additional selection of the photographing button 652 by the user , The photographing of the subject can be started.

6C, the electronic device 601 displays a screen 610 (e.g., a home screen) containing executable icons mapped to applications such as a camera application, a voice recognition application, (E.g., display 160).

In one embodiment, the electronic device 601 is in a state where the display 606 is powered off / on, or when the electronic device 601 enters a sleep mode (including power / screen off of the display 606) , And can detect the user's selection of any button or key included in the input / output interface (input / output interface 150).

In one embodiment, the electronic device 601 may select a user for an arbitrary button or key included in the input / output interface (input / output interface 150) on an arbitrary screen such as an application screen, a lock screen, Can be detected. For example, the button (s) may be formed on the front, side, or rear of the electronic device 601, and the button (s) may include a power button, a volume button Decrease button), a menu button, a home button / key 602, a return button, and a search button.

For example, the electronic device 601 may detect an input (e.g., double click, long click / press) of the user 611 selecting the home button (or home key) Prior to the input, the electronic device may perform the initialization necessary to operate the camera system (e.g., camera system 180) in the normal mode. When the initialization is completed, the electronic device can operate the camera system in the sleep mode. The electronic device 601 may switch the camera system from the sleep mode to the normal mode in response to the input. The electronic device 601 may execute the camera application (or an application associated with the camera system) in response to the input.

6B, a camera application screen 620 (or a camera application window) including a live preview image 641 is displayed on the display 606 of the electronic device 601 as the camera application is executed, Can be displayed.

The electronic device 601 selects the home button (or home key) 602 shown in FIG. 6C (a) without further selection of the photographing button 652 by the user In response to the input of the user 611 performing the photographing operation.

6C, the electronic device 601 is automatically activated in response to the input of the user 611 selecting the home button (or home key) 602 shown in FIG. 6C (a) The photographed image 642 can be displayed on a partial area of the second menu bar 650. [

6D, the electronic device 601 displays a screen 610 (e.g., a home screen) containing executable icons mapped to applications such as a camera application, a speech recognition application, (E.g., display 160).

In one embodiment, the electronic device 601 is in a state where the display 606 is powered off / on, or when the electronic device 601 enters a sleep mode (including power / screen off of the display 606) , And can detect the user's selection of any button or key included in the input / output interface (input / output interface 150).

In one embodiment, the electronic device 601 may select a user for an arbitrary button or key included in the input / output interface (input / output interface 150) on an arbitrary screen such as an application screen, a lock screen, Can be detected. For example, the button (s) may be formed on the front, side, or rear of the electronic device 601, and the button (s) may include a power button, a volume button Decrease button), a menu button, a home button / key 602, a return button, and a search button.

For example, the electronic device 601 may detect an input (e.g., double click, long click / press) of the user 611 selecting the home button (or home key) Prior to the input, the electronic device may perform the initialization necessary to operate the camera system (e.g., camera system 180) in the normal mode. When the initialization is completed, the electronic device can operate the camera system in the sleep mode. The electronic device 601 may switch the camera system from the sleep mode to the normal mode in response to the input. The electronic device 601 may execute the camera application (or an application associated with the camera system) in response to the input.

6B, a camera application screen 602 (or a camera application window) including a live preview image 641 is displayed on the display 606 of the electronic device 601 as the camera application is executed, Can be displayed.

The electronic device 601 is capable of automatically capturing an autofocus (AF) 660 and a subject automatically as the input of the user 611 selecting the home button (or home key) .

6D, the electronic device 601 includes a user 611 for selecting the home button (or home key) 602 shown in (a) and / or (b) The image 642 automatically photographed in response to the input may be displayed on a partial area of the second menu bar 650. [

6E, the electronic device 601 may automatically execute the camera application in response to the input of the user 611 selecting the home button (or home key) The electronic device 601 may display a camera application screen 602 (or camera application window) that includes a live preview image 641 on the display 606.

The electronic device 601 can automatically initiate an autofocus (AF) 660 as the input of the user 611 selecting the home button (or home key) have.

6E, the electronic device 601 may be configured such that the input of the user 611 selecting the home button (or home key) 602 is continuously maintained, autofocus: AF) 661 can be automatically started. The change of the autofocus target can be repeatedly performed until the input of the user 611 is stopped and the autofocus target is fixed and the shooting of the subject can be automatically started when the input of the user 611 is interrupted.

6E, the electronic device 601 includes a user 611 selecting a home button (or a home key) 602 shown in FIG. 6E and / or FIG. 6B The image 642 automatically photographed in response to the input may be displayed on a partial area of the second menu bar 650. [

6F, the electronic device 601 displays a screen 610 (e.g., a home screen) containing executable icons mapped to applications such as a camera application, a voice recognition application, (E.g., display 160).

In one embodiment, the electronic device 601 is in a state where the display 606 is powered off / on, or when the electronic device 601 enters a sleep mode (including power / screen off of the display 606) , And can detect the user's selection of any button or key included in the input / output interface (input / output interface 150).

In one embodiment, the electronic device 601 may select a user for an arbitrary button or key included in the input / output interface (input / output interface 150) on an arbitrary screen such as an application screen, a lock screen, Can be detected. For example, the button (s) may be formed on the front, side, or rear of the electronic device 601, and the button (s) may include a power button, a volume button Decrease button), a menu button, a home button / key 602, a return button, and a search button.

For example, the electronic device 601 may detect an input (e.g., double click, long click / press) of the user 611 selecting the home button (or home key) Prior to the input, the electronic device may perform the initialization necessary to operate the camera system (e.g., camera system 180) in the normal mode. When the initialization is completed, the electronic device can operate the camera system in the sleep mode. The electronic device 601 may switch the camera system from the sleep mode to the normal mode in response to the input. The electronic device 601 may execute the camera application (or an application associated with the camera system) in response to the input.

6F, the electronic device 601 is automatically activated in response to the input of the user 611 selecting the home button (or home key) 602 shown in FIG. 6F (a) The photographing of the subject can be started. The electronic device 601 may automatically display a camera application screen 620 (or a camera application window) including a live preview image 641 on the display 606 after automatically taking an image of a subject. The electronic device 601 displays an automatically photographed image 642 in a portion of the second menu bar 650 in response to an input of the user 611 selecting the home button (or home key) can do.

6A, the electronic device 601 displays a screen 610 (e.g., a home screen) containing executable icons mapped to applications such as a camera application, a voice recognition application, (E.g., display 160).

In one embodiment, the electronic device 601 is in a state in which the display 606 is screened off or the display 606 is in a state in which the electronic device 601 enters a sleep mode (including screen off of the display 606) ) Of the user. For example, in a screen off state, a touch panel (e.g., touch panel 2652 in Fig. 26) of the display 606 may be in a power-on state.

In one embodiment, the electronic device 601 may detect a user's selection of the display 606 on any screen, such as an application screen, a lock screen, a home screen, and the like. For example, the electronic device 601 may be a user who long touches a predetermined area (e.g., an empty area within the screen 610 where the graphic elements are not displayed, an edge area within the screen 610) Can be detected.

Prior to the input, the electronic device may perform the initialization necessary to operate the camera system (e.g., camera system 180) in the normal mode. When the initialization is completed, the electronic device can operate the camera system in the sleep mode. The electronic device 601 may switch the camera system from the sleep mode to the normal mode in response to the input. The electronic device 601 may execute the camera application (or an application associated with the camera system) in response to the input.

Referring to FIG. 6 (b), the electronic device 601 can automatically start photographing the subject in response to the input of the user 611 shown in FIG. 6 (a). The electronic device 601 may automatically display a camera application screen 620 (or a camera application window) including a live preview image 641 on the display 606 after automatically taking an image of a subject. The electronic device 601 may display an automatically captured image 642 in a portion of the second menu bar 650 in response to an input of the user 611. [

6H, the electronic device 601 displays a screen 610 (e.g., a home screen) containing executable icons mapped to applications such as a camera application, a voice recognition application, (E.g., display 160).

In one embodiment, the electronic device 601 is in a state where the display 606 is powered off / on, or when the electronic device 601 enters a sleep mode (including power / screen off of the display 606) , And can detect the user's selection of any button or key included in the input / output interface (input / output interface 150).

In one embodiment, the electronic device 601 may select a user for an arbitrary button or key included in the input / output interface (input / output interface 150) on an arbitrary screen such as an application screen, a lock screen, Can be detected. For example, the button (s) may be formed on the front, side, or rear of the electronic device 601, and the button (s) may include a power button, a volume button Decrease button), a menu button, a home button / key 602, a return button, and a search button.

For example, the electronic device 601 may detect an input (e.g., double click, long click / press) of the user 611 selecting the home button (or home key) Prior to the input, the electronic device may perform the initialization necessary to operate the camera system (e.g., camera system 180) in the normal mode. When the initialization is completed, the electronic device can operate the camera system in the sleep mode. The electronic device 601 may switch the camera system from the sleep mode to the normal mode in response to the input. The electronic device 601 may execute the camera application (or an application associated with the camera system) in response to the input.

6 (h), the electronic device 601 is automatically activated in response to the input of the user 611 selecting the home button (or home key) 602 shown in FIG. 6 (a) The photographing of the subject can be started.

In one embodiment, the electronic device 601 may not display anything on the screen after automatically taking an image of the subject.

In one embodiment, the electronic device 601 may be configured to display an image of a subject after the subject has been automatically photographed, or may correspond to an image of the photographed subject or correspond to an application to display an image of the photographed subject Graphic elements or indicators 670 (e.g., icons, images, text) on the screen 610.

For example, when the user selects the indicator 670, the electronic device 601 may display on the display 606 an application for displaying an image of the photographed subject, an image of the photographed subject.

6 (h), the electronic device 601 is automatically activated in response to the input of the user 611 selecting the home button (or home key) 602 shown in FIG. 6 (a) The photographing of the subject can be started.

In one embodiment, the electronic device 601 may display an image 671 of a photographed subject on the screen 610 after automatically taking an image of the subject. For example, the electronic device 601 may display an image 671 of the photographed subject on the screen 610 in a transparent manner. For example, when the user selects the indicator 670, the electronic device 601 displays an application that displays an image of the photographed subject on the display 606 or stores it in a memory (e.g., memory 130) .

7 is a flow chart illustrating a method of operation of an electronic device according to various embodiments. The method of operating the electronic device may include operations 710-750. The method of operation of the electronic device may be performed by an electronic device (e.g., electronic device 101), a processor of the electronic device (e.g., processor 120), or a camera control module (e.g., camera control module 190) .

In operation 710, the electronic device may be powered on or automatically powered on after user input. For example, the electronic device may apply power to internal components.

720 operation, the electronic device automatically initiates a boot process for device probing (or power-on self-test (POST)), loading of the operating system .

In operation 730, the electronic device may be a device probing operation, such as a camera system (e.g., camera system 180), a sensor portion (e.g., sensor portion 175), or any subsequent operating system (For example, until the home screen is displayed on the display (e.g., display 160) for the first time) in order to operate the camera system in the normal mode.

In operation 740, upon completion of the initialization, the electronic device may operate the camera system in a sleep mode.

In operation 750, when the boot process is completed, the electronic device may display a home screen on the display.

8 is a diagram for explaining a method of operating an electronic device according to various embodiments.

8A, the electronic device 801 (e.g., the electronic device 101) may be powered off and then powered on or automatically powered on by the user's input, Test), loading the operating system, and so on. The electronic device 801 may display a preset image (e.g., still image, moving image, animation) on the display 806 (e.g., the display 160) during the booting process. The electronic device 801 may perform the initialization necessary to operate the camera system in the normal mode during the boot process. When the initialization is completed, the electronic device 801 can operate the camera system in the sleep mode.

Referring to FIG. 8B, the electronic device 801 may display the home screen 820 on the display 806 when the booting process is completed.

The home screen 820 includes a status bar 822 for displaying an application update, an execution state of a local communication module, a received signal strength, a time, etc., an icon for displaying a list of all applications, A desktop 824 for displaying icons of individual applications, a menu 826 including a search icon or a home icon, and the like.

9 is a flow chart illustrating a method of operating an electronic device according to various embodiments. The method of operation of the electronic device may include operations 910-960. The method of operation of the electronic device may be performed by an electronic device (e.g., electronic device 101), a processor of the electronic device (e.g., processor 120), or a camera control module (e.g., camera control module 190) .

In operation 910, the electronic device may display / power off a display (e.g., display 160) if a predetermined third condition is met. The preset third condition includes a predetermined first time arrival or elapse without generating a new event from the last event (e.g., user input, message / call reception / transmission from external device, etc.) processed by the processor .

In operation 920, the electronic device may operate the electronic device or the processor in a sleep mode if a preset fourth condition is met. The preset fourth condition is a predetermined second time arrival or elapse of a predetermined second time without occurrence of a new event from the last event (e.g., user input, message / call reception / transmission, program operation, etc.) Or an arrival or elapse of a preset third time from when the display is turned on / off. The second time may be greater than the first time.

In one embodiment, in order to operate the electronic device in the sleep mode, the electronic device provides a fourth power to the components of the electronic device that is less than a third power provided to the electronic device in the normal mode . For example, the third power may comprise a minimum power for maintaining data stored in memory (e.g., memory 130), a minimum power for receiving user input via input / output interface 150, and a communication interface 170 Lt; RTI ID = 0.0 > a < / RTI > signal from an external device. For example, the sensor portion (e.g., sensor portion 218) and / or the display may be powered or minimally powered. For example, the processor may be powered or minimally powered. For example, in the normal mode, the electronic device may be in a state capable of performing processing of an event (e.g., user input, reception / transmission of a message / call from an external device, program operation, etc.) The electronic device may be in a state unable to process the event.

In one embodiment, to transition the electronic device from the sleep mode to the normal mode, the electronic device may provide the fourth power to the components of the electronic device.

In operation 930, the electronic device may detect events that require wake up (e.g., user input, reception / transmission of messages / calls from external devices, arrival of alarm times, etc.).

In operation 940, in response to detecting the event, the electronic device may display / power on the display. Prior to screen / power-on of the display, the electronic device may apply power to the processor such that the processor can operate in the normal mode.

In one embodiment, after the display is powered on, the lock mode of the electronic device may be released by the user.

In operation 950, depending on the screen / power-on of the display, the electronic device may perform the initialization necessary to operate the camera system (e.g., camera system 180) in the normal mode.

In one embodiment, as the display / power on of the display is turned off and the lock mode is released, the electronic device can perform the initialization necessary to operate the camera system in the normal mode.

In operation 960, upon completion of the initialization, the electronic device may operate the camera system in a sleep mode.

10 is a diagram for explaining a method of operating an electronic device according to various embodiments.

10A, the electronic device 1001 (e.g., the electronic device 101) may display / power off the display 1006 (e.g., the display 160). The display 1006, The electronic device 1001 transmits the electronic device 1001 or the processor (for example, the processor 120) to the sleep mode < RTI ID = 0.0 >Lt; / RTI >

10B, when an event requiring a wake-up (e.g., user input, reception / transmission of a message / call from an external device, arrival of an alarm time, etc.) is detected or occurred, The display unit 1001 may display / power on the display. Prior to screen / power on of the display 1006, the electronic device 1001 may apply power to the processor such that the processor can operate in a normal mode.

In one embodiment, a lock screen 1010 may be displayed on the display 1006 as the display is screen / powered on.

The lock screen 1010 may include a background screen 1012 (or a background image) and an input device for releasing the lock mode (e.g., a password input device, a pattern input device, and the like). The input device 1014 may be displayed over the background screen 1012 in the form of a transparent layer. The user can release the lock mode / lock screen 1010 by performing a swipe / drag of a preset pattern on the input device 1014. [

10C, when the lock screen 610 is released, a screen 1020 (e.g., a home screen or an application screen) immediately before the lock mode is executed can be displayed on the display 1006 have.

11 is a flow chart illustrating a method of operating an electronic device according to various embodiments. The method of operation of the electronic device may include operations 1110-1150. The method of operation of the electronic device may be performed by an electronic device (e.g., electronic device 101), a processor of the electronic device (e.g., processor 120), or a camera control module (e.g., camera control module 190) .

In operation 1110, the electronic device may display (e.g., display 160) a first screen that includes a first graphical element (e.g., image, text, icon, menu, etc.) associated with the first application .

In operation 1120, the electronic device may detect a user input (e.g., touch, hovering, voice command, etc.) that selects the first graphical element.

In operation 1130, in response to the user input, the electronic device includes a second graphical element (e.g., image, text, icon, menu, etc.) that requires operation of a camera system Can be displayed on the display (e.g., display 160).

In operation 1140, in response to the display of the second graphic element, the electronic device may perform the initialization necessary to operate the camera system (e.g., camera system 180) in the normal mode.

In operation 1150, upon completion of the initialization, the electronic device may operate the camera system in a sleep mode.

12 is a diagram for explaining a method of operating an electronic device according to various embodiments.

12A, an electronic device 1201 (e.g., electronic device 101) may be coupled to a display 1206 (e.g., display 160) (E.g., a home screen) that includes a first graphical element 1212 (e.g., an icon mapped to a gallery application) associated with an application (e.g., an application).

12B, when the user selects the first graphical element 1212, the electronic device 1201 receives a second graphic element 1212 that requires operation of a camera system (e.g., camera system 180) A display 1220 (e.g., a screen of a gallery application) that includes a graphical element 1222 (e.g., an icon mapped to a camera application) may be displayed on the display (e.g., display 160). In response to the display of the second graphical element 1222, the electronic device 1201 may perform the initialization necessary to operate the camera system (e.g., the camera system 180) in the normal mode. When the initialization is completed, the electronic device can operate the camera system in the sleep mode.

Referring to FIG. 12C, when the user selects the second graphic element 1222, the electronic device 1201 can execute a camera application.

13 is a flow chart illustrating a method of operation of an electronic device according to various embodiments. The method of operation of the electronic device may include operations 1310-1340. The method of operation of the electronic device may be performed by an electronic device (e.g., electronic device 101), a processor of the electronic device (e.g., processor 120), or a camera control module (e.g., camera control module 190) .

In operation 1310, the electronic device displays a screen (e.g., a display (e.g., a display) containing graphic elements (e.g., images, text, icons, menus, etc.) 160). ≪ / RTI >

In operation 1320, the electronic device may detect a user's access to the graphical element via the display.

In one embodiment, the electronic device is capable of detecting a hovering input on the display. The electronic device detects when the position of the hovering input is included in the display area of the graphic element, the position of the hovering input is adjacent to the display area of the graphic element, or when the hovering input moves toward the graphic element can do.

In operation 1330, in response to detecting the user access, the electronic device may perform the initialization necessary to operate the camera system in the normal mode.

In operation 1340, once the initialization is complete, the electronic device may operate the camera system in a sleep mode.

14 and 15 are diagrams for explaining a method of operating an electronic device according to various embodiments.

14, when a user is within a first threshold distance h in a state of being away from the surface of the display 1406 (e.g., the display 160) of the electronic device 1401 (e.g., the electronic device 101) The display 1406 can detect the hovering input of the input unit 1410 when the input unit 1410 (part of the body such as a pen or a finger) is positioned. The display 1406 may provide information (e.g., the location, intensity, distance, etc.) of the hovering input to a processor (e.g., processor 120) or a camera control module )).

15 (a), the electronic device 1401 includes a graphical element 1512 (e.g., an icon) that requires the operation of a camera system (e.g., camera system 180) Can be displayed. The location 1502 of the hovering input may be included in the display area of the graphical element 1512 when the input unit 1500 is located above the graphical element 1512 vertically. If the location 1502 of the hovering input is included in the display area of the graphical element 1512, the electronic device may determine that the user has access to the graphical element.

Referring to Figure 15 (b), the location 1523 of the hovering input 1522 may be located adjacent to the display area of the graphical element 1514 that requires operation of the camera system. The electronic device 1401 can determine whether the distance between the graphical element 1514 (or the center of the graphical element 1514) and the location 1523 of the hovering input 1522 is within a predetermined threshold distance have. If the distance between the graphic element 1514 and the location 1523 of the hovering input 1522 is within the critical distance, the electronic device may determine that the user has accessed the graphic element.

15C, the position of the hovering inputs 1524 and 1526 can be moved 1530 and the electronic device can track the trajectory of movement of the hovering inputs 1524 and 1526. [ If the movement 1530 of the hovering input 1524,1526 is directed to a graphical element 1516 that requires operation of the camera system, the electronic device may determine that the user has accessed the graphical element 1516 .

16 is a flowchart showing an operation method of an electronic device according to various embodiments. The method of operation of the electronic device may include 1610 to 1640 operations. The method of operation of the electronic device may be performed by an electronic device (e.g., electronic device 101), a processor of the electronic device (e.g., processor 120), or a camera control module (e.g., camera control module 190) .

In operation 1610, the electronic device may detect a situation associated with the electronic device that matches a predetermined context.

In one embodiment, the preset situation for the electronic device is such that, when the electronic device has been located or reached a preset area / location, when the electronic device has reached a preset time, (E.g., execution of the application (s), etc.) or the current state of the electronic device (e.g. battery state, radio signal reception state, memory state, etc.) have. For example, the electronic device can execute a gallery application, a social application for real-time message communication with an external device, etc. according to user input.

In one embodiment, a predetermined situation for the electronic device may be determined based on usage history information of the electronic device (e.g., history of the electronic device operating in the sleep mode at a specific place, etc.).

In operation 1620, the electronic device may retrieve information associated with the situation from a database stored in a memory (e.g., memory 130) of the electronic device. For example, the electronic device may register / store the user's usage history information associated with the camera system (e.g., camera system 180) in the database. For example, when the user executes an application (e.g., a camera application) that requires the operation of the camera system after executing the gallery application, the electronic device executes the execution of the gallery application for the preset situation And can be registered / stored in the database as information.

In operation 1630, if information associated with the situation is retrieved from the database, the electronic device may perform the initialization necessary to operate the camera system in a normal mode.

In operation 1640, upon completion of the initialization, the electronic device may operate the camera system in a sleep mode.

17 is a flow chart illustrating a method of operating an electronic device according to various embodiments. The method of operating the electronic device may include 1710-1740 operations. The method of operation of the electronic device may be performed by an electronic device (e.g., electronic device 101), a processor of the electronic device (e.g., processor 120), or a camera control module (e.g., camera control module 190) .

In operation 1710, the electronic device communicates with the user via the communication interface (e.g., communication interface 170), input / output interface (e.g., input / output interface 150), display (e.g., display 160) You can receive speech (for example, voice input via a microphone) or text (for example, messages created through the display). For example, the electronic device may receive a text message from an external device, receive a message from a user to be transmitted to an external device via a social application, receive a message from an external device via a social application, Or receive voice from an external device during a telephone call.

In operation 1720, the electronic device may retrieve information associated with the voice / text in a database stored in a memory (e.g., memory 130) of the electronic device. For example, the electronic device may register / store voice / text associated with a camera system (e.g., camera system 180) in the database. For example, the registered / stored voice / text may be a photo, a camera, a video, a video call, a self camera, and the like.

In operation 1730, if information associated with the voice / text is retrieved from the database, the electronic device may perform the initialization necessary to operate the camera system in the normal mode.

In operation 1740, upon completion of the initialization, the electronic device may operate the camera system in a sleep mode.

18 is a flow chart illustrating a method of operation of an electronic device according to various embodiments.

In operation 1810, an application 1801 (e.g., a camera application) sends a command (e.g., openCamera ()) to the camera system 1802 for initialization / operation of the camera system 1802 .

In operation 1820, the application 1801 may pass commands (e.g., setParameter ()) and settings to the camera system 1802 for setting the camera system.

In one embodiment, the camera system set values include at least one of an International Standardization Organization (ISO) set value, a WB (White Balance) / AWB set value, a frame rate, a capture resolution, resolution, preview format settings, automatic exposure (AE) settings, autofocus (AF) settings, noise reduction settings, resizing / scaling a color space conversion (CSC) setting value, a gamma correction setting value, a PAF setting value, an HDRI setting value, an image input from the camera module, Allocation information of a partial area of a memory (e.g., memory 130) for processing, and the like.

In one embodiment, the application 1801 may forward one message to the camera system 1802, which includes a plurality of settings for the camera system 1802. For example, the application 1801 can forward one message (or data frame) containing a plurality of setting values (or all setting values) for the camera module of the camera system 1802 to the camera module . For example, the application 1801 may forward one message (or data frame) containing a plurality of settings (or all settings) for the image processing apparatus to the image processing apparatus of the camera system 1802 have. For example, the application 1801 may include one message (or message) containing a plurality of settings (or all settings) for the first image signal processor and / or the second image signal processor of the camera system 1802 Data frame) to the first image signal processor. For example, the application 1801 may forward one message (or data frame) containing a plurality of settings (or all settings) for the second image signal processor to the second image signal processor.

In operation 1830, the application 1801 may pass a command (e.g., startPreview ()) to the camera system 1802 for outputting a live preview image.

19 is a flow chart illustrating a method of operating an electronic device according to various embodiments.

In operation 1910, an application 1901 (e.g., camera application) sends a command (e.g., openCamera ()) to the camera system 1902 for initialization / operation of the camera system 1902 (e.g., camera system 180) .

In operation 1920, in response to the command for initialization / operation, the camera system 1902 may obtain the settings stored in the internal memory (s).

In operation 1930, the application 1901 may pass a command (e.g., startPreview ()) to the camera system 1902 for outputting a live preview image.

20 illustrates a camera system in accordance with various embodiments. The camera system 180a of the electronic device (e.g. electronic device 101) differs only in that it has a similar configuration to the camera system 180 shown in Figure 2 and further includes a second camera module 210a , And redundant description will be omitted.

The camera system 180a may include at least one of a first camera module 210, a second camera module 210a, and an image processing device 202a.

The first camera module 210 may be disposed on the front surface of the electronic device, and may output an image of a subject positioned in front of the electronic device. The second camera module 210a may be disposed on the rear surface of the electronic device and may output an image of a subject located behind the electronic device.

Each of the camera modules 210 and 210a can capture a subject and output an image of the photographed subject and can include a lens system 211 and 211a and an image sensor 212 and 212a.

Each of the lens systems 211 and 211a can form an image of a subject by converging the light inputted from the outside. Each of the lens systems 211 and 211a may include at least one lens, and each lens may be a convex lens, an aspherical lens, or the like.

Each of the image sensors 212 and 212a can detect an optical image formed by the corresponding lens system 211 or 211a as a digital image.

Each of the image sensors 212 and 212a may include input / output units 214 and 214a (or input / output circuits), memories 216 and 216a, and sensing units 218 and 218a (or a sensing circuit).

Each of the input and output units 214 and 214a can function as an interface for inputting and / or outputting signals / data to / from an external device (e.g., the processor 120 and the image processing apparatus 202a). Each of the input / output units 214 and 214a can transmit the signal / data input from the external device to the corresponding memory 216 or 216a or the corresponding sensing unit 218 or 218a. Each of the input / output units 214 and 214a can transmit signals / data input from the corresponding memories 216 and 216a or corresponding sensing units 218 and 218a to the external device.

Each of the memories 216 and 216a includes a program (e.g., firmware) for operating the corresponding camera modules 210 and 210a, setting information (e.g., a plurality of set values) of the camera modules 210 and 210a, An image detected by the sensors 218 and 218a, and the like.

Each of the sensing units 218 and 218a can detect an optical image formed by the lens system 211 or 211a as a digital image.

In one embodiment, each of the sensing units 218 and 218a may include a controller for controlling the overall operation of the corresponding camera module 210, 210a and / or the corresponding image sensor 212, 212a.

The image processing apparatus 202a may process at least one image output from the first camera module 210 and / or the second camera module 210a. The image processing apparatus 202a may include a first image signal processor 220a and a second image signal processor 230a.

The first image signal processor 220a may process the image output from the first camera module 210. [ The second image signal processor 230a may process the image output from the second camera module 210a.

Each image signal processor 220a and 230a may include input / output units 224a and 234a (or input / output circuits), memories 226a and 236a, and image processing units 228a and 238a (or an image processing circuit).

Each of the input / output units 224a and 234a can function as an interface for inputting and / or outputting signals / data to / from an external device (e.g., the processor 120, the camera module 210, and the display 160). Each of the input / output units 224a and 234a may transmit the signal / data input from the external apparatus to the corresponding memories 226a and 236a or the corresponding image processing units 228a and 238a. Each of the input / output units 224a and 234a can transmit signals / data input from the memories 226a and 236a or the image processing units 228a and 238a to the external device.

Each memory 226a and 236a stores a program (e.g., firmware) for operating the image signal processors 220a and 230a, setting information (e.g., a plurality of setting values) of the image signal processors 220a and 230a, An image to be processed or processed by the image signal processors 220a and 230a, image processing information processed by the image signal processors 220a and 230a, and the like.

Each of the image processing units 228a and 238a may perform a first process on the image output from the corresponding camera module 210 or 210a. Each of the image processing units 228a and 238a may process an image input from the corresponding camera module 210 or 210a in units of frames according to the control of the processor 120. [ Each of the image processing units 228a and 238a may output the converted image in accordance with the screen characteristics (size, image quality, resolution, etc.) of the display 160. [

21 is a flow chart illustrating a method of operating an electronic device according to various embodiments. The method of operation of the electronic device may include 2110 to 2150 operations. The method of operation of the electronic device may be performed by an electronic device (e.g., electronic device 101), a processor of the electronic device (e.g., processor 120), or a camera control module (e.g., camera control module 190) .

In operation 2110, the electronic device may perform the initialization necessary to operate the camera system (e.g., camera system 180a) in normal mode.

In one embodiment, the electronic device may perform the initialization in response to an input. The input may include at least one of execution of a camera application, selection of a graphic element that requires operation of the camera system, or reception of an instruction to request operation of the camera system.

In one embodiment, the electronic device can perform the initialization if a predetermined first condition is satisfied.

In one embodiment, the predetermined first condition is selected from the group consisting of the booting of the electronic device, the switching of the electronic device from the sleep mode to the normal mode, the switching of the display (e.g., display 160) (E.g., buttons, icons, menus, menu items) that require the operation of the camera system, a graphical element that requires the operation of the camera system A user's access to the camera system, a user's access to a graphical element that requires operation of the camera system, detection of a situation associated with the electronic device consistent with a predetermined context, , Or detection of at least one word that matches at least one preset word.

In one embodiment, the preset situation for the electronic device is such that, when the electronic device has been located or reached a preset area / location, when the electronic device has reached a preset time, (E.g., execution of the application (s), etc.) or the current state of the electronic device (e.g. battery state, radio signal reception state, memory state, etc.) have.

In one embodiment, a predetermined situation for the electronic device may be determined based on usage history information of the electronic device (e.g., history of the electronic device operating in the sleep mode at a specific place, etc.).

In one embodiment, the initialization may include storing a program for operation of the camera system in an internal memory of the camera system and communicating the camera system set values to the camera system.

In one embodiment, the camera system comprises: a first camera module (e.g., a first camera module 210) for outputting a first image of a first subject located in front of the electronic device; (E.g., a second camera module 210a) for outputting a second image of a second subject located at the first image and / or an image processing apparatus (E.g., an image processing device 202a).

In one embodiment, the image processing apparatus includes a first image signal processor (e.g., a first image signal processor 220a) that performs a first process on the first image and a second image signal processor (E.g., a second image signal processor 230a) that performs a second image signal processor (e.g.

In operation 2120, when the initialization is completed, the electronic device can simultaneously operate the first camera module and the second camera module in a normal mode. For example, the first camera module may output a first image of a first subject positioned in front of the electronic device, and the second camera module may output a second image of a second subject located behind the electronic device, Can be output.

In one embodiment, the first image signal processor may perform a first process on the first image output from the first camera module. The second image signal processor may perform a second process on the second image output from the second camera module.

In operation 2130, the electronic device may display one of the first image and the second image on a display (e.g., display 160).

In one embodiment, the electronic device controls one of the first image signal processor and the second image signal processor to process an image input from the camera module and output it to the display, And the other of the second image signal processors processes the image input from the corresponding camera module, but does not output it to the display.

In one embodiment, the electronic device controls the first one of the first image signal processor and the second image signal processor to process and output an image input from the corresponding camera module to the display, The processor and the other one of the second image signal processors may control not to process the image input from the corresponding camera module.

In one embodiment, the electronic device is configured such that the one of the first image signal processor and the second image signal processor processes an image input from the corresponding camera module and outputs it to the display (i.e., ), And the other one of the first image signal processor and the second image signal processor is operable to operate in a sleep mode.

In 2140 operation, the electronic device may detect a user input requiring switching between the first image and the second image (or switching between the first camera module and the second camera module).

In operation 2150, the electronic device may display the other of the first image and the second image on the display.

In one embodiment, the electronic device controls the other of the first image signal processor and the second image signal processor to process and output an image input from the camera module to the display, The signal processor and the second image signal processor may control to process an image input from the corresponding camera module but not output to the display.

In one embodiment, the electronic device controls the other of the first image signal processor and the second image signal processor to process and output an image input from the camera module to the display, The signal processor and the second image signal processor may control not to process the image input from the corresponding camera module.

In one embodiment, the electronic device is configured to process the input image from the corresponding camera module and output it to the display (i. E., Operate in normal mode) And the one of the first image signal processor and the second image signal processor can be controlled to operate in a sleep mode.

22A to 22C are diagrams for explaining a method of operating an electronic device according to various embodiments.

Referring to FIG. 22A, in accordance with the initialization of the camera system 180a, the first camera module 210 and the second camera module 210a can be operated in the normal mode after being powered on, respectively. The first camera module 210 may output the first image to the first image signal processor 220a of the image processing apparatus 202a. The second camera module 210a may output the second image to the second image signal processor 230a of the image processing apparatus 202a. The first image signal processor 220a may perform a first process on the first image output from the first camera module 210. [ The second image signal processor 230a may perform a second process on the second image output from the second camera module 210a. The first image signal processor 220a outputs the first processed first image to a display 160 and the display 160 may display the first processed first image. The second image signal processor 230a may be controlled not to output the second processed second image to the display 160. [

In one embodiment, the second image signal processor 230a may not perform a second process on the second image.

In one embodiment, the second image signal processor 230a may operate in a sleep mode.

22B, the first camera module 210 is switched according to the switching between the first image and the second image (or switching between the first camera module 210 and the second camera module 210a) May output the first image to the first image signal processor 220a of the image processing apparatus 202a. The second camera module 210a may output the second image to the second image signal processor 230a of the image processing apparatus 202a. The first image signal processor 220a may perform a first process on the first image output from the first camera module 210. [ The second image signal processor 230a may perform a second process on the second image output from the second camera module 210a. The second image signal processor 230a outputs the second processed second image to the display 160 and the display 160 may display the second processed second image. The first image signal processor 220a may be controlled not to output the first processed first image to the display 160. [

In one embodiment, the first image signal processor 220a may not perform the first processing for the first image.

In one embodiment, the first image signal processor 220a may operate in a sleep mode. For example, in response to switching between the first image and the second image, the second image signal processor 230a switches from sleep mode to normal mode (i.e., wakes up) and the first image signal processor 220a can switch from the normal mode to the sleep mode.

Referring to FIG. 22C, in accordance with the initialization of the camera system 180b, the first camera module 210 and the second camera module 210a can be operated in a normal mode after being powered on, respectively. The first camera module 210 may output the first image to the image signal processor 220b of the image processing apparatus 202b. The second camera module 210a may output the second image to the image signal processor 220b of the image processing apparatus 202b. The image signal processor 220b may perform a first process on the first image output from the first camera module 210. [ The image signal processor 220b may perform a second process on the second image output from the second camera module 210a. The image signal processor 220b may output the first processed first image to the display 160 and the display 160 may display the first processed first image. The image signal processor 220b may be controlled not to output the second processed second image to the display 160. [

In one embodiment, the image signal processor 220b may not perform a second process on the second image.

23 is a flow chart illustrating a method of operating an electronic device according to various embodiments. The method of operation of the electronic device may include 2310 to 2360 operations. The method of operation of the electronic device may be performed by an electronic device (e.g., electronic device 101), a processor of the electronic device (e.g., processor 120), or a camera control module (e.g., camera control module 190) .

In operation 2310, the electronic device may perform the initialization necessary to operate the camera system (e.g., camera system 180a) in the normal mode.

In one embodiment, the electronic device may perform the initialization in response to an input. The input may include at least one of execution of a camera application, selection of a graphic element that requires operation of the camera system, or reception of an instruction to request operation of the camera system.

In one embodiment, the electronic device can perform the initialization if a predetermined first condition is satisfied.

In one embodiment, the predetermined first condition is selected from the group consisting of the booting of the electronic device, the switching of the electronic device from the sleep mode to the normal mode, the switching of the display (e.g., display 160) (E.g., buttons, icons, menus, menu items) that require the operation of the camera system, a graphical element that requires the operation of the camera system A user's access to the camera system, a user's access to a graphical element that requires operation of the camera system, detection of a situation associated with the electronic device consistent with a predetermined context, , Or detection of at least one word that matches at least one preset word.

In one embodiment, the preset situation for the electronic device is such that, when the electronic device has been located or reached a preset area / location, when the electronic device has reached a preset time, (E.g., execution of the application (s), etc.) or the current state of the electronic device (e.g. battery state, radio signal reception state, memory state, etc.) have.

In one embodiment, a predetermined situation for the electronic device may be determined based on usage history information of the electronic device (e.g., history of the electronic device operating in the sleep mode at a specific place, etc.).

In one embodiment, the initialization may include storing a program for operation of the camera system in an internal memory of the camera system and communicating the camera system set values to the camera system.

In one embodiment, the camera system comprises: a first camera module (e.g., a first camera module 210) for outputting a first image of a first subject located in front of the electronic device; (E.g., a second camera module 210a) for outputting a second image of a second subject located at the first image and / or an image processing apparatus (E.g., an image processing device 202a).

In one embodiment, the image processing apparatus includes a first image signal processor (e.g., a first image signal processor 220a) that performs a first process on the first image and a second image signal processor (E.g., a second image signal processor 230a) that performs a second image signal processor (e.g.

In operation 2320, when the initialization is completed, the electronic device can operate one of the first camera module and the second camera module in a normal mode. The electronic device may operate the other of the first camera module and the second camera module in a sleep mode.

In operation 2330, the electronic device may display one of the first image and the second image on a display (e.g., display 160).

In one embodiment, the electronic device is configured such that one of the first image signal processor and the second image signal processor processes an image input from the camera module and outputs it to the display (i.e., to operate in a normal mode) And the other of the first image signal processor and the second image signal processor can be controlled to operate in a sleep mode.

In operation 2340, the electronic device may detect a user input requiring switching between the first image and the second image (or switching between the first camera module and the second camera module).

In operation 2350, according to the user input, the electronic device may operate the other one of the first camera module and the second camera module in a normal mode. The electronic device may operate the one of the first camera module and the second camera module in a sleep mode.

In operation 2360, the electronic device may display the other of the first image and the second image on the display.

In one embodiment, the electronic device is configured to process the input image from the corresponding camera module and output it to the display (i. E., Operate in normal mode) And the one of the first image signal processor and the second image signal processor can be controlled to operate in a sleep mode.

24A to 24C are diagrams for explaining a method of operating an electronic device according to various embodiments.

Referring to FIG. 24A, in accordance with the initialization of the camera system 180a, the first camera module 210 can be operated in the normal mode after being powered on. The second camera module 210a may operate in the sleep mode after being powered on. The first camera module 210 may output the first image to the first image signal processor 220a of the image processing apparatus 202a. The second camera module 210a operates in the sleep mode and can not generate the second image or output the second image to the second image signal processor 230a of the image processing apparatus 202a . The first image signal processor 220a may perform a first process on the first image output from the first camera module 210. [ The first image signal processor 220a outputs the first processed first image to a display 160 and the display 160 may display the first processed first image.

In one embodiment, the second image signal processor 230a may operate in a sleep mode.

Referring to FIG. 24B, the second camera module 210a is switched according to the switching between the first image and the second image (or switching between the first camera module 210 and the second camera module 210a) (I.e., wake up) from the sleep mode to the normal mode, and output the second image to the second image signal processor 230a. The first camera module 210 can switch from the normal mode to the sleep mode. The first camera module 210 operates in the sleep mode and thus can not generate the first image or output the first image to the first image signal processor 220a. The second image signal processor 230a may perform a second process on the second image output from the second camera module 210a. The second image signal processor 230a outputs the second processed second image to the display 160 and the display 160 may display the second processed second image.

In one embodiment, the first image signal processor 220a may operate in a sleep mode. For example, in response to switching between the first image and the second image, the second image signal processor 230a switches from sleep mode to normal mode (i.e., wakes up) and the first image signal processor 220a can switch from the normal mode to the sleep mode.

Referring to FIG. 24C, in accordance with the initialization of the camera system 180b, the first camera module 210 can be operated in the normal mode after being powered on. The second camera module 210a may operate in the sleep mode after being powered on. The first camera module 210 may output the first image to the image signal processor 220b of the image processing apparatus 202b. The second camera module 210a operates in the sleep mode and can not generate a second image or output the second image to the image signal processor 220b. The image signal processor 220b may perform a first process on the first image output from the first camera module 210. [ The image signal processor 220b may output the first processed first image to the display 160 and the display 160 may display the first processed first image.

25A to 25C are diagrams for explaining a method of operating an electronic device according to various embodiments.

Referring to FIG. 25A, in accordance with the initialization of the camera system 180b, the first camera module 210 can be operated in the normal mode after being powered on. The second camera module 210a may be powered off. The first camera module 210 may output the first image to the image signal processor 220b of the image processing apparatus 202b. The image signal processor 220b may perform a first process on the first image output from the first camera module 210. [ The image signal processor 220b may output the first processed first image to the display 160 and the display 160 may display the first processed first image.

25B, an application 2510 (e.g., a camera application) may power off the first camera module 210 in response to switching between the first camera module 210 and the second camera module 210a. Instructions via calls of multiple APIs (e.g., stopPreview API 2521, sendCommand API 2522, release API 2523, and close API 2524) of the Hardware Abstraction Layer (HAL) (E.g., stopPreview () 2511, sendCommand () 2512, release 2513, and close 2514 to the camera system 180b or the first camera module 210 have. The application 2510 may be configured to communicate with a plurality of APIs (e.g., openCamera API 2525, startPreview API 2526) of the HAL 2520 to power on the second camera module 210a and operate in a normal mode. (E.g., openCamera () 2515, startPreview () 2516 via calls to the camera system 180b or the second camera module 210a.

Referring to FIG. 25C, in response to switching between the first camera module 210 and the second camera module 210a, the application 2510 powers off the first camera module 210, (E.g., Switching () 2517) through a call to one API (e.g., Switching API 2527) of the HAL 2520 to power on module 210a and operate in normal mode To the camera system 180b.

For example, the one API (e.g., the switching API 2527) may include a plurality of APIs (e.g., stopPreview API 2521, sendCommand API 2522, a plurality of APIs (e.g., openCamera API 2525, startPreview API 2526) for powering on the second camera module 210a and operating in a normal mode, In order.

For example, the one command (e.g., Switching () 2517) includes a plurality of commands (e.g., stopPreview () 2511, sendCommand () 2512), release () 2513, close () 2514, and a plurality of commands for powering on the second camera module 210a and operating in a normal mode, such as openCamera startPreview () 2516) to the camera system 180b.

According to various embodiments, a method of operating an electronic device includes: performing an initialization necessary to operate the camera system of the electronic device in a normal mode; Operating the camera system in a sleep mode when the initialization is completed; Switching the camera system from the sleep mode to the normal mode; And displaying an image output from the camera system in the normal mode on a display of the electronic device.

According to various embodiments, the initialization is performed when a predetermined first condition is satisfied, and the operation for switching to the normal mode may be performed when a preset second condition is satisfied.

According to various embodiments, the predetermined first condition may include: booting the electronic device, switching the electronic device from a sleep mode to a normal mode, screen / power on of the display after entering the sleep mode of the electronic device, An execution of an application including graphic elements requiring the operation of the camera system, a display of a screen including graphic elements requiring the operation of the camera system, a user's access to the camera system, Detecting at least one of a user's access to the required graphical element, detection of a situation associated with the electronic device consistent with a preset context, or detection of at least one word matching at least one preset word can do.

According to various embodiments, the preset situation for the electronic device is such that, when the electronic device is located or reaches a predetermined area / location, when the electronic device reaches a preset time, (E.g., execution of the application (s), etc.) or the current state of the electronic device (e.g., battery state, radio signal reception state, memory state, etc.) matches a preset state .

According to various embodiments, a predetermined situation for the electronic device may be determined based on usage history information of the electronic device (e.g., history of the electronic device operating in a sleep mode at a specific place, etc.).

According to various embodiments, the second condition may be a request for the detection of a preset situation for the electronic device, the execution of a camera application, the selection of graphic elements requiring the operation of the camera system, or the operation of the camera system And receiving at least one of the commands.

According to various embodiments, the camera system includes: a camera module for outputting an image of a subject; And an image processing apparatus that performs processing on the image output from the camera module.

According to various embodiments, the initialization may include: powering the camera system; And communicating at least one of a program for operation of the camera system or configuration information of the camera system to the camera system.

According to various embodiments, the initialization includes: storing a program for operation of the camera system in an internal memory of the camera system; And communicating the camera system set values to the camera system.

According to various embodiments, the initialization includes: storing a program for operation of the camera system in an internal memory of the camera system; And communicating a message to the camera system, the message including a plurality of set values of the camera system.

According to various embodiments, the initialization includes: storing a program for operation of the camera system in an internal memory of the camera system; And obtaining the set values stored in an internal memory of the camera system by the camera system.

According to various embodiments, the camera system includes: a camera module for outputting an image of a subject; And an image processing device for performing processing on an image output from the camera module, wherein the initialization is performed by transmitting at least one of a program for operation of the camera module or setting information of the camera module to the camera module action; And transferring at least one of a program for operation of the image processing apparatus or setting information of the image processing apparatus to the image processing apparatus.

According to various embodiments, the camera system includes: a camera module for outputting an image of a subject; A first image signal processor for performing a first process on an image output from the camera module; And a second image signal processor for performing a second process on an image output from the camera module independently of the first image signal processor, or a second process for performing the first process or the second process in cooperation with the first image signal processor, An image signal processor, said initialization comprising: transferring at least one of a program for operation of said camera module or configuration information of said camera module to said camera module; Transferring at least one of a program for operation of the first image signal processor or configuration information of the first image signal processor to the first image signal processor; And communicating at least one of a program for operation of the second image signal processor or configuration information of the second image signal processor to the second image signal processor.

According to various embodiments, the camera system includes: a camera module for outputting an image of a subject; And an image processing apparatus for performing processing on an image output from the camera module, wherein the initialization includes: storing a program for operation of the camera module in an internal memory of the camera module; Transmitting the set values of the camera module to the camera module; Storing a program for operation of the image processing apparatus in an internal memory of the image processing apparatus; And transferring the set values of the image processing apparatus to the image processing apparatus.

According to various embodiments, the act of displaying the image includes: controlling a camera module of the camera system to photograph a subject; Controlling the image processing apparatus of the camera system to perform processing on the image of the subject outputted from the camera module; And displaying the processed image on the display.

According to various embodiments, the operation of performing the initialization and the operation of operating the camera system in the sleep mode may be performed automatically, respectively.

According to various embodiments, the operation of operating the camera system in the sleep mode may include providing the camera system with a second power less than a first power provided to the camera system in the normal mode .

According to various embodiments, the operation of operating the camera system in the sleep mode includes providing the camera system with a second power less than a first power provided to the camera system in the normal mode, The second power may include a minimum power for maintaining data stored in the internal memory of the camera system and a minimum power for signal input.

According to various embodiments, the operation of operating the camera system in the sleep mode includes providing the camera system with a second power less than a first power provided to the camera system in the normal mode, Switching from the sleep mode to the normal mode may comprise providing the first power to the camera system.

According to various embodiments, the image may be a live preview image.

According to various embodiments, when the camera system is identified during booting of the electronic device, an operation of performing the initialization may be performed.

According to various embodiments, the initialization may be performed when the display is turned on / off after the display is turned on / off and the electronic device operates in a sleep mode.

According to various embodiments, the initialization may be performed when a screen including graphic elements requiring operation of the camera system is displayed on the display.

According to various embodiments, the method further comprises: displaying on the display a screen including graphical elements that require operation of the camera system; And detecting the user's access to the graphical element via the display, wherein when the user's access to the graphical element is detected via the display, an act of performing the initialization may be performed have.

According to various embodiments, the method further comprises: displaying on the display a screen including graphical elements that require operation of the camera system; And detecting a hovering input on the display, wherein the position of the hovering input is included in a display area of the graphic element, the position of the hovering input is adjacent to a display area of the graphic element, Is moved toward the graphic element, the operation of performing the initialization may be performed.

According to various embodiments, the method further comprises: detecting a context associated with the electronic device; And retrieving information associated with the situation from a database stored in a memory of the electronic device, wherein when the information associated with the situation is retrieved from the database, performing the initialization may be performed.

According to various embodiments, the operation of performing the initialization may be performed if at least one word that matches at least one word preset in speech or text is detected.

According to various embodiments, the method further comprises receiving voice or text from an external device, wherein upon detecting at least one word matching at least one word preset in speech or text, May be performed.

According to various embodiments, the method further comprises switching switching between a normal mode and a sleep mode for at least one component of the camera system between a screen / power on and a screen / power off for at least one component of the electronic device And may further include an operation of synchronizing to the switching.

According to various embodiments, the method further comprises synchronizing the switching between the normal mode and the sleep mode for the camera module of the camera system to the switching between the screen / power on and display / power off for the display of the electronic device .

According to various embodiments, the method further comprises synchronizing the switching between normal mode and sleep mode for at least one component of the camera system to switching between execution and termination for at least one application of the electronic device .

According to various embodiments, the camera system includes: a camera module for outputting an image of a subject; A first image signal processor for performing a first process on an image output from the camera module; And a second image signal processor for performing a second process on an image output from the camera module independently of the first image signal processor, or a second process for performing the first process or the second process in cooperation with the first image signal processor, The method may further include synchronizing the switching between normal mode and sleep mode for the second image signal processor to switching between execution and termination for the camera application of the electronic device .

According to various embodiments, the method further comprises synchronizing the switching between the normal mode and the sleep mode for at least one component of the camera system to the switching between the normal mode and the sleep mode for at least one component of the electronic device Operation may be further included.

According to various embodiments, the method may further comprise synchronizing the switching between the normal mode and the sleep mode for the image processing apparatus of the camera system to the switching between the normal mode and the sleep mode for the processor of the electronic device have.

According to various embodiments, a method of operating an electronic device comprises: performing an initialization of a camera system of the electronic device; Operating at least one of a first camera module and a second camera module of the camera system in a normal mode upon completion of the initialization; And displaying an image output from one of the first camera module and the second camera module on a display of the electronic device.

According to various embodiments, when the initialization is completed, the first camera module and the second camera module can be operated in a normal mode at the same time.

According to various embodiments, the initialization includes: storing a program for operation of the camera system in an internal memory of the camera system; And communicating the camera system set values to the camera system.

According to various embodiments, the initialization of the camera system may be performed when a preset first condition is satisfied.

According to various embodiments, the predetermined first condition may include: booting the electronic device, switching the electronic device from a sleep mode to a normal mode, screen / power on of the display after entering the sleep mode of the electronic device, An execution of an application including graphic elements requiring the operation of the camera system, a display of a screen including graphic elements requiring the operation of the camera system, a user's access to the camera system, Detecting at least one of a user's access to the required graphical element, detection of a situation associated with the electronic device consistent with a preset context, or detection of at least one word matching at least one preset word can do.

According to various embodiments, the method further comprises: when the initialization is complete, operating the camera system in a sleep mode; And switching the camera system from the sleep mode to the normal mode.

According to various embodiments, the initialization is performed when the predetermined first condition is satisfied, and the operation of switching to the normal mode may be performed when a preset second condition is satisfied.

According to various embodiments, the second condition may be a request for the detection of a preset situation for the electronic device, the execution of a camera application, the selection of graphic elements requiring the operation of the camera system, or the operation of the camera system And receiving at least one of the commands.

According to various embodiments, the camera system comprises: the first camera module for outputting a first image of a first subject located in front of the electronic device; The second camera module outputting a second image of a second subject located behind the electronic device; And an image processing apparatus that performs processing on the first image and / or the second image.

According to various embodiments, the image processing apparatus further comprises: a first image signal processor for performing a first processing on the first image; And a second image signal processor for performing a second process on the second image.

According to various embodiments, when the initialization is completed, the first camera module and the second camera module may be operated in a normal mode at the same time, and the method may further include, for the first image output from the first camera module, Performing a first process; And performing a second process on the second image output from the second camera module, wherein the first processed first image or the second processed second image is displayed on the display .

According to various embodiments, the method further comprises, in response to the input, stopping the display of the image output from the one of the first camera module and the second camera module, And displaying the image output from the other one of the plurality of image forming apparatuses on the display of the electronic apparatus.

According to various embodiments, the method may further comprise operating the other of the first camera module and the second camera module in a sleep mode.

According to various embodiments, the image processing apparatus further comprises: a first image signal processor for performing a first process on the first image output from the first camera module; And a second image signal processor for performing a second process on the second image output from the second camera module, the method comprising the steps of: The image signal processor being operable in a normal mode of the first image signal processor and the second image signal processor to output an image output from the image signal processor, Can be displayed on the display.

According to various embodiments, the method further comprises: operating the other of the first camera module and the second camera module in a sleep mode; In response to an input, operating the one of the first camera module and the second camera module in the sleep mode and the other one of the first camera module and the second camera module in the sleep mode to the normal mode ; And displaying an image output from the other one of the first camera module and the second camera module on a display of the electronic device.

According to various embodiments, the one of the first camera module and the second camera module is operated in the sleep mode, and the other one of the first camera module and the second camera module is switched from the sleep mode to the normal Mode may be performed using a predetermined switching application programming interface (API).

According to various embodiments, the image output from the camera system may include a live preview image.

According to various embodiments, the method may further include displaying a screen of the camera application in the normal mode.

According to various embodiments, the live preview image may be included in the screen of the camera application.

According to various embodiments, an operation of displaying a screen of a camera application in the normal mode; Detecting an input of a user for shooting a subject; And an operation of photographing the subject in response to the input of the user.

According to various embodiments, the predetermined second condition may comprise a selection of physical buttons provided on the electronic device.

According to various embodiments, the predetermined second condition may include a double-click of a home button provided in the electronic device.

According to various embodiments, an operation of displaying a screen of a camera application in the normal mode; And an operation of automatically photographing the subject.

According to various embodiments, an operation of automatically taking an image of the subject in the normal mode; And displaying a screen of the camera application after the photographing.

According to various embodiments, an electronic device includes a camera system configured to photograph a subject; A display configured to display a screen; And to perform an initialization necessary to operate the camera system in a normal mode, wherein when the initialization is completed, the camera system is configured to operate in a sleep mode, and the camera system is switched from the sleep mode to the normal mode And to display on the display an image output from the camera system in the normal mode.

According to various embodiments, the initialization is performed when a predetermined first condition is satisfied, and the transition to the normal mode may be performed when a preset second condition is satisfied.

According to various embodiments, the predetermined first condition may include: booting the electronic device, switching the electronic device from a sleep mode to a normal mode, screen / power on of the display after entering the sleep mode of the electronic device, An execution of an application including graphic elements requiring the operation of the camera system, a display of a screen including graphic elements requiring the operation of the camera system, a user's access to the camera system, Detecting at least one of a user's access to the required graphical element, detection of a situation associated with the electronic device consistent with a preset context, or detection of at least one word matching at least one preset word can do.

According to various embodiments, the preset situation for the electronic device is such that, when the electronic device is located or reaches a predetermined area / location, when the electronic device reaches a preset time, (E.g., execution of the application (s), etc.) or the current state of the electronic device (e.g., battery state, radio signal reception state, memory state, etc.) matches a preset state .

According to various embodiments, a predetermined situation for the electronic device may be determined based on usage history information of the electronic device (e.g., history of the electronic device operating in a sleep mode at a specific place, etc.).

According to various embodiments, the second condition may be a request for the detection of a preset situation for the electronic device, the execution of a camera application, the selection of graphic elements requiring the operation of the camera system, or the operation of the camera system And receiving at least one of the commands.

According to various embodiments, the camera system includes: a camera module for outputting an image of a subject; And an image processing apparatus that performs processing on the image output from the camera module.

According to various embodiments, the processor is configured to apply power to the camera system and configured to communicate to the camera system at least one of a program for operation of the camera system or configuration information of the camera system .

According to various embodiments, the processor is configured to store a program for operation of the camera system in an internal memory of the camera system, and configured to communicate settings of the camera system to the camera system.

According to various embodiments, the processor is configured to store a program for operation of the camera system in an internal memory of the camera system, and to forward a message containing a plurality of settings of the camera system to the camera system Lt; / RTI >

According to various embodiments, the processor is configured to store a program for operation of the camera system in an internal memory of the camera system, the camera system configured to obtain settings stored in an internal memory of the camera system .

According to various embodiments, the camera system includes: a camera module for outputting an image of a subject; And an image processing device for performing processing on the image output from the camera module, wherein the processor is configured to transmit at least one of a program for operation of the camera module or setting information of the camera module to the camera module And configured to transmit at least one of a program for operation of the image processing apparatus or setting information of the image processing apparatus to the image processing apparatus.

According to various embodiments, the camera system includes: a camera module for outputting an image of a subject; A first image signal processor for performing a first process on an image output from the camera module; And a second image signal processor for performing a second process on an image output from the camera module independently of the first image signal processor, or a second process for performing the first process or the second process in cooperation with the first image signal processor, Wherein the processor is configured to transfer at least one of a program for the operation of the camera module or a configuration information of the camera module to the camera module, Or at least one of the setting information of the first image signal processor and the setting information of the first image signal processor to the first image signal processor, To the second image signal processor It may be configured to transfer.

According to various embodiments, the camera system includes: a camera module for outputting an image of a subject; And an image processing apparatus for performing processing on an image output from the camera module, wherein the processor is configured to store a program for operation of the camera module in an internal memory of the camera module, And to transmit the setting values to the camera module, wherein the program is configured to store a program for operation of the image processing apparatus in an internal memory of the image processing apparatus, and to transmit the setting values of the image processing apparatus to the image processing apparatus Lt; / RTI >

According to various embodiments, the processor is configured to control a camera module of the camera system to capture a subject and to process the image of the subject output from the camera module, And configured to display the processed image on the display.

According to various embodiments, the processor can automatically perform the operation of performing the initialization and the operation of operating the camera system in the sleep mode, respectively.

According to various embodiments, the processor may be configured to provide the camera system with a second power less than a first power provided to the camera system in the normal mode.

According to various embodiments, the processor is configured to provide the camera system with a second power less than a first power provided to the camera system in the normal mode, and the second power is provided to an internal memory of the camera system A minimum power for maintaining stored data and a minimum power for signal input.

According to various embodiments, the image may be a live preview image.

According to various embodiments, the processor may be configured to perform the initialization if the camera system is identified during booting of the electronic device.

According to various embodiments, the processor may be configured to perform the initialization if the display is screen / power off and the display is screen / powered on after the electronic device is operating in a sleep mode.

According to various embodiments, the processor may be configured to perform the initialization when a screen is displayed on the display, the screen including graphical elements requiring operation of the camera system.

According to various embodiments, the processor is configured to display on the display a screen including graphical elements that require operation of the camera system, and to detect the user's access to the graphical element via the display And configured to perform the initialization if the user's access to the graphical element is detected via the display.

According to various embodiments, the processor is configured to display on the display a screen that includes graphical elements that require operation of the camera system, and is configured to detect a hovering input on the display, the location of the hovering input May be configured to perform the initialization when the hovering input is included in the display area of the graphical element, the position of the hovering input is adjacent to the display area of the graphic element, or the hovering input is moving toward the graphic element .

According to various embodiments, the processor is configured to detect a context associated with the electronic device and configured to retrieve information associated with the context from a database stored in a memory of the electronic device, Once the associated information is retrieved, it can be configured to perform the initialization.

According to various embodiments, the processor may be configured to perform the initialization if at least one word that matches at least one word preset in speech or text is detected.

According to various embodiments, the processor is configured to receive voice or text from an external device and configured to perform the initialization if at least one word that matches at least one word preset in voice or text is detected .

According to various embodiments, the processor is configured to switch between normal mode and sleep mode for at least one component of the camera system between screen / power on and screen / power off for at least one component of the electronic device And may be configured to be synchronized to switching.

According to various embodiments, the processor can be configured to synchronize switching between normal mode and sleep mode for the camera module of the camera system to switching between screen / power on and screen / power off for the display of the electronic device have.

According to various embodiments, the processor may be configured to synchronize switching between normal mode and sleep mode for at least one component of the camera system to switching between execution and termination for at least one application of the electronic device have.

According to various embodiments, the camera system includes: a camera module for outputting an image of a subject; A first image signal processor for performing a first process on an image output from the camera module; And a second image signal processor for performing a second process on an image output from the camera module independently of the first image signal processor, or a second process for performing the first process or the second process in cooperation with the first image signal processor, And an image signal processor, the processor being configured to synchronize switching between normal mode and sleep mode for the second image signal processor to switching between execution and termination for the camera application of the electronic device.

According to various embodiments, the processor is configured to synchronize switching between a normal mode and a sleep mode for at least one component of the camera system to a switching between a normal mode and a sleep mode for at least one component of the electronic device Lt; / RTI >

According to various embodiments, the processor may be configured to synchronize switching between a normal mode and a sleep mode for an image processing apparatus of the camera system to a switching between a normal mode and a sleep mode for the processor of the electronic device.

According to various embodiments, an electronic device includes a camera system configured to photograph a subject; A display configured to display a screen; And performing an initialization of the camera system; Operating at least one of a first camera module and a second camera module of the camera system in a normal mode upon completion of the initialization; And a processor configured to display an image output from one of the first camera module and the second camera module on the display.

According to various embodiments, upon completion of the initialization, the processor may be configured to simultaneously operate the first camera module and the second camera module in a normal mode.

According to various embodiments, the processor may be configured to store a program for operation of the camera system in an internal memory of the camera system, and to communicate settings of the camera system to the camera system.

According to various embodiments, the processor may be configured to perform initialization of the camera system if a predetermined first condition is met.

According to various embodiments, the predetermined first condition may include: booting the electronic device, switching the electronic device from a sleep mode to a normal mode, screen / power on of the display after entering the sleep mode of the electronic device, An execution of an application including graphic elements requiring the operation of the camera system, a display of a screen including graphic elements requiring the operation of the camera system, a user's access to the camera system, Detecting at least one of a user's access to the required graphical element, detection of a situation associated with the electronic device consistent with a preset context, or detection of at least one word matching at least one preset word can do.

According to various embodiments, the processor may be configured to operate the camera system in a sleep mode and switch the camera system from the sleep mode to a normal mode upon completion of the initialization.

According to various embodiments, the initialization is performed when the predetermined first condition is satisfied, and the transition to the normal mode may be performed when a preset second condition is satisfied.

According to various embodiments, the second condition may be a request for the detection of a preset situation for the electronic device, the execution of a camera application, the selection of graphic elements requiring the operation of the camera system, or the operation of the camera system And receiving at least one of the commands.

According to various embodiments, the camera system comprises: the first camera module for outputting a first image of a first subject located in front of the electronic device; The second camera module outputting a second image of a second subject located behind the electronic device; And an image processing apparatus that performs processing on the first image and / or the second image.

According to various embodiments, the image processing apparatus further comprises: a first image signal processor for performing a first processing on the first image; And a second image signal processor for performing a second process on the second image.

According to various embodiments, the processor may be configured to operate the first camera module and the second camera module simultaneously in a normal mode when the initialization is completed, and to process the first image for the first image output from the first camera module And to perform a second process on the second image output from the second camera module, wherein the first processed first image or the second processed second image is displayed on the display Can be displayed.

According to various embodiments, the processor, in response to the input, stops displaying the image output from the one of the first camera module and the second camera module, and the first camera module and the second camera module To display on the display of the electronic device an image output from the other of the plurality of devices.

According to various embodiments, the processor may be configured to operate the other of the first camera module and the second camera module in a sleep mode.

According to various embodiments, the image processing apparatus further comprises: a first image signal processor for performing a first process on the first image output from the first camera module; And a second image signal processor for performing a second process on the second image output from the second camera module, wherein the processor is configured to perform a second process on the other of the first camera module and the second camera module The image signal processor being operable in a normal mode of the first image signal processor and the second image signal processor to be displayed on a display of the electronic device .

According to various embodiments, the processor is configured to operate the other of the first camera module and the second camera module in a sleep mode, and in response to the input, determine whether the first one of the first camera module and the second camera module Switches the other one of the first camera module and the second camera module from the sleep mode to the normal mode, and activates the other one of the first camera module and the second camera module To display an image output from the electronic device on the display of the electronic device.

According to various embodiments, the processor operates the one of the first camera module and the second camera module in the sleep mode using a preset switching API (application programming interface), and the first camera module And to switch the other one of the second camera module from the sleep mode to the normal mode.

According to various embodiments, the image output from the camera system may include a live preview image.

According to various embodiments, the processor may be configured to display a screen of the camera application on the display in the normal mode.

According to various embodiments, the live preview image may be included in the screen of the camera application.

According to various embodiments, the processor is configured to display a screen of a camera application on the display in the normal mode, and is configured to detect an input of a user for capturing an object, wherein in response to the user's input, And to control the camera system to perform shooting of the subject.

According to various embodiments, the predetermined second condition may comprise a selection of physical buttons provided on the electronic device.

According to various embodiments, the predetermined second condition may include a double-click of a home button provided in the electronic device.

According to various embodiments, the processor is configured to display a screen of a camera application in the normal mode on the display, and the processor can be configured to automatically take an image of the subject by controlling the camera system.

According to various embodiments, the processor is configured to control the camera system in the normal mode to automatically take an image of the subject, and to display a screen of the camera application after the image taking on the display.

26 shows a block diagram 2600 of an electronic device 2601 according to various embodiments. The electronic device 2601 may constitute all or part of the electronic device 101 shown in Fig. 1, for example. 26, the electronic device 2601 includes a processor including one or more application processors (APs) 2610 and / or one or more communication processors (CP), a communication module 2620, a SIM A subscriber identification module card 2624, a memory 2630, a sensor module 2640, an input device 2650, a display 2660, an interface 2670, an audio module 2680, a camera module 2691, A management module 2695, a battery 2696, an indicator 2697, or a motor 2698.

The AP 2610 may control a plurality of hardware or software components connected to the AP 2610 by driving an operating system or an application program, and may perform various data processing and operations including multimedia data. The AP 2610 may be implemented as a system on chip (SoC), for example. According to one embodiment, the AP 2610 may further include a graphics processing unit (GPU) (not shown).

The communication module 2620 (e.g., communication interface 170) may communicate with other electronic devices (e. G., Electronic devices 104,102) that are networked with the electronic device 2601 ) Or the server 106). According to one embodiment, the communication module 2620 includes a cellular module 2621, a Wifi module 2623, a BT module 2625, a GPS module 2627, an NFC module 2628, or a radio frequency (RF) module 2628 2629). ≪ / RTI >

The cellular module 2621 provides at least one of voice call, video call, video sharing, text service, and Internet service through a communication network (e.g., LTE, LTE-A, CDMA, WCDMA, UMTS, WiBro or GSM) can do. The cellular module 2621 may also perform identification and authentication of the electronic device within the communication network using, for example, a subscriber identity module (e.g., SIM card 2624). According to one embodiment, the cellular module 2621 may perform at least some of the functions that the AP 2610 may provide. For example, the cellular module 2621 may perform at least some of the multimedia control functions.

According to one embodiment, the communication processor may be included in the cellular module 2621. In addition, the cellular module 2621 may be implemented with, for example, SoC. 26, components such as the cellular module 2621 (e.g., communication processor 2611), the memory 2630 or the power management module 2695 are shown as separate components from the AP 2610 However, according to one embodiment, the AP 2610 may be implemented to include at least a portion of the aforementioned components (e.g., cellular module 2621).

According to one embodiment, the AP 2610 or the cellular module 2621 (e.g., a communications processor) may load or read commands or data received from at least one of non-volatile memory or other components connected thereto, load. In addition, the AP 2610 or the cellular module 2621 may store data generated by at least one of the other components or received from at least one of the other components in the non-volatile memory.

Each of the Wifi module 2623, the BT module 2625, the GPS module 2627 or the NFC module 2628 includes a processor for processing data transmitted and received through a corresponding module . Although the cellular module 2621, the Wifi module 2623, the BT module 2625, the GPS module 2627, or the NFC module 2628 are shown as separate blocks in FIG. 26, according to one embodiment, At least some (e.g., two or more) of the wireless module 2621, the Wifi module 2623, the BT module 2625, the GPS module 2627 or the NFC module 2628 may be included in one integrated chip (IC) have. At least some of the processors (e.g., cellular module 2621) corresponding to cellular module 2621, Wifi module 2623, BT module 2625, GPS module 2627, or NFC module 2628, And a Wifi processor corresponding to the Wifi module 2623) may be implemented in one SoC.

The RF module 2629 can transmit and receive data, for example, transmit and receive RF signals. The RF module 2629 may include at least one of a transceiver, a power amplifier module (PAM), a frequency filter, a low noise amplifier (LNA), and the like, although not shown. have. The RF module 2629 may further include at least one of a component for transmitting and receiving electromagnetic waves in free space, for example, a conductor, a wire, and the like in wireless communication. 26, the cellular module 2621, the Wifi module 2623, the BT module 2625, the GPS module 2627, and the NFC module 2628 are shown sharing one RF module 2629, At least one of the cellular module 2621, the Wifi module 2623, the BT module 2625, the GPS module 2627 or the NFC module 2628 transmits and receives an RF signal through a separate RF module can do.

The SIM card 2624 may be a card including a subscriber identity module and may be inserted into a slot formed at a specific location of the electronic device. The SIM card 2624 may include unique identification information (e.g., ICCID) or subscriber information (e.g., international mobile subscriber identity (IMSI)).

The memory 2630 (e.g., the memory 130) may include an internal memory 2632 or an external memory 2634. The built-in memory 2632 may be a nonvolatile memory such as a dynamic RAM (DRAM), a static RAM (SRAM), a synchronous dynamic RAM (SDRAM), or the like, Such as one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, NAND flash memory, And may include at least one.

According to one embodiment, the internal memory 2632 may be a solid state drive (SSD). The external memory 2634 may be a flash drive, for example, a compact flash (CF), a secure digital (SD), a micro secure digital (SD), a mini secure digital (SD), an extreme digital A memory stick, and the like. The external memory 2634 may be functionally connected to the electronic device 2601 through various interfaces. According to one embodiment, the electronic device 2601 may further include a storage device (or storage medium) such as a hard drive.

The sensor module 2640 may measure a physical quantity or sense an operating state of the electronic device 2601, and convert the measured or sensed information into an electrical signal. The sensor module 2640 includes a gesture sensor 2640A, a gyro sensor 2640B, an air pressure sensor 2640C, a magnetic sensor 2640D, an acceleration sensor 2640E, a grip sensor 2640F, A light sensor 2640G, a color sensor 2640H (e.g., an RGB (red, green, blue) sensor), a biosensor 2640I, a temperature / humidity sensor 2640J, 2640M). ≪ / RTI > Additionally or alternatively, the sensor module 2640 may include, for example, an E-nose sensor (not shown), an EMG sensor (not shown), an EEG sensor (not shown) (Not shown), an IR sensor (not shown), an iris sensor (not shown), a fingerprint sensor (not shown), and the like. The sensor module 2640 may further include a control circuit for controlling at least one sensor included in the sensor module 2640.

The input device 2650 may include a touch panel 2652, a (digital) pen sensor 2654, a key 2656, or an ultrasonic input device 2658. The touch panel 2652 can recognize a touch input by at least one of an electrostatic type, a pressure sensitive type, an infrared type, and an ultrasonic type. In addition, the touch panel 2652 may further include a control circuit. In electrostatic mode, physical contact or proximity recognition is possible. The touch panel 2652 may further include a tactile layer. In this case, the touch panel 2652 may provide a tactile response to the user.

The (digital) pen sensor 2654 can be implemented using the same or similar method as receiving the touch input of the user, or using a separate recognition sheet, for example. The key 2656 may include, for example, a physical button, an optical key or a keypad. The ultrasonic input device 2658 is an apparatus that can confirm data by sensing a sound wave from an electronic device 2601 to a microphone (e.g., a microphone 2688) through an input tool for generating an ultrasonic signal, Recognition is possible. According to one embodiment, the electronic device 2601 may use the communication module 2620 to receive user input from an external electronic device (e.g., a computer or a server) connected thereto.

The display 2660 (e.g., display 160) may include a panel 2662, a hologram device 2664, or a projector 2666. The panel 2662 may be, for example, a liquid-crystal display (LCD) or an active-matrix organic light-emitting diode (AM-OLED). The panel 2662 may be embodied, for example, flexible, transparent or wearable. The panel 2662 may be formed of one module with the touch panel 2652. The hologram device 2664 can display a stereoscopic image in the air using the interference of light. The projector 2666 can display an image by projecting light onto a screen. The screen may be located, for example, inside or outside the electronic device 2601. According to one embodiment, the display 2660 may further include control circuitry for controlling the panel 2662, the hologram device 2664, or the projector 2666.

The interface 2670 may include, for example, a high-definition multimedia interface 2672, a universal serial bus 2674, an optical interface 2676, or a D-sub (D-subminiature 2678) . ≪ / RTI > The interface 2670 may, for example, be included in the communication interface 170 shown in FIG. Additionally or alternatively, the interface 2670 may include a mobile high-definition link (MHL) interface, a secure digital (SD) card / multi-media card (MMC) interface, or an infrared data association . ≪ / RTI >

The audio module 2680 can convert sound and electric signals into both directions. At least some of the components of the audio module 2680 may be included, for example, in the input / output interface 150 shown in FIG. The audio module 2680 may process sound information input or output through at least one of, for example, a speaker 2682, a receiver 2684, an earphone 2686, a microphone 2688, and the like.

According to one embodiment, the camera module 2691 is a device capable of capturing a still image and a moving image, and includes at least one image sensor (e.g., a front sensor or a rear sensor), a lens (not shown) processor (ISP), not shown) or a flash (not shown) such as a LED or xenon lamp.

The power management module 2695 can manage the power of the electronic device 2601. Although not shown, the power management module 2695 may include, for example, a power management integrated circuit (PMIC), a charger integrated circuit (PMIC), or a battery or fuel gauge.

The PMIC can be mounted, for example, in an integrated circuit or a SoC semiconductor. The charging method can be classified into wired and wireless. The charging IC can charge the battery, and can prevent an overvoltage or an overcurrent from the charger. According to one embodiment, the charging IC may comprise a charging IC for at least one of a wired charging scheme or a wireless charging scheme. The wireless charging system may be, for example, a magnetic resonance system, a magnetic induction system or an electromagnetic wave system, and additional circuits for wireless charging may be added, such as a coil loop, a resonant circuit or a rectifier have.

The battery gauge can measure, for example, the remaining amount of the battery 2696, the voltage during charging, the current or the temperature. The battery 2696 may store or generate electricity, and may supply power to the electronic device 2601 using the stored or generated electricity. The battery 2696 may include, for example, a rechargeable battery or a solar battery.

The indicator 2697 may indicate at least one of a specific state of the electronic device 2601 or a portion thereof (e.g., the AP 2610), for example, a boot state, a message state, a charging state, The motor 2698 can convert the electrical signal into mechanical vibration. Although not shown, the electronic device 2601 may include a processing unit (e.g., GPU) for mobile TV support. The processing device for supporting the mobile TV can process media data conforming to standards such as digital multimedia broadcasting (DMB), digital video broadcasting (DVB), or media flow.

Each of the above-described components of the electronic device according to various embodiments may be composed of one or more components, and the name of the component may be changed according to the type of the electronic device. The electronic device according to various embodiments may be configured to include at least one of the above-described components, and some components may be omitted or further include other additional components. In addition, some of the components of the electronic device according to various embodiments may be combined into one entity, so that the functions of the components before being combined can be performed in the same manner.

The term " module " as used in various embodiments may mean a unit comprising, for example, one or a combination of two or more of hardware, software or firmware. A " module " may be interchangeably used with terms such as, for example, unit, logic, logical block, component or circuit. A " module " may be a minimum unit or a portion of an integrally constructed component. A " module " may be a minimum unit or a portion thereof that performs one or more functions. &Quot; Modules " may be implemented either mechanically or electronically. For example, a "module" in accordance with various embodiments may be an application-specific integrated circuit (ASIC) chip, field-programmable gate arrays (FPGAs) or programmable logic devices -logic device).

According to various embodiments, at least some of the devices (e.g., modules or functions thereof) or methods (e.g., operations) according to various embodiments may be stored in a computer-readable storage medium computer-readable storage media). The instructions, when executed by one or more processors (e.g., processor 120), may cause the one or more processors to perform functions corresponding to the instructions. The computer readable storage medium may be, for example, the memory 130. [ At least some of the programming modules may be implemented (e.g., executed) by the processor 120, for example. At least some of the programming modules may include at least one of, for example, a module, a program, a routine, sets of instructions, a process, etc., for performing one or more functions.

The computer-readable recording medium includes a magnetic medium such as a hard disk, a floppy disk and a magnetic tape, an optical recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD (Digital Versatile Disc) A magneto-optical medium such as a floppy disk, and a program command such as a read only memory (ROM), a random access memory (RAM), a flash memory, Module) that is configured to store and perform the functions described herein. The program instructions may also include machine language code such as those generated by a compiler, as well as high-level language code that may be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the various embodiments, and vice versa.

Modules or programming modules according to various embodiments may include at least one or more of the elements described above, some of which may be omitted, or may further include other additional elements. Operations performed by modules, programming modules, or other components in accordance with various embodiments may be performed in a sequential, parallel, iterative, or heuristic manner. Also, some operations may be performed in a different order, omitted, or other operations may be added.

According to various embodiments, there is provided a storage medium storing instructions which, when executed by at least one processor, cause the at least one processor to be configured to perform at least one operation, Performing an initialization of the camera system of the electronic device if a predetermined condition is satisfied; Operating the camera system in a sleep mode when the initialization is completed; Switching the camera system from the sleep mode to a normal mode in response to a first input; And displaying an image output from the camera system in the normal mode on a display of the electronic device.

In addition, the various embodiments disclosed in the present specification and drawings are only illustrative of specific examples in order to facilitate description of various embodiments and facilitate understanding of various embodiments, and are not intended to limit the scope of various embodiments. Accordingly, the scope of various embodiments should be construed as being included in the scope of various embodiments without departing from the scope of the embodiments disclosed herein, and all changes or modifications derived from the technical ideas of various embodiments.

The present invention relates to a camera control module and a camera control module, and more particularly, it relates to an electronic device,

Claims (25)

A method of operating an electronic device,
Performing an initialization of the camera system of the electronic device;
Operating the camera system in a sleep mode when the initialization is completed;
Switching the camera system from the sleep mode to a normal mode; And
And displaying an image output from the camera system in the normal mode on a display of the electronic device. The method according to claim 1,
Wherein the performing of the initialization is performed when a predetermined first condition is satisfied, and the operation of switching to the normal mode is performed if a predetermined second condition is satisfied. The method according to claim 1,
In the initialization,
Applying power to the camera system; And
And communicating to the camera system at least one of a program for operation of the camera system or configuration information of the camera system. 3. The method of claim 2,
Wherein the predetermined second condition is selected from the group consisting of: detecting a preset condition for the electronic device, executing a camera application, selecting a graphic element requiring operation of the camera system, or receiving an instruction requesting operation of the camera system Lt; / RTI > The method according to claim 1,
Wherein the operation of operating the camera system in the sleep mode comprises:
And providing the camera system with a second power less than a first power provided to the camera system in the normal mode,
Wherein the switching from the sleep mode to the normal mode comprises:
And providing the first power to the camera system. The method according to claim 1,
And if the camera system is identified during booting of the electronic device, performing the initialization is performed. The method according to claim 1,
Wherein the initializing is performed when the display is turned on and after the display is turned on and after the electronic device operates in a sleep mode. The method according to claim 1,
Wherein the initialization is performed when a screen including graphic elements requiring operation of the camera system is displayed on the display. The method of claim 1,
Displaying on the display a screen including graphic elements that require operation of the camera system; And
Further comprising detecting the user's access to the graphical element via the display,
And if the user's access to the graphical element is detected via the display, performing the initialization is performed. The method of claim 1,
Detecting a context associated with the electronic device; And
Further comprising retrieving information associated with the situation from a database stored in a memory of the electronic device,
And if the information associated with the situation is retrieved from the database, performing the initialization is performed. 3. The method of claim 2,
Wherein the predetermined second condition includes a double-click of a home button provided in the electronic device. The method of claim 1,
Further comprising synchronizing switching between a normal mode and a sleep mode for at least one component of the camera system to switching between a screen on and a screen off for at least one component of the electronic device. The method of claim 1,
Further comprising synchronizing switching between a normal mode and a sleep mode for at least one component of the camera system to switching between a normal mode and a sleep mode for at least one component of the electronic device. A machine-readable storage medium having recorded thereon a program for executing an operating method of an electronic device,
Performing an initialization of the camera system of the electronic device;
Operating the camera system in a sleep mode when the initialization is completed;
Switching the camera system from the sleep mode to a normal mode; And
And displaying an image output from the camera system in the normal mode on a display of the electronic device. In an electronic device,
A camera system configured to photograph a subject;
A display configured to display a screen; And
And to perform initialization of the camera system,
Wherein when the initialization is completed, the camera system is configured to operate in a sleep mode,
And to switch the camera system from the sleep mode to a normal mode,
And to display on the display an image output from the camera system in the normal mode. 16. The method of claim 15,
The processor comprising:
And to perform the initialization if a preset first condition is satisfied,
And to switch the camera system from the sleep mode to the normal mode when a preset second condition is satisfied. 16. The apparatus of claim 15,
And to apply power to the camera system,
And to transmit to the camera system at least one of a program for operation of the camera system or setting information of the camera system. 17. The method of claim 16,
Wherein the predetermined second condition comprises at least one of execution of a camera application, selection of graphic elements requiring operation of the camera system, or reception of an instruction requesting operation of the camera system. 16. The apparatus of claim 15,
And to provide the camera system with a second power less than a first power provided to the camera system in the normal mode in the sleep mode. 16. The apparatus of claim 15,
And perform the initialization when the display is turned on and after the display is turned on after the electronic device is operated in the sleep mode. 16. The apparatus of claim 15,
And to perform the initialization when a screen including graphic elements requiring operation of the camera system is displayed on the display. 16. The apparatus of claim 15,
And switch between normal mode and sleep mode for at least one component of the camera system to switch between on and off of at least one component of the electronic device. 16. The apparatus of claim 15,
And synchronize switching between normal mode and sleep mode for at least one component of the camera system to switching between execution and termination for at least one application of the electronic device. 16. The apparatus of claim 15,
And to switch between a normal mode and a sleep mode for at least one component of the camera system to switch between a normal mode and a sleep mode for at least one component of the electronic device. 17. The method of claim 16,
Wherein the predetermined second condition includes a double-click of a home button provided in the electronic device.

Images