CN106937056B

CN106937056B - Focusing processing method and device for double cameras and mobile terminal

Info

Publication number: CN106937056B
Application number: CN201710205479.6A
Authority: CN
Inventors: 欧阳灵趋
Original assignee: Nubia Technology Co Ltd
Current assignee: Nubia Technology Co Ltd
Priority date: 2017-03-31
Filing date: 2017-03-31
Publication date: 2020-10-09
Anticipated expiration: 2037-03-31
Also published as: CN106937056A

Abstract

The invention discloses a focusing processing method and device for double cameras and a mobile terminal. The focusing processing method is suitable for a mobile terminal, and the mobile terminal comprises a first camera and a second camera. The focusing processing method comprises the following steps: when focusing expansion operation triggered by a user is received, determining a focusing object, a focusing starting point and a focusing end point according to the focusing expansion operation triggered by the user; controlling the first camera to obtain a first image of the object and controlling the second camera to obtain a plurality of second images with different focal lengths of the object, wherein the focal length of the first image corresponds to the focusing starting point, and the focal length of each second image corresponds to a certain point between the focusing starting point and the focusing end point; and merging the first image and the plurality of second images of different focal lengths into a preview image of the object. Therefore, the user can adjust the focusing range of the photographed object according to the requirement, the user can be helped to shoot a more satisfactory and high-quality picture, and the use experience of the user is provided.

Description

Focusing processing method and device for double cameras and mobile terminal

Technical Field

The invention relates to the technical field of photographing processing of mobile terminals, in particular to a focusing processing method and device for double cameras and a mobile terminal.

Background

At present, in order to help a user acquire clearer, more vivid and more stereoscopic photos, more and more mobile terminals such as a smart phone, a tablet computer and a Personal Digital Assistant (PDA) are provided with a dual-camera module on the same side, such as the back side. The design of the double-camera module mainly comprises a wide-angle camera module (also called as a main camera module) and a long-focus camera module (also called as a sub-camera module), so that the mobile terminal with the double cameras can realize the focusing function. The principle of realizing focusing is as follows: after the camera is opened, the camera enters the wide-angle camera and the telephoto camera simultaneously, and pictures of the two cameras are synthesized for a user to preview.

However, under the auto-focusing and blurring functions of the dual cameras, when the range of the object to be focused is large, the auto-focusing only focuses on a part of the object, so that the edge of the object to be focused is blurred too early, some parts of the same object in the shot picture are clear, and other parts are blurred, so that the whole picture is not ideal, and the use experience of a user is affected.

Therefore, it is necessary to provide a focusing method and apparatus capable of expanding the focusing area of the photographed object to solve the above problems and enable the user to take an ideal picture.

Disclosure of Invention

The invention mainly aims to provide a focusing processing method and device for double cameras and a mobile terminal, aiming at enabling a user to adjust the focusing range of a photographed object as required by adjusting a focusing area, helping the user to photograph a more satisfactory and high-quality picture and providing the user experience.

In order to achieve the above object, the present invention provides a method for focusing with two cameras, which is applicable to a mobile terminal, where the mobile terminal includes a first camera and a second camera. The focusing processing method comprises the following steps:

when focusing expansion operation triggered by a user is received, determining a focusing object, a focusing starting point and a focusing end point according to the focusing expansion operation triggered by the user;

controlling the first camera to obtain a first image of the object and controlling the second camera to obtain a plurality of second images with different focal lengths of the object, wherein the focal length of the first image corresponds to the focusing starting point, and the focal length of each second image corresponds to a certain point between the focusing starting point and the focusing end point; and

merging the first image and the plurality of second images of different focal lengths into a preview image of the object.

Further, the step of "controlling the first camera to obtain the first image of the object and controlling the second camera to obtain the plurality of second images of the object with different focal lengths" specifically includes:

acquiring scene depth information of a focusing object by using a binocular platform or a depth sensor;

determining the object image and the background image of the object in the first image and the second image according to the depth information; and

and performing segmentation processing on the first image and the second image according to the determined object image and the determined background image to obtain an image area of the segmented object.

Further, the step of "combining the first image and the plurality of second images with different focal lengths into the preview image of the object" specifically includes:

and carrying out contrast enhancement processing on the segmented image area of the object and synthesizing a preview image of the object.

Further, before the step "when receiving the focusing operation triggered by the user, determining the focusing object and the focusing start point and the focusing end point according to the focusing operation triggered by the user", the method further comprises the following steps:

judging whether the first camera and the second camera are in a photographing focusing preview state or not;

and when the first camera and the second camera enter a photographing and focusing preview state, further judging whether focusing operation triggered by a user is received.

Further, when a user applies a long press operation to an object acquired when the first camera and the second camera are in a photographing and focusing preview state, it is determined that the user applies a focusing operation to the object.

The invention provides a double-lens focusing processing device, which runs in a mobile terminal, wherein the mobile terminal comprises a first camera and a second camera, and the focusing processing device comprises:

the device comprises a determining module, a focusing module and a judging module, wherein the determining module is used for determining a focusing object, a focusing starting point and a focusing end point according to focusing expansion operation triggered by a user when the focusing expansion operation triggered by the user is received;

an image obtaining module, configured to control the first camera to obtain a first image of the object and control the second camera to obtain a plurality of second images with different focal lengths of the object, where a focal length of the first image corresponds to the focusing start point, and a focal length of each second image corresponds to a certain point between the focusing start point and the focusing end point; and

a merging module, configured to merge the first image and the plurality of second images with different focal lengths into a preview image of the object.

Further, the "controlling the first camera to obtain the first image of the object and the second camera to obtain the plurality of second images of the object with different focal lengths" specifically includes:

Further, before the step of determining a focusing object and a focusing start point and a focusing end point according to the focusing operation triggered by the user when the focusing operation triggered by the user is received, the method further comprises the following steps:

Compared with the prior art, the focusing system and the focusing method provided by the invention can enable a user to know the area where the current focusing range is located very conveniently and quickly, and can further preview the image of the object in the focusing range, so that the user can further judge the image of the object, such as whether the focusing distance is proper or not, whether the previewed picture is satisfactory or not, and the like.

Drawings

Fig. 1 is a schematic diagram of a hardware structure of a mobile terminal implementing various embodiments of the present invention;

FIG. 2 is a diagram of a wireless communication system for the mobile terminal shown in FIG. 1;

FIG. 3 is a diagram illustrating functional modules of a focus processing system according to an embodiment of the present invention;

FIG. 4 is a diagram illustrating functional modules of a focus processing system according to another embodiment of the present invention;

FIG. 5 is a flowchart illustrating a focusing method according to an embodiment of the present invention;

FIG. 6 is a flowchart of step S303 in FIG. 5 in further detail;

FIG. 7 is a flowchart illustrating a focusing method according to an embodiment of the present invention;

the objectives, features, and advantages of the present invention will be further explained with reference to the accompanying drawings.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

A mobile terminal implementing various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in themselves. Thus, "module" and "component" may be used in a mixture.

Further, it should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The mobile terminal may be implemented in various forms. For example, the terminal described in the present invention may include a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a navigation device, and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, it will be understood by those skilled in the art that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal in addition to elements particularly used for moving purposes.

Fig. 1 is a schematic hardware configuration of a mobile terminal implementing various embodiments of the present invention.

The mobile terminal 100 may include a wireless communication unit 110, an a/V (audio/video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply unit 190, etc. Fig. 1 illustrates a mobile terminal having various components, but it is to be understood that not all illustrated components are required to be implemented. More or fewer components may alternatively be implemented. Elements of the mobile terminal will be described in detail below.

The wireless communication unit 110 typically includes one or more components that allow radio communication between the mobile terminal 100 and a wireless communication system or network. For example, the wireless communication unit may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short-range communication module 114, and a location information module 115.

The broadcast receiving module 111 receives a broadcast signal and/or broadcast associated information from an external broadcast management server via a broadcast channel. The broadcast channel may include a satellite channel and/or a terrestrial channel. The broadcast management server may be a server that generates and transmits a broadcast signal and/or broadcast associated information or a server that receives a previously generated broadcast signal and/or broadcast associated information and transmits it to a terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and the like. Also, the broadcast signal may further include a broadcast signal combined with a TV or radio broadcast signal. The broadcast associated information may also be provided via a mobile communication network, and in this case, the broadcast associated information may be received by the mobile communication module 112. The broadcast signal may exist in various forms, for example, it may exist in the form of an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB), an Electronic Service Guide (ESG) of digital video broadcasting-handheld (DVB-H), and the like. The broadcast receiving module 111 may receive a signal broadcast by using various types of broadcasting systems. In particular, the broadcast receiving module 111 may receive a broadcast signal by using a signal such as multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), digital video broadcasting-handheld (DVB-H), forward link media (MediaFLO)^@) A digital broadcasting system of a terrestrial digital broadcasting integrated service (ISDB-T), etc. receives digital broadcasting. The broadcast receiving module 111 may be constructed to be suitable for various broadcasting systems that provide broadcast signals as well as the above-mentioned digital broadcasting systems. The broadcast signal and/or broadcast associated information received via the broadcast receiving module 111 may be stored in the memory 160 (or other type of storage medium).

The mobile communication module 112 transmits and/or receives radio signals to and/or from at least one of a base station (e.g., access point, node B, etc.), an external terminal, and a server. Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received according to text and/or multimedia messages.

The wireless internet module 113 supports wireless internet access of the mobile terminal. The module may be internally or externally coupled to the terminal. The wireless internet access technology to which the module relates may include WLAN (wireless LAN) (Wi-Fi), Wibro (wireless broadband), Wimax (worldwide interoperability for microwave access), HSDPA (high speed downlink packet access), and the like.

The short-range communication module 114 is a module for supporting short-range communication. Some examples of short-range communication technologies include bluetooth^TMRadio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), zigbee^TMAnd so on.

The location information module 115 is a module for checking or acquiring location information of the mobile terminal. A typical example of the location information module is a GPS (global positioning system). According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information, thereby accurately calculating three-dimensional current location information according to longitude, latitude, and altitude. Currently, a method for calculating position and time information uses three satellites and corrects an error of the calculated position and time information by using another satellite. In addition, the GPS module 115 can calculate speed information by continuously calculating current position information in real time.

The a/V input unit 120 is used to receive an audio or video signal. The a/V input unit 120 may include a camera 121 and a microphone 122, and the camera 121 processes image data of still pictures or videos obtained by an image capturing apparatus in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 151. The image frames processed by the camera 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 121 may be provided according to the configuration of the mobile terminal. The microphone 122 may receive sounds (audio data) via the microphone in a phone call mode, a recording mode, a voice recognition mode, or the like, and can process such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the mobile communication module 112 in case of a phone call mode. The microphone 122 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.

The user input unit 130 may generate key input data according to a command input by a user to control various operations of the mobile terminal. The user input unit 130 allows a user to input various types of information, and may include a keyboard, dome sheet, touch pad (e.g., a touch-sensitive member that detects changes in resistance, pressure, capacitance, and the like due to being touched), scroll wheel, joystick, and the like. In particular, when the touch pad is superimposed on the display unit 151 in the form of a layer, a touch screen may be formed.

The sensing unit 140 detects a current state of the mobile terminal 100 (e.g., an open or closed state of the mobile terminal 100), a position of the mobile terminal 100, presence or absence of contact (i.e., touch input) by a user with the mobile terminal 100, an orientation of the mobile terminal 100, acceleration or deceleration movement and direction of the mobile terminal 100, and the like, and generates a command or signal for controlling an operation of the mobile terminal 100. For example, when the mobile terminal 100 is implemented as a slide-type mobile phone, the sensing unit 140 may sense whether the slide-type phone is opened or closed. In addition, the sensing unit 140 can detect whether the power supply unit 190 supplies power or whether the interface unit 170 is coupled with an external device. The sensing unit 140 may include a proximity sensor 1410 as will be described below in connection with a touch screen.

The interface unit 170 serves as an interface through which at least one external device is connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The identification module may store various information for authenticating a user using the mobile terminal 100 and may include a User Identity Module (UIM), a Subscriber Identity Module (SIM), a Universal Subscriber Identity Module (USIM), and the like. In addition, a device having an identification module (hereinafter, referred to as an "identification device") may take the form of a smart card, and thus, the identification device may be connected with the mobile terminal 100 via a port or other connection means. The interface unit 170 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal and the external device.

In addition, when the mobile terminal 100 is connected with an external cradle, the interface unit 170 may serve as a path through which power is supplied from the cradle to the mobile terminal 100 or may serve as a path through which various command signals input from the cradle are transmitted to the mobile terminal. Various command signals or power input from the cradle may be used as signals for recognizing whether the mobile terminal is accurately mounted on the cradle. The output unit 150 is configured to provide output signals (e.g., audio signals, video signals, alarm signals, vibration signals, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and the like.

The display unit 151 may display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 may display a User Interface (UI) or a Graphical User Interface (GUI) related to a call or other communication (e.g., text messaging, multimedia file downloading, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or an image and related functions, and the like.

Meanwhile, when the display unit 151 and the touch pad are overlapped with each other in the form of a layer to form a touch screen, the display unit 151 may serve as an input device and an output device. The display unit 151 may include at least one of a Liquid Crystal Display (LCD), a thin film transistor LCD (TFT-LCD), an Organic Light Emitting Diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as transparent displays, and a typical transparent display may be, for example, a TOLED (transparent organic light emitting diode) display or the like. Depending on the particular desired implementation, the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown). The touch screen may be used to detect a touch input pressure as well as a touch input position and a touch input area.

The audio output module 152 may convert audio data received by the wireless communication unit 110 or stored in the memory 160 into an audio signal and output as sound when the mobile terminal is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output module 152 may provide audio output related to a specific function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 may provide an output to notify the mobile terminal 100 of the occurrence of an event. Typical events may include call reception, message reception, key signal input, touch input, and the like. In addition to audio or video output, the alarm unit 153 may provide output in different ways to notify the occurrence of an event. For example, the alarm unit 153 may provide an output in the form of vibration, and when a call, a message, or some other incoming communication (communicating communication) is received, the alarm unit 153 may provide a tactile output (i.e., vibration) to inform the user thereof. By providing such a tactile output, the user can recognize the occurrence of various events even when the user's mobile phone is in the user's pocket. The alarm unit 153 may also provide an output notifying the occurrence of an event via the display unit 151 or the audio output module 152.

The memory 160 may store software programs and the like for processing and controlling operations performed by the controller 180, or may temporarily store data (e.g., a phonebook, messages, still images, videos, and the like) that has been or will be output. Also, the memory 160 may store data regarding various ways of vibration and audio signals output when a touch is applied to the touch screen.

The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. Also, the mobile terminal 100 may cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.

The controller 180 generally controls the overall operation of the mobile terminal. For example, the controller 180 performs control and processing related to voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 1810 for reproducing (or playing back) multimedia data, and the multimedia module 1810 may be constructed within the controller 180 or may be constructed separately from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.

The power supply unit 190 receives external power or internal power and provides appropriate power required to operate various elements and components under the control of the controller 180.

The various embodiments described herein may be implemented in a computer-readable medium using, for example, computer software, hardware, or any combination thereof. For a hardware implementation, the embodiments described herein may be implemented using at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a processor, a controller, a microcontroller, a microprocessor, an electronic unit designed to perform the functions described herein, and in some cases, such embodiments may be implemented in the controller 180. For a software implementation, the implementation such as a process or a function may be implemented with a separate software module that allows performing at least one function or operation. The software codes may be implemented by software applications (or programs) written in any suitable programming language, which may be stored in the memory 160 and executed by the controller 180.

Up to this point, mobile terminals have been described in terms of their functionality. Hereinafter, a slide-type mobile terminal among various types of mobile terminals, such as a folder-type, bar-type, swing-type, slide-type mobile terminal, and the like, will be described as an example for the sake of brevity. Accordingly, the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.

Specifically, in the embodiment of the present invention, the camera 121 for acquiring image information included in the a/V input unit 120 includes a first camera 1210 and a second camera 1211. The first camera 1210 and the second camera 1211 may be mounted on the same side of the mobile terminal 100, such as the back side, or on different sides of the mobile terminal 100, such as the first camera 1210 being mounted on the front side and the second camera 1211 being mounted on the back side. Further, the first camera 1210 may be a wide-angle camera, and the second camera 1211 may be a telephoto camera, which is not particularly limited herein.

The mobile terminal 100 as shown in fig. 1 may be configured to operate with communication systems such as wired and wireless communication systems and satellite-based communication systems that transmit data via frames or packets.

A communication system in which a mobile terminal according to the present invention is operable will now be described with reference to fig. 2.

Such communication systems may use different air interfaces and/or physical layers. For example, the air interface used by the communication system includes, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and Universal Mobile Telecommunications System (UMTS) (in particular, Long Term Evolution (LTE)), global system for mobile communications (GSM), and the like. By way of non-limiting example, the following description relates to a CDMA communication system, but such teachings are equally applicable to other types of systems.

Referring to fig. 2, the CDMA wireless communication system may include a plurality of mobile terminals 100, a plurality of Base Stations (BSs) 270, Base Station Controllers (BSCs) 275, and a Mobile Switching Center (MSC) 280. The MSC280 is configured to interface with a Public Switched Telephone Network (PSTN) 290. The MSC280 is also configured to interface with a BSC275, which may be coupled to the base station 270 via a backhaul. The backhaul may be constructed according to any of several known interfaces including, for example, E1/T1, ATM, IP, PPP, frame Relay, HDSL, ADSL, or xDSL. It will be understood that a system as shown in fig. 2 may include multiple BSCs 2750.

Each BS270 may serve one or more sectors (or regions), each sector covered by a multi-directional antenna or an antenna pointing in a particular direction being radially distant from the BS 270. Alternatively, each partition may be covered by two or more antennas for diversity reception. Each BS270 may be configured to support multiple frequency allocations, with each frequency allocation having a particular frequency spectrum (e.g., 1.25MHz,5MHz, etc.).

The intersection of partitions with frequency allocations may be referred to as a CDMA channel. The BS270 may also be referred to as a Base Transceiver Subsystem (BTS) or other equivalent terminology. In such a case, the term "base station" may be used to generically refer to a single BSC275 and at least one BS 270. The base stations may also be referred to as "cells". Alternatively, each sector of a particular BS270 may be referred to as a plurality of cell sites.

As shown in fig. 2, a Broadcast Transmitter (BT)295 transmits a broadcast signal to the mobile terminal 100 operating within the system. A broadcast receiving module 111 as shown in fig. 1 is provided at the mobile terminal 100 to receive a broadcast signal transmitted by the BT 295. In fig. 2, several Global Positioning System (GPS) satellites 300 are shown. The satellite 300 assists in locating at least one of the plurality of mobile terminals 100.

In fig. 2, a plurality of satellites 300 are depicted, but it is understood that useful positioning information may be obtained with any number of satellites. The GPS module 115 as shown in fig. 1 is generally configured to cooperate with satellites 300 to obtain desired positioning information. Other techniques that can track the location of the mobile terminal may be used instead of or in addition to GPS tracking techniques. In addition, at least one GPS satellite 300 may selectively or additionally process satellite DMB transmission.

As a typical operation of the wireless communication system, the BS270 receives reverse link signals from various mobile terminals 100. The mobile terminal 100 is generally engaged in conversations, messaging, and other types of communications. Each reverse link signal received by a particular base station 270 is processed within the particular BS 270. The obtained data is forwarded to the associated BSC 275. The BSC provides call resource allocation and mobility management functions including coordination of soft handoff procedures between BSs 270. The BSCs 275 also route the received data to the MSC280, which provides additional routing services for interfacing with the PSTN 290. Similarly, the PSTN290 interfaces with the MSC280, the MSC interfaces with the BSCs 275, and the BSCs 275 accordingly control the BS270 to transmit forward link signals to the mobile terminal 100.

Based on the above mobile terminal hardware structure and communication system, the present invention provides various embodiments of the method.

Referring to fig. 3, a schematic diagram of functional modules of a focus processing system 200 according to a first embodiment of the invention is shown. The focusing processing system 200 includes, but is not limited to, a determining module 210, a determining module 220, an image acquiring module 230, a synthesizing module 240, and a displaying module 250. It should be noted that the modules referred to in the present invention are program instruction segments that can be executed by the controller 180 of the mobile terminal 100 and can perform specific functions. The specific functions of the above functional modules will be described in further detail below.

The determining module 210 is configured to determine whether a focus expansion request triggered by a user is received.

In an embodiment, the determining module 210 determines whether the focus enlargement request is received by determining whether a preset operation, such as a long-press operation or a zoom-in operation, is applied to a focus marker of an image preview interface acquired by the first camera 1210 (also referred to as a main camera) by a user. The long-press operation refers to that the time for pressing or touching the focusing marker by the user is greater than a preset value, such as 5 seconds or 10 seconds. The zooming-in operation refers to that a user applies a zooming dragging operation to the focus frame or the focus icon, for example, a sliding operation with two fingers opposite to each other. The focus markers include, but are not limited to, a focus frame or a focus icon, etc.

Specifically, when a user performs a preset operation on a focusing frame or a focusing icon of the camera preview interface acquired by the first camera 1210, the determining module 210 determines that a focusing expansion request is received. In contrast, when the user does not perform a preset operation on the focusing frame or the focusing icon of the camera preview interface acquired by the first camera 1210, the determining module 210 determines that the focusing expansion request is not received.

In another embodiment, the determining module 210 determines whether the focus enlargement request is received by determining whether a preset focus enlargement control button or icon is triggered by a user. When the user presses a preset focus expansion control button or clicks a preset focus expansion icon, the determining module 210 determines that a focus expansion request is received. In contrast, when the user does not press the preset focus expansion control button or does not click the preset focus expansion icon, the determining module 210 determines that the focus expansion request is not received. The click may be a double click or a single click, without limitation.

In another embodiment, the determining module 210 is further configured to determine whether the first camera 1210 and/or the second camera 1211 are in a photographing preview state. When the first camera 1210 and/or the second camera 1211 are in the photographing preview state, the determining module 210 further determines that a focus expansion request triggered by a user is not received.

Of course, in order to distinguish the specific functions of the determining module 210, please refer to fig. 4, in another specific implementation manner of the present invention, the determining module 210 is divided into a first determining sub-module 211 and a second determining sub-module 212. The first determining submodule 211 is configured to determine whether the first camera 1210 and/or the second camera 1211 are in a photographing preview state. The second determination sub-module 212 is used for determining whether a focus enlargement request triggered by the user is received. The detailed process of the second determining sub-module 212 determining that the focus expansion request is received is the same as the determining module 210 in the first embodiment, and is not described herein again.

When the determining module 210 determines that a focus expansion request triggered by a user is received, the determining module 220 determines a focus object, a focus starting point, and a focus ending point in response to the focus expansion request. In this embodiment, the determining module 220 determines a focusing object, a focusing start point and a focusing end point according to an operation of triggering the focusing expansion request by a user. In a specific implementation manner of the present invention, when the operation triggering the focus expansion request is a long press operation, the determining module 220 determines the focusing object and the focusing start point according to the position of the long press operation, and determines the focusing end point according to the duration of the long press operation. The focusing starting point corresponds to the focal length which is the minimum value, and the focusing end point corresponds to the focal length which is the maximum value.

When the user performs the focus enlarging operation on a specific object, in order to facilitate the user to observe the current focusing range of the object, the determining module 220 may display the starting point and the ending point of focusing in a specific manner, for example, with different colors.

The image capturing module 230 controls the first camera 1210 to capture a first image of the object to be focused and controls the second camera 1211 to capture a plurality of second images of the object with different focal lengths.

In this embodiment, the focal length of the first image corresponds to a focusing start point of the focusing object, and the focal length of each second image corresponds to a certain focal point from the focusing start point to the focusing end point. That is, the image obtaining module 230 controls the second camera 1211 to sequentially obtain a plurality of second images of the focusing object from the focusing point except for the focusing start point to the focusing end point every a preset time, for example, 1S or 2S.

The merging module 240 is configured to merge the first image and the plurality of second images with different focal lengths into a preview image of the object.

The display module 250 is configured to display the preview image of the object synthesized by the merging module 240.

Thus, the focusing processing system 200 provided by the present invention enables the user to know the area where the current focusing range is located very conveniently and quickly, and can further preview the image of the object in the focusing range, so that the user can further make a judgment on the image of the object, such as judging whether the focusing distance is proper and whether the preview state of the photo is satisfactory.

Referring to fig. 4, a schematic diagram of functional modules of a focusing processing system 200 according to a second embodiment of the invention is shown. The focusing processing system 200 includes, but is not limited to, a determining module 210, a determining module 220, an image acquiring module 230, and a synthesizing module 240. The determining module 210 includes a first determining sub-module 211 and a second determining sub-module 212. The image acquisition module 230 includes a scene depth acquisition module 231, an object background determination module 232, and a segmentation module 233.

It should be noted that the modules referred to in the present invention are program instruction segments that can be executed by the controller 180 of the mobile terminal 100 and can perform specific functions. The specific functions of the above functional modules will be described in further detail below. In addition, in the second embodiment, the specific functions of the first determining sub-module 211, the second determining sub-module 212, and the determining module 220 are the same as those of the same modules in the first embodiment, and are not repeated herein.

The scene depth acquiring module 231 is configured to acquire scene depth information of a focused object by using a binocular platform or a depth sensor. In the embodiment of the present invention, both the first camera 1210 and the second camera 1211 are mounted with a depth sensor or a binocular platform is provided on the mobile terminal 100. The depth sensor acquires distance information of a scene by utilizing the reflection of actively emitted infrared light in the scene.

The object background determination module 232 is configured to determine the object image and the background image of the object in the first image and the second image according to the depth information acquired by the scene depth acquisition module 231.

The segmentation module 233 is configured to perform segmentation processing on the first image and the second image according to the object image and the background image determined by the object background determination module 220 to obtain an image region of the segmented object.

Accordingly, the synthesis module 240 performs contrast enhancement processing on the image region of the object obtained by the segmentation module 233 and synthesizes a preview image of the object.

In this way, the focusing processing system provided by the second embodiment of the present invention can determine the object image and the background image according to the scene depth information of the focusing object, acquire the corresponding object image from the acquired first image and second image, and combine the acquired object images into the preview image of the object in the focusing process.

Referring to fig. 5, a flowchart of steps of a focusing processing method according to a first embodiment of the invention is shown. The functions implemented by the method may be implemented by the controller 180 in the mobile terminal 100 calling program code, which of course may be stored in a computer storage medium such as the memory 160. As can be seen, the mobile terminal 100 includes at least a controller 180 and a memory 160. In addition, in the present embodiment, the execution order of the steps in the flowchart shown in fig. 5 may be changed and some steps may be omitted, depending on the specific case.

In step S301, the determining module 210 determines that a focus expansion request triggered by a user is not received. If yes, go to step S302; if not, the process returns to step S301.

In an embodiment, the step S301 specifically includes: the determining module 210 determines whether a user applies a preset operation, such as a long-press operation or a zoom-in operation, to a focus marker of an image preview interface acquired by a first camera 1210 (also referred to as a main camera). The long-press operation refers to that the time for pressing or touching the focusing marker by the user is greater than a preset value, such as 5 seconds or 10 seconds. The zooming-in operation refers to that a user applies a zooming dragging operation to the focus frame or the focus icon, for example, a sliding operation with two fingers opposite to each other. The focus markers include, but are not limited to, a focus frame or a focus icon, etc.

In another embodiment, the step S301 specifically includes: the determining module 210 determines whether a user triggers a preset focus expansion control button or icon. When the user presses a preset focus expansion control button or clicks a preset focus expansion icon, the determining module 210 determines that a focus expansion request is received. In contrast, when the user does not press the preset focus expansion control button or does not click the preset focus expansion icon, the determining module 210 determines that the focus expansion request is not received. The click may be a double click or a single click, without limitation.

In other embodiments, the step S301 may be omitted. That is, the initial step of the flowchart illustrated in fig. 3 is S302.

In step S302, the determining module 220 determines a focusing object, a focusing start point and a focusing end point in response to the focusing expansion request.

In this embodiment, the determining module 220 determines a focusing object, a focusing start point and a focusing end point according to an operation of triggering the focusing expansion request by a user. In a specific implementation manner of the present invention, when the operation triggering the focus expansion request is a long press operation, the determining module 220 determines the focusing object and the focusing start point according to the position of the long press operation, and determines the focusing end point according to the duration of the long press operation. The focusing starting point corresponds to the focal length which is the minimum value, and the focusing end point corresponds to the focal length which is the maximum value.

In step S303, the image obtaining module 230 controls the first camera 1210 to obtain a first image of the object to be focused and controls the second camera 1211 to obtain a plurality of second images of the object with different focal lengths.

In this embodiment, the focal length of the first image corresponds to a focusing start point of the focusing object, and the focal length of each second image corresponds to a point between the focusing start point and the focusing end point. That is, the image obtaining module 230 controls the second camera 1211 to sequentially obtain a plurality of second images of the focusing object from the focusing point except for the focusing start point to the focusing end point every a preset time, for example, 1S or 2S.

In step S304, the merging module 240 merges the first image acquired by the image acquiring module 230 and the plurality of second images with different focal lengths into a preview image of the object.

In step S305, the display module 250 controls to display the preview image synthesized by the merging module 240.

Referring to fig. 6, a flowchart illustrating a more detailed step of step S303 shown in fig. 6 is shown.

In step S3031, the scene depth obtaining module 231 obtains the scene depth information of the focusing object by using a binocular platform or a depth sensor.

In the embodiment of the present invention, both the first camera 1210 and the second camera 1211 are mounted with a depth sensor or a binocular platform is provided on the mobile terminal 100. The depth sensor acquires distance information of a scene by utilizing the reflection of actively emitted infrared light in the scene.

In step S3032, the object background determining module 232 determines the object image and the background image of the object in the first image and the second image according to the depth information acquired by the scene depth acquiring module 231.

Step S3033, the segmentation module 233 performs segmentation processing on the first image and the second image according to the object image and the background image determined by the object background determination module 220 to obtain an image region of the segmented object.

In step S304, the synthesis module 240 performs contrast enhancement processing on the image region of the object obtained by the segmentation module 233 and synthesizes a preview image of the object.

Referring to fig. 7, a flowchart of a focusing method in a second embodiment of the invention is shown. The functions implemented by the method may be implemented by the controller 180 in the mobile terminal 100 calling program code, which of course may be stored in a computer storage medium such as the memory 160. As can be seen, the mobile terminal 100 includes at least a controller 180 and a memory 160. In addition, in the present embodiment, the execution order of the steps in the flowchart shown in fig. 4 may be changed and some steps may be omitted, depending on the specific case.

Step S401, the determining module 210 determines whether the first camera 1210 and/or the second camera 1211 is in a preview photographing state; if yes, go to step S402; if not, the process returns to step S401.

In step S402, the determining module 210 determines that a focus enlarging request triggered by a user is not received. If yes, go to step S403; if not, the process returns to step S402.

In an embodiment, the step S402 specifically includes: the determining module 210 determines whether a user applies a preset operation, such as a long-press operation or a zoom-in operation, to a focus marker of an image preview interface acquired by a first camera 1210 (also referred to as a main camera). The long-press operation refers to that the time for pressing or touching the focusing marker by the user is greater than a preset value, such as 5 seconds or 10 seconds. The zooming-in operation refers to that a user applies a zooming dragging operation to the focus frame or the focus icon, for example, a sliding operation with two fingers opposite to each other. The focus markers include, but are not limited to, a focus frame or a focus icon, etc.

In another embodiment, the step S402 specifically includes: the determining module 210 determines whether a user triggers a preset focus expansion control button or icon. When the user presses a preset focus expansion control button or clicks a preset focus expansion icon, the determining module 210 determines that a focus expansion request is received. In contrast, when the user does not press the preset focus expansion control button or does not click the preset focus expansion icon, the determining module 210 determines that the focus expansion request is not received. The click may be a double click or a single click, without limitation.

In other embodiments, steps S401 and S402 may be omitted.

In step S403, the determining module 220 determines a focusing object, a focusing start point and a focusing end point in response to the focusing expansion request.

In step S404, the image obtaining module 230 controls the first camera 1210 to obtain a first image of the object to be focused and controls the second camera 1211 to obtain a plurality of second images of the object with different focal lengths.

In step S405, the merging module 240 merges the first image acquired by the image acquiring module 230 and the plurality of second images with different focal lengths into a preview image of the object.

In step S406, the display module 250 controls to display the preview image synthesized by the merging module 240.

As can be seen from the above steps, the focusing processing system 200 according to the second embodiment of the present invention enables the user to perform focusing and enlarging operations on the photographing process in the photographing preview state, and know the area where the current focusing range is located, and further preview the image of the object in the focusing range, so that the user can further determine the image of the object, for example, whether the focusing distance is suitable and whether the preview state of the image is satisfactory.

It should be noted that the focusing method provided by the embodiment of the present invention is implemented in a scene of taking a picture on a mobile terminal device.

Focusing is to adjust the focal distance when using a camera, and focusing is also called focusing. The camera or the camera on the mobile terminal device applies a focusing mechanism to change the object distance and the distance position, so that the process of imaging the shot object clearly is focusing.

In the embodiment of the invention, a user uses a terminal to shoot, after the user clicks a camera application and opens the camera application, when a shooting key is triggered or a display screen of mobile terminal equipment is clicked, namely the mobile terminal equipment receives a focusing instruction, the mobile terminal equipment starts to collect a first image through an image sensor, namely the terminal starts to shoot the first image on a target object, and the terminal defaults to shoot by adopting an initial focal length when shooting is started, so that the terminal can obtain the initial focal length when the first image is collected and obtain shooting parameters according to the setting parameters of the terminal.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims

1. A focusing processing method of double lenses is suitable for a mobile terminal, the mobile terminal comprises a first camera and a second camera, and the focusing processing method is characterized by comprising the following steps:

when a focusing expansion request triggered by a user is received, determining a focusing object, a focusing starting point and a focusing end point in response to the focusing expansion request;

controlling the first camera to acquire a first image of the focusing object and controlling the second camera to acquire a plurality of second images with different focal lengths of the focusing object, wherein the focal length of the first image corresponds to the focusing starting point, and the focal length of each second image corresponds to a certain point between the focusing starting point and the focusing end point; and

merging the first image and the plurality of second images with different focal lengths into a preview image of the focusing object;

the controlling the second camera to obtain a plurality of second images with different focal lengths of the focusing object includes: controlling the second camera to sequentially acquire a plurality of second images of the focusing object from a focusing point outside the focusing starting point to the focusing end point at preset time intervals;

the step of controlling the first camera to obtain the first image of the focusing object and controlling the second camera to obtain the plurality of second images of the focusing object with different focal lengths specifically includes:

acquiring scene depth information of a focusing object by using a binocular platform or a depth sensor, wherein the scene depth information comprises distance information of a scene;

determining an object image of the focusing object and a background image of the focusing object in the first image and the second image according to the depth information; and

performing segmentation processing on the first image and the second image according to the determined object image and the background image of the focusing object to obtain a segmented image area of the focusing object;

the step of "combining the first image and the plurality of second images with different focal lengths into the preview image of the focused object" specifically includes:

and carrying out contrast enhancement processing on the segmented image area of the focusing object and synthesizing a preview image of the focusing object.

2. The focus processing method according to claim 1, wherein before the step of determining a focused object, a focusing start point and an end point in response to a focus enlargement request triggered by a user when the focus enlargement request is received, further comprises the steps of:

judging whether the first camera and/or the second camera are/is in a photographing focusing preview state;

and when the first camera and/or the second camera enter a photographing focusing preview state, further judging whether a focusing expansion request triggered by a user is received.

3. The focusing processing method according to claim 2, wherein when a long press operation is applied by a user to a focusing object acquired when the first camera and the second camera are in a photographing focus preview state, it is determined that the user has applied a focus enlargement request to the focusing object.

4. The utility model provides a double-lens focus processing apparatus, moves in mobile terminal, mobile terminal includes first camera and second camera, its characterized in that, focus processing apparatus includes:

the device comprises a determining module, a focusing module and a focusing module, wherein the determining module is used for determining a focusing object, a focusing starting point and a focusing end point according to a focusing expansion request triggered by a user when the focusing expansion request triggered by the user is received;

an image obtaining module, configured to control the first camera to obtain a first image of the object to be focused and control the second camera to obtain a plurality of second images with different focal lengths of the object to be focused, where a focal length of the first image corresponds to the focusing start point, and a focal length of each second image corresponds to a point between the focusing start point and the focusing end point; and

a merging module, configured to merge the first image and the plurality of second images with different focal lengths into a preview image of the focusing object;

the image acquisition module controls the second camera to sequentially acquire a plurality of second images of the focusing object from the focusing point except the focusing starting point to the focusing end point at preset time intervals;

the "controlling the first camera to obtain the first image of the focusing object and the second camera to obtain the second images of the focusing object with different focal lengths" specifically includes:

the "combining the first image and the plurality of second images with different focal lengths into the preview image of the focusing object" specifically includes:

5. The focus processing apparatus according to claim 4, further comprising, before said "determining a focusing object, a focusing start point and an end point according to a user-triggered focus enlargement request when receiving the user-triggered focus enlargement request":

and when the first camera and the second camera enter a photographing and focusing preview state, further judging whether a focusing expansion request triggered by a user is received.

6. The focus processing apparatus according to claim 5, wherein when a long press operation is applied by a user to a focusing object acquired when the first camera and the second camera are in a photographing focus preview state, it is determined that the user has applied a focus enlargement request to the focusing object.