WO2017067481A1

WO2017067481A1 - Method and mobile terminal for processing image

Info

Publication number: WO2017067481A1
Application number: PCT/CN2016/102737
Authority: WO
Inventors: 张圣杰
Original assignee: 努比亚技术有限公司
Priority date: 2015-10-23
Filing date: 2016-10-20
Publication date: 2017-04-27
Also published as: CN105262952A

Abstract

A mobile terminal comprises: an acquisition unit, a transmission unit, a synthesis unit and a display unit. The acquisition unit is configured to acquire a focus picture captured by a first camera according to a focus command of a user, and to acquire a defocus picture corresponding to the focus picture captured by a second camera. The transmission unit is configured to transmit the acquired focus picture and defocus picture to the synthesis unit. The synthesis unit is configured to synthesize the acquired focus picture and defocus picture. The display unit is configured to display the synthesized picture. The technical solution realizes automatic and fast synthesis of an image which is in focus and edges thereof are softened, and improves the user experience.

Description

Mobile terminal and method for processing image thereof

Technical field

The present application relates to, but is not limited to, smart terminal technology, and more particularly to a mobile terminal and a method for processing an image thereof.

Background technique

At present, the methods for achieving soft focus include the following: one is to use a special soft focus lens; the other is to use soft focus or slow shutter to achieve soft focus; the third is to use image processing software (PS, Adobe Photoshop) for shooting Photo or image for post-softening. Among them, the use of special soft focus lens is costly, which increases the user's economic burden; the method of using soft focus or slow shutter speed to achieve soft focus has higher requirements on the user's photographic technology; using PS for post processing, the user cannot take photos. WYSIWYG at the time.

That is to say, the method for realizing soft focus in the related art cannot satisfy the needs of photographers, and it is impossible to automatically and quickly synthesize images with sharp focus and edge softening in camera shooting of a mobile terminal, and the user experience is not good.

Summary of the invention

The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims.

Embodiments of the present invention provide a mobile terminal and a method for processing an image thereof, which can automatically and quickly synthesize images with sharp focus and edge softening, and enhance the user experience.

An embodiment of the present invention provides a mobile terminal, where the mobile terminal includes a binocular camera, and the mobile terminal further includes: an acquiring unit, a transmitting unit, a synthesizing unit, and a display unit;

Obtaining a unit, configured to acquire a focus picture captured by the first camera according to a focus instruction of the user; and acquire a defocus picture corresponding to the focus picture captured by the second camera;

a transmission unit configured to transmit the obtained focus picture and defocused picture to the synthesizing unit;

a synthesizing unit configured to combine the obtained focus picture and the defocused picture;

The display unit is set to display the synthesized screen.

Optionally, the acquiring unit is configured to acquire a focus image captured by the first camera according to a focus instruction of the user by:

Adjusting and recording the focus position of the lens of the first camera in the binocular camera according to a preset focusing algorithm;

Obtaining a picture captured by the first camera of the binocular camera at the adjusted focus position as a focused image with a clear focus.

Optionally, the acquiring unit is configured to acquire a defocused picture corresponding to the focus picture captured by the second camera by:

Adjusting a defocus position of a lens of the second camera in the binocular camera according to the recorded focus position;

Obtaining a picture captured by the second camera in the binocular camera at the adjusted defocus position as a defocused picture of edge softening.

Optionally, the display unit is further configured to display a human-machine interaction interface for adjusting a soft focus effect;

The mobile terminal further includes a first monitoring unit, configured to send a first notification to the acquiring unit when the user selects a selection operation of the human-machine interaction interface;

The obtaining unit is configured to receive the first notification, acquire a selection operation of the user on the human-machine interaction interface, and adjust a soft focus effect of the defocused image according to the obtained user selection operation;

Wherein, the soft focus effect comprises: a softening effect and a halo effect.

Optionally, the obtaining unit is configured to:

When the first monitoring unit monitors the user sliding softening effect button, the direction and distance of the user sliding softening effect button are acquired; and the softening processing screen is adjusted in real time according to the obtained direction and distance of the user sliding softening effect button; or,

When the first monitoring unit monitors the user sliding halo effect button, the direction and distance of the user sliding halo effect button are acquired; and the halo processing screen is adjusted in real time according to the obtained direction and distance of the user sliding halo effect button.

Optionally, the mobile terminal further includes a second monitoring unit and a processing unit;

The second monitoring unit is configured to monitor a user's operation on the synthesized screen; and when the user's operation on the synthesized screen is monitored, send a second notification to the processing unit;

The processing unit is configured to receive the second notification, and perform corresponding processing on the synthesized screen according to the operation of the synthesized screen by the user;

The operation of the user on the synthesized picture includes a storage operation or a non-storage operation.

Optionally, the mobile terminal further includes a setting unit configured to set a correspondence between a direction and a distance of the user sliding the softening effect button and the softening process; setting a direction and a distance and a halo processing of the user sliding the light effect button Correspondence between them.

Optionally, the mobile terminal further includes a pre-prediction unit configured to: monitor whether the user has a specific operation on the touch screen of the mobile terminal;

Obtaining information of a specific operation when the user is monitored to have a specific operation on the touch screen of the mobile terminal;

Determining whether the obtained information of the specific operation satisfies the preset condition;

When it is determined that the obtained information of the specific operation satisfies the preset condition, the obtained information of the specific operation is recorded and the information of the specific operation recorded is taken as the focus command of the user;

Wherein, the specific operation includes a click operation or a pressing operation; the information of the specific operation includes a position, and/or a duration, and/or a force size.

Optionally, the specific operation further includes a sliding operation; the information of the specific operation may further include a sliding distance, and/or a sliding direction.

Optionally, the synthesis unit is set to:

Acquiring each first pixel of the focused picture and acquiring each second pixel of the defocused picture;

Obtaining a third pixel point by using a weighted average algorithm for the first pixel point and the second pixel point corresponding to the first pixel point;

A screen composed of each of the third pixels is used as a combined screen.

The embodiment of the invention further provides a method for processing an image, which is applied to a mobile terminal with a binocular camera, and includes:

Obtaining a focus image captured by the first camera according to a user's focus instruction;

Obtaining a defocus picture corresponding to the focus picture captured by the second camera;

The obtained focus picture and defocus picture are synthesized and the combined picture is displayed.

Optionally, the acquiring a focus image captured by the first camera according to the user's focus instruction includes:

Optionally, the acquiring the defocused image corresponding to the focus picture captured by the second camera comprises:

Optionally, the method further includes:

Displaying a human-computer interaction interface for adjusting the soft focus effect;

Monitoring and obtaining the user's selection operation on the human-computer interaction interface;

Adjusting a soft focus effect of the defocused screen according to the obtained user's selection operation;

Wherein, the soft focus effect comprises: a softening effect and a halo effect.

Optionally, the adjusting the soft focus effect of the defocusing screen according to the obtained user's selection operation comprises:

When the user sliding softening effect button is detected, the direction and distance of the user sliding softening effect button are acquired; and the softening processing screen is adjusted in real time according to the obtained direction and distance of the user sliding softening effect button; or

When the user sliding halo effect button is detected, the direction and distance of the user sliding halo effect button are acquired; the halo processing screen is adjusted in real time according to the obtained direction and distance of the user sliding halo effect button.

Optionally, the method further includes: setting a direction and a distance and a softness of the user sliding the softening effect button The correspondence between the processing; setting the correspondence between the direction and distance of the user sliding halo effect button and the halo processing.

Optionally, after the combining the obtained focus picture and the defocused picture and displaying the synthesized picture, the method further includes:

Monitoring the user's operation on the synthesized picture;

Performing corresponding processing on the synthesized screen according to the monitored user's operation on the synthesized screen;

Optionally, the synthesizing the acquired focus picture and the defocus picture include:

A screen composed of each of the third pixels is used as a combined screen.

Optionally, before the acquiring the focus image captured by the first camera according to the user's focus instruction, the method further includes:

Monitoring whether the user has a specific operation on the touch screen of the mobile terminal;

Optionally, the specific operation further includes a sliding operation; the information of the specific operation further includes a sliding distance, and/or a sliding direction.

The embodiment of the present invention further provides a computer readable storage medium storing computer executable instructions, which are implemented when the computer executable instructions are executed.

The technical solution of the embodiment of the present invention includes: an acquiring unit, a transmitting unit, a synthesizing unit, and a display unit; wherein the acquiring unit is configured to acquire a focus image captured by the first camera according to a focus instruction of the user; and acquire and focus the second camera. a defocusing picture corresponding to the picture; a transmission unit configured to transmit the obtained focus picture and the defocused picture to the synthesizing unit; a synthesizing unit configured to be combined to obtain a focused picture and a defocused picture; and a display unit configured to display the synthesized picture . The technical solution of the embodiment of the invention realizes automatic and fast synthesis of images with clear focus and edge softening, which enhances the user's experience.

Other aspects will be apparent upon reading and understanding the drawings and detailed description.

BRIEF abstract

The drawings described herein are intended to provide a further understanding of the present application, and are intended to be a part of this application. In the drawing:

1 is a schematic structural diagram of hardware of a mobile terminal that implements various embodiments of the present application;

2 is a schematic diagram of a communication system supporting communication between mobile terminals of the present application;

3 is a structural block diagram of a binocular imaging apparatus according to an embodiment of the present invention;

4 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention;

FIG. 5 is a flowchart of a method for processing an image according to an embodiment of the present invention; FIG.

FIG. 6 is a schematic diagram of a holding terminal according to an embodiment of the present invention.

FIG. 7 is a schematic diagram of a human-machine interaction interface according to an embodiment of the present invention.

Embodiments of the invention

The technical solutions of the present application will be described in more detail below with reference to the accompanying drawings and embodiments.

A mobile terminal implementing various embodiments of the present application will now be described with reference to the accompanying drawings. In the following description, the use of suffixes such as "module", "component" or "unit" for indicating an element is merely an explanation for facilitating the present application, and does not have a specific meaning per se. Therefore, "module" and "component" can be used in combination.

The mobile terminal can be implemented in various forms. For example, the terminals described in this application may include, for example, mobile phones, smart phones, notebook computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Tablets), PMPs (Portable Multimedia Players), navigation devices, and the like. Mobile terminals and fixed terminals such as digital TVs, desktop computers, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, those skilled in the art will appreciate that configurations in accordance with embodiments of the present application can be applied to fixed type terminals in addition to elements that are specifically for mobile purposes.

FIG. 1 is a schematic structural diagram of hardware of a mobile terminal that implements various embodiments of the present application.

The mobile terminal 100 may include a wireless communication unit 110, an A/V (Audio/Video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply unit 190. and many more. Figure 1 illustrates a mobile terminal having various components, but it should be understood that not all illustrated components are required to be implemented. More or fewer components can be implemented instead. The elements of the mobile terminal will be described in detail below.

Wireless communication unit 110 typically includes one or more components that permit radio communication between mobile terminal 100 and a wireless communication system or network. For example, the wireless communication unit may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short-range communication module 114, and a location information module 115.

The broadcast receiving module 111 receives a broadcast signal and/or broadcast associated information from an external broadcast management server via a broadcast channel. The broadcast channel can include a satellite channel and/or a terrestrial channel. The broadcast management server may be a server that generates and transmits a broadcast signal and/or broadcast associated information or a server that receives a previously generated broadcast signal and/or broadcast associated information and transmits it to the terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and the like. Moreover, the broadcast signal may further include a broadcast signal combined with a TV or radio broadcast signal. The broadcast associated information may also be provided via a mobile communication network, and in this case, the broadcast associated information may be received by the mobile communication module 112. The broadcast signal may exist in various forms, for example, it may exist in the form of Digital Multimedia Broadcasting (DMB) Electronic Program Guide (EPG), Digital Video Broadcasting Handheld (DVB-H) Electronic Service Guide (ESG), and the like. . The broadcast receiving module 111 can receive a signal broadcast by using various types of broadcast systems. In particular, the broadcast receiving module 111 can use forward link media (MediaFLO) by using, for example, multimedia broadcast-terrestrial (DMB-T), digital multimedia broadcast-satellite (DMB-S), digital video broadcast-handheld (DVB-H) The digital broadcasting system of the ^@ ) data broadcasting system, the terrestrial digital broadcasting integrated service (ISDB-T), and the like receives digital broadcasting. The broadcast receiving module 111 can be constructed as various broadcast systems suitable for providing broadcast signals as well as the above-described digital broadcast system. The broadcast signal and/or broadcast associated information received via the broadcast receiving module 111 may be stored in the memory 160 (or other type of storage medium).

The mobile communication module 112 transmits the radio signals to and/or receives radio signals from at least one of a base station (e.g., an access point, a Node B, etc.), an external terminal, and a server. Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received in accordance with text and/or multimedia messages.

The wireless internet module 113 supports wireless internet access of the mobile terminal. The module can be internally or externally coupled to the terminal. The wireless Internet access technologies involved in the module may include WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless Broadband), Wimax (Worldwide Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), etc. .

The short range communication module 114 is a module for supporting short range communication. Some examples of short-range communication technology include Bluetooth ^TM, a radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, etc. ^TM.

The location information module 115 is a module for checking or acquiring location information of the mobile terminal. A typical example of a location information module is GPS (Global Positioning System). According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information to accurately calculate three-dimensional current position information based on longitude, latitude, and altitude. Currently, the method for calculating position and time information uses three satellites and corrects the calculated position and time information errors by using another satellite. Further, the GPS module 115 is capable of calculating speed information by continuously calculating current position information in real time.

The A/V input unit 120 is for receiving an audio or video signal. The A/V input unit 120 may include a camera 121 and a microphone 122 that processes image data of still pictures or video obtained by the image capturing device in a video capturing mode or an image capturing mode. The processed image frame can be displayed on the display unit 151. The image frames processed by the camera 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 121 may be provided according to the configuration of the mobile terminal. The microphone 122 can receive sound (audio data) via a microphone in an operation mode of a telephone call mode, a recording mode, a voice recognition mode, and the like, And it is possible to process such sounds into audio data. The processed audio (voice) data can be converted to a format output that can be transmitted to the mobile communication base station via the mobile communication module 112 in the case of a telephone call mode. The microphone 122 can implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated during the process of receiving and transmitting audio signals.

The user input unit 130 may generate key input data according to a command input by the user to control various operations of the mobile terminal. The user input unit 130 allows the user to input various types of information, and may include a keyboard, a pot, a touch pad (eg, a touch sensitive component that detects changes in resistance, pressure, capacitance, etc. due to contact), a scroll wheel , rocker, etc. In particular, when the touch panel is superimposed on the display unit 151 in the form of a layer, a touch screen can be formed.

The sensing unit 140 detects the current state of the mobile terminal 100 (eg, the open or closed state of the mobile terminal 100), the location of the mobile terminal 100, the presence or absence of contact (ie, touch input) by the user with the mobile terminal 100, and the mobile terminal. The orientation of 100, the acceleration or deceleration movement and direction of the mobile terminal 100, and the like, and generates a command or signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is implemented as a slide type mobile phone, the sensing unit 140 can sense whether the slide type phone is turned on or off. In addition, the sensing unit 140 can detect whether the power supply unit 190 provides power or whether the interface unit 170 is coupled to an external device. Sensing unit 140 may include proximity sensor 141 which will be described below in connection with a touch screen.

The interface unit 170 serves as an interface through which at least one external device can connect with the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, and an audio input/output. (I/O) port, video I/O port, headphone port, and more. The identification module may be stored to verify various information used by the user using the mobile terminal 100 and may include a User Identification Module (UIM), a Customer Identification Module (SIM), a Universal Customer Identity Module (USIM), and the like. In addition, the device having the identification module (hereinafter referred to as "identification device") may take the form of a smart card, and thus the identification device may be connected to the mobile terminal 100 via a port or other connection device. The interface unit 170 can be configured to receive input from an external device (eg, data information, power, etc.) and transmit the received input to one or more components within the mobile terminal 100 or can be used at the mobile terminal and external device Transfer data between.

In addition, when the mobile terminal 100 is connected to an external base, the interface unit 170 can be used as an allowable The path through which power is supplied from the cradle to the mobile terminal 100 or may be used as a path through which various command signals input from the cradle are transmitted to the mobile terminal. Various command signals or power input from the base can be used as signals for identifying whether the mobile terminal is accurately mounted on the base. Output unit 150 is configured to provide an output signal (eg, an audio signal, a video signal, an alarm signal, a vibration signal, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and the like.

The display unit 151 can display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 can display a user interface (UI) or a graphical user interface (GUI) related to a call or other communication (eg, text messaging, multimedia file download, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or image and related functions, and the like.

Meanwhile, when the display unit 151 and the touch panel are superposed on each other in the form of a layer to form a touch screen, the display unit 151 can function as an input device and an output device. The display unit 151 may include at least one of a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), an organic light emitting diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as a transparent display, and a typical transparent display may be, for example, a TOLED (Transparent Organic Light Emitting Diode) display or the like. According to a particular desired embodiment, the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown) . The touch screen can be used to detect touch input pressure as well as touch input position and touch input area.

The audio output module 152 may convert audio data received by the wireless communication unit 110 or stored in the memory 160 when the mobile terminal is in a call signal receiving mode, a call mode, a recording mode, a voice recognition mode, a broadcast receiving mode, and the like. The audio signal is output as sound. Moreover, the audio output module 152 can provide audio output (eg, call signal reception sound, message reception sound, etc.) associated with a particular function performed by the mobile terminal 100. The audio output module 152 can include a speaker, a buzzer, and the like.

The alarm unit 153 can provide an output to notify the mobile terminal 100 of the occurrence of an event. Typical Events may include call reception, message reception, key signal input, touch input, and the like. In addition to audio or video output, the alert unit 153 can provide an output in a different manner to notify of the occurrence of an event. For example, the alarm unit 153 can provide an output in the form of vibrations, and when a call, message, or some other incoming communication is received, the alarm unit 153 can provide a tactile output (ie, vibration) to notify the user of it. By providing such a tactile output, the user is able to recognize the occurrence of various events even when the user's mobile phone is in the user's pocket. The alarm unit 153 can also provide an output of the notification event occurrence via the display unit 151 or the audio output module 152.

The memory 160 may store a software program or the like for processing and control operations performed by the controller 180, or may temporarily store data (for example, a phone book, a message, a still image, a video, etc.) that has been output or is to be output. Moreover, the memory 160 can store data regarding vibrations and audio signals of various manners that are output when a touch is applied to the touch screen.

The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (eg, SD or DX memory, etc.), a random access memory (RAM), a static random access memory ( SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic memory, magnetic disk, optical disk, and the like. Moreover, the mobile terminal 100 can cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.

The controller 180 typically controls the overall operation of the mobile terminal. For example, the controller 180 performs the control and processing associated with voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 181 for reproducing (or playing back) multimedia data, which may be constructed within the controller 180 or may be configured to be separate from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.

The power supply unit 190 receives external power or internal power under the control of the controller 180 and provides appropriate power required to operate the various components and components.

The various embodiments described herein can be implemented in a computer readable medium using, for example, computer software, hardware, or any combination thereof. For hardware implementations, the embodiments described herein can be implemented using an application specific integrated circuit (ASIC), digital signal processor (DSP), digital signal processing A device (DSPD), a programmable logic device (PLD), a field programmable gate array (FPGA), a processor, a controller, a microcontroller, a microprocessor, at least one of the electronic units designed to perform the functions described herein One implementation, in some cases, such an implementation may be implemented in controller 180. For software implementations, implementations such as procedures or functions may be implemented with separate software modules that permit the execution of at least one function or operation. The software code can be implemented by a software application (or program) written in any suitable programming language, which can be stored in memory 160 and executed by controller 180.

So far, the mobile terminal has been described in terms of its function. Hereinafter, for the sake of brevity, a slide type mobile terminal among various types of mobile terminals such as a folding type, a bar type, a swing type, a slide type mobile terminal, and the like will be described as an example. Therefore, the present application can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.

The mobile terminal 100 as shown in FIG. 1 may be configured to operate using a communication system such as a wired and wireless communication system and a satellite-based communication system that transmits data via frames or packets.

A communication system in which the mobile terminal according to the present application can operate will now be described with reference to FIG.

Such communication systems may use different air interfaces and/or physical layers. For example, air interfaces used by communication systems include, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and Universal Mobile Telecommunications System (UMTS) (in particular, Long Term Evolution (LTE)). ), Global System for Mobile Communications (GSM), etc. As a non-limiting example, the following description relates to a CDMA communication system, but such teachings are equally applicable to other types of systems.

Referring to FIG. 2, a CDMA wireless communication system can include a plurality of mobile terminals 100, a plurality of base stations (BS) 270, a base station controller (BSC) 275, and a mobile switching center (MSC) 280. The MSC 280 is configured to interface with a public switched telephone network (PSTN) 290. The MSC 280 is also configured to interface with a BSC 275 that can be coupled to the base station 270 via a backhaul line. The backhaul line can be constructed in accordance with any of a number of well known interfaces including, for example, E1/T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. It will be appreciated that the system as shown in FIG. 2 can include multiple BSCs 275.

Each BS 270 can serve one or more partitions (or regions), each of which is covered by a multi-directional antenna or an antenna directed to a particular direction radially away from the BS 270. Alternatively, each partition may be covered by two or more antennas for diversity reception. Each BS 270 can be configured to support multiple frequencies Rate allocation, and each frequency allocation has a specific spectrum (eg, 1.25 MHz, 5 MHz, etc.).

The intersection of partitioning and frequency allocation can be referred to as a CDMA channel. BS 270 may also be referred to as a Base Transceiver Subsystem (BTS) or other equivalent terminology. In such a case, the term "base station" can be used to generally refer to a single BSC 275 and at least one BS 270. A base station can also be referred to as a "cell station." Alternatively, each partition of a particular BS 270 may be referred to as a plurality of cellular stations.

As shown in FIG. 2, a broadcast transmitter (BT) 295 transmits a broadcast signal to the mobile terminal 100 operating within the system. A broadcast receiving module 111 as shown in FIG. 1 is provided at the mobile terminal 100 to receive a broadcast signal transmitted by the BT 295. In Figure 2, several Global Positioning System (GPS) satellites 300 are shown. The satellite 300 helps locate at least one of the plurality of mobile terminals 100.

In Figure 2, a plurality of satellites 300 are depicted, but it is understood that useful positioning information can be obtained using any number of satellites. The GPS module 115 as shown in Figure 1 is typically configured to cooperate with the satellite 300 to obtain desired positioning information. Instead of GPS tracking technology or in addition to GPS tracking technology, other techniques that can track the location of the mobile terminal can be used. Additionally, at least one GPS satellite 300 can selectively or additionally process satellite DMB transmissions.

As a typical operation of a wireless communication system, BS 270 receives reverse link signals from various mobile terminals 100. Mobile terminal 100 typically participates in calls, messaging, and other types of communications. Each reverse link signal received by a particular base station 270 is processed within a particular BS 270. The obtained data is forwarded to the relevant BSC 275. The BSC provides call resource allocation and coordinated mobility management functions including a soft handoff procedure between the BSs 270. The BSC 275 also routes the received data to the MSC 280, which provides additional routing services for interfacing with the PSTN 290. Similarly, PSTN 290 interfaces with MSC 280, which forms an interface with BSC 275, and BSC 275 controls BS 270 accordingly to transmit forward link signals to mobile terminal 100.

3 is a block diagram of a main electrical structure of a camera according to an embodiment of the present invention. The photographic lens 701 is composed of a plurality of optical lenses for forming a subject image, and is a single focus lens or a zoom lens, and in the present embodiment, the photographic lens 701 is two. The photographic lens 701 can be moved in the optical axis direction by the lens driving unit 711, and controls the focus position of the taking lens 701 based on the control signal from the lens driving control circuit 712, and also controls the focus distance in the case of the zoom lens. The lens drive control circuit 712 performs drive control of the lens drive unit 711 in accordance with a control command from the microcomputer 707.

An imaging element 702 is disposed in the vicinity of a position where the subject image is formed by the photographing lens 701 on the optical axis of the photographing lens 701. The imaging element 702 functions as an imaging unit that images an object and acquires captured image data. Photodiodes constituting each pixel are two-dimensionally arranged in a matrix on the imaging element 702. Each photodiode generates a photoelectric conversion current corresponding to the amount of received light, which is subjected to charge accumulation by a capacitor connected to each photodiode. The front surface of each pixel is provided with a Bayer array of RGB color filters.

The imaging element 702 is connected to an imaging circuit 703 that performs charge accumulation control and image signal readout control in the imaging element 702, and performs waveform shaping after reducing the reset noise of the read image signal (analog image signal). Further, gain improvement or the like is performed to obtain an appropriate signal level. The imaging circuit 703 is connected to an analog-to-digital conversion (A/D) conversion unit 704 that performs analog-to-digital conversion on the analog image signal and outputs a digital image signal (hereinafter referred to as image data) to the bus 199.

The bus 199 is a transmission path for transmitting various data read or generated inside the camera. The A/D conversion unit 704 is connected to the bus 199, and an image processor 705, a JPEG processor 706, a microcomputer 707, a dynamic random access memory (SDRAM) 708, and a memory interface are connected (hereinafter referred to as A memory I/F) 709, a liquid crystal display (LCD) driver 710.

The image processor 705 performs various types of images such as OB subtraction processing, white balance adjustment, color matrix calculation, gamma conversion, color difference signal processing, noise removal processing, simultaneous processing, edge processing, and the like on the image data based on the output of the imaging element 702. deal with. The JPEG processor 706 compresses the image data read out from the SDRAM 708 in accordance with the JPEG compression method when the image data is recorded on the recording medium 715. Further, the JPEG processor 706 performs decompression of JPEG image data for image reproduction display. At the time of decompression, the file recorded in the recording medium 715 is read, and after the compression processing is performed in the JPEG processor 706, the decompressed image data is temporarily stored in the SDRAM 708 and displayed on the LCD 716. Further, in the present embodiment, the JPEG method is employed as the image compression/decompression method. However, the compression/decompression method is not limited thereto, and other compression/decompression methods such as MPEG, TIFF, and H.264 may be employed.

The microcomputer 707 functions as a control unit of the entire camera, and collectively controls various processing sequences of the camera. The microcomputer 707 is connected to the operation unit 713 and the flash memory 714.

The operation unit 713 includes but is not limited to a physical button or a virtual button, and the entity or virtual button may be a power button, a camera button, an edit button, a dynamic image button, a reproduction button, a menu button, a cross button, an OK button, a delete button, and an enlarge button. The operation members such as various input buttons and various input keys are detected, and the operation states of these operation members are detected.

The detection result is output to the microcomputer 707. Further, a touch panel is provided on the front surface of the LCD 716 as a display portion, and the touch position of the user is detected, and the touch position is output to the microcomputer 707. The microcomputer 707 executes various processing sequences corresponding to the user's operation based on the detection result of the operation member from the operation unit 713. Also, here, the microcomputer 707 may perform various processing sequences corresponding to the user's operation based on the detection result of the touch panel in front of the LCD 716.

The flash memory 714 stores programs for executing various processing sequences of the microcomputer 707. The microcomputer 707 performs overall control of the camera in accordance with the program. Further, the flash memory 714 stores various adjustment values of the camera, and the microcomputer 707 reads out the adjustment value, and performs control of the camera in accordance with the adjustment value.

The SDRAM 708 is an electrically rewritable volatile memory for temporarily storing image data or the like. The SDRAM 708 temporarily stores the image data output from the A/D conversion unit 704 and the image data processed in the image processor 705, the JPEG processor 706, and the like.

The memory interface 709 is connected to the recording medium 715, and performs control for writing image data and a file header attached to the image data to the recording medium 715 and reading out from the recording medium 715. The recording medium 715 is, for example, a recording medium such as a memory card that can be detachably attached to the camera body. However, the recording medium 715 is not limited thereto, and may be a hard disk or the like built in the camera body.

The LCD driver 710 is connected to the LCD 716, and stores image data processed by the image processor 705 in the SDRAM. When display is required, the image data stored in the SDRAM is read and displayed on the LCD 716, or the image data stored in the JPEG processor 706 is compressed. In the SDRAM, when display is required, the JPEG processor 706 reads the compressed image data of the SDRAM, decompresses it, and displays the decompressed image data through the LCD 716.

The LCD 716 is disposed on the back of the camera body or the like to perform image display. The LCD 716 is provided with a touch panel that detects a user's touch operation. Further, as the display portion, the liquid crystal display panel (LCD 716) is disposed in the present embodiment. However, the present invention is not limited thereto, and various display panels such as an organic EL may be employed.

Based on the hardware structure of the mobile terminal and the communication system, the solution of the embodiment of the present invention is proposed.

The binocular camera is a common component structure. The binocular camera is fixedly placed on the back of the mobile terminal. Its advantage is that the imaging speed is fast, the picture is clear, and the depth of field effect can be simulated. The binocular camera imaging system can obtain the left eye image and the right eye image at the same time, and the left eye image and the right eye image are processed by the imaging processing software to form an original image requiring preview framing. The inventors have found that the function of the binocular camera described above can be used to achieve softening of the framing photo.

4 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention. The mobile terminal includes a binocular camera. As shown in FIG. 4, the mobile terminal includes an acquiring unit 40, a transmitting unit 41, a synthesizing unit 42, and a display unit 43. among them,

The obtaining unit 40 is configured to acquire a focus picture captured by the first camera according to the focus instruction of the user, and acquire a defocus picture corresponding to the focus picture captured by the second camera.

The acquiring unit 40 is configured to acquire the focus image captured by the first camera according to the user's focus instruction by:

Obtain the image captured by the first camera in the binocular camera at the adjusted focus position as a focused focus image.

The obtaining unit 40 is configured to acquire a defocused screen corresponding to the focus picture captured by the second camera by:

The picture captured by the second camera in the binocular camera at the adjusted defocus position is obtained as a defocused picture of the edge softening.

Optionally, the obtaining unit 40 is configured to receive the first notification, obtain a selection operation of the user in the human-machine interaction interface, and adjust a soft focus effect of the defocused image according to the obtained user selection operation;

Among them, the soft focus effect includes: a softening effect and a halo effect.

The transmission unit 41 is arranged to transmit the obtained focus picture and defocus picture to the synthesizing unit 42.

The synthesizing unit 42 is configured to synthesize the obtained focus picture and defocus picture.

It should be noted that, as to how to synthesize the focus picture and the defocus picture, it is a conventional technique well known to those skilled in the art, and the method of synthesizing the focus picture and the defocus picture is not used to limit the present application.

For example, the synthesizing unit 42 may synthesize the obtained focus picture and defocus picture by the following method:

A screen composed of each of the third pixels is used as a combined screen.

The display unit 43 is arranged to display the synthesized screen.

Optionally, the display unit 43 is further configured to display a human-computer interaction interface for adjusting the soft focus effect.

The human-computer interaction interface for adjusting the soft focus effect is as shown in FIG. 7. When the user slides the soft effect button, the direction and distance of the user sliding softening effect button are obtained through the pressure sensor; according to the obtained user sliding softening effect button The direction and distance of the real-time display is the softened screen corresponding to the direction and distance of the user's sliding softening effect button; or, when the user slides the halo effect button, the direction of the user sliding halo effect button is obtained by the pressure sensor And the distance; according to the direction and distance of the obtained user sliding halo effect button, the real-time display shows the halo-processed screen corresponding to the direction and distance of the user's sliding halo effect button. Optionally, the mobile terminal further includes a setting unit configured to set a correspondence between a direction and a distance of the user sliding the softening effect button and the softening process; setting a direction and a distance and a halo processing of the user sliding the light effect button Correspondence between them.

Optionally, the mobile terminal further includes a first monitoring unit 44 configured to monitor a user's selection operation on the human-machine interaction interface; and when the user selects a selection operation of the human-computer interaction interface, send the first notification to the obtaining unit 40. .

Optionally, the mobile terminal further includes a second monitoring unit 45 and a processing unit 46;

The second monitoring unit 45 is configured to monitor the user's operation on the synthesized screen; when the user's operation on the synthesized screen is monitored, the second notification is sent to the processing unit 46;

The processing unit 46 is configured to receive the second notification, and perform corresponding processing on the synthesized screen according to the operation of the synthesized screen by the user;

Wherein, when the information of the specific operation includes the location and the duration, the pre-prediction unit is configured to determine whether the obtained information of the specific operation satisfies the preset condition by:

Determining whether the obtained duration is greater than or equal to the duration threshold; when it is determined that the obtained duration is greater than or equal to the duration threshold, determining that the obtained specific operation information satisfies the preset condition;

When it is judged that the obtained duration is less than the duration threshold, it is judged that the obtained information of the specific operation does not satisfy the preset condition.

Wherein, when the information of the specific operation includes the location and the force size, the pre-prediction unit is configured to determine whether the obtained information of the specific operation satisfies the preset condition by:

Determining whether the obtained force is greater than or equal to the pressure threshold;

When it is determined that the obtained force amount is greater than or equal to the pressure threshold, it is determined that the obtained specific operation information satisfies the preset condition;

When it is judged that the obtained force is smaller than the pressure threshold, it is judged that the obtained information of the specific operation does not satisfy the preset condition.

Wherein, when the information of the specific operation includes the position and the force size and the duration, the pre-prediction unit is configured to judge whether the obtained information of the specific operation satisfies the preset condition by:

Determining whether the obtained force is greater than or equal to the pressure threshold; and determining whether the obtained duration is greater than or equal to the duration threshold;

When it is judged that the obtained force is smaller than the pressure threshold, and it is judged that the obtained duration is greater than Or equal to the duration threshold, it is determined that the obtained information of the specific operation satisfies the preset condition;

When it is determined that the obtained duration is less than the duration threshold, or it is determined that the obtained force is smaller than the pressure threshold, it is determined that the obtained specific operation information does not satisfy the preset condition.

Optionally, the specific operation may further include a sliding operation; the information of the specific operation may further include a sliding distance, and/or a sliding direction.

Wherein, when the information of the specific operation includes the sliding direction, the pre-prediction unit is configured to determine whether the obtained information of the specific operation satisfies the preset condition by:

Determining whether the obtained sliding direction is in a preset direction;

When it is determined that the obtained sliding direction is in the preset direction, it is determined that the obtained information of the specific operation satisfies the preset condition;

When it is judged that the obtained sliding direction is not in the preset direction, it is judged that the obtained information of the specific operation does not satisfy the preset condition.

Wherein, when the information of the specific operation includes the sliding distance, the pre-prediction unit is configured to determine whether the obtained information of the specific operation satisfies the preset condition by:

Determining whether the obtained sliding distance is greater than or equal to a preset distance threshold;

When it is determined that the obtained sliding distance is greater than or equal to the preset distance threshold, it is determined that the obtained specific operation information satisfies the preset condition;

When it is determined that the obtained sliding distance is less than the preset distance threshold, it is determined that the obtained information of the specific operation does not satisfy the preset condition.

Wherein, when the information of the specific operation includes the sliding direction and the sliding distance, the pre-prediction unit is configured to determine whether the obtained information of the specific operation satisfies the preset condition by:

Determining whether the obtained sliding direction is in a preset direction; and determining whether the obtained sliding distance is greater than or equal to a preset distance threshold;

When it is determined that the obtained sliding direction is in the preset direction, and the obtained sliding distance is greater than or equal to the preset distance threshold, it is determined that the obtained specific operation information satisfies the preset condition;

When it is determined that the obtained sliding direction is not in the preset direction, or it is determined that the obtained sliding distance is less than the preset distance threshold, it is determined that the obtained specific operation information does not satisfy the preset condition.

It should be noted that the first monitoring unit 40 and the second monitoring unit 45 in the mobile terminal provided by the embodiment of the present invention may be disposed in the sensing unit 140 in FIG. 1, and the obtaining module 40 and the transmitting module 41 may be disposed in the figure. In the camera 121 of 1, the display unit 43 may be disposed in the display unit 151 in FIG. 1, and the synthesizing unit 42 and the processing unit 46 may be disposed in the controller 180 in FIG. However, this application is not limited thereto.

FIG. 5 is a flowchart of a method for processing an image according to an embodiment of the present invention, which is applied to a mobile terminal with a binocular camera, as shown in FIG. 5, and includes:

Step 501: Acquire a focus picture captured by the first camera according to a focus instruction of the user.

Wherein, the binocular camera comprises a first camera and a second camera.

This step can include:

Optionally, before the step, the method further includes: monitoring whether the user has a specific operation on the touch screen of the mobile terminal;

Wherein, when the information of the specific operation includes the location and the duration, it is determined whether the obtained information of the specific operation satisfies the preset condition, including:

Wherein, when the information of the specific operation includes the location and the magnitude of the force, determining whether the obtained information of the specific operation meets the preset condition comprises: determining whether the obtained force is greater than or equal to the pressure threshold;

Wherein, when the information of the specific operation includes the position and the force size and the duration, it is determined whether the obtained information of the specific operation satisfies the preset condition, including:

When it is determined that the obtained force is smaller than the pressure threshold, and it is determined that the obtained duration is greater than or equal to the duration threshold, it is determined that the obtained specific operation information satisfies the preset condition;

Wherein, when the information of the specific operation includes the sliding direction, it is determined whether the obtained information of the specific operation satisfies the preset condition, including:

Determining whether the obtained sliding direction is in a preset direction;

Wherein, when the information of the specific operation includes the sliding distance, the information of the specific operation obtained is judged Whether the preset conditions are met, including:

Wherein, when the information of the specific operation includes the sliding direction and the sliding distance, it is determined whether the obtained information of the specific operation satisfies the preset condition, including:

It should be noted that determining whether the obtained specific operation information satisfies the preset condition is to avoid the influence of the user's misoperation on the subsequent process of the embodiment of the present invention.

Optionally, the method further includes: ending the process when it is determined that the obtained information of the specific operation does not satisfy the preset condition.

Among them, the information of the specific operation can be obtained through the pressure sensor. The pressure sensor may be located in the display area of the mobile terminal, or may be located in the interactive area of the display of the mobile terminal and the side of the mobile terminal. FIG. 6 is an example in which the mobile terminal is held by the right hand, and an example of holding the mobile terminal with the left hand is not described again.

Step 502: Acquire a defocus picture corresponding to the focus picture captured by the second camera.

This step can include:

It should be noted that the method for adjusting the defocus position according to the focus position is a conventional technical means well known to those skilled in the art, and is not described herein again, and is not intended to limit the application.

Optionally, the method further includes:

Adjusting the soft focus effect of the defocused screen according to the obtained user's selection operation;

The human-computer interaction interface for adjusting the soft focus effect is as shown in FIG. 7. When the user slides the soft effect button, the direction and distance of the user sliding softening effect button are obtained through the pressure sensor; according to the obtained user sliding softening effect button The direction and distance of the real-time display is the softened screen corresponding to the direction and distance of the user's sliding softening effect button; or, when the user slides the halo effect button, the direction of the user sliding halo effect button is obtained by the pressure sensor And the distance; according to the direction and distance of the obtained user sliding halo effect button, the real-time display shows the halo-processed screen corresponding to the direction and distance of the user's sliding halo effect button. Optionally, the method further includes: setting a correspondence between a direction and a distance of the user sliding the softening effect button and the softening process; setting a correspondence between a direction and a distance of the user sliding the light effect button and the halo processing .

Step 503: synthesize the obtained focus picture and defocus picture and display the synthesized picture.

If you can use the following methods to synthesize the obtained focus picture and defocus picture:

A screen composed of each of the third pixels is used as a combined screen.

Optionally, after step 503, the method further includes:

Monitoring the user's operation on the synthesized picture;

In the method of the embodiment of the invention, by acquiring the focus picture and the defocus picture, synthesizing and displaying the focus picture and the defocus picture, WYSIWYG is realized, thereby realizing automatic and fast synthesis of the image with clear focus and edge softening. , enhance the user's experience.

It is to be understood that the term "comprises", "comprising", or any other variants thereof, is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device comprising a series of elements includes those elements. It also includes other elements that are not explicitly listed, or elements that are inherent to such a process, method, article, or device. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.

The serial numbers of the embodiments of the present invention are merely for the description, and do not represent the advantages and disadvantages of the embodiments.

Through the description of the above embodiments, those skilled in the art can clearly understand that the foregoing embodiment method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be through hardware, but in many cases, the former is better. Implementation. Based on such understanding, the technical solution of the present application, which is essential or contributes to the related art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, CD-ROM). The instructions include a number of instructions for causing a terminal device (which may be a cell phone, computer, server, air conditioner, or network device, etc.) to perform the methods described in various embodiments of the present application.

The above is only a preferred embodiment of the present application, and is not intended to limit the scope of the patent application, and the equivalent structure or equivalent process transformations made by the specification and the drawings of the present application, or directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of this application.

Industrial applicability

The embodiment of the present application provides a mobile terminal and a method for processing an image thereof, which realizes an automatic and fast synthesis of an image with clear focus and edge softening, which enhances the user experience.

Claims

a mobile terminal, comprising: a binocular camera, the mobile terminal comprising: an acquisition unit, a transmission unit, a synthesizing unit and a display unit; wherein

Obtaining a unit, configured to acquire a focus picture captured by the first camera according to a focus instruction of the user; and acquire a defocus picture corresponding to the focus picture captured by the second camera;

a transmission unit configured to transmit the obtained focus picture and defocused picture to the synthesizing unit;

a synthesizing unit configured to combine the obtained focus picture and the defocused picture;

The display unit is set to display the synthesized screen.
The mobile terminal of claim 1, wherein the acquisition unit is configured to acquire a focus image captured by the first camera according to a focus instruction of the user by:

Adjusting and recording the focus position of the lens of the first camera in the binocular camera according to a preset focusing algorithm;

Obtaining a picture captured by the first camera of the binocular camera at the adjusted focus position as a focused image with a clear focus.
The mobile terminal of claim 2, wherein the acquisition unit is configured to acquire a defocused picture corresponding to the focused picture captured by the second camera by:

Adjusting a defocus position of a lens of the second camera in the binocular camera according to the recorded focus position;

Obtaining a picture captured by the second camera in the binocular camera at the adjusted defocus position as a defocused picture of edge softening.
The mobile terminal according to claim 1, wherein the display unit is further configured to display a human-machine interaction interface for adjusting a soft focus effect;

The mobile terminal further includes a first monitoring unit, configured to send a first notification to the acquiring unit when the user selects a selection operation of the human-machine interaction interface;

The obtaining unit is configured to receive the first notification, acquire a selection operation of the user on the human-machine interaction interface, and adjust a soft focus effect of the defocused image according to the obtained user selection operation;

Wherein, the soft focus effect comprises: a softening effect and a halo effect.
The mobile terminal of claim 4, wherein the obtaining unit is configured to:

When the first monitoring unit monitors the user sliding softening effect button, the direction and distance of the user sliding softening effect button are acquired; and the softening processing screen is adjusted in real time according to the obtained direction and distance of the user sliding softening effect button; or,

When the first monitoring unit monitors the user sliding halo effect button, the direction and distance of the user sliding halo effect button are acquired; and the halo processing screen is adjusted in real time according to the obtained direction and distance of the user sliding halo effect button.
The mobile terminal according to claim 5, further comprising a setting unit configured to set a correspondence between a direction and a distance of the user sliding the softening effect button and the softening process; and setting a direction of the user sliding the light effect button And the correspondence between distance and halo processing.
The mobile terminal according to any one of claims 1 to 6, further comprising a second monitoring unit and a processing unit; wherein

The second monitoring unit is configured to monitor a user's operation on the synthesized screen; and when the user's operation on the synthesized screen is monitored, send a second notification to the processing unit;

The processing unit is configured to receive the second notification, and perform corresponding processing on the synthesized screen according to the operation of the synthesized screen by the user;

The operation of the user on the synthesized picture includes a storage operation or a non-storage operation.
The mobile terminal according to claim 1, further comprising a pre-prediction unit configured to: monitor whether the user has a specific operation on the touch screen of the mobile terminal;

Obtaining information of a specific operation when the user is monitored to have a specific operation on the touch screen of the mobile terminal;

Determining whether the obtained information of the specific operation satisfies the preset condition;

When it is determined that the obtained information of the specific operation satisfies the preset condition, the obtained information of the specific operation is recorded and the information of the specific operation recorded is taken as the focus command of the user;

Wherein, the specific operation includes a click operation or a pressing operation; the information of the specific operation includes a position, and/or a duration, and/or a force size.
The mobile terminal of claim 8, wherein the specific operation further comprises a sliding operation The information for a particular operation may also include a sliding distance, and/or a sliding direction.
The mobile terminal of claim 1, wherein the synthesizing unit is configured to:

Acquiring each first pixel of the focused picture and acquiring each second pixel of the defocused picture;

Obtaining a third pixel point by using a weighted average algorithm for the first pixel point and the second pixel point corresponding to the first pixel point;

A screen composed of each of the third pixels is used as a combined screen.
A method for processing an image is applied to a mobile terminal having a binocular camera built therein, including:

Obtaining a focus image captured by the first camera according to a user's focus instruction;

Obtaining a defocus picture corresponding to the focus picture captured by the second camera;

The obtained focus picture and defocus picture are synthesized and the combined picture is displayed.
The method according to claim 11, wherein the acquiring a focus image captured by the first camera according to a focus instruction of the user comprises:

Adjusting and recording the focus position of the lens of the first camera in the binocular camera according to a preset focusing algorithm;

Obtaining a picture captured by the first camera of the binocular camera at the adjusted focus position as a focused image with a clear focus.
The method according to claim 12, wherein the acquiring the defocused image corresponding to the focus picture captured by the second camera comprises:

Adjusting a defocus position of a lens of the second camera in the binocular camera according to the recorded focus position;

Obtaining a picture captured by the second camera in the binocular camera at the adjusted defocus position as a defocused picture of edge softening.
The method of claim 11 further comprising:

Displaying a human-computer interaction interface for adjusting the soft focus effect;

Monitoring and obtaining the user's selection operation on the human-computer interaction interface;

Adjusting a soft focus effect of the defocused screen according to the obtained user's selection operation;

Wherein, the soft focus effect comprises: a softening effect and a halo effect.
The method according to claim 14, wherein the adjusting the soft focus effect of the defocused picture according to the obtained user's selection operation comprises:

When the user sliding softening effect button is detected, the direction and distance of the user sliding softening effect button are acquired; and the softening processing screen is adjusted in real time according to the obtained direction and distance of the user sliding softening effect button; or

When the user sliding halo effect button is detected, the direction and distance of the user sliding halo effect button are acquired; the halo processing screen is adjusted in real time according to the obtained direction and distance of the user sliding halo effect button.
The method according to claim 15, further comprising: setting a correspondence between a direction and a distance of the user sliding softening effect button and the softening process; setting a direction and distance of the user sliding light effect button and a halo processing Correspondence between them.
The method according to any one of claims 11 to 16, after the combining the obtained focused picture and the defocused picture and displaying the synthesized picture, the method further comprises:

Monitoring the user's operation on the synthesized picture;

Performing corresponding processing on the synthesized screen according to the monitored user's operation on the synthesized screen;

The operation of the user on the synthesized picture includes a storage operation or a non-storage operation.
The method according to claim 11, wherein the synthesizing the acquired focus picture and the defocus picture comprises:

Acquiring each first pixel of the focused picture and acquiring each second pixel of the defocused picture;

Obtaining a third pixel point by using a weighted average algorithm for the first pixel point and the second pixel point corresponding to the first pixel point;

A screen composed of each of the third pixels is used as a combined screen.
The method according to claim 11, wherein the method further comprises: before acquiring the focus picture captured by the first camera according to the user's focus instruction, the method further comprising:

Monitoring whether the user has a specific operation on the touch screen of the mobile terminal;

Obtaining information of a specific operation when the user is monitored to have a specific operation on the touch screen of the mobile terminal;

Determining whether the obtained information of the specific operation satisfies the preset condition;

When it is determined that the obtained information of the specific operation satisfies the preset condition, the obtained information of the specific operation is recorded and the information of the specific operation recorded is taken as the focus command of the user;

Wherein, the specific operation includes a click operation or a pressing operation; the information of the specific operation includes a position, and/or a duration, and/or a force size.
The method of claim 19, wherein the specific operation further comprises a sliding operation; the information of the specific operation further comprises a sliding distance, and/or a sliding direction.