CN107809586B

CN107809586B - Mobile terminal focusing mode switching method, mobile terminal and storage medium

Info

Publication number: CN107809586B
Application number: CN201711047261.9A
Authority: CN
Inventors: 姬向东
Original assignee: Nubia Technology Co Ltd
Current assignee: Nubia Technology Co Ltd
Priority date: 2017-10-31
Filing date: 2017-10-31
Publication date: 2020-09-01
Anticipated expiration: 2037-10-31
Also published as: CN107809586A

Abstract

The invention discloses a method for switching focusing modes of a mobile terminal, the mobile terminal and a storage medium; the method comprises the following steps: detecting a focusing operation of the mobile terminal; acquiring a first image corresponding to a left pixel point and a second image corresponding to a right pixel point; performing feature extraction on the first image and the second image; determining the reliability of the focusing operation which is currently performed based on the extracted features of the first image and the second image; and switching the focusing modes when determining that preset focusing mode switching conditions are met based on the focusing mode adopted by the current focusing operation and the determined reliability of the current focusing operation.

Description

Mobile terminal focusing mode switching method, mobile terminal and storage medium

Technical Field

The present invention relates to the field of electronic technologies, and in particular, to a method for switching a focusing mode of a mobile terminal, and a storage medium.

Background

When a user uses a mobile terminal to shoot an image, the shot image needs to be focused. The focusing process is a process of changing the object distance and the image distance through a focusing mechanism of the mobile terminal so that the shot object can be clearly imaged.

Currently, the image focusing method mainly includes Phase Detection Auto Focus (PDAF) and Contrast Detection Auto Focus (CAF); in contrast focusing, the requirement for light is high, and correspondingly, although the focusing speed is low, the requirement for light is low, and both have advantages and disadvantages. However, how to freely switch the focusing mode according to the requirement of the actual shooting effect (focusing effect) has not been an effective solution in the related art.

Disclosure of Invention

In view of the above, embodiments of the present invention provide a method for switching a focus mode of a mobile terminal, a mobile terminal and a storage medium to solve at least one problem in the prior art.

The technical scheme of the embodiment of the invention is realized as follows:

the embodiment of the invention provides a method for switching focusing modes of a mobile terminal, which comprises the following steps:

detecting a focusing operation of the mobile terminal;

acquiring a first image corresponding to a left pixel point and a second image corresponding to a right pixel point;

performing feature extraction on the first image and the second image;

determining the reliability of the focusing operation which is currently performed based on the extracted features of the first image and the second image;

and switching the focusing modes when determining that preset focusing mode switching conditions are met based on the focusing mode adopted by the current focusing operation and the determined reliability of the current focusing operation.

In the foregoing solution, the determining the reliability of the currently performed focusing operation based on the extracted features of the first image and the second image includes:

performing feature matching on the extracted features of the first image and the corresponding features of the second image to obtain the image matching degree of the first image and the second image;

and determining the reliability of the focusing operation based on the image matching degree of the first image and the second image.

In the foregoing scheme, the performing feature matching on the extracted features of the first image and the corresponding features of the second image to obtain the image matching degree between the first image and the second image includes:

performing edge matching on the extracted edge of the first image and the extracted edge of the second image;

determining the image matching degree of the first image and the second image based on the number of matched same edges in the first image and the second image.

In the foregoing scheme, the performing feature matching on the extracted features of the first image and the corresponding features of the second image to obtain the matching degree between the first image and the second image includes:

comparing the edge strength of the matched same edges in the first image and the second image;

determining the image matching degree of the first image and the second image based on the number of matched same edges and the ratio of the edge strength of the same edges.

In the foregoing solution, when it is determined that a preset focusing mode switching condition is satisfied based on a focusing mode adopted by a current focusing operation and the determined reliability of the current focusing operation, switching the focusing mode includes:

responding to that the focusing mode adopted by the current focusing operation is a first focusing mode, and if the determined reliability of the current focusing operation is lower than a preset first reliability threshold value, switching the first focusing mode to a second focusing mode of different modes.

and responding to that the focusing mode adopted by the current focusing operation is a second focusing mode, and if the determined reliability of the current focusing operation is higher than a preset second reliability threshold value, switching the second focusing mode into a first focusing mode of different modes.

An embodiment of the present invention further provides a mobile terminal, where the mobile terminal includes:

the memory is used for storing a processing program of a switching method of the focusing mode of the mobile terminal;

the processor is used for executing the processing program of the switching method of the focusing mode of the mobile terminal stored in the memory so as to realize the following steps:

detecting a focusing operation of the mobile terminal;

performing feature extraction on the first image and the second image;

In the foregoing solution, the processor is further configured to, when executing a processing program of a method for switching a focusing mode of a mobile terminal stored in the memory, implement:

obtaining the reliability of focusing operation corresponding to the first focusing mode;

and switching the focusing modes when determining that a preset focusing mode switching condition is met based on the reliability of the focusing operation corresponding to the first focusing mode.

The embodiment of the invention also provides a storage medium, which is characterized in that an executable program is stored, and when the executable program is executed by a processor, the switching method of the focusing mode of the mobile terminal is realized.

By applying the switching method of the focusing mode of the mobile terminal, the mobile terminal and the storage medium in the embodiment of the invention, the focusing operation of the mobile terminal is detected; acquiring a first image corresponding to a left pixel point and a second image corresponding to a right pixel point; performing feature extraction on the first image and the second image; determining the reliability of the focusing operation which is currently performed based on the extracted features of the first image and the second image; and switching the focusing modes when determining that preset focusing mode switching conditions are met based on the focusing mode adopted by the current focusing operation and the determined reliability of the current focusing operation. Therefore, the terminal adapts the current focusing mode according to the focusing mode adopted by the current focusing operation and the reliability of the current focusing operation, so that the focusing effect and the focusing efficiency are improved, the shooting effect of a user is better, and the user experience is enhanced.

Drawings

Fig. 1 is a schematic hardware configuration diagram of an alternative mobile terminal 100 implementing various embodiments of the present invention;

FIG. 2 is a diagram of a wireless communication system for the mobile terminal 100 shown in FIG. 1;

FIG. 3 is a schematic view illustrating an alternative flow chart of a method for switching a focusing mode of a mobile terminal according to an embodiment of the present invention;

FIG. 4 is a schematic view illustrating an alternative flow chart of a method for switching a focusing mode of a mobile terminal according to an embodiment of the present invention;

fig. 5 is an alternative schematic diagram of a composition structure of a mobile terminal in an embodiment of the present invention.

Detailed Description

It should be understood that the embodiments described herein are only for explaining the technical solutions of the present invention, and are not intended to limit the scope of the present invention.

A mobile terminal implementing various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in themselves. Thus, "module" and "component" may be used in a mixture.

The mobile terminal may be implemented in various forms. For example, the terminal described in the present invention may include a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a Personal Digital Assistant (PDA), a tablet computer (PAD), a Portable Multimedia Player (PMP), a navigation device, etc., and a stationary terminal such as a digital TV, a desktop computer, etc. In the following, it is assumed that the terminal is a mobile terminal. However, it will be understood by those skilled in the art that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal in addition to elements particularly used for moving purposes.

Fig. 1 is a schematic hardware structure of a mobile terminal 100 for implementing various embodiments of the present invention, and as shown in fig. 1, the mobile terminal 100 may include: RF (Radio Frequency) unit 101, WiFi module 102, audio output unit 103, a/V (audio/video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111. Those skilled in the art will appreciate that the mobile terminal architecture shown in fig. 1 is not intended to be limiting of mobile terminals, which may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

The following describes each component of the mobile terminal in detail with reference to fig. 1:

the radio frequency unit 101 may be configured to receive and transmit signals during information transmission and reception or during a call, and specifically, receive downlink information of a base station and then process the downlink information to the processor 110; in addition, the uplink data is transmitted to the base station. Typically, radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with a network and other devices through wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communications), GPRS (General Packet Radio Service), CDMA2000(Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division duplex-Long Term Evolution), and TDD-LTE (Time Division duplex-Long Term Evolution).

WiFi belongs to short-distance wireless transmission technology, and the mobile terminal can help a user to receive and send e-mails, browse webpages, access streaming media and the like through the WiFi module 102, and provides wireless broadband internet access for the user. Although fig. 2 shows the WiFi module 102, it is understood that it does not belong to the essential constitution of the mobile terminal, and may be omitted entirely as needed within the scope not changing the essence of the invention.

The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output as sound when the mobile terminal 100 is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, and the like.

The a/V input unit 104 is used to receive audio or video signals. The a/V input Unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, the Graphics processor 1041 Processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphic processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 may receive sound (audio data) via the microphone 1042 in an operation mode such as a phone call mode, a recording mode, a voice recognition mode, and the like, and can process such sound into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 101 in case of a phone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.

The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 1061 and/or a backlight when the mobile terminal 100 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when stationary, and can be used for applications of recognizing the posture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured on the mobile phone, further description is omitted here.

The display unit 106 is used to display information input by a user or information provided to the user. The Display unit 106 may include a Display panel 1061, and the Display panel 1061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 107 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the mobile terminal. Specifically, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also referred to as a touch screen, may collect a touch operation performed by a user on or near the touch panel 1071 (e.g., an operation performed by the user on or near the touch panel 1071 using a finger, a stylus, or any other suitable object or accessory), and drive a corresponding connection device according to a predetermined program. The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 110, and can receive and execute commands sent by the processor 110. In addition, the touch panel 1071 may be implemented in various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may include other input devices 1072. In particular, other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like, and are not limited to these specific examples.

In some embodiments, the touch panel 1071 may cover the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or nearby, the touch panel 1071 transmits the touch operation to the processor 110 to determine the type of the touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Although the touch panel 1071 and the display panel 1061 are shown in fig. 2 as two separate components to implement the input and output functions of the mobile terminal, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to implement the input and output functions of the mobile terminal, and is not limited herein.

The interface unit 108 serves as an interface through which at least one external device is connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from external devices and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and external devices.

The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 109 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 110 is a control center of the mobile terminal, connects various parts of the entire mobile terminal using various interfaces and lines, and performs various functions of the mobile terminal and processes data by operating or executing software programs and/or modules stored in the memory 109 and calling data stored in the memory 109, thereby performing overall monitoring of the mobile terminal. Processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.

The mobile terminal 100 may further include a power supply 111 (e.g., a battery) for supplying power to various components, and preferably, the power supply 111 may be logically connected to the processor 110 via a power management system, so as to manage charging, discharging, and power consumption management functions via the power management system.

Although not shown in fig. 1, the mobile terminal 100 may further include a bluetooth module or the like, which is not described in detail herein.

In order to facilitate understanding of the embodiments of the present invention, a communication network system on which the mobile terminal of the present invention is based is described below.

Referring to fig. 2, fig. 2 is an architecture diagram of a communication Network system according to an embodiment of the present invention, where the communication Network system is an LTE system of a universal mobile telecommunications technology, and the LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203, and an IP service 204 of an operator, which are in communication connection in sequence.

Specifically, the UE201 may be the terminal 100 described above, and is not described herein again.

The E-UTRAN202 includes eNodeB2021 and other eNodeBs 2022, among others. Among them, the eNodeB2021 may be connected with other eNodeB2022 through backhaul (e.g., X2 interface), the eNodeB2021 is connected to the EPC203, and the eNodeB2021 may provide the UE201 access to the EPC 203.

The EPC203 may include an MME (Mobility Management Entity) 2031, an HSS (Home Subscriber Server) 2032, other MMEs 2033, an SGW (Serving gateway) 2034, a PGW (PDN gateway) 2035, and a PCRF (Policy and charging functions Entity) 2036, and the like. The MME2031 is a control node that handles signaling between the UE201 and the EPC203, and provides bearer and connection management. HSS2032 is used to provide registers to manage functions such as home location register (not shown) and holds subscriber specific information about service characteristics, data rates, etc. All user data may be sent through SGW2034, PGW2035 may provide IP address assignment for UE201 and other functions, and PCRF2036 is a policy and charging control policy decision point for traffic data flow and IP bearer resources, which selects and provides available policy and charging control decisions for a policy and charging enforcement function (not shown).

The IP services 204 may include the internet, intranets, IMS (IP Multimedia Subsystem), or other IP services, among others.

Although the LTE system is described as an example, it should be understood by those skilled in the art that the present invention is not limited to the LTE system, but may also be applied to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, and future new network systems.

Based on the above mobile terminal hardware structure and communication network system, the present invention provides various embodiments of the method.

Before further detailed description of the embodiments of the present invention, two focusing modes related to the embodiments of the present invention are described, but in practical applications, the focusing modes may be various and are not limited to the following two modes.

The method comprises the steps that phase focusing is carried out, pixel points of an image sensor are formed by left and right pixel points in pairs, a mobile terminal obtains a first image through the left pixel points, a second image is obtained through the right pixel points, the mobile terminal respectively generates an image data waveform corresponding to the first image and an image data waveform corresponding to the second image, when the data waveforms of the first image and the second image are superposed, the current state of focusing is known, the shot image is the clearest at the moment, namely, the mobile terminal guides focusing through the phase difference of the two data waveforms, shielding pixel points are reserved on a photosensitive element and used for carrying out phase detection, the detected phase difference is converted into an out-of-focus rate, and the focusing is guided through the out-of-focus rate, so that accurate focusing is realized. The focusing mode does not need repeated movement of a lens and a focusing process block, but on the other hand, because shielding pixel points on the image sensor are needed to carry out phase detection, the requirement of the focusing mode on light intensity is higher, the focusing mode is not easy to realize under weak light, and the application range is limited.

And (4) contrast type focusing, wherein the focusing mode searches the lens position with the maximum contrast, namely the accurate focusing position according to the contrast change of the picture at the focus. In the focusing process, the picture is gradually clear and the contrast ratio begins to rise along with the movement of the focusing lens, when the picture is clearest and the contrast ratio is highest, the picture is in a focusing state, but the terminal does not know, so the lens can be continuously moved, when the contrast ratio begins to fall, the lens is further moved, the contrast ratio is further reduced, the terminal knows that the focus is missed, and the lens retreats to the position with the highest contrast ratio to finish focusing. Therefore, in the focusing process of the focusing mode, the lens needs to move continuously from the beginning of focusing to the end of focusing, and moves back after passing through the optimal focusing position, so that the focusing stroke is increased in the whole process, the focusing speed is low, and the efficiency is low.

Based on the above descriptions of the phase focus mode and the contrast focus mode, the following further describes in detail embodiments of the present invention.

Example one

Fig. 3 is a method for switching a focusing mode of a mobile terminal according to an embodiment of the present invention, which is applied to a mobile terminal, and as shown in fig. 3, the method for switching a focusing mode of a mobile terminal according to an embodiment of the present invention includes:

step 301: and detecting the focusing operation of the mobile terminal.

In practical applications, when a user uses the mobile terminal to shoot, the mobile terminal detects a shooting instruction triggered by the user, performs a focusing operation in image acquisition, and further triggers the subsequent operations from step 302 to step 305.

In the embodiment of the present invention, the image capturing device of the mobile terminal has at least two focusing modes, which are a phase focusing mode and a contrast focusing mode, respectively.

Step 302: and acquiring a first image corresponding to the left pixel point and a second image corresponding to the right pixel point.

In practical implementation, the mobile terminal has a phase focusing mode, so that the mobile terminal can obtain a first image through a left pixel point of an image sensor of the mobile terminal and obtain a second image through a right pixel point of the image sensor.

Step 303: and performing feature extraction on the first image and the second image.

Here, in practical implementation, the extracted features of the image may include one or more of: edges, corners, areas, etc.

In an embodiment, the extracted features of the image may be edges, and feature extraction of the first image and the second image is achieved through edge detection.

The edge of an image refers to a set of those pixels whose surrounding pixels have sharp changes in gray, which is the most basic feature of an image, and the edge exists in objects, backgrounds, and areas. The basic idea of edge detection is to detect edge points in an image, and then connect the edge points into a contour according to a certain strategy, thereby forming a segmentation region.

Step 304: and determining the reliability of the focusing operation which is currently performed based on the extracted features of the first image and the second image.

In practical application, the extracted features of the first image and the features of the corresponding second image are subjected to feature matching to obtain the image matching degree of the first image and the second image;

In an embodiment, the degree of image matching between the first image and the second image may be obtained by:

performing edge matching on the extracted edge of the first image and the extracted edge of the second image; determining the image matching degree of the first image and the second image based on the number of matched same edges in the first image and the second image.

Exemplarily, the following steps are carried out: the number of the edges in the first image is 80 through edge detection, the number of the edges in the second image is 90, the 80 edges are identical through feature matching, the matching degree of the first image and the second image is 89% through calculation, and the corresponding reliability is 0.8 through the mapping relation between the preset image matching degree and the reliability of focusing operation.

In other embodiments, the degree of image matching of the first image with the second image may be obtained by:

performing edge matching on the extracted edge of the first image and the extracted edge of the second image; comparing the edge strength of the matched same edges in the first image and the second image; determining the image matching degree of the first image and the second image based on the number of matched same edges and the ratio of the edge strength of the same edges.

Exemplarily, the following steps are carried out: the method comprises the steps of obtaining 80 edges in a first image through edge detection, obtaining 90 edges in a second image, obtaining that 80 edges exist in the same mode through feature matching, calculating the ratio of the edge strength of the same edges respectively, adding and averaging the ratios to obtain that the ratio of the edge strength of the first image to the edge strength of the second image is 80%, obtaining that the image matching degree is 82% through the mapping relation between the number of the same edges, the ratio of the edge strength and the image matching degree, and obtaining that the corresponding reliability is 0.75 through the mapping relation between the preset image matching degree and the reliability of focusing operation.

Step 305: and switching the focusing modes when determining that preset focusing mode switching conditions are met based on the focusing mode adopted by the current focusing operation and the determined reliability of the current focusing operation.

In an embodiment, the first focusing mode is phase focusing, the second focusing mode is contrast focusing, a confidence threshold of focusing operation is preset, and if the focusing mode adopted by the current focusing operation is the first focusing mode, and the mobile terminal determines that the confidence of the current focusing operation is lower than the preset first confidence threshold, the first focusing mode is switched to the second focusing mode of different modes.

If the focusing mode adopted by the current focusing operation is the second focusing mode, the mobile terminal switches the second focusing mode to the first focusing mode in different modes when determining that the reliability of the current focusing operation is higher than a preset second reliability threshold (which may be the same as or different from the first reliability threshold).

It should be noted that after the mobile terminal performs the focusing mode switching, the reliability of the switched focusing operation still needs to be calculated, and when the reliability meets the preset condition, the focusing mode switching is performed again until the focusing is performed, and the terminal performs image acquisition.

By applying the embodiment of the invention, the terminal adapts the current focusing mode according to the focusing mode adopted by the current focusing operation and the reliability of the current focusing operation, so that the focusing effect and the focusing efficiency are improved, the shooting effect of a user is better, and the user experience is enhanced.

Example two

Fig. 4 is a diagram of a method for switching a focusing mode of a mobile terminal according to an embodiment of the present invention, which is applied to a mobile terminal including a phase focusing mode and a contrast focusing mode, as shown in fig. 4, the method for switching a focusing mode of a mobile terminal according to an embodiment of the present invention includes:

step 401: and the mobile terminal detects the focusing operation of the mobile terminal and adopts a phase focusing mode to focus.

In practical applications, when a user uses the mobile terminal to shoot, the mobile terminal detects a shooting instruction triggered by the user, and performs a focusing operation in image acquisition by default in a phase focusing mode (of course, in an embodiment, a contrast focusing mode may also be used by default).

Step 402: and acquiring a first image corresponding to the left pixel point and a second image corresponding to the right pixel point.

Here, since the mobile terminal has a phase focusing mode, the pixel points of the image sensor of the mobile terminal are formed by the left and right pixel points in pairs, and the mobile terminal obtains the first image through the left pixel point and obtains the second image through the right pixel point.

Step 403: and carrying out edge detection on the first image and the second image to obtain edges in the first image and the second image.

Here, the edges of the images retain important structural attributes of the images, and the purpose of edge detection (feature extraction) of the first image and the second image is to identify points in the digital image where the brightness change is significant.

Step 404: and matching the edges in the obtained first image and the second image to obtain the image matching degree of the first image and the second image.

In actual implementation, the number of the same edges in the first image and the second image can be obtained by matching the edges extracted from the first image and the second image, and the image matching degree of the first image and the second image is determined according to the number of the same edges obtained by matching. For example: the number of the edges in the first image is 85 and the number of the edges in the second image is 90 through edge detection, 30 edges are the same through feature matching, and the matching degree of the first image and the second image is 33% through calculation.

Step 405: and determining the reliability of the current focusing operation based on the image matching degree of the first image and the second image.

In some embodiments, a mapping relationship between the image matching degree of the first image and the second image and the reliability of the current focusing operation is preset, and after the image matching degree of the first image and the second image is obtained, the reliability of the current focusing operation is obtained through the mapping relationship. For example: when the matching degree of the first image and the second image is 33%, the reliability of the current focusing operation is 0.3 through the calculation of the mapping relation.

Step 406: comparing the determined reliability of the current focusing operation with a preset reliability threshold, judging whether the reliability is smaller than the reliability threshold, and if the reliability of the current focusing operation is smaller than the preset reliability threshold, executing step 407; if the reliability of the current focusing operation is not less than the predetermined reliability threshold, go to step 410.

Step 407: and switching the current phase focusing mode into the inverse differential focusing mode.

Step 408: obtaining reliability corresponding to contrast type focusing, comparing the obtained reliability with a preset reliability threshold, judging whether the obtained reliability is greater than the reliability threshold, and if the obtained reliability is greater than the preset reliability threshold, executing a step 409; if the obtained confidence level is greater than the preset confidence level threshold, go to step 410.

After switching to the contrast focusing mode, the corresponding reliability needs to be calculated in the same manner as in the phase focusing, the first image and the second image are obtained, feature extraction is performed, the matching degree of the first image and the second image is determined, and then the current reliability is determined.

Step 409: and switching the current inverse differential focusing mode into a phase focusing mode.

In this embodiment, the reliability needs to be calculated after each focusing mode switching is performed, and the mode switching is performed when the reliability meets a preset condition until focusing is performed, and the terminal performs image acquisition.

Step 410: and ending the processing flow.

EXAMPLE III

The embodiment provides a mobile terminal, as shown in fig. 5, the mobile terminal in the embodiment of the present invention includes: a processor 51, a memory 52, a communication bus 53 and an image acquisition device 54 (such as a camera);

the communication bus 53 is used for realizing connection communication between the processor 51 and the memory 52;

the memory 52 is used for storing an information processing program of a switching method of the focusing mode of the mobile terminal;

the processor 51 is configured to execute an information processing program of a method for switching a focusing mode of a mobile terminal stored in the memory 52, so as to implement the following steps:

detecting a focusing operation of the mobile terminal;

performing feature extraction on the first image and the second image;

In an embodiment, the processor 51 is further configured to, when executing the information processing program, implement:

Here, it should be noted that: the above description related to the mobile terminal is similar to the above description of the method, and the description of the beneficial effects of the same method is omitted for brevity. For technical details not disclosed in the embodiments of the mobile terminal of the present invention, refer to the description of the embodiments of the method of the present invention.

In the embodiment of the present invention, the functions executed by the processor 31 in the mobile terminal may be implemented by a Central Processing Unit (CPU) or a Digital Signal Processor (DSP), a Field Programmable Gate Array (FPGA), or an Integrated Circuit (ASIC) in the terminal.

To implement the information processing embodiment of the motion sensing application, an embodiment of the present invention further provides a computer-readable storage medium, where one or more programs are stored in the computer-readable storage medium, and the one or more programs are executable by one or more processors to implement the following steps:

detecting a focusing operation of the mobile terminal;

performing feature extraction on the first image and the second image;

In one embodiment, the one or more programs are specifically executable by the one or more processors to perform the steps of:

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, all the functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.

Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: a mobile storage device, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.

Alternatively, the integrated unit of the present invention may be stored in a computer-readable storage medium if it is implemented in the form of a software functional module and sold or used as a separate product. Based on such understanding, the technical solutions of the embodiments of the present invention may be essentially implemented or a part contributing to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic or optical disk, or various other media that can store program code.

The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.

Claims

1. A switching method of focusing modes of a mobile terminal is characterized in that an image acquisition device of the mobile terminal is provided with at least two focusing modes; one focusing mode of the at least two focusing modes is a phase focusing mode; the method comprises the following steps:

detecting a focusing operation of the mobile terminal;

performing feature extraction on the first image and the second image;

switching the focusing mode when determining that a preset focusing mode switching condition is met based on the focusing mode adopted by the current focusing operation and the determined reliability of the current focusing operation;

wherein the method further comprises:

and after the switching of the focusing mode is executed, calculating the reliability of the switched focusing mode, and switching the focusing mode when the reliability of the switched focusing mode meets the switching condition until focusing is carried out, and acquiring an image.

2. The method of claim 1, wherein the determining the confidence level of the currently performed focusing operation based on the extracted features of the first image and the second image comprises:

3. The method of claim 2, wherein the feature matching the extracted features of the first image with the corresponding features of the second image to obtain the degree of image matching between the first image and the second image comprises:

4. The method of claim 2, wherein the feature matching the extracted features of the first image with the corresponding features of the second image to obtain a degree of matching between the first image and the second image comprises:

5. The method according to claim 1 or 2, wherein switching the focusing mode when determining that a preset focusing mode switching condition is satisfied based on the focusing mode adopted by the current focusing operation and the determined reliability of the current focusing operation comprises:

responding to that a focusing mode adopted by current focusing operation is a first focusing mode, and if the determined reliability of the current focusing operation is lower than a preset first reliability threshold value, switching the first focusing mode into a second focusing mode of different modes, wherein the first focusing mode is a phase focusing mode; the second focus mode is a contrast focus mode.

6. The method according to claim 1 or 2, wherein switching the focusing mode when determining that a preset focusing mode switching condition is satisfied based on the focusing mode adopted by the current focusing operation and the determined reliability of the current focusing operation comprises:

responding to that a focusing mode adopted by the current focusing operation is a second focusing mode, and if the determined reliability of the current focusing operation is higher than a preset second reliability threshold value, switching the second focusing mode into a first focusing mode of different modes, wherein the first focusing mode is a phase focusing mode; the second focus mode is a contrast focus mode.

7. The method of claim 6, wherein the method further comprises:

8. A mobile terminal is characterized in that an image acquisition device of the mobile terminal is provided with at least two focusing modes; one focusing mode of the at least two focusing modes is a phase focusing mode; the mobile terminal includes:

a processor, configured to execute a processing program of the method for switching the focusing mode of the mobile terminal stored in the memory, so as to implement the following steps:

detecting a focusing operation of the mobile terminal;

performing feature extraction on the first image and the second image;

the processor is further configured to calculate the reliability of the switched focusing mode after the switching of the focusing mode is completed, and perform switching of the focusing mode until focusing is performed when the reliability of the switched focusing mode meets a switching condition, so as to perform image acquisition.

9. The mobile terminal of claim 8,

the processor is further configured to perform feature matching on the extracted features of the first image and the corresponding features of the second image to obtain an image matching degree of the first image and the second image;

10. A computer-readable storage medium, in which an executable program is stored, and when the executable program is executed by a processor, the method for switching the focusing mode of a mobile terminal according to any one of claims 1 to 7 is implemented.