CN111988530B

CN111988530B - Mobile terminal and photographing method thereof

Info

Publication number: CN111988530B
Application number: CN202010906184.3A
Authority: CN
Inventors: 闫三锋
Original assignee: Hisense Mobile Communications Technology Co Ltd
Current assignee: Hisense Mobile Communications Technology Co Ltd
Priority date: 2020-09-01
Filing date: 2020-09-01
Publication date: 2022-07-29
Anticipated expiration: 2040-09-01
Also published as: CN111988530A

Abstract

The application discloses a mobile terminal and a photographing method thereof, and relates to the technical field of terminals. Before the mobile terminal receives the touch operation aiming at the photographing control, the focusing of the camera can be forbidden, so that the display effect of the image displayed on the electronic ink screen can be improved. After receiving the touch operation for the photographing control, the mobile terminal can control the camera to perform one-time complete focusing and obtain a photographed image after the focusing is completed. Thereby, the sharpness of the photographed image finally taken is ensured.

Description

Mobile terminal and photographing method thereof

Technical Field

The present application relates to the field of terminal technologies, and in particular, to a mobile terminal and a photographing method thereof.

Background

The mobile terminal may include an electronic ink screen and a camera. In the photographing process, if the mobile terminal detects that the position of the mobile terminal changes, the camera can be controlled to focus. And after focusing is completed, the mobile terminal can update the image displayed on the electronic ink screen.

However, if the position of the mobile terminal is continuously changed, the electronic ink screen frequently refreshes the image displayed on the electronic ink screen. And because the refreshing frequency of the electronic ink screen is low, the image displayed on the electronic ink screen is blurred, and the finally shot image may be blurred.

Disclosure of Invention

The application provides a mobile terminal and a photographing method thereof, which can solve the problem that in the related art, images displayed on an electronic ink screen are fuzzy, and further the finally photographed images are fuzzy. The technical scheme is as follows:

in one aspect, a mobile terminal is provided, and the mobile terminal includes: the system comprises a processor, an electronic ink screen and a camera; the processor is configured to:

after the camera is started, if the touch operation aiming at the photographing control is not received, the camera is forbidden to focus;

responding to the touch operation aiming at the photographing control, and controlling the camera to focus;

encoding image data acquired after the focusing of the camera is finished to obtain a photographed image;

and the electronic ink screen is used for displaying the photographed image.

Optionally, the processor is configured to:

and encoding the target image data with the highest definition in the multi-frame image data acquired after the focusing of the camera is finished to obtain a photographed image.

Optionally, the processor is configured to:

if the definition of the target image data with the highest definition in the multi-frame image data is greater than a definition threshold value, encoding the target image data to obtain a photographed image;

Wherein the sharpness threshold is positively correlated with ambient brightness.

Optionally, the processor is further configured to:

and if the definition of the target image data is less than or equal to the definition threshold, displaying prompt information for prompting focusing failure on the electronic ink screen.

Optionally, the mobile terminal further includes: an image signal processor; the image signal processor is configured to:

acquiring multi-frame image data acquired by the camera;

determining a quasi-focus value of each frame of image data in the plurality of frames of image data, wherein the quasi-focus value is used for indicating the definition of the image data;

determining ambient brightness based on at least one frame of image data in the plurality of frames of image data;

the processor is further configured to:

determining target image data with highest definition according to the quasi-focus value of each frame of image data in the multi-frame image data;

and determining the definition threshold according to the environment brightness.

Optionally, the processor is further configured to:

and if the position of the mobile terminal is detected to be changed, the camera is controlled to focus again.

In another aspect, a photographing method of a mobile terminal is provided, the mobile terminal including: an electronic ink screen and a camera; the method comprises the following steps:

and displaying the photographed image on the electronic ink screen.

Optionally, encoding image data acquired after the focusing of the camera is completed to obtain a photographed image, including:

Optionally, the encoding of the target image data with the highest definition in the multi-frame image data collected after the focusing of the camera is completed to obtain the photographed image includes:

Optionally, the method further includes:

In yet another aspect, a mobile terminal is provided, the mobile terminal including: the mobile terminal comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein the processor executes the computer program to realize the photographing method of the mobile terminal.

In still another aspect, a computer-readable storage medium is provided, in which a computer program is stored, and the computer program is executed by a processor to implement the photographing method of the mobile terminal according to the above aspect.

In still another aspect, a computer program product containing instructions is provided, which when run on the computer causes the computer to execute the method for photographing of a mobile terminal according to the above aspect.

The beneficial effect that technical scheme that this application provided brought includes at least:

the application provides a mobile terminal and a photographing method thereof, wherein the mobile terminal can prohibit a camera from focusing before receiving touch operation aiming at a photographing control, so that the display effect of an image displayed on an electronic ink screen can be improved. After receiving the touch operation for the photographing control, the mobile terminal can control the camera to perform one-time complete focusing and obtain a photographed image after the focusing is completed. Thereby, the sharpness of the photographed image finally taken is ensured.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a flowchart of a photographing method of a mobile terminal according to an embodiment of the present disclosure;

fig. 2 is a flowchart of another photographing method for a mobile terminal according to an embodiment of the present disclosure;

fig. 3 is a schematic diagram of a photographing interface of a mobile terminal according to an embodiment of the present disclosure;

FIG. 4 is a schematic diagram of an interface for displaying prompt information according to an embodiment of the present disclosure;

fig. 5 is a schematic structural diagram of a mobile terminal according to an embodiment of the present application;

fig. 6 is a schematic structural diagram of another mobile terminal provided in an embodiment of the present application;

fig. 7 is a block diagram of a software structure of a mobile terminal according to an embodiment of the present disclosure.

Detailed Description

To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.

In the related art, after a camera of a mobile terminal is started, before a touch operation for a photographing control of the mobile terminal is received, continuous automatic focusing can be performed. For example, after detecting that the position of the mobile terminal is changed, the mobile terminal can control the camera to focus again. Accordingly, the mobile terminal needs to control its electronic ink screen to display the refocused image. In each focusing process of the camera, the electronic ink screen needs to update the image displayed on the electronic ink screen for many times until focusing is finished.

However, since the refresh frequency of the electronic ink screen is low, if the position of the mobile terminal is continuously changed and the image displayed on the electronic ink screen needs to be updated for many times each time, the image displayed on the electronic ink screen has a residual image and is relatively blurred, so that the user cannot determine the focusing effect of the current camera. At this time, if the user touches the photographing control of the mobile terminal, the image photographed by the mobile terminal may be blurred.

The embodiment of the application provides a photographing method of a mobile terminal, and the photographing method can be applied to the mobile terminal. The mobile terminal may include: the mobile terminal comprises an electronic ink screen and a camera, and the mobile terminal can carry out automatic focusing. Optionally, the mobile terminal may be a mobile phone, a tablet computer, or a wearable device, for example, the mobile terminal may be a mobile phone. Referring to fig. 1, the method may include:

Step 101, after the camera is started, if a touch operation for the photographing control is not received, the camera is prohibited from focusing.

The processor of the mobile terminal, that is, a Central Processing Unit (CPU) of the mobile terminal, may detect whether a touch operation of a user of the mobile terminal on a photographing control displayed on the electronic ink screen is received after receiving a start instruction for the camera and starting the camera. If the processor does not receive the touch operation aiming at the photographing control, the focusing of the camera can be forbidden, namely, the automatic focusing of the camera is not allowed in the previewing process before photographing.

As the focusing of the camera is forbidden before the picture taking, on one hand, the updating times of the electronic ink screen to the image displayed on the electronic ink screen can be reduced, and the display effect of the image displayed on the electronic ink screen can be improved. On the other hand, the power consumption of the mobile terminal can be reduced, and the endurance time of the mobile terminal is prolonged.

And 102, responding to the touch operation aiming at the photographing control, and controlling the camera to focus.

If the CPU of the mobile terminal receives the touch operation of the user for the photographing control, the camera can be controlled to focus in response to the touch operation for the photographing control.

For example, after receiving the touch operation for the photographing control, the CPU may send a focusing instruction to the camera. After the camera receives the focusing instruction, focusing can be carried out in response to the focusing instruction.

After receiving the touch operation aiming at the photographing control, the CPU can control the camera to carry out one-time complete focusing. In addition, after the general user touches the photographing control, the mobile terminal cannot be moved, that is, the position of the mobile terminal cannot be changed greatly. At the moment, the CPU controls the camera to carry out one-time complete focusing, so that the focusing effect of the camera can be ensured to be better, and the subsequently obtained photographed image can be ensured to be clearer.

And 103, encoding image data acquired after the focusing of the camera is finished to obtain a photographed image.

After the focusing of the camera is completed, the CPU can encode the image data collected by the camera, so that a photographed image is obtained.

And 104, displaying the photographed image on the electronic ink screen.

After the CPU obtains the photographed image, the photographed image can be displayed on an electronic ink screen of the mobile terminal for being checked by a user of the mobile terminal.

In summary, the embodiment of the present application provides a photographing method for a mobile terminal, where before the mobile terminal receives a touch operation for a photographing control, focusing of a camera may be prohibited, so that a display effect of an image displayed on an electronic ink screen may be improved. After receiving the touch operation for the photographing control, the mobile terminal can control the camera to perform one-time complete focusing and obtain a photographed image after the focusing is completed. Thereby, the sharpness of the photographed image finally taken is ensured.

Fig. 2 is a flowchart of another photographing method for a mobile terminal according to an embodiment of the present disclosure, where the method may be applied to a mobile terminal. The mobile terminal may include: the mobile terminal comprises an electronic ink screen and a camera, and the mobile terminal can carry out automatic focusing. Optionally, the mobile terminal may be a mobile phone, a tablet computer, or a wearable device, for example, the mobile terminal may be a mobile phone. Referring to fig. 2, the method may include:

step 201, after the camera is started, if the touch operation for the photographing control is not received, the camera is prohibited from focusing.

The CPU of the mobile terminal receives a starting instruction aiming at the camera, and after the camera is started, whether touch operation of a user of the mobile terminal aiming at a photographing control displayed on the electronic ink screen is received or not can be detected. If the CPU does not receive the touch operation for the photographing control, focusing of the camera may be prohibited, that is, automatic focusing of the camera is not permitted in the preview process before photographing.

Optionally, the touch operation may be a slide operation or a click operation.

Step 202, responding to the touch operation aiming at the photographing control, and controlling the camera to focus.

If the CPU of the mobile terminal receives the touch operation of the user for the photographing control, the camera can be controlled to focus in response to the touch operation for the photographing control. For example, the CPU may send a focusing instruction to the camera after receiving the touch operation for the photographing control. After the camera receives the focusing instruction, focusing can be carried out in response to the focusing instruction.

After receiving the touch operation aiming at the photographing control, the CPU can control the camera to carry out one-time complete focusing. In addition, after the general user touches the photographing control, the mobile terminal cannot be moved, that is, the position of the mobile terminal cannot be changed greatly. At the moment, the CPU controls the camera to carry out one-time complete focusing, so that the focusing effect of the camera can be better, and the photographed image obtained after the focusing is finished can be clearer.

For example, referring to fig. 3, fig. 3 shows a schematic diagram of a shooting interface of a mobile terminal. As can be seen from fig. 3, the photographing interface may include a photographing control 01, a recently photographed image display box 02, and a preview image 03. As can be seen from fig. 3, the preview image displayed on the electronic ink screen of the mobile terminal is blurred before being out of focus.

Assuming that the user needs to take a picture of the object in the preview image, the shooting control 01 can be clicked. Correspondingly, the CPU of the mobile terminal can respond to the click operation aiming at the photographing control to control the camera to focus.

And 203, acquiring a focusing value of each frame of image data in the multi-frame image data acquired after the focusing of the camera is finished.

After the CPU of the mobile terminal controls the camera to perform focusing, a Focus Value (FV) of each frame of image data in the multi-frame image data acquired after the focusing of the camera is completed may be obtained. The FV may be used to indicate the sharpness of the image data, and a larger FV for the image data indicates a sharper image data, i.e. a sharper image indicated by the image data.

Because each frame of image data in the multi-frame image data acquired by the CPU is acquired after the focusing of the camera is finished, each frame of image data can be ensured to be clearer.

In this embodiment, the mobile terminal may further include: an Image Signal Processor (ISP). The camera can gather image data according to predetermined image acquisition frequency after starting to can all send the image data of gathering to ISP, close until this camera. Correspondingly, the ISP can acquire multi-frame image data acquired by the camera. For each frame of image data collected by the received camera, the ISP can determine a focus value of the frame of image data. It should be noted that, for received multiple frames of image data, the ISP may store multiple frames of image data acquired after the camera completes focusing and FV of each frame of image data in the multiple frames of image data in a buffer area of the mobile terminal. Accordingly, the CPU can read FV of each frame image data of a plurality of frames of image data from the buffer.

In addition, the ISP may also establish a corresponding relationship between each frame of image data in the multiple frames of image data and an FV of the frame of image data, so that when the CPU subsequently reads an FV of a certain frame of image data from the buffer, the image data corresponding to the FV may be determined based on the corresponding relationship. Alternatively, when the CPU subsequently reads a certain frame of image data from the buffer, the CPU may acquire FV of the frame of image data based on the correspondence.

Alternatively, the ISP may store both the plurality of frames of image data and the FV of the plurality of frames of image data in the buffer area of the mobile terminal. For example, the ISP may store each frame of image data and the FV of the frame of image data in a super-buffer list (super-buffer list). The super-buffer list may include two sub-lists with a correspondence established, one of the two sub-lists may be used for storing the image data, and the other of the two sub-lists may be used for storing the FV of the image data.

Optionally, for each frame of image data in the acquired multiple frames of image data, the ISP may determine FV of the frame of image data by using an Auto Focus (AF) algorithm. For example, the ISP may determine a contrast of an image of a specified object in the image indicated by the frame of image data with an image other than the image of the specified object, and may determine FV of the frame of image data based on the contrast. Wherein, the FV of the image data is positively correlated with the contrast, i.e. the larger the contrast, the larger the FV of the image data; the smaller the contrast, the smaller the FV of the image data.

That is, the ISP may determine the sharpness of the edge (also referred to as a contour) of the image of the specified object in the image indicated by the frame of image data, and the sharper the edge of the image of the specified object, the larger FV of the frame of image data, the more blurred the edge of the image of the specified object, and the smaller FV of the frame of image data.

Optionally, after receiving the multiple frames of image data sent after the camera has focused, the ISP may further screen out the specified number of candidate image data that are received recently from the multiple frames of image data. The ISP may then store the specified number of alternative image data, and the FV of the alternative image data, into a buffer of the mobile terminal. Wherein the specified number may be pre-stored by the ISP, for example the specified number may be 7 or 8.

For example, assuming that the designated number is 8 and the camera transmits 20 frames of image data to the ISP after focusing is completed, the ISP may determine 8 frames of image data received most recently from among the 20 frames of image data as candidate image data.

In the embodiment of the application, before the ISP acquires the multi-frame image data acquired by the camera, namely, in the process of controlling the camera to focus by the CPU, or after the camera is focused, if the CPU detects that the position of the mobile terminal is changed, the camera can be controlled again to focus, so that the problem that the finally obtained photographed image is blurred due to the reduction of the camera focusing precision caused by the overlarge force of the user touching the photographing control is avoided in time, and the definition of the finally obtained photographed image is ensured.

Optionally, the mobile terminal may further include: the displacement sensor can acquire displacement data of the mobile terminal and can send the displacement data to the CPU. The acceleration sensor can acquire acceleration data of the mobile terminal and can send the acceleration data to the CPU. If the CPU determines that the displacement of the mobile terminal is larger than the displacement threshold value based on the displacement data sent by the displacement sensor, and determines that the acceleration of the mobile terminal is larger than the acceleration threshold value based on the acceleration data sent by the acceleration sensor, the position of the mobile terminal can be determined to be changed. Wherein, the displacement threshold and the acceleration threshold can be pre-stored in the mobile terminal.

And 204, determining the target image data with the highest definition according to the quasi-focus value of each frame of image data in the multi-frame image data.

After acquiring the quasi-focus value of each frame of image data in the multiple frames of image data, the CPU of the mobile terminal may compare the magnitude of the quasi-focus value of the multiple frames of image data. Then, the CPU may determine the image data with the largest focus value among the plurality of frames of image data as the target image data, that is, the CPU may determine the image data with the highest resolution among the plurality of frames of image data as the target image data.

Because the CPU of the mobile terminal can screen out the target image data with the highest definition from the multi-frame image data, namely the optimal frame of image data in the multi-frame image data, the definition of the subsequently obtained photographed image is effectively ensured.

For example, it is assumed that, among five frames of image data acquired by the CPU, FV of first frame image data is 10, FV of second frame image data is 20, FV of third frame image data is 15, FV of fourth frame image data is 30, and FV of fifth frame image data is 50. Since 50 is the largest, the CPU can determine that the image data with the highest sharpness among the five frames of image data is the fifth frame of image data, and can determine that the target image data is the fifth frame of image data among the five frames of image data.

Step 205, determining a definition threshold according to the ambient brightness.

In the embodiment of the application, the mobile terminal can acquire the ambient brightness when the camera shoots, namely the current ambient brightness, and can determine the definition threshold value based on the ambient brightness and the corresponding relation between the pre-stored ambient brightness and the definition threshold value.

Wherein, the definition threshold value is positively correlated with the ambient brightness, namely, the greater the ambient brightness is, the greater the definition threshold value is; the smaller the ambient brightness, the smaller the sharpness threshold.

In the embodiment of the application, in the process of acquiring the multi-frame image data, the current ambient brightness is basically kept unchanged, that is, the brightness difference value of the ambient brightness corresponding to any two frames of image data in the multi-frame image data is smaller than the brightness threshold value. Therefore, after the ISP acquires the plurality of frames of image data collected by the camera, the ISP may further determine the current ambient brightness based on at least one frame of image data in the plurality of frames of image data. Then, the ISP may send the determined ambient brightness to the CPU, and the CPU may determine the sharpness threshold according to the ambient brightness after receiving the ambient brightness.

It should be noted that, if the at least one frame of image data includes multiple frames of image data, the ISP may determine the ambient brightness corresponding to each frame of image data in the multiple frames of image data. Then, the ISP may determine an average value of a plurality of ambient luminances in one-to-one correspondence with the plurality of frames of image data as the current ambient luminance. The average may be a geometric average, an arithmetic average, and a root mean square, among others.

Alternatively, the ISP may use an Auto Exposure (AE) algorithm to process each frame of image data in at least one frame of image data to obtain the ambient brightness corresponding to the frame of image data. For example, the ISP may obtain raw data (raw data) of each frame of image data in the at least one frame of image data, and then the ISP may process the raw data by using the AE algorithm, so as to obtain the ambient brightness corresponding to the frame of image data. Wherein the original data comprises the original brightness information of the image indicated by the image data.

Step 206, detecting whether the definition of the target image data is greater than a definition threshold.

After determining the target image data with the highest definition in the multi-frame image data collected by the camera and the definition threshold, the CPU of the mobile terminal can detect whether the definition of the target image data is greater than the definition threshold. If the CPU determines that the sharpness of the target image data is greater than the sharpness threshold, it may be determined that focusing is successful, and then step 206 may be performed. If the CPU determines that the sharpness of the target image data is less than or equal to the sharpness threshold, it may be determined that focusing has failed, and then step 207 may be performed.

For example, assuming that the definition threshold is 25 and the FV of the target image data is 50, the CPU of the mobile terminal may determine that the definition of the target image data is greater than the definition threshold since 50 is greater than 25, and then may perform step 206. Assuming that the FV of the target image data determined by the CPU is 15, since 15 is smaller than 25, the CPU may determine that the sharpness of the target image data is smaller than the sharpness threshold value, and may then execute step 207.

Optionally, after the focusing is successful, the CPU may further store the target image data in an encoding buffer. The encoding buffer may be used to store image data to be encoded.

And step 207, encoding the target image data to obtain a photographed image.

If the CPU of the mobile terminal determines that the definition of the target image data is greater than the definition threshold, the CPU can encode the target image data so as to obtain a photographed image. Thereby, the sharpness of the obtained photographed image can be ensured.

In the embodiment of the present application, the CPU may further store the photographed image after obtaining the photographed image.

Optionally, the CPU may encode the target image data by using a target image encoding format to obtain the photographed image. The target image encoding format may be: joint Photographic Experts Group (JPEG) format, Bitmap (BMP) format, and streaming network graphics (PNG) format, among others.

For example, the target image encoding format may be a JPEG format. Therefore, the size of the memory space of the mobile terminal occupied by the photographed image obtained by coding can be effectively reduced on the premise of not losing the details of the target image data.

And step 208, displaying the photographed image on the electronic ink screen.

After the CPU obtains the photographed image, the photographed image can be displayed (also referred to as a playback) on the electronic ink screen of the mobile terminal, so that the user of the mobile terminal can view the photographed image.

For example, referring to fig. 3, after the camera is controlled to focus, the obtained photographed image is clearer than the image before the camera is controlled to focus.

And 209, displaying prompt information for prompting focusing failure on the electronic ink screen.

If the CPU of the mobile terminal determines that the definition of the target image data is less than or equal to the definition threshold, the focusing failure can be determined, and prompt information for prompting the focusing failure can be displayed on the electronic ink screen.

Optionally, the CPU may display the prompt in the form of a prompt box on the electronic ink screen.

Optionally, in the process of displaying the prompt message on the electronic ink screen, the CPU may further control a speaker of the mobile terminal to send a voice prompt message for prompting the failure of focusing.

For example, assuming that the CPU displays the prompt information in the form of a prompt box, the CPU may display the prompt information shown in fig. 3 when determining that the definition of the target image data is less than or equal to the definition. As can be seen in FIG. 4, the prompt box 04 may include prompt information 041, a determination control 042, and a cancel control 043. The prompt information 041 may be the text information "failure to focus, blurred photographed image, whether to refocus? ". If the user clicks the determination control 042, the CPU may cancel displaying the prompt box 04 in response to a click operation of the user for the determination control 042, and controls the camera to focus again to take a picture again.

If the user clicks the cancel control 043, the CPU may cancel the display of the prompt box 04 in response to a click operation of the user for the cancel control 043.

It should be further noted that, the order of the steps of the photographing method of the mobile terminal provided in the embodiment of the present application may be appropriately adjusted, and the steps may also be increased or decreased according to the situation. For example, step 205 may be performed before step 203, and any method that is within the scope of the present disclosure and that is obvious to one skilled in the art is also within the scope of the present disclosure, and thus will not be described in detail herein.

In summary, the embodiment of the present application provides a photographing method for a mobile terminal, where before the mobile terminal receives a touch operation for a photographing control, focusing of a camera may be prohibited, so that a display effect of an image displayed on an electronic ink screen may be improved. After receiving the touch operation for the photographing control, the mobile terminal can control the camera to perform one-time complete focusing and obtain a photographed image after the focusing is completed. Thereby, the sharpness of the photographed image finally photographed is ensured.

Fig. 5 is a schematic structural diagram of a mobile terminal according to an embodiment of the present application, where the mobile terminal may be configured to execute the photographing method according to the foregoing method embodiment. Referring to fig. 5, the mobile terminal 110 may include: CPU101, electronic ink screen 1102, and camera 121. The CPU101 may be configured to:

coding image data acquired by a camera to obtain a photographed image;

the electronic ink screen 1102 is used for displaying a photographed image.

Optionally, the CPU 101 may be configured to: and coding the target image data with the highest definition in the multi-frame image data collected by the camera to obtain a photographed image.

Optionally, the CPU 101 may be configured to: if the definition of the target image data with the highest definition in the multi-frame image data is greater than a definition threshold value, encoding the target image data to obtain a photographed image;

wherein the sharpness threshold is positively correlated with the ambient brightness.

Optionally, the CPU 101 may be further configured to:

Optionally, as also shown in fig. 5, the mobile terminal 110 may further include: an image signal processor 1103. The image signal processor 1103 may be configured to:

Acquiring multi-frame image data acquired by a camera;

determining a quasi-focus value of each frame of image data in the multi-frame image data, wherein the quasi-focus value is used for indicating the definition of the image data; determining ambient brightness based on at least one frame of image data in the plurality of frames of image data;

the CPU 101 may be configured to: determining target image data with highest definition according to the quasi-focus value of each frame of image data in the multi-frame image data; and determining a definition threshold according to the environment brightness, wherein the definition threshold is positively correlated with the environment brightness.

Optionally, the CPU 101 may be further configured to:

In summary, the embodiment of the present application provides a mobile terminal, which can prohibit a camera from focusing before receiving a touch operation for a photographing control, so that a display effect of an image displayed on an electronic ink screen can be improved. After receiving the touch operation for the photographing control, the mobile terminal can control the camera to perform one-time complete focusing and obtain a photographed image after the focusing is completed. Thereby, the sharpness of the photographed image finally taken is ensured.

Fig. 6 is a schematic structural diagram of another mobile terminal according to an embodiment of the present application. Referring to fig. 6, the mobile terminal 110 may include: a display unit 130, a Radio Frequency (RF) circuit 150, an audio circuit 160, a wireless fidelity (Wi-Fi) module 170, a bluetooth module 180, a power supply 190, a camera 121, and a processor 1101.

The camera 121 may be used to capture still pictures or video, among other things. The object generates an optical picture through the lens and projects the optical picture to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensitive elements convert the light signals into electrical signals which are then passed to the processor 1101 for conversion into digital picture signals.

The processor 1101 is a control center of the mobile terminal 110, connects various parts of the entire terminal using various interfaces and lines, performs various functions of the mobile terminal 110 and processes data by running or executing software programs stored in the memory 140 and calling data stored in the memory 140. In some embodiments, processor 1101 may include one or more processing units; the processor 1101 may also integrate an application processor, which mainly handles operating systems, user interfaces, applications, etc., and a baseband processor, which mainly handles wireless communications. It will be appreciated that the baseband processor described above may not be integrated into the processor 1101. In the present application, the processor 1101 may run an operating system and an application program, may control a user interface to display, and may implement the photographing method of the mobile terminal provided in the embodiment of the present application. Additionally, processor 1101 is coupled to input unit and display unit 130.

The display unit 130 may be used to receive input numeric or character information and generate signal inputs related to user settings and function control of the mobile terminal 110, and optionally, the display unit 130 may also be used to display information input by the user or information provided to the user and a Graphical User Interface (GUI) of various menus of the mobile terminal 110. The display unit 130 may include a display screen 131 disposed on the front surface of the mobile terminal 110. The display screen 131 may be configured in the form of a liquid crystal display, a light emitting diode, or the like. The display unit 130 may be used to display various graphical user interfaces described herein.

The display unit 130 includes: a display screen 131 and a touch screen 132 disposed on the front of the mobile terminal 110. The display screen 131 may be used to display preview pictures. Touch screen 132 may collect touch operations on or near by the user, such as clicking a button, dragging a scroll box, and the like. The touch screen 132 may be covered on the display screen 131, or the touch screen 132 and the display screen 131 may be integrated to implement the input and output functions of the mobile terminal 110, and after the integration, the touch screen may be referred to as a touch display screen for short.

Memory 140 may be used to store software programs and data. The processor 1101 executes various functions of the mobile terminal 110 and data processing by executing software programs or data stored in the memory 140. The memory 140 may include high speed random access memory and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Memory 140 stores an operating system that enables mobile terminal 110 to operate. The memory 140 in the present application may store an operating system and various application programs, and may also store codes for executing the photographing of the mobile terminal provided in the embodiment of the present application.

The RF circuit 150 may be used for receiving and transmitting signals during information transmission and reception or during a call, and may receive downlink data of a base station and then deliver the received downlink data to the processor 1101 for processing; the uplink data may be transmitted to the base station. Typically, the RF circuitry includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.

Audio circuitry 160, speaker 161, and microphone 162 may provide an audio interface between a user and mobile terminal 110. The audio circuit 160 may transmit the electrical signal converted from the received audio data to the speaker 161, and convert the electrical signal into a sound signal for output by the speaker 161. The mobile terminal 110 may also be configured with a volume button for adjusting the volume of the sound signal. On the other hand, the microphone 162 converts the collected sound signal into an electrical signal, which is received by the audio circuit 160 and converted into audio data, which is then output to the RF circuit 150 to be transmitted to, for example, another terminal, or to the memory 140 for further processing. In this application, the microphone 162 may capture the voice of the user.

Wi-Fi belongs to a short-distance wireless transmission technology, and the mobile terminal 110 may help a user to send and receive e-mails, browse webpages, access streaming media, and the like through the Wi-Fi module 170, which provides a wireless broadband internet access for the user.

And the Bluetooth module 180 is used for performing information interaction with other Bluetooth devices with Bluetooth modules through a Bluetooth protocol. For example, the mobile terminal 110 may establish a bluetooth connection with a wearable electronic device (e.g., a smart watch) also equipped with a bluetooth module through the bluetooth module 180, so as to perform data interaction.

Mobile terminal 110 also includes a power supply 190 (e.g., a battery) that powers the various components. The power supply may be logically coupled to the processor 1101 through a power management system to manage charging, discharging, and power consumption functions through the power management system. The mobile terminal 110 may also be configured with a power button for powering on and off the terminal, and locking the screen.

The mobile terminal 110 may include at least one sensor 1110, such as a motion sensor 11101, a distance sensor 11102, a fingerprint sensor 11103, and a temperature sensor 11104. Mobile terminal 110 may also be configured with other sensors such as gyroscopes, barometers, hygrometers, thermometers, and infrared sensors.

It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the mobile terminal and each device described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

Fig. 7 is a block diagram of a software structure of a mobile terminal according to an embodiment of the present application. The layered architecture divides the software into several layers, each layer having a clear role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the android system is divided into four layers, an application layer, an application framework layer, an Android Runtime (ART) and system library, and a kernel layer from top to bottom.

The application layer may include a series of application packages. As shown in fig. 7, the application package may include applications such as camera, gallery, calendar, phone call, map, navigation, WLAN, bluetooth, music, video, short message, etc. The application framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions.

As shown in FIG. 7, the application framework layers may include a window manager, content provider, view system, phone manager, resource manager, notification manager, and the like.

The window manager is used for managing window programs. The window manager can obtain the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

Content providers are used to store and retrieve data and make it accessible to applications. The data may include video, pictures, audio, calls made and received, browsing history and bookmarks, phone books, etc.

The view system includes visual controls such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.

The phone manager is used to provide communication functions of the mobile terminal 110. Such as management of call status (including on, off, etc.).

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and the like.

The notification manager enables the application to display notification information in the status bar, can be used to convey notification-type messages, can disappear automatically after a short dwell, and does not require user interaction. Such as a notification manager used to inform download completion, message alerts, etc. The notification manager may also be a notification that appears in the form of a chart or scroll bar text at the top status bar of the system, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, text information is prompted in the status bar, a prompt tone is given, the communication terminal vibrates, and an indicator light flashes.

The android runtime comprises a core library and a virtual machine. The android runtime is responsible for scheduling and management of the android system.

The core library comprises two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.

The application layer and the application framework layer run in a virtual machine. And executing java files of the application program layer and the application program framework layer into a binary file by the virtual machine. The virtual machine is used for performing the functions of object life cycle management, stack management, thread management, safety and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface managers (surface managers), media libraries (media libraries), three-dimensional graphics processing libraries (e.g., openGL ES), 2D graphics engines (e.g., SGL)), and the like.

The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

The media library supports a variety of commonly used audio, video format playback and recording, and still picture files, etc. The media library may support a variety of audio-video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, picture rendering, synthesis, layer processing and the like.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.

An embodiment of the present application provides a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the instructions are executed on a computer, the instructions cause the computer to execute the photographing method of the mobile terminal provided in the foregoing embodiment, for example, the method shown in fig. 1 or fig. 2.

The embodiment of the present application further provides a computer program product containing instructions, which when run on a computer, causes the computer to execute the method for photographing a mobile terminal provided in the above method embodiment, for example, the method shown in fig. 1 or fig. 2.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

The term "at least one" in this application means one or more, and the term "plurality" in this application means two or more.

The above description is only exemplary of the present application and should not be taken as limiting the present application, and any modifications, equivalents, improvements and the like that are made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims

1. A mobile terminal, characterized in that the mobile terminal comprises: the system comprises a processor, an image signal processor, an electronic ink screen and a camera;

the electronic ink screen is used for: after the camera is started, displaying a preview image and a photographing control, wherein the photographing control is positioned outside the preview image;

the processor is configured to: after the camera is started, if the touch operation aiming at the photographing control is not received, the camera is forbidden to focus; responding to the touch operation aiming at the photographing control, and controlling the camera to focus;

the image signal processor is configured to: acquiring multi-frame image data acquired after the focusing of the camera is finished; processing each frame of image data in at least one frame of image data in the multiple frames of images by adopting an automatic exposure algorithm to obtain the ambient brightness corresponding to the at least one frame of image data; determining the current ambient brightness based on the ambient brightness corresponding to the at least one frame of image data; screening out the newly acquired alternative image data with the specified number from the multi-frame image data;

The processor is further configured to: determining a sharpness threshold based on the current ambient brightness, the sharpness threshold being positively correlated with the current ambient brightness; if the definition of the target image data with the highest definition in the specified number of alternative image data is greater than a definition threshold value, encoding the target image data to obtain a photographed image;

the electronic ink screen is further configured to: and displaying the photographed image.

2. The mobile terminal of claim 1, wherein the processor is further configured to:

3. The mobile terminal of claim 2, wherein the image signal processor is configured to:

determining a focus value for each frame of image data in the specified number of candidate image data, the focus value indicating a sharpness of the image data;

the processor is further configured to:

and determining the target image data with the highest definition according to the quasi-focus value of each frame of image data in the specified number of the alternative image data.

4. The mobile terminal of any of claims 1 to 3, wherein the processor is further configured to:

5. A photographing method of a mobile terminal, the mobile terminal comprising: an electronic ink screen and a camera; the method comprises the following steps:

after the camera is started, displaying a preview image and a photographing control on the electronic ink screen, wherein the photographing control is positioned outside the preview image;

if the touch operation aiming at the photographing control is not received, the camera is forbidden to focus;

acquiring multi-frame image data acquired after the focusing of the camera is finished;

processing each frame of image data in at least one frame of image data in the multiple frames of images by adopting an automatic exposure algorithm to obtain the ambient brightness corresponding to the at least one frame of image data;

determining the current ambient brightness based on the ambient brightness corresponding to the at least one frame of image data;

screening out the newly acquired alternative image data with the specified number from the multi-frame image data;

Determining a sharpness threshold based on the current ambient brightness, the sharpness threshold being positively correlated with the current ambient brightness;

if the definition of the target image data with the highest definition in the specified number of alternative image data is greater than a definition threshold value, encoding the target image data to obtain a photographed image;

6. The method of claim 5, further comprising: