WO2025007751A1 - 显示方法、移动终端及计算机可读存储介质 - Google Patents

显示方法、移动终端及计算机可读存储介质 Download PDF

Info

Publication number
WO2025007751A1
WO2025007751A1 PCT/CN2024/100202 CN2024100202W WO2025007751A1 WO 2025007751 A1 WO2025007751 A1 WO 2025007751A1 CN 2024100202 W CN2024100202 W CN 2024100202W WO 2025007751 A1 WO2025007751 A1 WO 2025007751A1
Authority
WO
WIPO (PCT)
Prior art keywords
zoom
request
target
image
ratio
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2024/100202
Other languages
English (en)
French (fr)
Inventor
姚龙山
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honor Device Co Ltd
Original Assignee
Honor Device Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honor Device Co Ltd filed Critical Honor Device Co Ltd
Priority to EP24835234.6A priority Critical patent/EP4716228A1/en
Publication of WO2025007751A1 publication Critical patent/WO2025007751A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/69—Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/62—Control of parameters via user interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters

Definitions

  • the embodiments of the present application relate to the field of terminal technology, and in particular, to a display method, a mobile terminal, and a computer-readable storage medium.
  • the camera function of mobile terminals can realize front and rear camera, image beautification processing, zoom, etc.
  • Mobile terminals are usually equipped with multiple sets of lenses, and different lenses correspond to different focal lengths. Lenses with different focal lengths can capture images of different distances, different fields of view, and different sharpness.
  • the zoom operation (Zoom) of the mobile terminal is to adjust the positions of several sets of lenses with different focal lengths to achieve the change of the focal length of the adjusted lens to capture images with different focal lengths.
  • different zoom touch actions can be applied to the photo preview interface of the mobile terminal.
  • the mobile terminal detects the touch parameters of the user's zoom touch action to generate a corresponding zoom request, and sends the generated zoom request to the corresponding functional module to process the zoom request, and displays the final preview image.
  • the mobile terminal will process each zoom request in sequence according to the order in which each zoom request is generated and display the corresponding preview image. This will result in the zoom request generated in real time by the mobile terminal being processed some time after being triggered, and the preview image corresponding to the zoom request will also be displayed some time later, and the delay from applying the zoom touch operation to displaying the corresponding zoom preview image is relatively long.
  • the embodiments of the present application provide a display method, a mobile terminal, and a computer-readable storage medium, which are used to implement a solution of jumping a zoom operation received later to a zoom operation received earlier to queue up and process and display it in advance, thereby reducing the response and display delay of the newly received zoom operation and optimizing the tracking performance of the zoom display.
  • a display control method wherein a mobile terminal receives multiple zoom operations in sequence, including a first zoom operation, at least one second zoom operation, and a third zoom operation, wherein the first zoom operation is received earlier than the third zoom operation, and there is at least one second zoom operation between the first zoom operation and the third zoom operation, and the zoom ratios of different zoom operations may be different.
  • the second zoom operation mentioned in the specification may be equal to the first zoom operation mentioned in the claims
  • the third zoom operation mentioned in the specification may be equal to the second zoom operation mentioned in the claims, and they will not be described one by one.
  • the first zoom operation mentioned in the specification may exist or not exist in actual photography, without limitation.
  • the mobile terminal first responds to the first zoom operation and obtains a first zoom image at the zoom ratio of the first zoom operation. Before responding to all second zoom operations or displaying the second zoom images corresponding to all second zoom operations, the mobile terminal first responds to the third zoom operation to obtain the third zoom image, and displays the third zoom image.
  • the process of responding to the zoom processing operation may include: generating a zoom request, sending the zoom request, image acquisition operation, image signal front-end processing operation, space alignment transformation processing operation, image signal back-end processing operation and image sending and displaying.
  • the display control method provided by the present application adjusts the response display process of the continuous zoom operation, and the third zoom operation generated later will be processed and displayed in advance before the at least one second zoom operation received earlier.
  • the entire response time or part of the response time of at least one second zoom operation is reduced, so that the display delay of the zoom operation received later is reduced, and the tracking performance of the zoom operation is improved.
  • the at least one second zoom operation is not fully responded to, which means that any one of the at least one second zoom operation does not require an image acquisition operation, or it may mean that some of the second zoom operations in the at least one point zoom operation require an image acquisition operation, or only some of the second zoom operations need to be subjected to partial image acquisition operations, such as only performing a spatial alignment transformation processing operation or an image signal back-end processing operation.
  • the zoom image corresponding to the at least one second zoom operation is no longer displayed, but the third zoom operation is directly responded to and the third zoom image is displayed after the first zoom image is displayed.
  • the mobile terminal first displays the first zoom image corresponding to the first zoom operation on the shooting interface, and directly displays the third zoom image corresponding to the third zoom operation.
  • the third zoom image corresponding to the third zoom operation most recently applied by the user will be quickly displayed, and the hand tracking performance is significantly improved.
  • each time the shooting interface of the mobile terminal receives a zoom operation it will first generate a corresponding zoom request and add it to the request queue corresponding to the zoom operation. That is, when the mobile terminal receives the first zoom operation, it will generate a corresponding first zoom request and add it to the request queue. Then, the mobile terminal generates a corresponding second zoom request for at least one second zoom operation received and adds it to the request queue. Then, if the mobile terminal receives a third zoom operation, it will also generate a corresponding third zoom request and add it to the request queue.
  • the request queue is a first-in-first-out queue, and the zoom request that joins first will be dequeued first for processing, and the zoom request that joins later will be dequeued later for processing. It should be noted that the mobile terminal may continue to receive multiple zoom operations, so the zoom request entry and exit are also continuous, which does not mean that the newly generated zoom request will be entered into the queue only after the previous zoom request is dequeued.
  • the first zoom request that enters the queue first will be dequeued first, and the first zoom request that is dequeued will perform image acquisition operations, including image collection operations, image processing operations, etc., to obtain and display the first zoom image.
  • the mobile terminal executes the image acquisition operation corresponding to the third zoom request to obtain the third zoom image and display the third zoom image.
  • the present application can process the third zoom request in advance before the second zoom request is displayed.
  • the mobile terminal can process the second zoom request at the same time.
  • the zoom ratio is replaced with the third zoom ratio of the third zoom request, so that the zoom image corresponding to the third zoom ratio is acquired in advance and displayed in advance as the third zoom image.
  • at least one second zoom request before the third zoom request may be dequeued and discarded, and no image acquisition operation is performed, or only part of the image acquisition operation is performed before the image acquisition operation of the third zoom request is performed, which can also ensure that the third zoom image is acquired and displayed in advance.
  • the mobile terminal when the mobile terminal jumps to respond to the third zoom request, it first selects a second zoom request suitable for jumping from the second zoom requests corresponding to the second zoom operation whose corresponding zoom image has not been displayed before the third zoom operation, as the target zoom request, and the queue entry time of the target zoom request is earlier than the queue entry time of the third zoom request.
  • the target zoom request is dequeued, the image acquisition operation of the third zoom request is jumped to be executed, and the acquired third zoom image is displayed in advance.
  • the selection basis may be which second zoom request has a zoom ratio that is closer to the zoom ratio of the third zoom request, or which second zoom request has an earlier dequeuing time, or which zoom request involves image data or processing procedures that are closer to the image data or processing procedures of the third zoom request.
  • One implementation method of jumping to respond to the third zoom request is to jump the third zoom ratio of the third zoom request to the target zoom request for early processing.
  • the target zoom ratio corresponding to the target zoom request is replaced or modified to the third zoom ratio.
  • the target zoom request is actually an image acquisition operation at the third zoom ratio, so the corresponding zoom image is also a third zoom image obtained at the third zoom ratio.
  • it can be ensured that the target zoom request in the request queue is responded to after being dequeued, and the third zoom image can be obtained and displayed in advance at the third zoom ratio.
  • Another implementation method of jumping to respond to the third zoom request is to process the third zoom request in advance.
  • the target zoom request when the target zoom request is dequeued, all zoom requests between the target zoom request and the third zoom request can be directly dequeued and discarded, and then the third zoom request is dequeued and the image acquisition operation corresponding to the third zoom request is executed to obtain the third zoom image. In this way, it can also be ensured that the zoom magnification of the zoom image finally displayed is consistent with the zoom magnification of the most recently received zoom operation.
  • the image acquisition operation of the target zoom request may not be performed at all, or part of the image acquisition operation of the target zoom request may be performed.
  • different preset ranges can be set by selecting the focal length of the lens corresponding to the zoom ratio.
  • the smoothness and timeliness of the entire zoom display process are affected.
  • the preset magnification can also be set according to the smoothness requirement or timeliness requirement of the zoom switching of the mobile terminal. The higher the smoothness requirement, the smaller the preset range is, and the higher the timeliness requirement, the larger the preset range is.
  • the mobile terminal first obtains the magnification difference between the second zoom ratio corresponding to each second zoom request and the third zoom ratio of the third zoom request, and selects the second zoom request with the magnification difference within the preset range as the target zoom request to which it can jump.
  • the selected target zoom request may be one or more. If there is one target zoom request, the target zoom request can be directly used as the zoom request to which the third zoom request can jump. If there are multiple target zoom requests, one can be randomly selected from the multiple target zoom requests as the target zoom request suitable for jumping to the third zoom request. It is also possible to select a target zoom request that is relatively more suitable for jumping from multiple target zoom requests in combination with the real-time processing status of each target zoom request or other zoom parameters such as lens type.
  • a solution is provided for selecting a target zoom request suitable for jumping according to the real-time status of each zoom request.
  • the mobile terminal After receiving the zoom operation acting on the shooting interface, the mobile terminal will immediately generate a corresponding zoom request, and add the zoom request to the request queue to wait for a response.
  • the state of the request in the request queue is the waiting state for dequeuing, and the real-time state of the request dequeued from the request queue changes from the waiting state for dequeuing to the dequeued state.
  • the original image acquisition operation can be performed by the camera sensor in the mobile terminal
  • the zoom request is issued to the camera driver
  • the camera driver controls the camera sensor to acquire the original image
  • the data processing module mainly includes three modules, which are: an image signal front-end processing module for preliminary cropping of the original image, a spatial alignment transformation processing module for calculating the cropping data, and an image signal back-end processing module for re-cropping based on the cropping data.
  • the image signal back-end processing module After the image signal back-end processing module performs re-cropping, a zoom image corresponding to the zoom request can be obtained, and the zoom image is sent to the camera application of the mobile terminal for display, and the camera application displays the received zoom image on the shooting interface.
  • the processing progress of the second zoom request in the dequeued state is faster than that in the waiting state. If the third zoom request is queued to the second zoom request in the dequeued state and processed in advance, the zoom delay is shorter and the hand tracking is better. The image acquisition operation in the waiting state has not started. If the third zoom request is queued to the second zoom request in the waiting state, all image acquisition operations corresponding to the third zoom request will be executed when the second zoom request is waiting to be dequeued, which can also achieve the effect of processing the third zoom request in advance and displaying the image.
  • the mobile terminal can combine the zoom ratio and the real-time status to comprehensively select a target zoom request suitable for the third zoom request to jump. Specifically, the mobile terminal selects the second zoom request whose zoom ratio difference with the third zoom ratio is within a preset range and whose real-time status is that it has been dequeued as the target zoom request. In this way, the smoothness and timeliness of the entire zoom display effect are guaranteed after the third zoom request is processed in advance.
  • zoom requests may be respectively in a data acquisition node, an image signal front-end processing node, a spatial alignment transformation processing node, an image signal back-end processing node, a node waiting for sending for display, etc., and these zoom requests can be used as the third zoom request.
  • Jump target zoom request considering that in the actual image acquisition operation process, there may be two or more zoom requests in the mobile terminal that are in a queued state and have not yet been sent for display, these zoom requests may be respectively in a data acquisition node, an image signal front-end processing node, a spatial alignment transformation processing node, an image signal back-end processing node, a node waiting for sending for display, etc.
  • the zoom request with a relatively later node of the image acquisition operation among these candidate zoom requests can be used as the target zoom request.
  • the candidate zoom request whose image acquisition operation is in the image signal back-end processing operation or the space transformation processing operation is given priority as the jumpable target zoom request.
  • the target zoom magnification of the target zoom request can be modified to the third zoom magnification of the third zoom request, and the remaining image acquisition operations, such as image signal processing operations and space alignment transformation processing operations, are performed at the third zoom magnification.
  • the third preview image can be obtained at the third zoom magnification relatively quickly, further reducing the response and display delay of the third zoom request.
  • the influence of target zoom requests in different real-time states on the image acquisition operation of the third zoom request is described in detail.
  • the above-mentioned step of jumping to execute the image acquisition operation corresponding to the third zoom request to obtain the third zoom image and displaying the third zoom image when the target zoom request is out of the queue may include: on the one hand, the real-time state of the target zoom request is a waiting state for dequeueing, that is, there are one or more second zoom requests waiting to be processed or being processed before the target zoom request. Then, according to the first-in-first-out principle, it is necessary to wait for the target zoom request to be out of the queue first.
  • the target zoom request Only when the target zoom request is out of the queue, jump to execute all image acquisition operations corresponding to the third zoom request to obtain the third zoom image.
  • the second zoom request and the target zoom request before the third zoom request can be directly discarded, or the third zoom ratio of the third zoom request can be used as the target zoom ratio of the target zoom request to perform all image acquisition operations in advance and obtain the corresponding third zoom image.
  • the image acquisition operation of the target zoom request may only have a spatial alignment transformation processing operation or an image signal backend processing operation left.
  • the target zoom ratio corresponding to the target zoom request can be replaced with the third zoom ratio, and after the zoom ratio is replaced, the remaining image acquisition operations of the target zoom request are performed with the replaced third zoom ratio to quickly obtain the third zoom image.
  • the mobile terminal includes: a camera application, a camera service and a hardware abstraction layer.
  • the mobile terminal usually includes an application layer, a framework layer, a hardware abstraction layer and a kernel layer from top to bottom, wherein the application layer runs a camera application and other functional applications, can receive user input operations, and display relevant image data, etc.
  • the framework layer is equipped with a camera service, etc., and provides an application programming interface and a programming framework for the upper-layer camera application and other functional applications.
  • the kernel layer is a layer between hardware and software.
  • the kernel layer at least includes a camera driver.
  • the hardware abstraction layer can encapsulate the driver in the kernel layer, and provide a calling interface to the framework layer, shielding the implementation details of the underlying hardware.
  • the camera application Each time the camera application receives a zoom operation acting on the shooting interface, the camera application sends a zoom parameter corresponding to the zoom operation to the camera service; the camera service generates a zoom request corresponding to the zoom operation and adds it to the request queue, and sends each zoom request in the request queue to the hardware abstraction layer in sequence; the hardware abstraction layer executes an image acquisition operation corresponding to each zoom request to obtain a zoom image, and sends the obtained zoom image to the camera application; the camera application displays the zoom image.
  • the hardware abstraction layer includes an interface module, a camera sensor and a data processing module; the interface module sends each zoom request received to the camera sensor; the camera sensor processes the zoom request according to each zoom request. An exposure and image output operation is performed to obtain a corresponding original image; the data processing module performs a data processing operation on the original image of each zoom request to obtain a corresponding zoom image, and sends the zoom image to the camera application.
  • the mobile terminal further includes a selection module
  • the hardware abstraction layer further includes an application module.
  • the selection module determines the target zoom request to which the third zoom request can jump; the application module modifies the target zoom ratio of the target zoom request to the third zoom ratio; the data processing module executes the image acquisition operation corresponding to the modified target zoom request to obtain the third zoom image.
  • a specific functional module is added to realize the queue-jumping selection and implementation scheme of the third zoom request.
  • a scheme is also provided for selecting a target zoom request to be jumped to according to the real-time status of each previous second zoom request. After each second zoom request is added to the queue, the real-time status is divided into two types, waiting for dequeue status or dequeue status.
  • the zoom request in the dequeue status has been issued and is in the node for performing a specific image acquisition operation, which includes an initial image acquisition operation node, an image signal front-end processing operation node, and an image signal back-end processing operation node in sequence according to the timing of the image acquisition operation.
  • the zoom request in the dequeued state will be responded to earlier than the zoom request in the waiting dequeued state. Furthermore, among these zoom requests in the dequeued state, the zoom requests in the spatial alignment transformation processing operation node and the signal backend processing operation node will be responded to earlier. Then, in order to display the third zoom image corresponding to the third zoom request in advance, the zoom request whose real-time state is the dequeued state can be selected. If there are multiple zoom requests in the dequeued state, the second zoom request whose real-time operation node after dequeuing is the image signal backend processing operation node or the spatial alignment transformation processing operation node can be selected and determined as the target zoom request.
  • This solution of only referring to the real-time state without relying on the zoom ratio to select the jumpable target zoom request is more suitable for one-way zoom scenarios in which the zoom ratio is gradually increased or gradually decreased, for example, the one-way zoom scenario in which the zoom ratio is gradually increased from 1x to 10x, or the zoom ratio is gradually reduced from 20x to 1x.
  • a mobile terminal which has the function of implementing the display control method described in the first aspect.
  • the function can be implemented by hardware, or by hardware executing corresponding software.
  • the hardware or software includes one or more modules corresponding to the above functions.
  • a mobile terminal comprising: a camera application, a processor and a memory, wherein the camera module and the memory are coupled to the processor; the memory is used to store computer execution instructions, and when the mobile terminal is running, the processor executes the computer execution instructions stored in the memory, so that the mobile terminal executes the display control method as described in any one of the above-mentioned first aspects.
  • a display control device comprising: a receiving module, a response module and a display module.
  • the receiving module is used to receive multiple zoom operations, and sequentially receives a first zoom operation, at least one second zoom operation and a third zoom operation, the first zoom operation is received earlier than the third zoom operation, and the first zoom operation is separated from the third zoom operation by at least one second zoom operation.
  • the response module is used to respond to a first zoom operation among the multiple zoom operations, and the display module is used to display a first zoom image, wherein the first zoom image is an image obtained at a first zoom ratio corresponding to the first zoom operation; the response module is also used to respond to a third zoom operation among the multiple zoom operations, and display a third zoom image, wherein the third zoom image is an image obtained at a third zoom ratio corresponding to the third zoom operation.
  • a computer-readable storage medium wherein instructions are stored in the computer-readable storage medium, and when the computer-readable storage medium is run on a computer, the computer can execute the display control method described in any one of the above-mentioned first aspects.
  • a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the display control method described in any one of the first aspects.
  • the technical effects brought about by any design method in the third to sixth aspects can refer to the technical effects brought about by different design methods in the first aspect, and will not be repeated here.
  • FIG1 is a schematic diagram of a shooting interface of a mobile terminal
  • FIG. 2 is a schematic diagram showing a comparison of interfaces before and after a mobile terminal receives a zoom operation in an existing solution
  • FIG3 is a schematic diagram of the expected optimization effect corresponding to FIG2 ;
  • FIG4 is a second schematic diagram of the interface comparison before and after the mobile terminal receives the zoom operation in the existing solution
  • FIG5 is a schematic diagram of the expected optimization effect corresponding to FIG4 ;
  • FIG6 is a schematic diagram of the internal software architecture of a mobile terminal provided in an embodiment of the present application.
  • FIG. 7 is a schematic diagram of an internal flow chart of a mobile terminal processing a zoom request according to an embodiment of the present application
  • FIG8 is a schematic diagram of an internal flow chart of a mobile terminal processing multiple zoom requests according to an embodiment of the present application
  • FIG9 is a flow chart of a display control method according to an embodiment of the present application for implementing a zoom request jump process
  • FIG10 is a schematic diagram showing a comparison of the processes before and after the mobile terminal application display control method provided in an embodiment of the present application
  • FIG11 is a schematic flow chart of a display control method provided in an embodiment of the present application.
  • FIG12 is a schematic diagram of a display control method for implementing a request queue interruption according to an embodiment of the present application
  • FIG. 13 is a schematic diagram of the structure of a mobile terminal provided in an embodiment of the present application.
  • the mobile terminal is provided with lenses of different focal lengths.
  • the zoom parameters such as the zoom ratio (Zoom Ratio) of the zoom to adjust the field of view (FOV) of the shooting interface
  • FOV field of view
  • the technical effect of enlarging or reducing the photographed object in the shooting interface is achieved.
  • the user applies a zoom operation on the shooting interface of the mobile terminal.
  • the camera application and related modules in the mobile terminal cooperate to respond to the zoom operation to obtain a zoomed image corresponding to the zoom ratio and display it on the shooting interface.
  • the main application scenarios of the display control method provided in the embodiment of the present application include the shooting preview scene of the mobile phone, and the shooting preview scene of the mobile phone will be described below.
  • the provided display control method is not limited to being applied only to mobile phones, and is not limited to being applied only to shooting preview scenes.
  • FIG1 is a schematic diagram of a shooting interface of a mobile terminal.
  • a user can perform a zoom operation.
  • the mobile terminal receives the zoom operation and responds to the zoom operation to obtain a corresponding zoom image and display the zoom image in the shooting interface.
  • the shooting interface 100 of the mobile terminal mainly includes:
  • the image display area 102 includes: a parameter control area 101, an image display area 102, a mode control area 103, a front and rear camera flip control 104, a gallery control 105, a shutter control 106, and a zoom control 107.
  • the parameter control area 101 includes a plurality of parameter controls, each of which is used to respond to a shooting parameter adjustment operation input by a user.
  • the parameter controls included in the parameter control area may include, but are not limited to: a flash control, an AI recognition switch control, a color standard control, and a more detailed camera setting control.
  • the image display area 102 may be used to display a preview image, which is an image captured in real time by a mobile terminal through a camera. The mobile terminal may refresh the display content in the image display area 102 in real time so that the user can preview the image currently captured by the camera.
  • the mode control area 103 may include a plurality of mode controls corresponding to different shooting modes, such as an aperture mode control, a night scene mode control, a portrait mode control, a photo mode control, a video mode control, a professional mode control, and more mode controls. Each mode control can be marked only by text information, for example, "aperture”, "night scene”, “portrait”, “photo”, “video”, “professional”, “more”, or it can be displayed by an icon, or a combination of text information and icons.
  • the zoom control 107 is used to respond to the zoom operation of the user on the mobile terminal to adjust the FOV of the image display area 102.
  • the "1 device" displayed on the zoom control 107 indicates that the current optical zoom ratio of the mobile terminal is 1x, and the subsequent x represents the zoom ratio.
  • the user can apply the zoom operation by applying a point operation or a sliding operation on the zoom control 107, and of course, the zoom operation can also be applied by a touch operation that does not act on the zoom control 107.
  • the mobile terminal can pre-define the operation of sliding fingers toward each other or sliding fingers away from each other on the shooting interface as a zoom operation, or pre-define the operations of clockwise rotation sliding and counterclockwise rotation sliding on the shooting interface as zoom operations. Such other pre-defined touch operations act on the shooting interface, but not necessarily on the zoom control 107.
  • the zoom operation received by the mobile terminal may also be a zoom operation that does not need to act on the shooting interface, but an adjustment operation on a physical device on the surface or side of the mobile terminal.
  • a physical button or knob is set on the side of the mobile terminal as a zoom switch, and this part of the physical buttons or knobs can be associated with indicating a specific zoom value selection or zoom ratio adjustment operation, etc.
  • This part of the physical buttons or knobs can be a separate physical device dedicated to receiving zoom operations, or it can be a reused existing volume adjustment button or channel adjustment knob in a shooting scene, etc., without limitation. This situation may be more suitable for scenarios where the mobile terminal is a retro-styled mobile phone, an elderly phone, a card machine, etc.
  • the mobile terminal After the mobile terminal receives the zoom operation applied by the user, it can respond to the zoom operation.
  • the process of responding to the zoom operation may include but is not limited to: generating a zoom request according to the zoom operation, sending the zoom request to perform image acquisition operation and image processing operation, obtaining a zoom image, and finally sending the zoom image to the shooting interface for display.
  • the user may apply multiple zoom operations in succession on the shooting interface, such as applying multiple zoom operations by sliding the zoom control, or applying multiple zoom operations by continuously clicking the zoom control.
  • the mobile terminal will also receive these multiple zoom operations in succession, and respectively generate a zoom request for each received zoom operation, perform image acquisition operation and image processing operation after the zoom request is sent, obtain the zoom image and send it for display. This is a complete set of zoom operation response processes.
  • each zoom operation response process requires a processing time of approximately 250 milliseconds. Then, if the user releases the hand after applying multiple zoom operations in succession, the mobile terminal will execute the zoom operation response process of each zoom operation in sequence according to the sequence of the zoom operations.
  • the last zoom operation needs to wait until all the previous zoom operation response processes are completed before it can be responded to, and the zoom image corresponding to the last zoom operation can only be displayed after the last zoom operation response process is completed.
  • the waiting time from receiving the last zoom operation to displaying the zoom image corresponding to the last zoom operation is long, that is, the delay of the zoom operation is long and the hand tracking performance is poor.
  • FIG2 a comparative schematic diagram of the existing zoom preview interface having a delay after applying a zoom operation in a scenario where a zoom operation is applied by a sliding touch touch mode is shown.
  • the user's finger operates the sliding control 107 at 1x
  • the zoom magnification 108 on the shooting interface shows 1x
  • the corresponding zoom image is a 1x zoom image.
  • the user's finger slides the sliding control 107 from 1x to 3x, and the zoom magnification 108 on the shooting interface has also been switched from 1x to 3x, but due to the response delay, the zoom image in the image display area 102 does not switch to a 3x zoom image, but still displays a 1x zoom image, and the hand tracking is poor.
  • the shooting interface we expect is shown in (a) to (b) of FIG3 .
  • the user's finger slides the sliding control 107 from 1x to 3x.
  • the zoom ratio 108 on the shooting interface has also been switched from 1x to 3x, and the zoom image in the image display area 102 has also been switched to a 3x zoom image.
  • the user can clearly feel the improvement of the zoom and chirality.
  • FIG4 it is a comparative schematic diagram of the delay after the zoom operation is applied to the existing zoom preview interface in the scenario of the relative sliding touch of the finger.
  • the user's fingers slide back to back to increase the zoom ratio, and the sliding control 107 automatically switches from 1x to 3x at this time.
  • the zoom ratio 108 on the shooting interface has also switched from 1x to 3x, but due to the response delay, the zoom image in the image display area 102 does not switch to a zoom image of 3x, but still displays a zoom image of 1x, and the chirality is poor.
  • the shooting interface expected by our mobile phone is that the user's fingers slide back to back to increase the zoom ratio, and the sliding control 107 automatically switches from 1x to 3x at this time.
  • the zoom ratio 108 on the shooting interface has also switched from 1x to 3x, and the zoom image in the image display area 102 switches from a zoom image of 1x to a zoom image of 3x, and the chirality is good.
  • the embodiment of the present application provides a display control method and a mobile terminal and a computer-readable storage medium for implementing the display control method, and the zoom request generated later is jumped to a certain previous zoom request for processing in advance to reduce the response delay of the zoom request generated later.
  • the provided display control method is applied to a mobile terminal equipped with a camera and related support modules.
  • the mobile terminal can be a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, an augmented reality (AR)/virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA) or a special camera (such as a SLR camera, a card camera), etc., without limitation.
  • AR augmented reality
  • VR virtual reality
  • UMPC ultra-mobile personal computer
  • PDA personal digital assistant
  • special camera such as a SLR camera, a card camera
  • the mobile terminal receives the zoom operation performed by the user on the shooting interface, and generates a zoom preview image corresponding to the zoom touch operation by calling the camera application and related modules running in the internal software architecture of the mobile terminal.
  • the camera application applicable to the embodiment of the present application may include any application on the mobile terminal that can realize the shooting preview function, such as the original camera application, the image beautification camera application, etc., without limitation.
  • FIG. 6 it is a diagram of the internal architecture of the mobile terminal. The following will explain in detail the process of the mobile terminal responding to the zoom operation in combination with the internal architecture of the mobile terminal.
  • the internal architecture of the mobile terminal can be divided into four layers, from top to bottom, namely, the application layer (APP), the framework layer (FWK), the hardware abstraction layer (HAL), and the kernel layer (or driver layer).
  • APP application layer
  • FWK framework layer
  • HAL hardware abstraction layer
  • driver layer kernel layer
  • the application layer can include a series of application packages, such as camera applications, gallery applications, applications with camera functions, etc.
  • Application packages can also include applications such as calls, calendars, maps, navigation, music, videos, short messages, etc.
  • the framework layer provides application programming interface (API) and programming framework for the applications in the application layer.
  • API application programming interface
  • the application framework layer includes some predefined functions.
  • the framework layer runs a camera service, which can be called by the camera application to implement functions related to shooting.
  • the framework layer can also include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, etc.
  • the window manager is used to manage window programs.
  • the window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc.
  • the content provider is used to store and obtain data and make the data accessible to the application.
  • the data may include video, images, audio, dialed and received calls, browsing history and bookmarks, phone books, etc.
  • the view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc.
  • the view system can be used to build applications.
  • the display interface can be composed of one or more views.
  • a display interface including a text notification icon can include a view for displaying text and a view for displaying pictures.
  • the phone manager is used to provide communication functions for the mobile terminal. For example, the management of call status (including connected, hung up, etc.).
  • the resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, etc.
  • the notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, notification information is used to inform the completion of downloads, message reminders, etc.
  • Notification information can also be a notification that appears in the top status bar of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window.
  • Notification information can also be, for example, a text message prompted in the status bar, a prompt sound, a vibration of the power terminal, a flashing indicator light, etc.
  • the camera application can also call the content provider, resource manager, notification manager, window manager, view system, etc. according to actual business needs, and the embodiments of the present application do not impose any restrictions on this.
  • the kernel layer is a layer between hardware and software.
  • the kernel layer includes at least a camera driver.
  • the camera driver can be used to drive a hardware module with a shooting function, such as a camera sensor (Camera Sensor).
  • the camera driver is responsible for data interaction with the camera sensor.
  • the kernel layer may also include a display driver, an audio driver, a sensor driver, etc., and the embodiments of the present application do not impose any restrictions on this.
  • the hardware abstraction layer can encapsulate the driver in the kernel layer and provide a calling interface to the framework layer, shielding the implementation details of the underlying hardware.
  • the hardware abstraction layer can include a camera call processing module (Camera HAL), a multi-camera decision module, etc.
  • the camera call processing module is the core software framework of the camera Camera, and the camera call processing module includes an interface module, a sensor node (Sensor Node) and a data processing module, etc.
  • the data processing module can include an image signal front-end processing (Image Signal Processing Front End, IFE) module, a spatial alignment transform (Spatial Alignment Transform, SAT) processing module, and an image signal back-end processing (Image Signal Processing Post End, IPE) module.
  • the related processing involved in the sensor node and the image signal front-end processing module belongs to the real-time pipeline (Realtime Pipeline) processing
  • the related processing involved in the control alignment transform processing module and the image signal back-end processing module belongs to the offline pipeline (Offline Pipeline) processing.
  • the above-mentioned sensor nodes, data processing modules and interface modules are components in the image data and control instruction transmission pipeline in the camera call processing module.
  • the sensor node may be a control node facing a camera sensor.
  • the camera driver controls the camera sensor.
  • the interface module can be a software interface for the application framework layer, which is used to interact with the application framework layer for data.
  • the interface module can also interact with the multi-camera decision module, data processing module, sensor node, etc. in the camera call processing module.
  • the data processing module can process the original image data sent back by the camera sensor, among which the image signal front-end processing module is used to process the preview image collected by the camera sensor for preliminary cropping and reserve the image edge (Margin); the spatial alignment transformation processing module is used to perform spatial alignment on the image data according to the zoom ratio and the spatial alignment transformation processing algorithm, and determine the cropping data and the warp data to make the preview image smoother; the image signal back-end processing module is used to perform cropping and warping on the preview image data according to the calculation results of the spatial alignment transformation processing module.
  • the image signal front-end processing module is used to process the preview image collected by the camera sensor for preliminary cropping and reserve the image edge (Margin)
  • the spatial alignment transformation processing module is used to perform spatial alignment on the image data according to the zoom ratio and the spatial alignment transformation processing algorithm, and determine the cropping data and the warp data to make the preview image smoother
  • the image signal back-end processing module is used to perform cropping and warping on the preview image data according to the calculation results of the spatial alignment
  • the camera application can pass the camera mode, zoom parameters and other information selected by the user to the camera service of the framework layer, and then the camera service passes it to the multi-camera decision module through the interface module of the hardware abstraction layer.
  • the multi-camera decision module can determine the camera sensor to be used for image output according to the application scenario, such as the camera sensor of the front camera or the camera sensor of the rear camera, and the camera sensor of the main camera, the camera sensor of the wide-angle camera, and the camera sensor of the telephoto camera in the rear camera.
  • the layers in the software structure shown in FIG6 and the components contained in each layer do not constitute a specific limitation on the mobile terminal.
  • the mobile terminal may include more or fewer layers than shown, and each layer may include more or fewer components, which is not limited in the present application.
  • the mobile terminal includes hardware and/or software modules corresponding to the execution of each function.
  • the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of the present application.
  • the process of the mobile terminal responding to the zoom operation can be mainly divided into two parts: a top-down signal flow (shown by the solid arrow in FIG. 7 ), that is, after the mobile terminal receives the zoom operation, it generates a response control signal to control the relevant modules to perform the image acquisition operation to obtain a zoom image; a bottom-up data flow (shown by the dotted arrow in FIG. 7 ), that is, after the camera sensor of the mobile terminal captures the original image, it obtains the zoom image after the image processing operation, and sends the zoom image to the camera application of the application layer for display.
  • a top-down signal flow shown by the solid arrow in FIG. 7
  • a bottom-up data flow shown by the dotted arrow in FIG. 7
  • the signal flow shown by the solid arrow in Figure 7 mainly includes: the user applies a zoom operation by clicking, sliding or other pre-defined operation methods on the shooting preview interface of the mobile terminal, and the touch module of the mobile terminal responds to the zoom touch operation and generates a corresponding touch point reporting event and sends it to the camera application of the application layer.
  • the camera application converts the point reporting coordinate data corresponding to the touch point reporting event into a zoom ratio (Zoom Ratio) and sends it to the camera service of the framework layer.
  • the camera service generates a zoom request corresponding to the zoom ratio and sends the zoom request to the camera hardware call module in the hardware abstraction layer.
  • the zoom request is sent to the sensor node. According to the zoom request, the sensor node controls the camera sensor through the camera driver to perform exposure and image output operations.
  • the data flow shown by the dotted arrow in FIG7 mainly includes: after the camera sensor completes the exposure and image output operation, the original image data corresponding to the zoom request is sent to the image signal front-end processing module through the camera driver.
  • the image signal front-end processing module performs preliminary cropping processing on the original image data corresponding to the zoom request, and sends the processed image data to the spatial alignment transformation processing module.
  • the image signal front-end processing module can perform preliminary cropping processing on the original image data according to the zoom ratio corresponding to the zoom request, and retain the edge area of the image, so that the spatial alignment transformation processing module can perform spatial alignment processing on the image.
  • FIG. 7 above shows a situation where a mobile terminal processes a zoom request.
  • the mobile terminal may continue to receive multiple zoom operations. Then, the internal camera application and related supporting modules of the mobile terminal need to respond to these multiple zoom operations in sequence. After each zoom operation is received, the camera application generates a corresponding zoom ratio based on the touch point event corresponding to the zoom operation, and sends the zoom ratio to the camera service, which generates a corresponding zoom request. Then, when multiple zoom operations are continuously received, the camera service will continue to generate multiple corresponding zoom requests, and the zoom ratios of different requests may be different.
  • the camera service can maintain a request queue and add each newly generated zoom request to the request queue.
  • the request queue is a first-in-first-out queue.
  • the zoom request that enters the queue first is first out of the queue and sent to the hardware abstraction layer for image acquisition operations.
  • the zoom request that has not been processed is waiting for processing in the request queue, and the newly generated zoom request is added to the end of the request queue.
  • zoom request 30 As shown in FIG8 , assuming that 30 zoom requests are currently continuously generated, the latest generated zoom request 30 is at the end of the request queue, all zoom requests before zoom request 20 have been processed, zoom request 20 to zoom request 24 have been dequeued and have not completed all image acquisition operations, and zoom request 25 to zoom request 30 are all in the request queue waiting to be dequeued and responded to.
  • each zoom request sent by the camera service undergoes data processing operations such as sensor node collecting image data, preliminary cropping, calculating cropping data and distortion data, re-cropping and image distortion in the camera hardware call module before the corresponding preview image is obtained and sent for display.
  • data processing operations such as sensor node collecting image data, preliminary cropping, calculating cropping data and distortion data, re-cropping and image distortion in the camera hardware call module before the corresponding preview image is obtained and sent for display.
  • Each zoom operation is processed from receiving to preview. The display time is longer and the response is slower.
  • the user When actually using the camera preview function, the user will continue to apply multiple zoom operations by clicking, sliding, etc. to indicate different zoom requirements, but usually the latest generated zoom request is closer to the user's actual zoom requirement.
  • Some of the previous zoom touch operations before the latest zoom request may be zoom touch operations that are accidentally triggered during the sliding process, or zoom requirements that the user needed at the previous moment but may no longer need at the current moment. That is, after the zoom request is generated, some of the previous zoom requests before the zoom request may no longer need to be processed and previewed, which is a factor that allows the zoom request to be queued up in advance.
  • the image data sources and data processing operations involved in the processing of different zoom requests are related to the zoom parameters such as the zoom ratio and the focal length of the lens to which each zoom request corresponds to a certain extent.
  • the sensor node first controls the camera sensor through the camera driver to perform exposure and image output operations, and the controlled camera sensor is the camera sensor corresponding to the zoom ratio.
  • the original preview image collected by the camera sensor is relied on to perform the initial cropping process corresponding to the zoom ratio, calculate the cropping and distortion data, and perform the re-cropping and distortion process.
  • the zoom ratios of different zoom requests are close (for example, the difference is within 0.5x, 1x or 1.5x), or they belong to the focal length range of the same lens type, then the original preview images obtained by the exposure and image output operation at the sensor node are also relatively close or even the same, and the subsequent initial cropping process, calculation of cropping and distortion data, or the data or calculation amount of re-cropping and distortion processing will also be relatively close. That is, when different zoom requests are processed, there may be similar or identical image acquisition or data processing operations due to relatively close or identical zoom parameters.
  • the original preview image obtained by a previous zoom request the intermediate data obtained after preliminary cropping, re-cropping and distortion, etc. may also be considered. This is another factor that allows the third zoom request to be processed in the queue.
  • the zoom magnifications of the previously generated zoom requests 20-29 in the request queue may be "2.8x, 2.0x, 3.5x, 2.8x, 2.5x, 1x, 2.5x, 3.5x, 3x, 3.2x," respectively, and the zoom magnification of the latest generated zoom request 30 may be "3.1x.”
  • the mobile terminal may be processing the zoom request 20 in advance, or may be processing the previous zoom requests 20-22, that is, multiple different previous zoom requests may all be in the processing state, but the processing nodes of the multiple previous zoom requests being processed are different.
  • the display control method provided in the embodiment of the present application is a schematic diagram of advancing the subsequent zoom operation to the previously generated zoom request for queue processing at the internal software architecture level.
  • the mobile terminal will continue to receive multiple zoom operations, and define the zoom operation with the earliest reception time among the multiple zoom operations that are not currently displayed as the first zoom operation, and the zoom operation with the latest reception time as the third zoom operation.
  • At least one zoom operation received between the first zoom operation and the third zoom operation is the second zoom operation.
  • the mobile terminal after the mobile terminal displays the first zoom image, it will directly display the third zoom operation, and will not display the second zoom image corresponding to the second zoom operation. Then, at least one of the second zoom operations in between may not need to be responded to at all, or may only need to respond to some of the second zoom operations.
  • zoom request 20 has completed the image acquisition operation and is about to be displayed, corresponding to the first zoom image of the first zoom operation.
  • Zoom request 30 is the latest generated third zoom request, and the zoom requests between zoom request 21 to zoom request 29 correspond to the second zoom request.
  • the third zoom request is jumped to display.
  • FIG. 10 it is a schematic diagram of the internal image acquisition operation and the external image display of the display control method.
  • FIG. 10 is a schematic diagram of the case where the third zoom request is not responded to in advance, that is, the mobile terminal will respond to the first zoom request, at least one second zoom request and the third zoom request in sequence, and display the first zoom image, at least one second zoom image and the third zoom image in sequence.
  • FIG10 is a schematic diagram of the case of responding to the third zoom request in advance, that is, the mobile terminal responds to the first zoom request and then jumps in to respond to the third zoom request, and jumps in to display the third zoom image after displaying the first zoom image.
  • the display control method provided in the embodiment of the present application considers first selecting a zoom request suitable for the third zoom request to jump from the multiple prior second zoom requests, and queueing the third zoom request to the selected second zoom request for processing. For example, in the example of FIG. 10 above, the zoom ratios of zoom request 23 (zoom ratio 2.8x), zoom request 28 (zoom ratio 3x), etc.
  • zoom ratio 3.1x zoom ratio of the third zoom request (i.e., zoom request 30), so it can be considered to advance the third zoom request to the time when the zoom requests with relatively close zoom ratios are processed or after being processed. In this way, the response delay of the subsequent zoom request can be reduced, and the stability and smoothness of the zoom preview display can be optimized.
  • FIG11 it is a flow chart of selecting a target zoom request in the display control method provided in an embodiment of the present application.
  • the process mainly includes the following steps:
  • Step S1101 selecting a jumpable target zoom request from the second zoom request
  • Step S1102 when the target zoom request is dequeued, jump to execute the graphics acquisition operation of the third zoom request;
  • Step S1103 displaying the third zoom image of the third zoom request in advance.
  • the request queue maintained by the mobile terminal may include: a first zoom request (zoom request 20) to be displayed, multiple previously generated second zoom requests (zoom requests 21-29) whose corresponding zoom images have not yet been displayed, and a newly generated third zoom request (zoom request 30).
  • the generation time of these zoom requests is arranged in sequence along the direction of the arrow, that is, the generation time of the prior zoom request 20 is the earliest, the generation time of the prior zoom request 21 is only later than the prior zoom request 20, and the generation time of the third zoom request 30 is the latest.
  • a second zoom request K is selected from the second zoom requests 21-29 as the target zoom request, where K ⁇ (20-29) is any integer.
  • the mobile terminal selects a target zoom request that can jump into the queue for the third zoom request, it can consider the impact of the zoom ratio on the amount of calculation or the impact on the smoothness of the display switching, and select the target zoom request according to the zoom ratio of each second zoom request.
  • it can also be based on the real-time status of each second zoom request, whether it is in the request queue waiting to be dequeued, or has been dequeued and the data is processed.
  • the mobile terminal may also select a target zoom request with a matching lens from a plurality of previous second zoom requests according to the lens type required by the third zoom request, without limitation.
  • the third zoom request can be processed in advance.
  • the mobile terminal When processing the target zoom request, the mobile terminal processes the third zoom request in advance, and after processing, the third zoom image corresponding to the third zoom request can be obtained. Then, at this time, the mobile terminal can preview and display the third zoom image.
  • the third zoom image is previewed and displayed, and its timely response zoom effect can be directly seen by the user, which is also the basis for the user to judge the zoom experience.
  • the latest generated zoom request is processed and displayed in advance, which greatly optimizes the user's photo preview experience.
  • the mobile terminal also includes a selection module, and the hardware abstraction layer also includes an application module; wherein the selection module determines a target zoom request to which the third zoom request can jump; the application module modifies the target zoom ratio of the target zoom request to the third zoom ratio; and the data processing module executes an image acquisition operation corresponding to the modified target zoom request to obtain the third zoom image.
  • the display control method provided in the embodiment of the present application is more suitable for the situation where there are three or more zoom requests.
  • the delay of the zoom response is relatively long, which will obviously affect the user experience. If there is only one zoom request, that is, there are no other second zoom requests that have not been processed before the third zoom request, then there is no need to determine the target zoom request, and the third zoom request can be directly processed after the first zoom request is processed.
  • the response delay here only includes the processing time of the third zoom request, and does not include the processing time waiting for other prior zoom requests.
  • the third zoom request can also be directly jumped to the processing before the second zoom request, etc., without limitation.
  • the display control method provided in the embodiment of the present application can be configured as a self-starting scheme for the zoom preview scene, that is, when the mobile terminal is in the zoom preview scene, the display control method provided in the embodiment of the present application will be applied in real time or periodically. For example, each time a new zoom request is generated, the newly generated zoom request can be used as the third zoom request, and a target zoom request that can be jumped into the queue is selected for it. If a new zoom request (such as zoom request 31) is generated after this newly generated zoom request (such as zoom request 30), then the zoom request generated first (such as zoom request 30) becomes the first zoom request of the zoom request generated later (such as zoom request 31).
  • the zoom request generated earlier (such as zoom request 30) can also be queued by the zoom request generated later (such as zoom request 31), so as to give priority to ensuring the timely response effect of the latest generated zoom request.
  • This configuration scheme may be more suitable for the zoom preview scenario where the user expects the zoom preview image to be displayed in time.
  • the display control method provided in the embodiment of the present application can also be configured as a solution manually enabled by the user. That is, the user can apply a corresponding touch operation in the setting interface of the mobile terminal or in the shooting control of the shooting preview interface to indicate the application of the display control method provided in the embodiment of the present application.
  • This configuration scheme may be more suitable for zoom preview scenarios where the user expects the zoom preview image to display different zoom effects in sequence.
  • 9 to 11 show the process of determining to respond to the third zoom request in advance based on the zoom ratio. Then, the following will explain in detail how to select a target zoom request suitable for the third zoom request jump based on the zoom ratio.
  • the mobile terminal can select a second request whose zoom magnification is close to the zoom magnification of the third zoom request as the target zoom request. For example, the magnification difference between the second zoom magnification and the third zoom magnification corresponding to each of the second zoom requests is obtained, and the second zoom request whose magnification difference is within a preset range is selected as the target zoom request.
  • the mobile terminal may also select a zoom magnification that is smaller than or larger than the zoom magnification of the third zoom request, or select a previous zoom request whose zoom magnification meets other preset conditions as the target zoom request, etc.
  • the real-time status is divided into two types, waiting to be dequeued or already dequeued.
  • the zoom request in the already dequeued state has been issued and is at a node that performs a specific image acquisition operation, which includes an initial image acquisition operation node, an image signal front-end processing operation node, and an image signal back-end processing operation node in sequence according to the timing of the image acquisition operation.
  • the real-time status of the second zoom request is different, and its remaining waiting time is different.
  • the previous zoom request in the waiting to be dequeued state has a remaining waiting time that includes at least its own entire processing time, and may also include the processing time for waiting for other prior zoom requests.
  • its remaining waiting time may include part of its own processing time.
  • the remaining waiting time of the second zoom request that is already dequeued is relatively short, and all processing operations may be completed earlier.
  • the mobile terminal may select a scheme of a jumpable target zoom request only according to the real-time status of each previous second zoom request.
  • the zoom request in the dequeued state will be responded to earlier than the zoom request in the waiting dequeued state. Furthermore, among these zoom requests in the dequeued state, the zoom requests in the spatial alignment transformation processing operation node and the signal backend processing operation node will be responded to earlier. Then, in order to display the third zoom image corresponding to the third zoom request in advance, the zoom request whose real-time state is the dequeued state can be selected. If there are multiple zoom requests in the dequeued state, the second zoom request whose real-time operation node after dequeuing is the image signal backend processing operation node or the spatial alignment transformation processing operation node can be selected and determined as the target zoom request.
  • This solution of only referring to the real-time state without relying on the zoom ratio to select the jumpable target zoom request is more suitable for one-way zoom scenarios in which the zoom ratio is gradually increased or gradually decreased, for example, the one-way zoom scenario in which the zoom ratio is gradually increased from 1x to 10x, or the zoom ratio is gradually reduced from 20x to 1x.
  • the solution of selecting the target zoom request only by referring to the real-time status can improve the timeliness of the third zoom request, but may affect the smoothness of preview image switching, etc.
  • the mobile terminal may also combine the zoom ratio and the real-time status to select a target zoom request that is more suitable for the third zoom request to jump into the queue.
  • the specific step of determining the target zoom request may include:
  • the mobile terminal first determines the zoom magnification of the third zoom request based on the zoom magnification of the third zoom request and the dependency of similar zoom magnifications in the data processing operation, and obtains a magnification range. Then, based on the magnification range, a part of the second zoom requests that may be suitable are screened out from all the second zoom requests, and then a target zoom request that is suitable for the third zoom request to jump to is further selected from the part of the second zoom requests. For ease of description, the part of the previous zoom requests can be defined as candidate zoom requests.
  • the mobile terminal first determines the magnification to which the zoom magnification of the third zoom request belongs. Specifically, the mobile terminal predefines a magnification step according to the correlation between the zoom magnifications of each focal length, and the magnification step indicates the range of zoom magnifications with relatively large correlation.
  • the mobile terminal determines the magnification range to which the zoom magnification belongs with the zoom magnification of the third zoom request as the center, wherein the length of the magnification range is equal to the preset adjustment step, and the median of the magnification range is the zoom magnification of the third zoom request.
  • the preset adjustment step predefined by the mobile terminal is 1x. If the zoom magnification of the third zoom request is 3.1x, then the corresponding magnification range may be (2.6x-3.6x). If the preset adjustment step is 0.4x, then the corresponding magnification range may be (2.9x-3.3x).
  • magnification range of the preset adjustment step before the zoom magnification of the third zoom request may be taken.
  • the preset adjustment step in the example is 0.4x
  • the zoom magnification of the third zoom request is 3.1x
  • the corresponding magnification range may be (2.7x-3.1x), etc.
  • magnification range may be select the magnification range, which are not limited.
  • the candidate zoom request whose image acquisition operation is in the image signal backend processing operation or the space alignment transformation processing operation is used as the target zoom request.
  • All processing operations of each zoom request in the data processing module include image signal front-end processing operation, spatial alignment transformation processing operation and image signal back-end processing operation in sequence.
  • the processing progress of the spatial alignment transformation processing operation and the image signal back-end processing operation is relatively fast.
  • the candidate zoom request whose image acquisition operation is in the image signal back-end processing operation or the spatial alignment transformation processing operation can be preferentially selected as the target zoom request.
  • the candidate zoom requests whose zoom magnifications belong to the magnification range and whose real-time status is that they have been dequeued are selected from the prior zoom requests.
  • the candidate zoom requests mentioned here are only used to refer to some zoom requests that meet the requirements, and are not limited to being assigned or renamed as candidate zoom requests. That is, the mobile terminal can only perform the action of screening according to the zoom magnification and magnification range, and does not need to perform the action of assigning or renaming objects for the part of the prior zoom requests obtained by the screening action.
  • the mobile terminal can also superimpose the zoom lens type to select the target zoom request.
  • the lenses installed in the mobile terminal mainly include the main camera lens, the wide-angle lens and the telephoto lens.
  • the main camera lens is the one with the highest pixel among all the cameras of the mobile terminal.
  • the wide-angle camera is a camera with a wide-angle function. The wide-angle viewing angle is wider than that of a general lens and the focal length is shorter. It is often used to shoot objects with a large area.
  • the telephoto camera can take longer photos to ensure the clarity of the photos. Wide-angle lenses and telephoto lenses can usually make up for the shortcomings of the main camera and improve the shooting effect.
  • the zoom parameters of the zoom request generated by the mobile terminal can also include the zoom lens type.
  • the zoom lens type The camera type includes at least one of a main camera lens, a telephoto lens, and a wide-angle lens.
  • the mobile terminal determines the target zoom request according to the zoom lens type of the third zoom request and the zoom lens types of each candidate zoom request. Specifically, the candidate zoom request whose zoom lens type includes the zoom lens type of the third zoom request is used as the target zoom request.
  • the zoom magnification of zoom request 20 is 2.8x, and its zoom lens type may be a telephoto lens.
  • the zoom magnification of zoom request 21 is 2.0x, and its zoom lens type may be a main camera lens.
  • the zoom magnification of the third zoom request 30 is 3.1x, and its zoom lens type may be a telephoto lens.
  • the zoom switching type from zoom request 20 to the third zoom request 30 is Zoom In, and the zoom lens type (main camera lens) included in zoom request 20 does not include the zoom lens type (telephoto lens) included in the third zoom request 30.
  • the zoom switching type from zoom request 21 to the third zoom request 30 is Zoom Out, and the zoom lens type (telephoto lens) included in zoom request 21 includes the zoom lens type (telephoto lens) included in the third zoom request 30.
  • the scheme of selecting zoom request 21 as the target zoom request reduces the operation of switching lenses to regenerate the original image and align it, compared with the scheme of selecting zoom request 20 as the target zoom request.
  • the mobile terminal may have multiple options for the node to which the third zoom request is redirected in advance.
  • the third zoom request may be advanced to after the target zoom request, and when the target zoom request is dequeued, the image acquisition operation of the third zoom request may be executed.
  • the real-time state of the third zoom request may be jumped to the current processing node of the target zoom request.
  • the real-time node of the target zoom request is a spatial alignment transformation processing node
  • the real-time node of the third zoom request is jumped from the waiting node to the spatial alignment transformation processing node.
  • each zoom request needs to undergo processing operations of each processing node in turn on the processing link before obtaining the final preview image.
  • the second zoom request 21 is in the spatial alignment transformation processing node
  • the earlier first focus request 20 may be in the image signal back-end processing node
  • the later second zoom request 22 may be in the image signal front-end processing node
  • the later previous zoom request 23 may be in the sensor node.
  • the target zoom ratio corresponding to the target zoom request is modified to the third zoom ratio, and the remaining image acquisition operations of the modified target zoom request are executed to obtain the third zoom image.
  • the mobile terminal can replace the second zoom ratio of the second zoom request with the third zoom ratio of the third zoom request, so that the zoom image corresponding to the third zoom ratio is acquired in advance and displayed in advance as the third zoom image.
  • At least one second zoom request before the third zoom request can be dequeued and then discarded without executing any image acquisition operation, or only a portion of the image acquisition operation is executed before executing the image acquisition operation of the third zoom request, which can also ensure that the third zoom image is acquired and displayed in advance.
  • zoom magnifications of each zoom request are shown in FIG12. Then, when display control is performed based on the zoom magnification factor, the process of selecting jump schemes for each subsequent zoom request 8 to 14 in sequence is as follows:
  • zoom ratio 1.6x of zoom request 8 is close to the zoom ratio 1.5x of zoom request 3, zoom request 8 jumps to zoom request 3, and the zoom ratio of zoom request 3 is changed to 1.6x of zoom request 8;
  • the zoom ratio 1.9x of zoom request 9 is close to the zoom ratio 2.0x of zoom request 4, so zoom request 9 first jumps to zoom request 4, and the zoom ratio of zoom request 4 is modified to the zoom ratio 1.9x of zoom request 9;
  • the zoom ratio 2.6x of zoom request 11 is close to the zoom ratio 2.5x of zoom request 5, zoom request 11 jumps to zoom request 5, and the zoom ratio of zoom request 5 is modified to the zoom ratio 2.6x of zoom request 11;
  • zoom ratio 3.0 of zoom request 12 is close to the zoom ratio 3.0 of zoom request 7 (same is also considered close), zoom request 12 jumps to zoom request 7, and the zoom ratio of zoom request 7 is modified to the zoom ratio 3.0x of zoom request 12;
  • Zoom request 13 has no previous zoom request suitable for queue interruption, so zoom request 13 can be reserved in order and placed after zoom request 7 after the zoom magnification is modified, forming a new zoom request 8 with a zoom magnification of 3.5x;
  • zoom ratio of zoom request 14 is close to that of zoom request 13 (new zoom request 8 ), so zoom request 14 is redirected to new zoom request 8 , and the zoom ratio of new zoom request 8 is modified to the zoom ratio of zoom request 14 (3.6x).
  • Memory stores computer-executable instructions
  • the processor executes the computer-executable instructions stored in the memory, so that the mobile terminal executes the display control method provided in the above embodiment.
  • the mobile terminal also includes components for implementing basic functions, which will be specifically described below in conjunction with FIG. 13 .
  • FIG13 is a schematic diagram of the structure of a mobile terminal 1300 provided in an embodiment of the present application.
  • the mobile terminal 1300 may include a processor 1310, a memory 1320, a camera 1330, a display screen 1340, a touch sensing module 1350, a motor 1360, an audio module 1370, a sensor module 1380, a button 1390, etc.
  • the sensor module 1380 may include a gyroscope sensor 1380A, an acceleration sensor 1380B, a distance sensor 1390, etc. 1380C, proximity light sensor 1380D, ambient light sensor 1380E, etc.
  • the structure illustrated in the embodiment of the present invention does not constitute a limitation on the mobile terminal 1300. It may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently.
  • the components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
  • the processor 1310 may include one or more processing units.
  • the processor 1310 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and/or a neural network processor (NPU).
  • AP application processor
  • GPU graphics processor
  • ISP image signal processor
  • controller a memory
  • DSP digital signal processor
  • DSP digital signal processor
  • NPU neural network processor
  • Different processing units may be independent devices or integrated in one or more processors.
  • the controller can be a decision maker that directs the various components of the mobile terminal 1300 to work in coordination according to the instructions. It is the nerve center and command center of the mobile terminal 1300.
  • the controller generates an operation control signal according to the instruction operation code and timing signal to complete the control of fetching and executing instructions.
  • the processor 1310 may also be provided with a memory 1320 for storing instructions and data.
  • the memory 1320 in the processor 1310 is a high-speed cache memory, which can store instructions or data that the processor 1310 has just used or cyclically used. If the processor 1310 needs to use the instruction or data again, it can be directly called from the memory 1320. This avoids repeated access, reduces the waiting time of the processor 1310, and thus improves the efficiency of the system.
  • the I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDL) and a serial clock line (SCL).
  • the processor 1310 may include multiple groups of I2C buses.
  • the processor 1310 may be coupled to the touch sensor, charger, flash, camera 1330, etc. through different I2C bus interfaces.
  • the processor 1310 may be coupled to the touch sensor through the I2C interface, so that the processor 1310 communicates with the touch sensor through the I2C bus interface to realize the touch function of the mobile terminal 1300.
  • the I2S interface can be used for audio communication.
  • the processor 1310 can include multiple groups of I2S buses.
  • the processor 1310 can be coupled to the audio module 1370 via the I2S bus to achieve communication between the processor 1310 and the audio module 1370.
  • the audio module 1370 can transmit an audio signal to the communication module via the I2S interface to achieve the function of answering a call through a Bluetooth headset.
  • the PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals.
  • the audio module 1370 and the communication module can be coupled via a PCM bus interface.
  • the audio module 1370 can also transmit audio signals to the communication module via the PCM interface to realize the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication, and the sampling rates of the two interfaces are different.
  • the UART interface is a universal serial data bus for asynchronous communication.
  • the bus is a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication.
  • the UART interface is generally used to connect the processor 1310 and the communication module.
  • the processor 1310 communicates with the Bluetooth module via the UART interface to implement the Bluetooth function.
  • the audio module 1370 can transmit an audio signal to the communication module via the UART interface to implement the function of playing music via a Bluetooth headset.
  • the MIPI interface can be used to connect the processor 1310 with peripheral devices such as the display screen 1340 and the camera 1330.
  • the MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc.
  • the processor 1310 and the camera 1330 communicate through the CSI interface to realize the shooting function of the mobile terminal 1300.
  • the processor 1310 and the display screen 1340 communicate through the DSI interface to realize the display function of the mobile terminal 1300.
  • the GPIO interface can be configured by software.
  • the GPIO interface can be configured as a control signal or as a data signal.
  • the GPIO interface can be used to connect the processor 1310 with the camera 1330, the display 1340, the communication module, the audio module 1370, the sensor module 1380, etc.
  • the GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
  • the USB interface may be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc.
  • the USB interface may be used to connect a charger to charge the mobile terminal 1300, or may be used to transmit data between the mobile terminal 1300 and a peripheral device.
  • the USB interface may also be used to connect an earphone to play audio through the earphone.
  • the USB interface may also be used to connect other mobile terminals, such as an AR device, etc.
  • the interface connection relationship between the modules shown in the embodiment of the present invention is only for illustrative purposes and does not constitute a structural limitation on the mobile terminal 1300.
  • the mobile terminal 1300 may adopt different interface connection modes in the embodiment of the present invention, or a combination of multiple interface connection modes.
  • the wireless communication function of the mobile terminal 1300 can be implemented by an antenna, a radio frequency module, a communication module, a modem, and a baseband processor.
  • the antenna is used to transmit and receive electromagnetic wave signals.
  • Each antenna in the mobile terminal 1300 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antenna.
  • the mobile terminal 1300 implements the display function through a GPU, a display screen 1340, and an application processor.
  • the GPU is a microprocessor for image processing, connecting the display screen 1340 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • the processor 1310 may include one or more GPUs that execute program instructions to generate or change display information.
  • the display screen 1340 is used to display images, videos, etc.
  • the display screen 1340 includes a display panel.
  • the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light-emitting diode or an active matrix organic light-emitting diode.
  • the mobile terminal 1300 may include 1 or N display screens 1340, where N is a positive integer greater than 1.
  • the mobile terminal 1300 can implement a shooting function through an ISP, a camera 1330, a video codec, a GPU, a display screen, and an application processor.
  • the ISP is used to process the data fed back by the camera 1330. For example, when taking a photo, the shutter is opened and light passes through the lens. The light signal is transmitted to the camera photosensitive element, and the light signal is converted into an electrical signal. The camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye.
  • the ISP can also perform algorithm optimization on the noise, brightness, and chromaticity of the image. The ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP can be set in the camera 1330.
  • the camera 1330 is used to capture still images or videos.
  • the object generates an optical image through the lens and projects it onto the photosensitive element.
  • the photosensitive element can be a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor.
  • CMOS complementary metal oxide semiconductor
  • the photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • the DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format.
  • the mobile terminal 1300 may include 1 or N cameras 1330, where N is a positive integer greater than 1.
  • the digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the mobile terminal 1300 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
  • Video codecs are used to compress or decompress digital videos.
  • Mobile terminal 1300 may support one or more video codecs.
  • mobile terminal 1300 may play or record videos in various coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG13, MPEG4, etc.
  • MPEG Moving Picture Experts Group
  • NPU is a neural network (NN) computing processor.
  • NN neural network
  • the intelligent cognition of the mobile terminal 1300 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.
  • the external memory interface can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile terminal 1300.
  • the external memory card communicates with the processor 1310 through the external memory interface to implement a data storage function. For example, files such as music and videos can be stored in the external memory card.
  • the internal memory can be used to store computer executable program codes, which include instructions.
  • the processor 1310 executes various functional applications and data processing of the mobile terminal 1300 by running the instructions stored in the internal memory.
  • the memory 1320 may include a program storage area and a data storage area.
  • the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.
  • the data storage area may store data created during the use of the mobile terminal 1300 (such as audio data, a phone book, etc.), etc.
  • the memory 1320 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, other volatile solid-state storage devices, a universal flash storage (Universal Flash Storage, UFS), etc.
  • a non-volatile memory such as at least one disk storage device, a flash memory device, other volatile solid-state storage devices, a universal flash storage (Universal Flash Storage, UFS), etc.
  • the mobile terminal 1300 can implement audio functions, such as voice-controlled photo taking, music playing and recording, etc., through the speaker, receiver, microphone, headphone jack, and application processor of the audio module 1370 .
  • the audio module 1370 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal.
  • the audio module 1370 can also be used to encode and decode audio signals.
  • the audio module 1370 can be arranged in the processor 1310, or some functional modules of the audio module 1370 can be arranged in the processor 1310.
  • the speaker also called a "horn" is used to convert an audio electrical signal into a sound signal.
  • the mobile terminal 1300 can listen to music or listen to a hands-free call through the speaker.
  • the receiver also called a "handset" is used to convert audio electrical signals into sound signals.
  • the mobile terminal 1300 receives a call or voice message, the voice can be received by placing the receiver close to the human ear.
  • a microphone also called a “microphone” or “microphone” is used to convert sound signals into audio electrical signals.
  • the user can put his mouth close to the microphone and speak to input the sound signal into the microphone.
  • the mobile terminal 1300 can be provided with at least one microphone.
  • the mobile terminal 1300 can be provided with two microphones, which can not only collect sound signals but also realize noise reduction function.
  • the mobile terminal 1300 can also be provided with three, four or more microphones to realize the collection of sound signals, noise reduction, identification of sound sources, and realization of directional recording function, etc.
  • the headphone jack is used to connect wired headphones.
  • the headphone jack can be a USB interface, or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, or a Cellular Telecommunications Industry Association of the USA (CTIA) standard interface.
  • OMTP Open Mobile Terminal Platform
  • CTIA Cellular Telecommunications Industry Association of the USA
  • the key 1390 includes a power key, a volume key, etc.
  • the key 1390 may be a mechanical key or a touch key.
  • the mobile terminal 1300 receives the key 1390 input and generates a key signal input related to the user settings and function control of the mobile terminal 1300.
  • Motor 1360 can generate vibration prompts.
  • Motor 1360 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback.
  • touch operations acting on different applications can correspond to different vibration feedback effects.
  • Touch operations acting on different areas of the display screen 1340 can also correspond to different vibration feedback effects.
  • Different application scenarios for example: time reminders, receiving messages, alarm clocks, games, etc.
  • the touch vibration feedback effect can also support customization.
  • the motor can also be used in the camera zoom shooting scene to achieve lens switching of different focal lengths by driving the movement of the lens.
  • the sensor module 1380 may include a gyro sensor 1380A, an acceleration sensor 1380B, a distance sensor 1380C, a proximity light sensor 1380D, and an ambient light sensor 1380E.
  • the gyro sensor 1380A and the acceleration sensor 1380B may be used for posture correction or horizontal positioning during the photographing process
  • the distance sensor 1380C may be used for depth of field determination or image processing during the photographing process
  • the proximity light sensor 1380D and the ambient light sensor 1380E may be used for sensing ambient light and adjusting image brightness values during the photographing process.
  • the display control methods in the aforementioned embodiments can all be implemented in the mobile terminal 1300 having the aforementioned hardware structure.
  • an embodiment of the present application further provides a display control device, the control device comprising a processor, and the processor is used to execute the display control method provided by the above embodiments.
  • An embodiment of the present application further provides a computer-readable storage medium, in which a computer program is stored.
  • the computer-readable storage medium is run on a computer, the computer is enabled to execute the display control method provided in the above embodiment.
  • An embodiment of the present application also provides a computer program product including instructions, which, when executed on a computer, enables the computer to execute the display control method provided in the above embodiment.
  • the mobile terminal, display control device, computer readable storage medium and the like provided by the embodiments of the present application
  • the specific implementation methods of the computer program product and the technical effects brought about by it can refer to the specific implementation process of the display control method provided in the above embodiments and the technical effects brought about by it, which will not be repeated here.
  • Each functional unit in each embodiment of the present application can be integrated into a processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of software functional units.
  • the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium.
  • the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the method described in each embodiment of the present application.
  • the aforementioned storage medium includes: various media that can store program codes, such as flash memory, mobile hard disk, read-only memory, random access memory, disk or optical disk.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Studio Devices (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请提供一种显示方法、移动终端及计算机可读存储介质，涉及终端技术领域。移动终端先后接收第一变焦操作、至少一个第二变焦操作和第三变焦操作，不同变焦操作的变焦倍率不同。移动终端先响应第一变焦操作，以第一变焦操作的变焦倍率得到第一变焦图像，之后即响应第三变焦操作对应得到第三变焦图像，并显示该第三变焦图像。在后生成的第三变焦操作会提前至在先接收的至少一个第二变焦操作之前，被提前处理和显示。相对于将所有的变焦操作都按照接收的先后顺序依次处理的变焦显示方案，减少了移动终端响应至少一个第二变焦操作的全部或者部分图像获取操作的时间，使得在后接收的变焦操作的显示延时减少，变焦操作的跟手性提高。

Description

显示方法、移动终端及计算机可读存储介质
本申请要求于2023年07月03日提交国家知识产权局、申请号为202310807236.5、发明名称为“显示控制方法、移动终端及计算机可读存储介质”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及终端技术领域，尤其涉及显示方法、移动终端及计算机可读存储介质。
背景技术
随着科学技术的发展，手机等移动终端的功能日益强大，移动终端的拍照功能可以实现前后摄像、图像美化处理、变焦等。移动终端内通常装配有多组镜头，不同镜头对应的焦段不同，不同焦段的镜头可以采集不同距离、不同视场角和不同清晰度的图像。移动终端的变焦操作(Zoom)是通过调整几组焦段不同的镜头的位置，实现调整后的镜头的焦距的变化，以采集不同焦距的图像。用户在使用移动终端进行拍照预览时，可以在移动终端的拍照预览界面施加不同的变焦触控动作，移动终端检测用户的变焦触控动作的触控参数，以生成对应的变焦请求，并将生成的变焦请求下发至相应的功能模组来处理该变焦请求，将最后得到的预览图像进行显示。
用户在进行拍照预览时，可能会有先后不同的变焦需求，那么其触发的变焦操作可能会有多个，对应生成的变焦请求也会有多个。移动终端会根据各变焦请求的生成顺序，依次处理各变焦请求并显示对应的预览图像。这就会导致，移动终端实时生成的变焦请求可能会在触发一段时间之后才会被处理，那么该变焦请求对应的预览图像也会在一段时间之后才会显示，从施加变焦触控操作到显示对应变焦预览图像的延时较长。
可见，现有的移动终端进行拍照预览时，变焦操作的响应延时较长，跟手性较差。
发明内容
本申请实施例提供一种显示方法、移动终端及计算机可读存储介质，用于实现通过将在后接收的变焦操作跳转到在先接收的变焦操作处插队提前处理并显示的方案，减少新接收的变焦操作的响应及显示延时，优化变焦显示的跟手性。
为达到上述目的，本申请的实施例采用如下技术方案：
第一方面，提供了一种显示控制方法，移动终端先后接收多个变焦操作，依次包括第一变焦操作、至少一个第二变焦操作和第三变焦操作，第一变焦操作的接收时间早于第三变焦操作的接收时间，且第一变焦操作和第三变焦操作之间间隔至少一个第二变焦操作，不同变焦操作的变焦倍率可能不同。说明书中提到的第二变焦操作可以等于权利要求中提到的第一变焦操作，说明书中提到的第三变焦操作可以等于权利要求中提到的第二变焦操作，不再一一赘述。另外，说明书中提到的第一变焦操作在实际拍照中，可以存在，也可以不存在，不作限定。
移动终端先响应第一变焦操作，以第一变焦操作的变焦倍率得到第一变焦图像， 在响应全部第二变焦操作或者在显示全部的第二变焦操作对应的第二变焦图像之前，移动终端先响应第三变焦操作对应得到第三变焦图像，并显示该第三变焦图像。响应变焦处理操作的过程可以依次包括：生成变焦请求、变焦请求下发、图像采集操作、图像信号前端处理操作、空间对齐变换处理操作、图像信号后端处理操作及图像送显。
本申请提供的显示控制方法调整持续变焦操作的响应显示过程，在后生成的第三变焦操作会提前至在先接收的这至少一个第二变焦操作之前，被提前处理和显示。相对于将所有的变焦操作都按照接收的先后顺序依次处理的变焦显示方案，减少了至少一个第二变焦操作的全部响应时间或者部分响应时间，使得在后接收的变焦操作的显示延时减少，变焦操作的跟手性提高。
在具体执行时，这至少一个第二变焦操作不被完全响应，是指这至少一个第二变焦操作中的任意一个第二变焦操作都不需要进行图像获取操作，也可以是指这至少一个点变焦操作中的部分第二变焦操作需要进行图像获取操作，或者只需要针对部分第二变焦操作进行部分的图像获取操作，例如仅进行空间对齐变换处理操作或者图像信号后端处理操作。
根据第一方面的一种可能实施方式，在先的第一变焦操作被响应且显示了对应的第一变焦图像之后，在接收到所述第三变焦操作后，不再显示所述至少一个第二变焦操作对应的变焦图像，而是在显示第一变焦图像之后直接响应所述第三变焦操作并显示所述第三变焦图像。或者只进行第一变焦图像之后的一个第二变焦请求的部分图像获取操作并且不送显对应的变焦图像，而是直接跳转至在后接收的第三变焦操作。移动终端在拍摄界面上先显示第一变焦操作对应的第一变焦图像，直接显示第三变焦操作对应的第三变焦图像，用户最新施加的第三变焦操作对应的第三变焦图像会被快速显示，跟手性有明显提升。
在第一方面的一种可能实施方式中，移动终端的拍摄界面在每接收到一个变焦操作时，都会先生成对应的变焦请求，并加入对应变焦操作的请求队列。也就是说，移动终端在接收到第一变焦操作时，就会生成对应的第一变焦请求，并加入该请求队列。接着，移动终端再对接收到的至少一个第二变焦操作生成对应的第二变焦请求并加入请求队列。再接着，移动终端再接收到第三变焦操作，那么也会生成对应的第三变焦请求并加入请求队列。请求队列是一个先进先出的队列，在先加入的变焦请求会先出队进行处理，后加入的变焦请求会后出队进行处理。需要说明的是，移动终端可能会持续接收多个变焦操作，那么变焦请求入队和出队也是在持续进行的，并不是说等在先的变焦请求出队后才会将新生成的变焦请求入队。
先入队的第一变焦请求会先出队，出队的第一变焦请求会进行图像获取操作，包括图像采集操作、图像处理操作等，得到第一变焦图像并显示。同样的，后入队的第三变焦操作对应的第三变焦请求出队时，移动终端执行所述第三变焦请求对应的图像获取操作，以得到所述第三变焦图像，显示所述第三变焦图像。区别于现有的要先将至少一个第二变焦请求出队进行图像获取操作并送显后再将第三变焦请求出队进行图像获取操作并送显的方案，本申请可以将第三变焦请求提前至第二变焦请求被显示之前处理。基于请求队列的先进先出原则，移动终端可以将第二变焦请求的第二变焦倍 率替换为第三变焦请求的第三变焦倍率，以使得第三变焦倍率对应的变焦图像被提前获取并作为第三变焦图像提前显示。或者也可以将第三变焦请求之前的至少一个第二变焦请求出队后全部丢弃不执行任何图像获取操作或者仅执行部分图像获取操作之后即执行第三变焦请求的图像获取操作，也能保证第三变焦图像被提前获取和显示。
在第一方面的一种可能实施方式中，移动终端在跳转响应第三变焦请求时，先在第三变焦操作前还未显示对应变焦图像的第二变焦操作对应的第二变焦请求中，选择一个适合跳转的第二变焦请求，作为目标变焦请求，该目标变焦请求的入队时间早于第三变焦请求的入队时间。在该目标变焦请求出队时，跳转执行第三变焦请求的图像获取操作，并提前显示获取的第三变焦图像。选择适合跳转的第二变焦请求的依据可以有多种，例如，选择依据可以是哪个第二变焦请求的变焦倍率与第三变焦请求的变焦倍率较为接近，或者哪个第二变焦请求的出队时间会比较早，或者，哪个变焦请求涉及的图像数据或者处理过程与第三变焦请求的图像数据或者处理过程比较接近。
在为第三变焦请求确定可跳转的目标变焦请求之后，跳转响应第三变焦请求的方式也可以有多种。
跳转响应第三变焦请求的一种实施方式为，将第三变焦请求的第三变焦倍率跳转至目标变焦请求处被提前处理。具体的，将目标变焦请求对应的目标变焦倍率替换或者修改为第三变焦倍率。这样，在目标变焦请求出队时，该目标变焦请求实际是以第三变焦倍率进行图像获取操作，那么，对应得到的变焦图像也是以第三变焦倍率得到的第三变焦图像。这种情况下，既能保证请求队列内的目标变焦请求出队后被响应，也能保证第三变焦图像被提前以第三变焦倍率获取并显示。需要说明的是，由于第三变焦请求的第三变焦倍率已经被提前至目标变焦请求进行处理，那么该第三变焦请求可以直接丢弃，或者等待第三变焦请求出队时丢弃。位于目标变焦请求和第三变焦请求之间的部分第二变焦请求也可以被同步丢弃，以保证最后显示的变焦图像的变焦倍率与最新接收的第三变焦操作的变焦倍率一致。
跳转响应第三变焦请求的另一种实施方式为，将第三变焦请求提前处理。按照先进先出的原则，在所述目标变焦请求出队时，可以直接将该目标变焦请求与所述第三变焦请求之间的全部变焦请求均出队丢弃，再将第三变焦请求出队并执行所述第三变焦请求对应的图像获取操作，以得到所述第三变焦图像。这样也能保证最后显示的变焦图像的变焦倍率与最新接收的变焦操作的变焦倍率一致。
需要说明的是，上述两种跳转响应第三变焦请求的方案，目标变焦请求的图像获取操作可以完全不需要执行，也可以执行目标变焦请求的部分图像获取操作。
在第一方面的一种可能实施方式中，考虑到影响到不同变焦请求的主要因素是变焦倍率，变焦倍率相同或者接近的变焦请求，其对应的变焦处理操作和获取的变焦图像相同或者接近。那么，在考虑将在后的第三变焦请求提前插队处理时，可以将第三变焦请求提前至在先生成的变焦请求中变焦倍率较为接近的第二变焦请求，作为可跳转的目标变焦请求。具体实施时，移动终端可以先设置一个预设范围，该预设范围用于限定适合跳转的变焦请求之间的倍率差值的允许范围。该预设范围可以根据移动终端内各镜头的焦段来设置，例如，针对不同的变焦倍率可以选择变焦倍率对应的镜头的焦段来设置不同的预设范围。另外，考虑到将在后的变焦请求提前插队处理可能会 影响到整个变焦显示过程的平滑性和及时性，那么预设倍率也可以根据移动终端进行变焦切换的平滑性要求或者及时性要求来设置，平滑性要求越高预设范围就相对越小，及时性要求越高预设范围相对越大。
移动终端先获取各第二变焦请求对应的第二变焦倍率与第三变焦请求的第三变焦倍率的倍率差值，筛选出倍率差值在预设范围内的第二变焦请求作为可跳转的目标变焦请求。此时选出来的目标变焦请求可能为一个，也可能为多个。若目标变焦请求为一个，则可以直接将该目标变焦请求作为第三变焦请求可跳转的变焦请求。若目标变焦请求为多个，那么可以从这多个目标变焦请求中随机选择一个作为适合第三变焦请求跳转的目标变焦请求。也可以再结合各目标变焦请求的实时的处理状态或者镜头类型等其他变焦参数，从多个目标变焦请求中选择一个相对更适合跳转的目标变焦请求等。
在第一方面的一种可能实施方式中，提供了根据各变焦请求的实时状态来选择适合跳转的目标变焦请求的方案。移动终端接收作用于拍摄界面的变焦操作后会随即生成对应的变焦请求，并将变焦请求加入请求队列等待被响应。按照先进先出的原则，请求队列内的请求所处的状态为等待出队状态，从请求队列内出队的请求的实时状态则由等待出队状态变为已经出队状态。
进一步的，已经出队状态的变焦请求的处理状态也可以有多种，依次包括：请求下发、等待图像采集、图像信号前端处理、空间对齐变换处理、图像信号后端处理、送显等。其中，原始图像采集操作可以由移动终端内的相机传感器来执行，变焦请求下发至相机驱动，相机驱动控制相机传感器来采集原始图像，并将采集的原始图像传输至后的数据处理模块。数据处理模块主要包括三个模块，按照处理时序依次为：对原始图像进行初步裁切的图像信号前端处理模块、计算裁切数据的空间对齐变换处理模块和依据裁切数据进行再次裁切的图像信号后端处理模块，图像信号后端处理模块进行再次裁切后即可得到对应变焦请求的变焦图像，将该变焦图像送显至移动终端的相机应用，由相机应用将接收的变焦图像显示在拍摄界面上。
相对来说，已经出队状态的第二变焦请求的处理进度比等待出队状态的处理进度要快，第三变焦请求若插队到已经出队状态的第二变焦请求处提前处理，变焦延时更短，跟手性较好。等待出队状态的图像获取操作还没开始，第三变焦请求若插队到等待出队状态的第二变焦请求，等待该第二变焦请求出队时开始执行对应该第三变焦请求的全部图像获取操作，也能实现将第三变焦请求提前处理和图像显示的效果。
在第一方面的一种可能实施方式中，移动终端可以结合变焦倍率和实时状态来综合选择适合第三变焦请求跳转的目标变焦请求。具体的，移动终端筛选出变焦倍率与所述第三变焦倍率的倍率差值在预设范围内，且所述实时状态为已经出队状态的第二变焦请求，作为所述目标变焦请求。这样，保证了第三变焦请求提前插队处理后整个变焦显示效果的平滑性和及时性。
在第一方面的一种可能实施方式中，考虑到在实际的图像获取操作流程中，移动终端内可能同时存在两个及以上处于已经出队状态且尚未送显的变焦请求，这些变焦请求可能分别处于数据采集节点、图像信号前端处理节点、空间对齐变换处理节点、图像信号后端处理节点、等待送显节点等，这些变焦请求都可以作为第三变焦请求可 跳转的目标变焦请求。那么，筛选出这部分变焦倍率与所述第三变焦倍率的倍率差值在预设范围内，且所述实时状态为已经出队状态的候选变焦请求后，可以将这些候选变焦请求中，图像获取操作的节点相对靠后的变焦请求作为目标变焦请求，例如，优先将图像获取操作处于图像信号后端处理操作或者空间对其变换处理操作的候选变焦请求作为可跳转的目标变焦请求。这样，如果选出来的目标变焦请求已经处于图像信号后端处理操作或者空间对齐变换处理操作，可以将目标变焦请求的目标变焦倍率修改为第三变焦请求的第三变焦倍率，以第三变焦倍率执行剩余的图像获取操作，例如图像信号处理操作和空间对齐变换处理操作等，可以比较快速地以第三变焦倍率得到第三预览图像，进一步减少了第三变焦请求的响应和显示延时。
在第一方面的一种可能实施方式中，详细说明不同实时状态的目标变焦请求对第三变焦请求的图像获取操作的影响。上述在所述目标变焦请求出队时，跳转执行所述第三变焦请求对应的图像获取操作，以获得所述第三变焦图像，显示所述第三变焦图像的步骤，可以包括：一方面，所述目标变焦请求的实时状态为等待出队状态，也即目标变焦请求之前还存在一个或者多个第二变焦请求等待处理或者处理中。那么，按照先进先出的原则，需要先等待所述目标变焦请求出队。在目标变焦请求出队时才跳转执行所述第三变焦请求对应的全部图像获取操作，以获得所述第三变焦图像。这种情况下，可以直接将第三变焦请求之前的第二变焦请求及目标变焦请求全部丢弃处理，也可以将第三变焦请求的第三变焦倍率作为目标变焦请求的目标变焦倍率来提前进行全部的图像获取操作并得到对应的第三变焦图像。
另一方面，若所述目标变焦请求的实时状态为已经出队状态，根据目标变焦请求的处理进度，该目标变焦请求的图像获取操作可能只剩余空间对齐变换处理操作或者图像信号后端处理操作。此时可以将所述目标变焦请求对应的目标变焦倍率替换为所述第三变焦倍率，在替换变焦倍率之后以替换后的第三变焦倍率来执行所述目标变焦请求剩余的图像获取操作，以快速获得所述第三变焦图像。
在第一方面的一种可能实施方式中，对移动终端内实现上述显示控制的相关软件模块作了解释。具体的，所述移动终端包括：相机应用、相机服务和硬件抽象层。移动终端通常包括自上而下的应用层、框架层、硬件抽象层和内核层，其中，应用层运行有相机应用和其他功能应用，能够接收用户的输入操作，并显示相关图像数据等。框架层装配有相机服务等，为上层的相机应用和其他功能应用提供应用编程接口和编程框架。内核层是硬件和软件之间的层。内核层至少包含相机驱动硬件抽象层可以对内核层中的驱动程序进行封装，并向框架层提供调用的接口，屏蔽底层硬件的实现细节。
所述相机应用每接收作用于拍摄界面的变焦操作，将所述变焦操作对应的变焦参数发送至所述相机服务；所述相机服务生成对应所述变焦操作的变焦请求并加入所述请求队列，并将所述请求队列内的各变焦请求依次下发至所述硬件抽象层；所述硬件抽象层执行各变焦请求对应的图像获取操作以得到变焦图像，将得到的变焦图像发送至所述相机应用；所述相机应用显示所述变焦图像。
具体的，所述硬件抽象层包括接口模块、相机传感器和数据处理模块；所述接口模块将所接收的各变焦请求发送至相机传感器；所述相机传感器根据各所述变焦请求 进行曝光出图操作，得到对应的原始图像；所述数据处理模块对各所述变焦请求的原始图像进行数据处理操作以得到对应的变焦图像，并将所述变焦图像发送至所述相机应用。
在第一方面的一种可能实施方式中，为实施本申请提供的显示控制方法，所述移动终端还包括选择模块，所述硬件抽象层还包括应用模块。所述选择模块确定所述第三变焦请求可跳转的目标变焦请求；所述应用模块将所述目标变焦请求的目标变焦倍率修改为所述第三变焦倍率；所述数据处理模块执行修改后的所述目标变焦请求对应的图像获取操作，以得到所述第三变焦图像。增加具体的功能模块，实现第三变焦请求的插队选择和实现方案。
在第一方面的一种可能实施方式中，还提供了根据在先的各第二变焦请求的实时状态来选择可跳转的目标变焦请求的方案。各第二变焦请求加入队列后，实时状态分为两种，等待出队状态或者已经出队状态。已经出队状态的变焦请求已经被下发，处于执行具体的图像获取操作的节点，按照图像获取操作的时序依次包括初始图像采集操作节点、图像信号前端处理操作节点、图像信号后端处理操作节点。
相对来说，处于已经出队状态的变焦请求相对于等待出队状态的变焦请求会被较早响应。进一步的，在这些已经出队状态的变焦请求中，处于空间对齐变换处理操作节点和处于信号后端处理操作节点的变焦请求会被更早响应。那么，为了提前显示第三变焦请求对应的第三变焦图像，可以选择实时状态为已经出队状态的变焦请求。若处于已经出队状态的变焦请求有多个，则可以选择出队后的实时操作节点为图像信号后端处理操作节点或者空间对齐变换处理操作节点的第二变焦请求，确定为所述目标变焦请求。这种仅参考实时状态而不需要依赖变焦倍率选择可跳转的目标变焦请求的方案，更适用于变焦倍率逐步增大或者逐步减小的单向变焦场景，例如，将变焦倍率从1x逐步增大至10x，或者将变焦倍率从20x逐步减小至1x的单向变焦场景。
第二方面，提供了一种移动终端，该移动终端具有实现上述第一方面所述的显示控制方法的功能。该功能可以通过硬件实现，也可以通过硬件执行相应的软件实现。该硬件或软件包括一个或多个与上述功能相对应的模块。
第三方面，提供了一种移动终端，包括：相机应用、处理器和存储器，所述相机模组、所述存储器与所述处理器耦合；该存储器用于存储计算机执行指令，当该移动终端运行时，该处理器执行该存储器存储的该计算机执行指令，以使该移动终端执行如上述第一方面中任一项所述的显示控制方法。
第四方面，提供了一种显示控制装置，包括：接收模块、响应模块和显示模块。其中，接收模块用于接收多个变焦操作，依次接收第一变焦操作、至少一个第二变焦操作和第三变焦操作，第一变焦操作的接收时间早于所述第三变焦操作的接收时间，所述第一变焦操作与所述第三变焦操作之间间隔至少一个第二变焦操作。所述响应模块用于响应所述多个变焦操作中的第一变焦操作，所述显示模块用于显示第一变焦图像，其中，所述第一变焦图像是以所述第一变焦操作对应的第一变焦倍率得到的图像；所述响应模块还用于响应于所述多个变焦操作中的第三变焦操作，显示第三变焦图像，其中，所述第三变焦图像是以所述第三变焦操作对应的第三变焦倍率得到的图像。
第五方面，提供了一种计算机可读存储介质，该计算机可读存储介质中存储有指令，当其在计算机上运行时，使得计算机可以执行上述第一方面中任一项所述的显示控制方法。
第六方面，提供了一种包含指令的计算机程序产品，当其在计算机上运行时，使得计算机可以执行上述第一方面中任一项所述的显示控制方法。
其中，第三方面至第六方面中任一种设计方式所带来的技术效果可参见第一方面中不同设计方式所带来的技术效果，此处不再赘述。
附图说明
图1为移动终端的拍摄界面示意图；
图2为现有方案中移动终端接收变焦操作前后的界面对比示意图之一；
图3为对应图2的期待优化效果示意图；
图4为现有方案中移动终端接收变焦操作前后的界面对比示意图之二；
图5为对应图4的期待优化效果示意图；
图6为本申请实施例提供的移动终端的内部软件架构示意图；
图7为本申请实施例提供的移动终端处理一个变焦请求的内部流程示意图；
图8为本申请实施例提供的移动终端处理多个变焦请求的内部流程示意图；
图9为本申请实施例提供的显示控制方法实现变焦请求跳转处理的流程示意图；
图10为本申请实施例提供的移动终端应用显示控制方法前后的流程对比示意图；
图11为本申请实施例提供的一种显示控制方法的流程示意图；
图12为本申请实施例提供的显示控制方法实现请求插队的示意图；
图13为本申请实施例提供的移动终端的结构示意图。
具体实施方式
以下结合附图对本申请的示范性实施例做出说明，其中包括本申请实施例的各种细节以助于理解，应当将它们认为仅仅是示范性的。因此，本领域普通技术人员应当认识到，可以对这里描述的实施例做出各种改变和修改，而不会背离本申请的范围和精神。同样，为了清楚和简明，以下的描述中省略了对公知功能和结构的描述。
为便于理解，先介绍本申请实施例涉及的部分技术常识。
移动终端内设置有不同焦段的镜头，通过调整变焦的变焦倍率(Zoom Ratio)等变焦参数，以调整拍摄界面的视场角(Field of View，FOV)，在拍摄界面内的被拍摄对象放大或者缩小的技术效果。在拍摄、录像或者拍照预览场景，用户为了获得被拍摄对象不同大小的图像，在移动终端的拍摄界面上施加变焦操作，移动终端内的相机应用及相关模块配合作用，响应变焦操作以获得对应变焦倍率的变焦图像并在拍摄界面进行显示。本申请实施例提供的显示控制方法的主要应用场景包括手机的拍摄预览场景，下面将以手机的拍摄预览场景展开描述。但并不限定所提供的显示控制方法仅能应用于手机，且不限定为仅应用于拍摄预览场景。
如图1所示为移动终端的一种拍摄界面的示意图，在该拍摄界面内，用户可以施加变焦操作，移动终端接收变焦操作并响应该变焦操作，得到对应的变焦图像，将变焦图像显示在拍摄界面内。具体的，如图1所示，移动终端的拍摄界面100主要包 括：参数控件区域101、图像显示区域102、模式控件区域103、前后摄翻转控件104、图库控件105、快门控件106和变焦控件107。其中，参数控件区域101包括多个参数控件，各个参数控件用于响应用户输入的拍摄参数调整操作。参数控件区域内包括的参数控件可以包括但不限于：闪光灯控件、AI识别开关控件、色彩标准控件、以及更加详细的相机设置控件。图像显示区域102可用于显示预览图像，该预览图像为移动终端通过摄像头实时采集的图像。移动终端可以实时刷新图像显示区域102中的显示内容，以便于用户预览摄像头当前采集的图像。模式控件区域103可以包括多个对应不同拍摄模式的模式控件，例如光圈模式控件、夜景模式控件、人像模式控件、拍照模式控件、录像模式控件、专业模式控件和更多模式控件等。各模式控件可以仅通过文字信息标记，例如，“光圈”、“夜景”、“人像”、“拍照”、“录像”、“专业”、“更多”，也可以通过图标、或者文字信息与图标结合的方式显示。
变焦控件107用于响应用户作用于移动终端的变焦操作，以调整图像显示区域102的FOV。变焦控件107上显示的“1装置”表示移动终端当前的光学变焦倍率为1倍倍率，后续x表示变焦倍率。用户可以通过施加作用于变焦控件107上的点选操作或者滑动操作的方式来施加变焦操作，当然也可以通过不作用于变焦控件107的触控操作来施加变焦操作。例如，移动终端可以预先定义作用于拍摄界面上的手指相向滑动或者手指相背滑动的操作为变焦操作，或者预先定义作用于拍摄界面上的顺时针旋转滑动和逆时针旋转滑动的操作也为变焦操作，这类预先定义的其他触控操作作用于拍摄界面上，但不一定作用于变焦控件107上的。
当然，在其他情况下，移动终端接收的变焦操作也可以为不需要作用于拍摄界面的变焦操作，而是作用于移动终端的表面或者侧面的物理器件上的调整操作。例如，在移动终端的侧面设置物理按键或者旋钮作为变焦开关，该部分物理按键或者旋钮可以关联指示具体的变焦数值选择或者变焦倍率调整操作等。这部分物理按键或者旋钮可以为单独的专用作接收变焦操作的物理器件，也可以为在拍摄场景下复用已有的音量调整按键或者频道调整旋钮等，不作限定。这种情况可能更适用移动终端为复古造型的手机、老年机、卡片机等的场景。
移动终端接收用户施加的变焦操作后，即可响应该变焦操作。响应变焦操作的过程可以包括但不限于：根据变焦操作生成变焦请求、将变焦请求下发执行图像采集操作和图像处理操作、得到变焦图像，最后将变焦图像送显至拍摄界面进行显示。在实际操作时，用户可能会在拍摄界面连续施加多个变焦操作，例如通过滑动变焦控件的方式施加多个变焦操作，或者通过连续点选变焦控件的方式施加多个变焦操作。那么，移动终端也会先后接收这多个变焦操作，并分别针对每个接收的变焦操作执行生成变焦请求、变焦请求下发后执行图像采集操作和图像处理操作、得到变焦图像并送显这一全套的变焦操作响应流程。常规情况下，每个变焦操作响应流程需要大概250毫秒的处理时长。那么，若用户连续施加多个变焦操作后离手，移动终端按照各变焦操作的先后顺序，依次执行完各变焦操作的变焦操作响应流程，最后的变焦操作需要等待前面的全部变焦操作响应流程都结束后才能开始被响应，且需要将该最后的变焦操作响应流程结束后才能显示对应该最后的变焦操作的变焦图像。由此，移动终端从 接收到最后的变焦操作到显示最后的变焦操作对应的变焦图像的等待时间较长，也即，变焦操作的延时较长，跟手性较差。
如图2所示，为滑动触控的触控方式施加变焦操作的场景下，现有的变焦预览界面施加变焦操作后存在延时的对比示意图。图2中(a)所示，用户的手指将滑动控件107操作在1x，拍摄界面上变焦倍率108显示1x，对应的变焦图像为1x的变焦图像。如图2中的(b)所示，用户的手指将滑动控件107从1x滑动到3x，此时拍摄界面上变焦倍率108也已经由1x切换为3x，但由于响应延时，图像显示区域102内的变焦图像并没有随之切换为3x的变焦图像，而是仍然显示1x的变焦图像，跟手性较差。而我们期待的拍摄界面如图3中的(a)至(b)所示，用户的手指将滑动控件107从1x滑动到3x，此时拍摄界面上变焦倍率108也已经由1x切换为3x，图像显示区域102内的变焦图像也随之切换为3x的变焦图像，用户可明显感知到变焦跟手性的提升。
如图4所示，为手指相对滑动式触控施加变焦操作的场景下，现有的变焦预览界面施加变焦操作后存在延时的对比示意图。如图4中的(a)至(b)所示，用户的手指将相背滑动以增大变焦倍率，此时滑动控件107自动从1x切换为3x，此时拍摄界面上变焦倍率108也已经由1x切换为3x，但由于响应延时，图像显示区域102内的变焦图像并没有随之切换为3x的变焦图像，而是仍然显示1x的变焦图像，跟手性较差。对应的如图5中的(a)至(b)所示，我们手机期待的拍摄界面为，用户的手指相背滑动以增大变焦倍率，此时滑动控件107自动从1x切换为3x，此时拍摄界面上变焦倍率108也已经由1x切换为3x，图像显示区域102内的变焦图像由1x的变焦图像随之切换为3x的变焦图像，跟手性较好。
为了得到较好的跟手性，本申请实施例提供一种显示控制方法及实现该显示控制方法的移动终端及计算机可读存储介质，将在后生成的变焦请求跳转至某一个在先变焦请求处理时提前处理，以减少该在后生成的变焦请求的响应延时。所提供的显示控制方法应用于装配有相机及相关支撑模组的移动终端。移动终端可以是手机、平板电脑、可穿戴设备、车载设备、增强现实(Augmented Reality，AR)/虚拟现实(Virtual Reality，VR)设备、笔记本电脑、超级移动个人计算机(Ultra-Mobile Personal Computer，UMPC)、上网本、个人数字助理(Personal Digital Assistant，PDA)或专门的照相机(例如单反相机、卡片式相机)等，不作限制。
移动终端接收用户作用于拍摄界面上的变焦操作，通过调用移动终端内部软件架构运行的相机应用及相关模块，生成对应变焦触控操作的变焦预览图像。需要说明的是，本申请实施例所适用的相机应用可以包括移动终端上任一能够实现拍摄预览功能的应用，例如原相机应用、图像美化相机应用等，不作限定。
如图6所示，为移动终端内部的架构图。下面将结合移动终端的内部架构，对移动终端响应变焦操作的流程进行详细解释。
具体的，移动终端的内部架构可以分为四层，从上至下分别为应用层(APPlication，APP)，框架层(Framework，FWK)，硬件抽象层(hardware abstraction layer，HAL)，以及内核(Kernel)层(或驱动层)。需要说明的是，除了这几个主要功能层，还可以包括其他功能模块等，不作限定。
应用层可以包括一系列应用程序包，如相机应用、图库、具有相机功能的应用等应用程序。应用程序包还可以包括通话、日历、地图、导航、音乐、视频、短信息等应用程序。
框架层为应用程序层的应用程序提供应用编程接口(Application Programming Interface，API)和编程框架。应用程序框架层包括一些预先定义的函数。
框架层运行有相机服务，该相机服务可供相机应用调用，从而实现与拍摄相关的功能。除此之外，框架层还可以包括窗口管理器，内容提供器，视图系统，电话管理器，资源管理器，通知管理器等。其中，窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小，判断是否有状态栏，锁定屏幕，截取屏幕等。内容提供器用来存放和获取数据，并使这些数据可以被应用程序访问。所述数据可以包括视频，图像，音频，拨打和接听的电话，浏览历史和书签，电话簿等。视图系统包括可视控件，例如显示文字的控件，显示图片的控件等。视图系统可用于构建应用程序。显示界面可以由一个或多个视图组成的。例如，包括短信通知图标的显示界面，可以包括显示文字的视图以及显示图片的视图。电话管理器用于提供移动终端的通信功能。例如通话状态的管理(包括接通，挂断等)。资源管理器为应用程序提供各种资源，比如本地化字符串，图标，图片，布局文件，视频文件等等。通知管理器使应用程序可以在状态栏中显示通知信息，可以用于传达告知类型的消息，可以短暂停留后自动消失，无需用户交互。比如通知信息被用于告知下载完成，消息提醒等。通知信息还可以是以图表或者滚动条文本形式出现在系统顶部状态栏的通知，例如后台运行的应用程序的通知，还可以是以对话窗口形式出现在屏幕上的通知。通知信息例如还可以是在状态栏提示的文本信息，发出的提示音，用电终端的振动，指示灯闪烁等。需要指出的是，相机应用也可以依据实际的业务需求调用内容提供器、资源管理器、通知管理器、窗口管理器、视图系统等，本申请实施例对此不作任何限制。
内核层是硬件和软件之间的层。内核层至少包含相机驱动。该相机驱动可用于驱动具备拍摄功能的硬件模块，如相机传感器(Camera Sensor)。换句话说，上述相机驱动需负责与相机传感器进行数据交互。内核层也还还可以包括显示驱动、音频驱动、传感器驱动等，本申请实施例对此不做任何限制。
硬件抽象层可以对内核层中的驱动程序进行封装，并向框架层提供调用的接口，屏蔽底层硬件的实现细节。如图6所示，上述硬件抽象层可以包括相机调用处理模块(Camera HAL)、多摄决策模块等。相机调用处理模块是相机Camera核心软件框架，该相机调用处理模块中包括接口模块、传感器节点(Sensor Node)和数据处理模块等。在一种实现方式中，数据处理模块可以包括图像信号前端处理(Image Signal Processing Front End，IFE)模块、空间对齐变换(Spatial Alignment Transform，SAT)处理模块、图像信号后端处理(Image Signal Processing Post End，IPE)模块。其中，传感器节点与图像信号前端处理模块涉及的相关处理属于实时管线(Realtime Pipeline)的处理，控件对齐变换处理模块和图像信号后端处理模块涉及的相关处理属于离线管线(Offline Pipeline)的处理。上述传感器节点、数据处理模块和接口模块是相机调用处理模块中图像数据和控制指令传输管道中的组件。
具体的，传感器节点可以是面向相机传感器的控制节点，该传感器节点可以通过 相机驱动控制相机传感器。接口模块可以是面向应用框架层的软件接口，用于与应用框架层进行数据交互，当然，接口模块还可以与相机调用处理模块中的多摄决策模块、数据处理模块、传感器节点等进行数据交互。数据处理模块可以处理相机传感器回传的原始图像数据，其中，图像信号前端处理模块用于处理相机传感器采集的预览图像进行初步裁切处理，预留出图像边缘(Margin)；空间对齐变换处理模块用于根据变焦倍率以及空间对齐变换处理算法对图像数据进行空间对齐，确定出裁切数据以及扭曲(Warp)数据，以使预览图像更加平滑；图像信号后端处理模块用于根据空间对齐变换处理模块的计算结果对预览图像的数据进行裁切及扭曲处理。
相机应用可以将用户选择的相机模式、变焦参数等信息，传递给框架层的相机服务，再由相机服务通过硬件抽象层的接口模块传递给多摄决策模块。多摄决策模块可以根据应用场景确定出图的相机传感器，如前置摄像头的相机传感器或后置摄像头的相机传感器，又如后置摄像头中的主摄像头的相机传感器、广角摄像头的相机传感器、长焦摄像头的相机传感器。
在具备变焦功能的移动终端内，其多摄决策模块还可以根据用户的变焦操作，确定待切换的目标摄像头，并通过相机驱动提前开启目标摄像头的相机传感器。另外，多摄决策模块还可以在开启相机传感器的多个摄像头中设置当前出图的摄像头。
可以理解的是，图6示出的软件结构中的层以及各层中包含的部件，并不构成对移动终端的具体限定。在本申请另一些实施例中，移动终端可以包括比图示更多或更少的层，以及每个层中可以包括更多或更少的部件，本申请不做限定。
另外，可以理解的是，移动终端为了实现本申请实施例中的变焦响应方法，其包含了执行各个功能相应的硬件和/或软件模块。结合本文中所公开的实施例描述的各示例的算法步骤，本申请能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行，取决于技术方案的特定应用和设计约束条件。本领域技术人员可以结合实施例对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请的范围。
在上述图6所示的内部架构图的基础上，图7保留移动终端中相机应用及相关支撑模块，示意移动终端响应变焦操作的流程。
移动终端响应变焦操作的流程可以主要分为两部分：自上而下的信号流(图7中实线箭头所示)，即移动终端接收变焦操作后，生成响应的控制信号控制相关模块执行图像获取操作，以得到变焦图像；自下而上的数据流(图7中虚线箭头所示)，即移动终端的相机传感器采集到原始图像后经过图像处理操作后得到变焦图像，并将变焦图像送显至应用层的相机应用进行显示。
基于前述图6所示的移动终端的内部架构层，相机应用的预览场景下，各功能模块配合执行变焦触控操作的流程可以主要包括：接收变焦触控操作、生成变焦请求、处理变焦请求得到预览图像以及将预览图像送显。在实际使用时，移动终端可能会持续接收多个变焦触控操作并生成多个变焦请求，移动终端依次处理各变焦请求以生成对应的预览图像并送显。本申请实施例提供的显示控制方法，为了减少最新的变焦触控操作的响应延时，将最新的变焦触控操作提前处理，改变移动终端处理多个持续的变焦触控操作的正常顺序。为便于理解，下面先对移动终端处理一个变焦触控操作的 常规流程进行解释。
如图7中实线箭头所示的信号流主要包括：用户在移动终端的拍摄预览界面通过点选、滑动或者其他预先定义的操作方式施加变焦操作，移动终端的触控模块响应于变焦触控操作并生成对应的触控报点事件发送给应用层的相机应用。相机应用接收到触控报点事件后，将与触控报点事件对应的报点坐标数据转换为变焦倍率(Zoom Ratio)并发送给框架层的相机服务。相机服务生成一对应该变焦倍率的变焦请求，并将该变焦请求下发至硬件抽象层中的相机硬件调用模块。变焦请求被发送至传感器节点。根据变焦请求，传感器节点通过相机驱动控制相机传感器进行曝光出图操作。
如图7中虚线箭头所示的数据流主要包括：在相机传感器完成曝光出图操作之后，与变焦请求对应的原始图像数据通过相机驱动发送至图像信号前端处理模块。图像信号前端处理模块对与变焦请求对应的原始图像数据进行初步裁切处理，并将处理后的图像数据发送至空间对齐变换处理模块。其中，图像信号前端处理模块可以根据变焦请求对应的变焦倍率对原始图像数据进行初步裁切处理，保留图像边缘区域，以便于空间对齐变换处理模块对图像进行空间对齐处理。空间对齐变换处理模块根据与变焦请求对应的变焦倍率以及相关空间对齐变换处理算法进行图像空间对齐处理，计算与图像数据对应的裁切数据以及扭曲数据，并将计算结果以及与变焦请求对应的图像数据发送至图像信号后端处理模块。图像信号后端处理模块根据空间对齐变换处理的计算结果对与变焦请求对应的图像数据进行再次裁切操作以及图像扭曲操作，得到与变焦请求对应的预览图像，再将该预览图像送显至应用层的相机应用进行预览显示。
需要说明的是，从相机传感器输出的原始图像依次经由图像信号前端处理模块、空间对齐变换处理模块、图像信号后端处理模块到送显的过程中，除了图像数据传输的数据流之外，同时也会传输包含各种数据处理指令和参数的信号流。
上述图7所示为移动终端处理一个变焦请求的情况，在相机应用的预览场景中，移动终端可能会持续接收多个变焦操作，那么，移动终端的内部相机应用及相关支撑模块需要依次响应这多个变焦操作。相机应用在每接收到一个变焦操作后，都会根据该变焦操作对应的触控报点事件生成对应的变焦倍率，将变焦倍率发送至相机服务，由相机服务生成对应的变焦请求。那么，在持续接收多个变焦操作的情况下，相机服务就会持续生成多个对应的变焦请求，不同请求的变焦倍率可能不同。
如图8所示，相机服务可以维护一个请求队列，将每个新生成的变焦请求加入该请求队列。请求队列为先进先出队列，先入队的变焦请求先出队下发至硬件抽象层进行图像获取操作，尚未处理的变焦请求在请求队列内等待处理，新生成的变焦请求加入请求队列的队尾。如图8所示，假设当前持续生成了30个变焦请求，最新生成的变焦请求30处于请求队列的队尾，变焦请求20之前的全部变焦请求已经处理完成，变焦请求20至变焦请求24都已经出队且尚未完成全部图像获取操作，变焦请求25至变焦请求30都在请求队列内等待出队被响应。
由图8可知，相机服务下发的每个变焦请求在相机硬件调用模块中经历传感器节点采集图像数据、初步裁切处理、计算裁切数据及扭曲数据、再次裁切处理及图像扭曲处理等数据处理操作，才能得到相应的预览图像并送显，各变焦操作从接收到预览 显示的时间较长，响应较慢。
在实际使用相机预览功能时，用户虽然会通过点选、滑动等方式持续施加多个变焦操作，以指示不同的变焦需求，但通常最新生成的变焦请求更贴近该用户的实际变焦需求。而在该最新的变焦请求之前的部分在先变焦触控操作，可能是属于滑动过程中无意触发的变焦触控操作，或者为用户在前一时刻需要但当前时刻可能不再需要的变焦需求。也即，在该变焦请求生成之后，该变焦请求之前的部分在先变焦请求可能已经不需要继续处理和预览显示，这是该变焦请求可以提前插队处理的一个因素。
另一方面，不同变焦请求在处理时所涉及到的图像数据来源和数据处理操作，在一定程度上关联了各变焦请求对应的变焦倍率、所属镜头焦段等变焦参数。由前述图8对应的变焦请求处理流程可知，变焦请求被下发至相机硬件调用模块后，先由传感器节点通过相机驱动控制相机传感器进行曝光出图操作，所控制的相机传感器为变焦倍率对应的相机传感器。在后续的数据处理依赖相机传感器采集的原始预览图像，进行对应变焦倍率的初次裁切处理、计算裁切及扭曲数据、进行再次裁切和扭曲处理。在预览场景中相机拍摄对象通常不变的情况下，若不同变焦请求的变焦倍率接近(例如差值在0.5x、1x或者1.5x之内)，或者属于同一个镜头类型的焦段范围内，那么在传感器节点进行曝光出图操作得到的原始预览图像也比较接近甚至相同，后续的初次裁切处理、计算裁切及扭曲数据或者进行再次裁切和扭曲处理的数据或者计算量也会比较接近。也即，不同变焦请求被处理时，可能由于较为接近或者相同的变焦参数而存在相近或者相同的图像获取或者数据处理操作，那么在处理变焦请求时，为节省处理时间，也可以考虑依赖某一在先变焦请求获取的原始预览图像、经过初步裁切处理、经过再次裁切处理和扭曲处理得到的中间数据等。这是第三变焦请求可以插队处理的另一个因素。
在一种示例中，请求队列中在先生成的变焦请求20-29的变焦倍率可能依次为“2.8x、2.0x、3.5x、2.8x、2.5x、1x、2.5x、3.5x、3x、3.2x、”，最新生成的变焦请求30的变焦倍率可能为“3.1x”。那么，在用户施加该最新生成的变焦请求30对应的变焦操作时，移动终端可能正在在先处理变焦请求20，或者正在处理在先变焦请求20-22，即多个不同在先变焦请求可以都处于正在处理的状态，但正在处理的多个在先变焦请求的处理节点不同。那么，在该最新的变焦请求30和正在处理的在先的变焦请求20或者在先变焦请求20-22之间的部分在先变焦请求，例如在先变焦请求23-29可能不再是用户实际的变焦需求，那么就可以考虑将最新生成的变焦请求提前至这部分在先变焦请求被处理时或者被处理后插队处理。
如图9所示，本申请实施例提供的显示控制方法在内部软件架构层面将在后的变焦操作提前至在先生成的变焦请求处插队处理的示意图。
在应用层面，移动终端会持续接收多个变焦操作，分别将当前尚未显示的这多个变焦操作中，接收时间最早的变焦操作定义为第一变焦操作，接收时间最晚的变焦操作定义为第三变焦操作，在这第一变焦操作和第三变焦操作之间接收的至少一个变焦操作均为第二变焦操作。在显示顺序上，移动终端显示了第一变焦图像之后，会直接显示第三变焦操作，并不显示第二变焦操作对应的第二变焦图像。那么，这之间间隔的至少一个第二变焦操作可能完全不需要响应，也可能只需要响应其中的部分第二变 焦操作即可。如图9所示，变焦请求20已经完成图像获取操作即将送显，对应第一变焦操作的第一变焦图像。变焦请求30为最新生成的第三变焦请求，变焦请求21至变焦请求29之间的变焦请求即对应第二变焦请求。在处理第二变焦请求并显示对应的第二变焦图像(如变焦请求21的变焦图像)之前，即跳转显示第三变焦请求(变焦请求30的变焦图像)。
如图10所示，为显示控制方法的内部图像获取操作和外部图像显示的示意图。
图10中的(a)为不提前响应第三变焦请求的情况下的示意图，即移动终端会依次响应第一变焦请求、至少一个第二变焦请求和第三变焦请求，并依次对应显示第一变焦图像、至少一个第二变焦图像和第三变焦图像。
图10中的(b)为提前响应第三变焦请求的情况下的示意图，即移动终端会响应第一变焦请求之后插队响应第三变焦请求，并在显示第一变焦图像后插队显示第三变焦图像。
对比图10的(a)和(b)可以看出，用户在后施加的第三变焦操作会被很快地响应并显示，可以直观地提升用户得到变焦体验。
此外，考虑到不同变焦请求的变焦倍率可能差别较大，若随意选择一个在先变焦请求进行插队，可能会因为变焦倍率差别较大导致预览图像的切换效果较差等技术问题。本申请实施例提供的显示控制方法，考虑先从在先的多个第二变焦请求中选择一个适合该第三变焦请求跳转的变焦请求，将第三变焦请求插队到选择出来的这个第二变焦请求处进行处理。例如前述图10的示例中，至少一个第二变焦请求中的变焦请求23(变焦倍率2.8x)、变焦请求28(变焦倍率3x)等的变焦倍率与第三变焦请求(即变焦请求30)的变焦倍率(变焦倍率3.1x)都比较接近，那么就可以考虑将该第三变焦请求提前至这部分变焦倍率比较接近的变焦请求被处理时或者被处理后插队处理。这样，既能减少在后的变焦请求的响应延时，又能优化变焦预览显示的稳定性和平滑性。
如图11所示，为本申请实施例提供的显示控制方法选择目标变焦请求的流程示意图。主要包括以下步骤：
步骤S1101，从第二变焦请求中选择可跳转的目标变焦请求；
步骤S1102，在目标变焦请求出队时，跳转执行第三变焦请求的图形获取操作；
步骤S1103，提前显示第三变焦请求的第三变焦图像。
移动终端维护的请求队列中可以包括：即将送显的第一变焦请求(变焦请求20)、多个在先生成的尚未显示对应变焦图像的第二变焦请求(变焦请求21-29)和最新生成的第三变焦请求(变焦请求30)，这些变焦请求的生成时间顺着箭头的方向依次排列，即在先变焦请求20的生成时间最早，在先变焦请求21的生成时间仅晚于在先变焦请求20，第三变焦请求30的生成时间最晚。
如图11所示，从第二变焦请求21-29中，选择一个第二变焦请求K作为目标变焦请求，K∈(20-29)中的任一整数。移动终端在为第三变焦请求选择一个可以跳转插队的目标变焦请求时，可以考虑变焦倍率对计算量的影响或者对显示切换平滑度的影响，根据各第二变焦请求的变焦倍率来选择该目标变焦请求。当然，也可以根据各第二变焦请求的实时状态是在请求队列中等待出队的状态，还是已经出队后数据处理 操作的状态，选择适合插队处理的目标变焦请求。在其他情况下，移动终端也可以根据该第三变焦请求需要的镜头类型，从多个在先的第二变焦请求中选择镜头匹配的目标变焦请求等，不作限定。
依据前述步骤确定了第三变焦请求可跳转的目标变焦请求后，就可以将该第三变焦请求提前处理。具体的提前方案可以有多种，例如，可以在目标变焦请求的数据处理操作完成后，跳转执行该第三变焦请求的数据处理操作。或者，也可以在目标变焦请求在完成某一个处理节点时，例如完成图像信号前端处理节点，或者完成空间对齐变换处理节点，或者完成图像信号后端处理节点时，跳转执行该第三变焦请求的数据处理操作。
移动终端在处理目标变焦请求时将第三变焦请求提前处理，处理后即可得到该第三变焦请求对应的第三变焦图像。那么，此时移动终端就可以将第三变焦图像预览显示。将第三变焦图像预览显示，其及时响应的变焦效果是用户可以直接看到的，也是用户评判变焦体验的依据。将最新生成的变焦请求提前处理并显示，较大程度地优化了用户的拍照预览体验。
继续参见上述的图9，移动终端还包括选择模块，所述硬件抽象层还包括应用模块；其中，所述选择模块确定所述第三变焦请求可跳转的目标变焦请求；所述应用模块将所述目标变焦请求的目标变焦倍率修改为所述第三变焦倍率；所述数据处理模块执行修改后的所述目标变焦请求对应的图像获取操作，以得到所述第三变焦图像。
另外，在具体实施时，可以考虑先将目标变焦请求的数据处理操作完成以得到对应的目标预览图像，将该目标预览图像送显后再将第三变焦请求对应的最新预览图像送显，以优化变焦图像切换的平滑度。当然，为了进一步减少响应延时，也可以考虑不需要将目标变焦请求的数据处理操作完成，或者不需要将目标变焦请求对应的目标预览图像送显，而是在将目标变焦请求的前一个变焦请求的变焦图像送显后直接将该第三变焦图像送显，以提高变焦预览显示的及时性。
需要说明的是，本申请实施例提供的显示控制方法，更适合存在三个及以上变焦请求的情况，这种情况下变焦响应的延时较长，会明显影响用户体验。若仅存在一个变焦请求，也即第三变焦请求之前不存在其他尚未处理完成的第二变焦请求，则可以不需要确定目标变焦请求，在第一变焦请求处理之后直接处理该第三变焦请求，此处存在的响应延时仅包括该第三变焦请求的处理时间，不包括等待其他在先的变焦请求的处理时间。若最新的第三变焦请求之前仅存在一个在先的第二变焦请求，那么，也可以直接等该在先的第二变焦请求处理完后再处理该第三变焦请求，或者直接将该一个第二变焦请求作为目标变焦请求，当然也可以直接将第三变焦请求跳转至该一个第二变焦请求之前提前处理等，不作限定。
本申请实施例提供的显示控制方法，可以配置为变焦预览场景的自启动方案，即移动终端处于变焦预览场景就会实时应用或者周期性应用本申请实施例提供的显示控制方法。例如，可以在每新生成一个变焦请求时，将该新生成的变焦请求作为第三变焦请求，为其选择可跳转插队的目标变焦请求。若在此新生成的变焦请求(如变焦请求30)之后又新生成一个变焦请求(如变焦请求31)，那么，在先生成的变焦请求(如变焦请求30)就成了在后生成的这个变焦请求(如变焦请求31)的在先变焦请 求，在先生成的变焦请求(如变焦请求30)等待提前插队处理的过程中也可以被在后生成的变焦请求(如变焦请求31)插队，以优先保证最新生成的变焦请求的及时响应效果。这种配置方案可能更适用于用户期待变焦预览图像及时显示的变焦预览场景。
当然，本申请实施例提供的显示控制方法，也可以配置为由用户手动开启的方案。即用户可以在移动终端的设置界面，或者在拍摄预览界面的拍摄控件施加对应的触控操作，以指示应用本申请实施例提供的显示控制方法。这种配置方案可能更适用于用户期待变焦预览图像依次显示不同变焦效果的变焦预览场景。
由前述图9至图11均示出了基于变焦倍率确定提前响应第三变焦请求的过程。那么，下面将详细解释下，如何基于变焦倍率来选择适合该第三变焦请求跳转的目标变焦请求。
基础的，移动终端可以选择变焦倍率与第三变焦请求的变焦倍率比较接近的第二请求作为目标变焦请求。例如，获取各所述第二变焦请求对应的第二变焦倍率与所述第三变焦倍率的倍率差值，选择倍率差值在预设范围内的所述第二变焦请求，作为所述目标变焦请求。
在其他情况下，移动终端也可以选择变焦倍率小于或者大于所述第三变焦请求的变焦倍率，或者选择变焦倍率满足其他预设条件的在先变焦请求作为目标变焦请求等。
各第二变焦请求加入队列后，实时状态分为两种，等待出队状态或者已经出队状态。已经出队状态的变焦请求已经被下发，处于执行具体的图像获取操作的节点，按照图像获取操作的时序依次包括初始图像采集操作节点、图像信号前端处理操作节点、图像信号后端处理操作节点。第二变焦请求的实时状态不同，其剩余等待时长就不同。例如，处于等待出队状态的在先变焦请求，其剩余等待时长至少包括其本身的全部处理时长，可能还包括等待其他在先的变焦请求的处理时长。处于已经出队状态在第二变焦请求，其剩余等待时长可能包含其本身的部分处理时长。处于已经出队状态的第二变焦请求的剩余等待时长相对较短，可能会较早地完成全部处理操作。
一方面，移动终端可以仅根据在先的各第二变焦请求的实时状态来选择可跳转的目标变焦请求的方案。
相对来说，处于已经出队状态的变焦请求相对于等待出队状态的变焦请求会被较早响应。进一步的，在这些已经出队状态的变焦请求中，处于空间对齐变换处理操作节点和处于信号后端处理操作节点的变焦请求会被更早响应。那么，为了提前显示第三变焦请求对应的第三变焦图像，可以选择实时状态为已经出队状态的变焦请求。若处于已经出队状态的变焦请求有多个，则可以选择出队后的实时操作节点为图像信号后端处理操作节点或者空间对齐变换处理操作节点的第二变焦请求，确定为所述目标变焦请求。这种仅参考实时状态而不需要依赖变焦倍率选择可跳转的目标变焦请求的方案，更适用于变焦倍率逐步增大或者逐步减小的单向变焦场景，例如，将变焦倍率从1x逐步增大至10x，或者将变焦倍率从20x逐步减小至1x的单向变焦场景。仅参考实时状态选择目标变焦请求的方案，可以提高第三变焦请求的及时性，但可能会影响预览图像切换平滑度等。
另一方面，移动终端也可以综合变焦倍率和实时状态这两个因素，来选择更适合第三变焦请求跳转插队的目标变焦请求。具体确定目标变焦请求的步骤，可以包括：
移动终端先根据第三变焦请求的变焦倍率，结合相近的变焦倍率在数据处理操作中的依赖关系，确定该第三变焦请求的变焦倍率在数据处理操作中数据来源或者计算量接近的多个变焦倍率，得到一个倍率范围。再依据该倍率范围从全部第二变焦请求中筛选出一部分可能适合的第二变焦请求，再从该部分第二变焦请求中进一步选择适合第三变焦请求可跳转的目标变焦请求。为便于描述，可以将该部分在先变焦请求定义为候选变焦请求。
移动终端先确定第三变焦请求的变焦倍率所属的倍率。具体的，移动终端根据各焦段的变焦倍率之间的关联性，预先定义一个倍率步长，该倍率步长指示关联性相对较大的变焦倍率的范围。移动终端以所述第三变焦请求的变焦倍率为中心确定所述变焦倍率所属的倍率范围，其中，所述倍率范围的长度等于所述预设调整步长，所述倍率范围的中值为所述第三变焦请求的变焦倍率。例如，所述移动终端预先定义的预设调整步长为1x，若第三变焦请求的变焦倍率为3.1x，那么，其对应的倍率范围可以为(2.6x-3.6x)。若预设调整步长为0.4x，那么其对应的倍率范围可以为(2.9x-3.3x)。
当然也可以有其他的确定倍率范围的方式，例如可以取第三变焦请求的变焦倍率之前的预设调整步长的倍率范围。示例的预设调整步长为0.4x，第三变焦请求的变焦倍率为3.1x，那么对应的倍率范围可以为(2.7x-3.1x)等。当然，也可以有其他的选择倍率范围的方式，不作限定。
移动终端从候选变焦请求中选择出目标变焦请求的过程，若存在至少两个候选变焦请求，将图像获取操作处于图像信号后端处理操作或者空间对齐变换处理操作的候选变焦请求作为所述目标变焦请求。
各变焦请求在数据处理模块内的全部处理操作依次包括图像信号前端处理操作、空间对齐变换处理操作和图像信号后端处理操作。空间对齐变换处理操作和图像信号后端处理操作的处理进度相对较快，在变焦倍率和实时状态都满足的情况下，可以优先选择图像获取操作处于图像信号后端处理操作或者空间对齐变换处理操作的候选变焦请求作为所述目标变焦请求。
需要说明的是，前述实施方式中所提到的，在先变焦请求中筛选出变焦倍率属于倍率范围，且实时状态为已经出队状态的候选变焦请求，此处所提到的候选变焦请求仅用于指代满足要求的部分变焦请求，并不限定为被赋值或者重命名为候选变焦请求。也即，移动终端可以仅执行根据变焦倍率和倍率范围进行筛选的动作，并不需要执行为筛选出动作得到的这部分在先变焦请求进行对象赋值或者重命名的动作。
在其他情况下，移动终端也可以叠加变焦镜头类型来选择目标变焦请求。移动终端内装配的镜头主要包括主摄镜头、广角镜头和长焦镜头。主摄镜头是移动终端的所有摄像头中像素最高的一个，广角摄像头是带有广角功能的摄像头，广角的视角比一般镜头广而焦距短，常用于拍摄面积很大的物体。长焦相机可以拍出更长的照片，保证照片的清晰度。广角镜头和长焦镜头通常能够弥补主摄像头的不足，提高拍摄效果。移动终端生成的变焦请求的变焦参数还可以包括变焦镜头类型，所述变焦镜头类 型包括主摄镜头、长焦镜头和广角镜头中的至少一种。
移动终端所根据所述第三变焦请求的变焦镜头类型，以及各所述候选变焦请求的变焦镜头类型，确定所述目标变焦请求。具体的，将变焦镜头类型包括所述第三变焦请求的变焦镜头类型的候选变焦请求，作为所述目标变焦请求。
例如前述示例所示，变焦请求20的变焦倍率为2.8x，其变焦镜头类型可能为长焦镜头。变焦请求21的变焦倍率为2.0x，其变焦镜头类型可能为主摄镜头。第三变焦请求30的变焦倍率为3.1x，其变焦镜头类型可能为长焦镜头。那么，变焦请求20到第三变焦请求30的变焦切换类型是放大Zoom In，变焦请求20包含的变焦镜头类型(主摄镜头)不包括第三变焦请求30包含的变焦镜头类型(长焦镜头)。变焦请求21到第三变焦请求30的变焦切换类型是缩小Zoom Out，变焦请求21包含的变焦镜头类型(长焦镜头)包括第三变焦请求30包含的变焦镜头类型(长焦镜头)。选择焦请求21作为目标变焦请求的方案，相对于选择变焦请求20作为目标变焦请求的方案，减少了切换镜头重新生成原始图像并对齐的操作。
在上述各实施方式的基础上确定目标变焦请求后，移动终端将第三变焦请求提前跳转的节点可以有多种选择。
在一种实施方式中，若目标变焦请求的实时状态为等待出队状态，则可以将该第三变焦请求提前至该目标变焦请求之后，等目标变焦请求出队时，跳转执行第三变焦请求的图像获取操作。
在另一种实施方式中，若所述目标变焦请求的实时状态为已经出队状态，可以将所述第三变焦请求的实时状态跳转至目标变焦请求当前的处理节点。例如，若目标变焦请求的实时节点为空间对齐变换处理节点，将所述第三变焦请求的实时节点从等待节点跳转至所述空间对齐变换处理节点。
当然，考虑到处理节点之间的连续性，即部分处理节点会存在处理链路上前向关联的处理节点，或者存在后向关联的处理节点，各变焦请求均需要在处理链路上依次经历各处理节点的处理操作后才得到最终的预览图像。例如，第二变焦请求21若处于空间对齐变换处理节点，则较早的在第一焦请求20可能处于图像信号后端处理节点，较晚的第二变焦请求22可能处于图像信号前端处理节点，更晚的在先变焦请求23可能处于传感器节点。那么，在跳转插队时，也可以考虑将第三变焦请求的实时节点从等待节点跳转至空间对齐变换处理节点之前的一个处理节点，即图像信号前端处理节点，等待目标变焦请求在空间对齐变换处理节点进入其后向关联的图像信号后端处理节点时，第三变焦请求从图像信号前端处理节点进入空间对齐变换处理节点。
具体执行时，若所述目标变焦请求的实时状态为已经出队状态，将所述目标变焦请求对应的目标变焦倍率修改为所述第三变焦倍率，执行修改后的所述目标变焦请求剩余的余图像获取操作，以获得所述第三变焦图像。基于请求队列的先进先出原则，移动终端可以将第二变焦请求的第二变焦倍率替换为第三变焦请求的第三变焦倍率，以使得第三变焦倍率对应的变焦图像被提前获取并作为第三变焦图像提前显示。或者也可以将第三变焦请求之前的至少一个第二变焦请求出队后全部丢弃不执行任何图像获取操作或者仅执行部分图像获取操作之后即执行第三变焦请求的图像获取操作，也能保证第三变焦图像被提前获取和显示。
此外，本申请实施例还存在其他的显示控制方案。例如图12所示，若在先生成的且尚未显示的请求队列里存在变焦请求1至7，且之后依次接收变焦请求8至14，各变焦请求的变焦倍率如图12中所示。那么，依据变焦倍率这一因素进行显示控制时，在为后来的各变焦请求8至14依次选择跳转方案的过程为：
变焦请求8的变焦倍率1.6x接近变焦请求3的变焦倍率1.5x，变焦请求8跳转至变焦请求3，变焦请求3的变焦倍率修改为变焦请求8的倍率1.6x；
变焦请求9的变焦倍率1.9x接近变焦请求4的变焦倍率2.0x，变焦请求9先跳转至变焦请求4，变焦请求4的变焦倍率修改为变焦请求9的变焦倍率1.9x；
变焦请求10的变焦倍率2.1接近变焦请求9的变焦倍率1.9x，变焦请求10再跳转至变焦请求9(实际的变焦请求4)，将变焦请求4的变焦倍率修改为变焦请求10的变焦倍率2.1x；
变焦请求11的变焦倍率2.6x接近变焦请求5的变焦倍率2.5x，变焦请求11跳转至变焦请求5，变焦请求5的变焦倍率修改为变焦请求11的变焦倍率2.6x；
变焦请求12的变焦倍率3.0接近变焦请求7的变焦倍率3.0(相同也算接近)，变焦请求12跳转变焦请求7，变焦请求7的变焦倍率修改为变焦请求12的变焦倍率3.0x；
变焦请求13没有适合插队的在先变焦请求，可以将变焦请求13依序保留，放置在被修改变焦倍率后的变焦请求7之后，形成新的变焦请求8，变焦倍率为3.5x；
变焦请求14的变焦倍率接近变焦请求13(新的变焦请求8)，将变焦请求14跳转至新的变焦请求8，将新的变焦请求8的变焦倍率修改为变焦请求14的变焦别来3.6x。
这样，即可得到如图12右侧序列所示的新的变焦请求处理序列及实际变焦倍率。由图12可以明显得出，在后的变焦请求被提前处理，减少了等待多个变焦请求的图像处理操作导致的响应延时。
综上，本申请实施例提供的显示控制方法，结合最新生成的第三变焦请求的变焦倍率等变焦参数，以及各在先生成的变焦请求的变焦倍率，从多个在先生成的变焦请求中选择一个适合第三变焦请求跳转插队的目标变焦请求，将第三变焦请求跳转至目标变焦请求处理时提前处理并送显，以减少该第三变焦请求的响应延时，优化变焦预览的跟手性。
此外，本申请实施例还提供一种移动终端，包括相机模组、存储器和处理器，相机模组与存储器和处理器耦合；
存储器存储计算机执行指令；
处理器执行存储器存储的计算机执行指令，使得移动终端执行上述实施例提供的显示控制方法。除此部分主要器件之外，移动终端还包括用于实现基础功能的元器件，下面将结合图13进行具体说明。
如图13所示为本申请实施例提供的一种移动终端1300的结构示意图。其中，移动终端1300可以包括处理器1310、存储器1320、相机1330、显示屏1340、触控感知模块1350、马达1360、音频模块1370、传感器模块1380、按键1390等。其中传感器模块1380可以包括陀螺仪传感器1380A、加速度传感器1380B、距离传感器 1380C、接近光传感器1380D、环境光传感器1380E等。
本发明实施例示意的结构并不构成对移动终端1300的限定。可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。图示的部件可以以硬件，软件或软件和硬件的组合实现。
处理器1310可以包括一个或多个处理单元。例如，处理器1310可以包括应用处理器(Application Processor，AP)，调制解调处理器，图形处理器(Graphics Processing Unit，GPU)，图像信号处理器(Image Signal Processor，ISP)，控制器，存储器，视频编解码器，数字信号处理器(Digital Signal Processor，DSP)，基带处理器，和/或神经网络处理器(Neural-Network Processing Unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。
上述控制器可以是指挥移动终端1300的各个部件按照指令协调工作的决策者。是移动终端1300的神经中枢和指挥中心。控制器根据指令操作码和时序信号，产生操作控制信号，完成取指令和执行指令的控制。
处理器1310中还可以设置存储器1320，用于存储指令和数据。在一些实施例中，处理器1310中的存储器1320为高速缓冲存储器，可以保存处理器1310刚用过或循环使用的指令或数据。如果处理器1310需要再次使用该指令或数据，可从所述存储器1320中直接调用。避免了重复存取，减少了处理器1310的等待时间，因而提高了系统的效率。
在一些实施例中，处理器1310可以包括接口。接口可以包括集成电路(Inter-Integrated Circuit，I2C)接口，集成电路内置音频(Inter-Integrated Circuit Sound，I2S)接口，脉冲编码调制(Pulse Code Modulation，PCM)接口，通用异步收发传输器(Universal Asynchronous Receiver/Transmitter，UART)接口，移动产业处理器接口(Mobile Industry Processor Interface，MIPI)，通用输入输出(General-Purpose Input/Output，GPIO)接口，SIM接口，和/或USB接口等。
I2C接口是一种双向同步串行总线，包括一根串行数据线(Serial Data Line，SDL)和一根串行时钟线(Derail Clock Line，SCL)。在一些实施例中，处理器1310可以包含多组I2C总线。处理器1310可以通过不同的I2C总线接口分别耦合触摸传感器，充电器，闪光灯，相机1330等。例如：处理器1310可以通过I2C接口耦合触摸传感器，使处理器1310与触摸传感器通过I2C总线接口通信，实现移动终端1300的触摸功能。
I2S接口可以用于音频通信。在一些实施例中，处理器1310可以包含多组I2S总线。处理器1310可以通过I2S总线与音频模块1370耦合，实现处理器1310与音频模块1370之间的通信。在一些实施例中，音频模块1370可以通过I2S接口向通信模块传递音频信号，实现通过蓝牙耳机接听电话的功能。
PCM接口也可以用于音频通信，将模拟信号抽样，量化和编码。在一些实施例中，音频模块1370与通信模块可以通过PCM总线接口耦合。在一些实施例中，音频模块1370也可以通过PCM接口向通信模块传递音频信号，实现通过蓝牙耳机接听电话的功能。所述I2S接口和所述PCM接口都可以用于音频通信，两种接口的采样速率不同。
UART接口是一种通用串行数据总线，用于异步通信。该总线为双向通信总线。它将要传输的数据在串行通信与并行通信之间转换。在一些实施例中，UART接口通常被用于连接处理器1310与通信模块。例如：处理器1310通过UART接口与蓝牙模块通信，实现蓝牙功能。在一些实施例中，音频模块1370可以通过UART接口向通信模块传递音频信号，实现通过蓝牙耳机播放音乐的功能。
MIPI接口可以被用于连接处理器1310与显示屏1340，相机1330等外围器件。MIPI接口包括摄像头串行接口(Camera Serial Interface，CSI)，显示屏串行接口(Display Serial Interface，DSI)等。在一些实施例中，处理器1310和相机1330通过CSI接口通信，实现移动终端1300的拍摄功能。处理器1310和显示屏1340通过DSI接口通信，实现移动终端1300的显示功能。
GPIO接口可以通过软件配置。GPIO接口可以配置为控制信号，也可配置为数据信号。在一些实施例中，GPIO接口可以用于连接处理器1310与相机1330，显示屏1340，通信模块，音频模块1370，传感器模块1380等。GPIO接口还可以被配置为I2C接口，I2S接口，UART接口，MIPI接口等。
USB接口可以是Mini USB接口，Micro USB接口，USB Type C接口等。USB接口可以用于连接充电器为移动终端1300充电，也可以用于移动终端1300与外围设备之间传输数据。也可以用于连接耳机，通过耳机播放音频。还可以用于连接其他移动终端，例如AR设备等。
本发明实施例示意的各模块间的接口连接关系，只是示意性说明，并不构成对移动终端1300的结构限定。移动终端1300可以采用本发明实施例中不同的接口连接方式，或多种接口连接方式的组合。
移动终端1300的无线通信功能可以通过天线、射频模块、通信模块，调制解调器以及基带处理器等实现。天线用于发射和接收电磁波信号。移动终端1300中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用，以提高天线的利用率。
移动终端1300通过GPU，显示屏1340，以及应用处理器等实现显示功能。GPU为图像处理的微处理器，连接显示屏1340和应用处理器。GPU用于执行数学和几何计算，用于图形渲染。处理器1310可包括一个或多个GPU，其执行程序指令以生成或改变显示信息。
显示屏1340用于显示图像，视频等。显示屏1340包括显示面板。显示面板可以采用液晶显示屏(Liquid Crystal Display，LCD)，有机发光二极管(Organic Light-Emitting Diode，OLED)，有源矩阵有机发光二极体或主动矩阵有机发光二极体
(Active-Matri13Organic Light Emitting Diode，AMOLED)，柔性发光二极管(Fle13Light-Emitting Diode，FLED)，Miniled，MicroLED，Micro-OLED，量子点发光二极管(Quantum dot Light Emitting Diodes，QLED)等。在一些实施例中，移动终端1300可以包括1个或N个显示屏1340，N为大于1的正整数。
移动终端1300可以通过ISP，相机1330，视频编解码器，GPU，显示屏以及应用处理器等实现拍摄功能。
ISP用于处理相机1330反馈的数据。例如，拍照时，打开快门，光线通过镜头 被传递到摄像头感光元件上，光信号转换为电信号，摄像头感光元件将所述电信号传递给ISP处理，转化为肉眼可见的图像。ISP还可以对图像的噪点，亮度，色度进行算法优化。ISP还可以对拍摄场景的曝光，色温等参数优化。在一些实施例中，ISP可以设置在相机1330中。
相机1330用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(Charge Coupled Device，CCD)或互补金属氧化物半导体(Complementary Metal-O13ide-Semiconductor，CMOS)光电晶体管。感光元件把光信号转换成电信号，之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB，YUV等格式的图像信号。在一些实施例中，移动终端1300可以包括1个或N个相机1330，N为大于1的正整数。
数字信号处理器用于处理数字信号，除了可以处理数字图像信号，还可以处理其他数字信号。例如，当移动终端1300在频点选择时，数字信号处理器用于对频点能量进行傅里叶变换等。
视频编解码器用于对数字视频压缩或解压缩。移动终端1300可以支持一种或多种视频编解码器。这样，移动终端1300可以播放或录制多种编码格式的视频，例如：动态图像专家组(Moving Picture E13perts Group，MPEG)1，MPEG2，MPEG13，MPEG4等。
NPU为神经网络(Neural-Network，NN)计算处理器，通过借鉴生物神经网络结构，例如借鉴人脑神经元之间传递模式，对输入信息快速处理，还可以不断的自学习。通过NPU可以实现移动终端1300的智能认知等应用，例如：图像识别，人脸识别，语音识别，文本理解等。
外部存储器接口可以用于连接外部存储卡，例如Micro SD卡，实现扩展移动终端1300的存储能力。外部存储卡通过外部存储器接口与处理器1310通信，实现数据存储功能。例如将音乐，视频等文件保存在外部存储卡中。
内部存储器可以用于存储计算机可执行程序代码，所述可执行程序代码包括指令。处理器1310通过运行存储在内部存储器的指令，从而执行移动终端1300的各种功能应用以及数据处理。存储器1320可以包括存储程序区和存储数据区。其中，存储程序区可存储操作系统，至少一个功能所需的应用程序(比如声音播放功能，图像播放功能等)等。存储数据区可存储移动终端1300使用过程中所创建的数据(比如音频数据，电话本等)等。此外，存储器1320可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件，闪存器件，其他易失性固态存储器件，通用闪存存储器(Universal Flash Storage，UFS)等。
移动终端1300可以通过音频模块1370的扬声器，受话器，麦克风，耳机接口，以及应用处理器等实现音频功能，例如语音控制拍照、音乐播放录音等。
音频模块1370用于将数字音频信息转换成模拟音频信号输出，也用于将模拟音频输入转换为数字音频信号。音频模块1370还可以用于对音频信号编码和解码。在一些实施例中，音频模块1370可以设置于处理器1310中，或将音频模块1370的部分功能模块设置于处理器1310中。
扬声器，也称“喇叭”，用于将音频电信号转换为声音信号。移动终端1300可以通过扬声器收听音乐，或收听免提通话。
受话器，也称“听筒”，用于将音频电信号转换成声音信号。当移动终端1300接听电话或语音信息时，可以通过将受话器靠近人耳接听语音。
麦克风，也称“话筒”，“传声器”，用于将声音信号转换为音频电信号。当拨打电话或发送语音信息时，用户可以通过人嘴靠近麦克风发声，将声音信号输入到麦克风。移动终端1300可以设置至少一个麦克风。在一些实施例中，移动终端1300可以设置两个麦克风，除了采集声音信号，还可以实现降噪功能。在一些实施例中，移动终端1300还可以设置三个，四个或更多麦克风，实现采集声音信号，降噪，还可以识别声音来源，实现定向录音功能等。
耳机接口用于连接有线耳机。耳机接口可以是USB接口，也可以是3.5mm的开放移动终端平台(Open Mobile Terminal Platform，OMTP)标准接口，美国蜂窝电信工业协会(Cellular Telecommunications Industry Association of the USA，CTIA)标准接口。
按键1390包括开机键，音量键等。按键1390可以是机械按键。也可以是触摸式按键。移动终端1300接收按键1390输入，产生与移动终端1300的用户设置以及功能控制有关的键信号输入。
马达1360可以产生振动提示。马达1360可以用于来电振动提示，也可以用于触摸振动反馈。例如，作用于不同应用(例如拍照，音频播放等)的触摸操作，可以对应不同的振动反馈效果。作用于显示屏1340不同区域的触摸操作，也可对应不同的振动反馈效果。不同的应用场景(例如：时间提醒，接收信息，闹钟，游戏等)也可以对应不同的振动反馈效果。触摸振动反馈效果还可以支持自定义。此外，马达还可以用于相机变焦拍照场景中，通过驱动镜片的移动来实现不同焦段的镜头切换。
传感器模块1380可以包括陀螺仪传感器1380A、加速度传感器1380B、距离传感器1380C、接近光传感器1380D、环境光传感器1380E。其中，陀螺仪传感器1380A和加速度传感器1380B可以应用于拍照过程中的姿态矫正或者水平定位等功能，距离传感器1380C可以应用于拍照过程中的景深确定或者图像处理，接近光传感器1380D、环境光传感器1380E可以应用于拍照过程中对环境光进行感知和图像亮度值调整等。
前述实施例中的显示控制方法均可以在具有上述硬件结构的移动终端1300中实现。
在上述实施例的基础上，本申请实施例还提供一种显示控制装置，所述控制装置包括处理器，所述处理器用于执行上述实施例提供的显示控制方法。
本申请实施例还提供了一种计算机可读存储介质，所述计算机可读存储介质中存储有计算机程序，当其在计算机上运行时，使得计算机执行上述实施例提供的显示控制方法。
本申请实施例还提供了一种包含指令的计算机程序产品，当其在计算机上运行时，使得计算机可以执行如上述实施例提供的显示控制方法。
本申请实施例提供的移动终端、显示控制装置、计算机可读存储介质，和包含指 令的计算机程序产品的具体实施方式及其所带来的技术效果，可参见前述实施例提供的显示控制方法的具体实施过程及其所带来的技术效果，此处不再赘述。
在一些实施例中，通过以上的实施方式的描述，所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，仅以上述各功能模块的划分进行举例说明，实际应用中，可以根据需要而将上述功能分配由不同的功能模块完成，即将装置的内部结构划分成不同的功能模块，以完成以上描述的全部或者部分功能。上述描述的系统，装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
在本申请实施例各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)或处理器执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：快闪存储器、移动硬盘、只读存储器、随机存取存储器、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述，仅为本申请实施例的具体实施方式，但本申请实施例的保护范围并不局限于此，任何在本申请实施例揭露的技术范围内的变化或替换，都应涵盖在本申请实施例的保护范围之内。因此，本申请实施例的保护范围应以所述权利要求的保护范围为准。

Claims (13)

  1. 一种显示方法，其特征在于，应用于移动终端，所述显示方法包括：
    接收第一变焦操作和第二变焦操作；所述第一变焦操作的接收时间早于所述第二变焦操作的接收时间，所述第一变焦操作对应第一变焦倍率，所述第二变焦操作对应第二变焦倍率；
    所述第二变焦倍率与所述第一变焦倍率的倍率差值在预设范围内，以所述第二变焦倍率处理第一图像数据得到第二变焦图像；所述第一图像数据为基于所述第一变焦操作获取的图像数据。
  2. 根据权利要求1所述的显示方法，其特征在于，所述接收第一变焦操作，包括：
    接收至少两个第一变焦操作；每个所述第一变焦操作的接收时间均早于所述第二变焦操作的接收时间；
    所述第二变焦倍率与所述第一变焦倍率的倍率差值在预设范围内，以所述第二变焦倍率处理第一图像数据得到第二变焦图像，包括：
    从所述至少两个第一变焦倍率中查找目标变焦倍率；其中，所述目标变焦倍率为与所述第二变焦倍率的倍率差值在预设范围内的第一变焦倍率；
    以所述第二变焦倍率处理目标图像数据，得到所述第二变焦图像；其中，所述目标图像数据为基于目标变焦操作获取的图像数据，所述目标变焦操作为所述目标变焦倍率对应的第一变焦操作。
  3. 根据权利要求2所述的显示方法，其特征在于，所述从所述至少两个第一变焦倍率中查找目标变焦倍率，包括：
    从至少两个第一变焦请求中，确定对应所述目标变焦倍率的目标变焦请求；其中，每个第一变焦请求对应一个第一变焦操作，每个所述第一变焦请求的生成时间均早于所述第二变焦操作对应的第二变焦请求的生成时间，所述目标变焦请求为对应所述目标变焦倍率的第一变焦请求；
    所述以所述第二变焦倍率处理目标图像数据，得到所述第二变焦图像，包括：
    响应所述目标变焦请求和所述第二变焦请求，以所述第二变焦倍率处理目标图像数据，得到所述第二变焦图像。
  4. 根据权利要求3所述的显示方法，其特征在于，所述响应所述目标变焦请求和所述第二变焦请求，以所述第二变焦倍率处理目标图像数据，得到所述第二变焦图像，包括：
    响应所述目标变焦请求，获得所述目标图像数据；
    以所述第二变焦倍率处理所述目标图像数据，得到所述第二变焦图像；
    显示所述第二变焦图像。
  5. 根据权利要求3所述的显示方法，其特征在于，所述响应所述目标变焦请求和所述第二变焦请求，以所述第二变焦倍率处理目标图像数据，得到所述第二变焦图像，包括：
    响应所述目标变焦请求，获得目标图像数据，以所述目标变焦倍率处理所述目标 图像数据得到目标变焦图像，取消显示所述目标变焦图像；
    响应所述第二变焦请求，获得第二图像数据，以所述第二变焦倍率处理所述第二图像数据得到所述第二变焦图像，显示所述第二变焦图像。
  6. 根据权利要求3所述的显示方法，其特征在于，所述响应所述目标变焦请求和所述第二变焦请求，显示所述第二变焦图像，包括：
    在没有响应所述目标变焦请求的情况下，响应所述第二变焦请求，获得第二图像数据；
    以所述第二变焦倍率处理所述第二图像数据得到所述第二变焦图像，显示所述第二变焦图像。
  7. 根据权利要求3-6中任一项所述的显示方法，其特征在于，所述得到所述第二变焦图像之后，所述显示方法还包括：
    停止响应第四变焦请求；其中，所述第四变焦请求为生成时间在所述目标变焦请求之后的所述第一变焦请求。
  8. 根据权利要求4-7中任一项所述的显示方法，其特征在于，所述接收第一变焦操作和第二变焦操作，包括：
    接收所述第一变焦操作，生成所述第一变焦请求，将所述第一变焦请求加入请求队列；
    接收所述第二变焦操作，生成所述第二变焦请求，将所述第二变焦请求加入所述请求队列；所述请求队列为先进先出队列，所述第一变焦请求加入所述请求队列的时间早于所述第二变焦请求加入所述请求队列的时间；
    所述响应所述目标变焦请求，包括：
    在所述目标变焦请求从所述请求队列出队后，响应所述目标变焦请求。
  9. 根据权利要求8所述的显示方法，其特征在于，所述目标变焦请求包括：变焦倍率与所述第二变焦倍率的倍率差值在预设范围内，且已经从所述请求队列中出队的第一变焦请求。
  10. 根据权利要求9所述的显示方法，其特征在于，各变焦请求出队后对应的图像处理操作依次包括：原始图像采集操作、图像信号前端处理操作、空间对齐变换处理操作和图像信号后端处理操作；
    所述从至少两个第一变焦请求中，确定对应所述目标变焦倍率的目标变焦请求，包括：
    选择变焦倍率与所述第二变焦倍率的倍率差值在预设范围内，且处于所述空间对齐变换处理操作或所述图像信号后端处理操作的第一变焦请求，作为所述目标变焦请求。
  11. 根据权利要求1-10中任一项所述的显示方法，其特征在于，所述第一变焦操作包括第一目标操作和第二目标操作，所述第二变焦操作包括第三变焦操作和第四变焦操作，所述第一目标操作的接收时间早于所述第三变焦操作的接收时间，所述第二目标操作的接收时间早于所述第四变焦操作的接收时间；所述第一目标操作对应第一目标变焦倍率，所述第二目标操作对应第二目标变焦倍率，所述第三变焦操作对应第三变焦倍率，所述第四变焦操作对应第四变焦倍率；
    所述接收第一变焦操作和第二变焦操作，所述第二变焦倍率与所述第一变焦倍率的倍率差值在预设范围内，以所述第二变焦倍率处理第一图像数据得到第二变焦图像，包括：
    接收所述第一目标变焦操作、所述第二目标变焦操作、所述第三变焦操作和所述第四变焦操作；
    所述第一目标变焦倍率与所述第三变焦倍率的倍率差值在预设范围内，以所述第三变焦倍率处理第一目标图像数据得到第三变焦图像；所述第一目标图像数据为基于所述第一目标变焦操作获取的图像数据；
    所述第二目标变焦倍率与所述第四变焦倍率的倍率差值在预设范围内，以所述第四变焦倍率处理第二目标图像数据得到第四变焦图像；所述第二目标图像数据为基于所述第二目标变焦操作获取的图像数据。
  12. 一种移动终端，其特征在于，包括相机模组、存储器和处理器，所述相机模组、所述存储器与所述处理器耦合；
    所述存储器存储计算机执行指令；
    所述处理器执行所述存储器存储的计算机执行指令，使得移动终端执行如权利要求1至11中任一项所述的显示方法。
  13. 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质中存储有计算机程序，当其在计算机上运行时，使得计算机执行如权利要求1至11中任一项所述的显示方法。
PCT/CN2024/100202 2023-07-03 2024-06-19 显示方法、移动终端及计算机可读存储介质 Ceased WO2025007751A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP24835234.6A EP4716228A1 (en) 2023-07-03 2024-06-19 Display method, mobile terminal, and computer-readable storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202310807236.5 2023-07-03
CN202310807236.5A CN119255108A (zh) 2023-07-03 2023-07-03 显示控制方法、移动终端及计算机可读存储介质

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US19/436,377 Continuation US20260129300A1 (en) 2023-07-03 2025-12-30 Display Method, Mobile Terminal, and Computer-Readable Storage Medium

Publications (1)

Publication Number Publication Date
WO2025007751A1 true WO2025007751A1 (zh) 2025-01-09

Family

ID=94026775

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2024/100202 Ceased WO2025007751A1 (zh) 2023-07-03 2024-06-19 显示方法、移动终端及计算机可读存储介质

Country Status (3)

Country Link
EP (1) EP4716228A1 (zh)
CN (1) CN119255108A (zh)
WO (1) WO2025007751A1 (zh)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009290318A (ja) * 2008-05-27 2009-12-10 Toshiba Corp 撮像装置およびズーム調整方法
CN113191841A (zh) * 2021-04-28 2021-07-30 张鹏 基于增强现实技术的科技创新与文化共享智能平台模式方法
CN113453203A (zh) * 2020-03-26 2021-09-28 华为技术有限公司 一种数据共享和指令操作控制方法及系统
CN113727016A (zh) * 2021-06-15 2021-11-30 荣耀终端有限公司 一种拍摄方法及电子设备
CN115802145A (zh) * 2021-09-08 2023-03-14 华为技术有限公司 拍摄方法及电子设备

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009290318A (ja) * 2008-05-27 2009-12-10 Toshiba Corp 撮像装置およびズーム調整方法
CN113453203A (zh) * 2020-03-26 2021-09-28 华为技术有限公司 一种数据共享和指令操作控制方法及系统
CN113191841A (zh) * 2021-04-28 2021-07-30 张鹏 基于增强现实技术的科技创新与文化共享智能平台模式方法
CN113727016A (zh) * 2021-06-15 2021-11-30 荣耀终端有限公司 一种拍摄方法及电子设备
CN115802145A (zh) * 2021-09-08 2023-03-14 华为技术有限公司 拍摄方法及电子设备

Also Published As

Publication number Publication date
CN119255108A (zh) 2025-01-03
EP4716228A1 (en) 2026-03-25

Similar Documents

Publication Publication Date Title
JP7355941B2 (ja) 長焦点シナリオにおける撮影方法および端末
EP4030276B1 (en) Content continuation method and electronic device
CN114697527B (zh) 一种拍摄方法、系统及电子设备
US12244919B2 (en) Video capturing method and electronic device
WO2021175197A1 (zh) 一种音频处理方法及设备
CN116709021B (zh) 变焦响应方法、电子设备及存储介质
WO2021218325A1 (zh) 视频处理方法、装置、计算机可读介质和电子设备
CN112217990B (zh) 任务调度方法、任务调度装置及存储介质
WO2022143883A1 (zh) 一种拍摄方法、系统及电子设备
CN111316604B (zh) 一种数据传输方法及电子设备
WO2021218318A1 (zh) 视频传输方法、电子设备和计算机可读介质
WO2022042769A2 (zh) 多屏交互的系统、方法、装置和介质
WO2022228259A1 (zh) 一种目标追踪方法及相关装置
EP4120668B1 (en) Video processing method and electronic device
WO2023160224A9 (zh) 一种拍摄方法及相关设备
WO2022156721A1 (zh) 一种拍摄方法及电子设备
CN117560574B (zh) 一种拍摄方法、电子设备和可读存储介质
WO2025007751A1 (zh) 显示方法、移动终端及计算机可读存储介质
WO2025011046A1 (zh) 一种图像送显方法、电子设备、存储介质及芯片
WO2024088074A1 (zh) 拍摄月亮的方法和电子设备
US20260129300A1 (en) Display Method, Mobile Terminal, and Computer-Readable Storage Medium
CN117082339B (zh) 拍摄模式切换方法、装置、电子设备及可读存储介质
WO2025119318A1 (zh) 一种拍摄参数调节方法、电子设备及存储介质
WO2025119320A1 (zh) 一种拍摄参数调节方法、电子设备及存储介质
CN118377401A (zh) 窗口操作方法及电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24835234

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2024835234

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2024835234

Country of ref document: EP

Effective date: 20251219

ENP Entry into the national phase

Ref document number: 2024835234

Country of ref document: EP

Effective date: 20251219

ENP Entry into the national phase

Ref document number: 2024835234

Country of ref document: EP

Effective date: 20251219

ENP Entry into the national phase

Ref document number: 2024835234

Country of ref document: EP

Effective date: 20251219

ENP Entry into the national phase

Ref document number: 2024835234

Country of ref document: EP

Effective date: 20251219

ENP Entry into the national phase

Ref document number: 2024835234

Country of ref document: EP

Effective date: 20251219

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2024835234

Country of ref document: EP

Effective date: 20251219

WWP Wipo information: published in national office

Ref document number: 2024835234

Country of ref document: EP