WO2023160179A1 - Magnification switching method and magnification switching apparatus - Google Patents

Abstract

Provided in the present application are a magnification switching method and a magnification switching apparatus, which are conducive to realizing smooth transition of a preview image during a click-switching operation for a magnification, thereby improving the zooming effect of a terminal device. The method comprises: displaying a first preview image under a first magnification that is acquired by a camera; in response to a selection operation of a user for a second magnification, displaying L frames of preview images corresponding to L transition magnifications, wherein the L transition magnifications comprise L magnifications between the first magnification and the second magnification, L ≥ 1 and being an integer; and displaying a second preview image under the second magnification that is acquired by the camera.

Description

Magnification switching method and magnification switching device

This application claims the priority of the Chinese patent application with the application number 202210178265.5 and the application name "magnification switching method and magnification switching device" submitted to the China Patent Office on February 24, 2022, the entire content of which is incorporated in this application by reference .

technical field

The present application relates to the field of terminals, and more specifically, to a magnification switching method and a magnification switching device.

Background technique

With the continuous development of terminal technology, users can realize more and more camera functions through terminal devices (for example, mobile phones). For example, a camera realizes a zoom function through magnification switching.

For example, the user starts to preview shooting at the first magnification (for example, 1x) through the camera, and if the user wants to take pictures of distant objects through the terminal device, then the user can click the magnification icon of the second magnification (for example, 5x) to Perform magnification switching, and preview shooting at the second magnification after switching.

However, after the magnification switching operation occurs, the field of view (FOV) of the camera jumps directly from the first magnification to the second magnification, and the user will see that the preview image at the first magnification directly jumps to the second magnification. The preview image under the double magnification will have the problem that the transition of the preview image is blunt, which makes the zoom effect of the terminal device poor and reduces the user experience.

Contents of the invention

The present application provides a magnification switching method and a magnification switching device, which are beneficial to realize a smooth transition of a preview image under a click switching operation of a magnification, and improve the zoom effect of a terminal device.

In a first aspect, a magnification switching method is provided, which is applied to a terminal device equipped with a camera, and the method includes: displaying a first preview image obtained by the camera at a first magnification. In response to the user's selection operation on the second magnification, L frames of preview images corresponding to L transition magnifications are displayed, and the L transition magnifications include L magnifications between the first magnification and the second magnification, and L≥1 and is an integer . Displaying the second preview image acquired by the camera under the second magnification.

In this application, before the user selects the second magnification, the terminal device may obtain the first preview image at the first magnification. After the user selects the second magnification, the terminal device can display L frames of preview images according to L transitional magnifications before displaying the second preview image. In this way, before switching from the first preview image to the second preview image, L The frame is used for the transition preview image, which can make the preview image displayed on the terminal device transition smoothly, which is beneficial to improving the zoom effect of the terminal device and improving the user experience.

With reference to the first aspect, in some implementations of the first aspect, before displaying L frames of preview images corresponding to L transitional magnifications in response to the user's selection operation on the second magnification, the method further includes: based on the first The magnification and the second magnification determine L transitional magnifications.

In combination with the first aspect, in some implementations of the first aspect, determining L transition magnifications based on the first magnification and the second magnification includes: The switching duration between frames and the time interval between adjacent frames determine L transition magnifications.

In this application, the terminal device can determine L transitional magnifications based on the switching duration between the first magnification and the second magnification, and the time interval between adjacent frames, which is conducive to completing the transition from the first magnification within the switching duration. Smooth transition to second magnification.

With reference to the first aspect, in some implementations of the first aspect, determining L transitional magnifications based on the first magnification and the second magnification includes: based on the first magnification, the second magnification, and a preset preview The number of image frames determines the L transition magnifications.

With reference to the first aspect, in some implementation manners of the first aspect, the camera of the terminal device includes a first camera and a second camera, the first preview image is from the first camera, and the second preview image is from the the second camera. The method also includes: turning on the second camera. The images are acquired by the first camera and the second camera, wherein the images acquired by the first camera and the second camera at the same time node are captured based on the same transition magnification. When the difference between the quality of the Mth frame image from the second camera and the quality of the Nth frame image from the first camera is less than or equal to the preset threshold, the first camera is turned off, and the preview image displayed before the first camera is turned off from the first camera. Wherein, the Nth frame of image from the first camera is taken at the same time point and based on the same magnification as the Mth frame of image from the second camera, N≥M≥1, and N and M are integers.

For example, the second camera and the first camera can acquire images based on the first magnification at the same time point, but the terminal device displays the first preview image from the first camera, and the terminal device can acquire images based on the first magnification by the second camera The second camera was turned on before, in this case, M=N.

Exemplarily, the terminal device may use the first camera to acquire an image based on the first magnification, and display the first preview image from the first camera. After that, the terminal device can turn on the second camera, acquire images at the same time point based on the same transition magnification through the first camera and the second camera, and display the preview image from the first camera until the Mth image from the second camera The difference between the quality of the frame image and the quality of the Nth frame image from the first camera is less than or equal to a preset threshold, and the first camera is turned off. In this case, M≠N.

In this application, the terminal device can output images in two ways through the first camera and the second camera, and turn off the first camera at an appropriate time. From turning on the second camera to turning off the first camera, the first camera and the second camera are realized. The soft switching between is beneficial to get a preview image with a smoother transition.

In a second aspect, a magnification switching device is provided, including an acquisition module and a processing module. Wherein, the acquiring module is used to: acquire the first preview image under the first magnification; and acquire the second preview image under the second magnification. The processing module is used to: display the first preview image acquired by the camera at the first magnification; in response to the user's selection operation on the second magnification, display L frames of preview images corresponding to L transition magnifications, and the L transition magnifications include L magnifications between the first magnification and the second magnification, L≥1 and an integer; and displaying the second preview image acquired by the camera at the second magnification.

With reference to the second aspect, in some implementation manners of the second aspect, the processing module is configured to: determine L transitional magnifications based on the first magnification and the second magnification.

With reference to the second aspect, in some implementations of the second aspect, the processing module is configured to: based on the first magnification, the second magnification, the switching duration between the first magnification and the second magnification, and the time between adjacent frames time interval to determine L transition magnifications.

With reference to the second aspect, in some implementation manners of the second aspect, the processing module is configured to: determine L transitional magnifications based on the first magnification, the second magnification, and the preset preview image frame number.

With reference to the second aspect, in some implementation manners of the second aspect, the camera includes a first camera and a second camera, the first preview image is from the first camera, and the second preview image is from the second camera. The processing module is used to: turn on the second camera. The acquiring module is used for: acquiring images through the first camera and the second camera, wherein the images acquired by the first camera and the second camera at the same time node are based on the same transition magnification. The processing module is also used for: when the difference between the quality of the Mth frame of image from the second camera and the quality of the Nth frame of image from the first camera is less than or equal to the preset threshold, turn off the first camera, and turn off the first The preview image shown before the camera is from the first camera. Wherein, the Nth frame of rabbit food from the first camera and the Mth frame of images from the second camera are captured at the same time node and based on the same magnification, N≥M≥1, and N and M are integers.

In a third aspect, another magnification switching device is provided, including a processor, the processor is coupled to a memory, and can be used to execute instructions in the memory, so as to implement the method in any possible implementation manner of the first aspect above. Optionally, the device further includes a memory. Optionally, the device further includes a communication interface, and the processor is coupled to the communication interface.

In an implementation manner, the ratio switching device is a terminal device. When the magnification switching device is a terminal device, the communication interface may be a transceiver, or an input/output interface.

In another implementation manner, the magnification switching device is a chip configured in a terminal device. When the magnification switching device is a chip configured in the terminal device, the communication interface may be an input/output interface.

In a fourth aspect, a processor is provided, including: an input circuit, an output circuit, and a processing circuit. The processing circuit is configured to receive a signal through the input circuit and transmit a signal through the output circuit, so that the processor executes the method in any possible implementation manner of the first aspect above.

In a specific implementation process, the above-mentioned processor can be a chip, the input circuit can be an input pin, the output circuit can be an output pin, and the processing circuit can be a transistor, a gate circuit, a flip-flop, and various logic circuits. The input signal received by the input circuit may be received and input by, for example but not limited to, the receiver, the output signal of the output circuit may be, for example but not limited to, output to the transmitter and transmitted by the transmitter, and the input circuit and the output The circuit may be the same circuit, which is used as an input circuit and an output circuit respectively at different times. The present application does not limit the specific implementation manners of the processor and various circuits.

In a fifth aspect, a processing device is provided, including a processor and a memory. The processor is used to read instructions stored in the memory, and may receive signals through the receiver and transmit signals through the transmitter, so as to execute the method in any possible implementation manner of the first aspect above.

Optionally, there are one or more processors, and one or more memories.

Optionally, the memory may be integrated with the processor, or the memory may be separated from the processor.

In the specific implementation process, the memory can be a non-transitory (non-transitory) memory, such as a read-only memory (read only memory, ROM), which can be integrated with the processor on the same chip, or can be set in different On the chip, the application does not limit the type of the memory and the arrangement of the memory and the processor.

It should be understood that a related data interaction process such as sending indication information may be a process of outputting indication information from a processor, and receiving capability information may be a process of receiving input capability information from a processor. In particular, processed output data may be output to the transmitter, and input data received by the processor may be from the receiver. Among them, the transmitter and receiver can be collectively referred to as a transceiver.

The processing device in the fifth aspect above can be a chip, and the processor can be implemented by hardware or by software. When implemented by hardware, the processor can be a logic circuit, an integrated circuit, etc.; when implemented by software When implemented, the processor may be a general-purpose processor, which is realized by reading the software code stored in the memory, and the memory may be integrated in the processor, or it may be located outside the processor and exist independently.

In a sixth aspect, a computer program product is provided, and the computer program product includes: computer program code, when the computer program code is executed, the computer is made to execute the method in any possible implementation manner of the above first aspect.

In a seventh aspect, a computer-readable storage medium is provided, the computer-readable storage medium stores a computer program, and when the computer program is executed, the computer executes the method in any possible implementation manner of the above-mentioned first aspect .

Description of drawings

FIG. 1 is a schematic diagram of an interface of a terminal device;

Fig. 2 is a schematic diagram of the drawing principle of a point-cut operation;

Fig. 3 is a schematic flow chart of a drawing method of a point-cut operation;

FIG. 4 is a schematic structural diagram of a terminal device applicable to an embodiment of the present application;

FIG. 5 is a software structural block diagram of a terminal device applicable to an embodiment of the present application;

Fig. 6 is a schematic diagram of the drawing principle of a point-cut operation provided by the embodiment of the present application;

FIG. 7 is a schematic flowchart of a method for switching magnification provided by an embodiment of the present application;

Fig. 8 is a schematic flowchart of another magnification switching method provided by the embodiment of the present application;

FIG. 9 is a schematic flow chart of yet another magnification switching method provided by an embodiment of the present application;

FIG. 10 is a schematic diagram of an interface of a terminal device provided in an embodiment of the present application;

Fig. 11 is a schematic block diagram of a magnification switching device provided by an embodiment of the present application;

Fig. 12 is a schematic block diagram of another magnification switching device provided by an embodiment of the present application.

Detailed ways

The technical solution in this application will be described below with reference to the accompanying drawings.

In the Android (Android) ecosystem, a user may use a camera application (Application, APP) of a terminal device to perform a click switching (may be referred to as a point cut) operation of a magnification. Therefore, it is a common usage scenario to be able to shoot objects at different distances, which improves the richness of the shooting scene.

FIG. 1 is a schematic diagram of an interface of a terminal device. Taking the terminal device as an example of a mobile phone, Figure 1 shows interface a, interface b, and interface c of the mobile phone, where interface a shows multiple applications in the mobile phone, for example, the user can click the camera icon to open the camera application Take a photo. After the user clicks the camera application, the mobile phone displays interface b, where interface b is a shooting interface. Exemplarily, interface b includes a plurality of magnification icons, the current camera magnification is 1x, and the user can click on different magnification icons to switch between different magnifications. Exemplarily, the user clicks the magnification icon of 5x, and the mobile phone can display the interface c. In the interface c, the magnification has been switched to 5x, and the mobile phone can obtain a preview image at the magnification of 10x.

Before the point-and-click operation shown in Figure 1, the mobile phone can display a preview image of the object to be photographed in interface b at a magnification of 1x through the camera, and the field of view (FOV) of the camera is maintained at 1x. After the user clicks the 5x magnification icon, the mobile phone can display the preview image of the object to be photographed in the c interface at a 5x magnification through the camera, and the FOV of the camera is maintained at 10x.

Fig. 2 is a schematic diagram of the drawing principle of a point-cut operation. Taking the terminal device as a mobile phone as an example, in FIG. 2 , the camera of the mobile phone may include a main camera lens and a telephoto lens. Before the user performs a point-and-click operation, the FOV of the main camera lens is maintained at a magnification of 1x to continuously output the image to obtain a preview image, and the preview image is displayed on the display. For example, when the user clicks the magnification icon of 10x to switch the magnification at the moment of point-cutting as shown in Figure 2, the mobile phone can switch from the main camera lens to the telephoto lens, and the FOV of the telephoto lens remains at the magnification of 10x continuously. The switched preview image is obtained by outputting the image, and the switched preview image is displayed on the display screen.

FIG. 3 is a schematic flowchart of a drawing method 300 for a point cut operation. Method 300 includes the following steps:

S301, the first camera produces images at the first magnification and sends them to display.

S302, in response to the user's click operation, the camera application sends a magnification switching request message to the hardware abstraction layer (hardware abstraction layer, HAL), the magnification switching request message is used to request switching from the first magnification to the second magnification, the magnification switching The request message includes the second magnification. Correspondingly, the hardware abstraction layer receives the magnification switching request message.

S303. The hardware abstraction layer sends a camera shutdown request message to the first camera, where the camera shutdown request message is used to request shutdown of the first camera. Correspondingly, the first camera receives the camera shutdown request message.

S304, the first camera is turned off and stops working.

S305. The hardware abstraction layer sends a camera startup request message to the second camera, where the camera startup request message is used to request startup of the second camera, and the camera startup request message includes a second magnification. Correspondingly, the second camera receives the camera start request message.

S306, the second camera is started, and a picture is drawn at the second magnification and sent for display.

Wherein, outputting a picture means obtaining a preview image of an object captured by the camera, and sending a display means displaying a preview image on a display screen. More specifically, the preview image can be displayed in a preview view frame built by the camera application.

It should be understood that during the point cut operation shown in FIG. 3 , after the point cut operation occurs, the FOV of the camera directly jumps from the first magnification (which may be 1x in the above-mentioned FIG. 1 or FIG. 2 ) to the second magnification ( It can be 5x in the above-mentioned Figure 1 or 10x in Figure 2), which will cause the preview image seen by the user to jump, and the transition is relatively blunt, so that the zoom effect of the camera application is poor, and the user experience is not good.

In view of this, the embodiment of the present application provides a magnification switching method and a magnification switching device. When the user uses the camera application of the terminal device to take pictures and preview, the terminal device can introduce a multi-frame transition preview image in the process of magnification point-cutting to realize the magnification. The smooth transition of the preview image when clicking and cutting is beneficial to improve the zoom effect of the camera application, thereby improving the user experience.

Before introducing the magnification switching method and the magnification switching device provided in the embodiments of the present application, the following points are explained first.

First, in the embodiments shown below, various terms and English abbreviations, such as preview image, magnification switching request message, main camera lens, telephoto lens, etc., are illustrative examples given for convenience of description, and are not Nothing should be construed as a limitation of this application. This application does not exclude the possibility of defining other terms that can achieve the same or similar functions in existing or future agreements.

Second, in the embodiments shown below, the first, second and various numbers are only for the convenience of description, and are not used to limit the scope of the embodiments of the present application. For example, distinguish between different preview images, different cameras, etc.

Third, "at least one" means one or more, and "multiple" means two or more. "And/or" describes the association relationship of associated objects, indicating that there may be three types of relationships, for example, A and/or B, which can mean: A exists alone, A and B exist at the same time, and B exists alone, where A, B can be singular or plural. The character "/" generally indicates that the contextual objects are an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one (one) of a, b and c may represent: a, or b, or c, or a and b, or a and c, or b and c, or a, b and c, wherein a, b, c can be single or multiple.

The terminal device in the embodiment of the present application may be a handheld device with a wireless connection function, a vehicle-mounted device, etc., and the terminal device may also be called a terminal (terminal), user equipment (user equipment, UE), mobile station (mobile station, MS ), mobile terminal (mobile terminal, MT), etc. At present, examples of some terminals are: mobile phone (mobile phone), tablet computer, smart TV, notebook computer, tablet computer (Pad), handheld computer, mobile Internet device (mobile internet device, MID), virtual reality (virtual reality, VR ) equipment, augmented reality (augmented reality, AR) equipment, wireless terminals in industrial control (industrial control), wireless terminals in self-driving (selfdriving), wireless terminals in remote medical surgery (remote medical surgery), smart grid ( Wireless terminals in smart grid, wireless terminals in transportation safety, wireless terminals in smart city, wireless terminals in smart home, cellular phones, cordless phones, session initiation protocol (session initiation protocol, SIP) telephones, wireless local loop (wireless local loop, WLL) stations, personal digital assistants (personal digital assistant, PDA), handheld devices with wireless communication capabilities, computing devices, or other devices connected to wireless modems Processing equipment, vehicle-mounted equipment, wearable equipment, terminal equipment in the 5G network or terminal equipment in the public land mobile communication network (public land mobile network, PLMN) that will evolve in the future, etc., the embodiment of the present application adopts for the terminal equipment The specific technology and specific equipment form are not limited.

As an example but not a limitation, in this embodiment of the present application, the terminal device may also be a wearable device. Wearable devices can also be called wearable smart devices, which is a general term for the application of wearable technology to intelligently design daily wear and develop wearable devices, such as glasses, gloves, watches, clothing and shoes. A wearable device is a portable device that is worn directly on the body or integrated into the user's clothing or accessories. Wearable devices are not only a hardware device, but also achieve powerful functions through software support, data interaction, and cloud interaction. Generalized wearable smart devices include full-featured, large-sized, complete or partial functions without relying on smart phones, such as smart watches or smart glasses, etc., and only focus on a certain type of application functions, and need to cooperate with other devices such as smart phones Use, such as various smart bracelets and smart jewelry for physical sign monitoring.

It should be understood that, in this embodiment of the present application, the terminal device may be a device for realizing the function of the terminal device, or may be a device capable of supporting the terminal device to realize the function, such as a chip system, and the device may be installed in the terminal. In the embodiment of the present application, the system-on-a-chip may be composed of chips, or may include chips and other discrete devices.

The terminal equipment in the embodiment of the present application may also be referred to as: user equipment (user equipment, UE), mobile station (mobile station, MS), mobile terminal (mobile terminal, MT), access terminal, subscriber unit, subscriber station, Mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication device, user agent or user device, etc.

FIG. 4 is a schematic structural diagram of a terminal device to which this embodiment of the present application applies. As shown in Figure 4, the terminal device 400 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charging management module 140, a power management module 141, Battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor 180, button 190, motor 191, indicator 192, camera 193, a display screen 194, and a subscriber identification module (subscriber identification module, SIM) card interface 195, etc. It can be understood that, the structure shown in this embodiment does not constitute a specific limitation on the terminal device 400 . In other embodiments of the present application, the terminal device 400 may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, display processing unit (display process unit, DPU), and/or neural network processor (neural-network processing unit, NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors. In some embodiments, the terminal device 400 may also include one or more processors 110 . Wherein, the processor may be the nerve center and command center of the terminal device 400 . The processor can generate an operation control signal according to the instruction opcode and the timing signal, and complete the control of fetching and executing the instruction. A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. The memory may hold instructions or data used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the terminal device 400.

In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transmitter (universal asynchronous receiver/transmitter, UART) interface, mobile industry processor interface (mobile industry processor interface, MIPI), general-purpose input and output (general-purpose input/output, GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and /or USB interface, etc. Wherein, the USB interface 130 is an interface conforming to the USB standard specification, specifically, it may be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like. The USB interface 130 can be used to connect a charger to charge the terminal device 400, and can also be used to transmit data between the terminal device 400 and peripheral devices. It can also be used to connect headphones and play audio through them.

It can be understood that the interface connection relationship between the modules shown in the embodiment of the present application is a schematic description, and does not constitute a structural limitation of the terminal device 400 . In other embodiments of the present application, the terminal device 400 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.

The wireless communication function of the terminal device 400 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like. Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in terminal device 400 can be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example: Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G applied on the terminal device 400 . The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier and the like. The mobile communication module 150 can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signals modulated by the modem processor, and convert them into electromagnetic waves and radiate them through the antenna 1 . In some embodiments, at least part of the functional modules of the mobile communication module 150 may be set in the processor 110 . In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be set in the same device.

A modem processor may include a modulator and a demodulator. Wherein, the modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator sends the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal is passed to the application processor after being processed by the baseband processor. The application processor outputs sound signals through audio equipment (not limited to speaker 170A, receiver 170B, etc.), or displays images or videos through display screen 194 . In some embodiments, the modem processor may be a stand-alone device. In some other embodiments, the modem processor may be independent from the processor 110, and be set in the same device as the mobile communication module 150 or other functional modules.

The wireless communication module 160 can provide wireless local area networks (wireless local area networks, WLAN), Bluetooth, global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), NFC, Solutions for wireless communication such as infrared technology (infrared, IR). The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 . The wireless communication module 160 can also receive the signal to be sent from the processor 110 , frequency-modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.

In some embodiments, the antenna 1 of the terminal device 400 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the terminal device 400 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include GSM, GPRS, CDMA, WCDMA, TD-SCDMA, LTE, GNSS, WLAN, NFC, FM, and/or IR technology and the like. The above-mentioned GNSS may include global positioning system (global positioning system, GPS), global navigation satellite system (global navigation satellite system, GLONASS), Beidou satellite navigation system (bei dou navigation satellite system, BDS), quasi-zenith satellite system (quasi -zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).

The terminal device 400 can implement a display function through the GPU, the display screen 194 and the application processor. Application processors may include NPUs and/or DPUs. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute instructions to generate or alter display information. The NPU is a neural-network (NN) computing processor. By referring to the structure of biological neural networks, such as the transfer mode between neurons in the human brain, it can quickly process input information and continuously learn by itself. Applications such as intelligent cognition of the terminal device 400 can be implemented through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like. DPU is also called display sub-system (display sub-system, DSS), and DPU is used for adjusting the color of display screen 194, and DPU can adjust the color of display screen through color three-dimensional lookup table (3D look up table, 3D LUT). Adjustment. DPU can also perform image scaling, noise reduction, contrast enhancement, backlight brightness management, hdr processing, display parameter Gamma adjustment and other processing.

The display screen 194 is used to display images, videos and the like. The display screen 194 includes a display panel. The display panel can adopt liquid crystal display (liquid crystal display, LCD), organic light-emitting diode (organic light-emitting diode, OLED), active-matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light emitting diode (AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed or quantum dot light emitting diodes (quantum dot light emitting diodes, QLED). In some embodiments, the terminal device 400 may include 1 or N display screens 194, where N is a positive integer greater than 1.

The terminal device 400 may realize the shooting function through an ISP, one or more cameras 193 , a video codec, a GPU, one or more display screens 194 , and an application processor.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device 400. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, save data files such as music, photos, videos, etc. in the external memory card.

The internal memory 121 may be used to store one or more computer programs including instructions. The processor 110 may execute the above-mentioned instructions stored in the internal memory 121, so that the terminal device 400 executes various functional applications, data processing, and the like. The internal memory 121 may include an area for storing programs and an area for storing data. Wherein, the stored program area can store an operating system; the stored program area can also store one or more application programs (such as a gallery, contacts, etc.) and the like. The storage data area can store data created during the use of the terminal device 400 (such as photos, contacts, etc.) and the like. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like. In some embodiments, the processor 110 can cause the terminal device 400 to execute various functional applications and data processing by executing instructions stored in the internal memory 121 and/or instructions stored in the memory provided in the processor 110 .

The terminal device 400 may implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. Such as music playback, recording, etc. Wherein, the audio module 170 is used for converting digital audio information into analog audio signal output, and is also used for converting analog audio input into digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be set in the processor 110 , or some functional modules of the audio module 170 may be set in the processor 110 . Speaker 170A, also referred to as a "horn", is used to convert audio electrical signals into sound signals. The terminal device 400 can listen to music through the speaker 170A, or listen to hands-free calls. Receiver 170B, also called "earpiece", is used to convert audio electrical signals into sound signals. When the terminal device 400 answers a phone call or voice information, the receiver 170B can be placed close to the human ear to listen to the voice. The microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can put his mouth close to the microphone 170C to make a sound, and input the sound signal to the microphone 170C. The terminal device 400 may be provided with at least one microphone 170C. In some other embodiments, the terminal device 400 may be provided with two microphones 170C, which may also implement a noise reduction function in addition to collecting sound signals. In some other embodiments, the terminal device 400 can also be provided with three, four or more microphones 170C, so as to collect sound signals, reduce noise, identify sound sources, and realize directional recording functions, etc. The earphone interface 170D is used for connecting wired earphones. The earphone interface 170D may be a USB interface 130, or a 3.5mm open mobile terminal platform (open mobile terminal platform, OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard. interface.

The sensors 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and an ambient light sensor 180L , bone conduction sensor 180M and so on.

The software system of the terminal device 400 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In this embodiment of the present application, an Android system with a layered architecture is taken as an example to illustrate the software structure of the terminal device 400 .

Fig. 5 is a block diagram of a software structure of a terminal device applicable to the embodiment of the present application. The layered architecture divides the software system of the terminal device 400 into several layers, and each layer has a clear role and division of labor. Layers communicate through software interfaces. In some embodiments, the Android system can be divided into application program layer (application, APP), application program framework layer (application framework), Android runtime (Android runtime) and system library, hardware abstraction layer (hardware abstraction layer, HAL) ) and the kernel layer (kernel). In some embodiments, the terminal device 400 further includes hardware (for example, a camera, a display screen).

The application program layer may include a series of application program packages, and the application program layer runs the application program by calling an application program interface (application programming interface, API) provided by the application program framework layer. As shown in FIG. 5 , the application package may include application programs such as camera, calendar, map, phone, music, WLAN, Bluetooth, video, social, gallery, navigation, and short message.

The application framework layer provides API and programming framework for applications in the application layer. The application framework layer includes some predefined functions. The framework layer provides programming services (for example, camera services, media services) to the application layer through the API interface. As shown in Figure 5, the application framework layer may include a window manager, a content provider, a resource manager, a notification manager, a view system, a phone manager, and the like.

A window manager is used to manage window programs. The window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc.

Content providers are used to store and retrieve data and make it accessible to applications. Data can include video images, audio, calls made and received, browsing history and bookmarks, phonebook, etc. The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on.

The view system can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.

The phone manager is used to provide the communication function of the terminal device 400 . For example, the management of call status (including connected, hung up, etc.).

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, etc.

The notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify the download completion, message reminder and so on. The notification manager can also be a notification that appears on the top status bar of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is issued, the terminal device 400 vibrates, and the indicator light flashes.

The Android runtime includes core libraries and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system. The core library consists of two parts: one part is the functions that the java language used by the java API framework needs to call, and the other part is the core library of Android. The application layer and the application framework layer run in virtual machines. The virtual machine executes the java files of the application program layer and the application program framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection. A system library can include multiple function modules. For example: surface manager (surface manager), media library (media libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.

The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of various commonly used audio and video formats, as well as still image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing and layer processing, etc. 2D graphics engine is a drawing engine for 2D drawing.

The hardware abstraction layer is an abstract interface driven by the device kernel, which provides an application program interface for accessing the underlying device to the higher-level java API framework. A hardware abstraction layer can include multiple library modules, each of which can implement an interface for a specific type of hardware component, for example, a camera interface, etc. When a framework API requires access to device hardware, the Android system will load library modules for that hardware component. Exemplarily, as shown in FIG. 5 , the library module includes a clipping control module and a multi-camera control module.

In the embodiment of this application, after the camera application responds to the user's magnification point cut (switching from the first magnification to the second magnification) operation, the cutting control module is used to determine the magnification interval, and obtain the distance between the first magnification and the second magnification. Multiple transition ratios between. The multi-camera control module is used to start or stop cameras, and to switch between cameras.

The kernel layer is the layer between hardware and software. The kernel layer is used to drive the hardware and make the hardware work. Exemplarily, as shown in FIG. 5 , the kernel layer includes a camera driver.

The hardware layer includes a camera module and a display screen, wherein the camera module includes at least one camera.

It should be understood that the terminal device in this embodiment of the present application may have the architecture shown in FIG. 4 and/or FIG. 5 above, but this is not limited in this embodiment of the present application.

In a possible scenario, the camera module of the terminal device includes a first camera and a second camera, and the switching between the first camera and the second camera may be involved in the process of the magnification point cut operation. The first camera and the second camera provide a richer video and camera experience. The magnification click switching process in this scenario will be introduced below with reference to FIG. 6 and FIG. 7 .

FIG. 6 is a schematic diagram of a drawing principle of a point cutting operation provided by an embodiment of the present application. Taking the terminal device including a first camera (for example, a main camera lens) and a second camera (for example, a telephoto lens) as an example, in FIG. The FOV is maintained at 1x magnification to acquire images, and a preview image is displayed on the display.

For example, at the moment of point cut as shown in Figure 6, the user clicks the 10x magnification icon to switch between magnifications. After the point cut operation occurs, the terminal device can determine the magnification interval, between the first magnification and the second magnification Carry out gear division to get multiple transition magnifications between 1x and 10x. As shown in Figure 6, taking the magnification interval of 0.5x as an example, the multiple transition magnifications that the terminal device can obtain after 1x include: 1.5x, 2x, 2.5x, 3x, 3.5x, 4x, 4.5x, 5x, 5.5 x, 6x, 6.5x, 7x, 7.5x, 8x, 8.5x, 9x, 9.5x. The cameras (the first camera and/or the second camera) of the terminal device can sequentially obtain images according to the order of multiple transition magnifications from small to large, until the terminal device obtains and displays the preview image under 10x, and completes the smooth transition of the preview image.

Exemplarily, as shown in FIG. 6 , the terminal device may start the second camera before acquiring the preview image at the first transitional magnification (1.5x) after the user's click operation on the second magnification occurs.

As shown in Figure 6, in response to the user’s operation of switching from the magnification point of 1x to 10x, the terminal device first determines that the magnification interval is 0.5x, and then the terminal device determines that the next magnification after 1x is 1.5x, and the terminal device can transition between magnifications. Start the second camera to get a preview image before going to 1.5x. After starting the second camera, for the first camera, the first camera can sequentially acquire multi-frame transition preview images under 1.5x, 2x, 2.5x, 3x, 3.5x, and 4x, and display them in the preview view box in sequence Multi-frame transition preview image. For the second camera, the second camera can sequentially acquire multiple frames of images at 1.5x, 2x, 2.5x, 3x, 3.5x, and 4x, but these multiple frames of images are not displayed in the preview view box.

When the magnification transitions to 4.5x, if the difference between the quality of the image captured by the second camera at 4.5x magnification and the quality of the image captured by the first camera at 4.5x magnification is less than or equal to the preset threshold, then the terminal The device can stop the first camera after displaying the preview image captured by the first camera at a magnification of 4.5x, and switch to the second camera to capture 5x, 5.5x, 6x, 6.5x, 7x, 7.5x, 8x, 8.5x, Multi-frame images under 9x and 9.5x, and display multi-frame preview images in the preview view box in turn.

In the embodiment of this application, the terminal device can obtain preview images under multiple transition magnifications by determining the magnification interval, and display them in the preview view box in turn, so that a smooth transition from 1x point cut to 10x can be achieved. In the preview view A smooth transition preview image is displayed in the frame to improve the zoom effect of the terminal device.

In addition, after the point-cut operation occurs, the terminal device can start the second camera to realize two-way image output from the first camera and the second camera, which is conducive to realizing soft switching between the first camera and the second camera and alleviating differences in switching. The problem of the abrupt transition of the preview image caused by the camera has improved the zoom effect of the terminal device in different camera switching scenarios.

The magnification switching method of the embodiment of the present application will be described below with reference to FIG. 7 by using the operations performed by each layer in the layered architecture.

FIG. 7 is a schematic flowchart of a magnification switching method 700 provided by an embodiment of the present application. The steps of the method 700 can be executed by the above-mentioned terminal device 400, the camera module of the terminal device 400 can include a first camera and a second camera, and the hardware abstraction layer of the terminal device 400 includes a clipping control module and a multi-camera control module, but this application The embodiment does not limit this. Method 700 includes the steps of:

For S701, the first camera produces images at the first magnification and sends them to display.

S702, in response to the user's point-and-click operation, the camera application sends a magnification switching request message to the cutting control module, the magnification switching request message is used to request switching from the first magnification to the second magnification, and the magnification switching request message includes the first magnification and second magnification. Correspondingly, the cutting control module receives the magnification switching request message.

S703, the cutting control module determines the magnification interval according to preset parameters.

Exemplarily, the preset parameters include a preset switching duration or a preset number of preview image frames. Wherein, the switching duration indicates the time limit for the terminal device to switch from the preview view at the first magnification to the preview image at the second magnification in the preview view frame after the user performs the magnification click operation. The number of frames of the preview image indicates the number of frames of the preview image used for transition required for the terminal device to display the preview image at the second magnification in the preview view frame.

Exemplarily, the switching time is 0.1s, and the transition time between preview images at adjacent transition magnifications is 0.02s. If you want to switch from 1x to 5x, you can complete the transition of preview images up to 5 times within 1s, then The terminal device can determine the magnification interval as 1x, and realize the transition from 1x, 2x, 3x, 4x, to 5x, and the sharing time is 0.08s. The terminal device can also determine that the magnification interval is 2x, firstly the transition from 1x, 3x to 5x takes 0.04s.

Exemplarily, the number of frames of the preview image is 3 frames. If it is necessary to switch from 1x to 5x, then the terminal device can determine the magnification interval as 1x to realize the transition from 1x, 2x, 3x, 4x, until 5x, which is used for the preview of the transition The frame number of the image is 3 frames.

Exemplarily, the number of preview image frames is 7 frames, and the terminal device can also determine the magnification interval as 0.5x to realize the transition from 1x, 1.5x, 2x, 2.5x, 3x, 3.5x, 4x, 4.5x to 5x, using The number of frames of the preview image for the transition is 7 frames.

It should be understood that, in order to obtain a smoother transition effect, the terminal device may determine a finer magnification interval, and the specific value of the magnification interval in this embodiment of the present application is not limited.

S704, the cutting control module determines the transition magnification according to the magnification interval.

S705. The multi-camera control module sends a camera keeping request message to the first camera, where the camera keeping request message is used to request the first camera to keep on, and the camera keeping request message may include a transition magnification. Correspondingly, the first camera receives the camera keeping request message.

S706, the first camera continues to be turned on to obtain a preview image at a transitional magnification.

S707. The first camera sends the preview image under the transition magnification to the camera application. Accordingly, the camera application receives the preview image.

S708. The camera application displays the preview image under the transition magnification in the preview view frame.

It should be understood that before switching from the first camera to the second camera, what the camera application displays in the preview view frame is the preview image obtained by the first camera. After switching from the first camera to the second camera, what the camera application displays in the preview view frame is the preview image obtained by the second camera.

S709, the multi-camera control module sends a camera startup request message to the second camera, where the camera startup request message is used to request startup of the second camera, and the camera startup request message may include a transition magnification. Correspondingly, the second camera receives the camera start request message.

On S710, the second camera is turned on to obtain a preview image at a transitional magnification.

The above S704 to S710 are repeatedly executed until the preview images obtained by the first camera and the second camera at the target transition magnification meet the preset condition, and the following steps S711 to S715 are executed.

Optionally, the preset condition may include: the difference between the quality of the image obtained by the second camera at the target transition magnification and the quality of the image obtained by the first camera at the target transition magnification is less than or equal to a preset threshold.

Exemplarily, the peak signal-to-noise ratio (peak signal-to-noise ratio, PSNR) of the image is used as the evaluation indicator for evaluating the quality of the image, if the preset threshold is 5dB, the second camera obtains the image under the target transition magnification The PSNR is 40dB, the PSNR of the image obtained by the first camera at the target transition magnification is 43dB, and the difference is 3dB<5dB, then the multi-camera control module can control the first camera to turn off, switch to the second camera to continuously acquire images and display them in the preview view A preview image is displayed in the box.

Taking the magnification interval as 0.5x, the first magnification as 1x, the second magnification as 10x, and the target magnification as 5x as an example, for S704, the cutting control module can determine the first transition magnification after the first magnification 1x according to the magnification interval as 1.5x, then the first camera gets the preview image at 1.5x and sends it to the camera app to display the preview image at 1.5x in the preview view box, the second camera also gets the preview image at 1.5x but not in the preview view box show. Afterwards, the clipping control module can determine the transition magnification after 1.5x to be 2x according to the magnification interval, and then the first camera obtains the preview image at 2x and sends it to the camera application to display the preview image at 2x in the preview view box, and the second The camera also obtains the preview image under 2x but does not display it in the preview view box. In this way, the first camera obtains and displays the transition magnification in turn in the preview view box (2.5x, 3x, 3.5x, 4x, 4.5x, 5x ), the second camera sequentially acquires the preview images under the subsequent transition magnifications (2.5x, 3x, 3.5x, 4x, 4.5x, 5x), but they are not displayed in the preview view box.

Exemplarily, the mean square error (mean square error, MSE), signal-to-noise ratio (signal-to-noise ratio, SNR) or mean absolute error (mean absolute error, MAE) of the image can also be used as the quality of the evaluation image The evaluation index is not limited in this embodiment of the present application.

S711. The multi-camera control module sends a camera shutdown request message to the first camera, where the camera shutdown request message is used to request to turn off the first camera. Correspondingly, the first camera receives the camera shutdown request message.

S712, the first camera is turned off and stops working.

S713. The second camera acquires a preview image at a transition magnification after the target transition magnification.

S714. The second camera sends a preview image at a transition magnification after the target transition magnification to the camera application, and accordingly, the camera application receives the preview image.

For S711 to S714, the first camera is closed, and the second camera continues to output pictures and send preview images to the preview view frame for display, thus completing the soft switching between cameras.

S715. The camera application displays a preview image at a transition magnification after the target transition magnification in the preview view frame.

The above S713 to S715 are repeatedly executed until the camera application displays the preview image at the second magnification in the preview view frame.

Taking the magnification interval as 0.5x, the first magnification is 1x, the second magnification is 10x, and the target magnification is 5x as an example, the second camera acquires the preview image at 5.5x and sends the preview image to the preview view box for display, and so on. , the second camera sequentially acquires preview images at the subsequent transitional magnifications (6x, 6.5x, 7x, 7.5x, 8x, 8.5x, 9x, 9.5x), and the camera application is displayed in the preview view box at the subsequent transitional magnifications preview image until the camera app displays a preview image at the second magnification (10x) in the preview view box. In this way, a smooth transition of the preview image can be realized during the process of magnification point-cutting, which improves the zooming effect of the terminal device.

In this embodiment, the shearing control module may sequentially determine the transition magnification according to the magnification interval. Optionally, the cutting control module may also directly determine multiple transition magnifications, and the multiple transition magnifications may be equally spaced or unequally spaced, which is not limited in this embodiment of the present application.

In a possible scenario, the camera module of the terminal device includes at least one camera, and during the magnification point-cut operation, the same camera can obtain preview images at different magnifications and display them in the preview view box, that is, No switching between cameras is involved. The magnification click switching process in this scenario will be introduced below with reference to FIG. 8 .

FIG. 8 is a schematic flowchart of another magnification switching method 800 provided by an embodiment of the present application. The steps of the method 800 can be executed by the above-mentioned terminal device 400, the camera module of the terminal device 400 can include a first camera, and the hardware abstraction layer of the terminal device 400 includes a clipping control module, but this embodiment of the application does not limit this. Method 800 includes the steps of:

In S801, the first camera produces images at the first magnification and sends them to display.

S802, in response to the user's point-and-click operation, the camera application sends a magnification switching request message to the cutting control module, the magnification switching request message is used to request switching from the first magnification to the second magnification, and the magnification switching request message includes the first magnification and second magnification. Correspondingly, the cutting control module receives the magnification switching request message.

S803, the cutting control module determines the magnification interval according to preset parameters.

S804, the cutting control module determines the transition magnification according to the magnification interval.

S805, the cropping control module sends the transition magnification to the first camera. Correspondingly, the first camera acquires a transition magnification.

S806. The first camera acquires a preview image under a transition magnification.

S807. The first camera sends the preview image under the transition magnification to the camera application. Accordingly, the camera application receives the preview image.

S808, the camera application displays a preview image under a transition magnification in the preview view frame.

The above S804 and S808 are repeatedly executed until the camera application displays the preview image under the second magnification in the preview view frame.

For the manner of determining the magnification interval and determining the transition magnification, reference may be made to the embodiment described in the method 700, which will not be repeated here.

In this embodiment of the application, the terminal device can use the first camera to complete preview shooting at different magnifications in response to the user's point-and-click operation, and the first camera can sequentially obtain transition preview images at multiple transition magnifications, which is conducive to realizing the Smooth transition of the preview image during point-and-cut operations, improving the zoom effect of the camera application.

To sum up, the embodiment of the present application provides another magnification switching method 900. As shown in FIG. 9 , the method 900 can be applied to a terminal device equipped with a camera, and the method 900 includes the following steps:

S901, displaying the first preview image acquired by the camera under the first magnification;

S902, in response to the user's selection operation on the second magnification, display L frames of preview images corresponding to L transition magnifications, the L transition magnifications include L magnifications between the first magnification and the second magnification, L≥1 and is an integer;

S903. Display the second preview image acquired by the camera under the second magnification.

In the embodiment of the present application, before the user selects the second magnification, the terminal device may obtain the first preview image at the first magnification. After the user selects the second magnification, the terminal device can display L frames of preview images according to L transition magnifications before displaying the second preview image, so as to smoothly transition from the first preview image to the second preview image, It is beneficial to improve the zooming effect of the terminal device and improve the user experience.

Wherein, the user's selection operation of the second magnification may include the user selecting the second magnification by clicking the magnification icon as shown in Figure 1, and may also include the user selecting the second magnification from multiple magnifications in other ways. , which is not limited in this embodiment of the present application.

It should be understood that the L frames of preview images are used to transition from the first preview image to the second preview image, and the L frames of preview images are captured by the terminal device in chronological order.

It should also be understood that the user may realize the zoom-in effect of the preview image by selecting the second magnification, or the user may realize the zoom-out effect of the preview image by selecting the second magnification. limited.

Exemplarily, the first magnification is 1x, the second magnification is 7x, and the transition magnifications are 2x, 3x, 4x, 5x, 6x in descending order, and there are 5 transition magnifications in total. Correspondingly, the terminal device can sequentially display the preview images acquired by the camera at 2x, 3x, 4x, 5x, and 6x.

Exemplarily, the first magnification is 7x, the second magnification is 1x, and the transition magnifications can be 6x, 5x, 4x, 3x, and 2x in descending order, and there are 5 transition magnifications in total. Correspondingly, the terminal device can sequentially display the preview images acquired by the camera at 6x, 5x, 4x, 3x, and 2x.

As an optional embodiment, before S902, the method 900 further includes: determining L transitional magnifications based on the first magnification and the second magnification.

In a possible implementation manner, determining L transitional magnifications based on the first magnification and the second magnification includes: based on the first magnification, the second magnification, the switching duration between the first magnification and the second magnification, and The time interval between adjacent frames determines L transition magnifications.

In this method, the switching duration between the first magnification and the second magnification can be the preset switching duration described in the embodiment shown in FIG. .

In a possible implementation manner, determining L transitional magnifications based on the first magnification and the second magnification includes: determining L transitional magnifications based on the first magnification, the second magnification, and a preset preview image frame number.

In this manner, the preset preview image frame number may be the preset preview image frame number described in the embodiment shown in FIG.

As an optional embodiment, the camera in method 900 includes a first camera and a second camera, the first preview image is from the first camera, and the second preview image is from the second camera. The method 900 further includes: turning on the second camera, and acquiring images through the first camera and the second camera, wherein the images acquired by the first camera and the second camera at the same time node are based on the same transition magnification. When the difference between the quality of the Mth frame image from the second camera and the quality of the Nth frame image from the first camera is less than or equal to the preset threshold, the first camera is turned off, and the preview image displayed before the first camera is turned off from the first camera. Wherein, the Nth frame of image from the first camera is taken at the same time point as the Mth frame of image from the second camera based on the same transition magnification, N≥M≥1, and N and M are integers.

In the embodiment of the present application, the user's selection operation of the second magnification involves a scene of switching between different cameras. In this way, the dual-channel output of the first camera and the second camera is conducive to improving the quality of the preview image. The image algorithm of the terminal device can optimize the characteristics of more preview images, and switch the camera used for display at an appropriate time. , which is beneficial to improve the stability of focusing and the effect of smooth transition.

In a possible implementation manner, the terminal device acquires an image at a first magnification through the first camera, and displays the image acquired from the first camera, that is, the first preview image. After that, the terminal device can turn on the second camera, and acquire images at transitional magnifications through the first camera and the second camera. In this manner, the first camera and the second camera can acquire images based on the same transition magnification at the same time point, and M≠N at this time.

Taking FIG. 6 as an example, the terminal device turns on the second camera after displaying the preview image from the first camera 1x. There are L=17 transition magnifications between 1x and 10x, and the first camera and the second camera can acquire images at the transition magnification at the same time node. Suppose M=7, N=8, that is, the transition magnification corresponding to the 8th frame image of the first camera and the 7th frame image of the second camera is 4.5x, that is, the quality of the 7th frame image from the second camera is the same as that from the If the quality difference of the eighth frame image of the first camera is less than or equal to the preset threshold, then the terminal device may turn off the first camera.

Wherein, the preset threshold may be the preset threshold described in the embodiment shown in FIG. 7 , for details, refer to the description of S710 , which will not be repeated here.

In another possible implementation manner, the terminal device acquires an image at a first magnification through the first camera, and displays the image acquired from the first camera, that is, the first preview image. At the same time, the terminal device has turned on the second camera, and the second camera captures an image at the first magnification but does not display the image captured by the second camera. In this manner, if the difference between the quality of the image captured by the second camera at the first magnification (that is, the first preview image) and the quality of the image captured by the first camera at the first magnification is less than or equal to the preset threshold, At this time M=N.

Take Figure 6 as an example, assuming that the start time of the second camera in the figure is advanced to before the point-cutting time, the terminal device acquires images at a magnification of 1x through the first camera and the second camera, and displays images from the first camera at a magnification of 1x. Get the preview image below. If the difference between the quality of the preview image acquired by the second camera at a magnification of 1x and the quality of the preview image acquired by the first camera at a magnification of 1x is less than or equal to the preset threshold, then the terminal device can display images from the first After the camera acquires the preview image at a magnification of 1x, turn off the first camera, and then acquire and display a preview image at a transitional magnification through the second camera until the preview image at 10x is acquired and displayed. In this case, N=M=1.

Similarly, situations such as N=M=2, N=M=3, N=M=4 may also exist. Taking N=M=2 as an example, the terminal device acquires images at magnifications of 1x and 1.5x through the first camera and the second camera, and displays preview images obtained from the first camera at magnifications of 1x and 1.5x, If the difference between the quality of the preview image acquired by the second camera at the magnification of 1.5x and the quality of the preview image acquired by the first camera at the magnification of 1.5x is less than or equal to the preset threshold, then the terminal device can display the image from After the preview image is acquired by the first camera at a magnification of 1.5x, the first camera is turned off.

It should be understood that regardless of the values of M and N, after the first camera is turned off, the terminal device can display the preview image obtained by the second camera that has been turned on, so as to achieve a smooth transition of magnification and improve the zoom effect of the terminal device.

It should also be understood that, in the foregoing embodiments, the soft switching process before the cameras is introduced by taking the terminal device including the first camera and the second camera as an example, but the embodiment of the present application does not limit the number of cameras of the terminal device. Exemplarily, the terminal device may further include a third camera, and the second camera may be switched to the third camera after the user clicks to switch.

Exemplarily, the first camera is an ultra-wide-angle camera, the second camera is a wide-angle camera, and the third camera is a telephoto camera. Assume that the magnification range supported by the ultra-wide-angle camera is -1x, and the magnification range supported by the wide-angle camera is from 1x to 3.5x, the magnification range supported by the telephoto camera is 4x to 7x.

The terminal device can turn on the ultra-wide-angle camera when the magnification is -1x, and display the preview image from the ultra-wide-angle camera. When the magnification switched by the user's click is within the magnification range supported by the wide-angle camera, the terminal device turns on the wide-angle camera to determine the transition magnification , through the ultra-wide-angle camera and the wide-angle camera dual output, display the preview image from the wide-angle camera at the right time. When the magnification switched by the user's click is within the magnification range supported by the telephoto camera, the terminal device will turn on the telephoto camera, determine the transition magnification, output images through the wide-angle camera and the telephoto camera, and display images from the telephoto camera at an appropriate time. Get the preview image. Through such a two-way image output method, it is convenient to display a preview image with a smooth transition, and improve the zoom effect of the terminal device.

FIG. 10 is a schematic diagram of an interface of a terminal device provided in an embodiment of the present application. Taking the terminal device as a mobile phone as an example, FIG. 10 shows interface a, interface b and interface c of the mobile phone. Wherein, interface a shows multiple applications in the mobile phone, for example, the user can click the camera icon to open the camera application to take pictures. After the user clicks the camera application, the mobile phone displays interface b, where interface b is a shooting interface. Exemplarily, interface b includes a plurality of magnification icons, the current camera magnification is 1x, and the user can click on different magnification icons to switch between different magnifications. Exemplarily, the user clicks the magnification icon of 5x, and the mobile phone may display interfaces c to f in sequence. On interface c, the terminal device can display the preview image of the first frame for transition, on interface d, the terminal device can display the preview image of the second frame for transition, and on interface e, the terminal device can display the preview image of the third frame for transition Image, in the f interface, the terminal device can display a preview image of the final 5x interface.

It can be seen that, compared with Figure 1, the magnification switching method provided by the embodiment of the present application can display multiple frames of preview images for the transition to the user after the click switching operation of the magnification occurs, so as to achieve the purpose of smooth transition , improve the zoom effect of the terminal device, and improve the user experience.

It should be understood that the number of preview images displayed in FIG. 10 is only an example, and preview images corresponding to the number of frames may actually be displayed according to the specific number of transition magnifications, which is not limited in this embodiment of the present application.

It should be understood that the sequence numbers of the above processes do not mean the order of execution, and the execution order of each process should be determined by its functions and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application.

The magnification switching method according to the embodiment of the present application is described in detail above with reference to FIG. 4 to FIG. 10 , and the magnification switching device according to the embodiment of the present application will be described in detail below in conjunction with FIG. 11 and FIG. 12 .

FIG. 11 shows a schematic block diagram of a magnification switching device 1100 provided by an embodiment of the present application. The device 1100 includes an acquisition module 1110 and a processing module 1120 .

Wherein, the acquiring module 1110 is configured to: acquire a first preview image at a first magnification; and acquire a second preview image at a second magnification. The processing module 1120 is configured to: display the first preview image acquired by the camera at the first magnification; in response to the user's selection operation on the second magnification, display L frames of preview images corresponding to L transitional magnifications, the L transitional magnifications include L magnifications between the first magnification and the second magnification, L≥1 and an integer; and displaying the second preview image acquired by the camera at the second magnification.

Optionally, the processing module 1120 is configured to: determine L transitional magnifications based on the first magnification and the second magnification.

Optionally, the processing module 1120 is configured to: determine L transitional magnifications based on the first magnification, the second magnification, the switching duration between the first magnification and the second magnification, and the time interval between adjacent frames.

Optionally, the processing module 1120 is configured to: determine L transitional magnifications based on the first magnification, the second magnification, and the preset preview image frame number.

Optionally, the camera includes a first camera and a second camera, the first preview image is from the first camera, and the second preview image is from the second camera. The processing module 1120 is configured to: turn on the second camera. The acquisition module 1110 is configured to: acquire images through the first camera and the second camera, wherein the images acquired by the first camera and the second camera at the same time node are based on the same transition magnification; When the difference between the image quality of the Mth frame image from the camera and the image quality of the Nth frame image from the first camera is less than or equal to the preset threshold, the first camera is turned off, and the preview image displayed before the first camera is turned off is from the first camera . Wherein, the Nth frame of image from the first camera is taken at the same time point and based on the same magnification as the Mth frame of image from the second camera, N≥M≥1, and N and M are integers.

In an optional example, those skilled in the art may understand that the apparatus 1100 may specifically be the terminal device in the foregoing embodiment, or the functions of the terminal device in the foregoing embodiment may be integrated in the apparatus 1100. The above functions can be implemented by hardware, or can be implemented by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the above functions. Apparatus 1100 may be configured to execute various processes and/or steps corresponding to the terminal device in the foregoing method embodiments.

It should be understood that the apparatus 1100 here is embodied in the form of functional modules. The term "module" here may refer to an application specific integrated circuit (ASIC), an electronic circuit, a processor (such as a shared processor, a dedicated processor, or a group processor, etc.) and memory, incorporated logic, and/or other suitable components to support the described functionality. In the embodiment of the present application, the device 1100 in FIG. 11 may also be a chip or a chip system, for example: a system on chip (system on chip, SoC).

FIG. 12 shows a schematic block diagram of another magnification switching device 1200 provided by an embodiment of the present application. The apparatus 1200 includes a processor 1210 , a transceiver 1220 and a memory 1230 . Wherein, the processor 1210, the transceiver 1220 and the memory 1230 communicate with each other through an internal connection path, the memory 1230 is used to store instructions, and the processor 1210 is used to execute the instructions stored in the memory 1230 to control the transceiver 1220 to send signals and /or to receive a signal.

It should be understood that the apparatus 1200 may specifically be the terminal device in the foregoing embodiments, or, the functions of the terminal device in the foregoing embodiments may be integrated into the apparatus 1200, and the apparatus 1200 may be used to execute various functions corresponding to the terminal apparatus in the foregoing method embodiments. steps and/or processes. Optionally, the memory 1230 may include read-only memory and random-access memory, and provides instructions and data to the processor. A portion of the memory may also include non-volatile random access memory. For example, the memory may also store device type information. The processor 1210 may be configured to execute instructions stored in the memory, and when the processor executes the instructions, the processor may execute various steps and/or processes corresponding to the terminal device in the foregoing method embodiments.

It should be understood that, in the embodiment of the present application, the processor 1210 may be a central processing unit (central processing unit, CPU), and the processor may also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits ( ASIC), Field Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor, or the processor may be any conventional processor, or the like.

Those skilled in the art can appreciate that the modules and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present application.

Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the above-described system, device, and module can refer to the corresponding process in the foregoing method embodiment, and details are not repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the modules is only a logical function division. In actual implementation, there may be other division methods. For example, multiple modules or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or modules may be in electrical, mechanical or other forms.

The modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, that is, they may be located in one place, or may be distributed to multiple network modules. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional module in each embodiment of the present application may be integrated into one processing module, each module may exist separately physically, or two or more modules may be integrated into one module.

If the functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (read-only memory, ROM), random access memory (random access memory, RAM), magnetic disk or optical disc and other media that can store program codes. .

The above is only the specific implementation of the application, but the protection scope of the embodiment of the application is not limited thereto, and any skilled person familiar with the technical field can easily think of changes within the technical scope disclosed in the embodiment of the application Or replacement, should be covered within the scope of protection of the embodiments of the present application. Therefore, the scope of protection of the embodiments of the present application should be based on the scope of protection of the claims.

Claims (10)

1. A magnification switching method, characterized in that it is applied to a terminal device equipped with a camera, and the method includes:

   displaying the first preview image acquired by the camera at the first magnification;

   In response to the user's selection operation on the second magnification, displaying L frames of preview images corresponding to L transitional magnifications, the L transitional magnifications including L magnifications between the first magnification and the second magnification, L≥1 and is an integer;

   and displaying the second preview image acquired by the camera under the second magnification.
2. The method according to claim 1, characterized in that, before displaying L frames of preview images corresponding to L transitional magnifications in response to the selection operation of the second magnification by the user, the method further comprises:

   The L transitional magnifications are determined based on the first magnification and the second magnification.
3. The method according to claim 2, wherein said determining said L transitional magnifications based on said first magnification and said second magnification comprises:

   The L transitional magnifications are determined based on the first magnification, the second magnification, the switching duration between the first magnification and the second magnification, and the time interval between adjacent frames.
4. The method according to claim 2, wherein said determining said L transitional magnifications based on said first magnification and said second magnification comprises:

   The L transitional magnifications are determined based on the first magnification, the second magnification, and a preset preview image frame number.
5. The method according to any one of claims 1 to 4, wherein the camera includes a first camera and a second camera, the first preview image comes from the first camera, and the second preview image from said second camera;

   The method also includes:

   Turn on the second camera;

   Images are acquired by the first camera and the second camera, and the images acquired by the first camera and the second camera at the same time node are captured based on the same transition magnification;

   When the quality difference between the Mth frame image from the second camera and the Nth frame image from the first camera is less than or equal to the preset threshold, turn off the first camera, and turn off the first camera The previously displayed preview image is from the first camera, wherein the Nth frame of image from the first camera is captured at the same time node and based on the same magnification as the Mth frame of image from the second camera , N≥M≥1, N and M are integers.
6. A magnification switching device, characterized by comprising a module for performing the method according to any one of claims 1-5.
7. A magnification switching device, characterized in that it includes: a processor, the processor is coupled with a memory, the memory is used to store a computer program, and when the processor invokes the computer program, the device executes the following steps: The method according to any one of claims 1-5.
8. A terminal device, characterized in that it includes: a processor, a memory, and a transceiver, the memory is used to store instructions, the transceiver is used to communicate with other devices, and the processor is used to execute the instructions stored in the memory , so that the terminal device executes the method according to any one of claims 1-5.
9. A computer-readable storage medium is characterized in that it is used to store a computer program, and when the computer program is run on a computer, the computer is made to execute the method according to any one of claims 1-5.
10. A computer program product, characterized in that the computer program product includes computer program code, and when the computer program code is run on a computer, the computer implements the computer program as described in any one of claims 1-5. Methods.

Images