WO2023160179A9

WO2023160179A9 - Magnification switching method and magnification switching apparatus

Info

Publication number: WO2023160179A9
Application number: PCT/CN2022/140486
Authority: WO
Inventors: 许集润
Original assignee: 荣耀终端有限公司
Priority date: 2022-02-24
Filing date: 2022-12-20
Publication date: 2024-01-18
Also published as: CN116709016A; WO2023160179A1

Abstract

Provided in the present application are a magnification switching method and a magnification switching apparatus, which are conducive to realizing smooth transition of a preview image during a click-switching operation for a magnification, thereby improving the zooming effect of a terminal device. The method comprises: displaying a first preview image under a first magnification that is acquired by a camera; in response to a selection operation of a user for a second magnification, displaying L frames of preview images corresponding to L transition magnifications, wherein the L transition magnifications comprise L magnifications between the first magnification and the second magnification, L ≥ 1 and being an integer; and displaying a second preview image under the second magnification that is acquired by the camera.

Description

Magnification switching method and magnification switching device

This application claims priority to the Chinese patent application filed with the China Patent Office on February 24, 2022, with the application number 202210178265.5 and the application name "Magnification switching method and magnification switching device", the entire content of which is incorporated into this application by reference. .

Technical field

The present application relates to the field of terminals, and more specifically, to a magnification switching method and a magnification switching device.

Background technique

With the continuous development of terminal technology, users can realize more and more photographing functions through terminal devices (for example, mobile phones). For example, the camera realizes the zoom function through magnification switching.

For example, the user starts preview shooting through the camera at a first magnification (for example, 1x). If the user wants to shoot a distant object through the terminal device, the user can click the magnification icon of the second magnification (for example, 5x) to Switch the magnification, and then preview and shoot at the second magnification.

However, after the magnification click switching operation occurs, the camera's field of view (FOV) jumps directly from the first magnification to the second magnification, and the user will see the preview image at the first magnification jump directly to the third magnification. The preview image at double magnification will have the problem of stiff transition in the preview image, which will make the zoom effect of the terminal device poor and reduce the user experience.

Contents of the invention

This application provides a magnification switching method and a magnification switching device, which are conducive to achieving a smooth transition of preview images under a magnification click switching operation and improving the zoom effect of the terminal device.

In a first aspect, a magnification switching method is provided, which is applied to a terminal device equipped with a camera. The method includes: displaying a first preview image at a first magnification acquired by the camera. In response to the user's selection operation on the second magnification, L frame preview images corresponding to L transition magnifications are displayed, the L transition magnifications include L magnifications between the first magnification and the second magnification, L≥1 and is an integer . Display the second preview image acquired by the camera at the second magnification.

In this application, before the user selects the second magnification, the terminal device may obtain the first preview image at the first magnification. After the user selects the second magnification, the terminal device may display L frames of preview images according to L transition magnifications before displaying the second preview image. In this way, L is added before the first preview image is switched to the second preview image. The frame is used for the transition of the preview image, which can make the preview image displayed by the terminal device smoothly transition, which is conducive to improving the zoom effect of the terminal device and improving the user experience.

In connection with the first aspect, in some implementations of the first aspect, before displaying L frame preview images corresponding to L transition magnifications in response to the user's selection operation of the second magnification, the method further includes: based on the first magnification and the second magnification, determine L transition magnifications.

Combined with the first aspect, in some implementations of the first aspect, L transition magnifications are determined based on the first magnification and the second magnification, including: based on the first magnification, the second magnification, the first magnification and the second magnification. The switching duration between frames and the time interval between adjacent frames determine L transition magnifications.

In this application, the terminal device can determine L transition magnifications based on the switching duration between the first magnification and the second magnification and the time interval between adjacent frames. This is conducive to completing the transition from the first magnification to the first magnification within the switching duration. Smooth transition to second magnification.

In conjunction with the first aspect, in some implementations of the first aspect, L transition magnifications are determined based on the first magnification and the second magnification, including: based on the first magnification, the second magnification and a preset preview The number of image frames determines the L transition magnifications.

With reference to the first aspect, in some implementations of the first aspect, the camera of the terminal device includes a first camera and a second camera, the first preview image is from the first camera, and the second preview image is from the Describe the second camera. The method also includes: turning on the second camera. Images are acquired through the first camera and the second camera, where the images acquired by the first camera and the second camera at the same time node are captured based on the same transition magnification. When the quality difference between the Mth frame image from the second camera and the Nth frame image from the first camera is less than or equal to the preset threshold, the first camera is closed, and the preview image displayed before closing the first camera From the first camera. Among them, the Nth frame image from the first camera is captured at the same time point and at the same magnification as the Mth frame image from the second camera, N≥M≥1, and N and M are integers.

For example, the second camera can acquire images based on the first magnification at the same time point as the first camera, but the terminal device displays the first preview image from the first camera, and the terminal device can acquire the image based on the first magnification with the second camera. The second camera was previously turned on. In this case, M=N.

For example, the terminal device may acquire an image based on a first magnification through a first camera, and display the first preview image from the first camera. After that, the terminal device can turn on the second camera, acquire images through the first camera and the second camera at the same time point based on the same transition magnification, and display the preview image from the first camera until the Mth image from the second camera. If the difference between the quality of the frame image and the quality of the Nth frame image from the first camera is less than or equal to the preset threshold, the first camera is turned off. In this case, M≠N.

In this application, the terminal device can output pictures through the first camera and the second camera, and close the first camera at the appropriate time. From opening the second camera to closing the first camera, the first camera and the second camera are realized. The soft switching between them is conducive to obtaining a preview image with a smoother transition.

In a second aspect, a magnification switching device is provided, including an acquisition module and a processing module. Wherein, the acquisition module is used to: acquire the first preview image at the first magnification; and acquire the second preview image at the second magnification. The processing module is used to: display the first preview image at the first magnification acquired by the camera; in response to the user's selection operation of the second magnification, display L frame preview images corresponding to L transition magnifications, the L transition magnifications include L magnifications between the first magnification and the second magnification, L≥1 and is an integer; and display the second preview image at the second magnification acquired by the camera.

Combined with the second aspect, in some implementations of the second aspect, the processing module is configured to: determine L transition magnifications based on the first magnification and the second magnification.

Combined with the second aspect, in some implementations of the second aspect, the processing module is configured to: based on the first magnification, the second magnification, the switching duration between the first magnification and the second magnification, and the switching duration between adjacent frames. time interval, determine L transition magnifications.

In conjunction with the second aspect, in some implementations of the second aspect, the processing module is configured to: determine L transition magnifications based on the first magnification, the second magnification and the preset number of preview image frames.

In conjunction with the second aspect, in some implementations of the second aspect, the camera includes a first camera and a second camera, the first preview image comes from the first camera, and the second preview image comes from the second camera. The processing module is used for: turning on the second camera. The acquisition module is configured to acquire images through the first camera and the second camera, where the images acquired by the first camera and the second camera at the same time node are captured based on the same transition magnification. The processing module is also configured to: when the quality difference between the Mth frame image from the second camera and the Nth frame image from the first camera is less than or equal to a preset threshold, close the first camera, and close the first camera. The preview image previously displayed by the camera is from the first camera. Among them, the Nth frame of rabbit food from the first camera and the Mth frame of image from the second camera are captured at the same time node and based on the same magnification, N≥M≥1, N and M are integers.

A third aspect provides another magnification switching device, including a processor, which is coupled to a memory and can be used to execute instructions in the memory to implement the method in any of the possible implementations of the first aspect. Optionally, the device further includes memory. Optionally, the device further includes a communication interface, and the processor is coupled to the communication interface.

In one implementation, the magnification switching device is a terminal device. When the magnification switching device is a terminal device, the communication interface may be a transceiver or an input/output interface.

In another implementation, the magnification switching device is a chip configured in the terminal device. When the magnification switching device is a chip configured in a terminal device, the communication interface may be an input/output interface.

In the fourth aspect, a processor is provided, including: an input circuit, an output circuit and a processing circuit. The processing circuit is configured to receive signals through the input circuit and transmit signals through the output circuit, so that the processor executes the method in any of the possible implementations of the first aspect.

In the specific implementation process, the above-mentioned processor can be a chip, the input circuit can be an input pin, the output circuit can be an output pin, and the processing circuit can be a transistor, a gate circuit, a flip-flop, and various logic circuits. The input signal received by the input circuit may be received and input by, for example, but not limited to, the receiver, and the signal output by the output circuit may be, for example, but not limited to, output to and transmitted by the transmitter, and the input circuit and the output A circuit may be the same circuit that functions as an input circuit and an output circuit at different times. This application does not limit the specific implementation methods of the processor and various circuits.

In a fifth aspect, a processing device is provided, including a processor and a memory. The processor is used to read instructions stored in the memory, and can receive signals through a receiver and transmit signals through a transmitter to execute the method in any of the possible implementations of the first aspect.

Optionally, there are one or more processors and one or more memories.

Alternatively, the memory may be integrated with the processor, or the memory may be provided separately from the processor.

In the specific implementation process, the memory can be a non-transitory memory, such as a read-only memory (ROM), which can be integrated on the same chip as the processor, or can be set in different On the chip, this application does not limit the type of memory and the arrangement of the memory and the processor.

It should be understood that the relevant data interaction process, for example, sending instruction information may be a process of outputting instruction information from the processor, and receiving capability information may be a process of the processor receiving input capability information. Specifically, the data output by the processing can be output to the transmitter, and the input data received by the processor can come from the receiver. Among them, the transmitter and receiver can be collectively called a transceiver.

The processing device in the above fifth aspect can be a chip, and the processor can be implemented by hardware or software. When implemented by hardware, the processor can be a logic circuit, an integrated circuit, etc.; when implemented by software, When implemented, the processor can be a general-purpose processor, which is implemented by reading the software code stored in the memory. The memory can be integrated in the processor, or can be located outside the processor and exist independently.

In a sixth aspect, a computer program product is provided. The computer program product includes: computer program code. When the computer program code is run, it causes the computer to execute the method in any of the possible implementations of the first aspect.

In a seventh aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program. When the computer program is run, it causes the computer to execute the method in any of the possible implementations of the first aspect. .

Description of drawings

Figure 1 is a schematic diagram of the interface of a terminal device;

Figure 2 is a schematic diagram of the drawing principle of a point-cut operation;

Figure 3 is a schematic flow chart of a drawing method for point-cut operation;

Figure 4 is a schematic structural diagram of a terminal device applicable to the embodiment of the present application;

Figure 5 is a software structure block diagram of a terminal device applicable to the embodiment of the present application;

Figure 6 is a schematic diagram of the drawing principle of a point-cut operation provided by the embodiment of the present application;

Figure 7 is a schematic flow chart of a magnification switching method provided by an embodiment of the present application;

Figure 8 is a schematic flow chart of another magnification switching method provided by an embodiment of the present application;

Figure 9 is a schematic flow chart of yet another magnification switching method provided by an embodiment of the present application;

Figure 10 is a schematic interface diagram of a terminal device provided by an embodiment of the present application;

Figure 11 is a schematic block diagram of a magnification switching device provided by an embodiment of the present application;

Figure 12 is a schematic block diagram of another magnification switching device provided by an embodiment of the present application.

Detailed ways

The technical solutions in this application will be described below with reference to the accompanying drawings.

In the Android ecosystem, users can use the camera application (APP) of the terminal device to perform magnification click switching (which can be referred to as point switching). It is a common usage scenario to be able to shoot objects at different distances, improving the richness of the shooting scene.

Figure 1 is a schematic diagram of the interface of a terminal device. Taking the terminal device as an example of a mobile phone, Figure 1 shows the a interface, b interface and c interface of the mobile phone. The a interface shows multiple applications in the mobile phone. For example, the user can click the camera icon to open the camera application. Take photos. After the user clicks on the camera application, the mobile phone displays interface b, which is the shooting interface. For example, interface b includes multiple magnification icons. The current magnification of the camera is 1x. The user can click on different magnification icons to switch between different magnifications. For example, the user clicks on the 5x magnification icon, and the mobile phone can display the c interface. In the c interface, the magnification has been switched to 5x, and the mobile phone can obtain a preview image at a 10x magnification.

Before the point-and-cut operation as shown in Figure 1, the mobile phone can display a preview image of the object to be photographed in the b interface through the camera at a magnification of 1x, and the camera's field of view (FOV) is maintained at 1x. After the user clicks on the 5x magnification icon, the phone can display a preview image of the object to be photographed in the c interface at 5x magnification through the camera, and the camera's FOV is maintained at 10x.

Figure 2 is a schematic diagram of the drawing principle of a point-cut operation. Taking the terminal device as a mobile phone as an example, in Figure 2, the camera of the mobile phone can include a main camera lens and a telephoto lens. Before the user performs a point-and-cut operation, the FOV of the main camera lens is maintained at 1x magnification and continues to capture a preview image, and the preview image is displayed on the display. For example, at the point-cut moment shown in Figure 2, the user clicks on the 10x magnification icon to switch the magnification. At this time, the mobile phone can switch from the main camera lens to the telephoto lens, and the FOV of the telephoto lens remains at the 10x magnification. Publish the picture to obtain the preview image after the switch, and display the preview image after the switch on the display screen.

FIG. 3 is a schematic flowchart of a drawing drawing method 300 for a point-and-cut operation. Method 300 includes the following steps:

S301, the first camera produces a picture at the first magnification and sends it to the display.

S302, in response to the user's point-cut operation, the camera application sends a magnification switching request message to the hardware abstraction layer (HAL). The magnification switching request message is used to request switching from the first magnification to the second magnification. The magnification switching The request message includes the second magnification. Correspondingly, the hardware abstraction layer receives the rate switching request message.

S303. The hardware abstraction layer sends a camera close request message to the first camera. The camera close request message is used to request to close the first camera. Correspondingly, the first camera receives the camera closing request message.

S304, the first camera is turned off and stops working.

S305. The hardware abstraction layer sends a camera start request message to the second camera. The camera start request message is used to request to start the second camera. The camera start request message includes the second magnification. Correspondingly, the second camera receives the camera start request message.

S306, the second camera is started, the image is taken out at the second magnification and sent to display.

Among them, drawing means that the camera captures the object and obtains a preview image, and sending and displaying means displaying the preview image on the display screen. More specifically, the preview image can be displayed in a preview view box built by the camera application.

It should be understood that during the point-cut operation shown in Figure 3, after the point-cut operation occurs, the FOV of the camera directly jumps from the first magnification (which can be 1x in Figure 1 or Figure 2 above) to the second magnification ( It can be 5x in Figure 1 or 10x in Figure 2). This will cause the preview image seen by the user to jump and the transition will be stiff, resulting in a poor zoom effect of the camera application and a poor user experience.

In view of this, embodiments of the present application provide a magnification switching method and a magnification switching device. When the user uses the camera application of the terminal device to take pictures and preview, the terminal device can introduce multi-frame transition preview images in the process of magnification point switching to achieve magnification The smooth transition of the preview image during point-and-click switching will help improve the zoom effect of the camera application, thus improving the user experience.

Before introducing the magnification switching method and magnification switching device provided by the embodiments of the present application, the following points should be explained.

First, in the embodiments shown below, various terms and English abbreviations, such as preview image, magnification switching request message, main camera lens, telephoto lens, etc., are all illustrative examples given for convenience of description. No limitations shall be imposed on this application. This application does not exclude the possibility of defining other terms that can achieve the same or similar functions in existing or future agreements.

Second, in the embodiments shown below, the first, second and various numerical numbers are only for convenience of description and are not used to limit the scope of the embodiments of the present application. For example, distinguish between different preview images, distinguish between different cameras, etc.

Third, “at least one” refers to one or more, and “plurality” refers to two or more. "And/or" describes the association of associated objects, indicating that there can be three relationships, for example, A and/or B, which can mean: A exists alone, A and B exist simultaneously, and B exists alone, where A, B can be singular or plural. The character "/" generally indicates that the related objects are in an "or" relationship. "At least one of the following" or similar expressions thereof refers to any combination of these items, including any combination of a single item (items) or a plurality of items (items). For example, at least one of a, b and c can mean: a, or b, or c, or a and b, or a and c, or b and c, or a, b and c, where a, b, c can be single or multiple.

The terminal device in the embodiment of the present application can be a handheld device, a vehicle-mounted device, etc. with a wireless connection function. The terminal device can also be called a terminal (terminal), user equipment (UE), mobile station (MS) ), mobile terminal (mobile terminal, MT), etc. At present, some examples of terminals are: mobile phones, tablets, smart TVs, laptops, tablets (Pad), handheld computers, mobile Internet devices (mobile internet device, MID), virtual reality (VR) ) equipment, augmented reality (AR) equipment, wireless terminals in industrial control, wireless terminals in self-driving, wireless terminals in remote medical surgery, smart grids ( Wireless terminals in smart grid, wireless terminals in transportation safety, wireless terminals in smart city, wireless terminals in smart home, cellular phones, cordless phones, session initiation protocols (session initiation protocol, SIP) telephone, wireless local loop (WLL) station, personal digital assistant (personal digital assistant, PDA), handheld device with wireless communication capabilities, computing device or other device connected to a wireless modem Processing equipment, vehicle-mounted equipment, wearable equipment, terminal equipment in the 5G network or terminal equipment in the future evolved public land mobile communication network (public land mobile network, PLMN), etc., the embodiments of the present application adopt the method for the terminal equipment Specific technologies and specific equipment forms are not limited.

As an example and not a limitation, in this embodiment of the present application, the terminal device may also be a wearable device. Wearable devices can also be called wearable smart devices. It is a general term for applying wearable technology to intelligently design daily wear and develop wearable devices, such as glasses, gloves, watches, clothing and shoes, etc. A wearable device is a portable device that is worn directly on the body or integrated into the user's clothing or accessories. Wearable devices are not just hardware devices, but also achieve powerful functions through software support, data interaction, and cloud interaction. Broadly defined wearable smart devices include full-featured, large-sized devices that can achieve complete or partial functions without relying on smartphones, such as smart watches or smart glasses, and those that only focus on a certain type of application function and need to cooperate with other devices such as smartphones. Use, such as various types of smart bracelets, smart jewelry, etc. for physical sign monitoring.

It should be understood that in the embodiments of the present application, the terminal device may be a device for realizing the function of the terminal device, or a device that can support the terminal device to realize the function, such as a chip system, and the device may be installed in the terminal. In the embodiments of this application, the chip system may be composed of chips, or may include chips and other discrete devices.

The terminal equipment in the embodiment of this application may also be called: user equipment (UE), mobile station (MS), mobile terminal (mobile terminal, MT), access terminal, user unit, user station, Mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication equipment, user agent or user device, etc.

Figure 4 is a schematic structural diagram of a terminal device applicable to the embodiment of the present application. As shown in Figure 4, the terminal device 400 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, and a power management module 141. Battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone interface 170D, sensor 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and subscriber identification module (subscriber identification module, SIM) card interface 195, etc. It can be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the terminal device 400. In other embodiments of the present application, the terminal device 400 may include more or less components than shown in the figures, or combine some components, or split some components, or arrange different components. The components illustrated may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, display processing unit (display process unit, DPU), and/or neural network processor (neural-network processing unit, NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors. In some embodiments, the terminal device 400 may also include one or more processors 110. The processor may be the nerve center and command center of the terminal device 400 . The processor can generate operation control signals based on the instruction opcode and timing signals to complete the control of fetching and executing instructions. The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in processor 110 is cache memory. The memory may hold instructions or data used or recycled by processor 110 . If the processor 110 needs to use the instructions or data again, it can be called directly from the memory. This avoids repeated access and reduces the waiting time of the processor 110, thereby improving the efficiency of the terminal device 400.

In some embodiments, processor 110 may include one or more interfaces. Interfaces may include integrated circuit (inter-integrated circuit, I2C) interface, integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, pulse code modulation (pulse code modulation, PCM) interface, universal asynchronous receiver and transmitter (universal asynchronous receiver/transmitter (UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and /or USB interface, etc. Among them, the USB interface 130 is an interface that complies with USB standard specifications, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the terminal device 400, and can also be used to transmit data between the terminal device 400 and peripheral devices. It can also be used to connect headphones to play audio through them.

It can be understood that the interface connection relationships between the modules illustrated in the embodiment of the present application are schematic illustrations and do not constitute a structural limitation on the terminal device 400 . In other embodiments of the present application, the terminal device 400 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

The wireless communication function of the terminal device 400 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor. Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in terminal device 400 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example: Antenna 1 can be reused as a diversity antenna for a wireless LAN. In other embodiments, antennas may be used in conjunction with tuning switches.

The mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G applied to the terminal device 400. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier, etc. The mobile communication module 150 can receive electromagnetic waves through the antenna 1, perform filtering, amplification and other processing on the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves through the antenna 1 for radiation. In some embodiments, at least part of the functional modules of the mobile communication module 150 may be disposed in the processor 110 . In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.

A modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs sound signals through audio devices (not limited to speaker 170A, receiver 170B, etc.), or displays images or videos through display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be independent of the processor 110 and may be provided in the same device as the mobile communication module 150 or other functional modules.

The wireless communication module 160 can provide applications on the terminal device 400 including wireless local area networks (WLAN), Bluetooth, global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), NFC, Infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 . The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.

In some embodiments, the antenna 1 of the terminal device 400 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the terminal device 400 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include GSM, GPRS, CDMA, WCDMA, TD-SCDMA, LTE, GNSS, WLAN, NFC, FM, and/or IR technology, etc. The above-mentioned GNSS can include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (quasi) -zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).

The terminal device 400 can implement display functions through a GPU, a display screen 194, an application processor, and the like. Application processors may include NPUs and/or DPUs. The GPU is an image processing microprocessor and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute instructions to generate or alter display information. NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can continuously learn by itself. The NPU can realize intelligent cognitive applications of the terminal device 400, such as image recognition, face recognition, speech recognition, text understanding, etc. The DPU is also called the display sub-system (display sub-system, DSS). The DPU is used to adjust the color of the display screen 194. The DPU can adjust the color of the display screen through a color three-dimensional lookup table (3D look up table, 3D LUT). Adjustment. The DPU can also perform image scaling, noise reduction, contrast enhancement, backlight brightness management, HDR processing, display parameter Gamma adjustment, etc.

The display screen 194 is used to display images, videos, etc. Display 194 includes a display panel. The display panel can use a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode). emitting diode (AMOLED), flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed or quantum dot light emitting diode (QLED). In some embodiments, the terminal device 400 may include 1 or N display screens 194, where N is a positive integer greater than 1.

The terminal device 400 can implement the shooting function through an ISP, one or more cameras 193, a video codec, a GPU, one or more display screens 194, and an application processor.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device 400. The external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function. For example, save data files such as music, photos, videos, etc. on an external memory card.

Internal memory 121 may be used to store one or more computer programs including instructions. The processor 110 can execute the above instructions stored in the internal memory 121 to cause the terminal device 400 to execute various functional applications, data processing, and the like. The internal memory 121 may include a program storage area and a data storage area. Among them, the stored program area can store the operating system; the stored program area can also store one or more application programs (such as gallery, contacts, etc.). The storage data area can store data created during use of the terminal device 400 (such as photos, contacts, etc.). In addition, the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. In some embodiments, the processor 110 can cause the terminal device 400 to perform various functional applications and data processing by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor 110 .

The terminal device 400 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. For example, music playback, recording, etc. Among them, the audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert analog audio input into a digital audio signal. Audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be provided in the processor 110 , or some functional modules of the audio module 170 may be provided in the processor 110 . Speaker 170A, also called "speaker", is used to convert audio electrical signals into sound signals. The terminal device 400 can listen to music through the speaker 170A, or listen to a hands-free call. Receiver 170B, also called "earpiece", is used to convert audio electrical signals into sound signals. When the terminal device 400 answers a call or a voice message, the voice can be heard by bringing the receiver 170B close to the human ear. Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak close to the microphone 170C with the human mouth and input the sound signal to the microphone 170C. The terminal device 400 may be provided with at least one microphone 170C. In other embodiments, the terminal device 400 may be provided with two microphones 170C, which in addition to collecting sound signals, may also implement a noise reduction function. In other embodiments, the terminal device 400 can also be equipped with three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions, etc. The headphone interface 170D is used to connect wired headphones. The headphone interface 170D can be a USB interface 130, or it can be a 3.5mm open mobile terminal platform (OMTP) standard interface, or it can be a cellular telecommunications industry association of the USA (CTIA) standard. interface.

The sensors 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and an ambient light sensor 180L. , bone conduction sensor 180M, etc.

The software system of the terminal device 400 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. The embodiment of this application takes the Android system with a layered architecture as an example to illustrate the software structure of the terminal device 400 .

Figure 5 is a software structure block diagram of a terminal device applicable to the embodiment of the present application. The layered architecture divides the software system of the terminal device 400 into several layers, and each layer has clear roles and division of labor. The layers communicate through software interfaces. In some embodiments, the Android system can be divided into application layer (application, APP), application framework layer (application framework), Android runtime (Android runtime) and system library, hardware abstraction layer (HAL) ) and the kernel layer. In some embodiments, the terminal device 400 also includes hardware (eg, camera, display screen).

The application layer can include a series of application packages. The application layer runs applications by calling the application programming interface (API) provided by the application framework layer. As shown in Figure 5, the application package can include applications such as camera, calendar, map, phone, music, WLAN, Bluetooth, video, social, gallery, navigation, short message, etc.

The application framework layer provides APIs and programming frameworks for applications in the application layer. The application framework layer includes some predefined functions. The framework layer provides programming services (for example, camera services, media services) to the application layer through API interfaces. As shown in Figure 5, the application framework layer can include a window manager, content provider, resource manager, notification manager, view system, phone manager, etc.

A window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, capture the screen, etc.

Content providers are used to store and retrieve data and make this data accessible to applications. Data can include video images, audio, calls made and received, browsing history and bookmarks, phone books, etc. The view system includes visual controls, such as controls that display text, controls that display pictures, etc.

A view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.

The phone manager is used to provide communication functions of the terminal device 400 . For example, call status management (including connected, hung up, etc.).

The resource manager provides various resources to applications, such as localized strings, icons, pictures, layout files, video files, etc.

The notification manager allows applications to display notification information in the status bar, which can be used to convey notification-type messages and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be notifications that appear in the status bar at the top of the system in the form of charts or scroll bar text, such as notifications for applications running in the background, or notifications that appear on the screen in the form of conversation windows. For example, text information is prompted in the status bar, a prompt sound is emitted, the terminal device 400 vibrates, and the indicator light flashes, etc.

The Android runtime includes core libraries and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system. The core library contains two parts: one part is the functional functions that need to be called by the Java language used by the Java API framework, and the other part is the core library of Android. The application layer and application framework layer run in virtual machines. The virtual machine executes the java files of the application layer and application framework layer into binary files. The virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection and other functions. System libraries can include multiple functional modules. For example: surface manager (surface manager), media libraries (media libraries), 3D graphics processing libraries (for example: OpenGL ES), 2D graphics engines (for example: SGL), etc.

The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, composition and layer processing. 2D Graphics Engine is a drawing engine for 2D drawing.

The hardware abstraction layer is an abstract interface of the device kernel driver, which provides application program interfaces for accessing underlying devices to higher-level Java API frameworks. The hardware abstraction layer can include multiple library modules, each of which can implement an interface for a specific type of hardware component, for example, a camera interface, etc. When a framework API requires access to device hardware, the Android system loads a library module for that hardware component. Exemplarily, as shown in Figure 5, the library module includes a shearing control module and a multi-shot control module.

In the embodiment of the present application, after the camera application responds to the user's magnification point switching (switching from the first magnification to the second magnification) operation, the shear control module is used to determine the magnification interval to obtain the ratio between the first magnification and the second magnification. multiple transition magnifications between. The multi-camera control module is used to start or stop cameras, and to switch between cameras.

The kernel layer is the layer between hardware and software. The kernel layer is used to drive the hardware and make the hardware work. For example, as shown in Figure 5, the kernel layer contains a camera driver.

The hardware layer includes a camera module and a display screen, where the camera module includes at least one camera.

It should be understood that the terminal device in the embodiment of the present application may have the architecture shown in FIG. 4 and/or FIG. 5, but the embodiment of the present application is not limited to this.

In a possible scenario, the camera module of the terminal device includes a first camera and a second camera. The process of magnification point switching may involve switching between the first camera and the second camera. The user can use the third camera to The first camera and the second camera provide a richer video and photo experience. The magnification click switching process in this scenario is introduced below with reference to Figures 6 and 7.

FIG. 6 is a schematic diagram of the drawing principle of a point cutting operation provided by an embodiment of the present application. Taking the terminal device as an example including a first camera (for example, a main camera lens) and a second camera (for example, a telephoto lens), in FIG. 6 , for example, before the user performs a magnification point-and-cut operation, the first camera The FOV is maintained at 1x magnification to acquire images, and a preview image is displayed on the display.

For example, at the point-and-cut moment shown in Figure 6, the user clicks on the 10x magnification icon to switch the magnification. After the point-and-cut operation occurs, the terminal device can determine the magnification interval, between the first magnification and the second magnification. Divide the gears to obtain multiple transition magnifications between 1x and 10x. As shown in Figure 6, taking the magnification interval as 0.5x as an example, the multiple transition magnifications that the terminal device can obtain after 1x include: 1.5x, 2x, 2.5x, 3x, 3.5x, 4x, 4.5x, 5x, 5.5 x, 6x, 6.5x, 7x, 7.5x, 8x, 8.5x, 9x, 9.5x. The camera of the terminal device (the first camera and/or the second camera) can sequentially obtain images according to multiple transition magnifications in order from small to large. The terminal device obtains and displays the preview image at 10x to complete the smooth transition of the preview image.

For example, as shown in FIG. 6 , the terminal device can start the second camera before acquiring the preview image at the first transition magnification (1.5x) after the user performs a point-and-cut operation on the second magnification.

As shown in Figure 6, in response to the user's operation of switching from the magnification point of 1x to 10x, the terminal device first determines the magnification interval to be 0.5x, and then the terminal device determines that the next magnification after 1x is 1.5x. The terminal device can make the magnification transition during the magnification transition. Start the second camera to get preview images before 1.5x. After starting the second camera, for the first camera, the first camera can sequentially obtain multi-frame transition preview images at 1.5x, 2x, 2.5x, 3x, 3.5x, and 4x, and display them in the preview view box sequentially Multi-frame transition preview image. For the second camera, the second camera can sequentially acquire multi-frame images at 1.5x, 2x, 2.5x, 3x, 3.5x, and 4x, but these multi-frame images are not displayed in the preview view box.

When the magnification transitions to 4.5x, if the quality difference between the image obtained by the second camera at a magnification of 4.5x and the quality of the image obtained by the first camera at a magnification of 4.5x is less than or equal to the preset threshold, then the terminal The device can stop the first camera after displaying the preview image acquired by the first camera at 4.5x, and switch to the second camera to acquire 5x, 5.5x, 6x, 6.5x, 7x, 7.5x, 8x, 8.5x, Multi-frame images at 9x and 9.5x, and multiple-frame preview images are displayed in the preview view box in sequence.

In the embodiment of the present application, the terminal device can obtain preview images at multiple transition magnifications by determining the magnification interval, and display them in the preview view box sequentially. This can achieve a smooth transition from the 1x point to 10x. In the preview view A preview image with smooth transition is displayed in the frame to improve the zoom effect of the terminal device.

In addition, after the point-to-cut operation occurs, the terminal device can activate the second camera to realize two-way picture output from the first camera and the second camera. This is conducive to realizing soft switching between the first camera and the second camera and easing the differences in switching. The issue of stiff preview image transition caused by the camera has improved the zoom effect of the terminal device in different camera switching scenarios.

The magnification switching method according to the embodiment of the present application will be introduced below with reference to FIG. 7 , based on the operations performed by each layer in the layered architecture.

Figure 7 is a schematic flow chart of a magnification switching method 700 provided by an embodiment of the present application. The steps of method 700 can be executed by the above-mentioned terminal device 400. The camera module of the terminal device 400 can include a first camera and a second camera. The hardware abstraction layer of the terminal device 400 includes a shearing control module and a multi-camera control module. However, this application The embodiment does not limit this. Method 700 includes the following steps:

S701, the first camera produces a picture at the first magnification and sends it to the display.

S702. In response to the user's point-and-cut operation, the camera application sends a magnification switching request message to the shearing control module. The magnification switching request message is used to request switching from the first magnification to the second magnification. The magnification switching request message includes the first magnification. and second magnification. Correspondingly, the shearing control module receives the magnification switching request message.

S703, the shearing control module determines the magnification interval according to the preset parameters.

For example, the preset parameters include a preset switching duration or a preset number of preview image frames. Among them, the switching duration indicates the time limit for the terminal device to switch from the preview view at the first magnification to the preview image at the second magnification in the preview view box after the user performs a magnification point switching operation. The number of frames of the preview image indicates the number of frames of the preview image required for the transition that the terminal device can display in the preview view frame the preview image at the second magnification.

For example, the switching duration is 0.1s, and the transition time between preview images at adjacent transition magnifications is 0.02s. If you want to switch from 1x to 5x, up to 5 preview image transitions can be completed within 1s, then The terminal equipment can determine the magnification interval to be 1x, realizing the transition from 1x, 2x, 3x, 4x, and up to 5x, with a total time of 0.08s. The terminal device can also determine the magnification interval to be 2x. The first transition from 1x, 3x to 5x takes a total of 0.04s.

For example, the number of preview image frames is 3 frames. If you want to switch from 1x to 5x, the terminal device can determine the magnification interval to be 1x to realize the transition from 1x, 2x, 3x, 4x, and up to 5x for preview of the transition. The number of frames of the image is 3 frames.

For example, the number of preview image frames is 7, and the terminal device can also determine the magnification interval to be 0.5x to realize the transition from 1x, 1.5x, 2x, 2.5x, 3x, 3.5x, 4x, 4.5x to 5x, using The number of frames for the transition preview image is 7 frames.

It should be understood that in order to obtain a smoother transition effect, the terminal device can determine a finer magnification interval. The specific value of the magnification interval in the embodiment of the present application is not limited.

S704, the shearing control module determines the transition magnification according to the magnification interval.

S705. The multi-camera control module sends a camera hold request message to the first camera. The camera hold request message is used to request the first camera to stay on. The camera hold request message may include a transition magnification. Correspondingly, the first camera receives the camera hold request message.

S706, the first camera continues to be turned on to obtain a preview image at a transition magnification.

S707, the first camera sends the preview image at the transition magnification to the camera application. Accordingly, the camera application receives the preview image.

S708, the camera application displays the preview image at the transition magnification in the preview view box.

It should be understood that before switching from the first camera to the second camera, the camera application displays the preview image obtained by the first camera in the preview view box. After switching from the first camera to the second camera, the camera application displays the preview image obtained by the second camera in the preview view box.

S709: The multi-camera control module sends a camera start request message to the second camera. The camera start request message is used to request to start the second camera. The camera start request message may include a transition magnification. Correspondingly, the second camera receives the camera start request message.

S710, the second camera is turned on to obtain a preview image at a transition magnification.

The above S704 to S710 are repeatedly executed until the preview images obtained by the first camera and the second camera at the target transition magnification meet the preset conditions, and the following steps S711 to S715 are executed.

Optionally, the preset condition may include: the difference between the quality of the image obtained by the second camera at the target transition magnification and the quality of the image obtained by the first camera at the target transition magnification is less than or equal to the preset threshold.

For example, the peak signal-to-noise ratio (PSNR) of the image is used as an evaluation index to evaluate the quality of the image. If the preset threshold is 5dB, the image obtained by the second camera at the target transition magnification is The PSNR is 40dB. The PSNR of the image obtained by the first camera at the target transition magnification is 43dB, and the difference is 3dB<5dB. Then the multi-camera control module can control the first camera to turn off, switch to the second camera to continuously acquire images and display them in the preview view. A preview image is displayed in the box.

Taking the magnification interval as 0.5x, the first magnification as 1x, the second magnification as 10x, and the target magnification as 5x as an example, for S704, the shear control module can determine the first transition magnification after the first magnification of 1x based on the magnification interval. 1.5x, then the first camera obtains the preview image under 1.5x and sends it to the camera application to display the preview image under 1.5x in the preview view box, and the second camera also obtains the preview image under 1.5x but not in the preview view box show. After that, the shearing control module can determine the transition magnification after 1.5x to be 2x based on the magnification interval. After that, the first camera obtains the preview image at 2x and sends it to the camera application to display the preview image at 2x in the preview view box. The second camera The camera also obtains the preview image at 2x but does not display it in the preview view box. In this cycle, the first camera sequentially obtains and displays the subsequent transition magnifications (2.5x, 3x, 3.5x, 4x, 4.5x, 5x) in the preview view box. ), the second camera sequentially acquires preview images at subsequent transition magnifications (2.5x, 3x, 3.5x, 4x, 4.5x, 5x) but does not display them in the preview view box.

For example, the mean square error (MSE), signal-to-noise ratio (SNR) or mean absolute error (MAE) of the image can also be used as a criterion to evaluate the quality of the image. The evaluation index is not limited in the embodiments of this application.

S711. The multi-camera control module sends a camera close request message to the first camera. The camera close request message is used to request to close the first camera. Correspondingly, the first camera receives the camera closing request message.

S712, the first camera is turned off and stops working.

S713: The second camera obtains a preview image at a transition magnification after the target transition magnification.

S714: The second camera sends the preview image at the transition magnification after the target transition magnification to the camera application, and accordingly, the camera application receives the preview image.

For S711 to S714, the first camera is turned off, and the second camera continues to produce pictures and sends the preview image to the preview view box for display, thus completing the soft switching between cameras.

S715, the camera application displays the preview image at the transition magnification after the target transition magnification in the preview view box.

Repeat the above S713 to S715 until the camera application displays the preview image at the second magnification in the preview view box.

Take the magnification interval as 0.5x, the first magnification is 1x, the second magnification is 10x, and the target magnification is 5x as an example. The second camera obtains a preview image at 5.5x and sends the preview image to the preview view box for display, and so on. , the second camera sequentially acquires preview images at subsequent transition magnifications (6x, 6.5x, 7x, 7.5x, 8x, 8.5x, 9x, 9.5x), and the camera application displays the subsequent transition magnifications in the preview view box preview image until the camera app displays the preview image at the second magnification (10x) in the preview view box. As a result, a smooth transition of the preview image can be achieved during the magnification point switching process, thereby improving the zoom effect of the terminal device.

In this embodiment, the shearing control module can determine the transition magnification in sequence according to the magnification interval. Optionally, the shear control module can also directly determine multiple transition magnifications. The multiple transition magnifications can be equally spaced or unequal spaced. This is not limited in the embodiment of the present application.

In a possible scenario, the camera module of the terminal device includes at least one camera. During the magnification point switching operation, the same camera can obtain preview images at different magnifications and display them in the preview view box, that is, There is no switching between cameras involved. The magnification click switching process in this scenario is introduced below with reference to Figure 8.

FIG. 8 is a schematic flow chart of another magnification switching method 800 provided by an embodiment of the present application. The steps of method 800 may be executed by the above-mentioned terminal device 400. The camera module of the terminal device 400 may include the first camera, and the hardware abstraction layer of the terminal device 400 may include a clipping control module, but this is not limited in the embodiment of the present application. Method 800 includes the following steps:

S801, the first camera produces a picture at the first magnification and sends it to the display.

S802, in response to the user's point and cut operation, the camera application sends a magnification switching request message to the shearing control module. The magnification switching request message is used to request switching from the first magnification to the second magnification. The magnification switching request message includes the first magnification. and second magnification. Correspondingly, the shearing control module receives the magnification switching request message.

S803: The shearing control module determines the magnification interval according to the preset parameters.

S804, the shearing control module determines the transition magnification according to the magnification interval.

S805, the shearing control module sends the transition magnification to the first camera. Correspondingly, the first camera acquires the transition magnification.

S806, the first camera obtains a preview image at a transition magnification.

S807, the first camera sends the preview image at the transition magnification to the camera application. Accordingly, the camera application receives the preview image.

S808, the camera application displays the preview image at the transition magnification in the preview view box.

Repeat the above S804 and S808 until the camera application displays the preview image at the second magnification in the preview view box.

The method of determining the magnification interval and the transition magnification may refer to the embodiment described in method 700 and will not be described again here.

In the embodiment of the present application, the terminal device can respond to the user's point-and-cut operation and use the first camera to complete preview shooting at different magnifications. The first camera can sequentially obtain transition preview images at multiple transition magnifications, which is beneficial to achieving magnification. Smooth transition of preview images during point-and-cut operations, improving the zoom effect of camera applications.

In summary, the embodiment of the present application provides yet another magnification switching method 900. As shown in Figure 9, the method 900 can be applied to a terminal device equipped with a camera. The method 900 includes the following steps:

S901, display the first preview image at the first magnification acquired by the camera;

S902, in response to the user's selection operation on the second magnification, display L frame preview images corresponding to L transition magnifications, the L transition magnifications including L magnifications between the first magnification and the second magnification, L≥1 and is an integer;

S903: Display the second preview image obtained by the camera at the second magnification.

In this embodiment of the present application, before the user selects the second magnification, the terminal device may obtain the first preview image at the first magnification. After the user selects the second magnification, the terminal device can display L frames of preview images according to the L transition magnifications before displaying the second preview image, so as to smoothly transition from the first preview image to the second preview image. It is helpful to improve the zoom effect of the terminal device and improve the user experience.

The user's selection operation of the second magnification may include the user selecting the second magnification by clicking on the magnification icon as shown in Figure 1, or may also include the user selecting the second magnification among multiple magnifications in other ways. , the embodiment of the present application does not limit this.

It should be understood that the L frame preview image is used to transition from the first preview image to the second preview image, and the L frame preview image is captured by the terminal device in chronological order.

It should also be understood that the user can achieve the enlargement effect on the preview image through the selection operation of the second magnification, and the user can also achieve the reduction effect on the preview image through the selection operation of the second magnification. The embodiment of the present application does not do this. limited.

For example, the first magnification is 1x, the second magnification is 7x, and the transition magnifications from small to large are 2x, 3x, 4x, 5x, and 6x, with a total of 5 transition magnifications. Correspondingly, the terminal device can sequentially display preview images obtained by the camera at 2x, 3x, 4x, 5x, and 6x.

For example, the first magnification is 7x, the second magnification is 1x, and the transition magnifications from large to small can be 6x, 5x, 4x, 3x, and 2x, with a total of 5 transition magnifications. Correspondingly, the terminal device can sequentially display preview images obtained by the camera at 6x, 5x, 4x, 3x, and 2x.

As an optional embodiment, before S902, the method 900 further includes: determining L transition magnifications based on the first magnification and the second magnification.

In a possible implementation, L transition magnifications are determined based on the first magnification and the second magnification, including: based on the first magnification, the second magnification, the switching time between the first magnification and the second magnification, and the corresponding The time interval between adjacent frames determines L transition magnifications.

In this method, the switching duration between the first magnification and the second magnification may be the preset switching duration described in the embodiment shown in FIG. 7. For details, please refer to the description of S703, which will not be described again here. .

In a possible implementation, determining L transition magnifications based on the first magnification and the second magnification includes: determining L transition magnifications based on the first magnification, the second magnification and the preset preview image frame number.

In this method, the preset preview image frame number may be the preset preview image frame number described in the embodiment shown in FIG. 7. For details, please refer to the description of S703, which will not be described again here.

As an optional embodiment, the camera in method 900 includes a first camera and a second camera, the first preview image comes from the first camera, and the second preview image comes from the second camera. Method 900 also includes: turning on the second camera, and acquiring images through the first camera and the second camera, where the images acquired by the first camera and the second camera at the same time node are captured based on the same transition magnification. When the quality difference between the Mth frame image from the second camera and the Nth frame image from the first camera is less than or equal to the preset threshold, the first camera is closed, and the preview image displayed before closing the first camera From the first camera. Among them, the Nth frame image from the first camera is captured at the same time point and based on the same transition magnification as the Mth frame image from the second camera, N≥M≥1, N and M are integers.

In this embodiment of the present application, the user's selection operation of the second magnification involves a scene of switching between different cameras. This method of dual-channel image output through the first camera and the second camera is conducive to improving the quality of the preview image. The image algorithm of the terminal device can optimize features through more preview images, and switch the camera used for display at the appropriate time. , which is helpful to improve the stability of focus and the effect of smooth transition.

In a possible implementation, the terminal device acquires an image at a first magnification through a first camera, and displays the image acquired from the first camera, that is, the first preview image. After that, the terminal device can turn on the second camera and obtain images at the transition magnification through the first camera and the second camera. In this way, the first camera and the second camera can acquire images based on the same transition magnification at the same time point, when M≠N.

Taking Figure 6 as an example, the terminal device turns on the second camera after displaying the preview image from the first camera 1x. There are L=17 transition magnifications between 1x and 10x. The first camera and the second camera can acquire images at the transition magnifications at the same time node. Assume M=7, N=8, that is, the transition magnification corresponding to the 8th frame image from the first camera and the 7th frame image from the second camera is 4.5x, that is, the quality of the 7th frame image from the second camera is different from the quality of the 7th frame image from the second camera. The difference in quality of the 8th frame image of the first camera is less than or equal to the preset threshold, then the terminal device can turn off the first camera.

The preset threshold may be the preset threshold described in the embodiment shown in FIG. 7. For details, please refer to the description of S710, which will not be described again here.

In another possible implementation, the terminal device acquires an image at a first magnification through a first camera, and displays the image acquired from the first camera, that is, the first preview image. At the same time, the terminal device has turned on the second camera, and uses the second camera to obtain images at the first magnification but does not display the images obtained by the second camera. In this way, if the quality difference between the image acquired by the second camera at the first magnification (i.e., the first preview image) and the quality of the image acquired by the first camera at the first magnification is less than or equal to the preset threshold, At this time M=N.

Taking Figure 6 as an example, assuming that the time of starting the second camera in the figure is advanced to before the point-cut moment, the terminal device acquires the image at a magnification of 1x through the first camera and the second camera, and displays the image from the first camera at a magnification of 1x. The preview image obtained below. If the quality difference between the quality of the preview image obtained by the second camera at a magnification of 1x and the quality of the preview image obtained by the first camera at a magnification of 1x is less than or equal to the preset threshold, then the terminal device can display the image from the first camera. After the camera acquires the preview image at 1x magnification, the first camera is turned off, and then the preview image at transition magnification is acquired and displayed through the second camera until the preview image at 10x is acquired and displayed. In this case, N=M=1.

In the same way, N=M=2, N=M=3, N=M=4, etc. may also exist. Taking N=M=2 as an example, the terminal device obtains images through the first camera and the second camera at magnifications of 1x and 1.5x, and displays the preview images obtained from the first camera at magnifications of 1x and 1.5x. If the quality difference between the quality of the preview image obtained by the second camera at a magnification of 1.5x and the quality of the preview image obtained by the first camera at a magnification of 1.5x is less than or equal to the preset threshold, then the terminal device can display the image from After the first camera acquires the preview image at a magnification of 1.5x, the first camera is turned off.

It should be understood that regardless of the values of M and N, after the first camera is turned off, the terminal device can display the preview image obtained by the second camera that has been turned on to achieve a smooth transition of magnification and improve the zoom effect of the terminal device.

It should also be understood that in the above embodiment, the soft switching process before the camera is introduced by taking the terminal device including the first camera and the second camera as an example, but the embodiment of the present application does not limit the number of cameras of the terminal device. For example, the terminal device may further include a third camera, and after the user clicks the switching operation, the second camera may be switched to the third camera.

For example, the first camera is an ultra-wide-angle camera, the second camera is a wide-angle camera, and the third camera is a telephoto camera. It is assumed that the magnification range supported by the ultra-wide-angle camera is -1x, and the magnification range supported by the wide-angle camera is 1x to 3.5x, the telephoto camera supports a magnification range from 4x to 7x.

The terminal device can turn on the ultra-wide-angle camera when the magnification is -1x and display the preview image from the ultra-wide-angle camera. When the user clicks to switch the magnification within the magnification range supported by the wide-angle camera, the terminal device turns on the wide-angle camera and determines the transition magnification. , through dual-channel image output through the ultra-wide-angle camera and wide-angle camera, and display the preview image obtained from the wide-angle camera at the appropriate time. When the magnification switched by the user's click is within the magnification range supported by the telephoto camera, the terminal device turns on the telephoto camera, determines the transition magnification, outputs the image through the wide-angle camera and the telephoto camera dually, and displays the image from the telephoto camera at the appropriate time. Get the preview image. This two-way image output method facilitates the display of smooth transition preview images and improves the zoom effect of the terminal device.

Figure 10 is a schematic interface diagram of a terminal device provided by an embodiment of the present application. Taking the terminal device as a mobile phone as an example, Figure 10 shows the a interface, b interface and c interface of the mobile phone. Among them, interface a shows multiple applications in the mobile phone. For example, the user can click the camera icon to open the camera application to take pictures. After the user clicks on the camera application, the mobile phone displays interface b, which is the shooting interface. For example, interface b includes multiple magnification icons. The current magnification of the camera is 1x. The user can click on different magnification icons to switch between different magnifications. For example, if the user clicks the 5x magnification icon, the mobile phone can display interfaces c to f in sequence. In the c interface, the terminal device can display the first frame of the preview image for transition. On the d interface, the terminal device displays the second frame of the preview image for transition. On the e interface, the terminal device displays the third frame of the preview image for transition. Image, in the f interface, the terminal device can display a preview image of the final 5x interface.

It can be seen that compared with Figure 1, the magnification switching method provided by the embodiment of the present application can display multiple frames of preview images for the transition to the user after the click switching operation of the magnification occurs, so as to achieve the purpose of smooth transition. , improve the zoom effect of the terminal device and improve the user experience.

It should be understood that the number of preview images shown in FIG. 10 is only an example. In fact, preview images corresponding to the number of frames may be displayed according to the specific number of transition magnifications. This is not limited in the embodiment of the present application.

It should be understood that the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its functions and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application.

The magnification switching method according to the embodiment of the present application has been described in detail with reference to FIGS. 4 to 10 . Next, the magnification switching device according to the embodiment of the present application will be described in detail with reference to FIGS. 11 and 12 .

Figure 11 shows a schematic block diagram of a magnification switching device 1100 provided by an embodiment of the present application. The device 1100 includes an acquisition module 1110 and a processing module 1120.

The acquisition module 1110 is configured to: acquire a first preview image at a first magnification; and acquire a second preview image at a second magnification. The processing module 1120 is configured to: display the first preview image at the first magnification acquired by the camera; in response to the user's selection operation on the second magnification, display L frame preview images corresponding to L transition magnifications, where the L transition magnifications include L magnifications between the first magnification and the second magnification, L≥1 and an integer; and display the second preview image at the second magnification acquired by the camera.

Optionally, the processing module 1120 is configured to determine L transition magnifications based on the first magnification and the second magnification.

Optionally, the processing module 1120 is configured to determine L transition magnifications based on the first magnification, the second magnification, the switching duration between the first magnification and the second magnification, and the time interval between adjacent frames.

Optionally, the processing module 1120 is configured to determine L transition magnifications based on the first magnification, the second magnification and the preset preview image frame number.

Optionally, the camera includes a first camera and a second camera, the first preview image comes from the first camera, and the second preview image comes from the second camera. The processing module 1120 is used to: turn on the second camera. The acquisition module 1110 is configured to: acquire images through the first camera and the second camera, where the images acquired by the first camera and the second camera at the same time node are captured based on the same transition magnification; When the quality difference between the Mth frame image of the camera and the Nth frame image from the first camera is less than or equal to the preset threshold, the first camera is closed, and the preview image displayed before closing the first camera is from the first camera. . Among them, the Nth frame image from the first camera is captured at the same time point and at the same magnification as the Mth frame image from the second camera, N≥M≥1, and N and M are integers.

In an optional example, those skilled in the art can understand that the device 1100 can be specifically the terminal device in the above embodiment, or the functions of the terminal device in the above embodiment can be integrated in the device 1100. The above functions can be implemented by hardware, or can be implemented by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions. The apparatus 1100 may be used to execute various processes and/or steps corresponding to the terminal device in the above method embodiment.

It should be understood that the device 1100 here is embodied in the form of a functional module. The term "module" as used herein may refer to an application specific integrated circuit (ASIC), an electronic circuit, a processor (such as a shared processor, a proprietary processor, or a group of processors) used to execute one or more software or firmware programs. processor, etc.) and memory, merged logic circuitry, and/or other suitable components to support the described functionality. In this embodiment of the present application, the device 1100 in Figure 11 may also be a chip or a chip system, such as a system on chip (SoC).

Figure 12 shows a schematic block diagram of another magnification switching device 1200 provided by an embodiment of the present application. The device 1200 includes a processor 1210, a transceiver 1220, and a memory 1230. Among them, the processor 1210, the transceiver 1220 and the memory 1230 communicate with each other through internal connection paths. The memory 1230 is used to store instructions, and the processor 1210 is used to execute the instructions stored in the memory 1230 to control the transceiver 1220 to send signals and /or receive a signal.

It should be understood that the device 1200 can be specifically a terminal device in the above embodiment, or the functions of the terminal device in the above embodiment can be integrated in the device 1200, and the device 1200 can be used to perform various functions corresponding to the terminal device in the above method embodiment. steps and/or processes. Optionally, the memory 1230 may include read-only memory and random access memory and provide instructions and data to the processor. A portion of the memory may also include non-volatile random access memory. For example, the memory may also store device type information. The processor 1210 can be used to execute instructions stored in the memory, and when the processor executes the instructions, the processor can execute various steps and/or processes corresponding to the terminal device in the above method embodiment.

It should be understood that in the embodiment of the present application, the processor 1210 may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits ( ASIC), field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.

Those of ordinary skill in the art can appreciate that the modules and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented with electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each specific application, but such implementations should not be considered beyond the scope of this application.

Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, devices and modules described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be described again here.

In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of modules is only a logical function division. In actual implementation, there may be other division methods. For example, multiple modules or components may be combined or can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, indirect coupling or communication connection of devices or modules, which may be in electrical, mechanical or other forms.

The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in one place, or they may be distributed to multiple network modules. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional module in each embodiment of the present application can be integrated into one processing module, or each module can exist physically alone, or two or more modules can be integrated into one module.

If the functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of this application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk and other media that can store program code. .

The above are only specific implementation modes of the present application, but the protection scope of the embodiments of the present application is not limited thereto. Any person familiar with the technical field can easily think of changes within the technical scope disclosed in the embodiments of the present application. or replacement, all should be covered by the protection scope of the embodiments of this application. Therefore, the protection scope of the embodiments of the present application shall be subject to the protection scope of the claims.

Claims

A magnification switching method, characterized in that it is applied to a terminal device equipped with a camera, and the method includes:

Display the first preview image at the first magnification acquired by the camera;

In response to the user's selection operation on the second magnification, displaying L frame preview images corresponding to L transition magnifications, the L transition magnifications including L magnifications between the first magnification and the second magnification, L≥1 and is an integer;

Display the second preview image acquired by the camera at the second magnification.
The method according to claim 1, characterized in that, before displaying L frame preview images corresponding to L transition magnifications in response to the user's selection operation of the second magnification, the method further includes:

The L transition magnifications are determined based on the first magnification and the second magnification.
The method of claim 2, wherein determining the L transition magnifications based on the first magnification and the second magnification includes:

The L transition magnifications are determined based on the first magnification, the second magnification, the switching duration between the first magnification and the second magnification, and the time interval between adjacent frames.
The method of claim 2, wherein determining the L transition magnifications based on the first magnification and the second magnification includes:

The L transition magnifications are determined based on the first magnification, the second magnification and a preset preview image frame number.
The method according to any one of claims 1 to 4, characterized in that the camera includes a first camera and a second camera, the first preview image is from the first camera, and the second preview image from said second camera;

The method also includes:

Turn on the second camera;

Images are acquired through the first camera and the second camera, and the images acquired by the first camera and the second camera at the same time node are captured based on the same transition magnification;

When the quality difference between the Mth frame image from the second camera and the Nth frame image from the first camera is less than or equal to the preset threshold, the first camera is turned off, and the first camera is turned off. The previously displayed preview image comes from the first camera, wherein the N-th frame image from the first camera is captured at the same time node and based on the same magnification as the M-th frame image from the second camera. , N≥M≥1, N and M are integers.
A magnification switching device, characterized by comprising a module for executing the method according to any one of claims 1-5.
A magnification switching device, characterized in that it includes: a processor, the processor is coupled to a memory, the memory is used to store a computer program, and when the processor calls the computer program, the device is caused to execute as follows: The method of any one of claims 1-5.
A terminal device, characterized in that it includes: a processor, a memory and a transceiver, the memory is used to store instructions, the transceiver is used to communicate with other devices, the processor is used to execute instructions stored in the memory , so that the terminal device performs the method according to any one of claims 1-5.
A computer-readable storage medium, characterized in that it is used to store a computer program, which when the computer program is run on a computer, causes the computer to execute the method according to any one of claims 1-5.
A computer program product, characterized in that the computer program product includes computer program code. When the computer program code is run on a computer, the computer implements the method described in any one of claims 1-5. Methods.