WO2023160179A9 - Procédé de commutation de grossissement et appareil de commutation de grossissement - Google Patents

Procédé de commutation de grossissement et appareil de commutation de grossissement Download PDF

Info

Publication number
WO2023160179A9
WO2023160179A9 PCT/CN2022/140486 CN2022140486W WO2023160179A9 WO 2023160179 A9 WO2023160179 A9 WO 2023160179A9 CN 2022140486 W CN2022140486 W CN 2022140486W WO 2023160179 A9 WO2023160179 A9 WO 2023160179A9
Authority
WO
WIPO (PCT)
Prior art keywords
magnification
camera
transition
terminal device
preview image
Prior art date
Application number
PCT/CN2022/140486
Other languages
English (en)
Chinese (zh)
Other versions
WO2023160179A1 (fr
Inventor
许集润
Original Assignee
荣耀终端有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 荣耀终端有限公司 filed Critical 荣耀终端有限公司
Publication of WO2023160179A1 publication Critical patent/WO2023160179A1/fr
Publication of WO2023160179A9 publication Critical patent/WO2023160179A9/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72439—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00—Reducing energy consumption in communication networks
    • Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks

Definitions

  • the present application relates to the field of terminals, and more specifically, to a magnification switching method and a magnification switching device.
  • terminal devices for example, mobile phones.
  • the camera realizes the zoom function through magnification switching.
  • the user starts preview shooting through the camera at a first magnification (for example, 1x). If the user wants to shoot a distant object through the terminal device, the user can click the magnification icon of the second magnification (for example, 5x) to Switch the magnification, and then preview and shoot at the second magnification.
  • a first magnification for example, 1x
  • the user can click the magnification icon of the second magnification (for example, 5x) to Switch the magnification, and then preview and shoot at the second magnification.
  • the camera's field of view jumps directly from the first magnification to the second magnification, and the user will see the preview image at the first magnification jump directly to the third magnification.
  • the preview image at double magnification will have the problem of stiff transition in the preview image, which will make the zoom effect of the terminal device poor and reduce the user experience.
  • This application provides a magnification switching method and a magnification switching device, which are conducive to achieving a smooth transition of preview images under a magnification click switching operation and improving the zoom effect of the terminal device.
  • a magnification switching method is provided, which is applied to a terminal device equipped with a camera.
  • the method includes: displaying a first preview image at a first magnification acquired by the camera.
  • L frame preview images corresponding to L transition magnifications are displayed, the L transition magnifications include L magnifications between the first magnification and the second magnification, L ⁇ 1 and is an integer .
  • the terminal device may obtain the first preview image at the first magnification.
  • the terminal device may display L frames of preview images according to L transition magnifications before displaying the second preview image. In this way, L is added before the first preview image is switched to the second preview image.
  • the frame is used for the transition of the preview image, which can make the preview image displayed by the terminal device smoothly transition, which is conducive to improving the zoom effect of the terminal device and improving the user experience.
  • the method before displaying L frame preview images corresponding to L transition magnifications in response to the user's selection operation of the second magnification, the method further includes: based on the first magnification and the second magnification, determine L transition magnifications.
  • L transition magnifications are determined based on the first magnification and the second magnification, including: based on the first magnification, the second magnification, the first magnification and the second magnification.
  • the switching duration between frames and the time interval between adjacent frames determine L transition magnifications.
  • the terminal device can determine L transition magnifications based on the switching duration between the first magnification and the second magnification and the time interval between adjacent frames. This is conducive to completing the transition from the first magnification to the first magnification within the switching duration. Smooth transition to second magnification.
  • L transition magnifications are determined based on the first magnification and the second magnification, including: based on the first magnification, the second magnification and a preset preview The number of image frames determines the L transition magnifications.
  • the camera of the terminal device includes a first camera and a second camera
  • the first preview image is from the first camera
  • the second preview image is from the Describe the second camera.
  • the method also includes: turning on the second camera. Images are acquired through the first camera and the second camera, where the images acquired by the first camera and the second camera at the same time node are captured based on the same transition magnification.
  • the quality difference between the Mth frame image from the second camera and the Nth frame image from the first camera is less than or equal to the preset threshold
  • the first camera is closed, and the preview image displayed before closing the first camera From the first camera.
  • the Nth frame image from the first camera is captured at the same time point and at the same magnification as the Mth frame image from the second camera, N ⁇ M ⁇ 1, and N and M are integers.
  • the second camera can acquire images based on the first magnification at the same time point as the first camera, but the terminal device displays the first preview image from the first camera, and the terminal device can acquire the image based on the first magnification with the second camera.
  • the terminal device may acquire an image based on a first magnification through a first camera, and display the first preview image from the first camera. After that, the terminal device can turn on the second camera, acquire images through the first camera and the second camera at the same time point based on the same transition magnification, and display the preview image from the first camera until the Mth image from the second camera. If the difference between the quality of the frame image and the quality of the Nth frame image from the first camera is less than or equal to the preset threshold, the first camera is turned off. In this case, M ⁇ N.
  • the terminal device can output pictures through the first camera and the second camera, and close the first camera at the appropriate time. From opening the second camera to closing the first camera, the first camera and the second camera are realized. The soft switching between them is conducive to obtaining a preview image with a smoother transition.
  • a magnification switching device including an acquisition module and a processing module.
  • the acquisition module is used to: acquire the first preview image at the first magnification; and acquire the second preview image at the second magnification.
  • the processing module is used to: display the first preview image at the first magnification acquired by the camera; in response to the user's selection operation of the second magnification, display L frame preview images corresponding to L transition magnifications, the L transition magnifications include L magnifications between the first magnification and the second magnification, L ⁇ 1 and is an integer; and display the second preview image at the second magnification acquired by the camera.
  • the processing module is configured to: determine L transition magnifications based on the first magnification and the second magnification.
  • the processing module is configured to: based on the first magnification, the second magnification, the switching duration between the first magnification and the second magnification, and the switching duration between adjacent frames. time interval, determine L transition magnifications.
  • the processing module is configured to: determine L transition magnifications based on the first magnification, the second magnification and the preset number of preview image frames.
  • the camera includes a first camera and a second camera
  • the first preview image comes from the first camera
  • the second preview image comes from the second camera.
  • the processing module is used for: turning on the second camera.
  • the acquisition module is configured to acquire images through the first camera and the second camera, where the images acquired by the first camera and the second camera at the same time node are captured based on the same transition magnification.
  • the processing module is also configured to: when the quality difference between the Mth frame image from the second camera and the Nth frame image from the first camera is less than or equal to a preset threshold, close the first camera, and close the first camera.
  • the preview image previously displayed by the camera is from the first camera.
  • the Nth frame of rabbit food from the first camera and the Mth frame of image from the second camera are captured at the same time node and based on the same magnification, N ⁇ M ⁇ 1, N and M are integers.
  • a third aspect provides another magnification switching device, including a processor, which is coupled to a memory and can be used to execute instructions in the memory to implement the method in any of the possible implementations of the first aspect.
  • the device further includes memory.
  • the device further includes a communication interface, and the processor is coupled to the communication interface.
  • the magnification switching device is a terminal device.
  • the communication interface may be a transceiver or an input/output interface.
  • the magnification switching device is a chip configured in the terminal device.
  • the communication interface may be an input/output interface.
  • a processor including: an input circuit, an output circuit and a processing circuit.
  • the processing circuit is configured to receive signals through the input circuit and transmit signals through the output circuit, so that the processor executes the method in any of the possible implementations of the first aspect.
  • the above-mentioned processor can be a chip, the input circuit can be an input pin, the output circuit can be an output pin, and the processing circuit can be a transistor, a gate circuit, a flip-flop, and various logic circuits.
  • the input signal received by the input circuit may be received and input by, for example, but not limited to, the receiver, and the signal output by the output circuit may be, for example, but not limited to, output to and transmitted by the transmitter, and the input circuit and the output A circuit may be the same circuit that functions as an input circuit and an output circuit at different times.
  • This application does not limit the specific implementation methods of the processor and various circuits.
  • a processing device including a processor and a memory.
  • the processor is used to read instructions stored in the memory, and can receive signals through a receiver and transmit signals through a transmitter to execute the method in any of the possible implementations of the first aspect.
  • processors there are one or more processors and one or more memories.
  • the memory may be integrated with the processor, or the memory may be provided separately from the processor.
  • the memory can be a non-transitory memory, such as a read-only memory (ROM), which can be integrated on the same chip as the processor, or can be set in different On the chip, this application does not limit the type of memory and the arrangement of the memory and the processor.
  • ROM read-only memory
  • sending instruction information may be a process of outputting instruction information from the processor
  • receiving capability information may be a process of the processor receiving input capability information.
  • the data output by the processing can be output to the transmitter, and the input data received by the processor can come from the receiver.
  • the transmitter and receiver can be collectively called a transceiver.
  • the processing device in the above fifth aspect can be a chip, and the processor can be implemented by hardware or software.
  • the processor can be a logic circuit, an integrated circuit, etc.; when implemented by software,
  • the processor can be a general-purpose processor, which is implemented by reading the software code stored in the memory.
  • the memory can be integrated in the processor, or can be located outside the processor and exist independently.
  • a computer program product includes: computer program code.
  • the computer program code When the computer program code is run, it causes the computer to execute the method in any of the possible implementations of the first aspect.
  • a computer-readable storage medium stores a computer program. When the computer program is run, it causes the computer to execute the method in any of the possible implementations of the first aspect. .
  • Figure 1 is a schematic diagram of the interface of a terminal device
  • Figure 2 is a schematic diagram of the drawing principle of a point-cut operation
  • Figure 3 is a schematic flow chart of a drawing method for point-cut operation
  • Figure 4 is a schematic structural diagram of a terminal device applicable to the embodiment of the present application.
  • Figure 5 is a software structure block diagram of a terminal device applicable to the embodiment of the present application.
  • Figure 6 is a schematic diagram of the drawing principle of a point-cut operation provided by the embodiment of the present application.
  • Figure 7 is a schematic flow chart of a magnification switching method provided by an embodiment of the present application.
  • Figure 8 is a schematic flow chart of another magnification switching method provided by an embodiment of the present application.
  • Figure 9 is a schematic flow chart of yet another magnification switching method provided by an embodiment of the present application.
  • Figure 10 is a schematic interface diagram of a terminal device provided by an embodiment of the present application.
  • Figure 11 is a schematic block diagram of a magnification switching device provided by an embodiment of the present application.
  • Figure 12 is a schematic block diagram of another magnification switching device provided by an embodiment of the present application.
  • APP camera application
  • magnification click switching which can be referred to as point switching
  • Figure 1 is a schematic diagram of the interface of a terminal device. Taking the terminal device as an example of a mobile phone, Figure 1 shows the a interface, b interface and c interface of the mobile phone.
  • the a interface shows multiple applications in the mobile phone.
  • the user can click the camera icon to open the camera application. Take photos.
  • the mobile phone displays interface b, which is the shooting interface.
  • interface b includes multiple magnification icons.
  • the current magnification of the camera is 1x.
  • the user can click on different magnification icons to switch between different magnifications.
  • the user clicks on the 5x magnification icon and the mobile phone can display the c interface.
  • the magnification has been switched to 5x, and the mobile phone can obtain a preview image at a 10x magnification.
  • the mobile phone can display a preview image of the object to be photographed in the b interface through the camera at a magnification of 1x, and the camera's field of view (FOV) is maintained at 1x.
  • FOV field of view
  • the phone can display a preview image of the object to be photographed in the c interface at 5x magnification through the camera, and the camera's FOV is maintained at 10x.
  • Figure 2 is a schematic diagram of the drawing principle of a point-cut operation.
  • the camera of the mobile phone can include a main camera lens and a telephoto lens.
  • the FOV of the main camera lens is maintained at 1x magnification and continues to capture a preview image, and the preview image is displayed on the display.
  • the mobile phone can switch from the main camera lens to the telephoto lens, and the FOV of the telephoto lens remains at the 10x magnification.
  • FIG. 3 is a schematic flowchart of a drawing drawing method 300 for a point-and-cut operation.
  • Method 300 includes the following steps:
  • the first camera produces a picture at the first magnification and sends it to the display.
  • the camera application in response to the user's point-cut operation, sends a magnification switching request message to the hardware abstraction layer (HAL).
  • the magnification switching request message is used to request switching from the first magnification to the second magnification.
  • the magnification switching The request message includes the second magnification.
  • the hardware abstraction layer receives the rate switching request message.
  • the hardware abstraction layer sends a camera close request message to the first camera.
  • the camera close request message is used to request to close the first camera.
  • the first camera receives the camera closing request message.
  • the hardware abstraction layer sends a camera start request message to the second camera.
  • the camera start request message is used to request to start the second camera.
  • the camera start request message includes the second magnification.
  • the second camera receives the camera start request message.
  • drawing means that the camera captures the object and obtains a preview image
  • sending and displaying means displaying the preview image on the display screen.
  • the preview image can be displayed in a preview view box built by the camera application.
  • the FOV of the camera directly jumps from the first magnification (which can be 1x in Figure 1 or Figure 2 above) to the second magnification ( It can be 5x in Figure 1 or 10x in Figure 2). This will cause the preview image seen by the user to jump and the transition will be stiff, resulting in a poor zoom effect of the camera application and a poor user experience.
  • embodiments of the present application provide a magnification switching method and a magnification switching device.
  • the terminal device can introduce multi-frame transition preview images in the process of magnification point switching to achieve magnification
  • the smooth transition of the preview image during point-and-click switching will help improve the zoom effect of the camera application, thus improving the user experience.
  • the first, second and various numerical numbers are only for convenience of description and are not used to limit the scope of the embodiments of the present application. For example, distinguish between different preview images, distinguish between different cameras, etc.
  • “at least one” refers to one or more, and “plurality” refers to two or more.
  • “And/or” describes the association of associated objects, indicating that there can be three relationships, for example, A and/or B, which can mean: A exists alone, A and B exist simultaneously, and B exists alone, where A, B can be singular or plural.
  • the character "/” generally indicates that the related objects are in an "or” relationship.
  • “At least one of the following” or similar expressions thereof refers to any combination of these items, including any combination of a single item (items) or a plurality of items (items).
  • At least one of a, b and c can mean: a, or b, or c, or a and b, or a and c, or b and c, or a, b and c, where a, b, c can be single or multiple.
  • the terminal device in the embodiment of the present application can be a handheld device, a vehicle-mounted device, etc. with a wireless connection function.
  • the terminal device can also be called a terminal (terminal), user equipment (UE), mobile station (MS) ), mobile terminal (mobile terminal, MT), etc.
  • terminals are: mobile phones, tablets, smart TVs, laptops, tablets (Pad), handheld computers, mobile Internet devices (mobile internet device, MID), virtual reality (VR) ) equipment, augmented reality (AR) equipment, wireless terminals in industrial control, wireless terminals in self-driving, wireless terminals in remote medical surgery, smart grids ( Wireless terminals in smart grid, wireless terminals in transportation safety, wireless terminals in smart city, wireless terminals in smart home, cellular phones, cordless phones, session initiation protocols (session initiation protocol, SIP) telephone, wireless local loop (WLL) station, personal digital assistant (personal digital assistant, PDA), handheld device with wireless communication capabilities, computing device or other device connected to a wireless modem Processing equipment, vehicle-mounted equipment, wearable equipment, terminal equipment in the 5G network or terminal equipment in the future evolved public land mobile communication network (public land mobile network, PLMN), etc., the embodiments of the present application adopt the method for the terminal equipment Specific technologies and specific equipment forms are not limited.
  • the terminal device may also be a wearable device.
  • Wearable devices can also be called wearable smart devices. It is a general term for applying wearable technology to intelligently design daily wear and develop wearable devices, such as glasses, gloves, watches, clothing and shoes, etc.
  • a wearable device is a portable device that is worn directly on the body or integrated into the user's clothing or accessories. Wearable devices are not just hardware devices, but also achieve powerful functions through software support, data interaction, and cloud interaction.
  • wearable smart devices include full-featured, large-sized devices that can achieve complete or partial functions without relying on smartphones, such as smart watches or smart glasses, and those that only focus on a certain type of application function and need to cooperate with other devices such as smartphones.
  • the terminal device may be a device for realizing the function of the terminal device, or a device that can support the terminal device to realize the function, such as a chip system, and the device may be installed in the terminal.
  • the chip system may be composed of chips, or may include chips and other discrete devices.
  • the terminal equipment in the embodiment of this application may also be called: user equipment (UE), mobile station (MS), mobile terminal (mobile terminal, MT), access terminal, user unit, user station, Mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication equipment, user agent or user device, etc.
  • UE user equipment
  • MS mobile station
  • MT mobile terminal
  • access terminal user unit, user station, Mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication equipment, user agent or user device, etc.
  • FIG. 4 is a schematic structural diagram of a terminal device applicable to the embodiment of the present application.
  • the terminal device 400 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, and a power management module 141.
  • Battery 142 antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone interface 170D, sensor 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and subscriber identification module (subscriber identification module, SIM) card interface 195, etc.
  • SIM subscriber identification module
  • the processor 110 may include one or more processing units.
  • the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, display processing unit (display process unit, DPU), and/or neural network processor (neural-network processing unit, NPU), etc.
  • different processing units can be independent devices or integrated in one or more processors.
  • the terminal device 400 may also include one or more processors 110.
  • the processor may be the nerve center and command center of the terminal device 400 .
  • the processor can generate operation control signals based on the instruction opcode and timing signals to complete the control of fetching and executing instructions.
  • the processor 110 may also be provided with a memory for storing instructions and data.
  • the memory in processor 110 is cache memory.
  • the memory may hold instructions or data used or recycled by processor 110 . If the processor 110 needs to use the instructions or data again, it can be called directly from the memory. This avoids repeated access and reduces the waiting time of the processor 110, thereby improving the efficiency of the terminal device 400.
  • processor 110 may include one or more interfaces.
  • Interfaces may include integrated circuit (inter-integrated circuit, I2C) interface, integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, pulse code modulation (pulse code modulation, PCM) interface, universal asynchronous receiver and transmitter (universal asynchronous receiver/transmitter (UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and /or USB interface, etc.
  • the USB interface 130 is an interface that complies with USB standard specifications, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc.
  • the USB interface 130 can be used to connect a charger to charge the terminal device 400, and can also be used to transmit data between the terminal device 400 and peripheral devices. It can also be used to connect headphones to play audio through them.
  • the interface connection relationships between the modules illustrated in the embodiment of the present application are schematic illustrations and do not constitute a structural limitation on the terminal device 400 .
  • the terminal device 400 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
  • the wireless communication function of the terminal device 400 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in terminal device 400 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example: Antenna 1 can be reused as a diversity antenna for a wireless LAN. In other embodiments, antennas may be used in conjunction with tuning switches.
  • the mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G applied to the terminal device 400.
  • the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier, etc.
  • the mobile communication module 150 can receive electromagnetic waves through the antenna 1, perform filtering, amplification and other processing on the received electromagnetic waves, and transmit them to the modem processor for demodulation.
  • the mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves through the antenna 1 for radiation.
  • at least part of the functional modules of the mobile communication module 150 may be disposed in the processor 110 .
  • at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.
  • a modem processor may include a modulator and a demodulator.
  • the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal.
  • the demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the application processor outputs sound signals through audio devices (not limited to speaker 170A, receiver 170B, etc.), or displays images or videos through display screen 194.
  • the modem processor may be a stand-alone device.
  • the modem processor may be independent of the processor 110 and may be provided in the same device as the mobile communication module 150 or other functional modules.
  • the wireless communication module 160 can provide applications on the terminal device 400 including wireless local area networks (WLAN), Bluetooth, global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), NFC, Infrared technology (infrared, IR) and other wireless communication solutions.
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 .
  • the wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.
  • the antenna 1 of the terminal device 400 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the terminal device 400 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include GSM, GPRS, CDMA, WCDMA, TD-SCDMA, LTE, GNSS, WLAN, NFC, FM, and/or IR technology, etc.
  • the above-mentioned GNSS can include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (quasi) -zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite based augmentation systems
  • the terminal device 400 can implement display functions through a GPU, a display screen 194, an application processor, and the like.
  • Application processors may include NPUs and/or DPUs.
  • the GPU is an image processing microprocessor and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 110 may include one or more GPUs that execute instructions to generate or alter display information.
  • NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can continuously learn by itself.
  • the NPU can realize intelligent cognitive applications of the terminal device 400, such as image recognition, face recognition, speech recognition, text understanding, etc.
  • the DPU is also called the display sub-system (display sub-system, DSS).
  • the DPU is used to adjust the color of the display screen 194.
  • the DPU can adjust the color of the display screen through a color three-dimensional lookup table (3D look up table, 3D LUT). Adjustment.
  • the DPU can also perform image scaling, noise reduction, contrast enhancement, backlight brightness management, HDR processing, display parameter Gamma adjustment, etc.
  • the display screen 194 is used to display images, videos, etc.
  • Display 194 includes a display panel.
  • the display panel can use a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode).
  • LCD liquid crystal display
  • OLED organic light-emitting diode
  • AMOLED organic light-emitting diode
  • FLED flexible light-emitting diode
  • Miniled MicroLed, Micro-oLed or quantum dot light emitting diode (QLED).
  • the terminal device 400 may include 1 or N display screens 194, where N is a positive integer greater than 1.
  • the terminal device 400 can implement the shooting function through an ISP, one or more cameras 193, a video codec, a GPU, one or more display screens 194, and an application processor.
  • the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device 400.
  • the external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function. For example, save data files such as music, photos, videos, etc. on an external memory card.
  • Internal memory 121 may be used to store one or more computer programs including instructions.
  • the processor 110 can execute the above instructions stored in the internal memory 121 to cause the terminal device 400 to execute various functional applications, data processing, and the like.
  • the internal memory 121 may include a program storage area and a data storage area. Among them, the stored program area can store the operating system; the stored program area can also store one or more application programs (such as gallery, contacts, etc.). The storage data area can store data created during use of the terminal device 400 (such as photos, contacts, etc.).
  • the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.
  • the processor 110 can cause the terminal device 400 to perform various functional applications and data processing by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor 110 .
  • the terminal device 400 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. For example, music playback, recording, etc.
  • the audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert analog audio input into a digital audio signal. Audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be provided in the processor 110 , or some functional modules of the audio module 170 may be provided in the processor 110 .
  • Speaker 170A also called “speaker" is used to convert audio electrical signals into sound signals.
  • the terminal device 400 can listen to music through the speaker 170A, or listen to a hands-free call.
  • Receiver 170B also called “earpiece” is used to convert audio electrical signals into sound signals.
  • the voice can be heard by bringing the receiver 170B close to the human ear.
  • Microphone 170C also known as “microphone” or “microphone” is used to convert sound signals into electrical signals.
  • the user can speak close to the microphone 170C with the human mouth and input the sound signal to the microphone 170C.
  • the terminal device 400 may be provided with at least one microphone 170C.
  • the terminal device 400 may be provided with two microphones 170C, which in addition to collecting sound signals, may also implement a noise reduction function. In other embodiments, the terminal device 400 can also be equipped with three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions, etc.
  • the headphone interface 170D is used to connect wired headphones.
  • the headphone interface 170D can be a USB interface 130, or it can be a 3.5mm open mobile terminal platform (OMTP) standard interface, or it can be a cellular telecommunications industry association of the USA (CTIA) standard. interface.
  • OMTP open mobile terminal platform
  • CTIA cellular telecommunications industry association of the USA
  • the sensors 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and an ambient light sensor 180L. , bone conduction sensor 180M, etc.
  • the software system of the terminal device 400 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.
  • the embodiment of this application takes the Android system with a layered architecture as an example to illustrate the software structure of the terminal device 400 .
  • FIG. 5 is a software structure block diagram of a terminal device applicable to the embodiment of the present application.
  • the layered architecture divides the software system of the terminal device 400 into several layers, and each layer has clear roles and division of labor.
  • the layers communicate through software interfaces.
  • the Android system can be divided into application layer (application, APP), application framework layer (application framework), Android runtime (Android runtime) and system library, hardware abstraction layer (HAL) ) and the kernel layer.
  • the terminal device 400 also includes hardware (eg, camera, display screen).
  • the application layer can include a series of application packages.
  • the application layer runs applications by calling the application programming interface (API) provided by the application framework layer.
  • API application programming interface
  • the application package can include applications such as camera, calendar, map, phone, music, WLAN, Bluetooth, video, social, gallery, navigation, short message, etc.
  • the application framework layer provides APIs and programming frameworks for applications in the application layer.
  • the application framework layer includes some predefined functions.
  • the framework layer provides programming services (for example, camera services, media services) to the application layer through API interfaces.
  • the application framework layer can include a window manager, content provider, resource manager, notification manager, view system, phone manager, etc.
  • a window manager is used to manage window programs.
  • the window manager can obtain the display size, determine whether there is a status bar, lock the screen, capture the screen, etc.
  • Content providers are used to store and retrieve data and make this data accessible to applications.
  • Data can include video images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
  • the view system includes visual controls, such as controls that display text, controls that display pictures, etc.
  • a view system can be used to build applications.
  • the display interface can be composed of one or more views.
  • a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.
  • the phone manager is used to provide communication functions of the terminal device 400 .
  • call status management including connected, hung up, etc.
  • the resource manager provides various resources to applications, such as localized strings, icons, pictures, layout files, video files, etc.
  • the notification manager allows applications to display notification information in the status bar, which can be used to convey notification-type messages and can automatically disappear after a short stay without user interaction.
  • the notification manager is used to notify download completion, message reminders, etc.
  • the notification manager can also be notifications that appear in the status bar at the top of the system in the form of charts or scroll bar text, such as notifications for applications running in the background, or notifications that appear on the screen in the form of conversation windows. For example, text information is prompted in the status bar, a prompt sound is emitted, the terminal device 400 vibrates, and the indicator light flashes, etc.
  • the Android runtime includes core libraries and a virtual machine.
  • the Android runtime is responsible for the scheduling and management of the Android system.
  • the core library contains two parts: one part is the functional functions that need to be called by the Java language used by the Java API framework, and the other part is the core library of Android.
  • the application layer and application framework layer run in virtual machines.
  • the virtual machine executes the java files of the application layer and application framework layer into binary files.
  • the virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection and other functions.
  • System libraries can include multiple functional modules. For example: surface manager (surface manager), media libraries (media libraries), 3D graphics processing libraries (for example: OpenGL ES), 2D graphics engines (for example: SGL), etc.
  • the surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc.
  • the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, composition and layer processing.
  • 2D Graphics Engine is a drawing engine for 2D drawing.
  • the hardware abstraction layer is an abstract interface of the device kernel driver, which provides application program interfaces for accessing underlying devices to higher-level Java API frameworks.
  • the hardware abstraction layer can include multiple library modules, each of which can implement an interface for a specific type of hardware component, for example, a camera interface, etc.
  • the Android system loads a library module for that hardware component.
  • the library module includes a shearing control module and a multi-shot control module.
  • the shear control module is used to determine the magnification interval to obtain the ratio between the first magnification and the second magnification. multiple transition magnifications between.
  • the multi-camera control module is used to start or stop cameras, and to switch between cameras.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer is used to drive the hardware and make the hardware work.
  • the kernel layer contains a camera driver.
  • the hardware layer includes a camera module and a display screen, where the camera module includes at least one camera.
  • terminal device in the embodiment of the present application may have the architecture shown in FIG. 4 and/or FIG. 5, but the embodiment of the present application is not limited to this.
  • the camera module of the terminal device includes a first camera and a second camera.
  • the process of magnification point switching may involve switching between the first camera and the second camera.
  • the user can use the third camera to The first camera and the second camera provide a richer video and photo experience.
  • the magnification click switching process in this scenario is introduced below with reference to Figures 6 and 7.
  • FIG. 6 is a schematic diagram of the drawing principle of a point cutting operation provided by an embodiment of the present application.
  • the terminal device as an example including a first camera (for example, a main camera lens) and a second camera (for example, a telephoto lens)
  • the first camera for example, before the user performs a magnification point-and-cut operation, the first camera
  • the FOV is maintained at 1x magnification to acquire images, and a preview image is displayed on the display.
  • the terminal device can determine the magnification interval, between the first magnification and the second magnification. Divide the gears to obtain multiple transition magnifications between 1x and 10x. As shown in Figure 6, taking the magnification interval as 0.5x as an example, the multiple transition magnifications that the terminal device can obtain after 1x include: 1.5x, 2x, 2.5x, 3x, 3.5x, 4x, 4.5x, 5x, 5.5 x, 6x, 6.5x, 7x, 7.5x, 8x, 8.5x, 9x, 9.5x.
  • the camera of the terminal device (the first camera and/or the second camera) can sequentially obtain images according to multiple transition magnifications in order from small to large.
  • the terminal device obtains and displays the preview image at 10x to complete the smooth transition of the preview image.
  • the terminal device can start the second camera before acquiring the preview image at the first transition magnification (1.5x) after the user performs a point-and-cut operation on the second magnification.
  • the terminal device in response to the user's operation of switching from the magnification point of 1x to 10x, the terminal device first determines the magnification interval to be 0.5x, and then the terminal device determines that the next magnification after 1x is 1.5x.
  • the terminal device can make the magnification transition during the magnification transition.
  • Start the second camera to get preview images before 1.5x.
  • the first camera can sequentially obtain multi-frame transition preview images at 1.5x, 2x, 2.5x, 3x, 3.5x, and 4x, and display them in the preview view box sequentially Multi-frame transition preview image.
  • the second camera can sequentially acquire multi-frame images at 1.5x, 2x, 2.5x, 3x, 3.5x, and 4x, but these multi-frame images are not displayed in the preview view box.
  • the terminal The device can stop the first camera after displaying the preview image acquired by the first camera at 4.5x, and switch to the second camera to acquire 5x, 5.5x, 6x, 6.5x, 7x, 7.5x, 8x, 8.5x, Multi-frame images at 9x and 9.5x, and multiple-frame preview images are displayed in the preview view box in sequence.
  • the terminal device can obtain preview images at multiple transition magnifications by determining the magnification interval, and display them in the preview view box sequentially. This can achieve a smooth transition from the 1x point to 10x.
  • the preview view A preview image with smooth transition is displayed in the frame to improve the zoom effect of the terminal device.
  • the terminal device can activate the second camera to realize two-way picture output from the first camera and the second camera. This is conducive to realizing soft switching between the first camera and the second camera and easing the differences in switching.
  • the issue of stiff preview image transition caused by the camera has improved the zoom effect of the terminal device in different camera switching scenarios.
  • magnification switching method according to the embodiment of the present application will be introduced below with reference to FIG. 7 , based on the operations performed by each layer in the layered architecture.
  • Figure 7 is a schematic flow chart of a magnification switching method 700 provided by an embodiment of the present application.
  • the steps of method 700 can be executed by the above-mentioned terminal device 400.
  • the camera module of the terminal device 400 can include a first camera and a second camera.
  • the hardware abstraction layer of the terminal device 400 includes a shearing control module and a multi-camera control module.
  • Method 700 includes the following steps:
  • the first camera produces a picture at the first magnification and sends it to the display.
  • the camera application sends a magnification switching request message to the shearing control module.
  • the magnification switching request message is used to request switching from the first magnification to the second magnification.
  • the magnification switching request message includes the first magnification. and second magnification.
  • the shearing control module receives the magnification switching request message.
  • the shearing control module determines the magnification interval according to the preset parameters.
  • the preset parameters include a preset switching duration or a preset number of preview image frames.
  • the switching duration indicates the time limit for the terminal device to switch from the preview view at the first magnification to the preview image at the second magnification in the preview view box after the user performs a magnification point switching operation.
  • the number of frames of the preview image indicates the number of frames of the preview image required for the transition that the terminal device can display in the preview view frame the preview image at the second magnification.
  • the switching duration is 0.1s
  • the transition time between preview images at adjacent transition magnifications is 0.02s. If you want to switch from 1x to 5x, up to 5 preview image transitions can be completed within 1s, then The terminal equipment can determine the magnification interval to be 1x, realizing the transition from 1x, 2x, 3x, 4x, and up to 5x, with a total time of 0.08s. The terminal device can also determine the magnification interval to be 2x. The first transition from 1x, 3x to 5x takes a total of 0.04s.
  • the number of preview image frames is 3 frames. If you want to switch from 1x to 5x, the terminal device can determine the magnification interval to be 1x to realize the transition from 1x, 2x, 3x, 4x, and up to 5x for preview of the transition.
  • the number of frames of the image is 3 frames.
  • the number of preview image frames is 7, and the terminal device can also determine the magnification interval to be 0.5x to realize the transition from 1x, 1.5x, 2x, 2.5x, 3x, 3.5x, 4x, 4.5x to 5x, using
  • the number of frames for the transition preview image is 7 frames.
  • the terminal device can determine a finer magnification interval.
  • the specific value of the magnification interval in the embodiment of the present application is not limited.
  • the shearing control module determines the transition magnification according to the magnification interval.
  • the multi-camera control module sends a camera hold request message to the first camera.
  • the camera hold request message is used to request the first camera to stay on.
  • the camera hold request message may include a transition magnification.
  • the first camera receives the camera hold request message.
  • the first camera continues to be turned on to obtain a preview image at a transition magnification.
  • the first camera sends the preview image at the transition magnification to the camera application. Accordingly, the camera application receives the preview image.
  • the camera application displays the preview image at the transition magnification in the preview view box.
  • the camera application displays the preview image obtained by the first camera in the preview view box. After switching from the first camera to the second camera, the camera application displays the preview image obtained by the second camera in the preview view box.
  • the multi-camera control module sends a camera start request message to the second camera.
  • the camera start request message is used to request to start the second camera.
  • the camera start request message may include a transition magnification.
  • the second camera receives the camera start request message.
  • the second camera is turned on to obtain a preview image at a transition magnification.
  • the preset condition may include: the difference between the quality of the image obtained by the second camera at the target transition magnification and the quality of the image obtained by the first camera at the target transition magnification is less than or equal to the preset threshold.
  • the peak signal-to-noise ratio (PSNR) of the image is used as an evaluation index to evaluate the quality of the image.
  • the preset threshold is 5dB
  • the image obtained by the second camera at the target transition magnification is The PSNR is 40dB.
  • the PSNR of the image obtained by the first camera at the target transition magnification is 43dB, and the difference is 3dB ⁇ 5dB.
  • the multi-camera control module can control the first camera to turn off, switch to the second camera to continuously acquire images and display them in the preview view. A preview image is displayed in the box.
  • the shear control module can determine the first transition magnification after the first magnification of 1x based on the magnification interval. 1.5x, then the first camera obtains the preview image under 1.5x and sends it to the camera application to display the preview image under 1.5x in the preview view box, and the second camera also obtains the preview image under 1.5x but not in the preview view box show. After that, the shearing control module can determine the transition magnification after 1.5x to be 2x based on the magnification interval.
  • the first camera obtains the preview image at 2x and sends it to the camera application to display the preview image at 2x in the preview view box.
  • the second camera The camera also obtains the preview image at 2x but does not display it in the preview view box.
  • the first camera sequentially obtains and displays the subsequent transition magnifications (2.5x, 3x, 3.5x, 4x, 4.5x, 5x) in the preview view box.
  • the second camera sequentially acquires preview images at subsequent transition magnifications (2.5x, 3x, 3.5x, 4x, 4.5x, 5x) but does not display them in the preview view box.
  • the mean square error (MSE), signal-to-noise ratio (SNR) or mean absolute error (MAE) of the image can also be used as a criterion to evaluate the quality of the image.
  • MSE mean square error
  • SNR signal-to-noise ratio
  • MAE mean absolute error
  • the multi-camera control module sends a camera close request message to the first camera.
  • the camera close request message is used to request to close the first camera.
  • the first camera receives the camera closing request message.
  • the second camera obtains a preview image at a transition magnification after the target transition magnification.
  • S714 The second camera sends the preview image at the transition magnification after the target transition magnification to the camera application, and accordingly, the camera application receives the preview image.
  • the first camera is turned off, and the second camera continues to produce pictures and sends the preview image to the preview view box for display, thus completing the soft switching between cameras.
  • the camera application displays the preview image at the transition magnification after the target transition magnification in the preview view box.
  • the second camera obtains a preview image at 5.5x and sends the preview image to the preview view box for display, and so on.
  • the second camera sequentially acquires preview images at subsequent transition magnifications (6x, 6.5x, 7x, 7.5x, 8x, 8.5x, 9x, 9.5x), and the camera application displays the subsequent transition magnifications in the preview view box preview image until the camera app displays the preview image at the second magnification (10x) in the preview view box.
  • a smooth transition of the preview image can be achieved during the magnification point switching process, thereby improving the zoom effect of the terminal device.
  • the shearing control module can determine the transition magnification in sequence according to the magnification interval.
  • the shear control module can also directly determine multiple transition magnifications.
  • the multiple transition magnifications can be equally spaced or unequal spaced. This is not limited in the embodiment of the present application.
  • the camera module of the terminal device includes at least one camera.
  • the same camera can obtain preview images at different magnifications and display them in the preview view box, that is, There is no switching between cameras involved.
  • the magnification click switching process in this scenario is introduced below with reference to Figure 8.
  • FIG. 8 is a schematic flow chart of another magnification switching method 800 provided by an embodiment of the present application.
  • the steps of method 800 may be executed by the above-mentioned terminal device 400.
  • the camera module of the terminal device 400 may include the first camera, and the hardware abstraction layer of the terminal device 400 may include a clipping control module, but this is not limited in the embodiment of the present application.
  • Method 800 includes the following steps:
  • the first camera produces a picture at the first magnification and sends it to the display.
  • the camera application in response to the user's point and cut operation, sends a magnification switching request message to the shearing control module.
  • the magnification switching request message is used to request switching from the first magnification to the second magnification.
  • the magnification switching request message includes the first magnification. and second magnification.
  • the shearing control module receives the magnification switching request message.
  • the shearing control module determines the magnification interval according to the preset parameters.
  • the shearing control module determines the transition magnification according to the magnification interval.
  • the shearing control module sends the transition magnification to the first camera.
  • the first camera acquires the transition magnification.
  • the first camera obtains a preview image at a transition magnification.
  • the first camera sends the preview image at the transition magnification to the camera application. Accordingly, the camera application receives the preview image.
  • the camera application displays the preview image at the transition magnification in the preview view box.
  • the method of determining the magnification interval and the transition magnification may refer to the embodiment described in method 700 and will not be described again here.
  • the terminal device can respond to the user's point-and-cut operation and use the first camera to complete preview shooting at different magnifications.
  • the first camera can sequentially obtain transition preview images at multiple transition magnifications, which is beneficial to achieving magnification. Smooth transition of preview images during point-and-cut operations, improving the zoom effect of camera applications.
  • the embodiment of the present application provides yet another magnification switching method 900.
  • the method 900 can be applied to a terminal device equipped with a camera.
  • the method 900 includes the following steps:
  • S901 display the first preview image at the first magnification acquired by the camera
  • S903 Display the second preview image obtained by the camera at the second magnification.
  • the terminal device may obtain the first preview image at the first magnification.
  • the terminal device can display L frames of preview images according to the L transition magnifications before displaying the second preview image, so as to smoothly transition from the first preview image to the second preview image. It is helpful to improve the zoom effect of the terminal device and improve the user experience.
  • the user's selection operation of the second magnification may include the user selecting the second magnification by clicking on the magnification icon as shown in Figure 1, or may also include the user selecting the second magnification among multiple magnifications in other ways. , the embodiment of the present application does not limit this.
  • the L frame preview image is used to transition from the first preview image to the second preview image, and the L frame preview image is captured by the terminal device in chronological order.
  • the user can achieve the enlargement effect on the preview image through the selection operation of the second magnification, and the user can also achieve the reduction effect on the preview image through the selection operation of the second magnification.
  • the embodiment of the present application does not do this. limited.
  • the first magnification is 1x
  • the second magnification is 7x
  • the transition magnifications from small to large are 2x, 3x, 4x, 5x, and 6x, with a total of 5 transition magnifications.
  • the terminal device can sequentially display preview images obtained by the camera at 2x, 3x, 4x, 5x, and 6x.
  • the first magnification is 7x
  • the second magnification is 1x
  • the transition magnifications from large to small can be 6x, 5x, 4x, 3x, and 2x, with a total of 5 transition magnifications.
  • the terminal device can sequentially display preview images obtained by the camera at 6x, 5x, 4x, 3x, and 2x.
  • the method 900 further includes: determining L transition magnifications based on the first magnification and the second magnification.
  • L transition magnifications are determined based on the first magnification and the second magnification, including: based on the first magnification, the second magnification, the switching time between the first magnification and the second magnification, and the corresponding The time interval between adjacent frames determines L transition magnifications.
  • the switching duration between the first magnification and the second magnification may be the preset switching duration described in the embodiment shown in FIG. 7.
  • S703 which will not be described again here. .
  • determining L transition magnifications based on the first magnification and the second magnification includes: determining L transition magnifications based on the first magnification, the second magnification and the preset preview image frame number.
  • the preset preview image frame number may be the preset preview image frame number described in the embodiment shown in FIG. 7.
  • S703 please refer to the description of S703, which will not be described again here.
  • the camera in method 900 includes a first camera and a second camera, the first preview image comes from the first camera, and the second preview image comes from the second camera.
  • Method 900 also includes: turning on the second camera, and acquiring images through the first camera and the second camera, where the images acquired by the first camera and the second camera at the same time node are captured based on the same transition magnification.
  • the quality difference between the Mth frame image from the second camera and the Nth frame image from the first camera is less than or equal to the preset threshold, the first camera is closed, and the preview image displayed before closing the first camera From the first camera.
  • the Nth frame image from the first camera is captured at the same time point and based on the same transition magnification as the Mth frame image from the second camera, N ⁇ M ⁇ 1, N and M are integers.
  • the user's selection operation of the second magnification involves a scene of switching between different cameras.
  • This method of dual-channel image output through the first camera and the second camera is conducive to improving the quality of the preview image.
  • the image algorithm of the terminal device can optimize features through more preview images, and switch the camera used for display at the appropriate time. , which is helpful to improve the stability of focus and the effect of smooth transition.
  • the terminal device acquires an image at a first magnification through a first camera, and displays the image acquired from the first camera, that is, the first preview image. After that, the terminal device can turn on the second camera and obtain images at the transition magnification through the first camera and the second camera. In this way, the first camera and the second camera can acquire images based on the same transition magnification at the same time point, when M ⁇ N.
  • the terminal device turns on the second camera after displaying the preview image from the first camera 1x.
  • L 17 transition magnifications between 1x and 10x.
  • the first camera and the second camera can acquire images at the transition magnifications at the same time node.
  • the difference in quality of the 8th frame image of the first camera is less than or equal to the preset threshold, then the terminal device can turn off the first camera.
  • the preset threshold may be the preset threshold described in the embodiment shown in FIG. 7. For details, please refer to the description of S710, which will not be described again here.
  • the terminal device acquires an image at a first magnification through a first camera, and displays the image acquired from the first camera, that is, the first preview image.
  • the terminal device has turned on the second camera, and uses the second camera to obtain images at the first magnification but does not display the images obtained by the second camera.
  • the terminal device acquires the image at a magnification of 1x through the first camera and the second camera, and displays the image from the first camera at a magnification of 1x.
  • the terminal device can display the preview image obtained by the second camera that has been turned on to achieve a smooth transition of magnification and improve the zoom effect of the terminal device.
  • the soft switching process before the camera is introduced by taking the terminal device including the first camera and the second camera as an example, but the embodiment of the present application does not limit the number of cameras of the terminal device.
  • the terminal device may further include a third camera, and after the user clicks the switching operation, the second camera may be switched to the third camera.
  • the first camera is an ultra-wide-angle camera
  • the second camera is a wide-angle camera
  • the third camera is a telephoto camera. It is assumed that the magnification range supported by the ultra-wide-angle camera is -1x, and the magnification range supported by the wide-angle camera is 1x to 3.5x, the telephoto camera supports a magnification range from 4x to 7x.
  • the terminal device can turn on the ultra-wide-angle camera when the magnification is -1x and display the preview image from the ultra-wide-angle camera.
  • the terminal device turns on the wide-angle camera and determines the transition magnification. , through dual-channel image output through the ultra-wide-angle camera and wide-angle camera, and display the preview image obtained from the wide-angle camera at the appropriate time.
  • the terminal device turns on the telephoto camera, determines the transition magnification, outputs the image through the wide-angle camera and the telephoto camera dually, and displays the image from the telephoto camera at the appropriate time. Get the preview image.
  • This two-way image output method facilitates the display of smooth transition preview images and improves the zoom effect of the terminal device.
  • Figure 10 is a schematic interface diagram of a terminal device provided by an embodiment of the present application.
  • the terminal device as a mobile phone as an example
  • Figure 10 shows the a interface, b interface and c interface of the mobile phone.
  • interface a shows multiple applications in the mobile phone.
  • the user can click the camera icon to open the camera application to take pictures.
  • the mobile phone displays interface b, which is the shooting interface.
  • interface b includes multiple magnification icons.
  • the current magnification of the camera is 1x.
  • the user can click on different magnification icons to switch between different magnifications. For example, if the user clicks the 5x magnification icon, the mobile phone can display interfaces c to f in sequence.
  • the terminal device can display the first frame of the preview image for transition.
  • the terminal device displays the second frame of the preview image for transition.
  • the terminal device displays the third frame of the preview image for transition.
  • Image in the f interface, the terminal device can display a preview image of the final 5x interface.
  • magnification switching method provided by the embodiment of the present application can display multiple frames of preview images for the transition to the user after the click switching operation of the magnification occurs, so as to achieve the purpose of smooth transition. , improve the zoom effect of the terminal device and improve the user experience.
  • preview images shown in FIG. 10 is only an example. In fact, preview images corresponding to the number of frames may be displayed according to the specific number of transition magnifications. This is not limited in the embodiment of the present application.
  • magnification switching method has been described in detail with reference to FIGS. 4 to 10 .
  • magnification switching device will be described in detail with reference to FIGS. 11 and 12 .
  • Figure 11 shows a schematic block diagram of a magnification switching device 1100 provided by an embodiment of the present application.
  • the device 1100 includes an acquisition module 1110 and a processing module 1120.
  • the acquisition module 1110 is configured to: acquire a first preview image at a first magnification; and acquire a second preview image at a second magnification.
  • the processing module 1120 is configured to: display the first preview image at the first magnification acquired by the camera; in response to the user's selection operation on the second magnification, display L frame preview images corresponding to L transition magnifications, where the L transition magnifications include L magnifications between the first magnification and the second magnification, L ⁇ 1 and an integer; and display the second preview image at the second magnification acquired by the camera.
  • the processing module 1120 is configured to determine L transition magnifications based on the first magnification and the second magnification.
  • the processing module 1120 is configured to determine L transition magnifications based on the first magnification, the second magnification, the switching duration between the first magnification and the second magnification, and the time interval between adjacent frames.
  • the processing module 1120 is configured to determine L transition magnifications based on the first magnification, the second magnification and the preset preview image frame number.
  • the camera includes a first camera and a second camera, the first preview image comes from the first camera, and the second preview image comes from the second camera.
  • the processing module 1120 is used to: turn on the second camera.
  • the acquisition module 1110 is configured to: acquire images through the first camera and the second camera, where the images acquired by the first camera and the second camera at the same time node are captured based on the same transition magnification;
  • the quality difference between the Mth frame image of the camera and the Nth frame image from the first camera is less than or equal to the preset threshold, the first camera is closed, and the preview image displayed before closing the first camera is from the first camera.
  • the Nth frame image from the first camera is captured at the same time point and at the same magnification as the Mth frame image from the second camera, N ⁇ M ⁇ 1, and N and M are integers.
  • the device 1100 can be specifically the terminal device in the above embodiment, or the functions of the terminal device in the above embodiment can be integrated in the device 1100.
  • the above functions can be implemented by hardware, or can be implemented by hardware executing corresponding software.
  • the hardware or software includes one or more modules corresponding to the above functions.
  • the apparatus 1100 may be used to execute various processes and/or steps corresponding to the terminal device in the above method embodiment.
  • the device 1100 here is embodied in the form of a functional module.
  • module may refer to an application specific integrated circuit (ASIC), an electronic circuit, a processor (such as a shared processor, a proprietary processor, or a group of processors) used to execute one or more software or firmware programs. processor, etc.) and memory, merged logic circuitry, and/or other suitable components to support the described functionality.
  • ASIC application specific integrated circuit
  • the device 1100 in Figure 11 may also be a chip or a chip system, such as a system on chip (SoC).
  • SoC system on chip
  • Figure 12 shows a schematic block diagram of another magnification switching device 1200 provided by an embodiment of the present application.
  • the device 1200 includes a processor 1210, a transceiver 1220, and a memory 1230.
  • the processor 1210, the transceiver 1220 and the memory 1230 communicate with each other through internal connection paths.
  • the memory 1230 is used to store instructions, and the processor 1210 is used to execute the instructions stored in the memory 1230 to control the transceiver 1220 to send signals and /or receive a signal.
  • the device 1200 can be specifically a terminal device in the above embodiment, or the functions of the terminal device in the above embodiment can be integrated in the device 1200, and the device 1200 can be used to perform various functions corresponding to the terminal device in the above method embodiment. steps and/or processes.
  • the memory 1230 may include read-only memory and random access memory and provide instructions and data to the processor. A portion of the memory may also include non-volatile random access memory. For example, the memory may also store device type information.
  • the processor 1210 can be used to execute instructions stored in the memory, and when the processor executes the instructions, the processor can execute various steps and/or processes corresponding to the terminal device in the above method embodiment.
  • the processor 1210 may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits ( ASIC), field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.
  • DSP digital signal processors
  • ASIC application-specific integrated circuits
  • FPGA field programmable gate array
  • a general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.
  • the disclosed systems, devices and methods can be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of modules is only a logical function division. In actual implementation, there may be other division methods.
  • multiple modules or components may be combined or can be integrated into another system, or some features can be ignored, or not implemented.
  • the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, indirect coupling or communication connection of devices or modules, which may be in electrical, mechanical or other forms.
  • modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in one place, or they may be distributed to multiple network modules. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
  • each functional module in each embodiment of the present application can be integrated into one processing module, or each module can exist physically alone, or two or more modules can be integrated into one module.
  • the functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium.
  • the technical solution of the present application is essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product.
  • the computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of this application.
  • the aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk and other media that can store program code. .

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Telephone Function (AREA)

Abstract

La présente demande concerne un procédé de commutation de grossissement et un appareil de commutation de grossissement, qui permettent de réaliser une transition sans à-coups d'une image de prévisualisation durant une opération de commutation par clic pour un grossissement, ce qui permet d'améliorer l'effet de zoom d'un dispositif terminal. Le procédé comprend : l'affichage d'une première image de prévisualisation avec un premier grossissement qui est acquise par une caméra ; en réponse à une opération de sélection, par un utilisateur, d'un second grossissement, l'affichage de L trames d'images de prévisualisation correspondant à L grossissements de transition, les L grossissements de transition comprenant L grossissements entre le premier grossissement et le second grossissement, L ≥ 1 et étant un entier ; et l'affichage d'une seconde image de prévisualisation avec le second grossissement qui est acquise par la caméra.
PCT/CN2022/140486 2022-02-24 2022-12-20 Procédé de commutation de grossissement et appareil de commutation de grossissement WO2023160179A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210178265.5A CN116709016A (zh) 2022-02-24 2022-02-24 倍率切换方法和倍率切换装置
CN202210178265.5 2022-02-24

Publications (2)

Publication Number Publication Date
WO2023160179A1 WO2023160179A1 (fr) 2023-08-31
WO2023160179A9 true WO2023160179A9 (fr) 2024-01-18

Family

ID=87764650

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/140486 WO2023160179A1 (fr) 2022-02-24 2022-12-20 Procédé de commutation de grossissement et appareil de commutation de grossissement

Country Status (2)

Country Link
CN (1) CN116709016A (fr)
WO (1) WO2023160179A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117560574A (zh) * 2024-01-10 2024-02-13 荣耀终端有限公司 一种拍摄方法、电子设备和可读存储介质

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012227886A (ja) * 2011-04-22 2012-11-15 Canon Inc 撮像装置及びその制御方法
CN114390199A (zh) * 2018-10-15 2022-04-22 华为技术有限公司 一种拍摄方法及电子设备
CN111510618B (zh) * 2019-01-30 2022-04-05 虹软科技股份有限公司 变焦方法及应用其的电子设备
WO2020220346A1 (fr) * 2019-04-30 2020-11-05 华为技术有限公司 Procédé et appareil de traitement d'image
CN115442516A (zh) * 2019-12-25 2022-12-06 华为技术有限公司 一种长焦场景下的拍摄方法及终端
CN111726528B (zh) * 2020-06-24 2022-04-08 Oppo广东移动通信有限公司 摄像头切换方法、装置、终端以及计算机存储介质
CN111885305B (zh) * 2020-07-28 2022-04-29 Oppo广东移动通信有限公司 预览画面处理方法及装置、存储介质和电子设备
CN113010738B (zh) * 2021-02-08 2024-01-30 维沃移动通信（杭州）有限公司 视频处理方法、装置、电子设备及可读存储介质
CN112995511B (zh) * 2021-03-02 2022-11-15 Oppo广东移动通信有限公司 摄像头切换方法、装置、电子设备和存储介质
CN113055592B (zh) * 2021-03-11 2023-03-21 Oppo广东移动通信有限公司 图像展示方法、装置、电子设备和计算机可读存储介质
CN115484375A (zh) * 2021-05-31 2022-12-16 华为技术有限公司 拍摄方法及电子设备
CN113727016A (zh) * 2021-06-15 2021-11-30 荣耀终端有限公司 一种拍摄方法及电子设备

Also Published As

Publication number Publication date
WO2023160179A1 (fr) 2023-08-31
CN116709016A (zh) 2023-09-05

Similar Documents

Publication Publication Date Title
US11722449B2 (en) Notification message preview method and electronic device
CN110231905B (zh) 一种截屏方法及电子设备
EP3923617A1 (fr) Procédé de réduction de la consommation d'énergie d'un terminal mobile et terminal mobile
WO2020155875A1 (fr) Procédé d'affichage destiné à un dispositif électronique, interface graphique personnalisée et dispositif électronique
WO2020024108A1 (fr) Procédé d'affichage d'icônes d'application et terminal
US20230168802A1 (en) Application Window Management Method, Terminal Device, and Computer-Readable Storage Medium
CN113935898A (zh) 图像处理方法、系统、电子设备及计算机可读存储介质
CN114115770A (zh) 显示控制的方法及相关装置
WO2023273543A1 (fr) Procédé et appareil de gestion de dossier
WO2023160179A9 (fr) Procédé de commutation de grossissement et appareil de commutation de grossissement
WO2020062304A1 (fr) Procédé de transmission de fichier et dispositif électronique
CN115119048B (zh) 一种视频流处理方法及电子设备
CN116389884B (zh) 缩略图显示方法及终端设备
CN116077943B (zh) 调度系统资源的方法及相关装置
WO2024067037A1 (fr) Procédé et système d'appel de service, dispositif électronique
CN116095220B (zh) 参数确定方法及相关装置
WO2023124829A1 (fr) Procédé d'entrée vocale collaborative, dispositif électronique et support de stockage lisible par ordinateur
CN116095219B (zh) 通知显示方法和终端设备
EP4290375A1 (fr) Procédé d'affichage, dispositif électronique et système
CN116095223B (zh) 通知显示方法和终端设备
CN116709018B (zh) 一种变焦条分割方法及电子设备
WO2022179371A1 (fr) Procédé d'affichage en mosaïque, dispositif électronique et système
WO2024051634A1 (fr) Procédé et système d'affichage de projection d'écran, et dispositif électronique
WO2022268009A1 (fr) Procédé de partage d'écran et dispositif associé
CN115113716A (zh) 一种息屏显示参数的调节方法和终端设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22928427

Country of ref document: EP

Kind code of ref document: A1