WO2021023035A1

WO2021023035A1 - Lens switching method and apparatus

Info

Publication number: WO2021023035A1
Application number: PCT/CN2020/104722
Authority: WO
Inventors: 冯帅
Original assignee: 华为技术有限公司
Priority date: 2019-08-06
Filing date: 2020-07-27
Publication date: 2021-02-11
Also published as: CN112351156B; CN112351156A

Abstract

Provided in the embodiments of the present application are a lens switching method and apparatus. The lens switching apparatus comprises a camera module, wherein the camera module comprises M lenses, N image sensors, and an electric motor, M being a positive integer greater than or equal to 2, N being a positive integer greater than or equal to 1, and M being greater than N. The method comprises: determining a lens to be switched, and switching said lens to a position corresponding to a target sensor to achieve snap-fit fastening and recombination of the lens and the image sensor. On the basis of this method, the number of image sensors can be less than the number of lenses, so as to reduce the number of image sensors while meeting the photographing demand of a user, thereby reducing the cost of a terminal device.

Description

Method and device for switching lens

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office, the application number is 201910721605.2, and the application name is "a lens switching method and device" on August 6, 2019, the entire content of which is incorporated into this application by reference .

Technical field

This application relates to the field of communication technology, and in particular to a lens switching method and device.

Background technique

At present, the camera function is increasingly being valued by users and has become one of the core functions of mobile terminal devices. In order to meet the needs of users for taking pictures in different scenarios, current mobile terminal devices are equipped with multiple independent cameras (camera modules) to adapt to different shooting scenarios. For example, when the shooting target is far away, use a telephoto camera to shoot; when the shooting target is very close, use a macro camera to shoot. Usually a camera includes an image sensor and a lens. Equipping mobile terminal equipment with multiple independent cameras will result in a significant increase in equipment manufacturing costs. Therefore, how to reduce the manufacturing cost of the equipment while meeting the shooting requirements of different shooting scenes becomes a problem to be solved.

Summary of the invention

The embodiments of the present application provide a lens switching method and device, which can reduce the number of image sensors while meeting the shooting needs of users, and reduce the cost of terminal equipment.

In a first aspect, an embodiment of the present application provides a lens switching method, which can be executed by a lens switching device. The lens switching device includes a camera module. The camera module includes M lenses, N image sensors, and one Motor; The M is a positive integer greater than or equal to 2, the N is a positive integer greater than or equal to 1, and the M is greater than N. Wherein, the lens switching device determines the lens to be switched, and then switches the lens to be switched to a position corresponding to the target image sensor to complete the recombination of the lens and the image sensor to realize the shooting function.

It can be seen that the number of image sensors can be less than the number of lenses, and reducing the number of image sensors will help reduce the cost of the terminal device.

In a possible design, the lens switching device may determine the rotation angle between the to-be-switched lens and the position corresponding to the target image sensor, and according to the rotation angle, move the to-be-switched lens in a counterclockwise or clockwise direction. Switch the lens to switch to the position corresponding to the target image sensor.

It can be seen that determining the rotation angle of the lens can more accurately switch the lens to the position corresponding to the target sensor according to the rotation angle.

In a possible design, the rotation angle includes a first rotation angle of the lens to be switched in a clockwise direction and a second rotation angle of the lens to be switched in a counterclockwise direction. If the first rotation angle is smaller than the second rotation angle, switch the lens to be switched to the position corresponding to the target image sensor in a clockwise direction; if the second rotation angle is smaller than the first rotation angle, Then, the to-be-switched lens is switched to the position corresponding to the target image sensor in a counterclockwise direction.

It can be seen that comparing the angle of the lens rotating in the clockwise direction or the counterclockwise direction, choosing a smaller angle to rotate is beneficial to simplify the lens switching process.

In a possible design, the lens switching device may determine shooting parameters, where the shooting parameters include a shooting scene and a shooting mode, and then determine the lens to be switched according to the shooting parameters.

It can be seen that the lens switching device can automatically determine the lens to be switched by determining the shooting parameters.

In a possible design, the lens switching device may output an analog interface to the camera module and receive a user's operation on the analog interface. The operation is that the user drags the target lens to the target The drag operation of the position corresponding to the image sensor, or the operation is a click operation on the target lens; and then the target lens is determined as the lens to be switched.

It can be seen that the lens switching device can determine the lens to be switched according to the user's selection, which is beneficial to satisfy the user's shooting needs.

In a possible design, the lens switching device may output the selection items of the lens and receive the user's selection operation of the lens; and then determine that the lens selected by the selection operation is the lens to be switched.

In a possible design, the lens switching device may perform switching prompts during the process of switching the to-be-switched lens to the position corresponding to the target image sensor.

It can be seen that through the switching prompt, the camera switching process can be displayed more vividly and the user's operating experience can be improved.

In one possible design, the switching prompt includes an audio prompt and/or a vibration prompt.

In a second aspect, an embodiment of the present application provides a lens switching device, which has the function of implementing the lens switching method provided in the first aspect. This function can be realized by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above-mentioned functions.

In a third aspect, an embodiment of the present application provides a terminal device including a processor and a memory; the memory is used to store a computer program, and the processor executes the computer program stored in the memory, so that the terminal device executes the first Aspect or the method in any possible implementation manner of the first aspect.

In a fourth aspect, an embodiment of the present application provides a readable storage medium that includes a program or instruction, and when the program or instruction runs on a computer, the computer executes the first aspect or any of the first aspects. One of the possible implementation methods.

The chip system in the foregoing aspect may be a system on chip (SOC), or a baseband chip, etc., where the baseband chip may include a processor, a channel encoder, a digital signal processor, a modem, and an interface module.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed in the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative work, other drawings can be obtained based on these drawings.

Fig. 1 is a schematic diagram of a camera module provided in the prior art;

Figure 2a is a schematic diagram of a camera module provided by an embodiment of the present application;

Figure 2b is a schematic diagram of another camera module provided by an embodiment of the present application;

Figure 2c is a schematic diagram of another camera module provided by an embodiment of the present application;

Figure 3a is a schematic diagram of another camera module provided by an embodiment of the present application;

Figure 3b is a schematic diagram of another camera module provided by an embodiment of the present application;

Figure 4a is a schematic diagram of another camera module provided by an embodiment of the present application;

Figure 4b is a schematic diagram of another camera module provided by an embodiment of the present application;

Figure 5a is a diagram of the correspondence between a lens and an image sensor provided in the prior art;

FIG. 5b is a diagram of the correspondence between a lens and an image sensor according to an embodiment of the present application;

FIG. 6 is a schematic structural diagram of a terminal device provided by an embodiment of the present application;

FIG. 7a is a schematic structural diagram of a software system and hardware layer of a terminal device provided by an embodiment of the present application;

FIG. 7b is a schematic diagram of a software and hardware processing flow of a terminal device according to an embodiment of the present application;

FIG. 8 is a schematic flowchart of a lens switching method provided by an embodiment of the present application;

FIG. 9 is a schematic diagram of an application scenario of a lens switching method provided by an embodiment of the present application;

FIG. 10 is a schematic diagram of an application scenario of another lens switching method provided by an embodiment of the present application;

11 is a schematic diagram of an application scenario of another lens switching method provided by an embodiment of the present application;

FIG. 12 is a schematic diagram of an application scenario of another lens switching method provided by an embodiment of the present application;

FIG. 13 is a schematic structural diagram of a lens switching device provided by an embodiment of the present application;

FIG. 14 is a schematic structural diagram of another lens switching device provided by an embodiment of the present application.

detailed description

The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

As the function of the camera attracts more and more attention from users, the current terminal equipment usually adopts a system design of multiple cameras to meet the shooting needs in different scenes. For example, when the shooting scene requires a wider field of view, a wide-angle camera is used. Shooting; when the shooting target is far away, use the telephoto camera to shoot; when shooting close-up close-ups, use the macro camera to shoot to achieve the best shooting experience.

However, the existing terminal equipment needs to be equipped with multiple independent cameras to adapt to different scenarios, that is, the terminal equipment needs to be equipped with multiple lenses and a corresponding number of image sensors, as shown in Figure 1. The terminal equipment includes three independent cameras, and each camera includes a lens and a corresponding image sensor. However, the use of the multi-camera solution shown in Figure 1 will increase the manufacturing cost of the terminal equipment, and the scalability of the multi-camera solution is poor. When the existing multiple cameras cannot meet the needs of the new shooting scene, you can This is achieved by adding cameras.

In order to solve the above problems, the embodiments of the present application provide a lens switching method and device, wherein the lens switching device may be a terminal device or a device for terminal equipment. The lens switching method realizes the free combination of M lenses and N image sensors by decoupling the fixed correspondence between the image sensor and the lens in the camera module, and by rotating the lens. When M is greater than N, the number of image sensors can be reduced and the cost of terminal equipment can be reduced.

The lens switching method can be applied to a lens switching device, where the lens switching device can be a terminal device or a device used for a terminal device. The lens switching device includes a camera module, the camera module includes M lenses, N image sensors, and a motor; the M is a positive integer greater than or equal to 2, and the N is a positive integer greater than or equal to 1. , The M is greater than N. In other words, in the camera module, the number of image sensors can be less than the number of lenses. The lens switching device can switch the to-be-switched lens to a designated position to be buckled and reassembled with the image sensor according to the user's shooting requirements, and meets the user's shooting requirements while reducing the manufacturing cost of the terminal equipment.

In an example, a camera module provided by an embodiment of the present application is shown in Figures 2a, 2b, and 2c. The camera module includes 3 lenses and 1 image sensor, that is, M is 3 and N is 1. The position of the image sensor in this embodiment is fixed, and the three lenses can be rotated by the motor to realize the switching of the lens. When the lens is rotated to the corresponding position of the image sensor, the optical axis alignment is completed, and the lens and the image sensor are buckled. Reorganization.

In a feasible implementation manner, the included angle between the three lenses remains unchanged; each lens can be rotated in two directions clockwise or counterclockwise, and the rotation angle is at most 90 degrees. As shown in Figure 2a and Figure 2b. Figures 2a and 2b show two different positional relationships between the motor and the image sensor. The motor in Figure 2a is located above the image sensor, and the motor in Figure 2b is located below the image sensor. Taking FIG. 2a as an example, the lens 2 can be rotated counterclockwise to the position corresponding to the image sensor, and the lens 1 and the lens 3 can also be rotated counterclockwise.

In another feasible implementation manner, the angle between the three lenses can be changed. As shown in Figure 2c, each lens can rotate 360 degrees omnidirectionally, and the angle between the three lenses can be changed, then lens 2 can be rotated clockwise to the position corresponding to the image sensor, and lens 1 and lens The position of 3 can be constant. It is understandable that the multiple lenses shown in this embodiment can all be independently placed in parallel without affecting the thickness of the whole machine.

In an example, another camera module provided by an embodiment of the present application is shown in FIGS. 3a and 3b. The camera module includes 5 lenses and 2 image sensors, that is, M is 5 and N is 2. In this example, the position of the image sensor is fixed, the 5 lenses can be rotated by a motor to realize the switching of the lenses, and each lens can be rotated 360 degrees in an omni-directional manner.

In a feasible implementation manner, the angle between the five lenses may be constant. For example, the image sensor corresponding to lens 2 is sensor 1, and the image sensor corresponding to lens 3 is sensor 2, then lens 2 can be rotated clockwise to the position corresponding to sensor 1, and lens 3 can be rotated clockwise to sensor 2 The other lenses also rotate correspondingly, as shown in Figure 3a.

In another feasible implementation, the angle between the five lenses can be changed. For example, the lens 2 can be rotated in a clockwise direction to the position corresponding to the sensor 1, and the lens 3 can be rotated in a clockwise direction to the position corresponding to the sensor 2, and the positions of other lenses remain unchanged, as shown in FIG. 3b. It is understandable that the camera module provided in this embodiment can support N image sensors to match the lens to produce images at the same time to achieve corresponding functions (such as picture-in-picture functions, etc.).

It should be noted that the lenses and image sensors in a camera module provided in this embodiment may also be arranged in rows or columns. For example, the camera module includes two lenses and an image sensor. The sensors are arranged in rows (such as from left to right), as shown in Figure 4a. When the camera module performs lens switching, each lens or the to-be-switched lens moves horizontally to the left or right to the position corresponding to the image sensor. For example, the lens 1 in FIG. 4a can move horizontally to the right to the position corresponding to the image sensor.

For example, the camera module includes three lenses and one image sensor, and each lens and image sensor are arranged in a row (such as from top to bottom), as shown in FIG. 4b. When the camera module performs lens switching, each lens or the to-be-switched lens moves vertically upward or downward to the position corresponding to the image sensor. For example, the lens 1 in FIG. 4b can be moved vertically upward to the position corresponding to the image sensor.

It should be noted that the camera module provided in this embodiment can realize dynamic matching of lenses and image sensors, and can realize that the number of image sensors is less than the number of lenses to reduce equipment cost. And when the number of image sensors is reduced, the terminal device can choose to install an image sensor with a higher image resolution, then different lenses can be matched with the image sensor with a higher image resolution, thereby also improving the shooting quality of the camera.

For example, in the multi-camera solution shown in FIG. 1, since each camera is an independent camera, when considering the manufacturing cost of the terminal device, an image sensor with a higher image resolution will not be matched for each lens. As shown in Figure 5a, the image sensor corresponding to the medium-focus lens has the highest image resolution, the image sensor corresponding to the wide-angle lens has the second highest image resolution, and the image sensor corresponding to the tele-focus lens has the lowest image resolution.

For another example, the camera module shown in FIGS. 2a to 2c includes 3 lenses and 1 image sensor, where the image sensor may be an image sensor with a higher image resolution. When any lens is switched to the image sensor corresponding It can be combined with the image sensor to realize the shooting function. As shown in Figure 5b, all three lenses can be matched with the image sensor to produce a picture, which is beneficial to improve the shooting quality of the camera.

The terminal device described in this embodiment can be a device with a wireless transceiver function, which can be deployed on land, including indoor or outdoor, handheld, wearable, or vehicle-mounted; it can also be deployed on water (such as ships); Deploy in the air (for example, on airplanes, balloons, satellites, etc.). The terminal device may be a mobile phone (mobile phone), a tablet computer (Pad), a computer with wireless transceiver function, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, an industrial control ( Wireless terminals in industrial control, in-vehicle terminal equipment, wireless terminals in self-driving, wireless terminals in remote medical, wireless terminals in smart grid, transportation safety (transportation) Wireless terminals in safety), wireless terminals in smart cities, wireless terminals in smart homes, wearable terminal devices, and so on. The embodiment of this application does not limit the application scenario. Terminal equipment can also be called user equipment (UE), access terminal equipment, vehicle-mounted terminal, industrial control terminal, UE unit, UE station, mobile station, mobile station, remote station, remote terminal equipment, mobile equipment, UE Terminal equipment, terminal equipment, wireless communication equipment, UE agent or UE device, etc. The terminal can also be fixed or mobile. The terminal device of the present application may also be an on-board module, on-board module, on-board component, on-board chip, or on-board unit built into a vehicle as one or more components or units. The vehicle passes through the built-in on-board module, on-board module, An on-board component, on-board chip, or on-board unit can implement the method of the present application.

For the convenience of description, in the following embodiments, the terminal device is a mobile phone as an example for description.

The embodiment of the present application provides a schematic structural diagram of a terminal device. Please refer to FIG. 6, which is a schematic structural diagram of the terminal device 600. The terminal device 600 may include a processor 610, an external memory interface 620, an internal memory 621, and a universal serial bus. (universal serial bus, USB) interface 630, charging management module 640, power management module 641, battery 642, antenna 1, antenna 2, mobile communication module 650, wireless communication module 660, audio module 670, speaker 670A, receiver 670B, microphone 670C, headphone interface 670D, sensor module 680, buttons 690, motor 691, indicator 692, camera 693, display screen 694, subscriber identification module (subscriber identification module, SIM) card interface 695, etc. The sensor module 680 can include pressure sensor 680A, gyroscope sensor 680B, air pressure sensor 680C, magnetic sensor 680D, acceleration sensor 680E, distance sensor 680F, proximity light sensor 680G, fingerprint sensor 680H, temperature sensor 680J, touch sensor 680K, ambient light Sensor 680L, bone conduction sensor 680M, etc.

It can be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the terminal device 600. In other embodiments of the present application, the terminal device 600 may include more or fewer components than shown, or combine certain components, or split certain components, or arrange different components. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

The processor 610 may include one or more processing units. For example, the processor 610 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU), etc. Among them, the different processing units may be independent devices or integrated in one or more processors.

The controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching and executing instructions.

A memory may also be provided in the processor 610 to store instructions and data. In an embodiment, the memory in the processor 610 is a cache memory. The memory can store instructions or data that have just been used or recycled by the processor 610. If the processor 610 needs to use the instruction or data again, it can be directly called from the memory. Repeated accesses are avoided, the waiting time of the processor 610 is reduced, and the efficiency of the system is improved.

In an embodiment, the processor 610 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, and a universal asynchronous transmitter (universal asynchronous transmitter) interface. receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and / Or Universal Serial Bus (USB) interface, etc.

The I2C interface is a two-way synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In an embodiment, the processor 610 may include multiple sets of I2C buses. The processor 610 may couple the touch sensor 680K, charger, flash, camera 693, etc., respectively through different I2C bus interfaces. For example, the processor 610 may couple the touch sensor 680K through an I2C interface, so that the processor 610 and the touch sensor 680K communicate through the I2C bus interface to realize the touch function of the terminal device 600.

The I2S interface can be used for audio communication. In an embodiment, the processor 610 may include multiple sets of I2S buses. The processor 610 may be coupled with the audio module 670 through an I2S bus to implement communication between the processor 610 and the audio module 670. In an embodiment, the audio module 670 may transmit audio signals to the wireless communication module 660 through the I2S interface, so as to realize the function of answering calls through the Bluetooth headset.

The PCM interface can also be used for audio communication to sample, quantize and encode analog signals. In an embodiment, the audio module 670 and the wireless communication module 660 may be coupled through a PCM bus interface. In an embodiment, the audio module 670 may also transmit audio signals to the wireless communication module 660 through the PCM interface, so as to realize the function of answering calls through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

The UART interface is a universal serial data bus used for asynchronous communication. The bus can be a two-way communication bus. It converts the data to be transmitted between serial communication and parallel communication. In an embodiment, the UART interface is usually used to connect the processor 610 and the wireless communication module 660. For example, the processor 610 communicates with the Bluetooth module in the wireless communication module 660 through the UART interface to implement the Bluetooth function. In an embodiment, the audio module 670 may transmit audio signals to the wireless communication module 660 through a UART interface, so as to realize the function of playing music through a Bluetooth headset.

The MIPI interface can be used to connect the processor 610 with the display screen 694, the camera 693 and other peripheral devices. The MIPI interface includes camera serial interface (camera serial interface, CSI), display serial interface (display serial interface, DSI), etc. In an embodiment, the processor 610 and the camera 693 communicate through a CSI interface to implement the shooting function of the terminal device 600. The processor 610 and the display screen 694 communicate through the DSI interface to realize the display function of the terminal device 600.

The GPIO interface can be configured through software. The GPIO interface can be configured as a control signal or as a data signal. In an embodiment, the GPIO interface may be used to connect the processor 610 with the camera 693, the display screen 694, the wireless communication module 660, the audio module 670, the sensor module 680, and so on. GPIO interface can also be configured as I2C interface, I2S interface, UART interface, MIPI interface, etc.

The USB interface 630 is an interface that complies with the USB standard specification, and specifically may be a Mini USB interface, a Micro USB interface, a USB Type C interface, and so on. The USB interface 630 can be used to connect a charger to charge the terminal device 600, and can also be used to transfer data between the terminal device 600 and peripheral devices. It can also be used to connect headphones and play audio through the headphones. This interface can also be used to connect to other terminal devices, such as AR devices.

It can be understood that the interface connection relationship between the modules illustrated in the embodiment of the present application is merely a schematic description, and does not constitute a structural limitation of the terminal device 600. In other embodiments of the present application, the terminal device 600 may also adopt different interface connection modes in the foregoing embodiments, or a combination of multiple interface connection modes.

The charging management module 640 is used to receive charging input from the charger. Among them, the charger can be a wireless charger or a wired charger. In an embodiment of wired charging, the charging management module 640 may receive the charging input of the wired charger through the USB interface 630. In an embodiment of wireless charging, the charging management module 640 may receive the wireless charging input through the wireless charging coil of the terminal device 600. While charging the battery 642, the charging management module 640 can also supply power to the terminal device through the power management module 641.

The power management module 641 is used to connect the battery 642, the charging management module 640 and the processor 610. The power management module 641 receives input from the battery 642 and/or the charge management module 640, and supplies power to the processor 610, the internal memory 621, the display screen 694, the camera 693, and the wireless communication module 660. The power management module 641 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance). In an embodiment, the power management module 641 may also be provided in the processor 610. In another embodiment, the power management module 641 and the charging management module 640 may also be provided in the same device.

The wireless communication function of the terminal device 600 can be implemented by the antenna 1, the antenna 2, the mobile communication module 650, the wireless communication module 660, the modem processor, and the baseband processor.

The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the terminal device 600 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna can be used in combination with a tuning switch.

The mobile communication module 650 can provide a wireless communication solution including 2G/3G/4G/5G and the like applied to the terminal device 600. The mobile communication module 650 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 650 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 650 can also amplify the signal modulated by the modem processor, and convert it into electromagnetic wave radiation via the antenna 1. In an embodiment, at least part of the functional modules of the mobile communication module 650 may be provided in the processor 610. In an embodiment, at least part of the functional modules of the mobile communication module 650 and at least part of the modules of the processor 610 may be provided in the same device.

The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal is processed by the baseband processor and then passed to the application processor. The application processor outputs sound signals through audio equipment (not limited to the speaker 670A, the receiver 670B, etc.), or displays images or videos through the display screen 694. In an embodiment, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 610 and be provided in the same device as the mobile communication module 650 or other functional modules.

The wireless communication module 660 can provide applications on the terminal device 600 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), and global navigation satellites. System (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 660 may be one or more devices integrating at least one communication processing module. The wireless communication module 660 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 610. The wireless communication module 660 may also receive the signal to be sent from the processor 610, perform frequency modulation, amplify, and convert it into electromagnetic waves to radiate through the antenna 2.

In an embodiment, the antenna 1 of the terminal device 600 is coupled with the mobile communication module 650, and the antenna 2 is coupled with the wireless communication module 660, so that the terminal device 600 can communicate with the network and other devices through wireless communication technology. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite-based augmentation systems (SBAS).

The terminal device 600 implements a display function through a GPU, a display screen 694, and an application processor. The GPU is a microprocessor for image processing, connected to the display 694 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 610 may include one or more GPUs, which execute program instructions to generate or change display information.

The display screen 694 is used to display images, videos, etc. The display screen 694 includes a display panel. The display screen may specifically include a folding screen, a special-shaped screen, etc. The display panel may use a liquid crystal display (LCD), organic light emitting diode (organic light-emitting diode, OLED), active-matrix organic light-emitting diode or active-matrix organic light-emitting diode (AMOLED), flexible light-emitting diode (FLED) ), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (QLED), etc. In an embodiment, the terminal device 600 may include one or N display screens 694, and N is a positive integer greater than one.

The terminal device 600 can realize a shooting function through an ISP, a camera module 693, a video codec, a GPU, a display screen 694, and an application processor. The camera module 693 can include a lens and an image sensor.

For example, when taking a picture, the shutter is opened, and light is transmitted to the image sensor through the lens. The image sensor can convert the light signal into an electric signal, and transfer the electric signal to the ISP for processing, and convert it into an image visible to the naked eye. ISP can also optimize the image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.

Among them, the lens is used to obtain a static image or video, and the object generates an optical image through the lens and is projected to the image sensor. The image sensor can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor. CMOS) phototransistor. The image sensor converts the light signal into an electrical signal, and then transfers the electrical signal to the ISP to convert it into a digital image signal. ISP outputs digital image signals to DSP for processing. DSP converts digital image signals into standard RGB, YUV and other formats.

Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the terminal device 600 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.

Video codecs are used to compress or decompress digital video. The terminal device 600 may support one or more video codecs. In this way, the terminal device 600 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, and so on.

NPU is a neural-network (NN) computing processor. By drawing on the structure of biological neural networks, for example, the transfer mode between human brain neurons, it can quickly process input information and can continuously learn by itself. The NPU can realize applications such as intelligent cognition of the terminal device 600, such as image recognition, face recognition, voice recognition, text understanding, and so on.

The external memory interface 620 may be used to connect an external memory card, such as a Micro SD card, so as to expand the storage capacity of the terminal device 600. The external memory card communicates with the processor 610 through the external memory interface 620 to realize the data storage function. For example, save music, video and other files in an external memory card.

The internal memory 621 may be used to store computer executable program code, where the executable program code includes instructions. The internal memory 621 may include a program storage area and a data storage area. Among them, the storage program area can store an operating system, at least one application program (such as a sound playback function, an image playback function, etc.) required by at least one function. The data storage area can store data (such as audio data, phone book, etc.) created during the use of the terminal device 600. In addition, the internal memory 621 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like. The processor 610 executes various functional applications and data processing of the terminal device 600 by running instructions stored in the internal memory 621 and/or instructions stored in a memory provided in the processor.

The terminal device 600 can implement audio functions through an audio module 670, a speaker 670A, a receiver 670B, a microphone 670C, a headset interface 670D, and an application processor. For example, music playback, recording, etc.

The audio module 670 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal. The audio module 670 can also be used to encode and decode audio signals. In an embodiment, the audio module 670 may be disposed in the processor 610, or part of the functional modules of the audio module 670 may be disposed in the processor 610.

The speaker 670A, also called "speaker", is used to convert audio electrical signals into sound signals. The terminal device 600 can listen to music through the speaker 670A, or listen to a hands-free call.

The receiver 670B, also called "earpiece", is used to convert audio electrical signals into sound signals. When the terminal device 600 answers a call or voice message, it can receive the voice by bringing the receiver 670B close to the human ear.

Microphone 670C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can make a sound by approaching the microphone 670C through the human mouth, and input the sound signal into the microphone 670C. The terminal device 600 may be provided with at least one microphone 670C. In other embodiments, the terminal device 600 may be provided with two microphones 670C, which can implement noise reduction functions in addition to collecting sound signals. In other embodiments, the terminal device 600 may also be provided with three, four or more microphones 670C to collect sound signals, reduce noise, identify sound sources, and realize directional recording functions.

The earphone interface 670D is used to connect wired earphones. The earphone interface 670D may be a USB interface 630, or a 3.5mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The pressure sensor 680A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In an embodiment, the pressure sensor 680A may be provided on the display screen 694. There are many types of pressure sensor 680A, such as resistive pressure sensor, inductive pressure sensor, capacitive pressure sensor and so on. The capacitive pressure sensor may include at least two parallel plates with conductive material. When a force is applied to the pressure sensor 680A, the capacitance between the electrodes changes. The terminal device 600 determines the strength of the pressure according to the change in capacitance. When a touch operation acts on the display screen 694, the terminal device 600 detects the intensity of the touch operation according to the pressure sensor 680A. The terminal device 600 may also calculate the touched position according to the detection signal of the pressure sensor 680A. In an embodiment, touch operations that act on the same touch position but have different touch operation strengths may correspond to different operation instructions. For example: when a touch operation whose intensity of the touch operation is less than the first pressure threshold is applied to the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

The gyro sensor 680B may be used to determine the motion posture of the terminal device 600. In an embodiment, the angular velocity of the terminal device 600 around three axes (ie, x, y, and z axes) can be determined by the gyroscope sensor 680B. The gyro sensor 680B can be used for image stabilization. Exemplarily, when the shutter is pressed, the gyroscope sensor 680B detects the shaking angle of the terminal device 600, and calculates the distance that the lens module needs to compensate according to the angle, so that the lens can counteract the shaking of the terminal device 600 through reverse movement to achieve anti-shake. The gyro sensor 680B can also be used for navigation and somatosensory game scenes.

The air pressure sensor 680C is used to measure air pressure. In an embodiment, the terminal device 600 calculates the altitude based on the air pressure value measured by the air pressure sensor 680C, and assists positioning and navigation.

The magnetic sensor 680D includes a Hall sensor. The terminal device 600 may use the magnetic sensor 680D to detect the opening and closing of the flip holster. In an embodiment, when the terminal device 600 is a flip machine, the terminal device 600 can detect the opening and closing of the flip according to the magnetic sensor 680D. Furthermore, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, features such as automatic unlocking of the flip cover are set.

The acceleration sensor 680E can detect the magnitude of the acceleration of the terminal device 600 in various directions (generally three axes). When the terminal device 600 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the terminal device, and is used in applications such as horizontal and vertical screen switching, and pedometer.

Distance sensor 680F, used to measure distance. The terminal device 600 can measure the distance by infrared or laser. In an embodiment, for shooting a scene, the terminal device 600 may use the distance sensor 680F to measure the distance to achieve rapid focusing.

The proximity light sensor 680G may include, for example, a light emitting diode (LED) and a light detector such as a photodiode. The light emitting diode may be an infrared light emitting diode. The terminal device 600 emits infrared light to the outside through the light emitting diode. The terminal device 600 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the terminal device 600. When insufficient reflected light is detected, the terminal device 600 can determine that there is no object near the terminal device 600. The terminal device 600 can use the proximity light sensor 680G to detect that the user holds the terminal device 600 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 680G can also be used in leather case mode, and the pocket mode will automatically unlock and lock the screen.

The ambient light sensor 680L is used to sense the brightness of the ambient light. The terminal device 600 can adaptively adjust the brightness of the display screen 694 according to the perceived brightness of the ambient light. The ambient light sensor 680L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 680L can also cooperate with the proximity light sensor 680G to detect whether the terminal device 600 is in the pocket to prevent accidental touch.

The fingerprint sensor 680H is used to collect fingerprints. The terminal device 600 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photographs, fingerprint answering calls, and so on.

The temperature sensor 680J is used to detect temperature. In an embodiment, the terminal device 600 uses the temperature detected by the temperature sensor 680J to execute the temperature processing strategy. For example, when the temperature reported by the temperature sensor 680J exceeds a threshold value, the terminal device 600 executes to reduce the performance of the processor located near the temperature sensor 680J, so as to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the terminal device 600 heats the battery 642 to avoid abnormal shutdown of the terminal device 600 due to low temperature. In some other embodiments, when the temperature is lower than another threshold, the terminal device 600 boosts the output voltage of the battery 642 to avoid abnormal shutdown caused by low temperature.

The touch sensor 680K is also called "touch device". The touch sensor 680K can be arranged on the display screen 694, and the touch screen is composed of the touch sensor 680K and the display screen 694, which is also called a “touch screen”. The touch sensor 680K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. The visual output related to the touch operation can be provided through the display screen 694. In other embodiments, the touch sensor 680K may also be disposed on the surface of the terminal device 600, which is different from the position of the display screen 694.

The bone conduction sensor 680M can acquire vibration signals. In an embodiment, the bone conduction sensor 680M can acquire the vibration signal of the vibrating bone mass of the human voice. The bone conduction sensor 680M can also contact the human pulse and receive blood pressure pulse signals. In an embodiment, the bone conduction sensor 680M may also be provided in the earphone, combined with the bone conduction earphone. The audio module 670 can parse the voice signal based on the vibration signal of the vibrating bone block of the voice obtained by the bone conduction sensor 680M, and realize the voice function. The application processor may analyze the heart rate information based on the blood pressure beating signal obtained by the bone conduction sensor 680M, and realize the heart rate detection function.

The button 690 includes a power button, a volume button and so on. The button 690 may be a mechanical button. It can also be a touch button. The terminal device 600 may receive key input, and generate key signal input related to user settings and function control of the terminal device 600.

The motor 691 can generate vibration prompts. The motor 691 can be used for incoming call vibrating prompts, and can also be used for touch vibration feedback. For example, touch operations applied to different applications (such as photographing, audio playback, etc.) can correspond to different vibration feedback effects. Acting on touch operations in different areas of the display screen 694, the motor 691 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminding, receiving information, alarm clock, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

The indicator 692 can be an indicator light, which can be used to indicate the charging status, power change, and can also be used to indicate messages, missed calls, notifications, and so on.

The SIM card interface 695 is used to connect to the SIM card. The SIM card can be inserted into the SIM card interface 695 or pulled out from the SIM card interface 695 to achieve contact and separation with the terminal device 600. The terminal device 600 may support 1 or N SIM card interfaces, and N is a positive integer greater than 1. The SIM card interface 695 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. The same SIM card interface 695 can insert multiple cards at the same time. The types of the multiple cards can be the same or different. The SIM card interface 695 can also be compatible with different types of SIM cards. The SIM card interface 695 can also be compatible with external memory cards. The terminal device 600 interacts with the network through the SIM card to implement functions such as call and data communication. In an embodiment, the terminal device 600 adopts eSIM, that is, an embedded SIM card. The eSIM card can be embedded in the terminal device 600 and cannot be separated from the terminal device 600.

The following is a detailed introduction to the software system and hardware layer of the terminal device. Please refer to Figure 7a. The software system of the terminal device in this embodiment can adopt a layered architecture. From top to bottom, they are the application layer, application framework layer and The core layer.

The application layer can include a series of application packages. As shown in Figure 7a, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

The application framework layer provides application programming interfaces (application programming interface, API) and programming frameworks for applications in the application layer. The application framework layer includes some predefined functions. As shown in Figure 7a, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and a system application program interface.

The window manager is used to manage window programs. The window manager can obtain the size of the display, determine whether there is a status bar, lock the screen, take a screenshot, etc.

The content provider is used to store and retrieve data and make these data accessible to applications. The data may include video, image, audio, phone calls made and received, browsing history and bookmarks, phone book, etc.

The view system includes visual controls, such as controls that display text and controls that display pictures. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface that includes a short message notification icon may include a view that displays text and a view that displays pictures.

The telephone manager is used to provide the communication function of the terminal device. For example, the management of the call status (including connecting, hanging up, etc.).

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, etc.

The notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and it can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify the download completion, message reminder, etc. The notification manager can also be a notification that appears in the status bar at the top of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, in the status bar to prompt text information, sound a prompt tone, terminal equipment vibration, flashing lights, etc.

System Application Programming Interface (API), also known as application programming interface, is a collection of definitions, procedures and protocols, through which the mutual communication between computer software is realized. One of the main functions of the API is to provide a common set of functions. API is also a kind of middleware, providing data sharing for various platforms.

The application layer and the application framework layer run in a virtual machine. The virtual machine executes the java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

The kernel layer is the layer between hardware and software. The core layer can include lens rotation drive, image data drive, display drive, sensor drive, audio drive, and motor drive. Through the driver program, the corresponding hardware device can be driven to work normally, for example, the lens rotation drive is used to drive the motor of the hardware layer or manually trigger the switch to complete the lens switch.

The hardware layer in this embodiment may include multiple devices, for example, motors, manual trigger switches, motor devices, audio devices, image sensors, and lenses. Each device is used to perform the corresponding function, for example, the lens and the image sensor can be combined to realize the shooting function, and the audio device can play the prompt sound.

Combining the above description of the software system and the hardware layer, the software and hardware processing flow of the lens switching method described in this embodiment in the terminal device is introduced in detail, as shown in FIG. 7b, which may specifically include the following steps:

According to the user's shooting needs, the camera application of the application layer can call the camera device control module to issue the lens switching control flow;

The application framework layer receives the lens switching control flow issued by the application layer, and transmits the lens switching control flow to the kernel layer by calling the API;

The lens switching driver program of the kernel layer receives the lens switching control flow, and generates a switching control signal to control a motor or manually trigger a switch to rotate the lens;

The motor or the manual trigger switch of the hardware layer receives the switching control signal, and the motor or the manual trigger switch starts to run to rotate the to-be-switched lens to the position corresponding to the target image sensor.

Among them, the camera application program includes a camera device control module and a camera data flow module. The camera device control module is used to control the switch and lens switching of the camera device. The camera data flow module is used to receive image data; the application framework layer includes the camera device API And data flow API, used to transmit control flow or data flow; the kernel layer includes lens switching driver and image data driver, the lens switching driver is used to generate control signals to drive the motor to achieve lens switching, and the image data driver is used to drive The camera module is used to obtain image data; the hardware layer includes a motor, a manual trigger switch, a lens and an image sensor, and the lens and image sensor are recombined for imaging.

In an example, the audio driver and/or the motor driver of the kernel layer may also receive the lens switching control stream, wherein the audio driver may generate an audio control signal according to the lens switching control stream to control the audio device to play the prompt sound; The motor drive can generate a vibration control signal according to the lens switching control flow to control the vibration of the motor. Correspondingly, the hardware layer also includes audio devices and/or motor devices.

Correspondingly, when the lens switch is completed, the image sensor can re-imaging according to the matched lens, generate a data stream, and transmit the data stream to the image data driver of the kernel layer, and the image data driver of the kernel layer passes the data stream through The data flow API of the kernel layer is passed to the camera data flow module of the application layer to provide shooting data for the camera application.

The steps of the lens switching method provided in the embodiment of the present application will be described in detail below. Please refer to FIG. 8. The method specifically includes the following steps:

S801: The lens switching device determines a lens to be switched, and the lens to be switched is a lens among the M lenses.

The lens switching device can select the lens in the camera module for shooting according to the user's shooting needs, and the lens to be shot is the lens to be switched. Among them, there may be one or more lenses to be switched. For example, when the user's shooting requirement requires a wider field of view (for example, when shooting a wider landscape), a wide-angle lens is required for shooting, and the lens switching device determines that the lens to be switched is a wide-angle lens. For another example, when the user's shooting requirement is to shoot close-up close-ups (for example, when shooting close-up close-ups of people), a macro lens is needed for shooting, and the lens switching device determines that the lens to be switched is a macro lens.

In an example, each lens in the camera module may correspond to each lens identifier. Specifically, determining the lens to be switched may be determining the lens identifier of the lens to be switched. Wherein, the lens identifier corresponding to each lens can be preset by the lens switching device. For example, the camera module includes 3 lenses, namely a wide-angle lens, a telephoto lens, and a macro lens. You can set the lens identification of the wide-angle lens as lens 1, the lens identification of the telephoto lens as lens 2, and the lens identification of the macro lens as lens 3.

Among them, the lens switching device can determine the lens to be switched in the following three ways, of course, it can also determine the lens to be switched in other ways, which is not limited in the embodiment of the application. Among them, in mode 1, the lens switching device can automatically determine the lens to be switched according to the shooting parameters. In the second and third modes, the lens switching device may determine the lens to be switched according to the user's selection operation.

Manner 1: Determine shooting parameters, where the shooting parameters include shooting scenes and shooting modes; determine the lens to be switched according to the shooting parameters.

For example, when the shooting parameters include the shooting scene, the lens switching device may determine the shooting scene according to the image shooting preview screen, and then determine the lens to be switched according to the shooting scene. Among them, the lens switching device can automatically recognize the shooting scene according to the content in the image shooting preview screen. For example, when the image shooting preview screen is opened, the lens switching device can analyze which type of image the image in the preview screen is, such as a landscape image or a character image; and then determine the depth of field of the image in the preview screen. Image parameters such as shooting distance.

Based on the foregoing recognition of the content in the image shooting preview screen, the lens switching device can determine the shooting scene according to the image type and image parameters in the preview screen. After the shooting scene is determined, the lens to be switched can be determined according to the correspondence between the shooting scene and the lens. The corresponding relationship between the shooting scene and the lens may be preset and stored in the lens switching device. For example, the correspondence between the shooting scene and the lens stored in the lens switching device may be as shown in Table 1 below. Among them, the lenses and corresponding shooting scenes shown in Table 1 are only some examples, which are used for illustration and do not limit the application scenes of this embodiment.

Table 1: Correspondence table of shooting scene and lens

广角镜头Wide-angle lens	适用于要求视场角宽广的场景，例如建筑、风景等拍摄场景Suitable for scenes requiring a wide field of view, such as shooting scenes such as architecture and landscape
远焦镜头Telephoto lens	适用于距离拍摄目标较远的场景，例如远景、航拍等拍摄场景Suitable for scenes far away from the shooting target, such as distant scenes, aerial photography, etc.
微距镜头Macro lens	适用于近距离拍摄的场景，例如人物特写、景物特写等拍摄场景Suitable for close-up shooting scenes, such as close-ups of people, close-ups and other shooting scenes

For example, as shown in FIG. 9, the user opens the camera application, and the display interface of the lens switching device displays an image shooting preview screen; the lens switching device determines the shooting scene according to the preview screen. For example, if the preview screen in Figure 8 shows a portrait, you can determine that the image type in the preview screen is a person; then analyze that the person in the preview screen occupies about two-thirds of the preview screen, and you can determine that the shooting distance is closer .

According to the above content recognition result, the lens switching device determines that the shooting scene is a close-up shooting scene of a person. According to Table 1, it can be known that the shooting scene can use a macro lens for shooting close-up of a person, and the lens to be switched is determined to be a macro lens.

For another example, when the shooting parameters include a shooting mode, the selection of the shooting mode can be output on the display interface, and the user's selection operation of the shooting mode can be received, and then the lens to be switched is determined according to the shooting mode selected by the selection operation. For example, when a user needs to take a photo with a camera, the shooting mode to be used can usually be determined according to the shooting target. For example, when the user needs to use the camera to shoot a landscape, the user usually chooses to use the landscape shooting mode to make the captured image more perfect.

When the user determines the shooting mode to be used, the shooting mode usually corresponds to a kind of lens, and the lens switching device can determine that the lens corresponding to the shooting mode is the lens to be switched. Wherein, the correspondence between the shooting mode and the lens may be preset and stored in the lens switching device. For example, the corresponding relationship between the shooting mode and the lens stored in the lens switching device may be shown in Table 2 below. Among them, the lenses and corresponding shooting modes shown in Table 2 are only some examples, which are used for illustration and do not limit the application scenarios of this embodiment.

Table 2: Correspondence table of shooting mode and lens

广角镜头Wide-angle lens	适用于夜景模式、风景模式、大光圈模式等Suitable for night scene mode, landscape mode, large aperture mode, etc.
远焦镜头Telephoto lens	适用于远景模式、航拍模式等Suitable for remote view mode, aerial mode, etc.
微距镜头Macro lens	适用于人像模式等Suitable for portrait mode etc.

For example, as shown in FIG. 10, the user opens the camera application, and the display interface will display options for shooting modes; the user clicks to select one of the shooting modes. For example, if the user currently needs to take a portrait, he can click to select the portrait shooting mode. Among them, when the display interface displays the options of the shooting mode, all the options of the shooting mode can be displayed by sliding left and right in the option bar. After receiving the user's selection operation of the shooting mode, the lens switching device searches the correspondence table between the shooting mode and the lens according to the selected shooting mode, and determines the lens to be switched. For example, if the lens corresponding to the portrait shooting mode is a macro lens, it is determined that the lens to be switched is a macro lens.

Method 2: The analog interface to the camera module can be output on the display interface of the lens switching device, and the user's operation on the analog interface can be received. The user's operation on the simulation interface may be a drag operation of dragging the target lens to a position corresponding to the target image sensor, or a clicking operation on the target lens. According to the user's operation on the simulation interface, the target lens is determined as the lens to be switched.

Among them, the simulation interface of the camera module is the simulation visualization interface of the camera module of the lens switching device. The user can manually select and switch the lens through the visualization interface, and the corresponding hardware device will correspond to the hardware layer according to the user's operation on the simulation interface. Perform related operations, such as completing lens switching.

The user's operation on the simulation interface may be a drag operation of dragging the target lens to a position corresponding to the target image sensor, for example, dragging the target lens clockwise or counterclockwise to the position corresponding to the image sensor. The user's operation on the simulation interface can also be a click operation on the target lens. For example, the user clicks on the target lens in the simulation interface. After receiving the user's click operation on the target lens, the lens switching device can automatically switch the target lens to The location corresponding to the target sensor.

For example, as shown in Figure 11, the user opens the camera application, clicks on the setting item, and can choose to display the simulation interface of the camera module. After entering the simulation interface, the simulation interface will display the simulation structure of the camera module inside the lens switching device, where the simulation structure is the structure displayed after visualizing the hardware structure of the camera module. The simulation interface shown in FIG. 11 includes 3 lenses and an image sensor, and each lens corresponds to a lens identifier (such as lens 1).

Optionally, the simulation interface can also display detailed information of each lens, such as lens parameters and shooting scenes applicable to the lens. The user can determine that the target lens is lens 1 according to the detailed information of each lens displayed in the simulation interface shown in FIG. 11 in combination with shooting requirements. After determining the target lens, the user can drag and rotate lens 1 to the position corresponding to the sensor, that is, determine that the lens to be switched is lens 1.

Optionally, after the user completes the operation of the lens in the simulation interface, the simulation interface can be closed. For example, a close option can be set in the upper right corner of the simulation interface, and when the lens switching device detects that the user clicks the close option, the simulation interface will be closed. For another example, within a period of time after the lens switching device detects the user's operation on the simulation interface, if the user's operation on the simulation interface is not detected again, the lens switching device defaults that the lens switching has been completed and the simulation interface will be automatically closed.

Manner 3: The selection items of the lens can be output on the display interface of the lens switching device, and the user's selection operation of the lens can be received, and then the lens selected by the user is determined as the lens to be switched.

Wherein, the selection item of the lens may include a lens identification and detailed information of the lens corresponding to the identification. For example, the lens switching device includes multiple lenses, and each lens corresponds to different lens detailed information. The detailed information of each lens can be displayed on the display interface. For example, the detailed information of lens 1 is that the focal length of the lens is 8 mm, and the suitable shooting scene of the lens is architecture. Shoot the scene.

For example, as shown in FIG. 12, the user opens the camera application and clicks the lens selection item, and the display interface of the lens switching device will display the lens selection item. For example, the camera module of the lens switching device includes 3 lenses, and the display interface will display the lens parameters and applicable shooting scenes of the 3 lenses. The user clicks to select one of the lenses according to the shooting needs. For example, if the user currently needs to take a portrait, he can select a macro lens, and the lens to be switched is determined to be a macro lens.

S802: The lens switching device switches the to-be-switched lens to a position corresponding to a target image sensor, where the target image sensor is a sensor of the N image sensors.

The target image sensor can be any one of the N image sensors. The position of any one of the image sensors in this embodiment is fixed, and the position to which the lens to be switched is determined after the target image sensor is determined is also determined. For example, when the camera module includes one image sensor and multiple lenses, the target image sensor is an image sensor in the camera module. After the lens to be switched is determined, the lens to be switched can be directly switched to the position corresponding to the image sensor. For example, in the camera module shown in FIG. 2a, if the lens to be switched is lens 2, then lens 2 is directly switched to the position corresponding to the sensor.

Wherein, the target image sensor may also be multiple image sensors among the N image sensors. For example, when the camera module includes multiple image sensors and multiple lenses, a free combination of multiple image sensors and multiple lenses can be realized. After determining multiple lenses to be switched, it is also necessary to determine the image sensor corresponding to each lens to be switched, so as to switch each lens to be switched to the corresponding position of the corresponding image sensor.

For example, the lens switching device may pre-store the correspondence between the lens and the image sensor. The lens switching device acquires the image sensor corresponding to the lens to be switched as the target sensor according to the pre-stored correspondence between the lens and the image sensor, and then switches the lens to be switched to the position corresponding to the target sensor.

For example, the camera module includes two image sensors, where the image resolution of sensor 1 is higher, and the image resolution of sensor 2 is lower. According to the user's shooting needs, determine the lenses to be switched as lens 1 and lens 2. Among them, lens 1 is a wide-angle lens, which needs to match an image sensor with a higher image resolution, and lens 2 is a telephoto lens, which requires lower image resolution Lens 1. Then the lens switching device can determine that the corresponding relationship between each lens to be switched and each image sensor is that lens 1 matches sensor 1, and lens 2 matches sensor 2, thereby determining that lens 1 is switched to the position corresponding to sensor 1, and lens 2 is switched to the position corresponding to sensor 2. position.

Wherein, when the lens to be switched is switched to the position corresponding to the target image sensor, it can be switched according to the rotation angle, which specifically includes the following steps: determining the rotation angle between the lens to be switched to the position corresponding to the target image sensor, and according to the rotation angle Switch the to-be-switched lens to a position corresponding to the target image sensor in a counterclockwise direction or a clockwise direction.

Further, it may be determined according to the first rotation angle and the second rotation angle in which direction to switch the lens to be switched to the position corresponding to the target image sensor. Wherein, the first angle of rotation is an angle of rotation in a clockwise direction, and the second angle of rotation is an angle of rotation in a counterclockwise direction. Specifically, it may include the following steps: if the first rotation angle is smaller than the second rotation angle, switching the to-be-switched lens to the position corresponding to the target image sensor in a clockwise direction; if the second rotation angle is smaller than the According to the first rotation angle, the lens to be switched is switched to the position corresponding to the target image sensor in a counterclockwise direction.

For example, in the camera module shown in FIG. 2a, the lens to be switched is lens 2, and the first rotation angle of lens 2 is about 270 degrees, and the second rotation angle of lens 2 is about 30 degrees. Rotate counterclockwise to the position corresponding to the target image sensor.

In an example, the lens to be switched can be switched to the position corresponding to the target image sensor by rotating the lens by the motor. For example, a switching control signal can be sent to the motor, and after the motor receives the switching control signal, it can drive the lens to be switched The lens rotates to the position corresponding to the target sensor.

In an example, the user can manually switch the lens to be switched to the position corresponding to the target image sensor. For example, a manual trigger switch (such as a manual knob) can be installed on the terminal device. When the lens is switched manually, the camera module can be visible (for example, the camera module area of the terminal is a transparent shell, or the display interface of the terminal Display the analog interface of the camera). The user can directly operate the manual trigger switch to rotate the lens to be switched to the position corresponding to the target image sensor, and the entire switching process is a visualization process to ensure that the lens to be switched is accurately switched to the position corresponding to the target image sensor.

In an example, in the process of switching the to-be-switched lens to the position corresponding to the target image sensor, a switching prompt may be performed at the same time, wherein the switching prompt may include, but is not limited to, an audio prompt, a vibration prompt, and the like. For example, during the switching process, prompt sounds (such as playing music, playing lens switching voice, etc.) can be played, or the terminal device can be vibrated to remind the user that the camera is switching, and the user experience in the switching process can be improved.

It can be seen that the embodiment of the present application provides a lens switching method. The method determines the lens to be switched, and then switches the lens to be switched to a position corresponding to the target image sensor, so as to realize the snapping and reassembly of the lens and the image sensor. The method can be applied to a lens switching device, where the lens switching device includes a camera module in which the lens and the image sensor are decoupled, and the free combination of multiple lenses and sensors can be realized through lens switching, which reduces The number of sensors to reduce the manufacturing cost of the terminal equipment; optionally, the peripherals (such as audio devices and motor devices) can be linked during the lens switching process, so that the user can perceive the lens switching process and improve the user's use Experience.

An embodiment of the present application provides a lens switching device, as shown in FIG. 13. The lens switching device 1300 may be used to execute the lens switching method described in FIG. 8, and the lens switching device includes:

The determining unit 1301 is configured to determine a lens to be switched, and the lens to be switched is one of the M lenses;

The switching unit 1302 is configured to switch the lens to be switched to a position corresponding to a target image sensor, and the target image sensor is one of the N image sensors.

In an implementation manner, the switching unit 1302 may be specifically used for:

Determining the rotation angle between the lens to be switched and the position corresponding to the target image sensor;

According to the rotation angle, the to-be-switched lens is switched to the position corresponding to the target image sensor in a counterclockwise direction or a clockwise direction.

In one implementation, the rotation angle includes a first rotation angle of the lens to be switched in a clockwise direction and a second rotation angle of the lens to be switched in a counterclockwise direction; the switching unit 1302 may specifically use in:

If the first rotation angle is smaller than the second rotation angle, switching the to-be-switched lens to a position corresponding to the target image sensor in a clockwise direction;

If the second rotation angle is smaller than the first rotation angle, the lens to be switched is switched to a position corresponding to the target image sensor in a counterclockwise direction.

In an implementation manner, the determining unit 1301 may be specifically configured to:

Determine shooting parameters, where the shooting parameters include a shooting scene and a shooting mode;

Determine the lens to be switched according to the shooting parameters.

Output an analog interface to the camera module;

Receiving a user's operation on the simulation interface, where the operation is a drag operation in which the user drags the target lens to a position corresponding to the target image sensor, or the operation is a click operation on the target lens;

The target lens is determined as the lens to be switched.

Options for output lens;

Receive the user's selection operation on the lens;

It is determined that the lens selected by the selection operation is the lens to be switched.

In an implementation manner, the lens switching device further includes a prompt unit 1303, which is used to perform a switching prompt during the process of switching the lens to be switched to a position corresponding to the target image sensor.

In an implementation manner, the switching prompt includes an audio prompt and/or a vibration prompt.

An embodiment of the present application provides another lens switching device, as shown in FIG. 14. The lens switching device 1400 may include a processor 1401 for determining the lens to be switched or switching the lens to be switched to a position corresponding to the target sensor; wherein the determining unit 1301, the switching unit 1302, and the prompt unit 1303 shown in FIG. 13 The implemented related functions can all be implemented by the processor 1401. The processor 1401 may include one or more processors. For example, the processor 1401 may be one or more central processing units (CPUs), network processors (NPs), hardware chips, or any combination thereof . In the case where the processor 1401 is a CPU, the CPU may be a single-core CPU or a multi-core CPU.

The lens switching device 1400 may further include a memory 1402, and the memory 1402 is used to store program codes and the like. The memory 1402 may include a volatile memory (volatile memory), such as a random access memory (random access memory, RAM); the memory 1402 may also include a non-volatile memory (non-volatile memory), such as a read-only memory (read-only memory). Only memory (ROM), flash memory (flash memory), hard disk drive (HDD) or solid-state drive (SSD); the memory 1402 may also include a combination of the foregoing types of memories.

The above-mentioned processor 1401 and memory 1402 may be used to implement the lens switching method described in FIG. 8, wherein the processor 1401 is used to determine the lens to be switched, and is also used to switch the lens to be switched to a position corresponding to the target image sensor.

In an implementation manner, the processor 1401 may be specifically used to:

According to the rotation angle, the lens to be switched is switched to a position corresponding to the target image sensor in a counterclockwise direction or a clockwise direction.

In one implementation, the rotation angle includes a first rotation angle of the lens to be switched in a clockwise direction and a second rotation angle of the lens to be switched in a counterclockwise direction; the processor 1401 may specifically use in:

In an implementation manner, the processor 1401 may be specifically used to:

Determine the lens to be switched according to the shooting parameters.

In an implementation manner, the processor 1401 may be specifically used to:

Output an analog interface to the camera module;

The target lens is determined as the lens to be switched.

In an implementation manner, the processor 1401 may be specifically used to:

Options for output lens;

Receive the user's selection operation on the lens;

In an implementation manner, the processor 1401 may be specifically used to:

In the process of switching the to-be-switched lens to the position corresponding to the target image sensor, a switching prompt is performed.

In one implementation, the switching prompt includes an audio prompt and/or a vibration prompt.

It should be noted that the device in the foregoing embodiment may be a terminal device, or a chip applied to a terminal device or other combination devices or components with the foregoing terminal functions.

The embodiment of the present application also provides a readable storage medium, which includes a program or instruction, when the program or instruction runs on a computer, the computer executes the lens executed by the lens switching device in the above method embodiment. Switch method.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented in the form of a computer program product in whole or in part. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on the computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website, computer, server, or data center. Transmission to another website, computer, server, or data center via wired (for example, coaxial cable, optical fiber, Digital Subscriber Line (DSL)) or wireless (for example, infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or a data center integrated with one or more available media. The usable medium may be a magnetic medium (for example, a floppy disk, a hard disk, and a magnetic tape), an optical medium (for example, a high-density digital video disc (Digital Video Disc, DVD)), or a semiconductor medium (for example, a solid state disk (Solid State Disk, SSD)) etc.

A person of ordinary skill in the art may realize that the units and algorithm steps of the examples described in the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of the two, in order to clearly illustrate the hardware and software Interchangeability. In the above description, the composition and steps of each example have been generally described in terms of function. Whether these functions are executed by hardware or software depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of this application.

The above are only specific implementations of this application, but the protection scope of this application is not limited to this. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in this application. Should be covered within the scope of protection of this application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.

Claims

A lens switching method, characterized in that it is applied to a lens switching device, the lens switching device includes a camera module, the camera module includes M lenses, N image sensors and a motor; the M is greater than or A positive integer equal to 2, the N is a positive integer greater than or equal to 1, and the M is greater than N, the method includes:

Determining a lens to be switched, where the lens to be switched is a lens of the M lenses;

Switching the to-be-switched lens to a position corresponding to a target image sensor, where the target image sensor is a sensor of the N image sensors.
The method according to claim 1, wherein the switching the to-be-switched lens to a position corresponding to the target image sensor comprises:

Determining the rotation angle between the lens to be switched and the position corresponding to the target image sensor;

According to the rotation angle, the lens to be switched is switched to a position corresponding to the target image sensor in a counterclockwise direction or a clockwise direction.
The method according to claim 2, wherein the rotation angle comprises a first rotation angle of the lens to be switched in a clockwise direction and a second rotation angle of the lens to be switched in a counterclockwise direction;

The switching the lens to be switched to a position corresponding to the target image sensor in a counterclockwise or clockwise direction according to the rotation angle includes:

If the first rotation angle is smaller than the second rotation angle, switching the to-be-switched lens to a position corresponding to the target image sensor in a clockwise direction;

If the second rotation angle is smaller than the first rotation angle, the lens to be switched is switched to a position corresponding to the target image sensor in a counterclockwise direction.
The method according to any one of claims 1 to 3, wherein the determining the lens to be switched comprises:

Determine shooting parameters, where the shooting parameters include a shooting scene and a shooting mode;

Determine the lens to be switched according to the shooting parameters.
The method according to any one of claims 1 to 3, characterized in that, before the determining the lens to be switched, the method further comprises:

Output an analog interface to the camera module;

Receiving a user's operation on the simulation interface, where the operation is a drag operation in which the user drags the target lens to a position corresponding to the target image sensor, or the operation is a click operation on the target lens;

The determining the lens to be switched includes:

The target lens is determined as the lens to be switched.
The method according to any one of claims 1 to 3, characterized in that, before the determining the lens to be switched, the method further comprises:

Options for output lens;

Receive the user's selection operation on the lens;

The determining the lens to be switched includes:

It is determined that the lens selected by the selection operation is the lens to be switched.
The method according to any one of claims 1 to 6, wherein the method further comprises:

In the process of switching the to-be-switched lens to the position corresponding to the target image sensor, a switching prompt is performed.
The method according to claim 7, wherein the switching prompt comprises an audio prompt and/or a vibration prompt.
A lens switching device, wherein the lens switching device includes a camera module, the camera module includes M lenses, N image sensors, and a motor; the M is a positive integer greater than or equal to 2, The N is a positive integer greater than or equal to 1, and the M is greater than N; the lens switching device further includes:

A determining unit, configured to determine a lens to be switched, and the lens to be switched is a lens among the M lenses;

The switching unit is configured to switch the lens to be switched to a position corresponding to a target image sensor, and the target image sensor is a sensor among the N image sensors.
The device according to claim 9, wherein the switching unit is configured to switch the to-be-switched lens to a position corresponding to the target image sensor, and is specifically configured to:

Determining the rotation angle between the lens to be switched and the position corresponding to the target image sensor;

According to the rotation angle, the lens to be switched is switched to a position corresponding to the target image sensor in a counterclockwise direction or a clockwise direction.
The device according to claim 10, wherein the rotation angle comprises a first rotation angle of the lens to be switched in a clockwise direction and a second rotation angle of the lens to be switched in a counterclockwise direction;

The switching unit is configured to switch the lens to be switched to the position corresponding to the target image sensor in a counterclockwise or clockwise direction according to the rotation angle, specifically:

If the first rotation angle is smaller than the second rotation angle, switching the to-be-switched lens to a position corresponding to the target image sensor in a clockwise direction;

If the second rotation angle is smaller than the first rotation angle, the lens to be switched is switched to a position corresponding to the target image sensor in a counterclockwise direction.
The device according to any one of claims 9 to 11, wherein the determining unit is configured to determine the lens to be switched, specifically:

Determine shooting parameters, where the shooting parameters include a shooting scene and a shooting mode;

Determine the lens to be switched according to the shooting parameters.
The device according to any one of claims 9 to 11, wherein the determining unit is configured to determine the lens to be switched, specifically:

Output an analog interface to the camera module;

Receiving a user's operation on the simulation interface, where the operation is a drag operation in which the user drags the target lens to a position corresponding to the target image sensor, or the operation is a click operation on the target lens;

The target lens is determined as the lens to be switched.
The device according to any one of claims 9 to 11, wherein the determining unit is configured to determine the lens to be switched, specifically:

Options for output lens;

Receive the user's selection operation on the lens;

It is determined that the lens selected by the selection operation is the lens to be switched.
The device according to any one of claims 9 to 14, wherein the device further comprises a prompting unit, the prompting unit is used to switch the to-be-switched lens to a position corresponding to the target image sensor. , Prompt for switching.
The device according to claim 15, wherein the switching prompt comprises an audio prompt and/or a vibration prompt.
A readable storage medium, characterized by comprising a program or instruction, when the program or instruction is run on a computer, the method according to any one of claims 1 to 8 is executed.