WO2023093274A1

WO2023093274A1 - Photographing preview method, image fusion method, electronic device, and storage medium

Info

Publication number: WO2023093274A1
Application number: PCT/CN2022/121449
Authority: WO
Inventors: 张冬明; 苟定勇
Original assignee: 中兴通讯股份有限公司
Priority date: 2021-11-29
Filing date: 2022-09-26
Publication date: 2023-06-01
Also published as: CN116208846A

Abstract

Embodiments of the present application provide a photographing preview method, an image fusion method, an apparatus, an electronic device, and a storage medium. An amplification factor of a telephoto lens is set, such that a field of view corresponding to the telephoto lens is the maximum (S310); a telephoto photographed image of the telephoto lens and a main photographed image of a main camera are obtained (S320); a target image in the telephoto photographed image is then obtained and the target image is amplified (S330); the amplified target image is displayed and locked to a preset position of a telephoto preview window, wherein the telephoto preview window is suspended on a main camera preview window (S340); and finally, the amplified target image and the main photographed image are fused to obtain a final photographed image (S350).

Description

Shooting preview method, image fusion method, electronic device and storage medium

Cross References to Related Applications

This application is based on a Chinese patent application with application number 202111473660.8 and a filing date of November 29, 2021, and claims the priority of this Chinese patent application. The entire content of this Chinese patent application is hereby incorporated by reference into this application.

technical field

The present application relates to but not limited to the field of electronic technology, and in particular relates to a shooting preview method, image fusion method, device, electronic equipment and storage medium.

Background technique

With the popularity of smart terminals, users are more likely to use the shooting function of smart terminals to record their life and work. For the shooting of some scenes, such as the shooting of the moon, it is often necessary to cooperate with the telephoto lens and the main camera lens to complete the shooting. Among them, in order to capture a clear image of the scene, the telephoto lens is set to a high magnification. After the main camera lens captures the target scene and its background, the image taken by the telephoto lens is fused with the image taken by the main camera lens. Form a clear image. However, because the distance between the telephoto lens and the main camera lens is very close, and the viewing angles of the two cameras are highly similar, when the user adjusts according to the shooting preview of the main camera lens during shooting, a slight shake may cause blurring in the telephoto lens. The scene disappears, causing the shooting to fail.

Contents of the invention

The following is an overview of the topics described in detail in this article. This summary is not intended to limit the scope of the claims.

Embodiments of the present application provide a shooting preview method, image fusion method, device, electronic equipment, and storage medium, which improve the anti-shake effect of shooting and improve user experience.

In the first aspect, an embodiment of the present application provides a shooting preview method, including: setting the magnification of the telephoto lens to maximize the viewing range corresponding to the telephoto lens; acquiring the telephoto shot image of the telephoto lens and The main shot image of the main camera lens; acquire the target image in the telephoto shot image, and enlarge the target image; display and lock the enlarged target image to the preset position of the telephoto image preview window, so The telephoto image preview window is suspended and set on the main camera image preview window.

In a second aspect, an embodiment of the present application provides an image fusion method, including: acquiring the enlarged target image obtained according to the shooting preview method described in the first aspect and the main shot image; fusing the enlarged The final target image is combined with the image captured by the main camera to obtain a final captured image.

In a third aspect, an embodiment of the present application further provides a photographing device, the device including: a telephoto lens parameter setting unit, configured to set the magnification of the telephoto lens to maximize the viewing range corresponding to the telephoto lens The image processing unit is configured to obtain the telephoto shot image of the telephoto lens and the main shot image of the main camera lens; the image processing unit is also configured to obtain the target image in the telephoto shot image and Enlarging the target image; an image display unit, including a main camera image preview window configured to display a main camera image and a telephoto image preview set to display a telephoto image suspended on the main camera preview window window, the image display unit is configured to display the locked enlarged target image to a preset position of the telephoto image preview window.

In the fourth aspect, the embodiment of the present application also provides an electronic device, including: a telephoto lens, a main camera lens, a memory, a processor, and a computer program stored in the memory and operable on the processor, the processor When the computer program is executed, the shooting preview method described in the first aspect above, or the image fusion method described in the second aspect is realized.

In the fifth aspect, the embodiment of the present application also provides a computer-readable storage medium, which stores computer-executable instructions, and the computer-executable instructions are used to execute the shooting preview method described in the first aspect above, or the second aspect The image fusion method described.

Additional features and advantages of the application will be set forth in the description which follows, and, in part, will be obvious from the description, or may be learned by practice of the application. The objectives and other advantages of the application will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.

Description of drawings

The accompanying drawings are used to provide a further understanding of the technical solution of the present application, and constitute a part of the specification, and are used together with the embodiments of the present application to explain the technical solution of the present application, and do not constitute a limitation to the technical solution of the present application.

1A and 1B are schematic diagrams showing the effects of image processing in the related art;

FIG. 2 is a flowchart of a shooting preview method provided by an embodiment of the present application;

3A to 3F are schematic diagrams showing the effect of the shooting preview method provided by an embodiment of the present application;

FIG. 4 is a flowchart of an image fusion method provided by an embodiment of the present application;

5A to 5D are schematic diagrams of the effect of the image fusion method provided by an embodiment of the present application;

Fig. 6 is a flowchart of a complete shooting method provided by an embodiment of the present application;

FIG. 7 is a schematic structural diagram of a photographing device provided by an embodiment of the present application.

Detailed ways

In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, not to limit the present application.

It should be noted that although a logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than in the flowchart. The terms "first", "second" and the like in the specification and claims and the above drawings are used to distinguish similar objects, and not necessarily used to describe a specific sequence or sequence.

With the development of electronic devices, there are more and more electronic devices with shooting functions. Because these electronic devices integrate a variety of lenses, they are no longer limited to a single mode of close-up shooting, but have developed other modes such as long-range shooting. . Taking electronic devices such as smart phones as an example, users often use mobile phones to take pictures of nearby or distant landscapes. The most common way to take pictures of distant scenery is to take pictures of the moon. In the existing technology, a high-power telephoto lens is often used for shooting to obtain a clear scene image, and then the scene image is fused with the overall landscape image captured by the main camera lens to form a moon with both the overall environmental atmosphere and clear details image. However, due to the very high magnification of the telephoto lens, which can reach 30x magnification, the viewfinder shift caused by the user's slight hand shake will cause the moon to float out of the viewfinder range, resulting in the failure of shooting.

Based on this, the application provides a shooting preview method, image fusion method, device, electronic equipment and storage medium, by setting the magnification of the telephoto lens as small as possible, and then making the viewing range of the telephoto lens as large as possible At the same time, the target image is enlarged and locked at the preset position, so that the user can shoot the target scene when moving the electronic device in a wide range, which improves the anti-shake effect in the shooting scene of the electronic device and improves the success rate of shooting. The user has a better shooting experience.

The embodiments of the present application will be further described below in conjunction with the accompanying drawings.

1A and 1B are schematic diagrams of the effect of image processing in the related art, specifically a schematic diagram of the processing effect of the image of the moon. As shown in Figure 1A, it is a moon image taken with a high-magnification telephoto lens. Due to the high magnification, the target image of the moon is very large and is located in the upper right corner of the image. At the same time, the main camera is also shooting. Since the main camera lens has no magnification or a small magnification, it can capture a smaller moon and other surrounding landscapes. In order to facilitate users to observe the shooting situation, the telephoto lens The preview window is superimposed on the preview window of the main camera. As shown in Figure 1B, the telephoto image preview window is suspended in the upper right corner of the main image preview window. Since the moon image in the telephoto image has not been processed, the moon in the telephoto image is also located in the telephoto image preview window. In the upper right corner, the dotted frame is a reminder frame, which is set to remind the user that the telephoto moon can be captured in the main camera lens. It can be found that at this time, as long as the user shifts the viewfinder slightly to the right, the moon will float out of the viewfinder frame, causing the viewfinder failure of the telephoto lens, which eventually leads to the failure of shooting.

It should be noted that the optical magnification of the telephoto lens of a smartphone is relatively small (for example, 5x). In order to obtain a larger magnification, digital zoom is assisted. When the digital zoom is 6 times, the telephoto lens The overall magnification factor is 5x*6=30x, which means that the moon can appear in both the telephoto lens and the main camera lens only within the framing area corresponding to 1/30 of the main camera lens’ framing area. It may cause the shooting to fail.

In order to solve the problem that the user is difficult to take pictures in the related art, the embodiment of the present application provides the following shooting preview method. Those skilled in the art should know that the shooting preview method provided by this application is not limited to the shooting preview of the moon. Any distant view, such as an airplane in the sky, a ship at sea, and any close-up view, such as people, plants, and display images, can be obtained through the embodiment of this application. The provided scheme completes the shooting, and this application uses the moon as an example of a scene shooting preview.

Fig. 2 is the flowchart of the shooting preview method in the moon shooting process provided by an embodiment of the present application. Fig. 3 provides a schematic diagram of the effect of the shooting preview method in the moon shooting process, and the shooting preview method at least includes the following steps:

Step S110: The main camera lens and the telephoto lens shoot at the same time.

In one embodiment, the main camera lens and the telephoto lens are turned on at the same time for shooting, and the magnification of the telephoto lens is set to be as small as possible.

Step S121: Acquiring an image captured by the main camera.

Step S122: Acquiring a telephoto shot image.

Since the user is continuously shooting the target scene when shooting, the telephoto lens and the main camera lens will respectively generate a telephoto video stream and a main camera video stream during the shooting process, and in the embodiment of the application, the main camera takes images The image captured with the telephoto is the telephoto video frame and the main camera video frame obtained based on the sampling of the telephoto video stream and the main camera video stream.

In one embodiment, the main camera lens shoots to obtain the main camera shot image. Referring to FIG. 3A, the telephoto lens shoots to obtain the telephoto shot image. Referring to FIG. 3B, since the magnification of the telephoto lens in the embodiment of the present application is small, The target image in the telephoto image is relatively small, that is, the moon is relatively small.

Step S130: Perform target image detection on the telephoto shot image.

In one embodiment, as shown in FIG. 3C , the target image taken by the telephoto lens is recognized through the convolutional neural network of artificial intelligence. The aspect ratio is set to be the same as that of the image captured by the telephoto lens, see FIG. 3D .

It is worth noting that in Figure 3C, the target image is delineated and output using the smallest rectangular frame, but in practical applications, frames of other shapes can be used to delineate and output the target image; at the same time, in practical applications, the rectangular frame is also It is not necessarily the smallest rectangular frame that can delineate the target image, and the smallest rectangular frame is only an implementation manner, which is more conducive to effective zooming in of the image.

Step S140: Enlarging the target image.

In one embodiment, as shown in FIG. 3E , according to the extraction frame obtained in the previous step, the target image is enlarged. Since the target image is in the middle of the extraction frame, the target image can still be in the middle when zooming proportionally. Location.

Step S150 : Preview the superimposed display.

In one embodiment, as shown in FIG. 3F , the enlarged telephoto image is displayed in the telephoto image preview window. Since the preview window is to help the user observe and determine whether the shooting conditions of the target image meet the shooting conditions or shooting requirements, it is suspended above the preview window of the main camera image as an auxiliary window, and the preview window of the telephoto image is smaller than the preview window of the main camera image. This is convenient for users to observe the shooting situation of the main camera image at any time. The position of the floating setting can be at any position, but in order not to block the main camera image, it is generally set at the corner of the main camera image preview window.

In one embodiment, when the user is shooting, he will continuously adjust the main camera lens and the telephoto lens according to the image display in the preview window to make the image displayed in the preview window satisfactory, and the shooting conditions are satisfied at this time.

In another embodiment, the shooting conditions are preset by a program in the electronic device, and the electronic device will judge whether the currently captured image meets the requirements according to the preset shooting conditions, and then enter the subsequent image fusion stage.

It is worth noting that the dotted frame in Figure 3F is a prompt frame, which is set to remind the user that the telephoto moon can be captured in the main camera lens. It can be found that, compared with the viewfinder range of the main camera lens in the related art in Figure 1, using the shooting preview method in the embodiment of the present application can significantly expand the viewfinder range of the main camera lens, and will not cause the moon to float due to the user's hand shaking. Outside the viewfinder frame, the anti-shake effect is greatly improved and the difficulty of shooting is reduced.

It is worth noting that step S110 to step S150 in the preview stage is a cyclic process, that is, each of the above steps is performed for video frames in the real-time transmitted video stream, thus realizing real-time video-level preview.

Through the shooting preview method provided by the above-mentioned embodiments of the present application, by setting the magnification of the telephoto lens as small as possible, the viewing range of the telephoto lens is made as large as possible, so that the details of the telephoto shot image are clear, and then the telephoto lens The captured target image is enlarged and locked at the preset position of the telephoto preview window, achieving multiple anti-shake effects.

Fig. 4 is a flowchart of an image fusion method provided by an embodiment of the present application, and Fig. 5 provides a schematic diagram of the effect of the image fusion method, and the image fusion method at least includes the following steps:

Step S210: Acquiring a captured image.

Step S221: Acquiring a telephoto image.

In one embodiment, as shown in FIG. 5A , the magnification of the telephoto lens is small, so the target image in the telephoto shot image is relatively small, that is, the moon is relatively small.

Step S222: Acquiring an image captured by the main camera.

In one embodiment, as shown in FIG. 5B , the shooting of the main camera lens in this embodiment is the same as that of a common main camera lens.

Step S230: Perform target image detection on the telephoto shot image.

In one embodiment, the target image taken by the telephoto lens is identified through an artificial intelligence convolutional neural network, for example, the target image is identified by using a ResNet50 convolutional neural network trained on a large-scale image data set ImageNet, At the same time, in order to avoid distortion in the enlargement of the target image in the next step, the aspect ratio of the image extraction frame is set to be the same as the aspect ratio of the captured image of the telephoto lens.

Step S240: Enlarge the target image.

In one embodiment, after the detection of the target image is completed, the target image is enlarged to obtain FIG. 5C .

Step S250: Fusing the image captured by the main camera and the enlarged target image to finally obtain the captured image.

In one embodiment, the main camera image is fused with the enlarged target image to obtain a moon image with both overall environmental atmosphere and clear details, as shown in FIG. 5D .

It is worth noting that, unlike the shooting preview method, which is performed in a loop, the image fusion method is aimed at fusing the current telephoto image and the main camera image every time the user presses the shutter.

In order to be able to show the whole process of shooting by applying the shooting preview method and image fusion method provided by the embodiment of the present application, that is, the user presses the shutter in the preview stage and then enters the image fusion stage, and the shooting process is completed after the two methods work together. exhibit.

As shown in Figure 6, Figure 6 is a flowchart of the shooting method provided by the embodiment of the present application, at least including the following steps:

Step S310: Setting the magnification factor of the telephoto lens so that the viewing range corresponding to the telephoto lens is the largest.

In one embodiment, the smart phone is the execution subject of the photographing method. Taking an Android mobile phone as an example, when entering some shooting modes, the Android platform will provide a corresponding off-the-shelf interface with a magnification setting, which is set to control the magnification of the camera, but the shooting method provided by this application does not use the magnification of the off-the-shelf interface magnification, but set the magnification by yourself, and make the magnification the smallest, even if the telephoto lens corresponds to the largest viewfinder range. For example, the optical magnification of the telephoto lens of a smart phone is generally 5x, so in this embodiment, 5x is selected as the magnification of the telephoto lens, so that the viewfinder range corresponding to 1/5 of the viewfinder area of the main camera lens It can ensure that both the telephoto lens and the main camera lens can successfully find a view, which can make it more convenient and fast for users to complete the scene shooting.

Step S320: Obtain a telephoto shot image of the telephoto lens and a main shot image of the main camera lens.

In one embodiment, the acquisition of the target image is carried out using the target detection technology of traditional artificial feature extraction, such as Viola-Jones detector, HOG (Histogram of Oriented Gradient, direction gradient histogram) detector, DPM (Deformable Part Model, can Deformed part model) detector, etc.

In another embodiment, a target detection technology based on an artificial intelligence model, such as an R-CNN model, an SPPNet model, a Fast-RCNN model, a Faster-RCNN model, a Feature Pyramid Networks model, etc. is used.

In an embodiment of shooting the moon, the target image is surrounded by the minimum rectangular bounding box to complete the recognition of the target image, and then the center point of the minimum rectangular bounding box is obtained to form an image extraction frame containing the minimum rectangular bounding box, wherein the image extraction frame The aspect ratio of the image is the same as that of the telephoto shot image; the aspect ratio of the image extraction frame is the same as that of the telephoto shot image, so that in the subsequent scaling steps, the target image can be guaranteed not to be deformed, and then Make the captured images more accurate and real.

It should be noted that any algorithm that can realize target detection and recognition can be applied to this step. Since target detection is not the focus of this application, it will not be described in detail here.

Step S330: Acquiring a target image in the telephoto shot image, and zooming in on the target image.

In one embodiment, the target image is enlarged using an interpolation method, and the difference method may be a nearest neighbor interpolation method, a bilinear interpolation method, or a bicubic interpolation method.

It should be noted that any algorithm that can realize target image zooming can be applied to this step. Since image zooming is not the focus of this application, it will not be described in detail here.

Step S340: Display and lock the enlarged target image to the preset position of the telephoto image preview window, and the telephoto preview window is suspended on the main camera preview window.

In one embodiment, the enlarged target image is displayed at the center of the telephoto image preview window, and the telephoto image preview window is a small window much smaller than the main camera image preview window, located on the upper right of the main camera image preview window angle, and since the target image is extracted based on image detection, it is not affected by the position of the target image in the telephoto image, so the target image can be locked at the center of the telephoto image preview window, that is, for the preview state Each frame of the video image can display the target image at the center position, which can solve the problem of the target image floating in the related technology. When the user is actually shooting, as long as the camera is moved, the target image position in the main camera image preview window If it is suitable, and there is a target image in the telephoto image preview window, the successful shooting of the scene can be realized.

In some other implementations, the main camera image preview window has prompt lines, and these prompt lines mark the viewfinder range of the telephoto lens, that is, to remind the user not to let the target scene exceed the range of the prompt line when moving the main camera lens to change the viewfinder , otherwise it will cause the framing failure of the telephoto lens. The existence of the prompt line can help the user better grasp the moving range of the lens framing, improve the success probability of scene shooting, and increase the freedom of framing.

In some other embodiments, the preset position may be other preset positions except the central position, and the preset position may be set in advance by the system, or may be set according to the user's usage habits or preferences.

Step S350: Fusing the enlarged target image and the image captured by the main camera to obtain a final captured image.

Fusion refers to the operation of generating a final image from multiple frames of images according to certain rules. In some embodiments, the electronic device can fuse multi-frame images through fusion methods such as linear weighting, nonlinear weighting fusion, multi-frame noise reduction algorithm, principal component analysis fusion, pyramid transformation, and wavelet transformation.

In one embodiment, the final captured image refers to the final image obtained in one image capturing process. When the electronic device fuses the enlarged target image captured by the telephoto lens with the main camera image to obtain the final captured image, the final captured image can be stored in the memory of the electronic device, and can also be displayed on the display screen of the electronic device .

Based on the shooting scheme provided by the above-mentioned embodiments of the present application, the user can move the electronic device within a wide range to shoot the target scene, improve the anti-shake effect in the scene shooting scene of the electronic device, and improve the success rate of shooting the scene. Make users have a better shooting experience.

In addition, the embodiment of the present application also provides a shooting device, as shown in FIG. 7, the device includes:

An input unit 100, the input unit 100 includes a main camera lens 1001 and a telephoto lens 1002, capable of taking pictures of external scenes.

It is worth noting that in order to be able to capture images with overlapping areas, the telephoto lens and the main camera lens are on the same side of the electronic device. At the same time, those skilled in the art should know that a shooting device can have multiple lens.

The telephoto lens parameter setting unit 200 is capable of setting the magnification of the telephoto lens to maximize the viewing range corresponding to the telephoto lens.

The image processing unit 300 can acquire the telephoto shot image of the telephoto lens and the main shot image of the main camera lens, and the image processing unit can also acquire the target image in the telephoto shot image and enlarge the target image.

The image display unit 400 includes a display 4001, and the display 4001 can display a main camera image preview window and a telephoto image preview window suspended on the main camera preview window. In order to facilitate the user to observe the preview image, the image display unit can display the enlarged target The image is displayed and locked at the preset position in the telephoto image preview window.

The image fusion unit 500 can fuse the enlarged target image and the main camera image to obtain the final image.

The memory 600, the memory 600 includes a computer application program, and the computer application program can execute the shooting preview method and the image fusion method provided in the above embodiments.

The processor 700 can run the shooting preview method and the image fusion method provided in the above embodiments.

Based on the shooting device provided by the above-mentioned embodiments of the present application, the user can move the electronic device within a wide range to shoot the target scene, improve the anti-shake effect in the scene shooting scene of the electronic device, and improve the success rate of shooting the scene. Make users have a better shooting experience.

As a non-transitory computer-readable storage medium, memory can be used to store non-transitory software programs and non-transitory computer-executable programs. In addition, the memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid-state storage devices. In some embodiments, the memory optionally includes memory located remotely from the processor, and these remote memories may be connected to the processor via a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The non-transitory software programs and instructions required to realize the information processing method of the above-mentioned embodiment are stored in the memory, and when executed by the processor, the information processing method in the above-mentioned embodiment is executed, for example, the above-described execution in FIG. 2 Method steps S110 to S150 , method steps S210 to 250 in FIG. 4 , method steps S310 to S350 in FIG. 6 .

The device embodiments or system embodiments described above are only illustrative, and the units described as separate components may or may not be physically separated, that is, they may be located in one place, or may be distributed to multiple network units superior. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, the embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are executed by a processor or a controller, for example, by the above-mentioned network device Execution by a processor in the embodiment can make the processor execute the shooting preview method and the image fusion method in the above embodiment, for example, execute the method steps S110 to S150 in FIG. 2 described above, and the method step S210 in FIG. 4 To 250, steps S310 to S350 of the method in FIG. 6 .

The embodiment of the present application includes: setting the magnification factor of the telephoto lens to maximize the framing range corresponding to the telephoto lens; obtaining the telephoto shot image of the telephoto lens and the main shot image of the main camera lens; obtaining the The target image in the telephoto shooting image is enlarged, and the target image is enlarged; the enlarged target image is displayed and locked to the preset position of the telephoto preview window, and the telephoto preview window is suspended on the main camera preview window ; Fusing the amplified target image with the main shot image to obtain a final shot image. According to the shooting scheme provided by the embodiment of the present application, by setting the magnification of the telephoto lens as small as possible, the viewing range of the telephoto lens and the main camera lens is made as large as possible, and at the same time, the target scene is magnified and locked at the preset position , so that the user can shoot the target scene when moving the electronic device in a large range, which improves the anti-shake effect in the shooting scene of the electronic device and increases the success rate of shooting.

Those skilled in the art can understand that all or some of the steps and systems in the methods disclosed above can be implemented as software, firmware, hardware and an appropriate combination thereof. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit . Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). As known to those of ordinary skill in the art, the term computer storage media includes both volatile and nonvolatile media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules, or other data. permanent, removable and non-removable media. Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cartridges, tape, magnetic disk storage or other magnetic storage devices, or can Any other medium used to store desired information and which can be accessed by a computer. In addition, as is well known to those of ordinary skill in the art, communication media typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media . The electronic device in this embodiment of the present application may be a terminal device. The terminal device may be a mobile terminal device or a non-mobile terminal device. Exemplarily, the mobile terminal device may be a mobile phone, a tablet computer, a notebook computer, a handheld computer, a vehicle terminal device, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant). assistant, PDA), etc., and the non-mobile terminal device may be a personal computer (personal computer, PC), television (television, TV), teller machine or self-service machine, etc., which are not specifically limited in this embodiment of the present application.

The above is a specific description of several implementations of the present application, but the application is not limited to the above-mentioned implementations. Those skilled in the art can also make various equivalent deformations or replacements without violating the essence of the application. These equivalent Any modification or substitution is within the scope defined by the claims of the present application.

Claims

A shooting preview method applied to electronic equipment, the method comprising:

Setting the magnification of the telephoto lens, so that the viewing range corresponding to the telephoto lens is the largest;

Obtain the telephoto shot image of the telephoto lens and the main shot image of the main camera lens;

Acquiring a target image in the telephoto shot image, and zooming in on the target image;

The enlarged target image is displayed and locked to a preset position of a telephoto image preview window, and the telephoto image preview window is suspended on the main camera image preview window.
The method according to claim 1, wherein said setting the magnification of the telephoto lens so that the maximum viewing range corresponding to the telephoto lens includes:

The magnification of the telephoto lens is set to be the minimum optical magnification of the electronic device.
The method according to claim 1, wherein the steps in the shooting preview method are executed in a loop until a shooting condition is satisfied; wherein the shooting condition includes a preset shooting condition or a shooting condition actually used by a user.
The method according to claim 1, wherein the telephoto lens shoots in real time to obtain a telephoto video stream, and the main camera lens shoots in real time to obtain a main camera video stream;

The acquisition of the telephoto shot image of the telephoto lens and the main shot image of the main camera lens includes:

Obtaining a telephoto video frame according to the telephoto video stream, and determining that the telephoto video frame is the telephoto captured image;

A main camera video frame is obtained according to the main camera video stream, and the main camera video frame is determined to be the image captured by the main camera.
The method according to claim 1, wherein said obtaining the target image in the telephoto shot image comprises:

Obtain a rectangular bounding box capable of enclosing the target image according to the target detection technology in image processing;

Obtain the target image according to the rectangular bounding box.

Wherein, the target detection technology includes at least one of the following: target detection technology based on traditional manual feature extraction, or target detection technology based on artificial intelligence model.
The method according to claim 5, wherein said obtaining said target image according to said rectangular bounding box comprises:

Obtain the center point of the rectangular bounding box;

Based on the central point, an image extraction frame including the rectangular bounding frame is formed, wherein the aspect ratio of the image extraction frame is the same as that of the telephoto captured image.
The method according to claim 1, wherein the preset position comprises a center position of the telephoto image preview window.
The method according to claim 1, wherein said enlarging said target image comprises:

The target image is enlarged by an interpolation method.
The method according to claim 1, wherein a prompt line is displayed in the preview window of the main camera image, and the prompt line is set to mark a viewfinder range of the telephoto lens.
An image fusion method applied to electronic equipment, the method comprising:

Acquiring the enlarged target image and the main shot image obtained according to the shooting preview method according to any one of claims 1 to 9;

Fusing the enlarged target image and the main camera image to obtain a final image.
A photographing device, the device comprising:

The telephoto lens parameter setting unit is configured to set the magnification of the telephoto lens, so that the viewing range corresponding to the telephoto lens is the largest;

The image processing unit is configured to obtain the telephoto shot image of the telephoto lens and the main shot image of the main camera lens; the image processing unit is also configured to obtain the target image in the telephoto shot image and zoom in said target image;

The image display unit includes a main camera image preview window configured to display a main camera image and a telephoto image preview window suspended on the main camera preview window and configured to display a telephoto image, the image display The unit is configured to display the locked enlarged target image at a preset position of the telephoto image preview window.
The device according to claim 11, wherein the telephoto lens parameter setting unit is configured to set the magnification of the telephoto lens to a minimum optical magnification.
The device according to claim 11, wherein the image processing unit is configured to obtain a rectangular bounding box capable of enclosing the target image according to a target detection technique in image processing; the image processing unit is also configured to obtain The central point of the rectangular bounding frame, and form an image extraction frame containing the rectangular bounding frame, wherein the aspect ratio of the image extraction frame is the same as the aspect ratio of the telephoto captured image.
An electronic device, comprising: a telephoto lens, a main camera lens, a display, a memory, a processor, and a computer program stored in the memory and operable on the processor, wherein the computer program is implemented when the processor executes the computer program The shooting preview method according to any one of claims 1 to 9, or the image fusion method according to claim 10.
A computer-readable storage medium, storing computer-executable instructions, the computer-executable instructions are used to execute the shooting preview method according to any one of claims 1 to 9, or the image fusion method according to claim 10 .