WO2018133849A1

WO2018133849A1 - Panoramic image photographic method, panoramic image display method, panoramic image photographic device, and panoramic image display device

Info

Publication number: WO2018133849A1
Application number: PCT/CN2018/073474
Authority: WO
Inventors: 罗勇; 余熙平; 陈�全; 喻运辉; 胡文波
Original assignee: 盯盯拍（东莞）视觉设备有限公司
Priority date: 2017-01-21
Filing date: 2018-01-19
Publication date: 2018-07-26
Also published as: CN108347556A

Abstract

The application discloses a panoramic image photographic method comprising: arranging two or more cameras to photograph images in a panoramic range, and stitching the photograph images into a panoramic image, wherein an image photographed by at least one of the cameras is sharper than an image photographed by a remaining camera. The application further discloses a panoramic image display method comprising: displaying a panoramic image for a user to select; selecting a display area according to an interactive operation; determining whether an intersected area is present between the display area selected by the interactive operation and a partial area; and if so, stitching an image corresponding to the intersected area to an image corresponding to the display area. The application further discloses a panoramic image photographic device and a panoramic image display device. The application can be employed to acquire a panoramic image and a high-definition image at a partial area, and consequently, a user can acquire the panoramic image to experience full coverage of a field of view provided by the panoramic image, and view details in a clear and sharp image at the partial area, enhancing user experience in photography at lower cost.

Description

Panoramic image capturing method, panoramic image display method, panoramic image capturing device, and panoramic image display device

Technical field

The present application relates to the field of image processing, and in particular, to a panoramic image capturing method, a panoramic image display method, a panoramic image capturing device, and a panoramic image display device.

Background technique

In the prior art, panoramic image capturing refers to shooting in which the horizontal direction is 360° and the vertical direction is 180° or more with a reference point as a center point. In general, panoramic shooting is performed by a panoramic camera, such as a panoramic camera that shoots a wide angle of 180° vertically and 360° horizontally, or a panoramic camera consisting of two cameras on the front and rear sides. The cameras are shot from a panoramic camera composed of different angles. However, there is a problem with these panoramic cameras, that is, the definition is relatively low, and high-definition video cannot be captured, and the content and details that the user pays more attention to in the panoramic image cannot be well presented.

Although some cameras such as gopro have the ability to shoot in high definition, they cannot capture panoramic images. In the prior art, by assembling these high-definition cameras, then downloading images obtained by each high-definition camera to the local, and then using professional software for panoramic stitching to achieve panoramic image shooting, but this method requires multiple motions. The camera is relatively expensive, and it is cumbersome to operate, which is inconvenient for the user, and the user does not necessarily need to take high-definition images of all areas in the panoramic range, which causes waste of resources.

Therefore, the panoramic camera in the prior art generally has a low definition of the panoramic image, especially when used in the fields of events, conferences, etc., the attention is easily dispersed, and the problem that the user cares about the content cannot be focused, even though multiple HD cameras are assembled to capture images and then stitched together to capture high-definition panoramic images, but this can also lead to problems with high cost and inefficiency, and inconvenient user use.

Summary of the invention

The present application provides a panoramic image capturing method, a panoramic image display method, a panoramic image capturing device, and a panoramic image display device, which can solve the problem that the panoramic image captured by the panoramic camera is low in definition and cannot focus on the user's concern and adopt multiple The combination of high-definition cameras to obtain panoramic images increases the cost, the shooting efficiency is low, and the user is inconvenient to use.

According to a first aspect of the present application, the present application provides a panoramic image capturing method, the method comprising: setting a camera module, the camera module includes at least two cameras, and the camera captures images in a panoramic range for splicing into a panoramic image, wherein at least one The image captured by the camera has higher definition than the rest of the camera; the control module is set, and the control module controls the camera module to perform shooting.

Preferably, the camera module comprises: a camera combination for capturing an image of the panoramic range for splicing into a panoramic image or a camera combination composed of at least two first cameras; at least one for capturing an image of a partial area within the panoramic range The second camera, wherein the image of the partial area captured by the second camera has higher definition than the image captured by the first camera; the camera body, the first camera and the second camera are disposed on the camera body.

Preferably, the camera module comprises: at least one first camera; at least one second camera that can adjust the sharpness of the captured image to be higher than the sharpness of the image captured by the first camera, and the first camera captures the image of the panoramic range for splicing A panoramic image; and a camera body, the first camera and the second camera are disposed on the camera body.

Preferably, in the step of capturing an image in the panoramic range, the method further comprises: adjusting the sharpness of the image captured by the second camera or controlling the shooting focal length of the second camera when the panoramic image has a single sharpness, so that the second The camera is consistent with the sharpness of the image captured by the first camera; when the panoramic image has at least two partial regions of different definition, the second camera is controlled to adjust the shooting focal length so that the image captured by the second camera is sharper than the first camera The sharpness of the captured image.

According to a second aspect of the present application, the present application provides a panoramic image display method, the method comprising: processing an image captured by a camera module and splicing into a single-resolution panoramic image for selection by a user; and selecting a panoramic image by an interactive action a display area to be displayed; determining whether the display area selected by the interactive action and the local area captured by the camera with high definition of the captured image have an intersection area; if so, according to the corresponding position of the image corresponding to the intersection area on the panoramic image, An image captured by a camera with a high resolution of the intersection image is spliced onto the image corresponding to the display area, and an image corresponding to the display area is displayed, wherein the image corresponding to the display area has at least two partial regions of different definitions; otherwise, The image corresponding to the display display area maintains a single sharpness.

Preferably, after determining whether the display area selected by the interaction action and the local area captured by the camera with high definition of the captured image have an intersection area, the method further comprises the step of: if the display area and the local area have an intersection area, further determining whether the interaction is satisfied The setting condition, if yes, jumps to the step of splicing the image corresponding to the intersection area onto the image corresponding to the display area; otherwise, the image corresponding to the display area remains a single sharpness.

Preferably, in the step of selecting a display area to be displayed in the panoramic image by an interactive action, the interactive action may be implemented by setting at least one of an action of detecting a user setting part, a gesture recognition technology, and setting an input device.

Preferably, the setting condition is whether the interactive action maintains the selection action setting time, whether the display range of the interaction action selection and the intersection range of the partial region are set values, or whether the interaction action performs the set operation.

Preferably, in the step that the image corresponding to the display area has at least two partial regions of different sharpness, the image of the display partial area is gradually changed from the image sharpness with the remaining area to the image sharpness higher than the remaining area.

According to a third aspect of the present application, the present application provides a panoramic image capturing apparatus, the apparatus comprising: a camera module, the camera module includes at least two cameras, and the camera captures images for splicing into a panoramic image, wherein at least one camera captures The sharpness of the image is higher than the rest of the camera; and the control module is used to control the module to control the camera module for shooting.

According to a fourth aspect of the present application, the present application provides a panoramic image display apparatus, including: a processing module for processing an image captured by a camera module and splicing into a single-resolution panoramic image for user selection; The display unit is configured to select a display area to be displayed in the panoramic image by an interactive action; the determining module is configured to determine whether the display area selected by the interaction action and the local area captured by the camera with high definition of the captured image have an intersection area; and a display module, If yes, the processing module splices the image captured by the camera with the higher resolution of the captured image corresponding to the intersection area to the image corresponding to the display area according to the corresponding position of the image corresponding to the intersection area on the panoramic image, and displays the display area. Corresponding image, wherein the image corresponding to the display area has at least two partial regions of different definitions; otherwise, the image corresponding to the display display area maintains a single sharpness.

The utility model has the beneficial effects that: the image is captured by at least two cameras for splicing into a panoramic image, and the image captured by the at least one camera has higher definition than the remaining cameras, so that the spliced panoramic image can have at least two different definitions. The local area, so that the panoramic image can be obtained, and the sharper image of the local area that the user needs to pay attention to can be obtained, so that the user can enjoy the advantage of the immersive experience brought by the panoramic image, and can also obtain attention. The clearer image of the content enhances the user's shooting experience, and the cost is lower, and the implementation is simpler and more convenient for the user.

DRAWINGS

1 is a schematic diagram of a panoramic image capturing device of the present application connected to a panoramic image display device;

2 is a schematic diagram of a panoramic image capturing apparatus including a microphone sensor in a third embodiment of the present application;

3 is a schematic diagram of a panoramic image capturing apparatus including a fixed connection module in a fourth embodiment of the present application;

4 is a schematic diagram of a panoramic image capturing apparatus shown in a fifth embodiment of the present application;

FIG. 5 is a schematic diagram of a panoramic image capturing apparatus according to a sixth embodiment of the present application; FIG.

FIG. 6 is a schematic diagram of a panoramic image capturing apparatus according to a seventh embodiment of the present application; FIG.

FIG. 7 is a schematic diagram of a panoramic image capturing apparatus according to an eighth embodiment of the present application; FIG.

FIG. 8 is a schematic diagram of a panoramic image capturing apparatus according to a ninth embodiment of the present application; FIG.

9 is a schematic diagram of a panoramic image capturing apparatus shown in a tenth embodiment of the present application;

FIG. 10 is a schematic diagram of a panoramic image capturing apparatus shown in an eleventh embodiment of the present application; FIG.

11 is a schematic diagram of a panoramic image capturing apparatus shown in a twelfth embodiment of the present application;

Figure 12 is a schematic diagram of a panoramic image capturing apparatus shown in a thirteenth embodiment of the present application;

Figure 13 is a schematic diagram of a panoramic image capturing apparatus shown in a fourteenth embodiment of the present application;

14 is a flowchart of a panoramic image capturing method illustrated in a seventeenth embodiment of the present application;

Fig. 15 is a flowchart showing a panoramic image display method shown in a seventeenth embodiment of the present application.

DESCRIPTION OF REFERENCE NUMERALS: camera module 1 first camera 11 second camera 12 camera body 13 rotation unit 14 control module 2 processing module 3 interaction module 4 display module 5.

detailed description

The present application will be further described in detail below with reference to the accompanying drawings.

First, some terms are described. VR, full name is Virtual Reality, and Chinese is virtual reality.

The idea of the present application is to capture an image by at least two cameras for splicing into a panoramic image, and the image captured by at least one camera has higher definition than the remaining cameras, so that the spliced panoramic image may have at least two different definitions. The local area, so that the user can obtain a partial area image with higher definition than other areas while acquiring the panoramic image.

Embodiment 1:

Please refer to FIG. 1 , an image capturing apparatus of the present application, comprising: a camera module 1 , the camera module 1 includes at least two cameras, and the camera captures images for splicing into a composite image, wherein at least one camera captures an image. The clarity is higher than the rest of the camera. The control module 2 is connected to the camera module 1 for controlling the camera module 1 to perform shooting.

In this embodiment, the control module 2 controls the synchronous shooting of the camera to ensure that the captured images can be correlated, and the time for capturing the images can be synchronized.

In this embodiment, the composite image may have two or more partial regions of different image sharpness. It should be noted here that the image sharpness is determined by the number of pixels per unit area of the image captured when the target object is captured. The more the number of pixels per unit area of the image of the target object, the more the number of pixels can be seen. The more detail the target object has, the higher the sharpness of the image. Conversely, the sharper the sharpness of the image.

For example, the image capturing device includes two cameras, one of which is a camera disposed at the top and facing in the direction of the sky. The pixels of the camera are 1080P, the wide angle is 240° vertically, the horizontal is 360°, and the pixel of the other camera is 720P. The wide angle is 120° horizontal and 110° vertical. Although the camera's shooting pixels are relatively high, because of its wide shooting angle, the image in the captured image has fewer pixels per unit area, which makes the image taken by the camera less clear. The camera with a pixel of 720P has a smaller shooting angle than 1080P, so the pixel area per unit area in the captured image is relatively large, so that the image taken by the camera with the pixel of 720P is more clear than 1080P. Therefore, the composite image obtained by splicing the image captured by the image capturing device has two partial image regions of sharpness.

Embodiment 2:

Please refer to FIG. 1 , a panoramic image capturing apparatus of the present application, comprising: a camera module 1 , at least two cameras, the camera capturing images in a panoramic range for splicing into a panoramic image, wherein at least one camera captures an image The clarity is higher than the rest of the camera. The control module 2 is connected to the camera module 1 for controlling the camera module 1 to perform shooting.

In this embodiment, the control module 2 controls the synchronous shooting of the camera to ensure that the time during shooting can be consistent.

In this embodiment, the panoramic image has two or more partial regions with different image sharpness. It should be noted here that the image sharpness is determined by the number of pixels per unit area of the image captured when the target object is captured. The more the number of pixels per unit area of the image of the target object, the more the number of pixels can be seen. The more detail the target object has, the higher the sharpness of the image. Conversely, the sharper the sharpness of the image.

In this embodiment, the sharpness of the image is determined by the wide angle of the camera and the captured pixels. In the case of the same pixel, the wide angle of the second camera is smaller than the wide angle of the first camera, the sharpness of the second camera is higher than the sharpness of the first camera, or the wide angle of the second camera and the first When the wide angle of the camera is the same, the shooting pixels of the second camera are higher than the shooting pixels of the first camera. Of course, the wide angle of the second camera is smaller than the wide angle of the first camera and the pixels of the second camera are higher than the shooting angle of the second camera. The pixels of the first camera.

In this embodiment, the panoramic image capturing device can capture the panoramic image of the panoramic range in two ways: in the first mode, the panoramic range image is captured by a camera or a camera combination, and at least one camera captures a partial region in the panoramic range. The image is implemented, wherein the sharpness of the captured image of the camera that captures the partial area image is higher than the sharpness of the image of the camera or the camera combination that captures the panoramic range; the second way, through two or more cameras The camera combination is composed to capture a panoramic range of images, wherein at least one camera captures images with higher definition than the rest of the cameras. In both of these ways, it is possible to acquire a partial area image within a panoramic range while obtaining a panoramic image, and the sharpness of the partial area image is higher than that of other area images.

The following is an example of two ways in which the above panoramic image capturing device captures an image of a panoramic range:

For example, the panoramic image capturing device includes two cameras, one of which is a panoramic camera, the pixel of the panoramic camera is 1080P, the wide angle is 180° vertical, 360° horizontal, for capturing panoramic images, and the other camera is 720P. The wide angle is 120° horizontal and 110° vertical, and is used to capture an image of a local area within a panoramic range set by the user. Although the panoramic camera has a relatively high shooting pixel, because of its wide shooting angle, the image in the captured image has fewer pixels per unit area, so that the image captured by the panoramic camera is not clear enough. The camera with a pixel of 720P is smaller than the 1080P, so the image of the captured image has a relatively large number of pixels per pixel area, so that the image taken by the camera with the pixel of 720P is more clear than 1080P. Therefore, the composite image obtained by the image captured by the panoramic image capturing device has a partial region image of two definitions in the composite image.

For another example, the panoramic image capturing device includes a camera combination composed of three cameras to capture a panoramic image, wherein the pixels of the three cameras are 4K, 2K, and 1080P, respectively, and the wide angles of the three cameras are the same, 120°, the rest of the parameters are the same. The difference between these three cameras is only the pixels. Obviously, the number of pixels per unit area of the image captured by the 4K camera is the most. Therefore, the sharpness of the image captured by the 4K camera is the highest, and the resolution of the image captured by the 2K camera. A camera above 1080P captures the sharpness of the image so that the panoramic image has three different resolution local area images.

In this embodiment, the control module 2 can control shooting by setting a button on the panoramic image capturing device. The control module 2 can also set a remote controller to control shooting in the panoramic image capturing device. Specifically, the control signal is sent by the remote controller, and the panoramic image capturing device performs an action after receiving the control signal through the wireless communication module, wherein the control signal can be a WIFI signal. , Bluetooth signal or 2G/3G/4G signal.

In this embodiment, the camera can adjust the shooting focal length. The control module 2 can control the camera to adjust the focal length.

The panoramic image capturing device in the embodiment has different sharpness of the image captured by the camera, so that after the image is stitched into a panoramic image, the panoramic image has at least two partial regions of different definitions, so that the panoramic image can be acquired at the same time. Get a higher-resolution image of the local area that the user needs to pay attention to, so that the user can enjoy the advantage of the immersive experience brought by the panoramic image, and also obtain a clearer image of the content that needs attention, and enhance the user's shooting. Experience, and low cost, it is also relatively simple to implement, user-friendly.

Embodiment 3:

Referring to FIG. 2, on the basis of Embodiment 2, the panoramic image capturing apparatus further includes a sound collection module, and the sound collection module includes a microphone sensor or a microphone sensor array composed of the microphone sensor.

For example, when the image pickup main body of the image pickup module 1 of the panoramic image capturing apparatus has a shape of a cube, a rectangular parallelepiped or a cylinder, the microphone sensor can be disposed around the photographing module one week, and can realize sound collection in a horizontal 360° and a vertical 360° range. When the shape of the imaging body of the camera module of the panoramic image capturing device is spherical, the microphone sensor can be disposed around the circumference of the sphere. In this way, when the collected sound is played, the sound effect of the scene can be restored, and the realism of the captured image is enhanced. Of course, the microphone sensor is not necessarily disposed on the panoramic image capturing device, and the matrix array of the microphone sensor can be first set on the external accessory, and then the external accessory is fixed on the panoramic image capturing device.

The panoramic image capturing device combined with the microphone sensor, especially the microphone sensor array, has a wide range of applications, for example, the application in the live broadcast of the live event, while giving the user a sense of visual immersion, but also restore the sound of the live scene, so that the user can be better Feel the atmosphere of the scene and increase the user experience; for example, in the case of video conferencing, the microphone sensor array can truly restore the position of the video conference sound, so that the participants who participated in the panoramic image capturing device can participate in the discussion at the scene. There will be no sense of distance.

Embodiment 4:

Referring to FIG. 3 , on the basis of the second embodiment or the third embodiment, the panoramic image capturing device further includes a fixed connection module. Only the content of the fixed connection module is described in detail. For other parts of the panoramic image capturing device, refer to the second embodiment. Or the third embodiment.

The fixed connection module comprises a UAV connection component that can be fixed on the UAV and is connected to the UAV, a bracket connection component that can fix the connection bracket, a mobile terminal connection component that can be fixed on the mobile terminal and connects the communication interface of the mobile terminal, and At least one of wearable components for wear by a user.

In this embodiment, the UAV connection component includes a connection unit and a fixing unit, and the connection unit can be connected to the UAV through a wired or wireless manner, so that the video captured by the panoramic image capturing device can be transmitted to the UAV, and then passed through The man-machine is transmitted to the control terminal; the fixing unit may be a suction cup, a robot or a clamping structure.

In this embodiment, the bracket connecting component comprises a fixing unit, and the fixing unit is generally arranged with the bracket. For example, the top of the bracket is provided with an extended connecting rod, and the connecting rod is provided with a thread, and the fixing unit of the bracket connecting component is provided. The screw hole allows the panoramic image capturing device to be fixed to the connecting rod by the cooperation of the connecting rod and the screw hole.

In this embodiment, the mobile terminal connection component includes a fixed unit and a connection interface. The connection interface can be set according to the model of the mobile terminal. For example, the Android mobile phone generally uses a USB interface, and the connection interface of the mobile terminal connection component can be set as a USB interface, and the Apple mobile phone uses a Lightning C interface, and the connection of the mobile terminal connection component. The interface can be set to the Lightning C interface. The fixing unit can be a clamping mechanism and can be clamped on the mobile terminal. In this way, the user can control the panoramic image capturing device through the mobile terminal, and also enable the panoramic image capturing device to be carried and used with him or her.

In this embodiment, the wear fixing component may be a helmet that the user can wear on the head; or a glove, a bracelet, or the like, and the user can fix the panoramic image capturing device head to the arm.

By fixing the connection module, the structure of the fixed connection module can be set according to actual needs, thereby fixing the panoramic image capturing device on different devices, so that the panoramic image capturing device has a wider application range.

Embodiment 5:

Please refer to FIG. 1 and FIG. 4 , a panoramic image capturing device of the present application, comprising: a camera module 1 and a control module 2 . The camera module 1 includes: a camera combination for capturing an image of a panoramic range for splicing into a panoramic image or a combination of at least two first cameras 11; at least one for capturing an image of a partial area within a panoramic range a second camera 12, wherein a sharpness of an image of a partial area captured by the second camera 12 is higher than a sharpness of an image captured by the first camera 11; and an image capturing main body 13, a first camera and a second camera are disposed in the image capturing body 13 on. The control module 2 is connected to the camera module 1 for controlling the camera to perform shooting.

In this embodiment, both the first camera 11 and the second camera 12 can adjust the shooting focal length. The control module 2 controls the first camera 11 and the second camera 12 to adjust the focal length.

In this embodiment, the panoramic image may have two or more partial regions with different image definitions. The type of the image clarity of the second camera 12 and the number of the second camera 12 can be set according to actual conditions, and are not limited herein. This allows you to capture images of more than one local area of interest in the panoramic range.

In other embodiments, the panoramic image capture device further includes a sound collection module. The sound collection module includes a microphone sensor disposed at a set position of the panoramic image capturing device or a microphone sensor array composed of the microphone sensor. For the specific structure of the sound collection module, refer to the description of the second embodiment, which is not repeated here.

In other embodiments, the panoramic image capture device further includes a fixed connection module. The fixed connection module comprises a UAV connection component that can be fixed on the UAV and is connected to the UAV, a bracket connection component that can fix the connection bracket, a mobile terminal connection component that can be fixed on the mobile terminal and connects the communication interface of the mobile terminal, and At least one of wearable components for wear by a user. For the specific structure of the fixed connection module, refer to the description of the third embodiment, which is not repeated here.

Through this combination of structures, the spliced panoramic image has at least two partial regions of different definitions, so that while acquiring the panoramic image, it is also possible to acquire an image with higher definition of the local area that the user needs to pay attention to, so that the user You can enjoy the advantages of the immersive experience brought by the panoramic image, and you can get a clearer image of the content you need to pay attention to, improve the user's shooting experience, and the cost is lower, and it is simpler to implement and convenient for users.

Example 6:

Referring to FIG. 1 and FIG. 5 , a panoramic image capturing apparatus of the present application includes: a camera module 1 and a control module 2 . The camera module 1 includes: a camera combination for capturing an image of a panoramic range for splicing into a panoramic image or a combination of at least two first cameras 11; at least one for capturing an image of a partial area within a panoramic range a second camera 12, wherein the image of the partial area captured by the second camera 12 has higher definition than the image captured by the first camera 11; the camera body 13, the first camera 11 and the second camera 12 are disposed in the On the camera body 13. The control module 2 is connected to the camera module 1 for controlling the camera to perform shooting.

In this embodiment, the camera module includes a first camera 11 , at least one second camera 12 , and a camera body 13 . The first camera 11 is a panoramic camera, and the first camera 11 is disposed at a center position of the top or bottom of the camera body 13 . The second camera 12 is disposed on the panoramic image capturing device, and the control module 2 connects the first camera 11 and the second camera 12.

In this embodiment, the first camera 11 is a panoramic camera, and the image in the panoramic range is captured. The range of the wide angle of the first camera 11 is greater than 180° in the vertical direction and 360° in the horizontal direction. The wide angle of shooting of the first camera 11 in the vertical direction is preferably 210° because the first camera 11 is disposed at the top of the panoramic image capturing device, so that the first camera 11 can capture an angle of 30° with the horizontal direction. The upper image or video, and the second camera 12 has a shooting angle of view of 160°.

In this embodiment, the second camera 12 can adjust the shooting focal length. The control module 2 controls the second camera 12 to adjust the focal length.

In this embodiment, the shape of the imaging body 13 may be a shape of a plurality of cylinders such as a cylinder, a rectangular parallelepiped, a cube, and a hexahedron, and is not limited thereto, and may be set according to actual conditions. The first camera 11 is fixed to the top or bottom of the cylinder so that an image of a 360° range around the panoramic image capturing device can be captured, and the second camera 12 can be fixed to any side of the panoramic image capturing device body 13. Takes an image of a partial area of interest to the user within the panoramic range.

In the embodiment, the second camera 12 is detachably fixed to the panoramic image capturing apparatus main body 13. Specifically, the second camera 12 is detachably fixed to different mounting positions by providing an installation position on the image pickup main body 13. Taking the imaging body 13 having a cubic shape as an example, the mounting position can be provided on all four sides of the cube, and the second camera 12 can be mounted on the mounting position of any of the front, rear, left, and right sides of the imaging body 13 according to the actual needs of the user. By providing the mounting position of the second camera 12 on the camera body 13, the second camera 12 can be mounted at different positions according to actual needs, which can more easily change the shooting direction of the second camera 12, and also makes the camera body A plurality of second cameras 12 can be installed so that the user can obtain more sharper images in more directions in the panoramic image.

In this embodiment, the panoramic image capturing device further includes a sound collecting module and/or a fixed connection module, and the description is not repeated herein, and the above-mentioned contents are specifically referred to.

Example 7:

Referring to FIG. 1 and FIG. 6, on the basis of Embodiment 6, the panoramic image capturing apparatus further includes a rotating unit 14 disposed on the imaging body 13, the rotating unit 14 is rotatable relative to the imaging body 13, and the second camera 12 is disposed on the rotating unit. 14 to achieve the adjustment of the shooting direction.

The rotating unit 14 can adjust the direction of the second camera 12 by electric or manual manual means. The camera body 13 is in the form of a cylinder. The rotating unit 14 includes a motor and a turntable. The motor is disposed at the bottom of the camera body 13. The rotating shaft of the motor is perpendicular to the bottom surface of the camera body 13. The rotating shaft of the motor is connected to the turntable. The second camera 12 is fixed on the turntable, so that the turntable can be rotated by the driving of the motor, thereby changing the photographing direction of the second camera 12. Alternatively, the rotating unit 14 includes a rotating shaft and a turntable. One end of the rotating shaft is fixed at the center of the bottom of the camera body 13. The other end of the rotating shaft is fixedly connected to the center position of the turntable, and the rotating shaft is opposite to the camera body. 13 turns. The second camera 12 is fixed to the side of the turntable. Thus, by manually controlling the rotation of the rotary shaft, the turntable can be driven to rotate, thereby changing the photographing direction of the second camera 12.

Example 8:

Referring to FIG. 1 and FIG. 7 , a panoramic image capturing apparatus of the present application includes: a camera module 1 and a control module 2 . The camera module 1 includes: a camera combination for capturing an image of a panoramic range for splicing into a panoramic image or a combination of at least two first cameras 11; at least one for capturing an image of a partial area within a panoramic range a second camera 12, wherein a sharpness of an image of a partial area captured by the second camera is higher than a sharpness of an image captured by the first camera; and an image capturing main body 13, a first camera and a second camera are disposed on the image capturing body 13. . The control module 2 is connected to the camera module 1 for controlling the camera to perform shooting.

In this embodiment, the camera module includes a camera combination composed of two first cameras 11 , at least one second camera 12 , and an imaging body 13 . The first camera 11 is a panoramic camera, wherein a first camera 11 is disposed on one side of the imaging body 13, another first camera 11 is disposed on the other side of the camera body 13 side, and the second camera 12 is disposed on the camera body. 13 , the control module 2 connects the first camera 11 and the second camera 12 . The panoramic camera captures a wide angle of 360 degrees vertically and a horizontal angle of 180 or more. In other embodiments, the panoramic camera can also be replaced with a fisheye camera.

In this embodiment, the first camera 11 and the second camera 12 can adjust the shooting focal length. The control module 2 controls the first camera 11 and the second camera 12 to adjust the focal length.

In this embodiment, the shape of the imaging body 13 may be a shape of a plurality of cylinders such as a cylinder, a rectangular parallelepiped, a cube, a hexahedron, and the like, which is not limited herein, and may be set according to actual application conditions.

In this embodiment, the second camera 12 is detachably fixed to the camera body 13. Specifically, the second camera 12 is detachably fixed to different mounting positions by providing an installation position on the image pickup main body 13. Taking the imaging body 13 having a cubic shape as an example, the mounting position can be provided on all four sides of the cube, and the second camera 12 can be mounted on the mounting position of any of the front, rear, left, and right sides of the imaging body 13 according to the actual needs of the user. By providing the mounting position of the second camera 12 on the camera body 13, the second camera 12 can be mounted at different positions according to actual needs, which can more easily change the shooting direction of the second camera 12, and also makes the camera body A plurality of second cameras 12 can be installed so that the user can obtain more high-definition content in the panoramic image.

Example 9:

Referring to FIG. 1 and FIG. 8, on the basis of the eighth embodiment, the camera body 13 further includes a rotating unit 14 disposed on the camera body 13, the rotating unit 14 is rotatable relative to the camera body 13, and the second camera 12 is disposed on the rotating unit. 14 to achieve the adjustment of the shooting direction.

Example 10:

Referring to FIG. 9 , a panoramic image capturing device of the present application includes a camera module 1 and a control module 2 . The camera module 1 includes: a camera combination for capturing an image of a panoramic range for splicing into a panoramic image or a combination of at least two first cameras 11; at least one for capturing an image of a partial area within a panoramic range a second camera 12, wherein a sharpness of an image of a partial area captured by the second camera is higher than a sharpness of an image captured by the first camera; and an image capturing main body 13, a first camera and a second camera are disposed on the image capturing body 13. . The control module 2 is connected to the camera module 1 for controlling the camera to perform shooting.

In this embodiment, the camera module 1 includes a camera combination composed of a plurality of first cameras 11 disposed around the panoramic image capturing device, at least one second camera 12, and an imaging body 13. The first camera 11 is circumferentially disposed on the imaging body 13. The second camera 12 is disposed at any position on either side of the imaging body 13, and the control module 2 connects the first camera 11 and the second camera 12.

In the present embodiment, the imaging body 13 includes four first cameras 11 disposed on the imaging body 13, and the first cameras 11 are arranged at equal intervals on the same circumference. This allows panoramic shooting with a range of 360°. The second camera 12 is disposed on either side of the imaging body 13.

Example 11:

Referring to FIG. 10 , on the basis of the tenth embodiment, the camera body 13 further includes a rotating unit 14 disposed on the camera body 13 , the rotating unit 14 is rotatable relative to the camera body 13 , and the second camera 12 is disposed on the rotating unit 14 . Achieve adjustment of the shooting direction.

Example 12:

Referring to FIG. 11 , the imaging module 1 includes an imaging combination composed of a plurality of first cameras 11 , at least one second camera 12 , and an imaging body 13 . The imaging body 13 has a spherical shape, and the first camera 11 and the second camera 12 are disposed on the imaging body. 13 on.

This embodiment is similar to the above several embodiments, except that the panoramic image capturing device is spherical, and the improvement based on this embodiment is not exemplified here. Please refer to the above example.

Example 13:

Please refer to FIGS. 1 and 12 , a panoramic image capturing device of the present application, comprising: a camera module 1 and a control module 2 . The camera module 1 includes: at least one first camera 11; at least one second camera 12 having a sharpness of the captured image higher than the sharpness of the image captured by the first camera, and the first camera 11 capturing an image of the panoramic range for splicing The image is synthesized into a panoramic image; and the image pickup main body 13 is disposed on the image pickup main body 13. The control module 2 is connected to the camera module 1 for controlling the camera to perform shooting.

In this embodiment, the camera module includes four cameras, wherein the two first cameras 11 and the two second cameras 12 have a cube shape, and the first camera 11 is fixedly disposed on the front and rear of the camera body 13 respectively. On the side, the second cameras 12 are fixedly disposed on the left and right sides of the camera body 13, respectively.

In other embodiments, referring to FIG. 13 , the camera module 1 includes a second camera 12 , three first cameras 11 , the camera body 13 has a cylindrical shape, and the second camera 12 and the first camera 11 surround the camera body 13 . Side setting. Here, the combination of the first camera 11 and the second camera 12 is not limited, and may be set according to actual conditions. In addition, the imaging resolution of the second camera 2 may be various, for example, the imaging pixel of the first camera 1 may be 480P, and the imaging pixel of the second camera 2 may be 720P or 1080P.

In other embodiments, the camera body 13 is spherical, and the camera body 13 includes a plurality of first cameras 11 and second cameras 12 that are simultaneously captured from various angles. The first camera 11 and the second camera 12 are disposed on the spherical camera body 13 . A plurality of positions constitute a camera combination for capturing a panoramic image. The camera is detachably fixed to the camera body 13.

In this embodiment, the first camera 11 and the second camera 12 are detachably fixed to the imaging body 13. Thus, it is possible to more easily realize the arbitrary combination of the positions of the first camera 11 and the second camera 12, and it is possible to perform combined shooting in accordance with the user's wishes. For example, the camera module 1 includes two first cameras 11 and two second cameras 12. The initial combination is that the front and rear sides of the camera body 13 are the first camera 11, and the left and right sides are the second camera 12, which can be removed by the user. The first camera 11 and the second camera 12 change their combination, such as mounting the first camera 11 on the front side and the left side of the image pickup main body 13, and mounting the second camera 12 on the rear side and the right side of the image pickup main body 13.

In this embodiment, the first camera 11 and the second camera 12 combine to capture a panoramic image. Since the shooting resolution of the second camera 12 is higher than that of the first camera 11, the sharpness of the image captured by the second camera 12 in the panoramic image is higher than that of the other regions in the panoramic range. The number of the second cameras 12 may be one or more, so that the stitched panoramic image may have at least one image area with higher definition than other areas, and the user may pay attention to a plurality of interesting contents in the panoramic image. The type of photographing sharpness of the second camera 12 may also have two or more types, so that the panoramic area image screen may have various definitions, such as image areas of two or more kinds of sharpness. Therefore, the type of the sharpness of the captured image of the second camera 12 and the number of the second camera 12 can be set according to actual conditions, and are not limited herein.

In this embodiment, there are two ways to make the composite image have a single sharpness or the composite image has at least two local regions of different definition:

The first way is to adjust the sharpness of the image captured by the second camera, so that the sharpness of the image captured by the second camera 12 is consistent with the sharpness of the image captured by the first camera 11, or the image captured by the second camera 12. The sharpness is higher than the sharpness of the image captured by the first camera 11 of the imaging main body 13.

The second mode is that the second camera 12 is an adjustable focus shooting camera, and the control module 2 of the camera body 13 can control the second camera 12 to adjust the shooting focal length, so that the shooting focal length of the second camera is consistent with the shooting focal length of the first camera 11 . Or, the second camera 12 is caused to capture a focal length higher than the shooting focal length of the first camera 11.

In other embodiments, the panoramic image capture device further includes a sound collection module. The sound collection module includes a microphone sensor disposed at a set position of the camera body 13 or a microphone sensor array composed of a microphone sensor. For the specific structure of the sound collection module, refer to the description of the second embodiment, which is not repeated here.

Through this combination of structures, the panoramic image can be acquired, and the image area of interest to the user in the panoramic range can be made to have higher definition, so that the user can obtain the panoramic image and enjoy the immersive image brought by the panoramic image. The advantage of the experience can also enable the user to obtain a clearer image of the content that needs attention, enhance the user's shooting experience, and the cost is lower, and the implementation is relatively simple and convenient for the user to use.

Example 15:

Referring to FIG. 1 , a panoramic image display device of the present application includes:

The interaction module 4 is configured to allow the user to select a display area to be displayed in the panoramic image through an interaction action, and is connected to the processing module 3.

a processing module 3, which is connected to the camera module 1 for processing and stitching the image captured by the camera module 1 into a panoramic image, so that the panoramic image has a single sharpness or the panoramic image has at least two different definitions Local area of degree.

The display module 5 is configured to connect to the processing module 3 according to the processing result of the processing module 3.

The display module 5 processes and combines the images captured by the camera module into a single-resolution panoramic image for the user to select; the processing module 3 determines the display area selected by the interaction action and the local area captured by the camera with high definition of the captured image. Whether the image has an intersection area, and if so, the processing module 3 splices the image corresponding to the intersection area to the image corresponding to the display area according to the corresponding position of the image corresponding to the intersection area on the panoramic image, and the display module 5 displays the image corresponding to the display area. The image corresponding to the intersection area is included, so that the image corresponding to the display area has at least two partial areas of different definitions; otherwise, the image corresponding to the display area still maintains a single definition.

Further, the processing module 3 determines whether the interaction action satisfies the setting condition, and if yes, splicing the image corresponding to the intersection area to the image corresponding to the display area, otherwise, displaying the image corresponding to the display area remains Single clarity.

In this embodiment, the interaction may be implemented by setting a sensor to detect an action of the user setting part, a gesture recognition technology, and setting at least one of the input devices.

In this embodiment, the setting condition is whether the interactive action maintains the selection action setting time, whether the display range of the interaction action selection and the intersection range of the partial region are set values, or whether the interaction action performs the set operation.

The operation principle of the panoramic image capturing device and the panoramic image display device will be described below with reference to FIGS. 1 to 13.

Since the panoramic image capturing device of the present application has an implementation manner, the working principles corresponding to the two modes are also different.

In the first way, an image in a panoramic range is captured by a combination of a first camera 11 or a first camera 11, and a partial area image of interest of the user in the panoramic range is captured by the second camera 12. Thus, the panoramic image capturing apparatus can obtain two types of code streams, one is the first code stream of the image captured by the first camera 11 or the first camera 11 array, and the other is the partial area image obtained by the second camera 12 Two streams. The processing module 3 encodes the first code stream and then splices the processing. Therefore, the display module 5 displays the panoramic image formed by the splicing of the first code stream. The interaction module 4 monitors the interaction of the user. When the interaction module 4 detects that the display area selected by the interaction action has an intersection area with the local area captured by the second camera 12, the processing module 3 corresponds to the image corresponding to the intersection area according to the image on the panoramic image. Position, the splicing of the second code stream and the first code stream is implemented, and the content displayed by the display module 5 includes the image corresponding to the second code stream indicating the intersection area and the image spliced corresponding to the first code stream.

The second way is to capture a panoramic range of images by a combination of cameras consisting of two or more cameras, at least one of which captures images with a higher definition than the rest of the cameras. The code stream obtained by the panoramic image capturing device includes two types, one is the first code stream obtained by the first camera 11 capturing the image, and the other is the second camera 12 capturing the image to obtain the second code stream. When the interaction module 4 detects that the interaction does not involve the content of the local area image captured by the second camera, the processing module 3 adjusts the image resolution of the second code stream to the image clarity of the first code stream according to the interaction. Or, the control module 2 adjusts the shooting focal length of the second camera, so that the second camera can acquire the same image sharpness code stream as the first camera to achieve the image sharpness of the first code stream and the second code stream. The first code stream of the processing module 3 and the adjusted second code stream are spliced, so that the image clarity of the panoramic image displayed by the display module 5 is consistent. When the interaction module 4 detects that the display area selected by the interaction action has an intersection area with the local area captured by the second camera 12, the processing module 3 implements the second code stream according to the corresponding position of the image corresponding to the intersection area on the panoramic image. The splicing of a code stream, the content displayed by the display module 5 includes the image corresponding to the second code stream indicating the intersection area and the image spliced corresponding to the first code stream.

The panoramic image is displayed on the interactive interface of the mobile terminal as an example for description. The interaction interface of the mobile terminal displays the initial state of the panoramic image. At this time, when the user performs operations such as selecting, zooming in, zooming out, moving the image on the interaction interface, the interaction module 4 monitors the interaction of the user, and when the interaction selection is detected, When the area and the local area captured by the second camera 12 have an intersection area, for example, when the interaction is to enlarge the partial area image, the processing module 3 compares the second code stream according to the corresponding position of the image corresponding to the intersection area on the panoramic image. The first stream is spliced such that the interactive interface displays the enlarged local area image with higher definition while displaying the panoramic image. For another example, the interactive action is to move the image. When the interaction module 4 detects that the image related to the local area is moved to the interactive interface, that is, when the content displayed by the display module 5 includes the partial area image, the processing module 3 is based on the local area image. The proportion occupied by the interactive interface splices the second code stream representing the intersection area with the first code stream, so that the interactive interface displays an image in which a part of the area is clear to the rest of the area.

The application of the virtual reality display device will be described as an example. When viewing a panoramic image with VR glasses, as the head swings, the display area in which the panoramic image is viewed, that is, the display window moves in accordance with the moving direction of the head, when the display window and the partial area captured by the second camera 12 have an intersection area , judging the length of time the display window stays, when the window stays longer than the set value, it is considered that the user is interested in the part of the content, the panoramic image changes, and the second code stream is decompressed and the first code stream The splicing is performed such that the image of the panoramic image involving the intersection area is sharper relative to the portion of the image captured by the first camera, and therefore, the window viewing the panoramic image sees at least two images of different definitions. As long as the viewing window continues to move in the partial direction of the image captured by the second camera, the processing module 3 continues to decode the second code stream and splicing with the first code stream.

Example 16:

The present application provides an image processing system including: a panoramic image capturing device and a panoramic image display device as described above. The image processing system is applied to a virtual reality display device.

The following describes the working principle of the application in the virtual reality display device.

First, the panoramic image capturing device captures a panoramic image at an event, a concert, or a meeting site, and captures an image of a set region within the panoramic range by the sharpness panoramic image capturing device that captures the image, and then the panoramic image capturing device compresses and transmits the camera for shooting. The code of the image is streamed to the virtual reality display device.

The head-mounted virtual reality display device receives the compressed code stream, and the interaction module 4 of the head-mounted virtual reality display device monitors the user's interaction. The virtual reality display device monitors a gesture or a head motion of the user. For example, when the user's head motion moves from left to right, the interaction module 4 of the virtual reality display device monitors the movement of the user's head motion and involves an image of the set region. When the local area in the panoramic image range selected according to the direction of the user's head is displayed, the corresponding partial area image is displayed, wherein the process of display is gradually changed from unclear to clear, so that the user may finally see the picture. Some are high-definition images, and some are images with a relatively low definition.

In this way, the live broadcast or playback of the live situation of the event, concert or conference is realized, and the user can obtain the panoramic image through the virtual reality display device, and also obtain the high-definition image of the region that is more concerned in the panoramic range. For example, at the concert site, the user can obtain an immersive effect like a concert or a performance at a concert through this virtual reality display device. Therefore, while giving the user an immersive effect, the device enables the user to focus on the content of the event, concert or meeting without losing the real atmosphere of the scene, making the playing effect more realistic and the experience better.

The technical solutions of the present application have a wide range of applications, and are not limited to the above applications, and also include fields such as personal sports, live events, live broadcasts, and on-site monitoring. For example, in the personal motion record, the user can wear the panoramic image capturing device by wearing the fixing component, so that during the movement, the surrounding environment can be changed during the movement, and the user's own can be clearly recorded. The state of motion, which increases the user's enjoyment of exercise and enhances the user's shooting experience.

Example 17:

Referring to FIG. 14, a method for photographing a panoramic image of the present application includes:

Step S101: setting a camera module, the camera module includes at least two cameras, and the camera captures images in a panoramic range for splicing into a panoramic image, wherein at least one camera captures images with higher definition than the remaining cameras;

In this embodiment, the camera module includes: a camera combination for capturing a panoramic range image for splicing into a panoramic image or a camera combination composed of at least two first cameras; at least one image for capturing a partial area within the panoramic range The second camera, wherein the image of the local area captured by the second camera has higher definition than the image captured by the first camera; the camera body, the first camera and the second camera are disposed on the camera body.

In another embodiment, the camera module includes: at least one first camera; at least one second camera that can adjust the sharpness of the captured image to be higher than the sharpness of the image captured by the first camera, and the first camera captures the image of the panoramic range For splicing into a panoramic image; and a camera body, the first camera and the second camera are disposed on the camera body.

Therefore, in the step of capturing the image in the panoramic range, the method further includes: adjusting the sharpness of the image captured by the second camera or controlling the shooting focal length of the second camera when the panoramic image has a single sharpness, so that the second camera Consistent with the sharpness of the image captured by the first camera; when the panoramic image has at least two partial regions of different resolution, controlling the second camera to adjust the shooting focal length so that the image captured by the second camera is sharper than the first camera The clarity of the image.

Step S102: setting a control module, and the control module controls the camera module to perform shooting.

In this embodiment, the control module controls the camera of the camera module to perform synchronous shooting, so as to ensure that the images captured by the camera can be synchronized in time series.

Referring to FIG. 15, an image display method of the present application includes:

Step S201: processing the image captured by the camera module and splicing into a single-resolution panoramic image for the user to select.

Step S202: Select a display area to be displayed in the panoramic image by an interactive action.

For example, you can set the remote control as an input device and operate the buttons on the remote control to achieve the selection. For another example, in the interaction of the head-mounted virtual device, the orientation can be realized by setting the orientation sensor and monitoring the orientation action to which the head is rotated. As another example, the interaction can be achieved by the binocular camera recognizing the gesture.

Step S203: It is judged whether the display area selected by the interactive action and the partial area photographed by the camera with high definition of the captured image have an intersection area.

Step S204: If the display area and the local area have an intersection area, further determine whether the interaction action satisfies the setting condition, and if yes, skip to step S205; otherwise, the image corresponding to the display display area still maintains a single definition.

In this embodiment, the setting condition may be whether the interaction action maintains the selection action setting time, whether the display range of the interaction action selection and the intersection area of the local area captured by the camera with high definition of the captured image are set values, or Whether the interactive action performs the set operation.

For example, when the user uses the head-mounted virtual device to interact, the head action acts as an interactive action, and when the user's head is directed to the local area 5S of the camera with high definition of the captured image, the user is deemed to have selected the area. Set the time as the display area. Or, as long as the user interacts through the head-mounted virtual device, the user selects the local area as the display area as long as the user's head motion is toward the boundary of the local area captured by the camera with high definition of the captured image. .

Step S205: According to the corresponding position of the image corresponding to the intersection area on the panoramic image, the image captured by the camera with high definition of the intersection image corresponding to the intersection area is spliced onto the image corresponding to the display area, and the image corresponding to the display area is displayed, wherein The image corresponding to the display area has at least two partial regions of different definitions. Otherwise, the image corresponding to the display display area maintains a single sharpness.

In the step of displaying the image corresponding to the display area having at least two partial regions of different sharpness, the image showing the partial area is gradually changed from the image sharpness with the remaining area to the image sharpness higher than the remaining area. The advantage of this is that the user does not need to perform image loading due to the high image clarity of a certain area when interacting with the image, which affects the display speed of the image, especially the higher the image clarity, when the image is displayed. The slower the speed, the more the user experience will be affected. By increasing the sharpness of the image sharpness, you can quickly browse through the panoramic range of images before the user views the HD area.

The image display method of the present application will be described below by taking a head-mounted virtual reality device as an example.

First, the user views a single-resolution panoramic image through the head-mounted virtual reality device, and the user selects a display area to be displayed in the panoramic image by moving the head motion, which is also detected by the gyroscope in the head-mounted virtual reality device. The change in the direction of the user's head, the image displayed in the display area of the head-mounted virtual reality device also follows the change. Alternatively, the change of the gesture can be recognized by the binocular camera recognition technology to control the change of the display area. For example, if the gesture is detected to slide from left to right, the display area also slides from the left side to the right side of the panoramic image.

It is judged whether the display area selected by the interactive action and the partial area photographed by the camera with high definition of the captured image have an intersection area. Also, it is determined whether or not the user's head motion is selected to a range of a partial area photographed by a camera having a high definition image.

If yes, it is further determined whether the interactive action satisfies the set condition. In this embodiment, when the user's head motion stays in a certain area setting time, it is determined that the interaction action satisfies the setting condition. Alternatively, the user can confirm the selection of the area as the display area by using the confirmation button on the remote control. In other embodiments, the interaction may be considered to satisfy the set condition as long as the display area and the local area intersect.

When the interaction action satisfies the setting condition, the image corresponding to the intersection area is spliced to the image corresponding to the display area according to the corresponding position of the image corresponding to the intersection area on the panoramic image, and the image corresponding to the displayed display area includes the intersection area corresponding to the image. The image is such that the image corresponding to the display area has at least two partial regions of different definition. Also, the image corresponding to the display area may be half-clear or half-clear, or may have multiple sharpness images.

When the image corresponding to the display area is displayed, if the corresponding image has at least two partial regions of different definition, when displaying, the image of the local region with higher definition is changed from the image clarity corresponding to the rest of the image to Higher image clarity.

An image capturing apparatus of the present application includes: a camera module, the camera module includes at least two cameras, and the camera captures images for splicing into a panoramic image, wherein at least one camera captures images with higher definition than the remaining cameras; and controls Module for controlling the module to control the camera module for shooting.

An image display apparatus of the present application includes: a processing module for processing an image captured by the camera module and splicing into a single-resolution panoramic image for selection by a user; and an interaction module for selecting a panoramic image through an interactive action a display area; a judging module, configured to determine whether the display area selected by the interaction action and the local area photographed by the camera with high definition of the captured image have an intersection area; and a display module, if yes, the processing module according to the intersection area Corresponding position of the corresponding image on the panoramic image, the image captured by the camera with high definition of the intersection image corresponding to the intersection area is spliced onto the image corresponding to the display area, and the image corresponding to the display area is displayed, wherein the image corresponding to the display area A local area having at least two different sharpnesses, otherwise the image corresponding to the display display area maintains a single sharpness.

It is worth noting here that the application can also be applied to a drone or a robot, which is not limited herein, and can be set according to a specific situation.

The beneficial effects of the present application are: capturing a panoramic image by a camera or a combination of cameras, and having at least one captured image having a higher resolution than a camera of the remaining cameras to capture a partial area image within the panoramic range, so that at least the panoramic image can be made Two kinds of local image of different definitions, while acquiring the panoramic image, acquire the image with higher definition of the local area, so that the user can obtain the panoramic image and enjoy the immersive experience brought by the panoramic image. The advantage also enables the user to obtain a clearer image of the content that needs attention, enhances the user's shooting experience, and is simpler to implement, lower in cost, and convenient for the user to use.

A person skilled in the art may understand that all or part of the steps of the various methods in the above embodiments may be completed by a program to instruct related hardware, and the program may be stored in a computer readable storage medium, and the storage medium may include: a read only memory, Random access memory, disk or optical disk, etc.

The above content is a further detailed description of the present application in conjunction with the specific embodiments, and the specific implementation of the present application is not limited to the description. For those skilled in the art to which the present invention pertains, several simple deductions or substitutions can be made without departing from the inventive concept.

Claims

A panoramic image capturing method, the method comprising:

a camera module is provided, the camera module includes at least two cameras, and the camera captures images in a panoramic range for splicing into a panoramic image, wherein at least one of the images captured by the camera has higher definition clarity than the remaining cameras;

The control module is set, and the control module controls the camera module to shoot.
The panoramic image capturing method according to claim 1, wherein the camera module comprises:

An image for capturing a panoramic range of images for splicing into a first camera of the panoramic image or a combination of at least two of the first cameras; at least one second camera for capturing an image of a partial area within a panoramic range, The sharpness of the image of the partial area captured by the second camera is higher than the sharpness of the image captured by the first camera; the image capturing body, the first camera and the second camera are disposed in the camera body on.
The panoramic image capturing method according to claim 1, wherein the camera module comprises:

At least one first camera; at least one second camera that can adjust the sharpness of the captured image to be higher than the sharpness of the image captured by the first camera, and the first camera captures the image of the panoramic range for splicing into The panoramic image; and an imaging subject, the first camera and the second camera being disposed on the imaging body.
The panoramic image capturing method according to claim 3, wherein in the step of capturing an image in the panoramic range, the method further comprises: adjusting the second when the panoramic image has a single definition Sharpness of an image captured by the camera or controlling a shooting focal length of the second camera to make the second camera coincide with the sharpness of the captured image of the first camera; when the panoramic image is made to have at least two different definitions In the local area, the second camera is controlled to adjust the shooting focal length such that the image sharpness of the second camera is higher than the sharpness of the image captured by the first camera.
A panoramic image display method, the method comprising:

Processing the image captured by the camera module and splicing into the single-resolution panoramic image for user selection;

Selecting a display area to be displayed in the panoramic image by an interactive action;

Determining whether the display area selected by the interaction action and the local area captured by the camera with high definition of the captured image have an intersection area;

If yes, splicing the image captured by the camera with a higher resolution of the captured image corresponding to the intersection region to the corresponding display area according to the corresponding position of the image corresponding to the intersection region on the panoramic image On the image, an image corresponding to the display area is displayed, wherein the image corresponding to the display area has at least two partial regions of different definition, otherwise, the image corresponding to the display area is displayed to maintain a single sharpness.
The panoramic image display method according to claim 5, further comprising: after determining whether the display area selected by the interactive action and the local area captured by the camera having high definition of the captured image have an intersection area Step: if the display area and the local area have the intersection area, further determining whether the interaction action satisfies the setting condition, and if yes, jumping to splicing the image corresponding to the intersection area to the display area In the step on the image, otherwise, the image corresponding to the display area is displayed to maintain a single sharpness.
The panoramic image display method according to claim 5, wherein in the step of selecting the display area to be displayed in the panoramic image by the interactive action, the action of the user-set part and the gesture recognition technology can be detected by setting a sensor. And setting at least one of the input devices to implement the interaction.
The panoramic image display method according to claim 5, wherein the setting condition is whether the interactive action maintains a selection action setting time, a display range of the interaction action selection, and an intersection range of the partial region Whether it is a set value or whether the interactive action performs the set operation.
The panoramic image display method according to claim 5, wherein in the step that the image corresponding to the display area has at least two partial regions of different definitions, the method includes: displaying an image of the partial area from the remaining area The sharpness of the image is consistently graded to be higher than the image clarity of the rest of the image.
A panoramic image capturing device, characterized in that the device comprises:

a camera module, the camera module includes at least two cameras, and the camera captures an image for splicing into the panoramic image, wherein at least one of the images captured by the camera has higher definition clarity than the remaining cameras;

The control module is used to control the module to control the camera module for shooting.
A panoramic image display device, characterized in that the device comprises:

a processing module, configured to process an image captured by the camera module and splicing into a single-resolution panoramic image for user selection;

An interaction module, configured to select, by an interaction action, a display area to be displayed in the panoramic image;

a judging module, configured to determine whether the display area selected by the interaction action and the local area photographed by the camera with high definition of the captured image have an intersection area;

a display module, configured to: if yes, the processing module captures, according to the corresponding position of the image corresponding to the intersection area on the panoramic image, the camera with high resolution of the captured image corresponding to the intersection area The image is spliced onto the image corresponding to the display area, and the image corresponding to the display area is displayed, wherein the image corresponding to the display area has at least two partial regions of different definition, otherwise, the image corresponding to the display area is displayed. Maintain a single clarity.