TW201913562A - Device and method for generating panorama image - Google Patents

Abstract

A panorama image generating device includes an image library, a receiving module, an analysis module, a first extracting module, a selecting module, a second extracting module, and a splicing module. The image library stores a plurality of images. The receiving module is configured to receive basic searching information. The analysis module is configured to obtain key searching information of the required image according to the basic searching information. The first extracting module is configured to exact first images which are matching the key searching information from the image library. The selecting module is configured to select second images which comprise different azimuth angles and match predetermined environmental parameter from the first images. The second extracting module is configured to extract optimization images of each azimuth angle from the second images according to an environmental parameter and an image parameter of each second image. The splicing module is configured to regulate the image parameter of each optimization image to splice a panorama image. A panorama image generating method is also provided.

Description

Panoramic image generating device and method

The present invention relates to the field of image processing technologies, and in particular, to a panoramic image generating device and method.

With the rise of smart phones and digital cameras, it has become common to record life content through images. The online cloud and offline terminals store a large number of users' images, most of which are 2D images. These image data reports contain many environmental parameters taken at that time. The panoramic image can make the users who can't visit the scene or want to relive the scene at the scene immersively, how to effectively and practically filter and integrate the image information scattered around the scene, and then integrate it to generate various angles. The panoramic image is a major technical challenge.

In view of the above, it is necessary to provide a panoramic image generating device and method capable of splicing 2D images to generate panoramic images.

An embodiment of the present invention provides a panoramic image generating apparatus, including an image database, wherein the image data library stores a plurality of images. The panoramic image generating device further includes: a receiving module, configured to receive a basic search information; and an analyzing module, configured to parse the image information that needs to be retrieved according to the basic search information; Extracting, from the image database, a first image that meets the image information; and a screening module, configured to filter out the first image from the extracted image and have a different azimuth angle and conform to a preset environment a second image of the parameter; a second extraction module, configured to extract a preferred image of each of the angles according to the environmental parameters and the image parameters of each of the second images; and a mosaic generation module, configured to: The image parameters of each of the preferred images are adjusted for splicing to generate a panoramic image.

An embodiment of the present invention provides a method for generating a panoramic image, comprising the steps of: receiving a basic search information; parsing the image information that is required to be retrieved according to the basic search information; and extracting the image from the image database. a first image of the information; a second image having different azimuth angles and conforming to the preset environmental parameter is filtered out from the extracted first image; and environmental parameters and graphs according to each of the second images A preferred image is extracted from the angle of each of the pixels, and the image parameters of each of the preferred images are adjusted to be stitched to generate a panoramic image.

Compared with the prior art, the above-mentioned panoramic image generating device and method can filter images according to the received basic search information (speech/text/image) and splicing the images to generate a panoramic image for the user to view, prompting the user Viewing experience.

Referring to FIG. 1-2, in an embodiment, a panoramic image generating apparatus 100 is configured to splicing images captured at different angles to form a panoramic image of a preset angle. For example, it can be a 180 degree panoramic image, a 270 degree panoramic image, or a 360 degree panoramic image. The 180-degree panoramic image is preferably a hemispherical panoramic image, and the 360-degree panoramic image is preferably a spherical panoramic image.

The panoramic image generating apparatus 100 includes an image database 10, a receiving module 20, an analysis module 30, a first extraction module 40, a screening module 50, a second extraction module 60, and a splicing generation module 70.

The image database 10 stores a plurality of images. The image database 10 may also be installed in a cloud server (not shown), and the panoramic image generating device 100 is connected to the image database 10 by accessing a cloud server. Of course, the image database 10 may be a collection of images stored in the panoramic image generating device 100 and images stored in the cloud server. Each image may include environmental parameters and image parameters associated therewith. The environmental parameter may be one or more of azimuth angle, aperture, shutter speed, exposure value, light angle, wind speed, temperature and humidity at the time of shooting. The image parameters may be one or more of depth of field information, color, brightness, sharpness, and focal length.

The receiving module 20 is configured to receive a basic search information. The basic search information may include one or more of image, voice information, and text information. For example, in the opening day of the Alishan Cherry Blossom Season in 2014 (March 10, 2014), a user could not visit the scene or wanted to relive the scene at that time. The user can input the "2014 Alishan Cherry Blossom Season Opening Day" information to the panoramic image generating device 100 in the form of voice or text, and the panoramic image generating device 100 can know that it is necessary to belong to the "2014 Alishan Cherry Blossom Season Opening Day". The images are spliced to form a panoramic image of a predetermined angle for the user to view with various devices (either a mobile device, a PC end, a VR device, or a panoramic image generating device 100). The user can also upload at least one image belonging to the "2014 Alishan Cherry Blossom Season Opening Day" to the panoramic image generating device 100 as the basic search information for input.

The parsing module 30 is configured to parse the image information that needs to be retrieved according to the basic search information. For example, if the receiving module 20 receives the basic search information of the "2014 Alishan Cherry Blossom Season Opening Day" in the form of voice or text. The parsing module 30 analyzes the semantics to obtain the image information to be retrieved including: time (2014), location (Alishan cherry blossom season scene) and precise time interval (opening day, March 10). If the receiving module 20 receives an input from the user, it is an image. The analysis module 30 analyzes the image by the image analysis on March 10, 2014. The location is the scene of the Alishan cherry blossom season. The image includes a suspension bridge, an entrance door, and cherry blossoms. The analysis module 30 can also obtain the image information to be retrieved by analyzing the image input by the user, including: time (2014), location (Alishan cherry blossom season scene) and precise time interval (opening day, March) 10th).

The first extraction module 40 is configured to extract, from the image database 10, a first image that conforms to the image information. For example, if the image database 10 contains 200 pictures taken in the "Alishan Cherry Blossom Season Opening Day 2014", the first extraction module 40 extracts the 200 images from the image database 10 (ie, 200 first images).

The screening module 50 is configured to filter, from the extracted first image, a second image having different azimuth angles and conforming to preset environmental parameters. For example, the preset environment parameter may include an aperture, an exposure value, and a ray angle, and the preset environment parameter may set a threshold or an interval value to filter out images having different azimuth angles and clearer image quality. The screening module 50 selects a second image that is consistent with the generated panoramic image from the 200 images extracted from the first extraction module 40 according to the captured azimuth angle and the preset environmental parameters.

In an embodiment, the panoramic image is preferably spliced by a second image with different azimuth angles and clearer image quality.

The second extraction module 60 is configured to extract a preferred image of the respective angles from the environment parameters and the image parameters of each of the second images. The preferred image of each azimuth angle may be a second image in which the difference between the environmental parameter and the image parameter in the adjacent azimuth angle is the smallest. For example, after screening by the screening module 50, the azimuth angle A has three images, the azimuth angle B has five images, the azimuth angle C has four images, and the azimuth angle D has seven images. If the panoramic image is spliced, an azimuth angle A image, an azimuth angle B image, an azimuth angle C image, and an azimuth angle D image are required. At this time, the second extraction module 60 takes as reference from the plurality of azimuth angle A images, the azimuth angle B image, the azimuth angle C image, and the azimuth angle D according to the environmental parameters and image parameters of the spliced adjacent images. The images are selected to avoid large differences in parameters of adjacent stitched images and reduce visual effects. For example, the second extraction module 60 extracts a parameter difference of the stitched image adjacent to the azimuth angle A from the three azimuth angle A images according to the parameters of the stitched image adjacent to the azimuth angle A. The smallest image is taken as the preferred image of the azimuth angle A. In other embodiments of the present invention, the second extraction module 60 may also extract an azimuth angle A image with the best environmental parameters and/or image parameters from the three azimuth angle A images as a preferred image. .

The splicing generation module 70 is configured to adjust image parameters of each of the preferred images to perform splicing to generate a panoramic image. Specifically, the splicing generation module 70 can adjust the color, brightness, sharpness, focal length, and the like of each preferred image extracted by the second extraction module 60. The stitching generation module 70 then stitches the adjusted image to generate the panoramic image.

Referring to FIG. 3-4 at the same time, in an embodiment, the splicing generation module 70 includes an adjustment unit 702 and a splicing unit 704. Since each preferred photo may have a different focal length when shooting, if the stitching is directly performed, the visual effect will be poor. The adjusting unit 702 is configured to perform center point correction on each of the preferred images to adjust the focal length of each of the preferred images such that the focal lengths are substantially the same, and the image ratio and angle are also appropriately adjusted when the focus adjustment is performed. The adjustment unit 702 simultaneously adjusts the image parameters of each of the preferred images. The splicing unit 704 is configured to select a preferred image whose focal length is closest to the corrected center point as a starting stitching image and splicing to the periphery based on the image base to generate the panoramic image.

In an embodiment, the basic search information received by the receiving module 20 may also be any image A of an album in a user mobile device (mobile phone, tablet). The panoramic image generating device 100 further includes a determining module 80 and a marking module 90. The panoramic image may be of a plurality of types such as a 180-degree panoramic image, a 270-degree panoramic image, and a 360-degree panoramic image.

The determining module 80 is configured to determine whether the preferred image extracted by the second extraction module 60 is sufficient to generate the panoramic image of the arbitrary angle type. If the determining module 80 determines that the extracted preferred image is capable of generating one or more panoramic images, the marking module 90 adds a markable information of a maximum angle type that can be generated on the image A of the album to prompt use. The image of this image A has a panoramic image for viewing. For example, if the determination module 80 determines that the extracted preferred image is capable of generating three panoramic images of 180 degrees, 270 degrees, and 360 degrees. The marking module 90 adds a marker information that can generate a 360-degree panoramic image on the image A of the album. If the determining module 80 determines that the extracted preferred image is capable of generating two panoramic images of 180 degrees and 270 degrees. The marking module 90 adds a marker information that can generate a 270-degree panoramic image on the image A of the album. The user can click on the picture A in the album or the mark information on the picture A, and the image is stitched in the background to generate the panoramic image corresponding to the image A for viewing.

When the determining module 80 determines that the extracted preferred image is not capable of generating the panoramic image of any angle type, the marking module 90 does not perform marking processing or the marking module on the image A of the album. 90 adds a markup information that cannot generate a panoramic image on the image A of the album.

In an embodiment, since the panoramic image is formed by splicing the preferred images of different azimuth angles, the determining module 80 determines whether the extracted preferred image is sufficient to generate the panoramic image of the arbitrary angle type. A panoramic image of an angle type is generated to delete an azimuth angle image. If it is judged to be missing, it is considered that the panoramic image of the angle type cannot be generated.

In an embodiment, if the splicing generation module 70 generates a panoramic image of an angle type and the missing content is small, the content can be filled by the content sensing technology.

FIG. 5 is a flowchart of a method for generating a panoramic image according to an embodiment of the present invention. The method can be used in the panoramic image generating device 100 shown in FIG. 2 or 3.

In step S500, the receiving module 20 receives a basic search information.

In step S502, the analysis module 30 parses the image information that needs to be retrieved according to the basic search information.

In step S504, the first extraction module 40 extracts a first image that conforms to the image information from the image database 10.

Step S506, the screening module 50 filters out the second image having different azimuth angles and conforming to the preset environmental parameters from the extracted first image.

Step S508, the second extraction module 60 extracts a preferred image of the respective angles from the environment parameters and the image parameters of each of the second images.

In step S510, the splicing generation module 70 adjusts the image parameters of each of the preferred images to perform splicing to generate a panoramic image.

In an embodiment, the splicing generation module 70 includes an adjustment unit 702 and a splicing unit 704. Since each preferred photo may have a different focal length when shooting, if the stitching is directly performed, the visual effect will be poor. The adjusting unit 702 performs center point correction on each of the preferred images to adjust the focal length of each of the preferred images such that the focal lengths are substantially the same, and the image ratio and angle are also appropriately adjusted when the focus adjustment is performed. The adjustment unit 702 simultaneously adjusts the image parameters of each of the preferred images. The splicing unit 704 selects a preferred image whose focal length is closest to the corrected center point as a starting spliced image and splicing to the periphery based on the image base to generate the panoramic image.

FIG. 6 is a flowchart of a method for generating a panoramic image according to another embodiment of the present invention. The process steps shown in Figure 6 and Figure 5 are basically the same, except that:

S500. The receiving module 20 receives a basic search information, where the basic search information is an image in an album. The method disclosed in FIG. 6 further includes step S512, step S514, and step S516.

In step S512, the determining module 80 determines whether the extracted preferred image is sufficient to generate a panoramic image of any preset angle type (180 degrees, 270 degrees, 360 degrees).

Step S514, if the determining module 80 determines that one or more preset angle panoramic images can be generated, the marking module 90 adds a markable information of a maximum angle type that can be generated on the image of the album.

In step S516, if the determining module 80 determines that the preset one-angle panoramic image cannot be generated, the marking module 90 does not perform marking processing on the image of the album.

In an embodiment, if the determining module 80 determines that the preset one-angle panoramic image cannot be generated, the marking module 90 may also add a marking information that cannot generate the panoramic image on the image of the album. .

The panoramic image generating device and method can filter images according to the received basic search information (speech/text/image) and splicing the images to generate a panoramic image for the user to view, prompting the user's viewing experience.

In summary, the present invention complies with the requirements of the invention patent and submits a patent application according to law. However, the above description is only a preferred embodiment of the present invention, and the scope of the present invention is not limited to the above-described embodiments, and equivalent modifications or variations made by those skilled in the art in accordance with the spirit of the present invention are It should be covered by the following patent application.

10‧‧‧ Image database

20‧‧‧ receiving module

30‧‧‧Analytical Module

40‧‧‧First extraction module

50‧‧‧Screening module

60‧‧‧Second extraction module

70‧‧‧Splicing generation module

80‧‧‧Judgement module

90‧‧‧Marking module

100‧‧‧ panoramic image generating device

702‧‧‧Adjustment unit

704‧‧‧Splicing unit

1 is a diagram showing an operational environment of a panoramic image generating device according to an embodiment of the present invention.

2 is a functional block diagram of a panoramic image generating device according to an embodiment of the present invention.

3 is a functional block diagram of a panoramic image generating device according to another embodiment of the present invention.

4 is a schematic diagram of center point correction of a plurality of preferred images according to an embodiment of the present invention.

FIG. 5 is a flow chart showing the steps of a method for generating a panoramic image according to an embodiment of the present invention.

6 is a flow chart showing the steps of a method for generating a panoramic image according to another embodiment of the present invention.

no

no

Claims (12)

A method for generating a panoramic image, the method for generating a panoramic image, comprising: receiving a basic search information; parsing image information to be retrieved according to the basic search information; and extracting the image information from the image database a first image; a second image having different azimuth angles and conforming to preset environmental parameters is filtered out from the extracted first image; and environmental parameters and image parameters according to each of the second images Extracting a preferred image of the angles of the respective parties; and adjusting image parameters of each of the preferred images to perform splicing to generate a panoramic image. The method for generating a panoramic image according to claim 1, wherein the adjusting the image parameters of each of the preferred images to perform splicing to generate the panoramic image comprises:: each of the preferred images Performing a center point correction to adjust a focal length of each of the preferred images; adjusting image parameters of each of the preferred images; selecting a preferred image having a focal length closest to the corrected center point as a starting stitching image orientation Stitching is performed around to generate the panoramic image. The method for generating a panoramic image according to claim 1, wherein the basic search information includes one or more of image, voice information, and text information. The method for generating a panoramic image according to claim 1, wherein the preferred image of each azimuth angle is a second image in which the difference between the environmental parameter and the image parameter in the adjacent azimuth angle is the smallest. The method for generating a panoramic image according to claim 1, wherein the basic search information is an image in an album, and the panoramic image includes a plurality of preset angle types of panoramic images, and the panoramic image generating method further The method includes: determining whether the extracted preferred image is sufficient to generate the panoramic image of any one of the preset angle types; and if the panoramic image can be generated, adding a maximum angle type that can be generated on the image of the album Tag information. The method for generating a panoramic image according to claim 5, wherein the method for generating a panoramic image further comprises: if the panoramic image cannot be generated, not marking the image of the album or in the album Add a marker information on the image that cannot generate a panoramic image. A panoramic image generating device, comprising an image database, wherein the image data library stores a plurality of images, wherein the panoramic image generating device further comprises: a receiving module, configured to receive a basic search information The parsing module is configured to parse the image information to be retrieved according to the basic search information; and the first extracting module is configured to extract, from the image database, the first image that meets the image information a screening module, configured to filter, from the extracted first image, a second image that has different azimuth angles and meets preset environmental parameters; and a second extraction module, configured to The environment parameter and the image parameter of the second image are used to extract a preferred image of the angles of the respective parties; and the splicing generation module is configured to adjust the image parameters of each of the preferred images to perform splicing to generate a panoramic image. The panoramic image generating device of claim 7, wherein the splicing generating module comprises an adjusting unit and a splicing unit, wherein the adjusting unit is configured to perform center point correction on each of the preferred images to adjust the Describe the focal length of each preferred image, and simultaneously adjust the image parameters of each of the preferred images; the splicing unit is configured to select a preferred image whose focal length is closest to the corrected center point as the starting stitching image direction Stitching is performed around to generate the panoramic image. The panoramic image generating apparatus according to claim 7, wherein the basic search information includes one or more of an image, a voice information, and a text information. The panoramic image generating device of claim 7, wherein the preferred image of each azimuth angle is a second image in which an environmental parameter and an image parameter have the smallest difference in adjacent azimuth angles. The panoramic image generating device of claim 7, wherein the panoramic image generating device further comprises a determining module and a marking module, wherein the basic search information is an image in an album, and the panoramic image includes a plurality of preset angle type panoramic images, the determining module is configured to determine whether the extracted preferred image is sufficient to generate the panoramic image of any one of the preset angle types, and the marking module is configured to determine the When the extracted preferred image is capable of generating the panoramic image, a mark information of a maximum angle type that can be generated is added to the image of the album. The panoramic image generating device of claim 11, wherein the marking module is used when the determining module is configured to determine that the extracted preferred image is not capable of generating the panoramic image of any angle type. The group does not mark the image of the album or the tag module adds a markup information on the image of the album that cannot generate a panoramic image.