CN114268783A - 3D image processing method and device based on cloud service - Google Patents
3D image processing method and device based on cloud service Download PDFInfo
- Publication number
- CN114268783A CN114268783A CN202210001107.2A CN202210001107A CN114268783A CN 114268783 A CN114268783 A CN 114268783A CN 202210001107 A CN202210001107 A CN 202210001107A CN 114268783 A CN114268783 A CN 114268783A
- Authority
- CN
- China
- Prior art keywords
- target object
- stereogram
- pictures
- dimensional
- dimensional space
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 14
- 239000002131 composite material Substances 0.000 claims abstract description 31
- 238000013329 compounding Methods 0.000 claims abstract description 24
- 238000000034 method Methods 0.000 claims abstract description 20
- 238000004590 computer program Methods 0.000 claims description 11
- 150000001875 compounds Chemical class 0.000 claims description 8
- 238000006243 chemical reaction Methods 0.000 claims description 6
- 239000000203 mixture Substances 0.000 claims description 4
- 230000000694 effects Effects 0.000 abstract description 6
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 238000005034 decoration Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Abstract
The invention is suitable for the technical field of 3D head portrait processing, and provides a 3D image processing method and a device based on cloud service, wherein the method comprises the following steps: the method comprises the following steps: acquiring a plurality of pictures of the target object, which are generated by carrying out 360-degree omnibearing shooting on the target object; step two: sending the pictures of the target objects to a cloud storage space; step three: compounding the pictures of the target objects to generate a composite image; step four: overlapping and removing the composite image and converting the composite image into a three-dimensional space stereogram; step five: sequentially repeating the first step, the second step, the third step and the fourth step to obtain a secondary three-dimensional space stereogram, and compounding the three-dimensional space stereogram with the secondary three-dimensional space stereogram; outputting a three-dimensional space stereogram after compounding through the sixth step; therefore, the image effect is smoother and close to a real scene, and the user experience is further improved.
Description
Technical Field
The invention belongs to the technical field of 3D (three-dimensional) head portrait processing, and particularly relates to a 3D image processing method and device based on cloud service.
Background
The panoramic picture has wide application fields, such as tourist attractions, hotels, building real estate, decoration and display and the like; the three-dimensional panoramic image is generated by shooting a scene into a plurality of photos by using a wide-angle lens, splicing the plurality of photos into coherent pictures by using related software, and performing panoramic browsing on the spliced pictures to realize the panoramic image effect; however, the existing panoramic image has serious blurring and image distortion after being enlarged, and cannot meet the use requirements of people.
Disclosure of Invention
In view of the foregoing disadvantages of the prior art, an object of the present invention is to provide a method and an apparatus for processing a 3D image based on a cloud service, which are used to solve the problems of poor 3D image effect and poor user experience caused by the failure to provide an effective method for processing a 3D image based on a cloud service in the prior art.
In one aspect, the present invention provides a cloud service-based 3D image processing method, including:
the method comprises the following steps: acquiring a plurality of pictures of a target object, which are generated by carrying out 360-degree omnibearing shooting on the target object;
step two: sending the pictures of the target objects to a cloud storage space;
step three: compounding a plurality of pictures of the target object to generate a composite image;
step four: overlapping and removing the composite image and converting the composite image into a three-dimensional space stereogram;
step five: sequentially repeating the first step, the second step, the third step and the fourth step to obtain a secondary three-dimensional space stereogram, and compounding or comparing the three-dimensional space stereogram with the secondary three-dimensional space stereogram;
and step six, outputting the compounded three-dimensional space stereogram or the comparison result.
Further preferably, in the step one: when 360-degree all-dimensional shooting is carried out on a target object to generate a plurality of pictures of the target object, the target object and objects around the target object are shot by using a wide-angle lens.
Further preferably, when the first step, the second step, the third step and the fourth step are sequentially repeated, the target object is photographed using the magnifying lens in the first step.
Preferably, in the step one: when 360-degree all-dimensional shooting is carried out on a target object to generate a plurality of pictures of the target object, shooting is carried out by taking the target object as a shooting center according to preset resolution and pixels.
Preferably, in the step three: before the cloud storage space compounds a plurality of pictures of the target object to generate a compound image, performing rectangular splicing on the plurality of pictures of the target object by taking the complete target object as a center;
compounding the edges of the images of the adjacent target objects to generate a composite image;
the picture of the target object contains local features of the target object.
Further preferably, when the composite image is subjected to overlap removal, edges of the picture of the target object with less overlapped edges are removed;
the converting into the three-dimensional spatial perspective includes: and (3) carrying out isometric deformation-free three-dimensional spherical three-dimensional space stereogram conversion by taking the cylindrical axis as the center.
Preferably, the method further comprises: and compounding or comparing the secondarily three-dimensional space stereogram with the three-dimensional space stereogram after the adaptability reduction is carried out on the three-dimensional space stereogram.
In another aspect, the present invention provides a cloud service-based 3D image processing apparatus, the apparatus including:
the shooting unit is used for shooting a target object in 360 degrees in an all-around way to generate a plurality of pictures of the target object;
the uploading unit is used for sending the pictures of the target objects to a cloud storage space;
the acquisition unit acquires 360-degree all-dimensional shooting of a target object from a cloud storage space to generate a plurality of pictures of the target object;
the plane compounding unit is used for compounding a plurality of pictures of the target object to generate a compound image;
the three-dimensional conversion unit is used for removing the overlapping of the composite image and converting the composite image into a three-dimensional space stereogram;
a three-dimensional composition unit that composes the three-dimensional spatial stereogram and the secondary three-dimensional spatial stereogram;
and the output unit outputs the compounded three-dimensional space stereogram.
In another aspect, the present invention also provides a non-transitory computer-readable storage medium storing computer-executable instructions that, when executed by one or more processors, may cause the one or more processors to perform the cloud service-based 3D image processing method described above.
In another aspect, the present invention also provides a computer program product comprising a computer program stored on a non-volatile computer-readable storage medium, the computer program comprising program instructions that, when executed by a processor, cause the processor to perform the above-described cloud service-based 3D image processing method.
The invention has the beneficial effects that: the method comprises the following steps: acquiring a plurality of pictures of the target object, which are generated by carrying out 360-degree omnibearing shooting on the target object; step two: sending the pictures of the target objects to a cloud storage space; step three: compounding the pictures of the target objects to generate a composite image; step four: overlapping and removing the composite image and converting the composite image into a three-dimensional space stereogram; step five: sequentially repeating the first step, the second step, the third step and the fourth step to obtain a secondary three-dimensional space stereogram, and compounding the three-dimensional space stereogram with the secondary three-dimensional space stereogram; outputting a three-dimensional space stereogram after compounding through the sixth step; therefore, the image effect is smoother and close to a real scene, and the user experience is further improved.
Drawings
Fig. 1 is a flowchart of an implementation of a cloud service-based 3D image processing method according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a cloud service-based 3D image processing apparatus according to a second embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The following detailed description of specific implementations of the present invention is provided in conjunction with specific embodiments:
the first embodiment is as follows:
fig. 1 shows an implementation flow of a cloud service-based 3D image processing method provided in an embodiment of the present invention, and for convenience of description, only parts related to the embodiment of the present invention are shown, which are detailed as follows:
in step S101: acquiring a plurality of pictures of the target object, which are generated by carrying out 360-degree omnibearing shooting on the target object;
in an embodiment of the present invention, in step one: when 360-degree omnibearing shooting is carried out on a target object to generate a plurality of pictures of the target object, a wide-angle lens is used for shooting the target object and objects around the target object;
when the target object is shot in 360 degrees in all directions to generate pictures of a plurality of target objects, the target object is taken as a shooting center to be shot according to preset resolution and pixels.
In step S102: sending the pictures of the target objects to a cloud storage space;
in the embodiment of the invention, cloud computing is performed, so that the workload of local equipment is reduced.
In step S103: compounding the pictures of the target objects to generate a composite image;
in the embodiment of the invention, before the cloud storage space compounds the pictures of a plurality of target objects to generate a compound image, the pictures of the plurality of target objects are subjected to rectangular splicing by taking the complete target object as the center; combining and splicing the pictures of the plurality of target objects according to the positions corresponding to the real objects;
compounding the edges of the images of the adjacent target objects to generate a composite image;
the picture of the target object contains the local features of the target object; i.e. 360 degrees around the target object and must contain local features of the target object to facilitate stitching and combining.
In step S104: overlapping and removing the composite image and converting the composite image into a three-dimensional space stereogram;
in the embodiment of the invention, when the composite image is subjected to overlap removal, the edge of the picture of the target object with less overlapped edge is removed;
converting to a three-dimensional spatial perspective includes: and (3) carrying out isometric deformation-free three-dimensional spherical three-dimensional space stereogram conversion by taking the cylindrical axis as the center.
In step S105: sequentially repeating the first step, the second step, the third step and the fourth step to obtain a secondary three-dimensional space stereogram, and compounding or comparing the three-dimensional space stereogram with the secondary three-dimensional space stereogram;
in the embodiment of the invention, the secondary three-dimensional space stereogram is subjected to adaptive reduction and then is compounded or compared with the three-dimensional space stereogram; the proportion of the stress reduction is consistent with that of the primary three-dimensional space stereo image;
further, in step five: when the first step, the second step, the third step and the fourth step are repeated in sequence, the target object is shot by using the magnifying lens in the first step; the resolution ratios of the two times of shooting are different, and the compounded effect is clearer;
in step S106, outputting the compounded three-dimensional space stereogram or the comparison result;
in the embodiment of the invention, three-dimensional comparison can be performed after local feature change is performed on the target object, so as to meet different use requirements.
In the embodiment of the invention, through the step one: acquiring a plurality of pictures of the target object, which are generated by carrying out 360-degree omnibearing shooting on the target object; step two: sending the pictures of the target objects to a cloud storage space; step three: compounding the pictures of the target objects to generate a composite image; step four: overlapping and removing the composite image and converting the composite image into a three-dimensional space stereogram; step five: sequentially repeating the first step, the second step, the third step and the fourth step to obtain a secondary three-dimensional space stereogram, and compounding the three-dimensional space stereogram with the secondary three-dimensional space stereogram; outputting a three-dimensional space stereogram after compounding through the sixth step; therefore, the image effect is smoother and close to a real scene, and the user experience is further improved.
Example two:
fig. 2 illustrates a structure of a cloud service-based 3D image processing apparatus according to a second embodiment of the present invention, and for convenience of description, only a part related to the second embodiment of the present invention is illustrated, where the structure includes:
the shooting unit 200 is used for shooting a target object in 360 degrees in all directions to generate a plurality of pictures of the target object;
the uploading unit 201 sends the pictures of the target objects to the cloud storage space 301;
an acquisition unit 302 which acquires a plurality of images of a target object from the cloud storage space 301 by performing 360-degree all-dimensional shooting on the target object; the cloud storage space 301 is a storage space in a cloud server;
a plane composition unit 303 for compositing the pictures of the plurality of target objects to generate a composite image;
a three-dimensional conversion unit 304, which removes the overlapping of the composite image and converts the composite image into a three-dimensional space stereogram;
a three-dimensional composition unit 305 that composes the three-dimensional spatial view and the quadratic three-dimensional spatial view;
an output unit 306 that outputs the combined three-dimensional spatial perspective; for example, the query result is output to the query terminal device through the cloud server.
In the embodiment of the present invention, each unit of the cloud service-based 3D image processing apparatus may be implemented by a corresponding hardware or software unit, and each unit may be an independent software or hardware unit, or may be integrated into a software or hardware unit, which is not limited herein.
Example three:
a third embodiment of the present invention provides a non-transitory computer-readable storage medium storing computer-executable instructions, which are executed by one or more processors, for example, to perform steps S101 to S106 of the method in fig. 1 described above.
By way of example, non-volatile storage media can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), electrically erasable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in many forms such as Synchronous RAM (SRAM), dynamic RAM, (DRAM), Synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), Synchlink DRAM (SLDRAM), and Direct Rambus RAM (DRRAM). The disclosed memory components or memory of the operating environment described herein are intended to comprise one or more of these and/or any other suitable types of memory.
Example four:
the fourth embodiment of the present invention provides a computer program product, where the computer program product includes a computer program stored on a non-volatile computer-readable storage medium, and the computer program includes program instructions, and when the program instructions are executed by a processor, the processor is caused to execute the cloud service-based 3D image processing method according to the foregoing method embodiment. For example, the method steps S101 to S106 in fig. 1 described above are performed.
The above-described embodiments are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of the embodiment.
Through the above description of the embodiments, those skilled in the art will clearly understand that the embodiments may be implemented by software plus a general hardware platform, and may also be implemented by hardware. With this in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer electronic device (which may be a personal computer, a server, or a network electronic device, etc.) to execute the methods of the various embodiments or some parts of the embodiments.
Conditional language such as "can," "might," or "may" is generally intended to convey that a particular embodiment can include (yet other embodiments do not include) particular features, elements, and/or operations, among others, unless specifically stated otherwise or otherwise understood within the context as used. Thus, such conditional language is not generally intended to imply that features, elements, and/or operations are in any way required for one or more embodiments or that one or more embodiments necessarily include logic for deciding, with or without student input or prompting, whether such features, elements, and/or operations are included or are to be performed in any particular embodiment.
What has been described herein in the specification and drawings includes examples of a 3D image processing method and apparatus capable of providing a cloud-based service. It will, of course, not be possible to describe every conceivable combination of components and/or methodologies for purposes of describing the various features of the disclosure, but it can be appreciated that many further combinations and permutations of the disclosed features are possible. It is therefore evident that various modifications can be made to the disclosure without departing from the scope or spirit thereof. In addition, or in the alternative, other embodiments of the disclosure may be apparent from consideration of the specification and drawings and from practice of the disclosure as presented herein. It is intended that the examples set forth in this specification and the drawings be considered in all respects as illustrative and not restrictive. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.
Claims (10)
1. A3D image processing method based on cloud service is characterized by comprising the following steps:
the method comprises the following steps: acquiring a plurality of pictures of a target object, which are generated by carrying out 360-degree omnibearing shooting on the target object;
step two: sending the pictures of the target objects to a cloud storage space;
step three: compounding a plurality of pictures of the target object to generate a composite image;
step four: overlapping and removing the composite image and converting the composite image into a three-dimensional space stereogram;
step five: sequentially repeating the first step, the second step, the third step and the fourth step to obtain a secondary three-dimensional space stereogram, and compounding or comparing the three-dimensional space stereogram with the secondary three-dimensional space stereogram;
and step six, outputting the compounded three-dimensional space stereogram or the comparison result.
2. The method of claim 1, wherein at said first step: when 360-degree all-dimensional shooting is carried out on a target object to generate a plurality of pictures of the target object, the target object and objects around the target object are shot by using a wide-angle lens.
3. The method of claim 1, wherein, at said step five: and when the first step, the second step, the third step and the fourth step are sequentially repeated, shooting the target object by using the magnifying lens in the first step.
4. A method according to claim 2 or 3, wherein, at said step one: when 360-degree all-dimensional shooting is carried out on a target object to generate a plurality of pictures of the target object, shooting is carried out by taking the target object as a shooting center according to preset resolution and pixels.
5. The method of claim 1, wherein, at step three: before the cloud storage space compounds a plurality of pictures of the target object to generate a compound image, performing rectangular splicing on the plurality of pictures of the target object by taking the complete target object as a center;
compounding the edges of the images of the adjacent target objects to generate a composite image;
the picture of the target object contains local features of the target object.
6. The method according to claim 1, wherein when the overlap removal is performed on the composite image, edges of the picture of the target object with less overlapped edges are removed;
the converting into the three-dimensional spatial perspective includes: and (3) carrying out isometric deformation-free three-dimensional spherical three-dimensional space stereogram conversion by taking the cylindrical axis as the center.
7. The method of claim 3, wherein the method further comprises:
and compounding or comparing the secondarily three-dimensional space stereogram with the three-dimensional space stereogram after the adaptability reduction is carried out on the three-dimensional space stereogram.
8. A cloud service-based 3D image processing apparatus, characterized in that the apparatus comprises:
the shooting unit is used for shooting a target object in 360 degrees in an all-around way to generate a plurality of pictures of the target object;
the uploading unit is used for sending the pictures of the target objects to a cloud storage space;
the acquisition unit acquires 360-degree all-dimensional shooting of a target object from a cloud storage space to generate a plurality of pictures of the target object;
the plane compounding unit is used for compounding a plurality of pictures of the target object to generate a compound image;
the three-dimensional conversion unit is used for removing the overlapping of the composite image and converting the composite image into a three-dimensional space stereogram;
a three-dimensional composition unit that composes the three-dimensional spatial stereogram and the secondary three-dimensional spatial stereogram;
and the output unit outputs the compounded three-dimensional space stereogram.
9. A non-transitory computer-readable storage medium storing computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform the cloud service based 3D image processing method of any one of claims 1-7.
10. A computer program product, characterized in that the computer program product comprises a computer program stored on a non-volatile computer-readable storage medium, the computer program comprising program instructions that, when executed by a processor, cause the processor to perform the cloud service based 3D image processing method of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210001107.2A CN114268783A (en) | 2022-01-04 | 2022-01-04 | 3D image processing method and device based on cloud service |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210001107.2A CN114268783A (en) | 2022-01-04 | 2022-01-04 | 3D image processing method and device based on cloud service |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114268783A true CN114268783A (en) | 2022-04-01 |
Family
ID=80832584
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210001107.2A Pending CN114268783A (en) | 2022-01-04 | 2022-01-04 | 3D image processing method and device based on cloud service |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114268783A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102013110A (en) * | 2010-11-23 | 2011-04-13 | 李建成 | Three-dimensional panoramic image generation method and system |
| WO2019223158A1 (en) * | 2018-05-23 | 2019-11-28 | 平安科技（深圳）有限公司 | Vr image production method, apparatus, computer device, and storage medium |
| US20200273149A1 (en) * | 2017-11-09 | 2020-08-27 | Zhejiang Dahua Technology Co., Ltd. | Systems and methods for generating panorama image |
| WO2021218551A1 (en) * | 2020-04-28 | 2021-11-04 | 华为技术有限公司 | Photographing method and apparatus, terminal device, and storage medium |
-
2022
- 2022-01-04 CN CN202210001107.2A patent/CN114268783A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102013110A (en) * | 2010-11-23 | 2011-04-13 | 李建成 | Three-dimensional panoramic image generation method and system |
| US20200273149A1 (en) * | 2017-11-09 | 2020-08-27 | Zhejiang Dahua Technology Co., Ltd. | Systems and methods for generating panorama image |
| WO2019223158A1 (en) * | 2018-05-23 | 2019-11-28 | 平安科技（深圳）有限公司 | Vr image production method, apparatus, computer device, and storage medium |
| WO2021218551A1 (en) * | 2020-04-28 | 2021-11-04 | 华为技术有限公司 | Photographing method and apparatus, terminal device, and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3522105B1 (en) | Method and device for performing mapping on spherical panoramic image | |
| CN110730296B (en) | Image processing apparatus, image processing method, and computer readable medium | |
| CN106375748B (en) | Stereoscopic Virtual Reality panoramic view joining method, device and electronic equipment | |
| US8849013B2 (en) | System and method of image processing | |
| CN101689292B (en) | Banana codec | |
| KR102208773B1 (en) | Panoramic image compression method and apparatus | |
| CN107395985B (en) | A kind of mobile terminal image composition method, device and mobile terminal | |
| US20220148129A1 (en) | Image fusion method and portable terminal | |
| CN109547766A (en) | A kind of panorama image generation method and device | |
| CN107113381A (en) | The tolerance video-splicing that space-time local deformation and seam are searched | |
| WO2020215644A1 (en) | Video image processing method and apparatus | |
| CN109308686A (en) | A kind of fish eye images processing method and processing device, equipment and storage medium | |
| CN106412669A (en) | Method and device for rendering panoramic video | |
| JP7264310B2 (en) | Image processing method, apparatus, non-transitory computer readable medium | |
| CN110611767B (en) | Image processing method and device and electronic equipment | |
| JP2021502784A (en) | How to realize the bullet time shooting effect and panoramic camera | |
| KR20190086964A (en) | System and Method for Removing Distortion of Fisheye Lens and Omnidirectional Image | |
| KR20190059712A (en) | 360 VR image conversion system and method using multiple images | |
| KR20180106549A (en) | 360 degree panorama multimedia contents processing apparatus and control method thereof | |
| Smith et al. | Cultural heritage omni-stereo panoramas for immersive cultural analytics—from the Nile to the Hijaz | |
| See et al. | Virtual reality 360 interactive panorama reproduction obstacles and issues | |
| CN114742940A (en) | Method, device and equipment for constructing virtual image texture map and storage medium | |
| CN114268783A (en) | 3D image processing method and device based on cloud service | |
| See et al. | Creating high fidelity 360° virtual reality with high dynamic range spherical panorama images | |
| CN114549329A (en) | Image inpainting method, apparatus and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |