CN109218699B - Image processing device and method based on 3D camera - Google Patents
Image processing device and method based on 3D camera Download PDFInfo
- Publication number
- CN109218699B CN109218699B CN201811008098.XA CN201811008098A CN109218699B CN 109218699 B CN109218699 B CN 109218699B CN 201811008098 A CN201811008098 A CN 201811008098A CN 109218699 B CN109218699 B CN 109218699B
- Authority
- CN
- China
- Prior art keywords
- image
- module
- target
- digital image
- distance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/60—Memory management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N2013/0074—Stereoscopic image analysis
- H04N2013/0092—Image segmentation from stereoscopic image signals
Abstract
The invention discloses an image processing device and method based on a 3D camera, wherein the image processing device comprises the 3D camera and a processing end, the processing end comprises an acquisition module, a processing module, an attaching module and a storage module, the processing end also comprises a database, the database comprises a plurality of digital images, and the 3D camera is used for acquiring an initial image of a shooting target; the acquisition module is used for calling the target digital image; the processing module is used for adjusting the parameters of the structural layer; the attaching module is used for attaching the pixel layer of the initial image to the target digital image; the storage module is used for storing the digital images. The image processing device and method based on the 3D camera can digitize the 3D image, so that the acquired 3D image is easier to manage and control, the resources consumed by operation can be reduced, the space occupied by the 3D image is reduced, and the image can be standardized by controlling the number of the image elements.
Description
Technical Field
The invention relates to an image processing device and method based on a 3D camera.
Background
The 3D camera, which is manufactured by using a 3D lens, generally has two or more image pickup lenses, and has a pitch close to the pitch of human eyes, and can capture different images of the same scene seen by similar human eyes. The holographic 3D has a disc 5 above the lens, and can view the same image in all directions through dot grating imaging or -shaped grating holographic imaging, such as being in the environment.
The first 3D camera to date the 3D revolution has all been around the hollywood heavy-pound large and major sporting events. With the advent of 3D cameras, this technology is one step closer to home users. After the camera is introduced, each memorable moment of the life, such as the first step taken by a child, a university graduation celebration and the like, can be captured by using a 3D lens in the future.
A 3D camera typically has more than two lenses. The 3D camera functions like a human brain, and can fuse two lens images together to form a 3D image. These images can be played on a 3D television, and can be viewed by viewers wearing so-called actively shuttered glasses, or directly viewed by naked-eye 3D display devices. The 3D shutter glasses can rapidly alternately open and close the lenses of the left and right glasses at a rate of 60 times per second. This means that each eye sees a slightly different picture of the same scene, so the brain can thus think that it is enjoying a single picture in 3D.
The existing 3D camera has the defects that the acquired images are not easy to process and control, and the 3D images occupy larger space.
Disclosure of Invention
The invention aims to overcome the defects that images acquired by a 3D camera are not easy to process and control and the occupied space of the 3D images is large in the prior art, and provides an image processing device and method based on the 3D camera, which can digitize the 3D images, enable the acquired 3D images to be easier to manage and control, reduce the resources consumed by operation, reduce the occupied space of the 3D images and standardize the images.
The invention solves the technical problems through the following technical scheme:
an image processing device based on a 3D camera is characterized in that the image processing device comprises the 3D camera and a processing end, the processing end comprises an acquisition module, a processing module, an attaching module and a storage module, the processing end further comprises a database, the database comprises a plurality of digital images,
the 3D camera is used for acquiring an initial image of a shooting target, and the initial image comprises a pixel layer and a structural layer;
the acquisition module is used for acquiring a target digital image matched with an initial image structural layer in the database according to the space shape of the initial image structural layer;
the processing module is used for adjusting the structural layer parameters of the target digital image according to the space shape;
the attaching module is used for attaching the pixel layer of the initial image to the structural layer of the target digital image with the adjusted structural layer parameters;
the storage module is used for storing the digital image of the target attached to the pixel layer as the digital image of the shooting target, and the digital image of the shooting target comprises pixels with the preset number.
The digital image is a pre-stored digital point cloud, the digital image is a preset digital point cloud, each digital point in the digital image has a label and a certain conduction relation exists between the digital points.
Preferably, the digitized image includes a pixel layer and a structural layer, and the storage module is further configured to set the number of pixels in the structural layer of the digitized image of the photographic target and/or pixels in the pixel layer.
Preferably, the digital image is provided with a plurality of control points for controlling the shape of the structural layer, and the processing module is configured to adjust the control points according to the spatial shape to adjust the structural layer parameters of the target digital image.
Preferably, the processing end comprises a placing module,
the placing module is used for placing the target digital image and the initial image in an overlapping mode to obtain the distance from a control point on the target digital image to the initial image;
the processing module is further configured to acquire the control point with the largest distance as a target control point, and move the target control point by the distance towards the direction of the initial image;
the processing module is further used for moving the peripheral control points around the target control point to the direction of the initial image by a value transmission distance, the value transmission distance of each peripheral control point is inversely proportional to the distance from the peripheral control point to the target control point, and the value transmission distance is smaller than the moving distance of the target control point.
Preferably, the processing end comprises a placing module,
the placing module is used for placing the digital image and the initial image in an overlapping mode to obtain the distance from each pixel on the digital image to the initial image;
for a digital image, the obtaining module is configured to add distances of each pixel of the digital image to obtain an overall matching value, and the digital image with the minimum overall matching value is the target digital image.
Preferably, the processing end further comprises a dividing module,
the dividing module is used for dividing the digital image into a plurality of areas according to the five sense organs;
the placing module is used for acquiring the distance from each pixel on the digital image to the initial image;
for each region in a digital image, the acquisition module is used for adding the distance of each pixel in the region to acquire a region matching value, and adding all the region matching values according to the proportion corresponding to the five sense organs to acquire the integral matching value.
The invention also provides an image processing method based on the 3D camera, which is characterized in that the image processing method obtains the digital image of the shooting target through the image processing device.
On the basis of the common knowledge in the field, the above preferred conditions can be combined randomly to obtain the preferred embodiments of the invention.
The positive progress effects of the invention are as follows:
the image processing device and method based on the 3D camera can digitize the 3D image, so that the acquired 3D image is easier to manage and control, the resources consumed by operation can be reduced, the space occupied by the 3D image is reduced, and the image can be standardized by controlling the number of the image elements.
Drawings
Fig. 1 is a flowchart of an image processing method according to embodiment 1 of the present invention.
Detailed Description
The invention is further illustrated by the following examples, which are not intended to limit the scope of the invention.
Example 1
The present embodiment provides an image processing apparatus based on a 3D camera, which includes a 3D camera and a processing terminal.
The processing end comprises an acquisition module, a processing module, an attaching module and a storage module.
The processing end also comprises a database, and the database comprises a plurality of digital images. Digitized images are canonical data, and images are in units of picture elements (image points) that can be edited to change parameters.
The 3D camera is used for acquiring an initial image of a shooting target, and the initial image comprises a pixel layer and a structural layer;
the acquisition module is used for acquiring a target digital image matched with an initial image structural layer in the database according to the space shape of the initial image structural layer;
the processing module is used for adjusting the structural layer parameters of the target digital image according to the space shape;
the attaching module is used for attaching the pixel layer of the initial image to the structural layer of the target digital image with the adjusted structural layer parameters;
the storage module is used for storing the digital image of the target attached to the pixel layer as the digital image of the shooting target, and the digital image of the shooting target comprises pixels with the preset number.
The digital image comprises a pixel layer and a structural layer, the storage module is also used for setting the number of pixels in the structural layer of the digital image of the shooting target and the number of pixels in the pixel layer, and the parameters of the digital image of the shooting target can be edited, so that the number of pixels and the number of pixels can be set, data can be specified and set, and the initial image is replaced by the digital image and can be edited.
Particularly, the digital image is provided with a plurality of control points for controlling the shape of the structural layer, and the processing module is used for adjusting the control points according to the spatial shape to adjust the structural layer parameters of the target digital image.
The processing end also comprises a placing module,
the placing module is used for placing the target digital image and the initial image in an overlapping mode so as to obtain the distance between a control point on the target digital image and the initial image.
The distance is the distance of the structural layer.
The processing module is further configured to acquire the control point with the largest distance as a target control point, and move the target control point by the distance towards the direction of the initial image;
the processing module is further used for moving the peripheral control points around the target control point to the direction of the initial image by a value transmission distance, the value transmission distance of each peripheral control point is inversely proportional to the distance from the peripheral control point to the target control point, and the value transmission distance is smaller than the moving distance of the target control point.
Referring to fig. 1, with the image processing apparatus, the present embodiment further provides an image processing method, including:
in step 102, the specific manner of adjusting the parameters of the structural layer is as follows:
the digital image is provided with a plurality of control points for controlling the shape of the structural layer, and the processing module adjusts the control points according to the spatial shape to adjust the structural layer parameters of the target digital image.
The control points are structural layer parameters. And adjusting the structural parameters by adjusting the control points. The control point may be
The placing module is used for placing the target digital image and the initial image in an overlapping mode to obtain the distance from a control point on the target digital image to the initial image;
the processing module acquires the control point with the largest distance as a target control point and moves the target control point to the direction of the initial image by the distance;
the processing module moves the peripheral control points around the target control point to the direction of the initial image by a transmission distance, the transmission distance of each peripheral control point is inversely proportional to the distance from the peripheral control point to the target control point, and the transmission distance is smaller than the moving distance of the target control point.
103, attaching the pixel layer of the initial image to the structural layer of the target digital image with the adjusted structural layer parameters by the attaching module;
and 104, setting the number of pixels in the digital image structure layer of the shooting target and the pixels in the pixel layer by the storage module.
And 105, storing the target digital image attached to the pixel layer as a digital image of a shooting target by the storage module, wherein the digital image of the shooting target comprises pixels with a preset number.
Example 2
This example is substantially the same as example 1 except that:
the processing end comprises a placing module which is provided with a placing module,
the placing module is used for placing the digital image and the initial image in an overlapping mode to obtain the distance from each pixel on the digital image to the initial image.
The distance is the distance of the structural layer.
For a digital image, the obtaining module is configured to add distances of each pixel of the digital image to obtain an overall matching value, and the digital image with the minimum overall matching value is the target digital image.
The specific way of obtaining the overall matching value is as follows:
the processing end also comprises a dividing module.
The dividing module is used for dividing the digital image into a plurality of areas according to the five sense organs.
The placing module is used for obtaining the distance from each pixel on the digital image to the initial image.
For each region in a digital image, the acquisition module is used for adding the distance of each pixel in the region to acquire a region matching value, and adding all the region matching values according to the proportion corresponding to the five sense organs to acquire the integral matching value.
Accordingly, step 101 in embodiment 1 is refined in the data processing method of the present embodiment as follows:
the dividing module is used for dividing the digital image into a plurality of areas according to the five sense organs.
The placing module is used for obtaining the distance from each pixel on the digital image to the initial image.
The distance is the distance of the structural layer.
For each region in a digital image, the acquisition module is used for adding the distance of each pixel in the region to acquire a region matching value, and adding all the region matching values according to the proportion corresponding to the five sense organs to acquire the integral matching value.
While specific embodiments of the invention have been described above, it will be appreciated by those skilled in the art that these are by way of example only, and that the scope of the invention is defined by the appended claims. Various changes and modifications to these embodiments may be made by those skilled in the art without departing from the spirit and scope of the invention, and these changes and modifications are within the scope of the invention.
Claims (5)
1. An image processing device based on a 3D camera is characterized in that the image processing device comprises the 3D camera and a processing end, the processing end comprises an acquisition module, a processing module, an attaching module and a storage module, the processing end further comprises a database, the database comprises a plurality of digital images,
the 3D camera is used for acquiring an initial image of a shooting target, and the initial image comprises a pixel layer and a structural layer;
the acquisition module is used for acquiring a target digital image matched with an initial image structural layer in the database according to the space shape of the initial image structural layer;
the processing module is used for adjusting the structural layer parameters of the target digital image according to the space shape;
the attaching module is used for attaching the pixel layer of the initial image to the structural layer of the target digital image with the adjusted structural layer parameters;
the storage module is used for storing the digital image of the target attached to the pixel layer as the digital image of the shooting target, and the digital image of the shooting target comprises pixels with the preset number;
the processing end comprises a placing module which is provided with a placing module,
the placing module is used for placing the digital image and the initial image in an overlapping mode to obtain the distance from each pixel on the digital image to the initial image;
for a digital image, the acquisition module is used for adding the distances of each pixel of the digital image to acquire an overall matching value, and the digital image with the minimum overall matching value is the target digital image;
the processing end also comprises a dividing module,
the dividing module is used for dividing the digital image into a plurality of areas according to the five sense organs;
the placing module is used for acquiring the distance from each pixel on the digital image to the initial image;
for each region in a digital image, the acquisition module is used for adding the distance of each pixel in the region to acquire a region matching value, and adding all the region matching values according to the proportion corresponding to the five sense organs to acquire the integral matching value.
2. The image processing apparatus as claimed in claim 1, wherein the digitized image includes a pixel layer and a structural layer, and the storage module is further configured to set the number of pixels in the structural layer of the digitized image of the photographic subject and/or the pixels in the pixel layer.
3. The image processing apparatus as claimed in claim 2, wherein the digitized image is provided with a plurality of control points for controlling the shape of the structure layer, and the processing module is configured to adjust the control points according to the spatial shape to adjust the structure layer parameters of the target digitized image.
4. The image processing device as claimed in claim 3, wherein the processing end comprises a placement module,
the placing module is used for placing the target digital image and the initial image in an overlapping mode to obtain the distance from a control point on the target digital image to the initial image;
the processing module is further configured to acquire the control point with the largest distance as a target control point, and move the target control point by the distance towards the direction of the initial image;
the processing module is further used for moving the peripheral control points around the target control point to the direction of the initial image by a value transmission distance, the value transmission distance of each peripheral control point is inversely proportional to the distance from the peripheral control point to the target control point, and the value transmission distance is smaller than the moving distance of the target control point.
5. An image processing method based on a 3D camera, characterized in that the image processing method obtains a digitized image of a photographic subject by an image processing apparatus according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811008098.XA CN109218699B (en) | 2018-08-31 | 2018-08-31 | Image processing device and method based on 3D camera |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811008098.XA CN109218699B (en) | 2018-08-31 | 2018-08-31 | Image processing device and method based on 3D camera |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109218699A CN109218699A (en) | 2019-01-15 |
| CN109218699B true CN109218699B (en) | 2020-12-01 |
Family
ID=64985359
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811008098.XA Active CN109218699B (en) | 2018-08-31 | 2018-08-31 | Image processing device and method based on 3D camera |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109218699B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104966316A (en) * | 2015-05-22 | 2015-10-07 | 腾讯科技（深圳）有限公司 | 3D face reconstruction method, apparatus and server |
| CN106683068A (en) * | 2015-11-04 | 2017-05-17 | 北京文博远大数字技术有限公司 | Three-dimensional digital image acquisition method and equipment thereof |
| CN108305312A (en) * | 2017-01-23 | 2018-07-20 | 腾讯科技（深圳）有限公司 | The generation method and device of 3D virtual images |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010088840A1 (en) * | 2009-02-06 | 2010-08-12 | The Hong Kong University Of Science And Technology | Generating three-dimensional models from images |
-
2018
- 2018-08-31 CN CN201811008098.XA patent/CN109218699B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104966316A (en) * | 2015-05-22 | 2015-10-07 | 腾讯科技（深圳）有限公司 | 3D face reconstruction method, apparatus and server |
| CN106683068A (en) * | 2015-11-04 | 2017-05-17 | 北京文博远大数字技术有限公司 | Three-dimensional digital image acquisition method and equipment thereof |
| CN108305312A (en) * | 2017-01-23 | 2018-07-20 | 腾讯科技（深圳）有限公司 | The generation method and device of 3D virtual images |
Non-Patent Citations (1)
| Title |
|---|
| 三维人脸表情获取及重建技术综述;王珊等;《系统仿真学报》;20180731;第30卷(第7期);第2432页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109218699A (en) | 2019-01-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107959778B (en) | Imaging method and device based on dual camera | |
| US8208048B2 (en) | Method for high dynamic range imaging | |
| US8155478B2 (en) | Image creation with software controllable depth of field | |
| KR20130039676A (en) | Image-capturing device, image processing apparatus, image processing method, and method of manufacturing image-capturing device | |
| CN103997599A (en) | Image processing apparatus, image pickup apparatus, image processing method, and non-transitory computer-readable storage medium | |
| CN108347505B (en) | Mobile terminal with 3D imaging function and image generation method | |
| CN108600729B (en) | Dynamic 3D model generation device and image generation method | |
| JP5843454B2 (en) | Image processing apparatus, image processing method, and program | |
| CN103370943B (en) | Imaging device and formation method | |
| RU2565855C1 (en) | Image capturing device, method of controlling said device and programme | |
| CN103874960A (en) | Monocular stereoscopic imaging device, imaging method, and program | |
| CN108391116B (en) | Whole body scanning device and method based on 3D imaging technology | |
| US20220137555A1 (en) | System and method for lightfield capture | |
| CN108111835B (en) | Shooting device, system and method for 3D image imaging | |
| US20190222773A1 (en) | Image processing apparatus and image processing method | |
| CN110262167A (en) | Picture pick-up device | |
| CN108513122B (en) | Model adjusting method and model generating device based on 3D imaging technology | |
| CN108737808B (en) | 3D model generation device and method | |
| CN109218699B (en) | Image processing device and method based on 3D camera | |
| CN109151437B (en) | Whole body modeling device and method based on 3D camera | |
| CN109218703B (en) | Data processing device and method based on 3D camera | |
| CN110876050B (en) | Data processing device and method based on 3D camera | |
| US11792511B2 (en) | Camera system utilizing auxiliary image sensors | |
| CN109348208B (en) | Perception code acquisition device and method based on 3D camera | |
| CN108195308B (en) | 3D scanning device, system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20230718 Address after: 201703 Room 2134, Floor 2, No. 152 and 153, Lane 3938, Huqingping Road, Qingpu District, Shanghai Patentee after: Shanghai Qingyan Heshi Technology Co.,Ltd. Address before: 201703 No.206, building 1, no.3938 Huqingping Road, Qingpu District, Shanghai Patentee before: UNRE (SHANGHAI) INFORMATION TECHNOLOGY Co.,Ltd. |