CN107516339B - Information processing method and information processing device - Google Patents
Information processing method and information processing device Download PDFInfo
- Publication number
- CN107516339B CN107516339B CN201710743813.3A CN201710743813A CN107516339B CN 107516339 B CN107516339 B CN 107516339B CN 201710743813 A CN201710743813 A CN 201710743813A CN 107516339 B CN107516339 B CN 107516339B
- Authority
- CN
- China
- Prior art keywords
- image
- obtaining
- information
- target object
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/10—Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
Abstract
The invention provides an information processing method and an information processing device, wherein the method is applied to electronic equipment and comprises the following steps: acquiring a first image of a target object, and obtaining a second image corresponding to the first image; constructing three-dimensional image information based on the second image; obtaining a first target area based on the three-dimensional image information, wherein the first target area is a part of the three-dimensional image; a first operation is performed on the first target area. After a first image (a color image) and a second image (point cloud information) of a target object are acquired through an acquisition module in the electronic equipment, the target object can be identified, and three-dimensional image information of the target object can be constructed based on the second image and further applied.
Description
Technical Field
The present invention relates to the field of electronic technologies, and in particular, to an information processing method and an information processing apparatus.
Background
With the development of science and technology, electronic technology has also been developed rapidly, and the variety of electronic products is more and more, and people also enjoy various conveniences brought by the development of science and technology. People can enjoy comfortable life brought along with the development of science and technology through various types of electronic equipment.
In the prior art, electronic devices for image capturing have been widely used, such as color cameras and depth cameras, and meanwhile, the electronic devices with a tango system are used to acquire point cloud image data of an object for object recognition. However, these point cloud data are not fully utilized, for example, the user is intelligently prompted to keep the camera and the object parallel.
Disclosure of Invention
In order to solve the above problem, the present invention provides an information processing method applied to an electronic device, the method including:
acquiring a first image of a target object, and obtaining a second image corresponding to the first image;
constructing three-dimensional image information based on the second image;
obtaining a first target area based on the three-dimensional image information, wherein the first target area is a part of the three-dimensional image;
and carrying out a first operation on the first target area.
Preferably, the first operation is performed on the first target area, specifically:
acquiring a third image corresponding to the first target area, wherein the third image is a part of the second image;
and performing a second operation on the third image to generate a first file.
Preferably, the electronic device further includes an image processing module, and the method further includes:
and performing a third operation on the first file through the image processing module.
Preferably, the first operation is performed on the first target area, specifically:
obtaining the relative position of the acquisition module and the target object;
and obtaining a deviation value of the acquisition module and the target object based on the relative position.
Preferably, the method further comprises:
and acquiring prompt information based on the deviation value, and prompting the prompt information to a user of the electronic equipment.
The present invention also provides an information processing apparatus including:
the system comprises an acquisition module, a display module and a processing module, wherein the acquisition module is used for acquiring a first image of a target object and obtaining a second image corresponding to the first image;
a generating module for constructing three-dimensional image information based on the second image;
an obtaining module, configured to obtain a first target region based on the three-dimensional image information, where the first target region is a part of the three-dimensional image;
and the operation module is used for carrying out first operation on the first target area.
Preferably, the apparatus further comprises:
a first obtaining sub-module, configured to obtain a third image corresponding to the first target region, where the third image is a part of the second image;
the first operation submodule is used for carrying out second operation on the third image;
and the first generation submodule is used for generating a first file based on the second operation.
Preferably, the apparatus further comprises:
an image processing module;
and the second operation sub-module is used for performing third operation on the first file through the image processing module.
Preferably, the apparatus further comprises:
the second obtaining submodule is used for obtaining the relative position of the acquisition module and the target object;
and the third obtaining submodule is used for obtaining a deviation value of the acquisition module and the target object based on the relative position.
Preferably, the apparatus further comprises:
the fourth obtaining submodule is used for obtaining prompt information based on the deviation value;
and the first prompting submodule is used for prompting the prompting information to a user of the device.
Compared with the prior art, the invention has the beneficial effects that: after a first image (a color image) and a second image (point cloud information) of a target object are acquired through an acquisition module in the electronic equipment, the target object can be identified, and three-dimensional image information of the target object can be constructed based on the second image and further applied.
Drawings
FIG. 1 is a flow chart of an information processing method according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of an information processing apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the present invention will be described in detail below with reference to the accompanying drawings and specific embodiments.
The invention provides an information processing method, which is applied to electronic equipment and comprises the following steps: acquiring a first image of a target object, and obtaining a second image corresponding to the first image; constructing three-dimensional image information based on the second image; obtaining a first target area based on the three-dimensional image information, wherein the first target area is a part of the three-dimensional image; and carrying out a first operation on the first target area.
After a first image (a color image) and a second image (point cloud information) of a target object are acquired through an acquisition module in the electronic equipment, the target object can be identified, and three-dimensional image information of the target object can be constructed based on the second image and further applied.
The technical solution of the present invention is explained in detail by the accompanying drawings and the specific embodiments.
Fig. 1 is a flowchart illustrating an information processing method according to an embodiment of the present invention, where the method is applied to an electronic device, and includes the following specific steps:
step 101, acquiring a first image of a target object, and obtaining a second image corresponding to the first image.
Specifically, in step 101, the target object is actually an object that can be captured as an image, and may be a specific actually existing object, or may be an image virtually generated by imaging software or the like, as long as the image can be captured. Accordingly, the first image is actually a color (RGB) image of the target object, which may be obtained by an acquisition module 201 on the electronic device, wherein the acquisition module 201 may comprise a color camera or the like.
And obtaining a second image corresponding to the first image, and actually obtaining point cloud information corresponding to the color image of the target object when the color image of the target object is obtained through the color camera, wherein the point cloud represents a conversion set of depth information between the surface of the shot target and the shooting equipment, the obtained point cloud information of the target object also has a color corresponding to the color image, the point cloud information of the target object can be obtained through a depth camera and the like, and each frame of the two image information realizes high time sequence synchronization by utilizing a tango technology.
For example, the target object may be a statue, and the electronic device may have a Tango system mounted thereon, wherein a first image of the statue, i.e., a color image of the statue, is captured by a color camera on the electronic device, and wherein a second image of the statue corresponding to the first image, i.e., point cloud information corresponding to the color image of the statue, is captured by a depth camera, wherein the point cloud information is a collection of points on an apparent surface of the statue. (Point cloud representing a set of transformations of depth information between the surface of the object being photographed and the photographing apparatus)
After the point cloud information with color of the target object is obtained in the step 101, the step 102 is executed.
And 102, constructing three-dimensional image information based on the second image.
Specifically, three-dimensional image information of the target object is constructed by the generation module 202 according to the point cloud information of the target object having colors, that is, the target object is rendered in a three-dimensional stereoscopic manner.
Also taking the target object as the statue for example, according to the point cloud information corresponding to the color image of the statue, a three-dimensional image of the statue is constructed by the generation module 202 on the electronic device, i.e. the statue is presented in a three-dimensional manner, and the three-dimensional image of the statue also has a color corresponding to the color image thereof.
Step 103, obtaining a first target area based on the three-dimensional image information, wherein the first target area is a part of the three-dimensional image.
Specifically, the obtained first target area may be any partial area in the three-dimensional image information of the target object, and may be selected according to actual use requirements, so as to facilitate the next operation on the target area.
Or by taking the target object as a statue, the user can select any part of the statue in the three-dimensional image of the statue according to the actual use requirement of the user to prepare for the next operation of the user.
And 104, performing a first operation on the first target area.
Specifically, the first operation may be to perform corresponding processing on the first target region, or may be to acquire data related to the first target region and then perform a further operation based on the acquired data.
Or taking the target object as the statue for example, and the statue is a human statue, the first target area obtained by the method is the head of the human statue, in the actual operation process, the head of the obtained human statue can be correspondingly processed, for example, the head of the human statue is magnified and rotated by multiple angles for viewing, or the head related data of the human statue can be obtained, for example, the relative position relationship (angle, distance, etc.) of the head of the human statue with respect to the camera on the electronic device.
In an optional embodiment, the performing the first operation on the first target area in step 104 may be: acquiring a third image corresponding to the first target area, wherein the third image is a part of the second image; the third image is point cloud information with color corresponding to the first target area in the three-dimensional image information of the selected target object, namely a part of the point cloud information with color of the target object.
Then, a second operation is performed on the third image to generate a first file, which is actually a second operation performed on the portion of the point cloud information with color of the acquired target object, and the second operation is actually to save the third image in a preset format, and generate the first file, where the preset format may be an exif format.
Or the target object is taken as a statue, and the statue is a human statue, the first target area acquired of which is the head of the human statue. The method includes the steps of obtaining a third image corresponding to the head of the character statue, namely point cloud information with colors of the head of the character statue, storing the point cloud information in an exif format, and generating a first file in the exif format.
Furthermore, the electronic device further comprises an image processing module, and the electronic device performs a third operation on the first file through the image processing module. The image processing module may perform corresponding image processing on the first file generated by saving the third image in the preset format, and certainly, in the actual operation process, the image processing module may also be disposed on another device, and after the electronic device saves the third image in the preset format and generates the first file, the first file may be transmitted, so that the third operation may be performed on the first file through another device. Specifically, the first file actually generates point cloud information having color of the first target area on the target object, that is, three-dimensional image information of the first target area, and accordingly, the third operation may be a multi-angle showing, background blurring, enlarging, reducing, and the like of the three-dimensional image information of the first target area.
Further, for example, when the target object is a statue, the electronic device performs operations such as multi-angle display, background blurring, enlargement, reduction, and the like on the head portrait of the character statue having color information in the first file in the exif format through a graphical program interface such as opengl (opengraphics library).
In another alternative embodiment, the first operation is performed on the first target region, which may be to obtain a relative position between the acquisition module 201 and the target object; and based on the relative position, obtaining a deviation value between the acquisition module 201 and the target object. Wherein the relative position includes a relative angular relationship between the position of the acquisition module 201 and the position of the target object. When the position of the acquisition module 201 is not relatively horizontal to the position of the target object, the electronic device obtains an angle value of a deviation between the position of the acquisition module 201 and the position of the target object.
Again taking the target object as a statue and the statue as a human statue as an example, the first target area acquired is the head of the human statue. Firstly, the electronic device first obtains an angle formed by the acquisition module 201 on the electronic device and a horizontal plane, then, the electronic device obtains an angle formed by the head of the figure statue relative to the horizontal plane, the angle formed by the acquisition module 201 and the horizontal plane is compared with the angle formed by the head of the figure statue relative to the horizontal plane, so as to obtain a relative deviation angle between the acquisition module 201 and the head of the figure statue, when the deviation angle is zero, the head of the figure statue can be displayed in the acquisition module 201 in an optimal mode, and when the deviation angle is not zero, the head of the figure statue can have certain deviation in imaging in the acquisition module 201.
Further, based on the deviation value, a prompt message is obtained, and the prompt message is prompted to a user of the electronic equipment. The prompt message indicates how the user reduces the deviation between the collection module 201 and the first target area.
Again taking the target object as a statue and the statue as a human statue as an example, the first target area acquired is the head of the human statue. After the electronic device obtains the angle formed by the acquisition module 201 on the electronic device and the angle formed by the head of the character representation relative to the horizontal plane, it can calculate the relative deviation angle between the acquisition module 201 and the head of the character representation, and further generate corresponding prompt information to prompt the user using the electronic device, for example, a prompt of "please tilt 5 degrees downwards", etc.
Based on the same concept as one of the information processing methods described above, the present invention also provides an information processing apparatus, as shown in fig. 2, including:
the acquisition module 201 is configured to acquire a first image of a target object and obtain a second image corresponding to the first image;
a generating module 202, configured to construct three-dimensional image information based on the second image;
an obtaining module 203, configured to obtain a first target region based on the three-dimensional image information, where the first target region is a part of the three-dimensional image;
an operation module 204, configured to perform a first operation on the first target area.
Preferably, the apparatus further comprises:
a first obtaining sub-module, configured to obtain a third image corresponding to the first target region, where the third image is a part of the second image;
the first operation submodule is used for carrying out second operation on the third image;
and the first generation submodule is used for generating a first file based on the second operation.
After a first image (a color image) and a second image (point cloud information) of a target object are acquired through an acquisition module in the electronic equipment, the target object can be identified, and three-dimensional image information of the target object can be constructed based on the second image and further applied.
Preferably, the apparatus further comprises:
an image processing module;
and the second operation sub-module is used for performing third operation on the first file through the image processing module.
Preferably, the apparatus further comprises:
a second obtaining sub-module, configured to obtain a relative position between the acquisition module 201 and the target object;
and a third obtaining sub-module, configured to obtain, based on the relative position, a deviation value between the acquisition module 201 and the target object.
Preferably, the apparatus further comprises:
the fourth obtaining submodule is used for obtaining prompt information based on the deviation value;
and the first prompting submodule is used for prompting the prompting information to a user of the device.
The above embodiments are only exemplary embodiments of the present invention, and are not intended to limit the present invention, and the scope of the present invention is defined by the claims. Various modifications and equivalents may be made by those skilled in the art within the spirit and scope of the present invention, and such modifications and equivalents should also be considered as falling within the scope of the present invention.
Claims (8)
1. An information processing method applied to an electronic device, the method comprising:
acquiring a first image of a target object, and obtaining a second image corresponding to the first image;
constructing three-dimensional image information based on the second image;
obtaining a first target area based on the three-dimensional image information, wherein the first target area is a part of the three-dimensional image and can be selected according to actual use requirements;
performing a first operation on the first target area, comprising:
obtaining the relative position of the acquisition module and the target object;
and obtaining a deviation value of the acquisition module and the target object based on the relative position.
2. The information processing method according to claim 1, wherein performing a first operation on the first target area specifically includes:
acquiring a third image corresponding to the first target area, wherein the third image is a part of the second image;
and performing a second operation on the third image to generate a first file.
3. An information processing method according to claim 2, said electronic device further comprising an image processing module, said method further comprising:
and performing a third operation on the first file through the image processing module.
4. An information processing method according to claim 1, said method further comprising:
and acquiring prompt information based on the deviation value, and prompting the prompt information to a user of the electronic equipment.
5. An information processing apparatus, the information processing apparatus comprising:
the system comprises an acquisition module, a display module and a processing module, wherein the acquisition module is used for acquiring a first image of a target object and obtaining a second image corresponding to the first image;
a generating module for constructing three-dimensional image information based on the second image;
the acquisition module is used for acquiring a first target area based on the three-dimensional image information, wherein the first target area is a part of the three-dimensional image and can be selected according to actual use requirements;
the operation module is used for carrying out first operation on the first target area;
the device further comprises:
the second obtaining submodule is used for obtaining the relative position of the acquisition module and the target object;
and the third obtaining submodule is used for obtaining a deviation value of the acquisition module and the target object based on the relative position.
6. An information processing apparatus according to claim 5, said apparatus further comprising:
a first obtaining sub-module, configured to obtain a third image corresponding to the first target region, where the third image is a part of the second image;
the first operation submodule is used for carrying out second operation on the third image;
and the first generation submodule is used for generating a first file based on the second operation.
7. An information processing apparatus according to claim 6, said apparatus further comprising:
an image processing module;
and the second operation sub-module is used for performing third operation on the first file through the image processing module.
8. An information processing apparatus according to claim 5, said apparatus further comprising:
the fourth obtaining submodule is used for obtaining prompt information based on the deviation value;
and the first prompting submodule is used for prompting the prompting information to a user of the device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710743813.3A CN107516339B (en) | 2017-08-25 | 2017-08-25 | Information processing method and information processing device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710743813.3A CN107516339B (en) | 2017-08-25 | 2017-08-25 | Information processing method and information processing device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107516339A CN107516339A (en) | 2017-12-26 |
| CN107516339B true CN107516339B (en) | 2020-06-23 |
Family
ID=60724331
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710743813.3A Active CN107516339B (en) | 2017-08-25 | 2017-08-25 | Information processing method and information processing device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107516339B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104658031A (en) * | 2015-03-06 | 2015-05-27 | 新维畅想数字科技（北京）有限公司 | Device and method for rendering three-dimensional image by directly using depth data |
| CN105678842A (en) * | 2016-01-11 | 2016-06-15 | 湖南拓视觉信息技术有限公司 | Manufacturing method and device for three-dimensional map of indoor environment |
| CN106296801A (en) * | 2015-06-12 | 2017-01-04 | 联想(北京)有限公司 | A kind of method setting up object three-dimensional image model and electronic equipment |
| CN106446515A (en) * | 2016-08-31 | 2017-02-22 | 上海联影医疗科技有限公司 | Three-dimensional medical image display method and apparatus |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4804256B2 (en) * | 2006-07-27 | 2011-11-02 | キヤノン株式会社 | Information processing method |
-
2017
- 2017-08-25 CN CN201710743813.3A patent/CN107516339B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104658031A (en) * | 2015-03-06 | 2015-05-27 | 新维畅想数字科技（北京）有限公司 | Device and method for rendering three-dimensional image by directly using depth data |
| CN106296801A (en) * | 2015-06-12 | 2017-01-04 | 联想(北京)有限公司 | A kind of method setting up object three-dimensional image model and electronic equipment |
| CN105678842A (en) * | 2016-01-11 | 2016-06-15 | 湖南拓视觉信息技术有限公司 | Manufacturing method and device for three-dimensional map of indoor environment |
| CN106446515A (en) * | 2016-08-31 | 2017-02-22 | 上海联影医疗科技有限公司 | Three-dimensional medical image display method and apparatus |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107516339A (en) | 2017-12-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106934777B (en) | Scanning image acquisition method and device | |
| JP6330036B2 (en) | Image processing apparatus and image display apparatus | |
| JP4010754B2 (en) | Image processing apparatus, image processing method, and computer-readable recording medium | |
| JP5886242B2 (en) | Image processing apparatus, image processing method, and image processing program | |
| CN105407280B (en) | Panoramic image synthesis method and system | |
| US20170301110A1 (en) | Producing three-dimensional representation based on images of an object | |
| US9613404B2 (en) | Image processing method, image processing apparatus and electronic device | |
| JP6755787B2 (en) | Image processing equipment, image processing methods and programs | |
| WO2017067262A1 (en) | Image processing method and apparatus | |
| WO2018113339A1 (en) | Projection image construction method and device | |
| CN104867113A (en) | Method and system for perspective distortion correction of image | |
| CN111654624B (en) | Shooting prompting method and device and electronic equipment | |
| CN114529606A (en) | Pose detection method and device, electronic equipment and storage medium | |
| CN107203961B (en) | Expression migration method and electronic equipment | |
| CN105279785B (en) | Method and device for three-dimensional modeling of exhibition stand | |
| CN107516339B (en) | Information processing method and information processing device | |
| CN105320506B (en) | A kind of method and device obtaining image | |
| JP6317611B2 (en) | Display display pattern generating apparatus and program thereof | |
| CN114390206A (en) | Shooting method and device and electronic equipment | |
| CN114241127A (en) | Panoramic image generation method and device, electronic equipment and medium | |
| CN114007056A (en) | Method and device for generating three-dimensional panoramic image | |
| CN107087114B (en) | Shooting method and device | |
| CN107534736A (en) | Method for registering images, device and the terminal of terminal | |
| JP6614500B2 (en) | Image reading apparatus, portable terminal, image reading method, and image reading program | |
| JP6067040B2 (en) | Information processing apparatus, information processing method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |