CN104113747A - Image acquisition and pseudo 3D display system based on binocular vision - Google Patents

Image acquisition and pseudo 3D display system based on binocular vision Download PDF

Info

Publication number
CN104113747A
CN104113747A CN201410331431.6A CN201410331431A CN104113747A CN 104113747 A CN104113747 A CN 104113747A CN 201410331431 A CN201410331431 A CN 201410331431A CN 104113747 A CN104113747 A CN 104113747A
Authority
CN
China
Prior art keywords
image
pseudo
binocular
binocular vision
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201410331431.6A
Other languages
Chinese (zh)
Inventor
续拓
吴小炼
杨梅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201410331431.6A priority Critical patent/CN104113747A/en
Publication of CN104113747A publication Critical patent/CN104113747A/en
Pending legal-status Critical Current

Links

Landscapes

  • Processing Or Creating Images (AREA)

Abstract

The invention discloses an image acquisition and pseudo 3D display system based on binocular vision. The system is formed by a binocular vision image acquisition system, an image processing system, a pseudo 3D display system and a control system. The binocular vision image acquisition system collects binocular vision images at different angles through a binocular camera; the image processing system processes the binocular vision images through an image processing algorithm to obtain depth images; the pseudo 3D display system adjusts the obtained depth images and displays the images; and the control system controls the support supporting the binocular camera to carry out angle adjustment with the pseudo 3D display system. The beneficial effect is that the system is simple in structure.

Description

Image acquisition and pseudo-3D display system based on binocular vision
Technical Field
The invention belongs to the technical field of image processing, and relates to an image acquisition and pseudo-3D display system based on binocular vision.
Background
Currently, the research and application of multimedia systems primarily realize face-to-face discussion and cooperation among people across regions, but the following disadvantages still exist: (1) sense of space and reality: the multimedia system conference lacks real meeting place atmosphere in the process of carrying out the conference, and the participants in different meeting places have no spatial sense to the perception of the whole conference, can not construct real spatial environment, and the participants can not perceive the spatial distribution of other participants. (2) Information integrity: in the multimedia system, the participants cannot obtain the video and audio information of all the participants at the same time, and meanwhile, the multimedia system cannot express the perception information such as eye contact, gaze perception and the like among the participants. (3) Supporting strength of cooperative work: in practical application, by means of a virtual reality technology, a virtual environment or a simulation environment which can be commonly experienced by all participants is constructed, and communication and cooperation can be carried out more accurately. Multimedia systems currently lack such support.
In order to solve the defects and limitations of a multimedia system and meet the higher application requirements of the CSCW (computer-supported cooperative work), a Virtual Space conference (VST) is proposed along with the development of a Virtual reality technology. The method aims to research and realize a cooperation environment which can support people in different regions to solve complex problems through interaction and cooperation. The virtual space conference system is a typical collaborative virtual reality system, and is a novel virtual reality system developed on the basis of a multimedia conference system. However, the VST system at present has the following disadvantages: (1) the VST system is not perfect in processing the dynamic images, so that the dynamic images are not smooth enough in the expression process, the perception of people on the three-dimensional images is influenced, and the perception convenience of the VST system for people is weakened. (2) The VST system only realizes the spatial establishment of the three-dimensional image and does not realize the image operation of the established three-dimensional image. When the image processing is to be performed on the desired image, it must be done by operating on the computer virtual image. This adds complexity and complexity to the image processing. (3) The VST system is based on large-scene multi-angle space three-dimensional imaging, so that the detail processing of the system is not complete and the power consumption is large.
Disclosure of Invention
The invention aims to provide an image acquisition and pseudo-3D display system based on binocular vision, and solves the problem that the existing 3D display system is complex in structure.
The technical scheme adopted by the invention is composed of a binocular vision image acquisition system, an image processing system, a pseudo-3D display system and a control system; wherein,
the binocular vision image acquisition system acquires binocular vision images at different angles through a binocular camera;
the image processing system processes the binocular vision image through an image processing algorithm to obtain a depth image;
adjusting the obtained depth image by the pseudo-3D display system and displaying the depth image;
the control system controls the bracket supporting the binocular camera and the pseudo-3D display system to adjust the angle.
Further, the binocular vision image acquisition system comprises a plurality of binocular cameras, a spherical support, an objective table and a first shading plate; the image processing system comprises a computer and an analog-to-digital conversion module; the pseudo 3D display system comprises a projector, a pseudo 3D six-face display, an image display screen and a second light shielding plate; the control system comprises a first steering engine holder and a second steering engine holder;
wherein every two mesh cameras are all fixed on the spherical support, the objective table that every two mesh camera lenses aim at the inside centre of sphere setting of spherical support, the object is put and is shot by two mesh cameras on the objective table, the spherical support is installed on first steering wheel cloud platform, install first light screen around the spherical support, all two mesh cameras pass through signal line connection analog-to-digital conversion module, analog-to-digital conversion module passes through signal line connection computer, the projecting apparatus passes through signal line connection computer, image display screen is used for accepting the projection image, image display screen fixes in second light screen top, image display screen below is equipped with pseudo-3D six face display, pseudo-3D six face display is arranged in on the second steering wheel cloud platform, second steering wheel cloud platform is used for changing the angle of pseudo-3D six face display, thereby with the three-dimensional image adjustment position of demonstration.
Furthermore, the objective table is made of a transparent acrylic material, so that a camera can conveniently shoot pictures; the binocular camera is directly installed through a fastener.
Further, the image processing algorithm is composed of a binocular vision algorithm, an image splicing algorithm and an image processing algorithm; wherein, the binocular vision algorithm is as follows: the binocular camera is used for processing the images obtained by the binocular camera to obtain a depth three-dimensional image; and (3) image splicing algorithm: the method is used for splicing a plurality of depth images to obtain a complete 3D stereo image in a virtual space; and (3) an image processing algorithm: the method is used for performing image processing such as size conversion and cutting conversion on the obtained 3D stereo image.
The invention has the beneficial effect of simple structure.
Drawings
FIG. 1 is a binocular vision bracket of an image acquisition and pseudo-3D display system based on binocular vision according to the present invention;
FIG. 2 is a pseudo-3D six-panel display according to the present invention;
FIG. 3 illustrates a depth image output calculation step according to the present invention;
FIG. 4 is a flow of image stitching in image processing according to the present invention;
FIG. 5 is a flow chart of enhancing a pseudo-3D image according to the present invention.
In the figure, 1, a binocular camera, 2, a spherical support, 3, an objective table, 4, a first steering engine holder, 5, a first light screen, 6, a computer, 7, an analog-to-digital conversion module, 8, a projector, 9, a pseudo 3D hexahedral display, 10, an image display screen, 11, a second light screen and 12, a second steering engine holder.
Detailed Description
The present invention will be described in detail below with reference to the accompanying drawings and specific embodiments.
The system comprises a binocular camera, a computer connected with the binocular camera through a data line, and a projector for projecting images to a pseudo-3D pyramid after the images are processed by the computer to form pseudo-3D image display. The method is characterized in that: through binocular vision image acquisition and pseudo-3D space stereo image display, the three-dimensional characteristics of a space object can be truly restored. The invention has the advantages of simple structure, convenient realization, high imaging accuracy and real image. Therefore, the method is suitable for popularization and application.
The binocular vision image acquisition system comprises a plurality of binocular cameras 1, a spherical support 2, an objective table 3 and a first shading plate 5; the image processing system comprises a computer 6 and an analog-to-digital conversion module 7; the pseudo 3D display system comprises a projector 8, a pseudo 3D six-face display 9, an image display screen 10 and a second light shielding plate 11; the control system comprises a first steering engine cradle head 4 and a second steering engine cradle head 12;
as shown in fig. 1, each binocular camera 1 is fixed on a spherical support 2, a lens of each binocular camera 1 is aligned with an objective table 3 arranged at the center of a sphere inside the spherical support 2, an object is placed on the objective table 3 and is shot by the binocular camera 1, the spherical support 2 is installed on a first steering engine cloud deck 4 and can be controlled by the first steering engine cloud deck 4 to move, and therefore the angle of the binocular camera 1 aligned with the objective table 3 is adjusted. Install first light screen 5 around ball-shaped support 2, shelter from outside highlight and be favorable to shooing. When the binocular camera is used, a measured object exists at the objective table 3, and each binocular camera 1 on the spherical support 2 is started. And adjusting the first steering engine cloud deck 4 to enable the binocular camera 1 to acquire the image of the measured object from a proper angle.
The image processing system comprises a computer 6 and an analog-to-digital conversion module 7, all the binocular cameras 1 are connected with the analog-to-digital conversion module 7 through signal lines, the analog-to-digital conversion module 7 is connected with the computer 6 through signal lines, all-dimensional stereo images collected by the binocular cameras 1 are converted into digital signals through the analog-to-digital conversion module 7 and sent to the computer 6, and images collected by the binocular vision image collection system are processed through an image processing algorithm on the computer 6.
The image processing algorithm is composed of a binocular vision algorithm, an image splicing algorithm and an image processing algorithm. Wherein, the binocular vision algorithm is as follows: the binocular camera is used for processing the images obtained by the binocular camera to obtain a depth three-dimensional image; and (3) image splicing algorithm: the method is used for splicing a plurality of depth images to obtain a complete 3D stereo image in a virtual space; and (3) an image processing algorithm: the method is used for performing image processing such as size conversion and cutting conversion on the obtained 3D stereo image.
As shown in fig. 2, the pseudo 3D display system includes a projector 8, a pseudo 3D six-sided display 9, and an image display screen 10, the projector 8 is connected to the computer 6 through a signal line, the image display screen 10 is used for receiving a projected image, the image display screen 10 is fixed above a second light shielding plate 11, and the second light shielding plate 11 is used for shielding strong light from affecting the display of a stereoscopic image. A pseudo 3D six-face display 9 is arranged below the image display screen 10, the pseudo 3D six-face display 9 can be used for building a 3D image displayed by the image display screen 10 in a space of the pseudo 3D six-face display to form a pseudo holographic three-dimensional image, the pseudo 3D six-face display 9 is arranged on a second steering engine cradle head 12, and the second steering engine cradle head 12 is used for changing the angle of the pseudo 3D six-face display 9 so as to adjust the position of the displayed three-dimensional image;
wherein, objective table 3 adopts transparent ya keli material to make things convenient for the camera to shoot the picture, and two mesh cameras 1 are direct to be installed through the fastener.
The treatment process comprises the following steps: as shown in fig. 1, a depth image output step, extracting image edges from an image captured by a camera through Canny operator edge detection, optimizing a detected image, obtaining a preliminary matching corresponding point set through edge point precise matching, obtaining a matching corresponding point set through non-edge point window adaptive matching, capturing a calibration template, calibrating a plane by using a plane calibration method, calculating internal and external parameters of the camera, calculating projection matrixes M1 and M2 through the internal and external parameters, calculating a spatial three-dimensional point set through the corresponding point set and the projection matrixes, establishing a spatial coordinate display point set to obtain a depth image, obtaining real coordinates and spatial position coordinates of the depth image through a physical object, establishing virtual spatial coordinates, matching the depth image with the virtual spatial coordinates, as shown in fig. 2, extracting image mark points, splicing the images to obtain a virtual 3D image, displaying the image, as shown in fig. 3, strengthening the 3D image in the virtual space, dividing the virtual coordinate space, dividing the image, obtaining each pseudo 3D image, strengthening the image, combining the images to obtain a projection video group, obtaining a pseudo 3D stereo image by the projection image and the pseudo 3D pyramid, and adjusting the steering engine holder to obtain a proper observation image. Establishing virtual space coordinates, inputting data, establishing a space image in a virtual space, displaying an image, strengthening a 3D image in the virtual space, dividing the virtual coordinate space, dividing the image to obtain each pseudo 3D image, strengthening the image, combining the images to obtain a projection video set, obtaining a pseudo 3D stereoscopic image by the projection image and the pseudo 3D pyramid, and adjusting a steering engine pan-tilt to obtain a proper observation image.
The foregoing is considered as illustrative only of the preferred embodiments of the invention and is not to be construed as limiting thereof in any way, the invention being hereinafter described as illustrative only and not as limitative of the invention. Any simple modification, equivalent change and modification made to the above embodiments according to the technical spirit of the present invention are within the scope of the technical solution of the present invention.

Claims (4)

1. The utility model provides an image acquisition and pseudo-3D display system based on binocular vision which characterized in that: the binocular vision image acquisition system comprises a binocular vision image acquisition system, an image processing system, a pseudo-3D display system and a control system; wherein,
the binocular vision image acquisition system acquires binocular vision images at different angles through a binocular camera;
the image processing system processes the binocular vision image through an image processing algorithm to obtain a depth image;
adjusting the obtained depth image by the pseudo-3D display system and displaying the depth image;
the control system controls the bracket supporting the binocular camera and the pseudo-3D display system to adjust the angle.
2. The binocular vision based image acquisition and pseudo-3D display system of claim 1, wherein: the binocular vision image acquisition system comprises a plurality of binocular cameras (1), a spherical support (2), an objective table (3) and a first shading plate (5); the image processing system comprises a computer (6) and an analog-to-digital conversion module (7); the pseudo-3D display system comprises a projector (8), a pseudo-3D six-face display (9), an image display screen (10) and a second light shielding plate (11); the control system comprises a first steering engine cloud platform (4) and a second steering engine cloud platform (12);
wherein each binocular camera (1) is fixed on a spherical support (2), the lens of each binocular camera (1) is aligned to an objective table (3) arranged at the center of the sphere inside the spherical support (2), an object is placed on the objective table (3) and is shot by the binocular cameras (1), the spherical support (2) is installed on a first steering engine pan-tilt (4), a first light screen (5) is installed around the spherical support (2), all the binocular cameras (1) are connected with an analog-digital conversion module (7) through signal lines, the analog-digital conversion module (7) is connected with a computer (6) through signal lines, a projector (8) is connected with the computer (6) through signal lines, an image display screen (10) is used for receiving a projection image, the image display screen (10) is fixed above a second light screen (11), a pseudo 3D hexahedral display (9) is arranged below the image display screen (10), the pseudo 3D six-face display (9) is arranged on a second steering engine cloud platform (12), and the second steering engine cloud platform (12) is used for changing the angle of the pseudo 3D six-face display (9), so that the position of a displayed three-dimensional image is adjusted.
3. The binocular vision based image acquisition and pseudo-3D display system of claim 1, wherein: the objective table (3) is made of a transparent acrylic material, so that a camera can shoot pictures conveniently; the binocular camera (1) is directly installed through a fastener.
4. The binocular vision based image acquisition and pseudo-3D display system of claim 1, wherein: the image processing algorithm consists of a binocular vision algorithm, an image splicing algorithm and an image processing algorithm; wherein, the binocular vision algorithm is as follows: the binocular camera is used for processing the images obtained by the binocular camera to obtain a depth three-dimensional image; and (3) image splicing algorithm: the method is used for splicing a plurality of depth images to obtain a complete 3D stereo image in a virtual space; and (3) an image processing algorithm: the method is used for performing image processing such as size conversion and cutting conversion on the obtained 3D stereo image.
CN201410331431.6A 2014-07-14 2014-07-14 Image acquisition and pseudo 3D display system based on binocular vision Pending CN104113747A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410331431.6A CN104113747A (en) 2014-07-14 2014-07-14 Image acquisition and pseudo 3D display system based on binocular vision

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410331431.6A CN104113747A (en) 2014-07-14 2014-07-14 Image acquisition and pseudo 3D display system based on binocular vision

Publications (1)

Publication Number Publication Date
CN104113747A true CN104113747A (en) 2014-10-22

Family

ID=51710366

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410331431.6A Pending CN104113747A (en) 2014-07-14 2014-07-14 Image acquisition and pseudo 3D display system based on binocular vision

Country Status (1)

Country Link
CN (1) CN104113747A (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104360488A (en) * 2014-11-14 2015-02-18 山东理工大学 Compact three-dimensional display system and display method thereof
CN104994370A (en) * 2015-06-30 2015-10-21 中国科学院自动化研究所 3D (three-dimensional) video image acquisition system
CN105869160A (en) * 2016-03-28 2016-08-17 武汉理工大学 Method and system for implementing 3D modeling and holographic display by using Kinect
CN106483814A (en) * 2016-12-26 2017-03-08 岭南师范学院 A kind of 3D holographic projection system based on augmented reality and its using method
CN106791785A (en) * 2016-12-29 2017-05-31 宇龙计算机通信科技(深圳)有限公司 A kind of camera head and mobile terminal
CN109363352A (en) * 2018-12-21 2019-02-22 四川变体科技有限公司 A kind of artificial intelligence dais
CN111541887A (en) * 2020-05-21 2020-08-14 北京航空航天大学 Naked eye 3D visual camouflage system

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201352301Y (en) * 2009-01-14 2009-11-25 东莞市环宇激光工程有限公司 Holographic projection device
CN101790105A (en) * 2010-03-22 2010-07-28 上海复翔信息科技有限公司 Holographic interaction system and construction method thereof
CN201562078U (en) * 2009-07-21 2010-08-25 藤萝科技股份有限公司 Imaging device for stereoscopic image
CN101853621A (en) * 2010-02-05 2010-10-06 北京水晶石数字科技有限公司 Octahedron phantom imaging system
CN202159185U (en) * 2011-07-13 2012-03-07 上海源珅多媒体有限公司 360-degree holographic imaging cabinet
CN102692808A (en) * 2012-05-09 2012-09-26 南京航空航天大学 Large-scene 360-degree panorama dynamic display method, and display system
CN202854479U (en) * 2012-08-09 2013-04-03 陈滟滪 Holographic image display device
CN202844541U (en) * 2012-08-09 2013-04-03 陈滟滪 Holographic displayed video game device
CN203102803U (en) * 2012-11-14 2013-07-31 中国电力科学研究院 Portable three-dimensional (3D) holographic visual display device for electric product
CN203405634U (en) * 2013-07-25 2014-01-22 苏州中加医疗科技有限公司 A holographic display screen

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201352301Y (en) * 2009-01-14 2009-11-25 东莞市环宇激光工程有限公司 Holographic projection device
CN201562078U (en) * 2009-07-21 2010-08-25 藤萝科技股份有限公司 Imaging device for stereoscopic image
CN101853621A (en) * 2010-02-05 2010-10-06 北京水晶石数字科技有限公司 Octahedron phantom imaging system
CN101790105A (en) * 2010-03-22 2010-07-28 上海复翔信息科技有限公司 Holographic interaction system and construction method thereof
CN202159185U (en) * 2011-07-13 2012-03-07 上海源珅多媒体有限公司 360-degree holographic imaging cabinet
CN102692808A (en) * 2012-05-09 2012-09-26 南京航空航天大学 Large-scene 360-degree panorama dynamic display method, and display system
CN202854479U (en) * 2012-08-09 2013-04-03 陈滟滪 Holographic image display device
CN202844541U (en) * 2012-08-09 2013-04-03 陈滟滪 Holographic displayed video game device
CN203102803U (en) * 2012-11-14 2013-07-31 中国电力科学研究院 Portable three-dimensional (3D) holographic visual display device for electric product
CN203405634U (en) * 2013-07-25 2014-01-22 苏州中加医疗科技有限公司 A holographic display screen

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104360488A (en) * 2014-11-14 2015-02-18 山东理工大学 Compact three-dimensional display system and display method thereof
CN104994370A (en) * 2015-06-30 2015-10-21 中国科学院自动化研究所 3D (three-dimensional) video image acquisition system
CN105869160A (en) * 2016-03-28 2016-08-17 武汉理工大学 Method and system for implementing 3D modeling and holographic display by using Kinect
CN105869160B (en) * 2016-03-28 2019-11-26 武汉理工大学 The method and system of three-dimensional modeling and holographic display are realized using Kinect
CN106483814A (en) * 2016-12-26 2017-03-08 岭南师范学院 A kind of 3D holographic projection system based on augmented reality and its using method
CN106791785A (en) * 2016-12-29 2017-05-31 宇龙计算机通信科技(深圳)有限公司 A kind of camera head and mobile terminal
CN109363352A (en) * 2018-12-21 2019-02-22 四川变体科技有限公司 A kind of artificial intelligence dais
CN111541887A (en) * 2020-05-21 2020-08-14 北京航空航天大学 Naked eye 3D visual camouflage system
CN111541887B (en) * 2020-05-21 2021-05-07 北京航空航天大学 Naked eye 3D visual camouflage system

Similar Documents

Publication Publication Date Title
CN104113747A (en) Image acquisition and pseudo 3D display system based on binocular vision
CN102510474B (en) 360-degree panorama monitoring system
DE112016004216T5 (en) General Spherical Observation Techniques
CN104050859A (en) Interactive digital stereoscopic sand table system
CN108399634B (en) RGB-D data generation method and device based on cloud computing
CN102984453A (en) Method and system of real-time generating hemisphere panoramic video images through single camera
CN206563985U (en) 3-D imaging system
CN105635551A (en) Method of dome camera for generating panoramic image, and dome camera
CN107358577B (en) Rapid splicing method of cubic panoramic image
CN105301887A (en) 3D panoramic camera system
CN102572486A (en) Acquisition system and method for stereoscopic video
CN104506761A (en) 360-degree panoramic stereoscopic camera
CN103065359A (en) Optical imaging three-dimensional contour reconstruction system and reconstruction method
CN106357966A (en) Panoramic image photographing device and panoramic image acquiring method
CN105809729B (en) A kind of spherical panorama rendering method of virtual scene
WO2020151268A1 (en) Generation method for 3d asteroid dynamic map and portable terminal
CN104599317A (en) Mobile terminal and method for achieving 3D (three-dimensional) scanning modeling function
CN104427230A (en) Reality enhancement method and reality enhancement system
CN109788270B (en) 3D-360-degree panoramic image generation method and device
CN107977998B (en) Light field correction splicing device and method based on multi-view sampling
CN102595178A (en) Field-butting three-dimensional display image correction system and method
CN111083368A (en) Simulation physics cloud platform panoramic video display system based on high in clouds
CN107197135A (en) A kind of video generation method, player method and video-generating device, playing device
GB2565301A (en) Three-dimensional video processing
CN205176477U (en) 3D looks around imaging system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
DD01 Delivery of document by public notice

Addressee: Xu Tuo

Document name: Notification that Application Deemed to be Withdrawn

WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20141022

WD01 Invention patent application deemed withdrawn after publication