CN111260563A - Video acquisition and transmission system based on orthographic technology - Google Patents
Video acquisition and transmission system based on orthographic technology Download PDFInfo
- Publication number
- CN111260563A CN111260563A CN202010178816.9A CN202010178816A CN111260563A CN 111260563 A CN111260563 A CN 111260563A CN 202010178816 A CN202010178816 A CN 202010178816A CN 111260563 A CN111260563 A CN 111260563A
- Authority
- CN
- China
- Prior art keywords
- image
- module
- ortho
- orthoimage
- transmission system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 38
- 238000005516 engineering process Methods 0.000 title claims abstract description 19
- 238000012545 processing Methods 0.000 claims abstract description 30
- 238000003709 image segmentation Methods 0.000 claims abstract description 16
- 238000004891 communication Methods 0.000 claims description 7
- 230000008030 elimination Effects 0.000 claims description 4
- 238000003379 elimination reaction Methods 0.000 claims description 4
- 238000000034 method Methods 0.000 description 3
- 230000007547 defect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformation in the plane of the image
- G06T3/40—Scaling the whole image or part thereof
- G06T3/4038—Scaling the whole image or part thereof for image mosaicing, i.e. plane images composed of plane sub-images
-
- G06T5/94—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/12—Edge-based segmentation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20021—Dividing image into blocks, subimages or windows
Abstract
The video acquisition and transmission system based on the orthographic technology comprises an image acquisition end, an image processing end and a calling database, wherein the image acquisition end is connected with the image processing end, and the image processing end is connected with the calling database; the image processing end comprises an image segmentation module, an image comparison selection module, an image splicing module and a transmission module, the image segmentation module divides a first orthoimage collected by the image collection end to be partitioned into image blocks, the image comparison selection module compares the image blocks of the same collected position to select the image block shot by the image collection end right above the position, the image splicing module splices all the image blocks selected by the image comparison selection module to obtain a second orthoimage, and the transmission module sends the first orthoimage and the second orthoimage to the retrieval database to be stored.
Description
Technical Field
The invention relates to the technical field of video acquisition and transmission, in particular to a video acquisition and transmission system based on an orthographic technology.
Background
In recent years, unmanned aerial vehicles have been widely used in the fields of surveying and mapping, exploration, emergency, disaster relief and the like due to the characteristics of high efficiency, flexibility, low cost and the like. The cost investment of the traditional aerial photogrammetry technology is greatly reduced by the aerial photogrammetry technology of the unmanned aerial vehicle, so that the aerial photogrammetry technology is from the noble to the civilian, and the unmanned aerial vehicle aerial photogrammetry technology has more common practical significance and application value.
On the other hand, the conventional implementation method for processing the unmanned aerial vehicle image is to transmit the unmanned aerial vehicle aerial image to a computer or a server through a USB interface for post-processing after the aerial photography flight task is completed, and the building in the obtained image is blocked obliquely to different degrees, so that emergency events in the fields of rescue and disaster relief, emergency handling, monitoring and investigation and the like cannot be processed accurately in time.
Therefore, the problems of the prior art are to be further improved and developed.
Disclosure of Invention
The object of the invention is: in order to solve the problems in the prior art, the present invention provides a video capture and transmission system based on an orthographic technology.
The technical scheme is as follows: in order to solve the technical problem, the technical scheme provides a video acquisition and transmission system based on an ortho-technology, which comprises an image acquisition end, an image processing end and a calling database, wherein the image acquisition end is used for acquiring a first ortho-image, the image processing end carries out compensation elimination on the acquired first ortho-image at different positions, and the calling database is used for storing a second ortho-image after compensation elimination;
the image processing end comprises an image segmentation module, an image comparison selection module, an image splicing module and a transmission module, the image segmentation module divides a first orthoimage collected by the image collection end to be partitioned into image blocks, the image comparison selection module compares the image blocks of the same collected position to select the image block shot by the image collection end right above the position, the image splicing module splices all the image blocks selected by the image comparison selection module to obtain a second orthoimage, and the transmission module sends the first orthoimage and the second orthoimage to the retrieval database to be stored.
The key point is that the image acquisition end comprises a walking device, a shooting device, a positioning device and a transmission device,
the walking device is used for changing the shooting position in real time, the shooting device is used for collecting a first orthoimage, and the shooting device is fixed on the surface of the walking device;
the positioning device is used for positioning the shooting position in real time and is arranged on the walking device;
the transmission device transmits the first orthoimage collected by the shooting device and the shooting position positioned by the positioning device to the image processing end in real time.
The key point is that the image splicing module marks the image block shooting position selected by the image comparison selection module on the corresponding image block.
The key point is that the image processing end further comprises a storage module, and the storage module is used for storing the image blocks of the first orthoimage.
The key point is that the calling database comprises a storage unit and a communication unit, the storage unit is used for storing the second orthoimage, and the communication unit is used for receiving the second orthoimage sent by the image processing terminal and sending the stored second orthoimage to the reading client.
The key point is that the system further comprises a reading client side, wherein the reading client side is used for sending a calling command to the calling database, receiving the called second orthoimage and displaying the called second orthoimage.
The key point is that the reading client can be a smart phone, an ipad and a PC terminal.
(III) the beneficial effects are as follows: the invention provides a video acquisition and transmission system based on an ortho-technology, which is used for dividing an acquired video into blocks and then selecting an ortho-image of each block for splicing, so that the ortho-image can be quickly acquired, and the excessive network traffic use cost caused by the transmission of a plurality of images is avoided.
Drawings
Fig. 1 is a schematic diagram of the connection relationship of the video acquisition and transmission system based on the orthographic technology.
Detailed Description
The present invention will be described in further detail with reference to preferred embodiments, and more details are set forth in the following description in order to provide a thorough understanding of the present invention, but it is apparent that the present invention can be embodied in many other forms different from the description herein and can be similarly generalized and deduced by those skilled in the art based on the practical application without departing from the spirit of the present invention, and therefore, the scope of the present invention should not be limited by the contents of this detailed embodiment.
The drawings are schematic representations of embodiments of the invention, and it is noted that the drawings are intended only as examples and are not drawn to scale and should not be construed as limiting the true scope of the invention.
A video acquisition and transmission system based on an orthographic technology is shown in figure 1 and comprises an image acquisition end, an image processing end and a calling database, wherein the image acquisition end is connected with the image processing end, and the image processing end is connected with the calling database.
The image acquisition end is used for acquiring a first orthoimage, the image processing end compensates and eliminates the acquired first orthoimage at different positions, and the calling database is used for storing a compensated and eliminated second orthoimage.
The image acquisition end comprises a walking device, a shooting device, a positioning device and a transmission device.
The running gear is used for changing the shooting position in real time, and the running gear can be an unmanned aerial vehicle or other devices capable of controlling the moving direction, height and speed.
The shooting device is used for collecting the first orthographic image, and the shooting device is preferably a camera and can also be other shooting devices with shooting and recording functions.
The shooting device is fixed on the surface of the walking device, the center of the bottom surface of the shooting device can be arranged, and other positions of the bottom surface of the shooting device can be arranged, so that the definition of the collected first ortho-image is guaranteed.
The positioning device is used for positioning the shooting position in real time, and the positioning device is arranged inside the walking device or on the surface of the walking device. The positioning device is preferably a Beidou positioning device or a GPS (global positioning system).
The transmission device transmits the first orthoimage collected by the shooting device and the shooting position positioned by the positioning device to the image processing end in real time. The transmission device is wireless transmission, preferably 3G/4G/5G, wifi, wireless microwave and the like.
The image processing end comprises an image segmentation module, an image comparison selection module, an image splicing module and a transmission module.
The image segmentation module is used for partitioning the image of the first orthoimage collected by the image collection end. When the size of the image blocks is input through the input device, the final purpose of calling the orthoimage by the user can be more accurately adapted.
The image comparison selection module compares the acquired image blocks at the same position and selects the image block shot by the image acquisition end right above the position.
And the image splicing module splices all image blocks selected by the image comparison selection module according to the first orthoimage to obtain the second orthoimage.
And the image splicing module marks the image block shooting position selected by the image comparison selection module on the corresponding image block. The position information may be displayed on the corresponding image block, or the image block position information may be hidden on the image block, which is not limited herein.
And the transmission module sends the first orthoimage and the second orthoimage to the calling database for storage so as to meet the use calling of a user. When the user calls the second ortho-image, the user can call the original shot image view, namely the first ortho-image corresponding to the position information according to the called position information.
The image processing terminal further comprises a storage module, the storage module comprises a cache module and a backup storage module, and the cache module is used for temporarily storing the image blocks of the first orthoimage so as to meet the selection of the image block by the image comparison selection module. The backup storage module is used for storing the image blocks selected by the image contrast selection module, the first orthoimage and the second orthoimage.
The calling database comprises a storage unit and a communication unit, the storage unit is used for storing the second orthoimage and the first orthoimage at a specific position in the second orthoimage, and the communication unit is used for receiving the second orthoimage sent by the image processing terminal and sending the stored second orthoimage to the reading client.
The video acquisition and transmission system based on the ortho technology further comprises a reading client, wherein the client reading end is used for sending a calling command to the calling database, receiving a called second ortho image or a first ortho image at a corresponding position, and displaying the called second ortho image, the first ortho image at the corresponding position or both simultaneously.
Preferably, the reading client may be a smart phone, an ipad, a PC terminal, or other functional equipment with communication and display functions.
A preferred embodiment of a video capture and transmission system based on an orthographic technique is described below.
The image segmentation module segments each frame of image according to the contour of an object, namely the image is composed of different segmented objects, the object in a video acquisition area is composed of different images, each image is composed of a plurality of objects, the number of the target object in the video acquisition area is managed and stored in the storage module of the image processing end, and the target object is an object which is larger than a threshold value in the image or an object of a designated image.
The invention also provides a target object management module which carries out unified numbering and image storage management according to the image segmentation module on the image segmentation result. And a plurality of sub-numbers are arranged under one number under the target management module, the number represents a target object, and the sub-numbers represent images of the target object at different angles. This may reduce the storage space of the image.
The image splicing module can also be used for calling images of corresponding numbered objects in the target object management module at different angles for combination according to the requirements of the images at different angles. For example, the front view of the video acquisition area is needed, the number of the target object in the corresponding area can be obtained according to the image of the video acquisition area, the front view of the target object with the corresponding number is extracted, and the target image in the image is replaced and recombined. According to the preferred embodiment of the invention, through the image segmentation module, the target object management module and the image splicing module, the images are segmented in advance, stored and managed, and the images are combined through the image splicing module according to the target requirements, so that the working efficiency is improved.
For example, the first orthophoto block divides the first orthophoto into a plurality of vehicle blocks and images of a single non-vehicle block at different angles. And the target object management module carries out unified numbering and image storage management according to the blocking result of the image segmentation module. The image comparison selection module acquires the numbers of the target objects in the corresponding areas of the plurality of vehicle blocks according to the video acquisition area images, extracts the front views of the target objects with the corresponding numbers, and selects the vehicle image blocks shot by the image acquisition end right above the vehicle positions of the blocks.
The image splicing module replaces and recombines the target image selected by the image comparison selection module, specifically, the image acquisition end is positioned above the vehicle position of the block and splices the vehicle image block and the non-vehicle block to obtain a third ortho-image. And due to the fact that the object is obliquely shielded in the third orthographic image, the vehicle blocks are replaced by the vehicle image blocks shot right above the position, and the object oblique shielding part is vacant.
And at the moment, the image splicing module calculates the area of the vacant part, and when the area of the vacant part is less than or equal to a threshold value, the image splicing module stretches the image of the shielded object and fills the image to the vacant part, so that the image is completely filled.
When the area of the empty part is less than or equal to the threshold, the image stitching module may further fill the designated image, which is not specifically limited herein.
And when the area of the vacant part is larger than the threshold value, the splicing module sends a vacant part block acquisition command to the image comparison selection module, wherein the vacant part block acquisition command comprises the position and the size of the vacant block. The image comparison selection module selects the image blocks shot by the image acquisition end right above the block position, and sends the vacant part block acquisition command and the image blocks selected by the image comparison selection module to the image segmentation module.
And the image segmentation module segments the image selected by the image comparison selection module according to the vacant part segment acquisition command to obtain the image segment of the blocked object part.
And the image splicing module splices the image blocks of the part of the object to be blocked with the third orthoimage to obtain the second orthoimage.
According to the preferred embodiment of the invention, the acquired image is subjected to the designated block processing through the image segmentation module, the target object management module, the image comparison selection module and the image splicing module, so that the processing quantity is greatly reduced, the processing speed of the system is improved, the efficiency is improved for processing events, and meanwhile, the target object is filled due to the defect of adjacent objects of the target object caused by oblique shielding, so that the defect of a second orthoimage is avoided.
The utility model provides a video acquisition and transmission system based on orthographic technique, carries out the orthographic image of selecting each piecemeal after the piecemeal with the video of gathering and splices, can acquire the orthographic image fast, has avoided a plurality of image transmission to produce too much network flow use cost, and the user can also transfer the first orthographic image of specific position simultaneously, has avoided the concatenation mistake.
The above description is provided for the purpose of illustrating the preferred embodiments of the present invention and will assist those skilled in the art in more fully understanding the technical solutions of the present invention. However, these examples are merely illustrative, and the embodiments of the present invention are not to be considered as being limited to the description of these examples. For those skilled in the art to which the invention pertains, several simple deductions and changes can be made without departing from the inventive concept, and all should be considered as falling within the protection scope of the invention.
Claims (7)
1. The video acquisition and transmission system based on the ortho-technology is characterized by comprising an image acquisition end, an image processing end and a calling database, wherein the image acquisition end is used for acquiring a first ortho-image, the image processing end carries out compensation elimination on the acquired first ortho-image at different positions, and the calling database is used for storing a second ortho-image after compensation elimination;
the image processing end comprises an image segmentation module, an image comparison selection module, an image splicing module and a transmission module, the image segmentation module divides a first orthoimage collected by the image collection end to be partitioned into image blocks, the image comparison selection module compares the image blocks of the same collected position to select the image block shot by the image collection end right above the position, the image splicing module splices all the image blocks selected by the image comparison selection module to obtain a second orthoimage, and the transmission module sends the first orthoimage and the second orthoimage to the retrieval database to be stored.
2. The video acquisition and transmission system based on the orthographic technology according to claim 1, wherein the image acquisition end comprises a walking device, a shooting device, a positioning device and a transmission device,
the walking device is used for changing the shooting position in real time, the shooting device is used for collecting a first orthoimage, and the shooting device is fixed on the surface of the walking device;
the positioning device is used for positioning the shooting position in real time and is arranged on the walking device;
the transmission device transmits the first orthoimage collected by the shooting device and the shooting position positioned by the positioning device to the image processing end in real time.
3. The orthographic based video acquisition and transmission system according to claim 1, wherein the image stitching module marks the image block shooting position selected by the image contrast selection module on the corresponding image block.
4. The ortho-technology based video acquisition and transmission system of claim 1, wherein the image processing side further comprises a storage module for storing image blocks of the first ortho image.
5. The video acquisition and transmission system based on the ortho-technology as claimed in claim 1, wherein the retrieval database comprises a storage unit and a communication unit, the storage unit is used for storing the second ortho-image, and the communication unit is used for receiving the second ortho-image sent by the image processing terminal and sending the stored second ortho-image to a reading client.
6. The ortho-technology based video capture and transmission system of claim 1, further comprising a client reader configured to send a call command to the call database, receive a second called ortho image, and display the second called ortho image.
7. The orthographic based video acquisition and transmission system according to claim 6, wherein the reading client is a smartphone, ipad, PC terminal.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010178816.9A CN111260563B (en) | 2020-03-15 | 2020-03-15 | Video acquisition and transmission system based on orthographic technology |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010178816.9A CN111260563B (en) | 2020-03-15 | 2020-03-15 | Video acquisition and transmission system based on orthographic technology |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111260563A true CN111260563A (en) | 2020-06-09 |
CN111260563B CN111260563B (en) | 2020-12-01 |
Family
ID=70949699
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010178816.9A Active CN111260563B (en) | 2020-03-15 | 2020-03-15 | Video acquisition and transmission system based on orthographic technology |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111260563B (en) |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106477038A (en) * | 2016-12-20 | 2017-03-08 | 北京小米移动软件有限公司 | Image capturing method and device, unmanned plane |
CN107289909A (en) * | 2016-04-13 | 2017-10-24 | 北京四维益友信息技术有限公司 | A kind of geographical information collection device |
WO2019167925A1 (en) * | 2018-03-02 | 2019-09-06 | Ricoh Company, Ltd. | Optical system, and imaging apparatus |
CN110378284A (en) * | 2019-07-18 | 2019-10-25 | 北京京东叁佰陆拾度电子商务有限公司 | Road faces drawing generating method and device, electronic equipment, storage medium |
CN110490975A (en) * | 2019-08-25 | 2019-11-22 | 中铁二局第一工程有限公司 | A kind of overall construction site plan production method based on orthography data |
CN110689563A (en) * | 2019-09-27 | 2020-01-14 | 佛山科学技术学院 | Data processing method for extracting illegal building information in remote sensing image |
CN110837839A (en) * | 2019-11-04 | 2020-02-25 | 嘉兴职业技术学院 | High-precision unmanned aerial vehicle orthoimage manufacturing and data acquisition method |
-
2020
- 2020-03-15 CN CN202010178816.9A patent/CN111260563B/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107289909A (en) * | 2016-04-13 | 2017-10-24 | 北京四维益友信息技术有限公司 | A kind of geographical information collection device |
CN106477038A (en) * | 2016-12-20 | 2017-03-08 | 北京小米移动软件有限公司 | Image capturing method and device, unmanned plane |
WO2019167925A1 (en) * | 2018-03-02 | 2019-09-06 | Ricoh Company, Ltd. | Optical system, and imaging apparatus |
CN110378284A (en) * | 2019-07-18 | 2019-10-25 | 北京京东叁佰陆拾度电子商务有限公司 | Road faces drawing generating method and device, electronic equipment, storage medium |
CN110490975A (en) * | 2019-08-25 | 2019-11-22 | 中铁二局第一工程有限公司 | A kind of overall construction site plan production method based on orthography data |
CN110689563A (en) * | 2019-09-27 | 2020-01-14 | 佛山科学技术学院 | Data processing method for extracting illegal building information in remote sensing image |
CN110837839A (en) * | 2019-11-04 | 2020-02-25 | 嘉兴职业技术学院 | High-precision unmanned aerial vehicle orthoimage manufacturing and data acquisition method |
Non-Patent Citations (2)
Title |
---|
叶思菁 等: "GF-1 遥感大数据自动化正射校正系统设计与实现", 《农业工程学报》 * |
孙世宇: "改进模型估计的无人机侦察视频快速拼接方法", 《红外与激光工程》 * |
Also Published As
Publication number | Publication date |
---|---|
CN111260563B (en) | 2020-12-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11763522B2 (en) | 3D reconstruction method based on on-site edge-cloud collaboration for cultivated land | |
CN108564647B (en) | A method of establishing virtual three-dimensional map | |
WO2017024975A1 (en) | Unmanned aerial vehicle portable ground station processing method and system | |
AU2018426323B2 (en) | Method and apparatus for planning sample points for surveying and mapping, control terminal, and storage medium | |
CN102480615B (en) | Image target area tracking system and method | |
CN105120237B (en) | Wireless image monitoring method based on 4G technologies | |
WO2020062434A1 (en) | Static calibration method for external parameters of camera | |
US9460554B2 (en) | Aerial video annotation | |
CN112634370A (en) | Unmanned aerial vehicle dotting method, device, equipment and storage medium | |
CN112113544B (en) | Remote sensing data processing method and system based on unmanned aerial vehicle image | |
WO2021093679A1 (en) | Visual positioning method and device | |
CN110009675A (en) | Generate method, apparatus, medium and the equipment of disparity map | |
CN112383745A (en) | Panoramic image-based digital presentation method for large-scale clustered construction project | |
KR20210102889A (en) | Planning method, apparatus, control terminal and storage medium of survey and mapping sample points | |
CN210603293U (en) | Traffic accident scene investigation processing system | |
CN105912638A (en) | Oblique photograph data storage and scheduling method and apparatus | |
CN115962757A (en) | Unmanned aerial vehicle surveying and mapping method, system and readable storage medium | |
CN202231781U (en) | Video playing device capable of acquiring recording position information | |
CN114067060A (en) | Dense point cloud rapid generation method for three-dimensional modeling | |
CN111260563B (en) | Video acquisition and transmission system based on orthographic technology | |
KR20210104033A (en) | Planning method, apparatus, control terminal and storage medium of survey and mapping sample points | |
CN113984037A (en) | Semantic map construction method based on target candidate box in any direction | |
CN212459378U (en) | Ground object hyperspectral meter remote sensing land utilization sample acquisition instrument based on unmanned aerial vehicle | |
CN110084822A (en) | A kind of target acquisition real time processing system and method towards the in-orbit application of satellite | |
CN215447761U (en) | Three-dimensional modeling system based on wind power unmanned aerial vehicle |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CP03 | Change of name, title or address |
Address after: 100094 room 901, 9 / F, building 4, zone 1, 81 Beiqing Road, Haidian District, Beijing Patentee after: Guoke Tiancheng Technology Co.,Ltd. Address before: 10 / F, block A3, No.1 Zhongguancun, No.81 Beiqing Road, Haidian District, Beijing 100094 Patentee before: TEEMSUN (BEIJING) TECHNOLOGY Co.,Ltd. |
|
CP03 | Change of name, title or address |