CN111260563A - Video acquisition and transmission system based on orthographic technology - Google Patents

Video acquisition and transmission system based on orthographic technology Download PDF

Info

Publication number
CN111260563A
CN111260563A CN202010178816.9A CN202010178816A CN111260563A CN 111260563 A CN111260563 A CN 111260563A CN 202010178816 A CN202010178816 A CN 202010178816A CN 111260563 A CN111260563 A CN 111260563A
Authority
CN
China
Prior art keywords
image
module
ortho
orthoimage
transmission system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010178816.9A
Other languages
Chinese (zh)
Other versions
CN111260563B (en
Inventor
韩刚
张利飞
孙智慧
李博韬
张瑞勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guoke Tiancheng Technology Co.,Ltd.
Original Assignee
Teemsun Beijing Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Teemsun Beijing Technology Co ltd filed Critical Teemsun Beijing Technology Co ltd
Priority to CN202010178816.9A priority Critical patent/CN111260563B/en
Publication of CN111260563A publication Critical patent/CN111260563A/en
Application granted granted Critical
Publication of CN111260563B publication Critical patent/CN111260563B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformation in the plane of the image
    • G06T3/40Scaling the whole image or part thereof
    • G06T3/4038Scaling the whole image or part thereof for image mosaicing, i.e. plane images composed of plane sub-images
    • G06T5/94
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/12Edge-based segmentation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20021Dividing image into blocks, subimages or windows

Abstract

The video acquisition and transmission system based on the orthographic technology comprises an image acquisition end, an image processing end and a calling database, wherein the image acquisition end is connected with the image processing end, and the image processing end is connected with the calling database; the image processing end comprises an image segmentation module, an image comparison selection module, an image splicing module and a transmission module, the image segmentation module divides a first orthoimage collected by the image collection end to be partitioned into image blocks, the image comparison selection module compares the image blocks of the same collected position to select the image block shot by the image collection end right above the position, the image splicing module splices all the image blocks selected by the image comparison selection module to obtain a second orthoimage, and the transmission module sends the first orthoimage and the second orthoimage to the retrieval database to be stored.

Description

Video acquisition and transmission system based on orthographic technology
Technical Field
The invention relates to the technical field of video acquisition and transmission, in particular to a video acquisition and transmission system based on an orthographic technology.
Background
In recent years, unmanned aerial vehicles have been widely used in the fields of surveying and mapping, exploration, emergency, disaster relief and the like due to the characteristics of high efficiency, flexibility, low cost and the like. The cost investment of the traditional aerial photogrammetry technology is greatly reduced by the aerial photogrammetry technology of the unmanned aerial vehicle, so that the aerial photogrammetry technology is from the noble to the civilian, and the unmanned aerial vehicle aerial photogrammetry technology has more common practical significance and application value.
On the other hand, the conventional implementation method for processing the unmanned aerial vehicle image is to transmit the unmanned aerial vehicle aerial image to a computer or a server through a USB interface for post-processing after the aerial photography flight task is completed, and the building in the obtained image is blocked obliquely to different degrees, so that emergency events in the fields of rescue and disaster relief, emergency handling, monitoring and investigation and the like cannot be processed accurately in time.
Therefore, the problems of the prior art are to be further improved and developed.
Disclosure of Invention
The object of the invention is: in order to solve the problems in the prior art, the present invention provides a video capture and transmission system based on an orthographic technology.
The technical scheme is as follows: in order to solve the technical problem, the technical scheme provides a video acquisition and transmission system based on an ortho-technology, which comprises an image acquisition end, an image processing end and a calling database, wherein the image acquisition end is used for acquiring a first ortho-image, the image processing end carries out compensation elimination on the acquired first ortho-image at different positions, and the calling database is used for storing a second ortho-image after compensation elimination;
the image processing end comprises an image segmentation module, an image comparison selection module, an image splicing module and a transmission module, the image segmentation module divides a first orthoimage collected by the image collection end to be partitioned into image blocks, the image comparison selection module compares the image blocks of the same collected position to select the image block shot by the image collection end right above the position, the image splicing module splices all the image blocks selected by the image comparison selection module to obtain a second orthoimage, and the transmission module sends the first orthoimage and the second orthoimage to the retrieval database to be stored.
The key point is that the image acquisition end comprises a walking device, a shooting device, a positioning device and a transmission device,
the walking device is used for changing the shooting position in real time, the shooting device is used for collecting a first orthoimage, and the shooting device is fixed on the surface of the walking device;
the positioning device is used for positioning the shooting position in real time and is arranged on the walking device;
the transmission device transmits the first orthoimage collected by the shooting device and the shooting position positioned by the positioning device to the image processing end in real time.
The key point is that the image splicing module marks the image block shooting position selected by the image comparison selection module on the corresponding image block.
The key point is that the image processing end further comprises a storage module, and the storage module is used for storing the image blocks of the first orthoimage.
The key point is that the calling database comprises a storage unit and a communication unit, the storage unit is used for storing the second orthoimage, and the communication unit is used for receiving the second orthoimage sent by the image processing terminal and sending the stored second orthoimage to the reading client.
The key point is that the system further comprises a reading client side, wherein the reading client side is used for sending a calling command to the calling database, receiving the called second orthoimage and displaying the called second orthoimage.
The key point is that the reading client can be a smart phone, an ipad and a PC terminal.
(III) the beneficial effects are as follows: the invention provides a video acquisition and transmission system based on an ortho-technology, which is used for dividing an acquired video into blocks and then selecting an ortho-image of each block for splicing, so that the ortho-image can be quickly acquired, and the excessive network traffic use cost caused by the transmission of a plurality of images is avoided.
Drawings
Fig. 1 is a schematic diagram of the connection relationship of the video acquisition and transmission system based on the orthographic technology.
Detailed Description
The present invention will be described in further detail with reference to preferred embodiments, and more details are set forth in the following description in order to provide a thorough understanding of the present invention, but it is apparent that the present invention can be embodied in many other forms different from the description herein and can be similarly generalized and deduced by those skilled in the art based on the practical application without departing from the spirit of the present invention, and therefore, the scope of the present invention should not be limited by the contents of this detailed embodiment.
The drawings are schematic representations of embodiments of the invention, and it is noted that the drawings are intended only as examples and are not drawn to scale and should not be construed as limiting the true scope of the invention.
A video acquisition and transmission system based on an orthographic technology is shown in figure 1 and comprises an image acquisition end, an image processing end and a calling database, wherein the image acquisition end is connected with the image processing end, and the image processing end is connected with the calling database.
The image acquisition end is used for acquiring a first orthoimage, the image processing end compensates and eliminates the acquired first orthoimage at different positions, and the calling database is used for storing a compensated and eliminated second orthoimage.
The image acquisition end comprises a walking device, a shooting device, a positioning device and a transmission device.
The running gear is used for changing the shooting position in real time, and the running gear can be an unmanned aerial vehicle or other devices capable of controlling the moving direction, height and speed.
The shooting device is used for collecting the first orthographic image, and the shooting device is preferably a camera and can also be other shooting devices with shooting and recording functions.
The shooting device is fixed on the surface of the walking device, the center of the bottom surface of the shooting device can be arranged, and other positions of the bottom surface of the shooting device can be arranged, so that the definition of the collected first ortho-image is guaranteed.
The positioning device is used for positioning the shooting position in real time, and the positioning device is arranged inside the walking device or on the surface of the walking device. The positioning device is preferably a Beidou positioning device or a GPS (global positioning system).
The transmission device transmits the first orthoimage collected by the shooting device and the shooting position positioned by the positioning device to the image processing end in real time. The transmission device is wireless transmission, preferably 3G/4G/5G, wifi, wireless microwave and the like.
The image processing end comprises an image segmentation module, an image comparison selection module, an image splicing module and a transmission module.
The image segmentation module is used for partitioning the image of the first orthoimage collected by the image collection end. When the size of the image blocks is input through the input device, the final purpose of calling the orthoimage by the user can be more accurately adapted.
The image comparison selection module compares the acquired image blocks at the same position and selects the image block shot by the image acquisition end right above the position.
And the image splicing module splices all image blocks selected by the image comparison selection module according to the first orthoimage to obtain the second orthoimage.
And the image splicing module marks the image block shooting position selected by the image comparison selection module on the corresponding image block. The position information may be displayed on the corresponding image block, or the image block position information may be hidden on the image block, which is not limited herein.
And the transmission module sends the first orthoimage and the second orthoimage to the calling database for storage so as to meet the use calling of a user. When the user calls the second ortho-image, the user can call the original shot image view, namely the first ortho-image corresponding to the position information according to the called position information.
The image processing terminal further comprises a storage module, the storage module comprises a cache module and a backup storage module, and the cache module is used for temporarily storing the image blocks of the first orthoimage so as to meet the selection of the image block by the image comparison selection module. The backup storage module is used for storing the image blocks selected by the image contrast selection module, the first orthoimage and the second orthoimage.
The calling database comprises a storage unit and a communication unit, the storage unit is used for storing the second orthoimage and the first orthoimage at a specific position in the second orthoimage, and the communication unit is used for receiving the second orthoimage sent by the image processing terminal and sending the stored second orthoimage to the reading client.
The video acquisition and transmission system based on the ortho technology further comprises a reading client, wherein the client reading end is used for sending a calling command to the calling database, receiving a called second ortho image or a first ortho image at a corresponding position, and displaying the called second ortho image, the first ortho image at the corresponding position or both simultaneously.
Preferably, the reading client may be a smart phone, an ipad, a PC terminal, or other functional equipment with communication and display functions.
A preferred embodiment of a video capture and transmission system based on an orthographic technique is described below.
The image segmentation module segments each frame of image according to the contour of an object, namely the image is composed of different segmented objects, the object in a video acquisition area is composed of different images, each image is composed of a plurality of objects, the number of the target object in the video acquisition area is managed and stored in the storage module of the image processing end, and the target object is an object which is larger than a threshold value in the image or an object of a designated image.
The invention also provides a target object management module which carries out unified numbering and image storage management according to the image segmentation module on the image segmentation result. And a plurality of sub-numbers are arranged under one number under the target management module, the number represents a target object, and the sub-numbers represent images of the target object at different angles. This may reduce the storage space of the image.
The image splicing module can also be used for calling images of corresponding numbered objects in the target object management module at different angles for combination according to the requirements of the images at different angles. For example, the front view of the video acquisition area is needed, the number of the target object in the corresponding area can be obtained according to the image of the video acquisition area, the front view of the target object with the corresponding number is extracted, and the target image in the image is replaced and recombined. According to the preferred embodiment of the invention, through the image segmentation module, the target object management module and the image splicing module, the images are segmented in advance, stored and managed, and the images are combined through the image splicing module according to the target requirements, so that the working efficiency is improved.
For example, the first orthophoto block divides the first orthophoto into a plurality of vehicle blocks and images of a single non-vehicle block at different angles. And the target object management module carries out unified numbering and image storage management according to the blocking result of the image segmentation module. The image comparison selection module acquires the numbers of the target objects in the corresponding areas of the plurality of vehicle blocks according to the video acquisition area images, extracts the front views of the target objects with the corresponding numbers, and selects the vehicle image blocks shot by the image acquisition end right above the vehicle positions of the blocks.
The image splicing module replaces and recombines the target image selected by the image comparison selection module, specifically, the image acquisition end is positioned above the vehicle position of the block and splices the vehicle image block and the non-vehicle block to obtain a third ortho-image. And due to the fact that the object is obliquely shielded in the third orthographic image, the vehicle blocks are replaced by the vehicle image blocks shot right above the position, and the object oblique shielding part is vacant.
And at the moment, the image splicing module calculates the area of the vacant part, and when the area of the vacant part is less than or equal to a threshold value, the image splicing module stretches the image of the shielded object and fills the image to the vacant part, so that the image is completely filled.
When the area of the empty part is less than or equal to the threshold, the image stitching module may further fill the designated image, which is not specifically limited herein.
And when the area of the vacant part is larger than the threshold value, the splicing module sends a vacant part block acquisition command to the image comparison selection module, wherein the vacant part block acquisition command comprises the position and the size of the vacant block. The image comparison selection module selects the image blocks shot by the image acquisition end right above the block position, and sends the vacant part block acquisition command and the image blocks selected by the image comparison selection module to the image segmentation module.
And the image segmentation module segments the image selected by the image comparison selection module according to the vacant part segment acquisition command to obtain the image segment of the blocked object part.
And the image splicing module splices the image blocks of the part of the object to be blocked with the third orthoimage to obtain the second orthoimage.
According to the preferred embodiment of the invention, the acquired image is subjected to the designated block processing through the image segmentation module, the target object management module, the image comparison selection module and the image splicing module, so that the processing quantity is greatly reduced, the processing speed of the system is improved, the efficiency is improved for processing events, and meanwhile, the target object is filled due to the defect of adjacent objects of the target object caused by oblique shielding, so that the defect of a second orthoimage is avoided.
The utility model provides a video acquisition and transmission system based on orthographic technique, carries out the orthographic image of selecting each piecemeal after the piecemeal with the video of gathering and splices, can acquire the orthographic image fast, has avoided a plurality of image transmission to produce too much network flow use cost, and the user can also transfer the first orthographic image of specific position simultaneously, has avoided the concatenation mistake.
The above description is provided for the purpose of illustrating the preferred embodiments of the present invention and will assist those skilled in the art in more fully understanding the technical solutions of the present invention. However, these examples are merely illustrative, and the embodiments of the present invention are not to be considered as being limited to the description of these examples. For those skilled in the art to which the invention pertains, several simple deductions and changes can be made without departing from the inventive concept, and all should be considered as falling within the protection scope of the invention.

Claims (7)

1. The video acquisition and transmission system based on the ortho-technology is characterized by comprising an image acquisition end, an image processing end and a calling database, wherein the image acquisition end is used for acquiring a first ortho-image, the image processing end carries out compensation elimination on the acquired first ortho-image at different positions, and the calling database is used for storing a second ortho-image after compensation elimination;
the image processing end comprises an image segmentation module, an image comparison selection module, an image splicing module and a transmission module, the image segmentation module divides a first orthoimage collected by the image collection end to be partitioned into image blocks, the image comparison selection module compares the image blocks of the same collected position to select the image block shot by the image collection end right above the position, the image splicing module splices all the image blocks selected by the image comparison selection module to obtain a second orthoimage, and the transmission module sends the first orthoimage and the second orthoimage to the retrieval database to be stored.
2. The video acquisition and transmission system based on the orthographic technology according to claim 1, wherein the image acquisition end comprises a walking device, a shooting device, a positioning device and a transmission device,
the walking device is used for changing the shooting position in real time, the shooting device is used for collecting a first orthoimage, and the shooting device is fixed on the surface of the walking device;
the positioning device is used for positioning the shooting position in real time and is arranged on the walking device;
the transmission device transmits the first orthoimage collected by the shooting device and the shooting position positioned by the positioning device to the image processing end in real time.
3. The orthographic based video acquisition and transmission system according to claim 1, wherein the image stitching module marks the image block shooting position selected by the image contrast selection module on the corresponding image block.
4. The ortho-technology based video acquisition and transmission system of claim 1, wherein the image processing side further comprises a storage module for storing image blocks of the first ortho image.
5. The video acquisition and transmission system based on the ortho-technology as claimed in claim 1, wherein the retrieval database comprises a storage unit and a communication unit, the storage unit is used for storing the second ortho-image, and the communication unit is used for receiving the second ortho-image sent by the image processing terminal and sending the stored second ortho-image to a reading client.
6. The ortho-technology based video capture and transmission system of claim 1, further comprising a client reader configured to send a call command to the call database, receive a second called ortho image, and display the second called ortho image.
7. The orthographic based video acquisition and transmission system according to claim 6, wherein the reading client is a smartphone, ipad, PC terminal.
CN202010178816.9A 2020-03-15 2020-03-15 Video acquisition and transmission system based on orthographic technology Active CN111260563B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010178816.9A CN111260563B (en) 2020-03-15 2020-03-15 Video acquisition and transmission system based on orthographic technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010178816.9A CN111260563B (en) 2020-03-15 2020-03-15 Video acquisition and transmission system based on orthographic technology

Publications (2)

Publication Number Publication Date
CN111260563A true CN111260563A (en) 2020-06-09
CN111260563B CN111260563B (en) 2020-12-01

Family

ID=70949699

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010178816.9A Active CN111260563B (en) 2020-03-15 2020-03-15 Video acquisition and transmission system based on orthographic technology

Country Status (1)

Country Link
CN (1) CN111260563B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106477038A (en) * 2016-12-20 2017-03-08 北京小米移动软件有限公司 Image capturing method and device, unmanned plane
CN107289909A (en) * 2016-04-13 2017-10-24 北京四维益友信息技术有限公司 A kind of geographical information collection device
WO2019167925A1 (en) * 2018-03-02 2019-09-06 Ricoh Company, Ltd. Optical system, and imaging apparatus
CN110378284A (en) * 2019-07-18 2019-10-25 北京京东叁佰陆拾度电子商务有限公司 Road faces drawing generating method and device, electronic equipment, storage medium
CN110490975A (en) * 2019-08-25 2019-11-22 中铁二局第一工程有限公司 A kind of overall construction site plan production method based on orthography data
CN110689563A (en) * 2019-09-27 2020-01-14 佛山科学技术学院 Data processing method for extracting illegal building information in remote sensing image
CN110837839A (en) * 2019-11-04 2020-02-25 嘉兴职业技术学院 High-precision unmanned aerial vehicle orthoimage manufacturing and data acquisition method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107289909A (en) * 2016-04-13 2017-10-24 北京四维益友信息技术有限公司 A kind of geographical information collection device
CN106477038A (en) * 2016-12-20 2017-03-08 北京小米移动软件有限公司 Image capturing method and device, unmanned plane
WO2019167925A1 (en) * 2018-03-02 2019-09-06 Ricoh Company, Ltd. Optical system, and imaging apparatus
CN110378284A (en) * 2019-07-18 2019-10-25 北京京东叁佰陆拾度电子商务有限公司 Road faces drawing generating method and device, electronic equipment, storage medium
CN110490975A (en) * 2019-08-25 2019-11-22 中铁二局第一工程有限公司 A kind of overall construction site plan production method based on orthography data
CN110689563A (en) * 2019-09-27 2020-01-14 佛山科学技术学院 Data processing method for extracting illegal building information in remote sensing image
CN110837839A (en) * 2019-11-04 2020-02-25 嘉兴职业技术学院 High-precision unmanned aerial vehicle orthoimage manufacturing and data acquisition method

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
叶思菁 等: "GF-1 遥感大数据自动化正射校正系统设计与实现", 《农业工程学报》 *
孙世宇: "改进模型估计的无人机侦察视频快速拼接方法", 《红外与激光工程》 *

Also Published As

Publication number Publication date
CN111260563B (en) 2020-12-01

Similar Documents

Publication Publication Date Title
US11763522B2 (en) 3D reconstruction method based on on-site edge-cloud collaboration for cultivated land
CN108564647B (en) A method of establishing virtual three-dimensional map
WO2017024975A1 (en) Unmanned aerial vehicle portable ground station processing method and system
AU2018426323B2 (en) Method and apparatus for planning sample points for surveying and mapping, control terminal, and storage medium
CN102480615B (en) Image target area tracking system and method
CN105120237B (en) Wireless image monitoring method based on 4G technologies
WO2020062434A1 (en) Static calibration method for external parameters of camera
US9460554B2 (en) Aerial video annotation
CN112634370A (en) Unmanned aerial vehicle dotting method, device, equipment and storage medium
CN112113544B (en) Remote sensing data processing method and system based on unmanned aerial vehicle image
WO2021093679A1 (en) Visual positioning method and device
CN110009675A (en) Generate method, apparatus, medium and the equipment of disparity map
CN112383745A (en) Panoramic image-based digital presentation method for large-scale clustered construction project
KR20210102889A (en) Planning method, apparatus, control terminal and storage medium of survey and mapping sample points
CN210603293U (en) Traffic accident scene investigation processing system
CN105912638A (en) Oblique photograph data storage and scheduling method and apparatus
CN115962757A (en) Unmanned aerial vehicle surveying and mapping method, system and readable storage medium
CN202231781U (en) Video playing device capable of acquiring recording position information
CN114067060A (en) Dense point cloud rapid generation method for three-dimensional modeling
CN111260563B (en) Video acquisition and transmission system based on orthographic technology
KR20210104033A (en) Planning method, apparatus, control terminal and storage medium of survey and mapping sample points
CN113984037A (en) Semantic map construction method based on target candidate box in any direction
CN212459378U (en) Ground object hyperspectral meter remote sensing land utilization sample acquisition instrument based on unmanned aerial vehicle
CN110084822A (en) A kind of target acquisition real time processing system and method towards the in-orbit application of satellite
CN215447761U (en) Three-dimensional modeling system based on wind power unmanned aerial vehicle

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CP03 Change of name, title or address

Address after: 100094 room 901, 9 / F, building 4, zone 1, 81 Beiqing Road, Haidian District, Beijing

Patentee after: Guoke Tiancheng Technology Co.,Ltd.

Address before: 10 / F, block A3, No.1 Zhongguancun, No.81 Beiqing Road, Haidian District, Beijing 100094

Patentee before: TEEMSUN (BEIJING) TECHNOLOGY Co.,Ltd.

CP03 Change of name, title or address