CN110430389A - Image data acquiring method, apparatus, computer equipment and storage medium - Google Patents
Image data acquiring method, apparatus, computer equipment and storage medium Download PDFInfo
- Publication number
- CN110430389A CN110430389A CN201910545160.7A CN201910545160A CN110430389A CN 110430389 A CN110430389 A CN 110430389A CN 201910545160 A CN201910545160 A CN 201910545160A CN 110430389 A CN110430389 A CN 110430389A
- Authority
- CN
- China
- Prior art keywords
- image frame
- unmanned plane
- information
- video
- flight
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/04—Protocols for data compression, e.g. ROHC
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
Abstract
The application is specifically related to a kind of image data acquiring method, apparatus, computer equipment and storage medium.Method includes: the video information uploaded by obtaining unmanned plane；Extract the original image frame that the video information includes default acquisition target；Identify the defect image frame for including in the original image frame；Intercept the video clip in the video information comprising the defect image frame；Upload the defect image frame and the video clip.The application image data acquiring method acquires image data by unmanned plane, identify the target defect picture frame in the data of unmanned plane acquisition, directly upload defect image frame and the video clip comprising defect image frame, the data volume for effectively reducing data transmission, substantially reduces image data in the data volume of transmission process.
Description
Technical field
This application involves field of computer technology, more particularly to a kind of image data acquiring method based on unmanned plane,
Device, computer equipment and storage medium.
Background technique
UAV referred to as " unmanned plane ", is manipulated using radio robot and the presetting apparatus provided for oneself
Not manned vehicle.Unmanned plane is actually the general designation of unmanned vehicle, can be divided into from technical standpoint definition: nobody
Fixed wing aircraft, unmanned VTOL aircraft, unmanned airship, unmanned helicopter, unmanned multi-rotor aerocraft, unmanned parasol
Deng.Currently, unmanned plane is used widely in the fields such as field construction, exploration, communications and transportation, tourism, rescue.
Since unmanned plane is not limited and can be carried various picture pick-up devices by landform, it is usually used in abort situation scene or people
The place of mark seldom extremely carries out the shooting observation of short distance.Unmanned plane can feed back to the video image material of shooting, for related
Personnel analyze scene.But the data quantity of video image material data is excessive, acquisition and transmission process complexity compared with
It is high.
Summary of the invention
Based on this, it is necessary to for existing unmanned plane in the acquisition of video image material data and the data of transmission process
Excessive technical problem is measured, a kind of image data acquiring method, apparatus, computer equipment and storage based on unmanned plane is provided
Medium.
A kind of image data acquiring method, which comprises
The video information that unmanned plane uploads is obtained, the video information is flown by the unmanned plane according to pre-set flight paths
Acquisition；
Extract the original image frame that the video information includes default acquisition target；
Identify the defect image frame for including in the original image frame；
Intercept the video clip in the video information comprising the defect image frame；
Upload the defect image frame and the video clip.
The control unmanned plane flies according to pre-set flight paths in one of the embodiments, receives and saves described
Before the video information that unmanned plane acquires in flight path further include:
Obtain the coordinate information of each default acquisition target；
According to the coordinate information of each default acquisition target, the flight range information of unmanned plane is determined；
The obstacle information of the flight range information is obtained in real time；
The flight path planning that unmanned plane is carried out according to the obstacle information, generates and pushes pre-set flight paths extremely
The unmanned plane.
In one of the embodiments, before the upload defect image further include:
Each frame video image in the video clip of the defect image frame and the defect image frame is divided into
The pixel region of multiple same sizes；
Each pixel region is divided into the subpixel area of multiple same sizes；
Each subpixel area is compressed with preset compression ratio, to form corresponding data block；
All data blocks for being associated with a pixel region are arranged according to preset sequence and are stored in one accordingly
In data block；
All data blocks are arranged by preset sequence and are stored in storage unit, it is described after obtaining compression processing
Defect image frame and the video clip；
The upload defect image frame and the video clip include:
The defect image frame and the video clip after uploading compression processing.
It is described in one of the embodiments, to extract the original image frame packet that the video information includes default acquisition target
It includes:
According to the location information of the unmanned plane, determine the unmanned plane in the flight time section of each default acquisition target；
Search the video information in the section of flight time described in the video information；
Picture frame is extracted in the video information in flight time section as original image frame.
It is described in one of the embodiments, to identify that the defect image frame for including in the original image frame includes:
Obtain each angular image of the default acquisition target；
According to the unmanned plane in the location information and camera angle information of each shooting time, each angle of unmanned plane is determined
Spend the corresponding real-time original image frame of image；
Obtain the default angular image for acquiring target and the similarity of the corresponding real-time original image frame；
When the similarity is lower than default similarity threshold, determine the original image frame for defect image frame.
It in one of the embodiments, include the video clip of the defect image frame in the interception video information
Include:
According to the location information of the unmanned plane, determine the unmanned plane in the flight time section of each default acquisition target；
The corresponding shooting time of the defect image frame is positioned to the flight time section；
According to the corresponding shooting time of first time defect image frame and last time defect image frame in each flight time section
Corresponding shooting time intercepts the video clip in the video information comprising the defect image frame.
A kind of image data acquiring device, described device include:
Image data acquisition module, for obtain unmanned plane upload video information, the video information by it is described nobody
Machine flies according to pre-set flight paths and acquires；
Image frame extraction module, for extracting the original image frame that the video information includes default acquisition target；
Picture recognition module, the defect image frame for including in the original image frame for identification；
Video intercepting module, for intercepting the video clip in the video information comprising the defect image frame；
Information uploading module, for uploading the defect image frame and the video clip.
In one of the embodiments, further include path planning module, the path planning module is specifically used for:
Obtain the coordinate information of each default acquisition target；
According to the coordinate information of each default acquisition target, the flight range information of unmanned plane is determined；
The obstacle information of the flight range information is obtained in real time；
The flight path planning that unmanned plane is carried out according to the obstacle information, obtains pre-set flight paths.
A kind of computer equipment, including memory and processor, the memory are stored with computer program, the processing
Device performs the steps of when executing the computer program
The video information that unmanned plane uploads is obtained, the video information is flown by the unmanned plane according to pre-set flight paths
Acquisition；
Extract the original image frame that the video information includes default acquisition target；
Identify the defect image frame for including in the original image frame；
Intercept the video clip in the video information comprising the defect image frame；
Upload the defect image frame and the video clip.
A kind of computer readable storage medium, is stored thereon with computer program, and the computer program is held by processor
It is performed the steps of when row
The video information that unmanned plane uploads is obtained, the video information is flown by the unmanned plane according to pre-set flight paths
Acquisition；
Extract the original image frame that the video information includes default acquisition target；
Identify the defect image frame for including in the original image frame；
Intercept the video clip in the video information comprising the defect image frame；
Upload the defect image frame and the video clip.
Above-mentioned image data acquiring method, apparatus, computer equipment and storage medium, by obtaining unmanned plane upload
Video information；Extract the original image frame that the video information includes default acquisition target；It identifies and is wrapped in the original image frame
The defect image frame contained；Intercept the video clip in the video information comprising the defect image frame；Upload the defect map
As frame and the video clip.The application image data acquiring method acquires image data by unmanned plane, identifies unmanned plane
Target defect picture frame in the data of acquisition, directly upload defect image frame and the video clip comprising defect image frame,
The data volume for effectively reducing data transmission, substantially reduces image data in the data volume of transmission process.
Detailed description of the invention
Fig. 1 is the applied environment figure of image data acquiring method in one embodiment；
Fig. 2 is the flow diagram of image data acquiring method in one embodiment；
Fig. 3 is the sub-process schematic diagram of the step S300 of Fig. 2 in one embodiment；
Fig. 4 is the sub-process schematic diagram of the step S500 of Fig. 2 in one embodiment；
Fig. 5 is the structural block diagram of image data acquiring device in one embodiment；
Fig. 6 is the internal structure chart of computer equipment in one embodiment.
Specific embodiment
It is with reference to the accompanying drawings and embodiments, right in order to which the objects, technical solutions and advantages of the application are more clearly understood
The application is further elaborated.It should be appreciated that specific embodiment described herein is only used to explain the application, not
For limiting the application.
Unmanned plane management method provided by the present application, can be applied in application environment as shown in Figure 1, wherein nobody
Machine 102 is communicated by network with unmanned plane management server 104, and unmanned plane management server 104 passes through network and cloud
Server 106 communicates, and unmanned plane management server 104 is located at unmanned plane and shuts down within doors, for controlling the work of unmanned plane.This
Outside, it includes warehouse and door that unmanned plane, which shuts down room, and warehouse has waterproof, heat insulating function.Warehouse bottom is equipped with one for pacifying
Put " the carry putting hole " of the carries such as camera on unmanned plane, laser radar.Unmanned plane management server is for acquiring default adopt
Collect the defect image of target, to safeguard that the normal work of default acquisition target provides technical support, first unmanned plane management service
Device obtains the video information that unmanned plane uploads, and video information is flown according to pre-set flight paths by unmanned plane and acquired；It identifies original
The defect image frame for including in picture frame；Intercept the video clip in video information comprising defect image frame；Upload defect image
Frame and video clip are used to cloud server for analysis staff.
As shown in Fig. 2, the image data acquiring method of the application in one of the embodiments, passes through unmanned plane management
Server realize, image data acquiring method specifically includes the following steps:
S100, the video information that unmanned plane uploads is obtained, video information is adopted by unmanned plane according to pre-set flight paths flight
Collection.
Pre-set flight paths refer to that unmanned plane management server is pre-set according to the actual situation, for instructing unmanned plane
The route of aerial mission is executed, the default acquisition target of unmanned plane acquisition image is contained on route, while flight can be evaded
Barrier in region, prevents the flight of barrier interference unmanned plane, and unmanned plane management server can be by by pre-set flight
Route imports unmanned plane, so that unmanned plane is flown according to this flight path to acquire required video information.In unmanned plane
After taking off, unmanned plane management server can be shut down within doors by setting and unmanned plane, be connect with unmanned plane management server
Router flies on the way to receive unmanned plane with collected video information again.
S300 extracts the original image frame that video information includes default acquisition target.
Unmanned plane each picture frame that camera acquires in flight course, some of them image are contained in video information
Frame is the picture frame not comprising default acquisition target, these picture frames are for the data analysis process of image data acquiring
Useless, it can be excluded by the extraction of data frame, directly acquire the original image frame comprising default acquisition target.
S500 identifies the defect image frame for including in original image frame.
Original image frame refers to all picture frames comprising default acquisition target, but for being carried out to default acquisition target
If maintenance, wherein normal original image frame be it is useless, can identify occur the figure of abnormality in original image frame
As frame, as defect image frame, in case the process of maintenance analysis uses.
S700 intercepts the video clip in video information comprising defect image frame.
Video information contains unmanned plane all video informations collected, it is necessary to which intercepting all video informations includes this
The video clip of a little defect image frames carrys out the image analysis work of standby maintenance staff.
S900 uploads defect image frame and video clip.
After extraction obtains defect video frame and corresponding video clip, it can be established by router and be taken with cloud
The connection of business device, is transferred to cloud server for defect video frame and corresponding video clip, only uploads defect video frame and view
Frequency segment is handled the image of acquisition that is, near unmanned plane by edge calculations, and data transmission can be effectively reduced
Amount, to reduce image data in acquisition and the complexity of transmission process, improves the efficiency of image real time transfer.
Above-mentioned image data acquiring method, apparatus, computer equipment and storage medium, by obtaining unmanned plane upload
Video information；Extract the original image frame that the video information includes default acquisition target；It identifies and is wrapped in the original image frame
The defect image frame contained；Intercept the video clip in the video information comprising the defect image frame；Upload the defect map
As frame and the video clip.The application image data acquiring method acquires image data by unmanned plane, identifies unmanned plane
Target defect picture frame in the data of acquisition, directly upload defect image frame and the video clip comprising defect image frame,
The data volume for effectively reducing data transmission, substantially reduces image data in the data volume of transmission process.
S100 includes: in one of the embodiments,
The coordinate information for obtaining each default acquisition target determines unmanned plane according to the coordinate information of each default acquisition target
Flight range information, in real time obtain flight range information obstacle information, according to obstacle information carry out unmanned plane fly
Row route planning generates and pushes pre-set flight paths to unmanned plane.
Unmanned plane management server prestores the information of entire flight range, and the image information collecting work of unmanned plane has pair
These target points can be inputted unmanned plane management server by the target collection point answered, user, and unmanned plane management server can be with
By marking these coordinate points on map, identification judges the possible flight range of unmanned plane.Furthermore unmanned plane can also obtain
The real-time obstacle information in these regions, these obstacle informations are specifically the obstacle being located within the scope of drone flying height
Object.The flight path planning of unmanned plane is carried out, by flight range information and obstacle information to obtain preset flight road
Line can obtain flight optimization route, and the pre-set flight paths are pushed to unmanned plane, improve unmanned plane image acquisition process
Efficiency.
In one of the embodiments, before S900 further include:
Each frame video image in the video clip of defect image frame and defect image frame is divided into multiple identical
The pixel region of size.
Each pixel region is divided into the subpixel area of multiple same sizes.
Each subpixel area is compressed with preset compression ratio, to form corresponding data block.
All data blocks for being associated with a pixel region are arranged according to preset sequence and are stored in one accordingly
In data block.
All data blocks are arranged by preset sequence and are stored in storage unit, the defect after obtaining compression processing
Picture frame and video clip.
S900 includes defect image frame and video clip after uploading compression processing.
Wherein, pixel region refers to the video image display area including multiple pixels.It can be by each frame video
Image is divided into multiple pixel regions, is then divided based on the pixel region for dividing completion again, obtains sub-pixel area
Domain, so that a complete video image is split as the lesser picture element display area of muti-piece, respectively to each subpixel area
Compressed encoding is carried out, to form the different data blocks for corresponding to each subpixel area, above-mentioned preset compression ratio be can wrap
25%, 50% and 75% is included, the specific percentage of compression can be according to the resolution ratio of acquisition image and for the figure of analysis
As required for data readability is configured.It, will by each subpixel area of compression to form corresponding data block
Corresponding data block is stored in the data block for being associated with each pixel region, with the storage organization of shape block data, and with
The mode of raster scanning is arranged and is stored, and is conducive to access to storing data.The fast data that compression can be completed
It uploads in cloud server, cloud server is by decoding these compressed block number evidences, to obtain original defect image
Frame and video clip.The data volume for being uploaded to cloud server can be further decreased by compressing, improves and is transmitted through in data
The efficiency of journey.
As shown in figure 3, S300 includes: in one of the embodiments,
S320 determines unmanned plane in the flight time section of each default acquisition target according to the location information of unmanned plane.
S340 searches the video information in video information in flight time section.
S360, extract the flight time section in video information in picture frame as original image frame.
Specifically, including locating module on unmanned plane, unmanned plane management server can be by locating module to current
The position of unmanned plane is positioned, at the time of may thereby determine that when unmanned plane reaches and leave each default acquisition target
Point, it is collected in the flight time section of each default acquisition target that unmanned plane management server can directly intercept unmanned plane
Video information, and the video data frame in these video informations is extracted, as original image frame to be processed.It can be by nobody
The position of machine and the corresponding relationship at moment, the extracting target from video image video image acquired from unmanned plane camera, avoid
The video image of processing is excessive, influences treatment effeciency.
As shown in figure 4, S500 includes: in one of the embodiments,
S520 obtains each angular image of default acquisition target
S540 determines each of unmanned plane according to unmanned plane in the location information and camera angle information of each shooting time
The corresponding real-time original image frame of angular image.
S560 obtains the default angular image for acquiring target and the similarity of corresponding real-time original image frame.
S580 determines that original image frame is defect image frame when similarity is lower than default similarity threshold.
Wherein, each angular image for presetting acquisition target specifically refers to unmanned plane from each different orientation and possible
The image for the normal default acquisition target that shooting angle takes, these images can first pass through in advance unmanned plane and be acquired,
And by each angular image of the desk checking after qualified as default acquisition target, mesh is acquired when preset using unmanned plane
During target image data acquiring, unmanned plane can also be allowed to acquire from these pervious shooting angle in real time as much as possible
Image data.The location information and camera angle of each image/video frame and unmanned plane at that time correspond, and can pass through
Location information (including location information and flying height information) and camera angle, from each angular image of default acquisition target
It is middle to search angular image corresponding with current original image frame.Then by comparing preset angular image and implementing acquisition
The image data frame arrived, when image data frame and preset angular image difference are excessive, it is believed that current default acquisition
There is certain variation in the original default acquisition target of targeted contrast, so as to which the image data frame is determined as defect image
Frame.Presetting acquisition target in one of the embodiments, is building site high building, when breakage occurs in the Green Protection cover of the building site high building
When, it can be uploaded the image/video frame comprising the breakage Green Protection cover as defect image frame.By by defect image frame
Cloud server is uploaded, so that the maintenance staff in cloud can analyze default acquisition target by defect image frame
Performance.
S700 includes: in one of the embodiments,
According to the location information of unmanned plane, determine unmanned plane in the flight time section of each default acquisition target.
The corresponding shooting time of defect image frame is positioned to flight time section.
According to the corresponding shooting time of first time defect image frame and last time defect image frame in each flight time section
Corresponding shooting time intercepts the video clip in video information comprising defect image frame.
In the case where there is defect image frame, the stronger analysis foundation of offer is provided and is given to Cloud Server
End, can intercept the video clip comprising the defect image frame at this time as further evidence to help cloud staff
Actual conditions are further analyzed, each piece of video comprising default acquisition target can be intercepted from entire video information at this time
Section, and by defect image frame alignment into these segments, defect image frame is intercepted from video clip to be occurred for the first time to the end
The video clip once occurred can effectively improve as the video clip for being uploaded to Cloud Server by providing analysis video
The validity of video image data analysis.
The image data acquiring method of the application includes: to obtain each default acquisition target in one of the embodiments,
Coordinate information；According to the coordinate information of each default acquisition target, the flight range information of unmanned plane is determined；Movement area is obtained in real time
The obstacle information of domain information；The flight path planning that unmanned plane is carried out according to obstacle information, generates and pushes pre-set flight
Route is to unmanned plane.Obtain the video information that unmanned plane uploads；According to the location information of unmanned plane, determine unmanned plane each default
Acquire the flight time section of target；Search the video information in video information in flight time section；It extracts in flight time section
Picture frame is as original image frame in video information.Obtain each angular image of default acquisition target；According to unmanned plane in each bat
The location information and camera angle information for taking the photograph the moment, determine the corresponding real-time original image frame of each angular image of unmanned plane；
Obtain the default angular image for acquiring target and the similarity of corresponding real-time original image frame；When similarity is similar lower than presetting
When spending threshold value, determine that original image frame is defect image frame.According to the location information of unmanned plane, determine that unmanned plane is adopted in each preset
Collect the flight time section of target；The corresponding shooting time of defect image frame is positioned to flight time section；When according to each flight
Between the corresponding shooting time of first time defect image frame shooting time corresponding with last time defect image frame in section, interception view
It include the video clip of defect image frame in frequency information.It will be each in the video clip of defect image frame and defect image frame
Frame video image is divided into the pixel region of multiple same sizes；Each pixel region is divided into the sub- picture of multiple same sizes
Plain region；Each subpixel area is compressed with preset compression ratio, to form corresponding data block；One will be associated with
All data blocks of pixel region are arranged according to preset sequence and are stored in a corresponding data block；By preset suitable
All data blocks are arranged and are stored in storage unit by sequence, defect image frame and piece of video after obtaining compression processing
Section.Defect image frame and video clip after uploading compression processing.
It should be understood that although each step in the flow chart of Fig. 2-4 is successively shown according to the instruction of arrow,
These steps are not that the inevitable sequence according to arrow instruction successively executes.Unless expressly stating otherwise herein, these steps
Execution there is no stringent sequences to limit, these steps can execute in other order.Moreover, at least one in Fig. 2-4
Part steps may include that perhaps these sub-steps of multiple stages or stage are not necessarily in synchronization to multiple sub-steps
Completion is executed, but can be executed at different times, the execution sequence in these sub-steps or stage is also not necessarily successively
It carries out, but can be at least part of the sub-step or stage of other steps or other steps in turn or alternately
It executes.
As shown in figure 5, the application further includes a kind of image data acquiring device, device includes:
Image data acquisition module 100, for obtain unmanned plane upload video information, video information by unmanned plane according to
Pre-set flight paths flight acquisition；
Image frame extraction module 300, for extracting the original image frame that video information includes default acquisition target；
Picture recognition module 500, the defect image frame for including in original image frame for identification；
Video intercepting module 700, for intercepting the video clip in video information comprising defect image frame；
Information uploading module 900, for uploading defect image frame and video clip.
It in one of the embodiments, further include path planning module, path planning module is specifically used for obtaining each default
Acquire the coordinate information of target；According to the coordinate information of each default acquisition target, the flight range information of unmanned plane is determined；In real time
Obtain the obstacle information of flight range information；The flight path planning that unmanned plane is carried out according to obstacle information, generates and pushes away
Send pre-set flight paths to unmanned plane.
In one of the embodiments, further include data compressing module, is used for defect image frame and defect image frame
Video clip in each frame video image be divided into the pixel regions of multiple same sizes；Each pixel region is divided into
The subpixel area of multiple same sizes；Each subpixel area is compressed with preset compression ratio, it is corresponding to be formed
Data block；All data blocks for being associated with a pixel region are arranged according to preset sequence and are stored in a corresponding number
According in block；All data blocks are arranged by preset sequence and are stored in storage unit, lacking after obtaining compression processing
Fall into picture frame and video clip.Information uploading module 900 is specifically for the defect image frame and view after uploading compression processing
Frequency segment.
Image frame extraction module 300 is used for the location information according to unmanned plane in one of the embodiments, determines nobody
Flight time section of the machine in each default acquisition target；Search the video information in video information in flight time section；Extract flight
Picture frame is as original image frame in video information in period.
Picture recognition module 500 is used to obtain each angular image of default acquisition target in one of the embodiments,；Root
According to unmanned plane in the location information and camera angle information of each shooting time, the corresponding reality of each angular image of unmanned plane is determined
When original image frame；Obtain the default angular image for acquiring target and the similarity of corresponding real-time original image frame；When similar
When degree is lower than default similarity threshold, determine that original image frame is defect image frame.
Video intercepting module 700 is used for the location information according to unmanned plane in one of the embodiments, determines unmanned plane
In the flight time section of each default acquisition target；The corresponding shooting time of defect image frame is positioned to flight time section；Root
According to the corresponding shooting time of first time defect image frame shooting corresponding with last time defect image frame in each flight time section
Moment intercepts the video clip in video information comprising defect image frame.
Specific about image data acquiring device limits the limit that may refer to above for image data acquiring method
Fixed, details are not described herein.Modules in above-mentioned image data acquiring device can fully or partially through software, hardware and its
Combination is to realize.Above-mentioned each module can be embedded in the form of hardware or independently of in the processor in computer equipment, can also be with
It is stored in the memory in computer equipment in a software form, in order to which processor calls the above modules of execution corresponding
Operation.
In one embodiment, a kind of computer equipment is provided, which can be server, internal junction
Composition can be as shown in Figure 6.The computer equipment includes processor, memory and the network interface connected by system bus.
Wherein, the processor of the computer equipment is for providing calculating and control ability.The memory of the computer equipment includes non-easy
The property lost storage medium, built-in storage.The non-volatile memory medium is stored with operating system and computer program.The built-in storage
Operation for operating system and computer program in non-volatile memory medium provides environment.The network of the computer equipment connects
Mouth with external terminal by network connection for being communicated.To realize a kind of picture number when the computer program is executed by processor
According to acquisition method.
It will be understood by those skilled in the art that structure shown in Fig. 6, only part relevant to application scheme is tied
The block diagram of structure does not constitute the restriction for the computer equipment being applied thereon to application scheme, specific computer equipment
It may include perhaps combining certain components or with different component layouts than more or fewer components as shown in the figure.
In one embodiment, a kind of computer equipment, including memory and processor are provided, is stored in memory
Computer program, the processor perform the steps of when executing computer program
The video information that unmanned plane uploads is obtained, video information is flown according to pre-set flight paths by unmanned plane and acquired；
Extract the original image frame that video information includes default acquisition target；
The defect image frame for including in identification original image frame；
Intercept the video clip in video information comprising defect image frame；
Upload defect image frame and video clip.
In one embodiment, it is also performed the steps of when processor executes computer program and obtains each default acquisition mesh
Target coordinate information；According to the coordinate information of each default acquisition target, the flight range information of unmanned plane is determined；It obtains and flies in real time
The obstacle information of row area information；The flight path planning that unmanned plane is carried out according to obstacle information is generated and is pushed default
Flight path is to unmanned plane.
In one embodiment, also perform the steps of when processor executes computer program by defect image frame and
Each frame video image in the video clip of defect image frame is divided into the pixel region of multiple same sizes；By each pixel
Region division is the subpixel area of multiple same sizes；Each subpixel area is compressed with preset compression ratio, with
Form corresponding data block；All data blocks for being associated with a pixel region are arranged according to preset sequence and are stored in one
In a corresponding data block；All data blocks are arranged by preset sequence and are stored in storage unit, compression is obtained
Treated defect image frame and video clip.
In one embodiment, the positioning according to unmanned plane is also performed the steps of when processor executes computer program
Information determines unmanned plane in the flight time section of each default acquisition target；Search the video in video information in flight time section
Information；Picture frame is as original image frame in video information in extraction flight time section.
In one embodiment, acquisition default acquisition target is also performed the steps of when processor executes computer program
Each angular image；According to unmanned plane in the location information and camera angle information of each shooting time, each of unmanned plane is determined
The corresponding real-time original image frame of angular image；Obtain the default angular image for acquiring target and corresponding real-time original image frame
Similarity；When similarity is lower than default similarity threshold, determine that original image frame is defect image frame.
In one embodiment, the positioning according to unmanned plane is also performed the steps of when processor executes computer program
Information determines unmanned plane in the flight time section of each default acquisition target；By the corresponding shooting time of defect image frame position to
In flight time section；According to the corresponding shooting time of first time defect image frame and last time defect map in each flight time section
As the corresponding shooting time of frame, the video clip in video information comprising defect image frame is intercepted.
In one embodiment, a kind of computer readable storage medium is provided, computer program is stored thereon with, is calculated
Machine program performs the steps of when being executed by processor
The video information that unmanned plane uploads is obtained, video information is flown according to pre-set flight paths by unmanned plane and acquired；
Extract the original image frame that video information includes default acquisition target；
The defect image frame for including in identification original image frame；
Intercept the video clip in video information comprising defect image frame；
Upload defect image frame and video clip.
In one embodiment, it is also performed the steps of when computer program is executed by processor and obtains each default acquisition
The coordinate information of target；According to the coordinate information of each default acquisition target, the flight range information of unmanned plane is determined；It obtains in real time
The obstacle information of flight range information；The flight path planning that unmanned plane is carried out according to obstacle information is generated and is pushed pre-
If flight path is to unmanned plane.
In one embodiment, also performed the steps of when computer program is executed by processor by defect image frame with
And each frame video image in the video clip of defect image frame is divided into the pixel region of multiple same sizes；By each picture
Plain region division is the subpixel area of multiple same sizes；Each subpixel area is compressed with preset compression ratio,
To form corresponding data block；All data blocks for being associated with a pixel region are arranged and are stored according to preset sequence
In one corresponding data block；All data blocks are arranged by preset sequence and are stored in storage unit, pressure is obtained
Contracting treated defect image frame and video clip.
In one embodiment, it also performs the steps of when computer program is executed by processor and is determined according to unmanned plane
Position information determines unmanned plane in the flight time section of each default acquisition target；Search the view in video information in flight time section
Frequency information；Picture frame is as original image frame in video information in extraction flight time section.
In one embodiment, acquisition default acquisition mesh is also performed the steps of when computer program is executed by processor
Each angular image of target；According to unmanned plane in the location information and camera angle information of each shooting time, unmanned plane is determined
The corresponding real-time original image frame of each angular image；Obtain the default angular image for acquiring target and corresponding real-time original image
The similarity of frame；When similarity is lower than default similarity threshold, determine that original image frame is defect image frame.
In one embodiment, it also performs the steps of when computer program is executed by processor and is determined according to unmanned plane
Position information determines unmanned plane in the flight time section of each default acquisition target；By the corresponding shooting time positioning of defect image frame
To flight time section；According to the corresponding shooting time of first time defect image frame and last time defect in each flight time section
The corresponding shooting time of picture frame intercepts the video clip in video information comprising defect image frame.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with
Instruct relevant hardware to complete by computer program, computer program to can be stored in a non-volatile computer readable
It takes in storage medium, the computer program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein, this Shen
Please provided by any reference used in each embodiment to memory, storage, database or other media, may each comprise
Non-volatile and/or volatile memory.Nonvolatile memory may include read-only memory (ROM), programming ROM
(PROM), electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include
Random access memory (RAM) or external cache.By way of illustration and not limitation, RAM is available in many forms,
Such as static state RAM (SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate sdram (DDRSDRAM), enhancing
Type SDRAM (ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM
(RDRAM), direct memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM) etc..
Each technical characteristic of above embodiments can be combined arbitrarily, for simplicity of description, not to above-described embodiment
In each technical characteristic it is all possible combination be all described, as long as however, the combination of these technical characteristics be not present lance
Shield all should be considered as described in this specification.
Above embodiments only express the several embodiments of the application, and the description thereof is more specific and detailed, but can not
Therefore it is construed as limiting the scope of the patent.It should be pointed out that for those of ordinary skill in the art, In
Under the premise of not departing from the application design, various modifications and improvements can be made, these belong to the protection scope of the application.
Therefore, the scope of protection shall be subject to the appended claims for the application patent.
Claims (10)
1. a kind of image data acquiring method, which comprises
The video information that unmanned plane uploads is obtained, the video information is adopted by the unmanned plane according to pre-set flight paths flight
Collection；
Extract the original image frame that the video information includes default acquisition target；
Identify the defect image frame for including in the original image frame；
Intercept the video clip in the video information comprising the defect image frame；
Upload the defect image frame and the video clip.
2. the method according to claim 1, wherein the video information for obtaining unmanned plane and uploading, the view
Before frequency information is acquired by the unmanned plane according to pre-set flight paths flight, further includes:
Obtain the coordinate information of each default acquisition target；
According to the coordinate information of each default acquisition target, the flight range information of unmanned plane is determined；
The obstacle information of the flight range information is obtained in real time；
The flight path planning that unmanned plane is carried out according to the obstacle information, generates and pushes pre-set flight paths to described
Unmanned plane.
3. the method according to claim 1, wherein before the upload defect image further include:
Each frame video image in the video clip of the defect image frame and the defect image frame is divided into multiple
The pixel region of same size；
Each pixel region is divided into the subpixel area of multiple same sizes；
Each subpixel area is compressed with preset compression ratio, to form corresponding data block；
All data blocks for being associated with a pixel region are arranged according to preset sequence and are stored in a corresponding data
In block；
All data blocks are arranged by preset sequence and are stored in storage unit, the defect after obtaining compression processing
Picture frame and the video clip；
The upload defect image frame and the video clip include:
The defect image frame and the video clip after uploading compression processing.
4. the method according to claim 1, wherein described extract the video information comprising presetting acquisition target
Original image frame include:
According to the location information of the unmanned plane, determine the unmanned plane in the flight time section of each default acquisition target；
Search the video information in the section of flight time described in the video information；
Picture frame is extracted in the video information in flight time section as original image frame.
5. the method according to claim 1, wherein the defect map for including in the identification original image frame
As frame includes:
Obtain each angular image of the default acquisition target；
According to the unmanned plane in the location information and camera angle information of each shooting time, each angle figure of unmanned plane is determined
As corresponding real-time original image frame；
Obtain the default angular image for acquiring target and the similarity of the corresponding real-time original image frame；
When the similarity is lower than default similarity threshold, determine the original image frame for defect image frame.
6. the method according to claim 1, wherein including the defect map in the interception video information
As the video clip of frame includes:
According to the location information of the unmanned plane, determine the unmanned plane in the flight time section of each default acquisition target；
The corresponding shooting time of the defect image frame is positioned to the flight time section；
It is corresponding with last time defect image frame according to the corresponding shooting time of first time defect image frame in each flight time section
Shooting time, intercept in the video information include the defect image frame video clip.
7. a kind of image data acquiring device, which is characterized in that described device includes:
Image data acquisition module, for obtaining the video information of unmanned plane upload, the video information is by the unmanned plane root
It flies and acquires according to pre-set flight paths；
Image frame extraction module, for extracting the original image frame that the video information includes default acquisition target；
Picture recognition module, the defect image frame for including in the original image frame for identification；
Video intercepting module, for intercepting the video clip in the video information comprising the defect image frame；
Information uploading module, for uploading the defect image frame and the video clip.
8. device according to claim 7, which is characterized in that it further include path planning module, the path planning module
It is specifically used for:
Obtain the coordinate information of each default acquisition target；
According to the coordinate information of each default acquisition target, the flight range information of unmanned plane is determined；
The obstacle information of the flight range information is obtained in real time；
The flight path planning that unmanned plane is carried out according to the obstacle information, generates and pushes pre-set flight paths to described
Unmanned plane.
9. a kind of computer equipment, including memory and processor, the memory are stored with computer program, feature exists
In the step of processor realizes any one of claims 1 to 6 the method when executing the computer program.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program
The step of method described in any one of claims 1 to 6 is realized when being executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910545160.7A CN110430389B (en) | 2019-06-21 | 2019-06-21 | Image data acquisition method and device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910545160.7A CN110430389B (en) | 2019-06-21 | 2019-06-21 | Image data acquisition method and device, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110430389A true CN110430389A (en) | 2019-11-08 |
| CN110430389B CN110430389B (en) | 2021-12-07 |
Family
ID=68409396
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910545160.7A Active CN110430389B (en) | 2019-06-21 | 2019-06-21 | Image data acquisition method and device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110430389B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112053647A (en) * | 2020-07-24 | 2020-12-08 | 华帝股份有限公司 | Method for acquiring function demonstration of intelligent household electrical appliance |
| CN112822497A (en) * | 2020-12-01 | 2021-05-18 | 青岛大学 | Video compression coding processing method based on edge calculation and related components |
| CN113255439A (en) * | 2021-04-13 | 2021-08-13 | 深圳市锐明技术股份有限公司 | Obstacle identification method, device, system, terminal and cloud |
| CN115604437A (en) * | 2022-12-15 | 2023-01-13 | 合肥岭雁科技有限公司（Cn） | Gateway data processing method, system, equipment and storage medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105160600A (en) * | 2015-09-23 | 2015-12-16 | 上海电巴新能源科技有限公司 | Iron tower structure inspection method for power supply line |
| CN105389555A (en) * | 2015-11-06 | 2016-03-09 | 天津航天中为数据系统科技有限公司 | Aerial-image-based hidden-danger target analysis method and system |
| CN106331712A (en) * | 2015-06-30 | 2017-01-11 | 展讯通信（上海）有限公司 | Video image compression method |
| CN107014827A (en) * | 2017-04-24 | 2017-08-04 | 国家电网公司 | Transmission line of electricity defect analysis method based on image processing, device and system |
| CN107172395A (en) * | 2017-06-01 | 2017-09-15 | 青岛科技大学 | Workshop monitoring system and method based on internet |
| CN207198666U (en) * | 2017-04-24 | 2018-04-06 | 国家电网公司 | Unmanned plane and UAS for transmission line of electricity image capturing |
| CN108389197A (en) * | 2018-02-26 | 2018-08-10 | 上海赛特斯信息科技股份有限公司 | Transmission line of electricity defect inspection method based on deep learning |
| CN109325936A (en) * | 2018-08-17 | 2019-02-12 | 国网天津市电力公司 | Controller switching equipment defect image identification terminal and method based on neural network deep learning |
| KR20190036589A (en) * | 2017-09-28 | 2019-04-05 | 주식회사 케이티 | Server for detecting bad solar panel |
| CN109640057A (en) * | 2018-12-30 | 2019-04-16 | 广东电网有限责任公司 | A kind of transmission line of electricity video monitoring method and relevant apparatus |
-
2019
- 2019-06-21 CN CN201910545160.7A patent/CN110430389B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106331712A (en) * | 2015-06-30 | 2017-01-11 | 展讯通信（上海）有限公司 | Video image compression method |
| CN105160600A (en) * | 2015-09-23 | 2015-12-16 | 上海电巴新能源科技有限公司 | Iron tower structure inspection method for power supply line |
| CN105389555A (en) * | 2015-11-06 | 2016-03-09 | 天津航天中为数据系统科技有限公司 | Aerial-image-based hidden-danger target analysis method and system |
| CN107014827A (en) * | 2017-04-24 | 2017-08-04 | 国家电网公司 | Transmission line of electricity defect analysis method based on image processing, device and system |
| CN207198666U (en) * | 2017-04-24 | 2018-04-06 | 国家电网公司 | Unmanned plane and UAS for transmission line of electricity image capturing |
| CN107172395A (en) * | 2017-06-01 | 2017-09-15 | 青岛科技大学 | Workshop monitoring system and method based on internet |
| KR20190036589A (en) * | 2017-09-28 | 2019-04-05 | 주식회사 케이티 | Server for detecting bad solar panel |
| CN108389197A (en) * | 2018-02-26 | 2018-08-10 | 上海赛特斯信息科技股份有限公司 | Transmission line of electricity defect inspection method based on deep learning |
| CN109325936A (en) * | 2018-08-17 | 2019-02-12 | 国网天津市电力公司 | Controller switching equipment defect image identification terminal and method based on neural network deep learning |
| CN109640057A (en) * | 2018-12-30 | 2019-04-16 | 广东电网有限责任公司 | A kind of transmission line of electricity video monitoring method and relevant apparatus |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112053647A (en) * | 2020-07-24 | 2020-12-08 | 华帝股份有限公司 | Method for acquiring function demonstration of intelligent household electrical appliance |
| CN112822497A (en) * | 2020-12-01 | 2021-05-18 | 青岛大学 | Video compression coding processing method based on edge calculation and related components |
| CN112822497B (en) * | 2020-12-01 | 2024-02-02 | 青岛大学 | Video compression coding processing method based on edge calculation and related components |
| CN113255439A (en) * | 2021-04-13 | 2021-08-13 | 深圳市锐明技术股份有限公司 | Obstacle identification method, device, system, terminal and cloud |
| CN113255439B (en) * | 2021-04-13 | 2024-01-12 | 深圳市锐明技术股份有限公司 | Obstacle identification method, device, system, terminal and cloud |
| CN115604437A (en) * | 2022-12-15 | 2023-01-13 | 合肥岭雁科技有限公司（Cn） | Gateway data processing method, system, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110430389B (en) | 2021-12-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110430389A (en) | Image data acquiring method, apparatus, computer equipment and storage medium | |
| US11897606B2 (en) | System and methods for improved aerial mapping with aerial vehicles | |
| CN108702444B (en) | Image processing method, unmanned aerial vehicle and system | |
| WO2021115124A1 (en) | Edge-cloud coordinated three-dimensional reconstruction method for farmland site | |
| CN112470092B (en) | Surveying and mapping system, surveying and mapping method, device, equipment and medium | |
| CN108370233B (en) | Method and equipment for detecting photovoltaic panel and unmanned aerial vehicle | |
| WO2017024975A1 (en) | Unmanned aerial vehicle portable ground station processing method and system | |
| CN111226185A (en) | Flight route generation method, control device and unmanned aerial vehicle system | |
| CN104615146A (en) | Unmanned aerial vehicle spraying operation automatic navigation method without need of external navigation signal | |
| CN111339893B (en) | Pipeline detection system and method based on deep learning and unmanned aerial vehicle | |
| US9418299B2 (en) | Surveillance process and apparatus | |
| CN206618697U (en) | A kind of high-voltage line image capturing system | |
| CN105527969A (en) | Mountain vegetation vertical zone investigation monitoring method based on UAV | |
| CN114255407B (en) | High-resolution-based anti-unmanned aerial vehicle multi-target identification and tracking video detection method | |
| CN102665039A (en) | Digital camera and operating method of camera by using cloud computing platform | |
| CN112508865A (en) | Unmanned aerial vehicle inspection obstacle avoidance method and device, computer equipment and storage medium | |
| CN112469967A (en) | Surveying and mapping system, surveying and mapping method, device, equipment and medium | |
| CN112000124A (en) | Unmanned aerial vehicle inspection method applied to power grid | |
| CN111527375B (en) | Planning method and device for surveying and mapping sampling point, control terminal and storage medium | |
| CN114200958A (en) | Automatic inspection system and method for photovoltaic power generation equipment | |
| US20180357932A1 (en) | Autonomous multi-pass data acquisition using unmanned aerial vehicles | |
| CN112106112A (en) | Point cloud fusion method, device and system and storage medium | |
| KR102547748B1 (en) | Server, method and computer program for managing digital twin model | |
| CN112613358A (en) | Article identification method, article identification device, storage medium, and electronic device | |
| CN111868656B (en) | Operation control system, operation control method, device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |