CN110044828A - A kind of coral active detector system and method for acousto-optic fusion - Google Patents
A kind of coral active detector system and method for acousto-optic fusion Download PDFInfo
- Publication number
- CN110044828A CN110044828A CN201910342484.0A CN201910342484A CN110044828A CN 110044828 A CN110044828 A CN 110044828A CN 201910342484 A CN201910342484 A CN 201910342484A CN 110044828 A CN110044828 A CN 110044828A
- Authority
- CN
- China
- Prior art keywords
- data
- coral
- target
- module
- acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 235000014653 Carica parviflora Nutrition 0.000 title claims abstract description 116
- 241000243321 Cnidaria Species 0.000 title claims abstract description 116
- 230000004927 fusion Effects 0.000 title claims abstract description 47
- 238000000034 method Methods 0.000 title claims abstract description 26
- 238000002604 ultrasonography Methods 0.000 claims abstract description 56
- 238000001514 detection method Methods 0.000 claims abstract description 37
- 230000000694 effects Effects 0.000 claims abstract description 30
- 230000003287 optical effect Effects 0.000 claims abstract description 21
- 230000003993 interaction Effects 0.000 claims abstract description 6
- 238000011282 treatment Methods 0.000 claims abstract description 6
- 238000004891 communication Methods 0.000 claims description 44
- 238000003860 storage Methods 0.000 claims description 25
- 238000012545 processing Methods 0.000 claims description 15
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims description 14
- 230000005540 biological transmission Effects 0.000 claims description 13
- 239000000523 sample Substances 0.000 claims description 11
- 230000003321 amplification Effects 0.000 claims description 10
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 10
- 238000006243 chemical reaction Methods 0.000 claims description 9
- 238000010219 correlation analysis Methods 0.000 claims description 7
- 230000008569 process Effects 0.000 claims description 7
- 238000004458 analytical method Methods 0.000 claims description 6
- 238000004061 bleaching Methods 0.000 claims description 4
- 230000004069 differentiation Effects 0.000 claims description 3
- 238000012423 maintenance Methods 0.000 claims description 3
- 238000009966 trimming Methods 0.000 claims description 3
- 230000008859 change Effects 0.000 claims description 2
- 239000000155 melt Substances 0.000 claims 1
- 238000012546 transfer Methods 0.000 claims 1
- 230000032258 transport Effects 0.000 claims 1
- 239000003643 water by type Substances 0.000 abstract description 6
- 238000005286 illumination Methods 0.000 abstract description 4
- 239000007844 bleaching agent Substances 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 7
- 238000011160 research Methods 0.000 description 6
- VTYYLEPIZMXCLO-UHFFFAOYSA-L Calcium carbonate Chemical group [Ca+2].[O-]C([O-])=O VTYYLEPIZMXCLO-UHFFFAOYSA-L 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 230000031068 symbiosis, encompassing mutualism through parasitism Effects 0.000 description 3
- 238000010521 absorption reaction Methods 0.000 description 2
- 238000009826 distribution Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000036541 health Effects 0.000 description 2
- 241000195493 Cryptophyta Species 0.000 description 1
- 241000700108 Ctenophora <comb jellyfish phylum> Species 0.000 description 1
- 241001269238 Data Species 0.000 description 1
- 241001465754 Metazoa Species 0.000 description 1
- 230000001154 acute effect Effects 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 229910000019 calcium carbonate Inorganic materials 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000012512 characterization method Methods 0.000 description 1
- 239000003653 coastal water Substances 0.000 description 1
- 238000004040 coloring Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000001727 in vivo Methods 0.000 description 1
- 229910052500 inorganic mineral Inorganic materials 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 239000011707 mineral Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000000644 propagated effect Effects 0.000 description 1
- 239000013535 sea water Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000002463 transducing effect Effects 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
- A01K—ANIMAL HUSBANDRY; AVICULTURE; APICULTURE; PISCICULTURE; FISHING; REARING OR BREEDING ANIMALS, NOT OTHERWISE PROVIDED FOR; NEW BREEDS OF ANIMALS
- A01K61/00—Culture of aquatic animals
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N29/00—Investigating or analysing materials by the use of ultrasonic, sonic or infrasonic waves; Visualisation of the interior of objects by transmitting ultrasonic or sonic waves through the object
- G01N29/04—Analysing solids
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S15/00—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
- G01S15/88—Sonar systems specially adapted for specific applications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S19/00—Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
- G01S19/38—Determining a navigation solution using signals transmitted by a satellite radio beacon positioning system
- G01S19/39—Determining a navigation solution using signals transmitted by a satellite radio beacon positioning system the satellite radio beacon positioning system transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
- G01S19/42—Determining position
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
- G08C17/02—Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/38—Services specially adapted for particular environments, situations or purposes for collecting sensor information
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A40/00—Adaptation technologies in agriculture, forestry, livestock or agroalimentary production
- Y02A40/80—Adaptation technologies in agriculture, forestry, livestock or agroalimentary production in fisheries management
- Y02A40/81—Aquaculture, e.g. of fish
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Remote Sensing (AREA)
- Radar, Positioning & Navigation (AREA)
- Life Sciences & Earth Sciences (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- Chemical & Material Sciences (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Acoustics & Sound (AREA)
- Environmental Sciences (AREA)
- Computing Systems (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Marine Sciences & Fisheries (AREA)
- Zoology (AREA)
- Animal Husbandry (AREA)
- Biodiversity & Conservation Biology (AREA)
- Medical Informatics (AREA)
- Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
Abstract
The invention discloses a kind of coral active detector system and methods of acousto-optic fusion, according to being hardened of reflecting of the weighting characteristics of coral and bleach, with ultrasonic echo be finally inversed by target coral locating for accurate location and soft or hard degree, auxiliary optical means acquire the color of coral, fusion treatment is carried out to the ultrasound data and optical data of the coral acquisition of different waters environment, to judge the activity of coral.The system includes the front-end acquisition device acquired for ultrasound data and light data and is responsible for that the data of acquisition handled, shown and realized with the background terminal of human-computer interaction.The present invention gives a kind of round-the-clock, inexpensive, lightweight intelligent solutions, reduce the economy and time cost of detection operations, breach the ocean illumination condition limitation that previous optical means faces, improve the robustness and accuracy of detection result.
Description
Technical field
The present invention relates to project cost consulting item Activity determination technical fields, and in particular to a kind of coral activity spy of acousto-optic fusion
Examining system and method.
Background technique
Up to ten thousand kinds of all kinds of marine organisms are inhabited in coral reef, are whether opened in marine ecosystems structural research, medicine
Important value is suffered from terms of hair, mineral exploration and extinct plants and animal, ancient geological sciences research or even coastal waters city guard against disaster.In recent years
Come, climate change and mankind's activity range expand and deeply, cause tremendous influence to coral reef ecologic system.Cause
This, has for the research of coral reef ecologic system, monitoring and protection work either in ecological level or economic level
Important meaning.It is indispensable when the wherein detection work of coral activity situation, even more research protection coral reef ecologic system
A step.
The active research mode of traditional coral is not only expended a large amount of based on in-site measurement, the method in kind salvaged
Time and manpower and material resources, in the real-time of acquisition data, there is huge limitation in space of collecting location etc..In addition, coral
The problem of the characteristics of coral reef is widely distributed, is relatively isolated between reef makes research cost is more acute.Remote sensing technology is as a kind of energy
It enough realizes large area, real-time observation, collect, the technology of processing data, be increasingly scientist's favor, but radio can only
The islands and reefs of the water surface or more are detected, and underwater situation cannot be detected, establishing method on the basis of optical sensor will receive
Influence on the technological layers such as resolution ratio and processing means.In addition, in more muddy or deeper waters, optical sensor
Value will also become very limited.Since sound can be propagated under water, therefore target is detected, is fixed sonar under water
Extensive utilization in position and communications applications, since corallite is smaller, detecting to it can only the relatively high ultrasound of selected frequency.
Coral polyp is many cells coelenterate, there is symbiosis zooxanthellae in vivo.The color of coral is mainly its symbiosis zooxanthellae
Color.The coral of loss of activity, symbiosis zooxanthellae can be discharged that coral polyp is external, show as the external color of coral by original
Bright-colored colour becomes the white of calcium carbonate skeleton script, this phenomenon is known as the albefaction of coral.It is generally acknowledged that coral bleaching is
The soft or hard degree of coral for the characterization of coral death, coral and health after death is different.In addition to main factor worm is yellow
Outside algae, the factors such as temperature, salinity, water flow, the depth of water in coral existence waters also have certain influence to coral growth, and then influence coral
The soft or hard degree of coral, while the difference of water environment also leads to the propagation characteristic difference of ultrasound.These combined factors cause to be good for
Coral whether health is variant to the absorption characteristic of ultrasound, and then influences the echo strength of supersonic sounding.In addition, coral divides mostly
Sea area of the cloth in 0-50 meters of ranges, and the anthozoic size of activity is fully able at 1 centimetre or so by the ultrasonic wave of certain frequency range
It detects well.
Supersonic sounding coral can detect coral present position, be depth, can also judge the activity of coral, and not
It is illuminated by the light the influence with seawater clarity.As described above, if the external color of coral becomes calcium carbonate from original bright-colored colour
The white of skeleton script then may determine that coral death, therefore from the analytic angle of color, it is aided with optical instrument, obtains target
The colouring information of coral, and then obtain to the double dimensions descriptions of the acousto-optic of coral bleaching situation, thus obtain accurately about
The active judgement of coral.
Summary of the invention
The purpose of the present invention is to solve existing detection methods can not be in muddy waters and the insufficient condition of intensity of illumination
Lower use, and the limitation influenced by ocean optical property.The present invention is hardened according to what the weighting characteristics of coral reflected
With bleach, with ultrasonic echo be finally inversed by target coral locating for accurate location and soft or hard degree, auxiliary optical means acquire coral
The color of coral carries out fusion treatment to the ultrasound data and optical data of the coral acquisition of different waters environment, to judge coral
The activity of coral realizes a kind of round-the-clock, inexpensive, lightweight acousto-optic fusion coral active detector system and method.
The first purpose of this invention can be reached by adopting the following technical scheme that:
A kind of coral active detector system of acousto-optic fusion, including by control module, data acquisition module, locating module,
Front end communications module, power supply composition front-end acquisition device and by fused data processor, storage unit, operation equipment, after
Hold the background terminal of communication module and display composition.
Further, each module of front-end acquisition device integrates, and is deployed in target reef group sea area, and carries out solid
It is fixed；Control module receives, handles and forwards the instruction sum number of data acquisition module, locating module and front end communications module transmission
According to overall control of the realization to data acquisition module, locating module and front end communications module；Data acquisition module is responsible for completing coral
The ultrasound data and light data of coral acquire；Locating module is realized with miniature GPS terminal, to carry in real time to backstage terminal report
The specific location of the front-end acquisition device of the locating module；Front end communications module realizes control module, data acquisition module, positioning
Module interconnects with background terminal data；Power supply is front-end acquisition device bulk supply.
Further, background terminal is responsible for being handled, shown and realized human-computer interaction to the data of acquisition；It is described to melt
Conjunction data processor pre-processes light data and ultrasound data, correlation analysis, priori data compare and then provide coral
Active judgement, while Prior Fusion database is updated using new acquisition data and judging result；The storage unit
Front-end acquisition device location data, the front-end acquisition device inputted to Prior Fusion data and back end communications module is received super
Sound and light data are stored, and location data is output to display so that staff confirms front-end acquisition device orientation；
The operation equipment realizes input of the staff to system；The back end communications module and front end communications module are wirelessly connected,
Realize the data interconnection of background terminal and each module of front-end acquisition device；The display for show setting parameter and target at
As display.
Further, data acquisition module includes mechanical control unit, ultrasound data acquisition unit and light data acquisition
Unit；Mechanical control unit realizes pitching, the rotation of the machine assembly structure of front-end acquisition device according to the instruction of background terminal
It operates so that detecting devices trimming locking detects target；Ultrasound data acquisition unit is responsible for emitting supersonic sounding signal and acquires coral
The ultrasound echo signal of coral reflection, the echo-signal are used for the Larger water depths measurement of coral and activity judgment；Light data acquisition
Unit realizes the high-resolution optical image taking to target.
Further, ultrasound data acquisition unit includes ultrasonic signal emission component and ultrasonic signal receiving part；Hair
Penetrate the broad-band ultrasonic detectable signal that component is 300kHz by ultrasonic transducer launching centre frequency.
Further, the fused data processor of background terminal carries out the parameters meters such as echo strength, time delay to ultrasound data
It calculates, the discriminance analysis of progress target coral after gray balance, illuminance correction etc. pre-process is carried out, to reflection mesh to optical data
The ultrasound data for marking soft or hard degree and the light data for indicating color of object carry out the fused datas such as correlation analysis and handle, to obtain
To the double dimensions descriptions of the acousto-optic of the albefaction situation of target coral this judgement coral activity key index, via with storage unit
The comparison of middle Prior Fusion data provides the differentiation of target coral activity situation, finally by accordingly result by connected display exhibition
Show to staff.
Further, in the storage unit of background terminal Prior Fusion database purchase priori different depth different activities
The ultrasound and light fused data of coral target, as the activity judgment standard to detection target；In addition to this, fused data is handled
Device, which can save the data and judging result that processing unit is handled each time as new priori data, enters storage unit more
New database；Re-optimization operation periodically is carried out to Prior Fusion database with more new database.
Second object of the present invention can be reached by adopting the following technical scheme that:
A kind of coral active detector method of acousto-optic fusion, the detection method the following steps are included:
S0, front-end acquisition device deployment:, will using unmanned plane or small-sized detection ship according to the distribution situation of target reef group
Front-end acquisition device is equably deployed to target sea area；
S1, front-end acquisition device deployment are usually in standby mode, and locating module is understood timing receipt and led to through front end at this time
Letter module uploads the GPS positioning data of itself to background terminal, and data acquisition module is then in close state；
S2, initialization: after staff confirms the target coral regional location for needing to detect, pass through the operation of background terminal
Equipment consults the location data for having disposed front-end acquisition device, and the nearest person in target area of adjusting the distance sends probe instructions and target
Location data；Enter after the front end communications module of front-end acquisition device platform terminal is sent upon receipt instruction and data and visits
Survey mode；Front end communications module will be transmitted to control module from the received instruction of background terminal；Control module controls data acquisition
The mechanical control unit of module rotates high-power transmitting probe and high-resolution underwater camera, pitch adjustment, so that
First sub-regions in its alignment target region；
S3, ultrasound data acquisition and transmission: after the completion of calibration, the ultrasound data acquisition unit of data acquisition module starts work
Make；Firstly, that the functional circuit of ultrasonic signal emission component generates background terminal, super through the wideband of communication module transmission so far
Acoustic detection signal carries out digital-to-analogue conversion and power amplification, is then popped one's head in by ultrasound emission and issues detectable signal；Ultrasonic signal connects
Component is received after the echo-signal for receiving target coral, after receiving the preposition amplification of circuit progress, analog-to-digital conversion, is transmitted to front end
Communication module carries out caching and subsequent transmission work；
S4, ultrasound data processing: data are stored and are transmitted to fused data processing by the storage unit of background terminal
Device；After fused data processor is analyzed and processed the parameters such as time delay, the echo strength of ultrasound echo signal, obtains to front end and adopt
Acquisition means further according to the pitch angle of mechanical device, acquire the Larger water depths of target, finally by distance and depth at a distance from target
The calculated result of degree is transmitted to control module through communication module；
S5, light data acquisition and transmission: after the control module target depth parameter that platform terminal generates upon receipt, control
The high-resolution underwater camera of light data acquisition unit adjusts lens focus according to depth parameter in data acquisition module, with right
Target coral carries out image data acquisition, and collected data are sent to background terminal through front end communications module；
S6, light data processing and data fusion: the storage unit of background terminal is logical through front end, rear end to front-end acquisition device
The data of letter module input are stored, and are transmitted to fused data processor and are carried out processing work；Fused data processor pair
Optical data carries out target identification analysis；In addition, fused data processor can also be to the ultrasound data of the reflection soft or hard degree of target
Carry out the fusion treatments such as correlation analysis with the light data for indicating color of object, thus obtain to the albefaction situation of target coral this
One judges the double dimension descriptions of the acousto-optic of coral activity key index；The difference of the Prior Fusion database purchase priori of storage unit
The ultrasound and light fused data of depth different activities degree coral, as the activity judgment standard to detection target；Fused data
The fused data for detecting target is compared processor with Prior Fusion data in storage unit, provides target coral activity shape
Condition differentiates, later by connected display exhibits to staff；
S7, the detection of next subregion: after the completion of subregion detection, control module will control the machinery of data acquisition module
Control unit rotates high-power transmitting probe and high-resolution underwater camera, pitch adjustment, so that its alignment target
Next sub-regions in region repeat step S3-S6 until the detection of all subregions finishes；At this point, fused data processor to
Display end of output detection request, after staff confirms, control module control front-end acquisition device come back to
Machine mode；
S8, next target detection: staff confirms the orientation of next target area, and passes through the positioning in fresh target region
Data are selected at a distance of nearest front-end acquisition device again, are detected to subsequent region；Step S3-S7 is repeated until all areas
Domain detection is completed；
S9, prior data bank maintenance with update: by each time detection work generation new acousto-optic fused data with it is corresponding
Differentiate as a result, being stored in the more new database of storage unit；Prior Fusion database will be periodically by number in more new database
According to being integrated, to guarantee the reliability of database, and then the final judging nicety rate of system is improved.
The present invention has the following advantages and effects with respect to the prior art:
1, the present invention is assisted based on supersonic sounding by optical instrument and priori data, in background terminal into
The method of row fused data processing completes the active detection operations of coral, cheap using associated ultrasonic and optical device
Feature, by replacing setting out the scheme of detecting ship with a kind of front-end acquisition device of fixation and using front-end collection, background process
Isolated structure gives a kind of inexpensive, round-the-clock, lightweight solution, so that the work of coral active detector can
Limitation of the traditional artificial method to place, time is broken through, the economy and time cost of staff are reduced.
2, present invention utilizes the characteristics of ultrasound to target coral depth measurement, while using the coral of different activities to ultrasound
This property of absorption characteristic difference, gives a kind of active method of supersonic sounding coral.This method can break through previous optics
The ocean illumination condition limitation that method faces enables detection operations unfavorable in illumination conditions such as rainy weather, muddy sea areas
In the case of be normally carried out, stronger adaptive capacity to environment can be possessed.
3, the present invention according to being hardened of reflecting of the weighting characteristics of coral and bleaches, and is finally inversed by target coral with ultrasonic echo
Accurate location locating for coral and soft or hard degree, auxiliary optical means acquire the color of coral, and then to different waters environment
The ultrasound data and optical data of coral acquisition carry out fusion treatment and improve detection result to judge the activity of coral
Robustness and accuracy.
4, the present invention has good expansion.Staff can increase different sensors in front-end acquisition device
To acquire target coral water environment parameter, such as temperature, salinity, water velocity, merged jointly with ultrasound and light data
Processing, so that detection result is more accurate.
Detailed description of the invention
Fig. 1 is a kind of structural block diagram of the coral active detector system of acousto-optic fusion disclosed by the invention；
Fig. 2 is data acquisition module structural block diagram in the present invention；
Fig. 3 is ultrasound data acquisition cellular construction block diagram in the present invention；
Fig. 4 is a kind of work flow diagram of the coral active detector method of acousto-optic fusion disclosed by the invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
Every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
Embodiment one
It is a kind of structural block diagram of the coral active detector system of acousto-optic fusion disclosed by the invention, the coral shown in Fig. 1
Active detector system includes the front end being made of control module, data acquisition module, locating module, front end communications module, power supply
Acquisition device and the backstage being made of fused data processor, storage unit, operation equipment, back end communications module and display
Terminal.
Each module of front-end acquisition device integrates, and is deployed in target reef group sea area, and fixed.Control module
It receives, the instruction and data of processing and forwarding data acquisition module, locating module and front end communications module transmission, realizes to data
The overall control of acquisition module, locating module and front end communications module.Data acquisition module is used to complete the ultrasound data of coral
It is acquired with light data.Locating module is realized using miniature GPS terminal, to carry the locating module to backstage terminal report in real time
Front-end acquisition device specific location.Front end communications module realizes control module, data acquisition module, locating module and backstage
The data interaction of terminal.Power supply is front-end acquisition device bulk supply.
Above-mentioned background terminal is responsible for being handled, shown and realized human-computer interaction to the data of acquisition.At fused data
Reason device pre-processes light data and ultrasound data, correlation analysis, priori data compare and then provide that coral is active to be sentenced
It is disconnected, while Prior Fusion database is updated using current acquisition data and judging result.Storage unit is to Prior Fusion
Data and the fore device location data of back end communications module input, the ultrasound of device acquisition and light data are stored, and
Location data is output to display so that staff confirms tool face azimuth.Operating equipment realizes staff to the defeated of system
Enter.Back end communications module and front end communications module are wirelessly connected, and realize the number of each module in background terminal and front-end acquisition device
According to interconnection.Display is for showing setting parameter and displaying target imaging.
It is the structural block diagram of data acquisition module in front-end acquisition device, including mechanical control unit, ultrasonic number shown in Fig. 2
According to acquisition unit and light data acquisition unit.Mechanical control unit realizes front-end acquisition device according to the instruction of background terminal
Pitching, the rotation process of machine assembly structure are so that detecting devices trimming locking detects target；Ultrasound data acquisition unit is responsible for
Emit supersonic sounding signal and acquire the ultrasound echo signal of coral reflection, which is used to survey the Larger water depths of coral
Fixed and activity judgment；Light data acquisition unit realizes the high-resolution optical image taking to target.
It is the structural block diagram of ultrasound data acquisition unit, including ultrasonic signal emission component and ultrasonic signal shown in Fig. 3
Receiving part.Ultrasonic signal emission component includes D/A converting circuit, power amplification circuit and utilization high-performance ultrasound transducing
The high-power transmitting probe of device building.Ultrasonic signal completes digital-to-analogue conversion and power amplification by emission element corresponding function circuit
Afterwards, the transmitting of signal is realized by probe.Ultrasonic signal receiving part by highly sensitive receiving transducer array, pre-amplification circuit,
Analog to digital conversion circuit is constituted.After receiving transducer array received to target echo signal, carried out via wherein corresponding functional circuit
After preposition amplification, analog-to-digital conversion, transmits signals to communication module and carry out caching and subsequent transmission work.
Embodiment two
It is working-flow figure shown in Fig. 4.The basic functional principle and process of the coral active detector method are as follows, packet
Include following steps:
S0, front-end acquisition device deployment:, will using unmanned plane or small-sized detection ship according to the distribution situation of target reef group
Front-end acquisition device is equably deployed to target sea area；
S1, front-end acquisition device deployment are usually in standby mode, and locating module is understood timing receipt and led to through front end at this time
Letter module uploads the GPS positioning data of itself to background terminal, and data acquisition module is then in close state；
S2, initialization: after staff confirms the target coral regional location for needing to detect, pass through the operation of background terminal
Equipment consults the location data for having disposed front-end acquisition device, and the nearest person in target area of adjusting the distance sends probe instructions and target
Location data；Enter after the front end communications module of front-end acquisition device platform terminal is sent upon receipt instruction and data and visits
Survey mode；Front end communications module will be transmitted to control module from the received instruction of background terminal；Control module controls data acquisition
The mechanical control unit of module rotates high-power transmitting probe and high-resolution underwater camera, pitch adjustment, so that
First sub-regions in its alignment target region；
S3, ultrasound data acquisition and transmission: after the completion of calibration, the ultrasound data acquisition unit of data acquisition module starts work
Make；Firstly, that the functional circuit of ultrasonic signal emission component generates background terminal, super through the wideband of communication module transmission so far
Acoustic detection signal carries out digital-to-analogue conversion and power amplification, is then popped one's head in by ultrasound emission and issues detectable signal；Ultrasonic signal connects
Component is received after the echo-signal for receiving target coral, after receiving the preposition amplification of circuit progress, analog-to-digital conversion, is transmitted to front end
Communication module carries out caching and subsequent transmission work；
S4, ultrasound data processing: data are stored and are transmitted to fused data processing by the storage unit of background terminal
Device；After fused data processor is analyzed and processed the parameters such as time delay, the echo strength of ultrasound echo signal, obtains to front end and adopt
Acquisition means further according to the pitch angle of mechanical device, acquire the Larger water depths of target, finally by distance and depth at a distance from target
The calculated result of degree is transmitted to control module through communication module；
S5, light data acquisition and transmission: after the control module target depth parameter that platform terminal generates upon receipt, control
The high-resolution underwater camera of light data acquisition unit adjusts lens focus according to depth parameter in data acquisition module, with right
Target coral carries out image data acquisition, and collected data are sent to background terminal through front end communications module；
S6, light data processing and data fusion: the storage unit of background terminal is logical through front end, rear end to front-end acquisition device
The data of letter module input are stored, and are transmitted to fused data processor and are carried out processing work；Fused data processor pair
Optical data carries out target identification analysis；In addition, fused data processor can also be to the ultrasound data of the reflection soft or hard degree of target
Carry out the fusion treatments such as correlation analysis with the light data for indicating color of object, thus obtain to the albefaction situation of target coral this
One judges the double dimension descriptions of the acousto-optic of coral activity key index；The difference of the Prior Fusion database purchase priori of storage unit
The ultrasound and light fused data of depth different activities degree coral, as the activity judgment standard to detection target；Fused data
The fused data for detecting target is compared processor with Prior Fusion data in storage unit, provides target coral activity shape
Condition differentiates, later by connected display exhibits to staff；
S7, the detection of next subregion: after the completion of subregion detection, control module will control the machinery of data acquisition module
Control unit rotates high-power transmitting probe and high-resolution underwater camera, pitch adjustment, so that its alignment target
Next sub-regions in region repeat step S3-S6 until the detection of all subregions finishes；At this point, fused data processor to
Display end of output detection request, after staff confirms, control module control front-end acquisition device come back to
Machine mode；
S8, next target detection: staff confirms the orientation of next target area, and passes through the positioning in fresh target region
Data are selected at a distance of nearest front-end acquisition device again, are detected to subsequent region；Step S3-S7 is repeated until all areas
Domain detection is completed；
S9, prior data bank maintenance with update: by each time detection work generation new acousto-optic fused data with it is corresponding
Differentiate as a result, being stored in the more new database of storage unit；Prior Fusion database will be periodically by number in more new database
According to being integrated, to guarantee the reliability of database, and then the final judging nicety rate of system is improved.
The above embodiment is a preferred embodiment of the present invention, but embodiments of the present invention are not by above-described embodiment
Limitation, other any changes, modifications, substitutions, combinations, simplifications made without departing from the spirit and principles of the present invention,
It should be equivalent substitute mode, be included within the scope of the present invention.
Claims (9)
1. a kind of coral active detector system of acousto-optic fusion, which is characterized in that the detection system includes being deployed in target reef
Multiple front-end acquisition devices in group sea area and the background terminal that computer room is set, wherein front-end acquisition device is used for ultrasound data
With the acquisition of light data, background terminal is for being handled, being shown and being realized human-computer interaction, multiple front ends to the data of acquisition
By being wirelessly connected between acquisition device and background terminal,
The front-end acquisition device includes control module, data acquisition module, locating module, front end communications module and power supply, institute
The instruction and data that control module received, and handled and forwarded data acquisition module, locating module and front end communications module transmission is stated,
The data acquisition module is used to acquire the ultrasound data and light data of coral；The locating module carries the positioning for acquiring
The specific location of the front-end acquisition device of module and in real time to backstage terminal report, the front end communications module realizes control mould
Block, the data exchange of data acquisition module, locating module and background terminal；
The background terminal includes fused data processor, storage unit, operation equipment, back end communications module and display, institute
State fused data processor light data and ultrasound data are pre-processed, correlation analysis, priori data compare so that provide
The active judgement of coral, while Prior Fusion database is updated using current acquisition data and judging result；It is described to deposit
Front-end acquisition device location data, the front-end acquisition device that storage unit inputs Prior Fusion data and back end communications module connect
The ultrasound and light data of receipts are stored, and location data is output to display so that staff confirms front-end acquisition device
Orientation；The operation equipment realizes input of the staff to system；The back end communications module and front end communications module are wireless
The data interaction of background terminal and front-end acquisition device is realized in connection；The display for show setting parameter and target at
As display.
2. a kind of coral active detector system of acousto-optic fusion according to claim 1, which is characterized in that the positioning mould
Block is realized using miniature GPS terminal.
3. a kind of coral active detector system of acousto-optic fusion according to claim 1, which is characterized in that adopt the front end
Acquisition means further include power supply, for front-end acquisition device bulk supply.
4. a kind of coral active detector system of acousto-optic fusion according to claim 1, which is characterized in that the data are adopted
Collecting module includes mechanical control unit, ultrasound data acquisition unit and light data acquisition unit, wherein the Mechanical course list
Member instructs the pitching for realizing the machine assembly structure of front-end acquisition device, rotation process so that detecting devices according to background terminal
Trimming locking detects target；The ultrasound data acquisition unit is used to emit supersonic sounding signal and acquire the ultrasound of coral reflection
Echo-signal；The light data acquisition unit is used for the high-resolution optical image of photographic subjects.
5. a kind of coral active detector system of acousto-optic fusion according to claim 1, which is characterized in that the ultrasound number
It include ultrasonic signal emission component and ultrasonic signal receiving part according to acquisition unit, wherein ultrasonic signal emission component passes through super
Sonic transducer launching centre frequency is the broad-band ultrasonic detectable signal of 300kHz.
6. a kind of coral active detector system of acousto-optic fusion according to claim 1, which is characterized in that the fusion number
Echo strength, delay parameter calculating are carried out to ultrasound data according to processor, gray balance is carried out to optical data, illuminance is corrected
Afterwards carry out target coral discriminance analysis, to reflection the soft or hard degree of target ultrasound data and indicate color of object light data into
The analysis of row correlation fusion obtains to the double dimension descriptions of the acousto-optic of target coral bleaching situation, melts via with priori in storage unit
The comparison for closing data provides the differentiation of target coral activity situation, accordingly result is finally output to display.
7. a kind of coral active detector system of acousto-optic fusion according to claim 1, which is characterized in that the storage is single
Member includes Prior Fusion database and more new database, wherein the different depth of the Prior Fusion database purchase priori is not
With the ultrasound and light fused data of activity coral target, as the activity judgment standard to detection target；The more new database
Data and judging result per treatment in fused data processor are stored as new priori data.
8. a kind of coral active detector method of acousto-optic fusion, which is characterized in that the detection method the following steps are included:
S1, the front-end acquisition device for being deployed in target reef group place sea area are in standby mode, and locating module timing receipt simultaneously passes through
Front end communications module uploads the GPS positioning data of itself to background terminal, and data acquisition module is in close state；
S2, according to the position of target coral search coverage, front-end collection dress has been disposed by the operation equipment access of background terminal
The location data set, the nearest front-end acquisition device in target area of adjusting the distance send the location data of probe instructions and target；
Front-end acquisition device enters detection mode after receiving the instruction and data that background terminal is sent by front end communications module, first
Front end communications module will be transmitted to control module from the received instruction of background terminal, and then control module controls data acquisition module
Mechanical control unit high-power transmitting probe and high-resolution underwater camera are rotated, pitch adjustment so that its is right
First sub-regions of quasi- target area；
The ultrasound data acquisition unit start-up operation of S3, data acquisition module, the first functional circuit of ultrasonic signal emission component
Digital-to-analogue conversion and power amplification are carried out to broad-band ultrasonic detectable signal, is then popped one's head in by ultrasound emission and issues detectable signal；It is super
Acoustical signal receiving part after receiving the preposition amplification of circuit progress, analog-to-digital conversion, passes after the echo-signal for receiving target coral
It transports to front end communications module and carries out caching and subsequent transmission work；
S4, background terminal storage unit will receive data and be stored and be transmitted to fused data processor, at fused data
After reason device is analyzed and processed echo strength, the delay parameter of ultrasound echo signal, front-end acquisition device and target are obtained
Distance acquires the Larger water depths of target further according to the pitch angle of mechanical device, finally passes through the calculated result of distance and depth
Back end communications module transfer is to control module；
After S5, control module the target depth parameter that platform terminal generates upon receipt, light data in data acquisition module is controlled
The high-resolution underwater camera of acquisition unit adjusts lens focus according to depth parameter, to carry out image data to target coral
Acquisition, and collected data are sent to background terminal through front end communications module；
S6, the data that the storage unit of background terminal inputs front-end acquisition device through front end, back end communications module store,
And it is transmitted to fused data processor and carries out processing work；Fused data processor carries out target identification analysis to optical data,
The light data of ultrasound data and expression color of object to the reflection soft or hard degree of target carries out correlation analysis, to obtain to mesh
Mark the double dimension descriptions of acousto-optic of coral bleaching situation；Fused data processor will be in the fused data and storage unit that detect target
Prior Fusion data are compared, and provide the differentiation of target coral activity situation, give work people by connected display exhibits later
Member；
The mechanical control unit that S7, control module control data acquisition module takes the photograph high-power transmitting probe and high-resolution under water
Shadow machine rotated, pitch adjustment, so that next sub-regions in its alignment target region, repeat step S3-S6 until all
Subregion detection finishes；The request that fused data processor will be detected to display end of output, after confirmed, control module control
Front-end acquisition device processed comes back to standby mode；
S8, the next target area of input orientation, and selected again by the location data in fresh target region before nearest
Acquisition device is held, subsequent region is detected, repeats step S3-S7 until all areas detection is completed.
9. a kind of coral active detector method of acousto-optic fusion according to claim 8, which is characterized in that the detection side
Method is further comprising the steps of:
S9, prior data bank maintenance and update: the new acousto-optic fused data that work generates will be detected each time and will be differentiated with corresponding
As a result, being stored in the more new database of storage unit, and periodically excellent again to the implementation of Prior Fusion database with more new database
Change operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910342484.0A CN110044828B (en) | 2019-04-26 | 2019-04-26 | Acousto-optic fused coral activity detection system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910342484.0A CN110044828B (en) | 2019-04-26 | 2019-04-26 | Acousto-optic fused coral activity detection system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110044828A true CN110044828A (en) | 2019-07-23 |
| CN110044828B CN110044828B (en) | 2022-12-16 |
Family
ID=67279499
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910342484.0A Expired - Fee Related CN110044828B (en) | 2019-04-26 | 2019-04-26 | Acousto-optic fused coral activity detection system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110044828B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110830583A (en) * | 2019-11-13 | 2020-02-21 | 中国联合网络通信集团有限公司 | Mine resource detection method, server and user side equipment |
| CN110889844A (en) * | 2019-11-29 | 2020-03-17 | 哈尔滨工程大学 | Coral distribution and health condition assessment method based on deep clustering analysis |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101539520A (en) * | 2009-04-17 | 2009-09-23 | 中国科学院南海海洋研究所 | Primary productivity fluorescence detecting system of seat-base type coral reef |
| CN101806693A (en) * | 2010-03-16 | 2010-08-18 | 中国科学院南海海洋研究所 | Method for monitoring growth and calcification rate of hermatypic coral in natural sea area |
| CN106086200A (en) * | 2016-07-04 | 2016-11-09 | 国家海洋局第三海洋研究所 | A kind of method for setting up the free technical specification warning coefficient H with endoparasitism phycobiont abundance and coral bleaching of Corallium Japonicum Kishinouye |
| US20170276829A1 (en) * | 2014-08-25 | 2017-09-28 | International Research Institute Of Stavanger As | Biosensor device, system and method for monitoring a deep-water sea-floor |
| CN109475343A (en) * | 2016-08-01 | 2019-03-15 | 深圳迈瑞生物医疗电子股份有限公司 | Ultrasonic elasticity measures display methods and system |
-
2019
- 2019-04-26 CN CN201910342484.0A patent/CN110044828B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101539520A (en) * | 2009-04-17 | 2009-09-23 | 中国科学院南海海洋研究所 | Primary productivity fluorescence detecting system of seat-base type coral reef |
| CN101806693A (en) * | 2010-03-16 | 2010-08-18 | 中国科学院南海海洋研究所 | Method for monitoring growth and calcification rate of hermatypic coral in natural sea area |
| US20170276829A1 (en) * | 2014-08-25 | 2017-09-28 | International Research Institute Of Stavanger As | Biosensor device, system and method for monitoring a deep-water sea-floor |
| CN106086200A (en) * | 2016-07-04 | 2016-11-09 | 国家海洋局第三海洋研究所 | A kind of method for setting up the free technical specification warning coefficient H with endoparasitism phycobiont abundance and coral bleaching of Corallium Japonicum Kishinouye |
| CN109475343A (en) * | 2016-08-01 | 2019-03-15 | 深圳迈瑞生物医疗电子股份有限公司 | Ultrasonic elasticity measures display methods and system |
Non-Patent Citations (4)
| Title |
|---|
| DIRK C.ZELLER: "Spawning aggregations: patterns of movement of he coral trout Plectropomus leopardus(Serranidae) as determined by ultrasonic telemetry", 《MAR ECOL PROG SER》 * |
| GREG FOSTER ET AL.: "Detecting end-member structural and biological elements of a coral reef using a single-beam acoustic ground discrimination system", 《INTERNATIONAL JOURNAL OF REMOTE SENSING》 * |
| 何晓娜: "海南七洲列岛周边珊瑚分布及其健康状况评价", 《湿地科学与管理》 * |
| 潘艳丽 等: "卫星遥感珊瑚礁白化概述", 《生态学报》 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110830583A (en) * | 2019-11-13 | 2020-02-21 | 中国联合网络通信集团有限公司 | Mine resource detection method, server and user side equipment |
| CN110889844A (en) * | 2019-11-29 | 2020-03-17 | 哈尔滨工程大学 | Coral distribution and health condition assessment method based on deep clustering analysis |
| CN110889844B (en) * | 2019-11-29 | 2023-03-21 | 哈尔滨工程大学 | Coral distribution and health condition assessment method based on deep clustering analysis |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110044828B (en) | 2022-12-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110414396B (en) | Unmanned ship perception fusion algorithm based on deep learning | |
| Zimmer et al. | Three-dimensional beam pattern of regular sperm whale clicks confirms bent-horn hypothesis | |
| Belcher et al. | Object identification with acoustic lenses | |
| CN103139482B (en) | Vision Builder for Automated Inspection is searched and rescued in the perils of the sea | |
| CN108415323A (en) | A kind of aquafarm intellectualized management system | |
| CN102928844B (en) | Underwater sub-wavelength resolution ratio three-dimensional imaging method | |
| US6829197B2 (en) | Acoustical imaging interferometer for detection of buried underwater objects | |
| US5168471A (en) | Integrated passive acoustic and active ultrasonic marine aquatic finder system | |
| CN109188421A (en) | A kind of maritime search and rescue system and method for unmanned rescue boat | |
| CN207908979U (en) | A kind of target identification tracing system of unmanned boat | |
| CN105572676A (en) | Seine object fish shoal tracking method based on horizontal fishgraph images | |
| CN107241533B (en) | A kind of battle array scanning laser imaging device and method under water | |
| CN106707287A (en) | Fish school quantity estimation method based on extended Kalman filtering combined with nearest neighbor clustering algorithm | |
| CN110044828A (en) | A kind of coral active detector system and method for acousto-optic fusion | |
| CN112180379A (en) | Fish data statistics and analysis system | |
| CN206516016U (en) | One kind is based on the intelligent intrusion detection equipment of multi-sensor fusion technology Initiative Defense | |
| CN114488164A (en) | Underwater vehicle synchronous positioning and mapping method and underwater vehicle | |
| CN107870335A (en) | The three-dimensional composite imaging method of EO-1 hyperion laser, system and nobody from the device that navigates | |
| CN116027349A (en) | Coral reef substrate classification method based on laser radar and side scan sonar data fusion | |
| CN109799493A (en) | Radar and Multisensor video fusion system and method | |
| CN113960625B (en) | Water depth inversion method based on satellite-borne single-photon laser active and passive remote sensing fusion | |
| CN110261932A (en) | A kind of polar region AUV acousto-optic detection system | |
| US6700833B2 (en) | Acoustical imaging interferometer for detection of buried underwater objects | |
| JP2000147117A (en) | Plotter system | |
| CN106872468B (en) | Laser differential imaging detection method and device thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20221216 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |