WO2024049376A1 - Drone fish detection system and algorithm - Google Patents

Drone fish detection system and algorithm Download PDF

Info

Publication number
WO2024049376A1
WO2024049376A1 PCT/TR2023/050097 TR2023050097W WO2024049376A1 WO 2024049376 A1 WO2024049376 A1 WO 2024049376A1 TR 2023050097 W TR2023050097 W TR 2023050097W WO 2024049376 A1 WO2024049376 A1 WO 2024049376A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
drone
module
artificial intelligence
fish
Prior art date
Application number
PCT/TR2023/050097
Other languages
French (fr)
Inventor
Abdulsamet HAŞILOĞLU
Mustafa TUNAY
Original Assignee
İstanbul Geli̇şi̇m Üni̇versi̇tesi̇
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by İstanbul Geli̇şi̇m Üni̇versi̇tesi̇ filed Critical İstanbul Geli̇şi̇m Üni̇versi̇tesi̇
Publication of WO2024049376A1 publication Critical patent/WO2024049376A1/en

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/86Combinations of sonar systems with lidar systems; Combinations of sonar systems with systems not using wave reflection
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/88Sonar systems specially adapted for specific applications
    • G01S15/96Sonar systems specially adapted for specific applications for locating fish
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64UUNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U10/00Type of UAV
    • B64U10/10Rotorcrafts
    • B64U10/13Flying platforms
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64UUNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U2101/00UAVs specially adapted for particular uses or applications
    • B64U2101/30UAVs specially adapted for particular uses or applications for imaging, photography or videography
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64UUNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U50/00Propulsion; Power supply
    • B64U50/30Supply or distribution of electrical power
    • B64U50/31Supply or distribution of electrical power generated by photovoltaics

Definitions

  • This invention is related to the artificial intelligence-based drone fish detection system and algorithm, which provides detailed detection of fish herds, etc. marine creatures by means of drones.
  • Fish finders used in the current system transmit the electrical signal to the mirrors in order to create a sound wave.
  • the wave is reflected back, and it is possible to interpret the underwater by converting it into an electrical signal.
  • the patent application US20130085630 describes a “Fishfinder Data Display Device, Fishfinder Device, Method of Specifying Destination and Computer Readable Media”.
  • the present invention includes a memory for storing the data obtained by the fish finder, and a display device containing the location information from which the data is received, a display unit, a controller for reading the position and autopilot operation.
  • the patent application CN110476860 describes a “Drone-Based Feeding System and Method”.
  • the present invention consists of a swarm detection device, a feeding drone and a cloud server.
  • the system that is the subject of the invention It provides monitoring of the fish flock and feeding it with a feeding drone.
  • the patent application TR201704522 describes a “Portable Fish Detector”.
  • the present invention deals with the portable fish detection device that detects the fish species, size, toxicity and prohibition status and informs the user on the visual screen.
  • This invention is a drone fish detection system and algorithm, and its feature is; Provides detailed detection of herds of fish, etc., by means of drones, provides high-performance, high-resolution images, has high accuracy, does not suffer from errors and performance reductions due to environmental factors, has high efficiency, low cost, simple, gives results without being affected by the characteristics of water and watercraft, It is a new technology based on artificial intelligence.
  • the invention in order to realize all the objectives mentioned above and which will emerge from the detailed description below; It enables the detection of fish herds or similar objects through drones in which camera and sensor systems are integrated.
  • the inventive system it is aimed to detect fish herds or similar objects in detail by processing the data obtained from the camera systems in autonomously flying drones through artificial intelligence algorithms and using the data obtained from the sensor system.
  • Image data of the water surface or underwater are obtained through the camera system included in the invention.
  • all data sets including camera data, location data, route data, etc., are stored in a database that is constantly updated.
  • the subject of the invention is not affected by the surrounding obstacles by covering both the drone and the drone propellers with a special light system in the system.
  • the invention allows the location data of fish herds or similar objects to be detected and allows the routes of sailors, fishermen, etc. to be created in advance.
  • Figure 1 A view of drone and mobile device interaction.
  • Figure 2 A modular view of the drone system.
  • Figure 3 A structural view of the drone system.
  • the invention is based on the fact that solar powered propellers provision of automatic flight (10), obtaining the data (20), obtain location data by means of obtaining the data (20), receipt of records (30) via the camera, control the operation of the control(40), unit transferring the data to transfer to the artificial intelligence module (50), analyzing the data transferred in the data analysis (60), processing the image data with processing with image processing techniques (70), obtaining the final detection data (80), updating (90) processing steps.
  • the propellers positioned around the drone operate with solar energy through the panels on it, allowing the drone to provision of automatic flight (10).
  • both the drone and the propeller are obtaining the data (20) such as photolumine scent in order to create an environmental perception and ensure that the system is affected by environmental obstacles in the least possible way.
  • data such as distance, location, direction, distance, etc.
  • a sensor system such as ultrasonic and/or radar, etc.
  • waves that vary according to the sensor system used, such as sound waves and/or electromagnetic waves obtaining the data (20).
  • receipt of records (30) of the water surface or underwater are taken by means of the camera system working in connection with the artificial intelligence module.
  • the image data obtained with the camera system and the sensor data obtained with the sensor system are transferred to the artificial intelligence module through the transfer to the artificial intelligence module (50).
  • the data obtained through the camera system and integrated into the artificial intelligence module are analyzed in the data analysis (60) before data processing.
  • image data is processing with image processing techniques (70) in the data processing module of the artificial intelligence module in order to calculate specific data such as the type, size and amount of sea creatures such as fish .
  • a subject in the system of the Invention Artificial Intelligence in drone detection module sensor system integrated in the module data obtained through the location, direction, distance, distance, etc and the data processing module of the data obtained in the type, size, quantity, such as specific data into a mixture of swarms of fish, of living etc obtaining the final detection data (80).
  • the raw image data obtained from the database contained in the artificial intelligence module in the invention subject system, the processed data processed in the data processing module, the fish obtained through the sensor, etc. the position, direction, distance, distance, coordinates, etc. belonging to living beings, the data, the drone route map data, the final result data obtained in the data detection module are continuously transferred and continuously updating (90) with the integration of all new and old data sets.

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)

Abstract

This invention is related to the artificial intelligence-based drone fish detection system and algorithm, which provides detailed detection of fish herds, etc. marine creatures by means of drones and its feature is; the propellers positioned around the drone are powered by solar energy to provision of automatic flight (10), obtaining the data (20) about the location, direction, distance, distance, etc. of fish flocks, sea creatures, etc., by means of a sensor, such as ultrasonic and/or radar, etc. integrated into the drone, receipt of records (30) of fish herds etc. via the camera integrated into the drone, control (40) unit integrated into the drone controls the operation of the drone and the modules integrated into the drone, transfer to the Artificial Intelligence Module (50) integrated into the drone via the data integration module, analysis of the data transferred in the data analysis (60) module in the artificial intelligence module, processing with image processing techniques (70) in the data processing module in the artificial intelligence module obtaining the final detection data (80) of fish flocks, etc., by blending the image and sensor data in the data detection module in the artificial intelligence module and continuous updating (90) of the database in the artificial intelligence module with the integration of all new and old data sets includes the process steps.

Description

DRONE FISH DETECTION SYSTEM AND ALGORITHM
Technical Field:
This invention is related to the artificial intelligence-based drone fish detection system and algorithm, which provides detailed detection of fish herds, etc. marine creatures by means of drones.
State of the Art:
Various techniques are used to detect fish today. With the development of technology, these techniques have been automated to make human life easier. The fish finders used in the current system enable the monitoring of the points where the fish are concentrated with the sound frequencies.
In order to get high efficiency from fish finders, it is necessary to fulfill many different criteria. The performance of fish finders varies depending on the salt content of the sea, its depth, wave condition, degree of turbidity, etc., the structure of the boat, the type of mirror to be connected, the power of the mirror, the way and size of the mirror attachment. For example, if a recessed mirror is to be used, costly and damaging applications such as drilling the bottom of the boat must be carried out.
Fish finders used in the current system transmit the electrical signal to the mirrors in order to create a sound wave. When the sound waves sent by the mirrors hit any object, the wave is reflected back, and it is possible to interpret the underwater by converting it into an electrical signal.
The patent application US20130085630 describes a “Fishfinder Data Display Device, Fishfinder Device, Method of Specifying Destination and Computer Readable Media”. The present invention includes a memory for storing the data obtained by the fish finder, and a display device containing the location information from which the data is received, a display unit, a controller for reading the position and autopilot operation.
The patent application CN110476860 describes a “Drone-Based Feeding System and Method”. The present invention; It consists of a swarm detection device, a feeding drone and a cloud server. The system that is the subject of the invention; It provides monitoring of the fish flock and feeding it with a feeding drone.
The patent application TR201704522 describes a “Portable Fish Detector”. The present invention; It deals with the portable fish detection device that detects the fish species, size, toxicity and prohibition status and informs the user on the visual screen.
There are no artificial intelligence-based systems in existing systems. In this respect, decision-making mechanisms remain primitive because they have not developed.
As a result, high efficiency, low cost, simple, high-performance, high-accuracy, high- resolution images that can overcome the above-mentioned disadvantages and enable detailed detection of sea creatures such as fish flocks, high-resolution images due to environmental factors, high efficiency, low cost, there is a need for a new artificial intelligence-based technology that gives results without being affected by the features of the vehicle.
Description of the Invention:
This invention is a drone fish detection system and algorithm, and its feature is; Provides detailed detection of herds of fish, etc., by means of drones, provides high-performance, high-resolution images, has high accuracy, does not suffer from errors and performance reductions due to environmental factors, has high efficiency, low cost, simple, gives results without being affected by the characteristics of water and watercraft, It is a new technology based on artificial intelligence. The invention in order to realize all the objectives mentioned above and which will emerge from the detailed description below; It enables the detection of fish herds or similar objects through drones in which camera and sensor systems are integrated.
In the inventive system, it is aimed to detect fish herds or similar objects in detail by processing the data obtained from the camera systems in autonomously flying drones through artificial intelligence algorithms and using the data obtained from the sensor system.
Image data of the water surface or underwater are obtained through the camera system included in the invention.
Detailed location data of fish herds or similar objects are obtained through the location and distance sensors included in the invention.
By means of artificial intelligence algorithms included in the invention, data are processed and fish herds or similar objects are detected.
In the system subject to the invention, all data sets, including camera data, location data, route data, etc., are stored in a database that is constantly updated.
The subject of the invention is not affected by the surrounding obstacles by covering both the drone and the drone propellers with a special light system in the system.
The invention allows the location data of fish herds or similar objects to be detected and allows the routes of sailors, fishermen, etc. to be created in advance.
The characteristic features of the products of the invention and the advantages outlined below and all structural shapes, and these shapes by making references to the detailed written description will be understood more clearly and, therefore, must be made in consideration of the evaluation of these figures and detailed description. Description of the Figures:
The invention will be described with reference to the accompanying figures, so that the features of the invention will be more clearly understood and appreciated, but the purpose of this is not to limit the invention to these certain regulations. On the contrary, it is intended to cover all alternatives, changes and equivalences that can be included in the area of the invention defined by the accompanying claims. The details shown should be understood that they are shown only for the purpose of describing the preferred embodiments of the present invention and are presented in order to provide the most convenient and easily understandable description of both the shaping of methods and the rules and conceptual features of the invention. In these drawings.
Figure 1 A view of drone and mobile device interaction.
Figure 2 A modular view of the drone system.
Figure 3 A structural view of the drone system.
The figures to help understand the present invention are numbered as indicated in the attached image and are given below along with their names.
Description of References:
10. Provision of Automatic Flight
20. Obtaining the Data
30. Receipt of Records
40. Control
50. Transfer to the Artificial Intelligence Module
60. Data Analysis
70. Processing with Image Processing Techniques
80. Obtaining the Final Detection Data
90. Updating Detailed Description of The Invention:
The invention is based on the fact that solar powered propellers provision of automatic flight (10), obtaining the data (20), obtain location data by means of obtaining the data (20), receipt of records (30) via the camera, control the operation of the control(40), unit transferring the data to transfer to the artificial intelligence module (50), analyzing the data transferred in the data analysis (60), processing the image data with processing with image processing techniques (70), obtaining the final detection data (80), updating (90) processing steps.
In the system of the invention, the propellers positioned around the drone operate with solar energy through the panels on it, allowing the drone to provision of automatic flight (10).
In the system subject to the invention, both the drone and the propeller are obtaining the data (20) such as photolumine scent in order to create an environmental perception and ensure that the system is affected by environmental obstacles in the least possible way.
In the system subject to the invention, data such as distance, location, direction, distance, etc., are obtained by means of a sensor system, such as ultrasonic and/or radar, etc., by means of waves that vary according to the sensor system used, such as sound waves and/or electromagnetic waves obtaining the data (20).
In the system that is the subject of the invention, receipt of records (30) of the water surface or underwater are taken by means of the camera system working in connection with the artificial intelligence module.
It controls (40) the functioning of the artificial intelligence module, the data analysis module integrated into the artificial intelligence module, the data processing module, the data detection module, the data integration module and the database. In the system subject to the invention, the image data obtained with the camera system and the sensor data obtained with the sensor system are transferred to the artificial intelligence module through the transfer to the artificial intelligence module (50).
In the inventive system, the data obtained through the camera system and integrated into the artificial intelligence module are analyzed in the data analysis (60) before data processing.
In the system that is the subject of the invention, image data is processing with image processing techniques (70) in the data processing module of the artificial intelligence module in order to calculate specific data such as the type, size and amount of sea creatures such as fish .
A subject in the system of the Invention, Artificial Intelligence in drone detection module sensor system integrated in the module data obtained through the location, direction, distance, distance, etc and the data processing module of the data obtained in the type, size, quantity, such as specific data into a mixture of swarms of fish, of living etc obtaining the final detection data (80).
The raw image data obtained from the database contained in the artificial intelligence module in the invention subject system, the processed data processed in the data processing module, the fish obtained through the sensor, etc. the position, direction, distance, distance, coordinates, etc. belonging to living beings, the data, the drone route map data, the final result data obtained in the data detection module are continuously transferred and continuously updating (90) with the integration of all new and old data sets.

Claims

CLAIMS - The invention relates to the drone fish detection system and algorithm, and its feature is;
- the propellers positioned around the drone are powered by solar energy to provision of automatic flight (10), obtaining the data (20) about the location, direction, distance, distance, etc. of fish flocks, sea creatures, etc., by means of a sensor, such as ultrasonic and/or radar, etc. integrated into the drone, receipt of records (30) of fish herds etc. via the camera integrated into the drone, control (40) unit integrated into the drone controls the operation of the drone and the modules integrated into the drone,
- transfer to the Artificial Intelligence Module (50) integrated into the drone via the data integration module, analysis of the data transferred in the data analysis (60) module in the artificial intelligence module, processing with image processing techniques (70) in the data processing module in the artificial intelligence module obtaining the final detection data (80) of fish flocks, etc., by blending the image and sensor data in the data detection module in the artificial intelligence module and continuous updating (90) of the database in the artificial intelligence module with the integration of all new and old data sets includes the process steps.
PCT/TR2023/050097 2022-08-29 2023-02-06 Drone fish detection system and algorithm WO2024049376A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
TR2022/013492 2022-08-29
TR2022/013492A TR2022013492A2 (en) 2022-08-29 2022-08-29 FISH DETECTION SYSTEM AND ALGORITHM WITH DRON

Publications (1)

Publication Number Publication Date
WO2024049376A1 true WO2024049376A1 (en) 2024-03-07

Family

ID=85162092

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/TR2023/050097 WO2024049376A1 (en) 2022-08-29 2023-02-06 Drone fish detection system and algorithm

Country Status (2)

Country Link
TR (1) TR2022013492A2 (en)
WO (1) WO2024049376A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118525760A (en) * 2024-07-25 2024-08-23 四川省农业机械科学研究院 Solar intelligent temperature control yak breeding system

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20200128221A (en) * 2019-04-18 2020-11-12 이기택 Smart fish farm management system
WO2022107513A1 (en) * 2020-11-19 2022-05-27 東京幻実株式会社 Fishing system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20200128221A (en) * 2019-04-18 2020-11-12 이기택 Smart fish farm management system
WO2022107513A1 (en) * 2020-11-19 2022-05-27 東京幻実株式会社 Fishing system
JP2022081369A (en) * 2020-11-19 2022-05-31 東京幻実株式会社 Fishing system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118525760A (en) * 2024-07-25 2024-08-23 四川省农业机械科学研究院 Solar intelligent temperature control yak breeding system

Also Published As

Publication number Publication date
TR2022013492A2 (en) 2022-10-21

Similar Documents

Publication Publication Date Title
KR102604969B1 (en) Autonomous navigation method using image segmentation
Armstrong et al. Underwater robotic technology for imaging mesophotic coral ecosystems
Polvara et al. Obstacle avoidance approaches for autonomous navigation of unmanned surface vehicles
Huvenne et al. Rovs and auvs
Watanabe et al. Underwater and airborne monitoring of marine ecosystems and debris
Allotta et al. The ARROWS project: adapting and developing robotics technologies for underwater archaeology
KR102339465B1 (en) Autonomous navigation ship system for removing sea waste based on deep learning-vision recognition
Zwolak et al. The autonomous underwater vehicle integrated with the unmanned surface vessel mapping the Southern Ionian Sea. The Winning Technology Solution of the Shell Ocean Discovery XPRIZE
Maki et al. Tracking a sea turtle by an AUV with a multibeam imaging sonar: Toward robotic observation of marine life
CN109515086A (en) Hydrospace detection robot and its operational method
KR102466804B1 (en) Autonomous navigation method using image segmentation
Johansen et al. Unmanned aerial surveillance system for hazard collision avoidance in autonomous shipping
EP0772787B1 (en) A system for underwater survey operations
CN112219801A (en) System and method for positioning fishes and other aquatic animals by unmanned aerial vehicle
Totland et al. Kayak Drone–a silent acoustic unmanned surface vehicle for marine research
Iacoponi et al. H-surf: Heterogeneous swarm of underwater robotic fish
Nash et al. Tracking the fine scale movements of fish using autonomous maritime robotics: A systematic state of the art review
Borovik et al. Experience of Using the Autonomous Underwater Vehicle MMT-3000 for Research on Benthic Communities in Antartica
CN116859948A (en) Autonomous navigation control method and system for unmanned ship for channel sweep based on target detection algorithm
WO2024049376A1 (en) Drone fish detection system and algorithm
Cardaillac et al. Application of maneuvering based control for autonomous inspection of aquaculture net pens
Pulido et al. Time and cost-efficient bathymetric mapping system using sparse point cloud generation and automatic object detection
Neto et al. Autonomous underwater vehicle to inspect hydroelectric dams
Mindell et al. New archaeological uses of autonomous underwater vehicles
WO2023164705A1 (en) Bird's eye view (bev) semantic mapping systems and methods using monocular camera

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23860994

Country of ref document: EP

Kind code of ref document: A1