AU2021106130A4

AU2021106130A4 - Fish Recognition System

Info

Publication number: AU2021106130A4
Application number: AU2021106130A
Authority: AU
Inventors: Edmond Wong
Original assignee: Fish Id Innovation Lab Pty Ltd
Current assignee: Fish Id Innovation Lab Pty Ltd
Priority date: 2021-08-20
Filing date: 2021-08-20
Publication date: 2021-10-28
Anticipated expiration: 2029-08-20
Also published as: AU2021106130B4

Abstract

usersr\AppUaa\Koaming\Managc w or\KecenrtunOJVOVAU <Isn Kecogntonb ystCminpecifncation ca - I11 0- 93O op5O( 0/.l.aOx-ZU I ABSTRACT An apparatus for imaging fish, the apparatus including a body having: a channel extending across the body from an opening to an exit, the opening being configured to receive a fish to be imaged and the exit being configured to allow the fish to be released from the channel; a cavity configured to contain an imaging device and an illumination source; and, a window separating the cavity and the channel so that the imaging device can capture an image of the fish through the window while the fish is positioned within the channel. 1/5 100 101 132 131 k 120 130 110 Fig. 1A

Description

1/5

100 101 132

131

k 120 130 110

Fig. 1A u:\usersr\AppUaa\Koaming\Managc w or\KeceniituJvOVOVAU IsnKecognitiongf ysl emnbpcinncation asme0a0-ro5V asV(3 op in? u/ .1).aoCx-U ThuZ I

-1

FISH RECOGNITION SYSTEM

Background of the Invention

[0001] The present invention relates to apparatuses and methods for capturing images of fish.

Description of the Prior Art

[0002] The reference in this specification to any prior publication (or information derived from it), or to any matter which is known, is not, and should not be taken as an acknowledgment or admission or any form of suggestion that the prior publication (or information derived from it) or known matter forms part of the common general knowledge in the field of endeavour to which this specification relates.

[0003] In some cases it is necessary to determine the different locations in which certain fish are caught, for example for the purpose of monitoring fish stocks. As such, it may be necessary to identify fish upon capture and track them until being passed to the final consumer.

[0004] Previous methods for identifying or tracking fish (or other creatures) may require the physical marking of fish or implanting tracking devices/tracking numbers onto individual fish and such methods hold a number of disadvantages. Firstly, markings, tracking devices and/or tracking numbers may no longer be able to identify fish if harm comes to the fish (resulting in such markings being stripped or devices being knocked free of the fish). Secondly, these methods are impractical and expensive to implement on a large or commercial scale. Thirdly, if implementing these methods on a substantial scale, they can result in undesirable environmental destruction.

Summary of the Invention

[0005] In one broad form, an apparatus for imaging fish, the apparatus including a body having: a channel extending across the body from an opening to an exit, the opening being configured to receive a fish to be imaged and the exit being configured to allow the fish to be released from the channel; a cavity configured to contain an imaging device and an illumination source; and, a window separating the cavity and the channel so that the imaging device can capture an image of the fish through the window while the fish is positioned within the channel.

u:\usersrAppUaa\Koaming\ManageVw orI\KecenurKC vovaiOsVOV nKecognItionb ysemnbpcihncaton as mea0-3 o p inSu/.l.aOx-Z 9O5V /S/Zu I

-2

[0006] In one embodiment, the cavity is sealed such that the illumination source and the imaging device are at least partially protected from fluids.

[0007] In one embodiment, the imaging device continuously records images, and wherein the images are analysed to detect when a fish is positioned within the channel to thereby capture an image of the fish.

[0008] In one embodiment, when the imaging device captures an image of the fish, the apparatus emits a notification.

[0009] In one embodiment, the apparatus further includes one or more processing devices configured to provide instructions to at least one of: the imaging device; and, the illumination source.

[0010] In one embodiment, the one or more processing devices provide instructions through at least one of: a wired connection; and, a wireless connection.

[0011] In one embodiment, the imaging device is a camera.

[0012] In one embodiment, the image of the fish is used to at least one of: identify the fish; track the fish; perform image recognition to track the fish; and, perform image recognition using machine learning to track the fish.

[0013] In one embodiment, the fish is a coral trout.

[0014] In one embodiment, the fish can be identified by unique patterns on the side of the fish.

[0015] In one embodiment, the body further includes an image display unit that incorporates the illumination source.

[0016] In one embodiment, the image display unit is magnetically mounted to the body.

[0017] In one broad form, a method for imaging fish, the method including: receiving a fish to be image into a channel, extending across a body from an opening to an exit, through the opening; positioning the fish into a cavity where the fish is illuminated by an illumination source; u:\usersr\AppUaa\Koaming\ManageVw orI\KecenurK C vovaiOsVOV nKecognItionb ysemnbpcihncaton as mea0-3 o p inSu/.l.aOx-Z 9O5V /S/Zu I

-3

capturing an image of the fish through a window while the fish is positioned within the cavity with an imaging device; and, releasing the fish from the channel through the exit.

[0018] In one embodiment, the fish to be imaged is: caught using a fishing line; and, removing from the fishing line such that the fish can be received into the channel.

[0019] In one embodiment, the fish is received into the channel by placing the fish into the opening.

[0020] In one embodiment, after the fish is released through the exit, the fish is released into a water storage vessel.

Brief Description of the Drawings

[0021] Various examples and embodiments of the present invention will now be described with reference to the accompanying drawings, in which:

[0022] Figure 1A is a schematic drawing showing an example of the cavity and chamber;

[0023] Figure lB is a cross-sectional drawing along line X-X of Figure 1A showing an example of the window;

[0024] Figure 2 is a flow chart of an example of a process of capturing an image of a fish;

[0025] Figure 3 is a flow chart of an example of a process of catching, capturing an image and storing a fish; and,

[0026] Figure 4 is a schematic drawing showing an example of line fishing used to catch fish.

Detailed Description of the Preferred Embodiments

[0027] An example of an apparatus 100 for imaging fish will now be described with reference to Figures 1A and 1B.

[0028] The apparatus 100 includes a body 101 which further includes a channel 120, a cavity 130 and a window 110. The channel extends across the body 101 and includes an opening 121 u:\usersr\AppUaa\Koaming\Managew orI\KecenuorK Oivova <isnKecognition ysemnbpc iicaton as tuca0-5r5 3 3 p in / .l.aOx-ZU/us/uz I

-4

and an exit 122. The opening 121 is configured to receive a fish allowing this to be placed in the channel for imaging before, being subsequently released via the opening.

[0029] The cavity 130 is configured to contain an imaging device 131 and an illumination source 132. A person skilled in the art would appreciate that the imaging device 131 could any one of a number of devices (i.e. a camera, video recorder etc.) so long as the imaging device 131 is capable of capturing at least an image of the fish. Depending on the fish being imaged and lighting conditions, the illumination source 132 can be used to illuminate the channel 120 to grant further clarity to the images captured by the imaging device 131, and ensure consistent illumination between different imaging steps. A person skilled in the art would appreciate that the illumination source 132 could take many forms (i.e. an LED or halogen light etc.) and could further include its own power source (i.e. a rechargeable battery bank).

[0030] The window 110 separates the channel 120 and the cavity 130. The imaging device 131 can capture an image of the fish through the window 110 while the fish is position within the channel 120. The window 110 provides a view for the imaging device 131 and illumination source 132 such that the imaging device 131 can capture an image of the fish when the fish is in the correct position within the channel 120.

[0031] An example of a method for imaging fish will now be described with reference to Figure 2.

[0032] At step 200, a fish is received that is to be imaged. The received fish may be received into a channel, which extends across a body from an opening to an exit such that the received fish may pass through the body from the opening to the exit through the channel. A person skilled in the art would appreciate a plurality of ways a fish may be received. For example, the opening could be shaped such that a user may place a fish into the opening and the fish will be guided through the channel without further assistance. Alternatively, the opening may be configured to operate with an automated system where fish are placed within the channel without requiring user interaction. The exit is configured to allow the fish to be released from the channel where a person skilled in the art would appreciate a plurality of ways a fish may exit the channel. For example, following the imaging of the fish, the fish may be released by the exit into a water u:\usersijr\AppUata\Koaming\Managc w orI\KecenirtunnOJVOVAU <IsnKecognition ysemnbpc iicaton as1110ca -o 5V asV( op in)u/ .1).aoCx-U SuZ I

-5

storage vessel for subsequent transport. Alternatively, the fish may be released by the exit back into a natural habitat.

[0033] At step 210, the fish is positioned so that it can be imaged. The fish is to be positioned within the cavity where it is illuminated by an illumination source. Positioning the fish in the cavity further allows the fish to present the relevant portion of the fish such that it optimises the effectiveness of the image. A person skilled in the art would appreciate that the optimal positioning varies depending on the fish being imaged and the purpose for the imaging.

[0034] At step 220, an image of the fish is captured. This image is captured by an imaging device through a window separating the channel and cavity while the fish is positioned within the cavity.

[0035] At step 230, the fish is released following an image of the fish being captured. The released fish may be released in a number of manners, as a person skilled in the art would appreciate, depending on the desired implementation of the invention. For example, the fish may be released into a water storage vessel where it be transported to a subsequent location, alternatively, the fish may be released back into the wild.

[0036] The above examples allow for an apparatus/method that can capture an image of a fish in a fashion that allows for more consistency. Capturing consistent images of fish can be difficult without specialised and potentially expensive equipment. A user attempting to capture an image of a fish is difficult due the slipperiness of the fish and is likely to result in inconsistent imaging of the fish. Additional difficulties could arise from strong winds, ocean spray, variable lighting conditions and other such variables that reduces the capacity to take consistent imaging of fish.

[0037] Inconsistent imaging of the fish will make subsequent applications of fish imaging less effective. For example, images of the fish could be used to identify the fish in order to monitor fish movement following transport or release back into the wild. If the imaging of the fish is inconsistent, attempts to analyse the images in order to identify the fish will be ineffective and potentially lead to the movements of imaged fish being incorrectly monitored. Therefore, increasing the consistency of fish imaging can allow for more effective subsequent applicants without the need for specialised, expensive equipment.

u:\usersgr\AppUata\Koaming\1Managc w orI\KecenirtunnOJVOVAU IsnKecognition ysemnbpc iicaton as1110ca -o 5V asV(Zop in)u/ .1).aoCx-U SuZ I

-6

[0038] A number of further features will now be described.

[0039] In one example, the cavity 130 is sealed such that the illumination source 132 and the imaging device 131 are at least partially protected from fluids. Typical illumination sources 132 and imaging devices 131 are not waterproof or otherwise considered protected from exposure to fluids and the process of imaging a fish is likely to result in unpredictable spray exposure, partially when handling live fish. Hence, typical illumination sources 132 and imaging devices 131 may be damaged if used to capture images of fish. While this issue may be circumvented by using waterproof/water resistance illumination sources/imaging devices, a more cost effective apparatus can protect the illumination source 132 and imaging device 131 by sealing the cavity 130 to thereby reduce the possibility of damage arising from fluid related exposure.

[0040] In one example, the apparatus 100 further includes one or more processing devices configured to provide instructions to the imaging device 131 and/or the illumination source 132. Further, the one or more processing devices are configured to provide instructions through a wired connection and/or a wireless connection. The one or more processing devices can also be configured to stage images, through the use of a storage medium, such that the images captured could be used in subsequent image recognition applications. For example, an image of the fish could be analysed by image recognition software, allowing the fish to be identified at a later date. Additionally, the images captured can include embedded information relating to location data (i.e. GPS data etc.) of the fish when capturing an image of the fish, which can assist in tracking the movements of fish.

[0041] In one example, the imaging device 131 continuously records images, and wherein the images are analysed, where the one or more processing devices may perform this analysis, to detect when a fish is positioned within the channel to thereby capture an image of the fish. While it is possible to monitor, either manually or through automation, when a fish is placed in the correct position to have an image captured, this may result in inconsistent image captures. For example, a user may find it difficult to hold a fish stable while on a moving vessel (i.e. a fishing vessel) while also activating the imaging device 131. Additionally, a user may not be paying attention when the fish is placed in the correct position, taking a photo too early or too late, and potentially render the captured image unusable. If continuous recording takes place, this reduces u:\usersijr\AppUata\Koaming\Managc w orI\KecenirtunnOJVOVAU <IsnKecognition ysemnbpc iicaton as1110ca -o 5V asV( op in)u/ .1).aoCx-U SuZ I

-7

the possibility of this kind of error and allows a user or automated process to capture an optimum image of the fish. By way of an example, the imaging device 131 is a camera. A camera is a widely available and cost effective measure to facilitate capturing a single image or a continuous record of images.

[0042] In one example, when the imaging device 131 captures an image of the fish, the apparatus 100 emits a notification. This notification may be in the form of light (i.e. a light that temporarily flashes following capturing an image), a sound (i.e. a recognisable tone is emitted following capturing an image) a combination of a light and a sound etc. that would notify a user that an image of the fish has been captured so that the fish may be released from the apparatus.

[0043] In one example, the image of the fish is used to identify the fish, track the fish, perform image recognition to track the fish, perform image recognition using machine learning to track the fish, or the like.

[0044] In one example, the fish is a coral trout (Plectropomus Leopardus). Further, the fish can be identified by unique patterns on the side of the fish. Coral trout can be individually identified by the unique patterns on the side of each fish. By capturing an image of the side of a coral trout and analysing these unique patterns, each coral trout can be identified with a subsequently obtained image of the same coral trout. Conventional methods for identifying fish may require physically marking the fish or implanting a tracking device/tracking number onto individual fish. These methods may be defeated by harm coming to the fish (which thereby damages/removes the identifier given to the fish) and can be impractical to implement on a large scale (and even if implemented on a large scale could be environmentally destructive). Therefore, by identifying fish using the unique patterns on their sides, it circumvents the detriments associated with conventional identification/tracking methods.

[0045] In one example, the body 101 further includes an image display unit that incorporates the illumination source 132. Further, the image display unit may be magnetically mounted to the body. The image display unit may be a multifunction device (i.e. a smart phone) that can generate the illumination necessary to provide consistent lighting for the imaging device 131. The image display unit may further include a waterproof covering to protect the image display unit from water damage, if the image display unit is not waterproofed in another manner. The u:\usersrAppUaa\Koaming\ManageVw orI\KecenirK tunOJVOVAU IsnKecognitiongf ysl emnbpcinncaton as1mea1 -5ro5VasV(Zop in)u/ .1).aoCx-U PSuZ I

-8

image display unit may also record and transmit GPS data to assist in tracking the location of fish when they are caught and where they travel.

[0046] In one example, the fish to be imaged is caught using a fishing line and the fish to be imaged is removed from the fishing line such that the fish can be received into the channel 120. Further, the fish is received into the channel 120 by placing the fish into the opening 121. As previously discussed, the invention facilitates the consistency imaging of fish. As such, the channel 120 can received a plurality of fish through a line fishing system that catches fish from the ocean or other bodies of water. Additionally, by receiving the fish into the opening 121 (and subsequently releasing from the exit 122) from the fishing line reduces the facilities required to capture an image of the fish and thereby allows consistent imaging of the fish to take place while in adverse conditions (i.e. harsh wind or spray).

[0047] In one example, after the fish is released through the exit 122, the fish is released into a water storage vessel. Following capturing an image of the fish, the fish may be released depending on the purpose for capturing the fish. Where fish are to be further transported (for subsequent sale etc.), the fish may be released into a water storage vessel which enables their transport while keeping the fish alive. Alternatively, if the fish are to be released back into their natural habitat, the fish could be immediately released back into the water body they were initially captured from.

[0048] A further example of a method for capturing an image of a fish will now be described with reference to Figure 3.

[0049] At step 300, the fish is caught using a fishing line or a line fishing system. The use of a fishing line/line fishing system allows for the catching of a plurality of fish which can be imaged by the invention.

[0050] At step 310, the fish are removed from the fishing line/line fishing system. Before the invention can image the fish, they must first be removed such that they can be received in a channel of the body. Following the removal of the fish, at step 320, the fish are placed into an opening of the channel or directly into the channel. A person skilled in the art would appreciate that there may be additional steps in between step 310 and step 320. For example, during step

: Isersijr\AppUata\Koaming\ManageVw orI\KecenirK tunOJVOVAU IsnKecognition ysemnbpcinhncaon as10-5ro 5 O meInca - v inS ? /.I).aoCx-ZU PuSZ I

-9

310, fish may be caught using a fishing line/line fishing system attached to a fishing boat. Following their capture, the fish could be transferred to a holding tank on the fishing boat. Following storage, the fish could be transferred from their storage on the fishing boat into the holding tank of a motherboat.

[0051] Depending on the implementation of the invention, the opening of the channel can assist in funnelling the fish so that, at step 330, the fish is the correct position to enable capturing an image of the fish.

[0052] At step 340, an image of the fish is captured. This image is captured by an imaging device through a window separating the channel and cavity while the fish is positioned within the cavity.

[0053] At step 350, the fish is released into a water storage vessel. By releasing the fish into a water storage vessel, the fish can be transported to a subsequent location while keeping the fish alive.

[0054] An example of a fishing line system will be described with reference to Figure 4.

[0055] The fishing line system involves a boat 440 that includes a fishing line 450. A person skilled in the art would appreciate that a plurality of fishing lines 450 may be attached to the boat 440 depending on the implementation of the invention. The fishing line 450 includes a plurality of hooks 451 that can catch fish 452. A person skilled in the art would also appreciate that the fishing line 450 may only include a single hook 451.

[0056] The caught fish 452 can then be reeled back into the boat 440 where they can be retrieved and imaged by the apparatus. A person skilled in the art would appreciate that the invention may be used in additional applications, such as proving capture of certain fish (or other creatures) and ensuring the integrity of fishing competitions.

[0057] Throughout this specification and claims which follow, unless the context requires otherwise, the word "comprise", and variations such as "comprises" or "comprising", will be understood to imply the inclusion of a stated integer or group of integers or steps but not the u:\usersr\AppUaa\Koaming\Managc w orI\KecenrtunOJVOVAU <Isn Kecogntbon sysl emnbpcinncationaso 5 l as.Inca - SZUZI

- 10

exclusion of any other integer or group of integers. As used herein and unless otherwise stated, the term "approximately" means ±20%.

[0058] Persons skilled in the art will appreciate that numerous variations and modifications will become apparent. All such variations and modifications which become apparent to persons skilled in the art, should be considered to fall within the spirit and scope that the invention broadly appearing before described.

Claims

u:\usersrAppUaa\Koaming\ManageVw orI\KecenurKC vovaiOsVOV nKecognItionb ysemnbpcihncaton as mea0-3 o p inSu/.l.aOx-Z 9O5V /S/Zu I

- 11

THE CLAIMS DEFINING THE INVENTION ARE AS FOLLOWS: 1) An apparatus for imaging fish, the apparatus including a body having: a) a channel extending across the body from an opening to an exit, the opening being configured to receive a fish to be imaged and the exit being configured to allow the fish to be released from the channel; b) a cavity configured to contain an imaging device and an illumination source; and, c) a window separating the cavity and the channel so that the imaging device can capture an image of the fish through the window while the fish is positioned within the channel. 2) An apparatus according to claim 1, wherein the cavity is sealed such that the illumination source and the imaging device are at least partially protected from fluids. 3) An apparatus according to either claim1 or claim 2, wherein the imaging device continuously records images, and wherein the images are analysed to detect when a fish is positioned within the channel to thereby capture an image of the fish. 4) An apparatus according to any one of the preceding claims, wherein, when the imaging device captures an image of the fish, the apparatus emits a notification. ) An apparatus according to any one of the preceding claims, wherein the apparatus further includes one or more processing devices configured to provide instructions to at least one of: a) the imaging device; and, b) the illumination source. 6) An apparatus according to claim 5, wherein the one or more processing devices provide instructions through at least one of: a) a wired connection; and, b) a wireless connection. 7) An apparatus according to any one of the preceding claims, wherein the imaging device is a camera. 8) An apparatus according to any one of the preceding claims, wherein the image of the fish is used to at least one of: a) identify the fish; b) track the fish; c) perform image recognition to track the fish; and, d) perform image recognition using machine learning to track the fish.

u:\usersr\AppUaa\Koaming\ManageVw orI\KecenurK C vovaiOsVOV nKecognItionb ysemnbpcihncaton as mea0-3 o p inSu,5 9O5V .as.IO-ZU/SZUZ I

- 12

9) An apparatus according to any one of the preceding claims, wherein the fish is a coral trout. )An apparatus according to claim 9, wherein the fish can be identified by unique patterns on the side of the fish. 11)An apparatus according to any one of the preceding claims, wherein the body further includes an image display unit that incorporates the illumination source. 12)An apparatus according to claim 11, wherein the image display unit is magnetically mounted to the body. 13)A method for imaging fish, the method including: a) receiving a fish to be imaged into a channel, extending across a body from an opening to an exit, through the opening; b) positioning the fish into a cavity where the fish is illuminated by an illumination source; c) capturing an image of the fish through a window while the fish is positioned within the cavity with an imaging device; and, d) releasing the fish from the channel through the exit. 14)A method according to claim 13, wherein the fish to be imaged is: a) caught using a fishing line; and, b) removed from the fishing line such that the fish can be received into the channel. )A method according to either claim 13 or claim 14, wherein the fish is received into the channel by placing the fish into the opening. 16)A method according to any one of claims 13 to 15, wherein, after the fish is released through the exit, the fish is released into a water storage vessel.

1/5 2021106130

100 101 132 X

131

X 120 130 110

Fig. 1A

2/5 2021106130

100 101

122 121

120 110

Fig. 1B

3/5

Receiving a fish 200 2021106130

Positioning the fish 210

Capturing an image 220 of the fish

Releasing the fish 230

Fig. 2

4/5

Catching a fish using 300 a fishing line 2021106130

Removing the fish 310 from the fishing line

Placing a fish into a 320 channel

Positioning the fish 330

Capturing an image 340 of the fish

Releasing the fish 350 into a water vessel

Fig. 3

5/5 2021106130

440

451

450

452

Fig. 4